Job Profiles in Big Data - StackDataLabs

41
Job Profiles & Future Scope of Big Data Stack Data Labs - Immersive Training Provider

Transcript of Job Profiles in Big Data - StackDataLabs

Page 1: Job Profiles in Big Data - StackDataLabs

Job Profiles & Future Scope ofBig Data

Stack Data Labs - Immersive Training Provider

Page 2: Job Profiles in Big Data - StackDataLabs

Introduction

● In the past few years, there is an increase in job profiles in Big Data.

● Big data is hot and it's unlikely that this will change in the near future.

● Companies’ have increased their focus on acquiring Big Data talent with the creation of a whole new set of Big Data roles and titles.

Page 3: Job Profiles in Big Data - StackDataLabs

Trends in Big Data 2017

● Big Data becomes fast and approachable.

● Spark and Machine Learning light up big data.

● Convergence of IoT, Cloud and big data creates

new opportunities for self-service analytics.

Page 4: Job Profiles in Big Data - StackDataLabs

Trends in Big Data 2017 ● Self-service data prep becomes mainstream as end

users begin to shape big data.

● Big data no longer just Hadoop.

● Big Data grows up, Hadoop adds to Enterprise

standards.

Page 5: Job Profiles in Big Data - StackDataLabs

Job Profiles in Big Data

Page 6: Job Profiles in Big Data - StackDataLabs

Data Scientist● A data scientist is as rare as a unicorn and gets to

work every day with the mindset of a curious data wizard.

● He/she masters a whole range of skills and talents going from being able to handle the raw data, analyzing that data with the help of statistical techniques, to share his/her insights with his peers in a compelling way.

Page 7: Job Profiles in Big Data - StackDataLabs

Responsibilities of Data Scientist

● Selecting features, building and optimizing classifiers

using machine learning techniques

● Data mining using state-of-the-art methods

● Extending company’s data with third party sources of

information when needed

Page 8: Job Profiles in Big Data - StackDataLabs

Responsibilities of Data Scientist

● Enhancing data collection procedures to include

information that is relevant for building analytic

systems

● Processing, cleansing, and verifying the integrity of

data used for analysis

Page 9: Job Profiles in Big Data - StackDataLabs

Responsibilities of Data Scientist

Page 10: Job Profiles in Big Data - StackDataLabs

Data Analyst

● Just like the data scientist, the skills and talents that

are needed for this role are diverse and range the

entire spectrum of the data science process combined

with a healthy “figure-it-out” attitude. ● Languages like R, Python, SQL and C are elementary

to him/her.

Page 11: Job Profiles in Big Data - StackDataLabs

Responsibilities of Data Analyst

● Analytical Skills: Data analysts work with large

amounts of data.You will need to see the data and

analyze it to find conclusions.

● Communication Skills: Data analysts are often called

to present their findings, or translate the data into an

understandable document.

Page 12: Job Profiles in Big Data - StackDataLabs

Responsibilities of Data Analyst

● Critical Thinking: Data analysts must look at the

numbers, trends, and data and come to new

conclusions based on the findings.

● Attention to Detail: Data is precise. Data analysts have

to make sure they are vigilant in their analysis to come

to correct conclusions.

Page 13: Job Profiles in Big Data - StackDataLabs

Responsibilities of Data Analyst

Page 14: Job Profiles in Big Data - StackDataLabs

Data Engineer

● The data engineer often has a background in software

engineering and loves to play around with databases

and large –scale processing systems.● Every role is different, though, so some may require

more specialized knowledge in one of these areas

over the others.

Page 15: Job Profiles in Big Data - StackDataLabs

Responsibilities of Data Engineer

● Data Analysis: Are you a pro with MapReduce, Hadoop

or even data mining? In addition to processing data,

you may also need to know more specialized

techniques like machine learning or even statistical

analysis.

Page 16: Job Profiles in Big Data - StackDataLabs

Responsibilities of Data Engineer

● Data Warehousing: Are you familiar with large data

stores? Do you know how to get data in or take data

out?

● Data Transformation: Sometimes data needs to be

changed or transformed into a different format in order

to properly analyze it.

Page 17: Job Profiles in Big Data - StackDataLabs

Responsibilities of Data Engineer

● Data Collection: You have to crawl before you can

walk. Crawling the Web or extracting data from an

existing database or API are common chores for Big

Data engineers.

Page 18: Job Profiles in Big Data - StackDataLabs

Responsibilities of Data Engineer

Page 19: Job Profiles in Big Data - StackDataLabs

Database Administrator

● Database Administrator makes sure that the database

is available to all relevant users, is performing

properly and is being kept safe.● A Database Administrator makes sure that all backup

and recovery systems are in place, and keeps track of

the different technologies that are being used.

Page 20: Job Profiles in Big Data - StackDataLabs

● Implement, support and manage the corporate

database.

● Design and configure relational database objects.

● Are responsible for data integrity and availability.

● May design, deploy and monitor database servers.

● Design data distribution and data archiving solutions.

Responsibilities of Database Administrator

Page 21: Job Profiles in Big Data - StackDataLabs

● Ensure database security, including backups & disaster

recovery.

● Plan and implement application and data provisioning.

Responsibilities of Database Administrator

Page 22: Job Profiles in Big Data - StackDataLabs

Responsibilities of Database Administrator

Page 23: Job Profiles in Big Data - StackDataLabs

Data Architect

● The person in this role creates the blueprints for data

management systems to integrate, centralize, protect

and maintain the data sources.● The data architect masters technologies like Hive, Pig,

and Spark, and needs to be on top of every new

innovation in the industry.

Page 24: Job Profiles in Big Data - StackDataLabs

Responsibilities of Data Architect

● Determines database structural requirements by

analyzing client operations, applications, and

programming; reviewing objectives with clients;

evaluating current systems;

● Prepares users by conducting training.

Page 25: Job Profiles in Big Data - StackDataLabs

● Develops database solutions by designing proposed

system; defining database physical structure and

functional capabilities, security, backup, and recovery

specifications.

● Installs database systems by developing flowcharts.

Page 26: Job Profiles in Big Data - StackDataLabs

Responsibilities of Data Architect

Page 27: Job Profiles in Big Data - StackDataLabs

Data & Analytics Manager

● A data analytics manager steers the direction of the

data science team and makes sure the right priorities

are set.● This person combines strong technical skills with a

diverse set of technologies (SQL, R, SAS, …) with the

social skills required to manage a team.

Page 28: Job Profiles in Big Data - StackDataLabs

Responsibilities of Data & Analytics Manager

● Suggest an area for and methods of improving

operations.

● May collect and analyze external market data to

provide benchmarks for comparison purposes.

Page 29: Job Profiles in Big Data - StackDataLabs

Responsibilities of Data & Analytics Manager

● Demonstrates expertise in a variety of the field's

concepts, practices, and procedures.

● Presents reports to management for use in decision

making and strategic planning.

Page 30: Job Profiles in Big Data - StackDataLabs

Responsibilities of Data & Analytics Manager

Page 31: Job Profiles in Big Data - StackDataLabs

Business Analyst

● The business analyst is often a bit different from the

rest of the team.● While often less technically oriented, the business

analyst makes up for it with his/her deep knowledge of

the different business processes.

Page 32: Job Profiles in Big Data - StackDataLabs

Responsibilities of Business Analyst

● Assisting with the business case

● Planning and monitoring

● Eliciting requirements

● Requirements organization

● Translating and simplifying requirements

● Requirements management and communication

Page 33: Job Profiles in Big Data - StackDataLabs

Responsibilities of Business Analyst

Page 34: Job Profiles in Big Data - StackDataLabs

Statistician

● Although often forgotten or replaced by fancier

sounding job titles, the statistician represents what

the data science field stands for: getting useful

insights from data.● Statisticians can handle all sorts of data

Page 35: Job Profiles in Big Data - StackDataLabs

Statistician

● With his/her strong background in statistical theories

and methodologies, and a logical and stats oriented

mindset, he/she harvests the data and turns it into

information and knowledge

Page 36: Job Profiles in Big Data - StackDataLabs

Responsibilities of Statistician

● Apply statistical theories and methods to solve

practical problems in business, engineering, the

sciences, or other fields

● Decide what data are needed to answer specific

questions or problems

● Determine methods for finding or collecting data

Page 37: Job Profiles in Big Data - StackDataLabs

Responsibilities of Statistician

● Design surveys or experiments or opinion polls to

collect data

● Collect data or train others to do so

● Analyze and interpret data

● Report conclusions from their analysis

Page 38: Job Profiles in Big Data - StackDataLabs

Responsibilities of Statistician

Page 39: Job Profiles in Big Data - StackDataLabs

Why is Big Data the best career move?● Soaring Demand for Analytics Professionals

● Huge Job Opportunities & Meeting the Skill Gap

● Huge Salary Aspects

● Big Data Analytics: A Top Priority in a lot of

Organizations

● Adoption of Big Data Analytics is Growing

Page 40: Job Profiles in Big Data - StackDataLabs

Why is Big Data the best career move?● Analytics: A Key Factor in Decision Making

● The Rise of Unstructured and Semistructured Data

Analytics

● Big Data Analytics is Used Everywhere!