Big Data – From Strategy to Production

Post on 15-Apr-2017

449 views 2 download

Transcript of Big Data – From Strategy to Production

Big Data – From Strategy to ProductionMag. Mario Meir-HuberBig Data Leader CEE

2

• Big Data – Challenges

• How to get it right?

Agenda

3

Big Data - Challenges

4 © 2014 Teradata

When Algorithms go bad …

5 © 2014 Teradata

+ 5.99$ shipping costs

6

Big Data Technology Stack

Hadoop Ecosystem

Big Data Platforms

Data Ingestion

AndProcessing

EfficiencyTrust

WorkloadGovernance

ToolsPlatform

ProgrammingParallel

Big Data Analytics

Data Science

Transformquestion

toalgorithm

Machine LearningAnalysis

IntegrationQuery

PerformanceTransform

Warehousing

Big Data Utilization

DomainExpertise

Asking theright

question

Reporting & Dashboards

Alerting & Recommend

ationsBusiness

IntelligenceText Analysis and Search

24/09/2015 6

DataCenters

Big Data Management

Scalable Data

Storage

IaaSCloud

VirtualizationNetwork

ComputeStorage

DBMSNoSQL

Man

agem

ent

Secu

rity

Pr

ivac

y

Gov

erna

nce

Data

Value

7

BIG  DATA  IS  NOT  JUST  A  SINGLETECHNOLOGY

8

BI/DWH Projects vs. Big Data Projects

$Xm

$Xm

$Xm

Release 1

Release 2

Release 3

3MAR

5MAY

7JUL

9SEP

11NOV

13JAN

15MAR

17MAY

19JUL

21SEP

23NOV

3MAR

5MAY

7JUL

9SEP

11NOV

13JAN

15MAR

17MAY

19JUL

21SEP

23NOV

BI/DWH Projects• Highly Planned & Controlled

• Slow Release Schedule

• 3x releases 2 years

• High Central funding cost

• Low Risk / High Success

Big Data Projects• Small Iterative Projects

• 40+ Discoveries / 2 years

• Low cost per project

• $20k-$50k per project

• BAU funded initiatives

• Project funded

• Central discovery team / BIU for free thinking

• High Risk / High Fail

• Iterates to a new project

40+ Projects over 2 years

3 Releases Over 2 years

9

BIG  DATA  IS  NOT  JUST  A

USE  CASE

10

BIG  DATA  IS  AMOVEMENTMORE  ANALYTICSON  ALL  YOUR  DATA

11

Big Data – IT business alignment

Provide a business strategyInvolve all business departments

Prioritize projects and build a roadmapExecute

Provide a technology roadmapAnalyze necessary technologies

Implement a Big Data platform (Data Lake)

Execute projects

12

BIG  DATA  NEEDS  THE  

BUSINESS

13

How to get it right?

1414 © 2014 Teradata