Big Data Solution Deployment Models - Neudesic · Deployment Models On Premise Deployment •...

14
© Copyright 2014, Neudesic. All rights reserved. Big Data Solution Deployment Models Presented By: Orion Gebremedhin BI/Big Data Solution Partner , Neudesic LLC. Data Platform VTSP, Microsoft Corp. @OrionGM

Transcript of Big Data Solution Deployment Models - Neudesic · Deployment Models On Premise Deployment •...

Page 1: Big Data Solution Deployment Models - Neudesic · Deployment Models On Premise Deployment • Microsoft Analytics Platform System (APS) • Oracle Big Data Appliance • Hortonworks

© Copyright 2014, Neudesic. All rights reserved.

Big Data Solution Deployment Models

Presented By: Orion GebremedhinBI/Big Data Solution Partner , Neudesic LLC.

Data Platform VTSP, Microsoft Corp.

@OrionGM

Page 2: Big Data Solution Deployment Models - Neudesic · Deployment Models On Premise Deployment • Microsoft Analytics Platform System (APS) • Oracle Big Data Appliance • Hortonworks

© Copyright 2014, Neudesic. All rights reserved.

2

Deployment Models

On Premise Deployment• Microsoft Analytics Platform System (APS)

• Oracle Big Data Appliance

• Hortonworks Data Platform (HDP)

• Cloudera's CDH

• Pivotal Data Computing Appliance (DCA)

Big Data-as-a-Service• HDInsight

• Cloudera on AWS

• Amazon RedShift

• Amazon Elastic MapReduce

Page 3: Big Data Solution Deployment Models - Neudesic · Deployment Models On Premise Deployment • Microsoft Analytics Platform System (APS) • Oracle Big Data Appliance • Hortonworks

© Copyright 2014, Neudesic. All rights reserved.

3

HDInsight: Hadoop-as-a-Cloud Service

Page 4: Big Data Solution Deployment Models - Neudesic · Deployment Models On Premise Deployment • Microsoft Analytics Platform System (APS) • Oracle Big Data Appliance • Hortonworks

© Copyright 2014, Neudesic. All rights reserved.

4

HDFS

* A Modern Data Architecture with Apache Hadoop, Hortonworks Inc. 2014

Page 5: Big Data Solution Deployment Models - Neudesic · Deployment Models On Premise Deployment • Microsoft Analytics Platform System (APS) • Oracle Big Data Appliance • Hortonworks

© Copyright 2014, Neudesic. All rights reserved.

5

HDInsight Versions

Page 6: Big Data Solution Deployment Models - Neudesic · Deployment Models On Premise Deployment • Microsoft Analytics Platform System (APS) • Oracle Big Data Appliance • Hortonworks

© Copyright 2014, Neudesic. All rights reserved.

Architecting the Modern Data Warehouse

6

Page 7: Big Data Solution Deployment Models - Neudesic · Deployment Models On Premise Deployment • Microsoft Analytics Platform System (APS) • Oracle Big Data Appliance • Hortonworks

© Copyright 2014, Neudesic. All rights reserved.

7

The ETL Automation Model

* A Modern Data Architecture with Apache Hadoop, Hortonworks Inc. 2014

Page 8: Big Data Solution Deployment Models - Neudesic · Deployment Models On Premise Deployment • Microsoft Analytics Platform System (APS) • Oracle Big Data Appliance • Hortonworks

© Copyright 2014, Neudesic. All rights reserved.

8

The ETL Automation Model

Page 9: Big Data Solution Deployment Models - Neudesic · Deployment Models On Premise Deployment • Microsoft Analytics Platform System (APS) • Oracle Big Data Appliance • Hortonworks

© Copyright 2014, Neudesic. All rights reserved.

9

Iterative Exploration

Page 10: Big Data Solution Deployment Models - Neudesic · Deployment Models On Premise Deployment • Microsoft Analytics Platform System (APS) • Oracle Big Data Appliance • Hortonworks

© Copyright 2014, Neudesic. All rights reserved.

10

The Data Warehouse On-demand Model

Page 11: Big Data Solution Deployment Models - Neudesic · Deployment Models On Premise Deployment • Microsoft Analytics Platform System (APS) • Oracle Big Data Appliance • Hortonworks

© Copyright 2014, Neudesic. All rights reserved.

11

BI Integration Model

Page 12: Big Data Solution Deployment Models - Neudesic · Deployment Models On Premise Deployment • Microsoft Analytics Platform System (APS) • Oracle Big Data Appliance • Hortonworks

© Copyright 2014, Neudesic. All rights reserved.

12

Hybrid BI-Integration Model (Cloud)

Cube

Power BI

SSIS

ED

W

TabularE

SA

Direct Access/ Report Model Level Integration

Data Layer Level Integration

On-Demand-Compute

Cloud Storage

AZCopyPowerShell

Page 13: Big Data Solution Deployment Models - Neudesic · Deployment Models On Premise Deployment • Microsoft Analytics Platform System (APS) • Oracle Big Data Appliance • Hortonworks

© Copyright 2014, Neudesic. All rights reserved.

1313

Data Sources

Reporting & Analytics

Staging

Mainframes and proprietary data sources

Flat Files sourcesSQL Server

HDFS

Hadoop

Data Integration tool

Enterprise Data Models

EnterpriseStaging Area

EDW

EnterpriseData Warehouse

Charts and DashboardsReports

Oracle, DB2, etc

Self-Service BI(Excel Pivot Reports, etc)

Hybrid BI Integration Model (on-prem)

Page 14: Big Data Solution Deployment Models - Neudesic · Deployment Models On Premise Deployment • Microsoft Analytics Platform System (APS) • Oracle Big Data Appliance • Hortonworks

© Copyright 2014, Neudesic. All rights reserved.

Questions?Tom Marek

[email protected]

Twitter: @twmarek

Orion Gebremedhin

[email protected]

Twitter: @OrionGM