Big Data Solution Deployment Models - Neudesic · Deployment Models On Premise Deployment •...
Transcript of Big Data Solution Deployment Models - Neudesic · Deployment Models On Premise Deployment •...
© Copyright 2014, Neudesic. All rights reserved.
Big Data Solution Deployment Models
Presented By: Orion GebremedhinBI/Big Data Solution Partner , Neudesic LLC.
Data Platform VTSP, Microsoft Corp.
@OrionGM
© Copyright 2014, Neudesic. All rights reserved.
2
Deployment Models
On Premise Deployment• Microsoft Analytics Platform System (APS)
• Oracle Big Data Appliance
• Hortonworks Data Platform (HDP)
• Cloudera's CDH
• Pivotal Data Computing Appliance (DCA)
Big Data-as-a-Service• HDInsight
• Cloudera on AWS
• Amazon RedShift
• Amazon Elastic MapReduce
© Copyright 2014, Neudesic. All rights reserved.
3
HDInsight: Hadoop-as-a-Cloud Service
© Copyright 2014, Neudesic. All rights reserved.
4
HDFS
* A Modern Data Architecture with Apache Hadoop, Hortonworks Inc. 2014
© Copyright 2014, Neudesic. All rights reserved.
5
HDInsight Versions
© Copyright 2014, Neudesic. All rights reserved.
Architecting the Modern Data Warehouse
6
© Copyright 2014, Neudesic. All rights reserved.
7
The ETL Automation Model
* A Modern Data Architecture with Apache Hadoop, Hortonworks Inc. 2014
© Copyright 2014, Neudesic. All rights reserved.
8
The ETL Automation Model
© Copyright 2014, Neudesic. All rights reserved.
9
Iterative Exploration
© Copyright 2014, Neudesic. All rights reserved.
10
The Data Warehouse On-demand Model
© Copyright 2014, Neudesic. All rights reserved.
11
BI Integration Model
© Copyright 2014, Neudesic. All rights reserved.
12
Hybrid BI-Integration Model (Cloud)
Cube
Power BI
SSIS
ED
W
TabularE
SA
Direct Access/ Report Model Level Integration
Data Layer Level Integration
On-Demand-Compute
Cloud Storage
AZCopyPowerShell
© Copyright 2014, Neudesic. All rights reserved.
1313
Data Sources
Reporting & Analytics
Staging
Mainframes and proprietary data sources
Flat Files sourcesSQL Server
HDFS
Hadoop
Data Integration tool
Enterprise Data Models
EnterpriseStaging Area
EDW
EnterpriseData Warehouse
Charts and DashboardsReports
Oracle, DB2, etc
Self-Service BI(Excel Pivot Reports, etc)
Hybrid BI Integration Model (on-prem)
© Copyright 2014, Neudesic. All rights reserved.
Questions?Tom Marek
Twitter: @twmarek
Orion Gebremedhin
Twitter: @OrionGM