PLEASE READ – INSTRUCTIONS FOR ADDING PAGE NUMBERS “X … · rdbms data lake (hadoop) machine...

Data Analytics

Nagesh Madhwal

Client Solutions Director, Consulting,

Southeast Asia, Dell EMC

3 Dell - Internal Use - Confidential

Next 15 yearsBusiness-centric

Cloud-Native Applications

Prescriptive Analytics

Agile Infrastructure

Internet of Everything

Last 15 yearsIT-centric

Traditional Applications

Traditional Analytics

Rigid Infrastructure

Internet


Evolution of Workloads

Your business must evolve.

Future success is achieved

by unlocking ALL DATA.


When it comes to Applications

and Data Analytics

TIME is everything.

Dell - Internal Use - Confidential7 of Y

The Power of “Now”

Business Event “Moment of Impact”

Data Captured

Intelligence Delivered

Decision Taken

Valu

e

Time

Real time Batch

Big Data

Opportunity Missed Opportunity “Too Late To Take Action”

Dell - Internal Use - Confidential8

Traditional Analytics

Limited to static data

Reactive and slow

Restricted sources and access


Traditional ..

Data Warehouse

Reporting

Source Systems

Files

Sources 1 to x

Batch Data SourcesExisting DBs, ERP

Staging Transform

ation

ETL Data Marts

Analytics


Traditional…

Data Warehouse

Reporting

Source Systems

Files

Sources 1 to x

Batch Data SourcesExisting DBs, ERP

Staging Transform

ation

ETL

Data Marts

Analytics

ETL

ETL

ODS


Modern Analytics

Analyze ALL data

Deliver anywhere, anytime analytics

Empower your end users


The Data Lake

12

ETL Offload | Analytics as a Service | Data Science | Decision Support |

Data Visualization | Executive Reporting | Predictive Modeling | Threat Analysis

Structured Unstructured

Managed using NoSQL

Static Schema

RDBMS/EDW

Dynamic Schema

Hadoop Eco Sys

file types: videos, pdf, ppt,

mp3, doc, email, pics

Managed using SQLdata types: numeric, currency,

alphabetic, name, date, address

Sources:

• ERP

• CRM

• SCM

• POS

Sources:

• Social

• IOT

• Text

• Geo

• Media

Use Cases /APPS

Kafka

BigSQLSqoop

Spark Streaming

Hive

FlumeImpala

HAWQ…

Application-Integrated Protocols


Modern Data Lake Environment

All Data

Fed Into

The

Data

Lake

HADOOP

DATA LAKE

ETL

- Exploratory, Ad Hoc

- Unpredictable Load

- Experimentation

- Loosely Governed

- Best Tools

- Production

- Predictable Load

- SLA Drive

- Heavily Governed

- Standard Tools

DWH

MPP

Analytics

Sandbox

Analytics / Sandbox Environment

Data Prep & Enrichment

ISILON SCALE OUT

NAS STORAGE

Foundation of your Data Management and Analytics

Architecture

Active Archive

BI / DWH Environment


Reference Architectures

DATA LAKE (HADOOP)RDBMS

MACHINE IOT

STATISTICAL MODELING/NLP EXPLORATION

TRANSFORM

BI

ORGANIZE MANAGE/CATALOG

DATA WAREHOUSESTREAMCEP

NEARREAL-TIME

MODELS MAY TAKE HOUR OR DAYSQUERIES MAY RETURN IN SECONDS OR MINUTES

SECONDS

SEARCH/INDEX

ENTERPRISE LOG ANALYSIS

APPLICATIONS

3rd PARTY

EMAIL

SOCIAL MEDIA SQL ON HADOOP

http://www.tpimagazine.com/siteimage/scale/800/600/353400.png

http://www.tpimagazine.com/siteimage/scale/800/600/353400.png

http://www.bizjournals.com/sanjose/blog/2012/06/san-joses-skytree-2-others-win-at.html?s=image_gallery

http://www.bizjournals.com/sanjose/blog/2012/06/san-joses-skytree-2-others-win-at.html?s=image_gallery

http://www.google.com/url?url=http://bigdatavendors.com/top.php&rct=j&frm=1&q=&esrc=s&sa=U&ei=G3U1VdaHDMueyATTk4GoDQ&ved=0CBgQ9QEwAQ&usg=AFQjCNGPF3lS-Cr1fgjnUGhiCaTZrf6Mqg

http://www.google.com/url?url=http://bigdatavendors.com/top.php&rct=j&frm=1&q=&esrc=s&sa=U&ei=G3U1VdaHDMueyATTk4GoDQ&ved=0CBgQ9QEwAQ&usg=AFQjCNGPF3lS-Cr1fgjnUGhiCaTZrf6Mqg

http://www.google.com/url?url=http://www.sitepoint.com/efficient-chinese-search-elasticsearch/&rct=j&frm=1&q=&esrc=s&sa=U&ei=UXU1Vf7EBI-gyQSz94CQAQ&ved=0CBoQ9QEwAQ&usg=AFQjCNFR3dtP-tI7IxXrTSGFmJdeJNe0Zg

http://www.google.com/url?url=http://www.sitepoint.com/efficient-chinese-search-elasticsearch/&rct=j&frm=1&q=&esrc=s&sa=U&ei=UXU1Vf7EBI-gyQSz94CQAQ&ved=0CBoQ9QEwAQ&usg=AFQjCNFR3dtP-tI7IxXrTSGFmJdeJNe0Zg

http://www.google.com/url?url=http://pixshark.com/kibana.htm&rct=j&frm=1&q=&esrc=s&sa=U&ei=i3U1Va7LNMWXyATCroDoAg&ved=0CBwQ9QEwAw&usg=AFQjCNG3dAT7sE9gEILc-jRnfJLwJUeXWQ

http://www.google.com/url?url=http://pixshark.com/kibana.htm&rct=j&frm=1&q=&esrc=s&sa=U&ei=i3U1Va7LNMWXyATCroDoAg&ved=0CBwQ9QEwAw&usg=AFQjCNG3dAT7sE9gEILc-jRnfJLwJUeXWQ

http://www.google.com/url?url=http://hortonworks.com/blog/the-future-of-apache-storm/&rct=j&frm=1&q=&esrc=s&sa=U&ei=gHY1VcLYC4mPyASYjoHQAQ&ved=0CBwQ9QEwAw&usg=AFQjCNHpG5A9AuTmKKwvOqilSl1ocMQmFQ

http://www.google.com/url?url=http://hortonworks.com/blog/the-future-of-apache-storm/&rct=j&frm=1&q=&esrc=s&sa=U&ei=gHY1VcLYC4mPyASYjoHQAQ&ved=0CBwQ9QEwAw&usg=AFQjCNHpG5A9AuTmKKwvOqilSl1ocMQmFQ

http://www.google.com/url?url=http://www.hadoopsphere.com/2015/03/hadoop-high-5-with-ibms-anjul-bhambhri.html&rct=j&frm=1&q=&esrc=s&sa=U&ei=mnY1VamjCI2uyATWooCIAw&ved=0CB4Q9QEwBA&usg=AFQjCNEwNc97BzzIMTHPvCy419nHjKOLhg

http://www.google.com/url?url=http://www.hadoopsphere.com/2015/03/hadoop-high-5-with-ibms-anjul-bhambhri.html&rct=j&frm=1&q=&esrc=s&sa=U&ei=mnY1VamjCI2uyATWooCIAw&ved=0CB4Q9QEwBA&usg=AFQjCNEwNc97BzzIMTHPvCy419nHjKOLhg

http://www.google.com/url?url=http://spark-summit.org/east&rct=j&frm=1&q=&esrc=s&sa=U&ei=0HY1VfipH4n2yQTt6YC4Aw&ved=0CBgQ9QEwAA&usg=AFQjCNG_COnNEYyI9VRZC4SyqIc9l96Mrg

http://www.google.com/url?url=http://spark-summit.org/east&rct=j&frm=1&q=&esrc=s&sa=U&ei=0HY1VfipH4n2yQTt6YC4Aw&ved=0CBgQ9QEwAA&usg=AFQjCNG_COnNEYyI9VRZC4SyqIc9l96Mrg

http://www.google.com/url?url=http://altaplana.com/clients.html&rct=j&frm=1&q=&esrc=s&sa=U&ei=-XY1VdXhJoKzyQTW_IGwCg&ved=0CBYQ9QEwAA&usg=AFQjCNF9_URNTrV0E64PWy3S79Ym5Rtw7A

http://www.google.com/url?url=http://altaplana.com/clients.html&rct=j&frm=1&q=&esrc=s&sa=U&ei=-XY1VdXhJoKzyQTW_IGwCg&ved=0CBYQ9QEwAA&usg=AFQjCNF9_URNTrV0E64PWy3S79Ym5Rtw7A

http://www.google.com/url?url=http://blog.virtualstoragezone.com/best-oracle-performance-xtremio/&rct=j&frm=1&q=&esrc=s&sa=U&ei=CZw3VfnmPOee7gakuYCQDg&ved=0CCgQ9QEwCQ&usg=AFQjCNEII-lplkxuQecYLyPTf50DzzXZKA


http://www.google.com/url?url=http://geekfluent.com/2014/07/08/emc-announces-next-generation-vmax-storage-array/&rct=j&frm=1&q=&esrc=s&sa=U&ei=Ypw3VeTvHuGa7gar3oGoDw&ved=0CCYQ9QEwCA&usg=AFQjCNH0YUtFUT3PERXHzTUjWrxEqdJWuw

http://www.google.com/url?url=http://geekfluent.com/2014/07/08/emc-announces-next-generation-vmax-storage-array/&rct=j&frm=1&q=&esrc=s&sa=U&ei=Ypw3VeTvHuGa7gar3oGoDw&ved=0CCYQ9QEwCA&usg=AFQjCNH0YUtFUT3PERXHzTUjWrxEqdJWuw

https://www.google.com/url?url=https://digitalpathologyassociation.org/2013-exhibitors-supporters&rct=j&frm=1&q=&esrc=s&sa=U&ei=ppw3VeuTC8rC7AaEvoHoBA&ved=0CBoQ9QEwAg&usg=AFQjCNHae1QfBoqnJPyxwFBeEU_R1_7efA

https://www.google.com/url?url=https://digitalpathologyassociation.org/2013-exhibitors-supporters&rct=j&frm=1&q=&esrc=s&sa=U&ei=ppw3VeuTC8rC7AaEvoHoBA&ved=0CBoQ9QEwAg&usg=AFQjCNHae1QfBoqnJPyxwFBeEU_R1_7efA

http://www.google.com/url?url=http://en.wikipedia.org/wiki/Greenplum&rct=j&frm=1&q=&esrc=s&sa=U&ei=MOs4VevPJJbfsASAmIHoBg&ved=0CDwQ9QEwEw&usg=AFQjCNEO7zx6us020SM17YnIuR5LKppk2Q

http://www.google.com/url?url=http://en.wikipedia.org/wiki/Greenplum&rct=j&frm=1&q=&esrc=s&sa=U&ei=MOs4VevPJJbfsASAmIHoBg&ved=0CDwQ9QEwEw&usg=AFQjCNEO7zx6us020SM17YnIuR5LKppk2Q

http://www.google.com/url?url=http://www.oracle.com/technetwork/database/exadata/overview/index.html&rct=j&frm=1&q=&esrc=s&sa=U&ei=hus4VeynIriKsQSF6oCAAg&ved=0CBYQ9QEwAA&usg=AFQjCNGNRS-bjm4SUXibEDLFk9H5RhmgHg

http://www.google.com/url?url=http://www.oracle.com/technetwork/database/exadata/overview/index.html&rct=j&frm=1&q=&esrc=s&sa=U&ei=hus4VeynIriKsQSF6oCAAg&ved=0CBYQ9QEwAA&usg=AFQjCNGNRS-bjm4SUXibEDLFk9H5RhmgHg

http://www.google.com/url?url=http://logo-kid.com/pivotal-hd-logo.htm&rct=j&frm=1&q=&esrc=s&sa=U&ei=n-w4VcvYB4y1sATO7YGoBg&ved=0CBYQ9QEwAA&usg=AFQjCNEeQD_s76YWxnq931MgAcQ-F4RZAg

http://www.google.com/url?url=http://logo-kid.com/pivotal-hd-logo.htm&rct=j&frm=1&q=&esrc=s&sa=U&ei=n-w4VcvYB4y1sATO7YGoBg&ved=0CBYQ9QEwAA&usg=AFQjCNEeQD_s76YWxnq931MgAcQ-F4RZAg

http://www.google.com/url?url=http://www.cloudera.com/content/cloudera/en/campaign/introducing-impala.html&rct=j&frm=1&q=&esrc=s&sa=U&ei=_e04VeSTLc61sATfrYHYCw&ved=0CBYQ9QEwAA&usg=AFQjCNF28VkVUrV07WSP2qs8S0vERAlC5w

http://www.google.com/url?url=http://www.cloudera.com/content/cloudera/en/campaign/introducing-impala.html&rct=j&frm=1&q=&esrc=s&sa=U&ei=_e04VeSTLc61sATfrYHYCw&ved=0CBYQ9QEwAA&usg=AFQjCNF28VkVUrV07WSP2qs8S0vERAlC5w

http://www.google.com/url?url=http://hortonworks.com/hadoop/hive/&rct=j&frm=1&q=&esrc=s&sa=U&ei=Oe44VbqmF-u1sATpnIBA&ved=0CBYQ9QEwAA&usg=AFQjCNGhlkNn-JB-ODmCFyT-65304tlSiA

http://www.google.com/url?url=http://hortonworks.com/hadoop/hive/&rct=j&frm=1&q=&esrc=s&sa=U&ei=Oe44VbqmF-u1sATpnIBA&ved=0CBYQ9QEwAA&usg=AFQjCNGhlkNn-JB-ODmCFyT-65304tlSiA

https://www.google.com/url?url=https://hadoopi.wordpress.com/2014/10/25/use-spark-sql-on-sql-developer/&rct=j&frm=1&q=&esrc=s&sa=U&ei=Ze44VeatNteHsQS3voDoBQ&ved=0CBYQ9QEwAA&usg=AFQjCNEZIaFwJhhkthDwP4wcHl-y_k5hQg

https://www.google.com/url?url=https://hadoopi.wordpress.com/2014/10/25/use-spark-sql-on-sql-developer/&rct=j&frm=1&q=&esrc=s&sa=U&ei=Ze44VeatNteHsQS3voDoBQ&ved=0CBYQ9QEwAA&usg=AFQjCNEZIaFwJhhkthDwP4wcHl-y_k5hQg

http://www.google.com/url?url=http://prestodb.io/&rct=j&frm=1&q=&esrc=s&sa=U&ei=Du84VYWhJuS1sAS8k4DgBQ&ved=0CBYQ9QEwAA&usg=AFQjCNHXjNHV9FjsbsPTTOXu6FbrKW-CTg

http://www.google.com/url?url=http://prestodb.io/&rct=j&frm=1&q=&esrc=s&sa=U&ei=Du84VYWhJuS1sAS8k4DgBQ&ved=0CBYQ9QEwAA&usg=AFQjCNHXjNHV9FjsbsPTTOXu6FbrKW-CTg



https://www.google.com/url?url=https://gigaom.com/2014/09/16/sql-on-hadoop-tech-apache-drill-is-ready-to-use-and-part-of-maprs-distro/&rct=j&frm=1&q=&esrc=s&sa=U&ei=c_E4Vaj7G6K1sATfh4HAAw&ved=0CBYQ9QEwAA&usg=AFQjCNHepqA2fhbLGHvLuT9n6-Yfe8PCiw

https://www.google.com/url?url=https://gigaom.com/2014/09/16/sql-on-hadoop-tech-apache-drill-is-ready-to-use-and-part-of-maprs-distro/&rct=j&frm=1&q=&esrc=s&sa=U&ei=c_E4Vaj7G6K1sATfh4HAAw&ved=0CBYQ9QEwAA&usg=AFQjCNHepqA2fhbLGHvLuT9n6-Yfe8PCiw


Big Data Journey To BDaaS

BDaaSAgility

Valu

e

Control

Prototyping

Dev/Test and Pre-Production Lifecycle Management

< 20 Nodes

Template Libraries, Shared Data Across Clusters, Rapid Prototyping and Evaluation

Dev / Test Lab

Multiple Hadoop Distros, Spark, Transient Workloads

Departmental

Hadoop and Spark in a Secure Production Environment

20+ Nodes

Performance, Security, Capacity Prioritization, Compute/ETL Offload,

Separate Compute/Storage

Dev/Test/Stage/QA/UAT

Improve Utilization, Scaling, Consistent Data

Big-Data-as-a-Service

Multi-Tenant Hadoop and Spark Deployment On/Off Premise

50+ Nodes

Multi-Tenancy, Self-Service, Logs, APIs, Tenant/Admin

Controls, Shared Data Lake with Access Controls

Heterogeneous Production Environments, Diverse Tenants

and User Groups

Support Multiple LOBs, Dynamic Resource

Management/QoS, Automation


Multi-Tenant Big-Data-as-a-Service

Multiple lines of business, multiple user

groups

Multiple use cases

Multiple ecosystem products

(including non-Hadoop, BI/ETL

tools)

Compute isolation between tenants

Multiple environments

per tenant

Multiple versions and/or

distributions

Data isolation by tenant (incl.

ability to physically isolate storage)

Data/Storage

Prod Dev/Test POC Prod Dev/Test

Data Isolation

Data Isolation

MARKETING R&D MANUFACTURING

360 Customer View Log Analysis Predictive Maintenance

MARKETING R&D MANUFACTURING

Shared, Centrally Managed Server Infrastructure

Compute Isolation

Compute Isolation


Analytics

Infrastructure

Integration

Range of solutions

44% of organizations still struggle with how to approach Big Data

S e r v i c e s


Data Analytics Journey


Big Data Systems

• VxRail

• VxRack

• Vblock

• XC Series


Big Data Foundations

• Servers

• Storage

• Networking

• Software


Big Data Solutions

• Reference Architectures

• Engineered Solutions

• Customized Designs


BUSINESS

TECHNOLOGY

DEPLOYASSESS PROVE

Big Data

Proof of Value

Big Data

Proof of

Technology

Big Data

Applied Analytics

Implementation

Big Data

Technology

Implementation

Big Data Vision

Workshop

Big Data Technology

Advisory

DELL EMC Big Data

Portfolio Implementation

Global Services

Dell - Internal Use - Confidential23 of Y

Subject Details

Workshop Objective To understand the key business initiatives and requirements for big data in order to understand where

and how to start the big data journey

Workshop Vision How to become data driven through the use of big data and analytics

Workshop Duration Half Day or 1 Day on customer site

Workshop Agenda 1) Business & IT Goals

2) Business Initiatives

3) Current Environment Review

4) Use Cases

5) Data Sources Review

6) Data Science / Analytics / BI Requirements

Recommended types of participants: IT and Business Users

Expected Outcomes 1) List of business opportunities and use cases

2) Business Value and Feasibility

3) Identify and prioritize data sources mapped with use cases

4) Prioritized used cases with potential business value and impediments

5) Document workshop results

6) Big Data Technology Roadmap with clear next steps

Next Step After Workshop Proof of Value (POV) or Proof of Technology (POT)

Dell EMC Workshop Team Head of Big Data Practice SEA, Head of Consulting SEA, Dell EMC Account / Sales Manager

Example of a Big Data Workshop


Customer Success Stories

PLEASE READ – INSTRUCTIONS FOR ADDING PAGE NUMBERS “X … · rdbms data lake (hadoop) machine...

Documents

Transcript of PLEASE READ – INSTRUCTIONS FOR ADDING PAGE NUMBERS “X … · rdbms data lake (hadoop) machine...