Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION...

36
Internal Use - Confidential

Transcript of Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION...

Page 1: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

Internal Use - Confidential

Page 2: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

Modernize Your Infrastructure

Ronnie Ng

Director, Systems Engineering SEA

Page 3: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

3

Internal Use - Confidential

Invest in cloud-native applications

TIME2000 2030

IT IN

VE

ST

ME

NT

S $

Traditionalapplications

“Invest” mode Digital transformation

“Optimize” mode IT transformation

Cloud-native applications

Dell - Internal Use - Confidential3

Page 4: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

4

Internal Use - Confidential

A modern data center requires IT transformation (M.A.T.)

Modernize infrastructure(Converged/hyper-converged)

Modern architecturesFlash

Scale-out

Software-defined

Cloud-enabled

Protected & trusted

Dell - Internal Use - Confidential4

Powered by Intel®

Xeon® Processors

Page 5: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

5

Internal Use - Confidential

Modernize infrastructure(Converged/hyper-converged)

Modern architecturesFlash

Scale-out

Software-defined

Cloud-enabled

Protected & trusted

Automate service delivery

Self-service experience

API driven M&O

at every level

Hybrid cloud

A modern data center requires IT transformation (M.A.T.)

Transform IT operations

People and process

Dell - Internal Use - Confidential5

Modernize infrastructure(Converged/hyper-converged)

Modern architecturesFlash

Scale-out

Software-defined

Cloud-enabled

Protected & trusted

Powered by Intel®

Xeon® Processors

Page 6: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

6

Internal Use - Confidential

Reduce costs (# of drives,

power, floor space, etc.)

Consistent and predictable

performance

Lower entry costs and

scale as you grow

Manage massive capacity

with fewer resources

Automated provisioning

and business agility

Flexible and programmable

data services leading to a

lower TCO

Policy driven service delivery

On/off premises data and/or

application mobility

Modernize data center requires modern architectures

Scale-out Software-definedCloud-enabledFlash

Dell - Internal Use - Confidential6

Protection and trustSecurity/governance | Data protection | Services/support

Page 7: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

7

Internal Use - Confidential

3-tier Data Center Architecture

Page 8: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

8

Internal Use - Confidential

#1 Leverage Flash Storage and Data Services

Page 9: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

9

Internal Use - Confidential

#1 Leverage Flash Storage and Data Services

Store more data

Reduce footprint in DC

Lower OpEx (Power/cooling)

Linear, predictable performance

Page 10: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

10

Internal Use - Confidential

ARCHITECTURE MATTERSDATA SERVICES

DELL EMC CONFIDNTIAL—INTERNAL USE ONLY

Inline

Deduplication

Inline

Compression

XVC

Virtual

CopiesIntegrated

Data Protection

D@REThin

Provisioning

Page 11: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

11

Internal Use - Confidential

#1 Leverage Flash Storage and Data Services

Eliminate brute force copy

Instant refresh of production data

Increased agility – unlimited copies, no performance penalty

Page 12: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

12

Internal Use - Confidential

UK FINANCIAL COMPANY DEV/TEST TCO SAVINGS= ~$3.7M

125TBEffective Capacity for 50 copies

ONLY4TBOF

= 31:1OVERALL REDUCTION

100Developers

SYSTEMS INFRASTRUCTURE

70% LESSFLOOR SPACE

40% MOREEffective Developers

Page 13: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

13

Internal Use - Confidential

#2 Optimize Data Protection, Leverage Cloud Storage

Page 14: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

14

Internal Use - Confidential

#2 Optimize Data Protection, Leverage Cloud Storage

Page 15: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

15

Internal Use - Confidential

#2 Optimize Data Protection, Leverage Cloud Storage

Page 16: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

16

Internal Use - Confidential

#2 Optimize Data Protection

Consolidate Backups to Data Domain

Content managementFile shares/serversVirtual machinesDatabases Enterprise applicationsE-mail servers

Backup Arch ive• Database

• Mainframe

• IBMi

• Big Data

• File/E-mail

• VMware

• File

• E-mail

• Big data

• Content management

• Storage tiering

• Database

• NAS

• ROBO

N E T W O R K

Disaster recovery Long-term retention

Page 17: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

18

Internal Use - Confidential

#2 Leverage Cloud Storage for Long Term Retention

Page 18: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

19

Internal Use - Confidential

#3 Deploy a Scale out Data Lake Strategy for Data Analytics

Page 19: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

20

Internal Use - Confidential

#3 Scale out Data Lake for Data Analytics

Page 20: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

21

Internal Use - Confidential

DATA MANAGEMENT CHALLENGE

Surveillance

Next-Gen Application

Hadoop & Analytics

Transaction

Logs

BLOBSSync & Share

Content

Shares

Marketing M&E

Social & Next-Gen

Archive &

Backup Target

Data Monetization

Design, Test

& Manufacture

Application Test

Home Directories & File Shares

Traditional Datacenter Workloads New Cloud Native Workloads

21 Dell - Internal Use - Confidential

Page 21: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

22

Internal Use - Confidential

DATA LAKE CONSOLIDATION

Home Directories & File SharesSurveillance

Next-Gen Application

Hadoop & Analytics

Transaction

Logs

BLOBSSync & Share

Content

Shares

Marketing M&E

Social & Next-Gen

Archive &

Backup Target

Data Monetization

Design, Test

& Manufacture

Application Test

22 Dell - Internal Use - Confidential

Page 22: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

23

Internal Use - Confidential

DATA LAKE CONSOLIDATION

Home Directories & File SharesSurveillance

Next-Gen Application

Hadoop & Analytics

Transaction

Logs

BLOBSSync & Share

Content

Shares

Marketing M&E

Social & Next-Gen

Archive &

Backup Target

Data Monetization

Design, Test

& Manufacture

Application Test

23 Dell - Internal Use - Confidential

Page 23: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

24

Internal Use - Confidential

DATA LAKE CONSOLIDATION

DATA LAKE

Home Directories & File SharesSurveillance

Next-Gen Application

Hadoop & Analytics

Transaction

Logs

BLOBSSync & Share

Content

Shares

Marketing M&E

Social & Next-Gen

Archive &

Backup Target

Data Monetization

Design, Test

& Manufacture

Application Test

24 Dell - Internal Use - Confidential

Page 24: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

Traditional Hadoop ArchitectureDirect Attached Storage (DAS)

HDFSfile

file

copy2

file

copy3node

info

file

node

infofile

copy2

file

copy3

file

node

info

file

copy2

file

copy3

file

node

infofile

copy2

file

copy3

Node

reply

Node

reply

Node

reply

Node

reply

node

reply

MAP

Reduce

MAP

Reduce

MAP

Reduce

MAP

Reduce

MAP

Reduce

node

infoMAP

Reduce

MAP

Reduce

MAP

Reduce

MAP

Reduce

Data

Compute

MAP

Reduce

MAP

Reduce

MAP

Reduce

MAP

Reduce

MAP

Reduce

MAP

Reduce

MAP

Reduce

MAP

Reduce

MAP

Reduce

Compute

Data

Name node

3X

NFS

Name node

Decision Support

Databases

Web Click

data

OLAP

EDW

HTTP

CIFS

FTP

NFS

Landing Zone Servers

Step 1:

Data is copied into the

Landing Zone

Step 2:

Data is copied into the

Cluster (3 times)Step 3:

Hadoop Jobs are run

Page 25: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

SIMPLIFY HADOOP ARCHITECTURE FOR FASTER TIME TO INSIGHT

NFS

Decision Support

Databases

Web Click

data

OLAP

EDW

Step 1:

Much or all of the Data lives on

the Isilon/Hadoop Cluster

node

info

node

info

node

infonode

info

MAP

Reduce

MAP

Reduce

MAP

Reduce

MAP

Reduce

name

node da

ta n

od

e

Isilon

name

node

name

node

name

node

Step 2:

Jobs are run

Hadoop Cluster

Apache

SMB, NFS,

HTTP, FTP,

HDFS

Page 26: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

27

Internal Use - Confidential

#4 Software Defined – Consolidate to increase agility

Page 27: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

28

Internal Use - Confidential

#4 CONSOLIDATE WITH SOFTWARE-DEFINED TO INCREASE AGILITY

Page 28: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

29

Internal Use - Confidential

DRIVER FOR HYPER CONVERGED PLATFORMS

Lower

TCO

Speed and

agility

Operational

simplicity

Scale

easily

HYPER-CONVERGED

Integrated storage & compute

Scale out efficiently

CAPEX and OPEX savings

Page 29: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

30

Internal Use - Confidential

FOCUS ON INNOVATION, NOT IT INTEGRATION

Page 30: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

31

Internal Use - Confidential

VxRail – HYPER CONVERGED INFRASTRUCTURE

VxRail 4.0

• Dell PowerEdge Servers

• Intel Broadwell Processors

• Addresses more use cases –

storage heavy, graphics

intensive, and ROBO

• 3-node entry point

• Engineered with Dell Servers &

VMware

WHAT’S NEW

Virtualized

environments

Virtual

desktops

Business

applications

Remote

office

Page 31: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

32

Internal Use - Confidential

VxRail – SOFTWARE DEFINED LIFECYCLE MGTLeverage your investment in VMware management and orchestration

Page 32: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

33

Internal Use - Confidential

In Summary

Page 33: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

34

Internal Use - Confidential

TraditionalWORKLOADS

Cloud-nativeWORKLOADS

Workloads are changing

34 Dell - Internal Use - Confidential

Page 34: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

35

Internal Use - Confidential

Traditional Cloud-native

IT centric

Client-server scale-up apps

Infrastructure resiliency

DevOps centric

Distributed scale-out apps

Application resiliency

Modern IT

IT Setup is changing

35 Dell - Internal Use - Confidential

Page 35: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop

• Leverage all-flash storage

• Optimize your data protection

• Deploy a scale-out data lake strategy

• Consolidate with software-defined/HCI

for business agility

Our offer

Modernize, Automate and Transform

with Dell EMC

36 Dell - Internal Use - Confidential

“Buy” resilient converged platforms

from Dell EMC to accelerate, “Build”

apps to differentiate

Page 36: Internal Use - Confidential · 2020-03-12 · Internal Use - Confidential DATA LAKE CONSOLIDATION DATA LAKE Surveillance Home Directories & File Shares Next-Gen Application Hadoop