Cloud Computing and Big Data - Charles Fan

19
© 2009 VMware Inc. All rights reserved Confidential Cloud Computing and Big Data Charles Fan, SVPof R&D, VMware

description

Charles Fan, Senior VP of VMware gave the talk at CAISS Annual Conference 2012, as part of the panel discussion: Storage Component Technologies - Enable Big Data and Make Better Cloud Computing.

Transcript of Cloud Computing and Big Data - Charles Fan

Page 1: Cloud Computing and Big Data - Charles Fan

© 2009 VMware Inc. All rights reserved

Confidential

Cloud Computing and Big Data

Charles Fan, SVPof R&D, VMware

Page 2: Cloud Computing and Big Data - Charles Fan

2 Confidential

Two Fundamental Challenges

Lower

Operational

Costs

Increase

Revenue

Page 3: Cloud Computing and Big Data - Charles Fan

3 Confidential

Cloud

Computing

Two Fundamental Challenges

Page 4: Cloud Computing and Big Data - Charles Fan

4 Confidential

Waves Of Computing: Key Attributes

Processor Custom LSI Few/Shared RISC x86 Multicore

Architectur

e Monolithic

Clustered/Scale-

Up Virtualized Scale-Out

Storage Tape → Disk Disk Disk/Flash

Data

Model ISAM RDBMS

RDBMS, NoSQL,

Hadoop

Language COBOL C, C++, Java Java, Spring, Rails,

Node.js

Killer App Financial Systems

ERP, CRM, SCM Real Time Analytics

Cost $$$$$$ $$$ $

Mainframe/Mini Client/Server Cloud

Page 5: Cloud Computing and Big Data - Charles Fan

5 Confidential

A Different Perspective Required

Page 6: Cloud Computing and Big Data - Charles Fan

6 Confidential

VM Deployment Now Dominant

Represents All CPUs (x86, RISC, CISC, EPIC) Source: IDC Server Virtualization MCS, January 2012

0

5,000,000

10,000,000

15,000,000

20,000,000

25,000,000

2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015

Physical Hosts Virtualized Machines

The Tipping Point

Page 7: Cloud Computing and Big Data - Charles Fan

7 Confidential

Storage Servers Networking Security Management

The Software-Defined Data Center

Page 8: Cloud Computing and Big Data - Charles Fan

8 Confidential

File & Print Database ERP Big Data HPC

Silos In The Data Center

Email

Page 9: Cloud Computing and Big Data - Charles Fan

9 Confidential

The Software Defined Data Center

Security

&

Auto

ma

tion

File & Print Database ERP Big Data HPC Email

Cloud Operating System

Server

Storage

Network

Efficiency + Control + Choice = Greater IT Agility

Page 10: Cloud Computing and Big Data - Charles Fan

10 Confidential

Days / Hours

2012

Months / Weeks

2008

Minutes / Seconds

Future

Virtualized Physical Software Defined Data

Center

Page 11: Cloud Computing and Big Data - Charles Fan

11 Confidential

Lower

Operational

Costs

Increase

Revenue

Cloud

Computing

Two Fundamental Challenges

Page 12: Cloud Computing and Big Data - Charles Fan

12 Confidential

BIG DATA

Two Fundamental Challenges

Page 13: Cloud Computing and Big Data - Charles Fan

13 Confidential

Structured Information

In Relational Databases

Enterprise Information

Unstructured Information

5X

LARGER

GROWING

3X FASTER

Page 14: Cloud Computing and Big Data - Charles Fan

14 Confidential

External Information Sources

Structured Information

In Relational Databases

Unstructured Information

Partner Information

Telemetry, Location-Based Information etc.

“Public” Information

The Digital Universe Grows By 5,000 PB / Day

Page 15: Cloud Computing and Big Data - Charles Fan

15 Confidential

Energy

Big Data Transforms Business

Every Industry Will Feel Impact Of Real Time, Big Data Analytics

Healthcare Government Cyber Security

Insurance Financial Telecom Retail

Advertising Gaming

Page 16: Cloud Computing and Big Data - Charles Fan

16 Confidential

Performance

Cost

/ G

B

Flash Enables New Levels of Performance

FLASH SSD

DRAM DIMM

FC / SAS HDD

SATA / FAT

SAS HDD

Page 17: Cloud Computing and Big Data - Charles Fan

17 Confidential

Performance

Cost

/ G

B

Flash Enables New Levels of Performance

FLASH SSD

DRAM DIMM

Higher Cost

50X

Better

Performance

300X

FC / SAS HDD

SATA / FAT

SAS HDD

Higher Cost

200X

Better

Performance

4000X

Page 18: Cloud Computing and Big Data - Charles Fan

18 Confidential

In The Storage

Network

In The Server

Network

In The Server

All Flash Hybrid

Page 19: Cloud Computing and Big Data - Charles Fan

19 Confidential

Thank You