Presentation cloud meets big

30
1 © Copyright 2011 EMC Corporation. All rights reserved. Cloud Meets Big Data For VMware Environments <Phil King EMC Solutions are Powered by Intel ® Xeon ® Processor Technology

Transcript of Presentation cloud meets big

1 © Copyright 2011 EMC Corporation. All rights reserved.

Cloud Meets Big

Data For

VMware

Environments

<Phil King

EMC Solutions are Powered by

Intel® Xeon® Processor

Technology

2 © Copyright 2011 EMC Corporation. All rights reserved.

Cloud Meets Big Data

• Cloud Architecture And Mission Critical Applications – Oracle, Microsoft, SAP

• Big Data Impact On IT Infrastructure – Scale-Out vs. Scale-Up Computing

• VMware = The Core Platform For IT – Seamless Mobility And Control Across Applications

EMC Solutions are Powered by

Intel® Xeon® Processor

Technology

CLOUD COMPUTING

4 © Copyright 2011 EMC Corporation. All rights reserved.

Application Environments Historically Physical Infrastructure Limits Value

Challenges

Limits on Performance Different

environments

(prod/test/dev)

Physical silos of

servers and storage

Multiple software versions

Underutilized Hardware

Management Complexity

Complex Recovery

5 © Copyright 2011 EMC Corporation. All rights reserved.

Strong Momentum – Virtualizing Business Critical Applications

38%

53%

43%

25% 25%

18%

42%

67%

47%

34% 28% 28%

0%

10%

20%

30%

40%

50%

60%

70%

80%

MicrosoftExchange

MicrosoftSharePoint

Microsoft SQL OracleMiddleware

Oracle DB SAP

2010 2011

% Of Workload Instances Running on VMware

6 © Copyright 2011 EMC Corporation. All rights reserved.

Why Virtualize Applications? Cost Savings And Service Quality Improvement

14%

14%

19%

20%

20%

24%

14%

14%

14%

20%

17%

11%

65%

65%

64%

56%

60%

57%

7%

7%

3%

4%

4%

8%

Oracle enterprise apps

Custom enterprise apps

SQL database

SAP

MS Exchange

Oracle database

Cost savings Service improvement Both Neither

7 © Copyright 2011 EMC Corporation. All rights reserved.

Cloud – A New Architecture

Dedicated, Vertical Stacks

Old World – Physical New World – Virtual

Dynamic Pools Of

Compute & Storage

EMC Solutions are Powered by

Intel® Xeon® Processor

Technology

8 © Copyright 2011 EMC Corporation. All rights reserved.

vSphere

vFabric

vC

en

ter

Virtual Storage Requirements

vSphere

vFabric

vC

en

ter

Flash SATA

Automated Storage Tiering

VMware Integration

Cloud Infrastructure

Dynamic Pools Of

Compute & Storage

EMC Solutions are Powered by

Intel® Xeon® Processor

Technology

9 © Copyright 2011 EMC Corporation. All rights reserved.

The Performance Gap Challenge CPU Improves 100 Times Every Decade; HDD Remains Flat

100-times Improved

10,000-times Improved

2000 2010 2020

MOORE’S LAW:

100x PER

DECADE

CPU Continues To Improve

While Disk Drive

Performance Remains Flat

As A Result, Applications Will

Increasingly Suffer Unless

We Rapidly Move To Flash

FLASH

EMC Proven Solution are Powered

by Intel® Xeon® Processor

Technology

EMC Solutions are Powered by

Intel® Xeon® Processor

Technology

10 © Copyright 2011 EMC Corporation. All rights reserved.

Oracle server

Static Association Of Disk Groups To Applications

Based On Best Gues

Exchange server

SQL server

MANUAL PROCESS • FAST Cache continuously ensures

that the hottest data is served from high performance Flash SSDs

• FAST VP (Virtual Pools)* optimizes storage pools automatically, ensuring that active data is being served from SSDs, while cold data is moved to lower cost disk

• EMC Proven Solution Results:

– 150% more OLTP TPM

– 3X more users

– 80% faster tuning

– Powered by Intel® Xeon® Processor Technology

SSD NL-SAS

SAS

Dynamic, Self-Optimizing Storage Pools

Based On Actual Data Activity

Oracle Microsoft SAP

100% AUTOMATED

Flash And EMC FAST Automation

FAST Cache & FAST VP

Optimizes Production Application Environments

EMC Solutions are Powered by

Intel® Xeon® Processor

Technology

11 © Copyright 2011 EMC Corporation. All rights reserved.

EMC VFCache For Virtualized Server Performance

• Server Flash caching solution that uses intelligent caching software and PCIe Flash technology to reduce latency and increase throughput

• “Hottest” data accessed on the PCIe card in the server increasing performance

• EMC Proven Solution Results:

– 200% more TPM

– 60% decrease in latency

– 50% more IO serviced within 1 ms or less

– Powered by Intel® Xeon® Processor Technology

VFCache VFCache VFCache VFCache

Extends EMC FAST To The Server Layer

EMC Solutions are Powered by

Intel® Xeon® Processor

Technology

12 © Copyright 2011 EMC Corporation. All rights reserved.

Virtualized Production Applications

CLAL Insurance

• Doubled Oracle server

utilization from 15-20%

to nearly 50%

• Increased database

performance and mobility

with VMware

Synopsis

• SAP production

runtime increased

by 9x through FAST

• Database response

efficiency increased

470%

Vanderbilt

• Virtualized SQL Server

• FAST Cache deployed

• 78% of all I/O serviced

by just 1.6% EFD

13 © Copyright 2011 EMC Corporation. All rights reserved.

Maximize Application Quality of Service C

ap

ab

ility

Quality of Service

IMPOVE BACKUPS

Off-load backups to

dedicated storage device

Maintain use of native

backup management tools

De-Duplication

SIMPLIFY

REPLICATION

Snaps and clones for

recovery and multi-tasks

Server failover and

maintenance

Self-service for DBAs

Storage and Server

Replication

ACCELERATE

RECOVERY

Protect all application

tiers with one solution

Recover applications

to any point-in-time

locally or remotely

Application Recovery

EMC Solutions are Powered by

Intel® Xeon® Processor

Technology

14 © Copyright 2011 EMC Corporation. All rights reserved.

Deduplication Improves Backup Efficiency Perform More Full And Incremental Backups With Less Disk

Production

Dedupe &

Compress

EMC Data Domain DD800 Appliance

• Up to 50% faster backup

– Throughput of up to 26.3 TB/Hour

– Send only de-duped and compressed

data over network

– Ex: 40:1 de-dupe ratio reduces cost

• Improved recoverability

– Instant restore and rollback

– Extended online backup retention

• No changes to backup scripts,

processes or system architecture

Remote Site

EMC

Networker

DD Boost

EMC Solutions are Powered by

Intel® Xeon® Processor

Technology

15 © Copyright 2011 EMC Corporation. All rights reserved.

Simplify Data Replication

• Replicate data in minutes vs.

hours

– Clones for full, consistent recovery

– Snaps for space efficiency

– GUI interface enables DBA control

CloneDB

Snap or

Clone

CloneDB Clone

• Combined with VMware:

– Move workload within or across virtual

servers transparently

– Provision production or test/dev

servers in minutes vs. hours

– Perform maintenance on servers

without application downtime

Production

Server A Server B

Virtual Server Virtual Server

vMotion

EMC Solutions are Powered by

Intel® Xeon® Processor

Technology

16 © Copyright 2011 EMC Corporation. All rights reserved.

Virtualized Backup, Recovery, Deduplication

Washington Trust

• 95% de-duplication of backup

• 10:1 server consolidation

• New database deployment in

<1 hour

Swedbank

• 95% faster deployment of

test and development

• Deployed more Oracle

software on the same host

increases ROI

17 © Copyright 2011 EMC Corporation. All rights reserved.

Standardize Visibility And Control

End-to-end visibility and control across

physical and virtual environments

• Analyze SAN topologies and relationships

across your virtual and physical environment

• Monitor impact of FAST policies across all

virtualized application environments

• Monitor alerts and view properties for both

physical and virtual objects

• Track capacity consumption and perform

chargeback reporting C

ON

TR

OL

CE

NT

ER

: E

ND

-TO

-EN

D V

ISIB

ILIT

Y A

ND

CO

NT

RO

L SAN

VMware ESX Servers

Physical or Virtual Storage

VMware VMware VMware

Symmetrix VNX Third party

EMC Control Center

EMC Solutions are Powered by

Intel® Xeon® Processor

Technology

18 © Copyright 2011 EMC Corporation. All rights reserved.

EMC Virtual Storage Integrator (VSI) for VMware vSphere • VM Administrator Control OF VNX/VNXe

storage – Create VMFS datastores (iSCSI, FC, FCoE) – Create RDM Volumes (iSCSI, FC, FCoE) – Create NFS datastores – Configure FAST-VP Tiering Policies – Legacy support for Celerra and CLARiiON

• Clone virtual machines (VNX File) – Provision cloned VMs to VMware View – Refresh desktops in VMware View

• Compress virtual machines (VNX File) – Reduce the storage space for VMs through VNX File

Deduplication and Compression – Uncompress VMs on demand

Celerra

EMC Solutions are Powered by

Intel® Xeon® Processor

Technology

19 © Copyright 2011 EMC Corporation. All rights reserved.

Big Data

Impact On

Virtual

Infrastructure EMC Solutions are Powered by

Intel® Xeon® Processor

Technology

20 © Copyright 2011 EMC Corporation. All rights reserved.

Unstructured Data

New Big Data Applications

Clickstream

Analysis Genomics

Seismic

Exploration

Movie

Rendering

Social

Graphing

?

Enterprise Applications

VMAX VNX

Structured Data

Cloud Infrastructure Cloud Infrastructure

EMC Solutions are Powered by

Intel® Xeon® Processor

Technology

21 © Copyright 2011 EMC Corporation. All rights reserved.

Big Data In Enterprise Applications

Example Big Data

Sources

• Large Scale Test,

Development

• Large Home Directories

• Unstructured Data

Source: IDC

By 2012, 80% of all storage capacity sold will be for file-based

data

EMC Solutions are Powered by

Intel® Xeon® Processor

Technology

EMC Proven Solution are Powered

by Intel® Xeon® Processor

Technology

22 © Copyright 2011 EMC Corporation. All rights reserved.

Data goes global

23 © Copyright 2011 EMC Corporation. All rights reserved.

Pressure from new markets •5.9 billion mobile subscribers (87% of world) - 30% in China/India

•1.9 billion have smartphones

•1.2 billion use smartphones on the internet

•Forrester predict 2 billion PCs and laptops in use by 2013

•80 million ipads will be sold in 2012, accessing 300k apps

•Other viable devices include thin client terminals, most new internet

enabled TVs, Xboxes and playstations......

Current addressable market driven by c.4bn viable end point devices.

When VMware first launched VDI in 2005, they foresaw 500m viable end-

points by 2010.

24 © Copyright 2011 EMC Corporation. All rights reserved.

EMC Isilon.

Record Capacity.

Record Scalability.

Remarkable

Simplicity. EMC Solutions are Powered by

Intel® Xeon® Processor

Technology

25 © Copyright 2011 EMC Corporation. All rights reserved.

Isilon Single Volume Simplicity

EM

PT

Y

EM

PT

Y

EM

PT

Y

EM

PT

Y

EM

PT

Y

FU

LL

F

UL

L

FU

LL

F

UL

L

BA

LA

NC

ED

BA

LA

NC

E

D

BA

LA

NC

E

D

BA

LA

NC

ED

BA

LA

NC

E

D

Directories and files striped across nodes

in a single volume

60 sec

Upgrade

Seamless Scale-Out For VMware With Isilon Uneven Utilization/Complex To

Scale

Many Systems or 2-way clusters

Many File Systems and Volumes

Many Points of Management

EMC Solutions are Powered by

Intel® Xeon® Processor

Technology

26 © Copyright 2011 EMC Corporation. All rights reserved.

Unstructured Data

Big Data Applications Enterprise Applications

Structured Data

Big Data Storage For Big Data Applications

VMAX VNX Isilon

Cloud Infrastructure Cloud Infrastructure

EMC Proven Solution are Powered

by Intel® Xeon® Processor

Technology EMC Solutions are Powered by

Intel® Xeon® Processor

Technology

27 © Copyright 2011 EMC Corporation. All rights reserved.

Enterprise Applications

Next-Generation Cloud Infrastructure Big Data Applications

vM

otio

n

Fully Automated Storage Tiering (FAST)

Compute

Tier

Storage

Tier

Cloud Infrastructure

EMC Solutions are Powered by

Intel® Xeon® Processor

Technology

28 © Copyright 2011 EMC Corporation. All rights reserved.

Cloud Meets Big Data

• Cloud Architecture Is Ready For Mission Critical Apps – More Performance And Easier Management

• Big Data Requires New Approach To Infrastructure – Isilon = Scale Out Infrastructure Standard For Big Data

• VMware = Platform For Cloud + Big Data – Seamless Mobility And Control Across Applications

EMC Solutions are Powered by

Intel® Xeon® Processor

Technology

29 © Copyright 2011 EMC Corporation. All rights reserved.

THANK YOU