VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain...

64
Bhumik Patel Rakesh Radhakrishnan VMworld STO2524BU #VMworld #STO2524BU Turbocharge All Flash vSAN on Next Generation Hardware VMworld 2017 Content: Not for publication or distribution

Transcript of VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain...

Page 1: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Bhumik PatelRakesh Radhakrishnan

VMworld STO2524BU

#VMworld #STO2524BU

Turbocharge All Flash vSAN on Next Generation Hardware

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 2: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

• This presentation may contain product features that are currently under development.

• This overview of new technology represents no commitment from VMware to deliver these features in any generally available product.

• Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind.

• Technical feasibility and market demand will affect final delivery.

• Pricing and packaging for any new technologies or features discussed or presented have not been determined.

Disclaimer

2

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 3: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Agenda

1 All Flash vSAN Market Landscape

2 vSAN on New Hardware Platforms

3 Evolving vSAN Software for Emerging Flash Technologies

4 TECH PREVIEW: vSAN on Persistent Memory (NVDIMM) - DEMO

5 Summary + Q&A

3

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 4: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

All Flash vSAN Market Landscape

4

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 5: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

HCI is the Fastest Growing Storage Segment

Source: Wikibon Server SAN Research Project, 2016

Switch to efficient,

server economics

Extend simple server

management to storage

Unlock affordable

server-side flash

Hyperscale

HCI(Server SAN)

Traditional

Storage

2012 2026

0

$10B

$20B

$30B

$40B

$50B

Total Storage Market $60B

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 6: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Technology Trends

CPU densities

continue to

increase

Hi-Density Flash and

NVMe will dominate

Enterprise Storage

High speed

interconnect to keep

up with fast storage

Technology is Accelerating HCI Adoption

• All Flash Market is growing at a rapid rate – 38% CAGR over last 5 years

• Enterprise customers are adopting and moving away from using magnetic drives

• Newer high speed storage & network interconnects are enabling the HCI market.

• New hardware trends deliver All Flash vSAN at the best $/IOP & $/Gig

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 7: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Tiered Architecture: New Era of Storage Technologies

Future

• NAND Flash: the new Capacity tier

• High capacity NVMe

• Byte-addressable NVDIMMs

• Network latency >> Device Latency

Yesterday

• Low latency devices too

expensive for persistent storage

• Device latency >> Network

latency

IOPS

250K

500K

1M

750K

$/Gig

NVDIMM

DRAM DRAM

Increasing Price ->

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 8: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Evolution of Storage Hierarchy (projection for next 3-5 years)

8

• Application performance needs are

increasing requiring millions of IOPs and

nanosecond latencies

• Application needs are driving evolution of

next gen NVMe and storage class memory

(3D NAND)

• vSAN All-Flash is being architected to take

advantage of these faster devices for in-

memory metadata and caching

Note: IOPS and Latency numbers refer to “raw storage device”IOPS and latency

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 9: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

HCI Powered by VMware vSANRuns on any standard

x86 server

Pools SSDs/HDDs into

a shared datastore

Delivers enterprise-

grade security, scale and

performance

Managed through

per-VM storage policies

Deeply integrated with

the VMware stack

vSAN Storage

Managed by vCenter

vSphere vSAN

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 10: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

vSAN Adoption: 3x Faster Than The Market

Q114 Q214 Q314 Q414 Q115 Q215 Q315 Q415 Q116 Q216 Q316 Q416 Q118 Q218

vSAN Customer Adoption

10,000 Customers

More than top 3 competitors combined

150% YoY bookings growth

VMworld Speakers

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 11: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

vSAN – By Industry

RETAIL

AIRLINES EDUCATION

HEALTHCARE MANUFACTURING

MEDIA & TECHNOLOGY

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 12: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

vSAN – By Industry

GOVERNMENT / PUBLIC SECTOR

FINANCIAL SERVICES

CLOUD PROVIDERS

OIL, GAS & POWER

TELCO

PROFESSIONAL SERVICES

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 13: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Evolution of vSAN Workload Adoption

Business-Critical Apps Virtual Desktops (VDI)

VMware Cloudon AWS (VMC)

DR / DAManagement Clusters

Databases (SQL/Oracle)

Data Center on Wheels Containers

ROBOvSAN

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 14: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

vSAN Is Pervasive In the Data CenterWhat use cases are you currently using vSAN for?

Business critical applications and databases (SAP, MS SQL, Oracle, MySQL, etc.)

65%

44%Management infrastructure

32%Business continuity and

disaster recovery infrastructure

28%Virtual desktop infrastructure (VDI)

21%Intelligent edge and remoteoffice/branch office (ROBO)

Source: TechValidate survey of 316 users of VMware vSAN

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 15: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

vSAN on New Hardware Platforms

15

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 16: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

vSAN ReadyNode Landscape

308ReadyNodes

116Unique Server

Platforms

15OEM Server

Partners

2250Unique Drives

(NVMe, SSD, HDD)

&VMworld 2017 Content: N

ot for publicatio

n or distribution

Page 17: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Dell PowerEdge R740 with VMware vSAN

17

Ω

Dell PowerEdge R740

• Largest # of vSAN Ready Nodes

for Intel Xeon Scalable

Processors

• AF4, AF6, AF8

• General Purpose workhorse

optimized for workload acceleration

• Private Cloud, VDI

• R740xd for High PerformanceVMworld 2017 Content: N

ot for publicatio

n or distribution

Page 18: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Use Case

• VMware environment powering critical lines of business including manufacturing,

distribution, pharmacies, customer loyalty programs

• vSAN 3 Node Hybrid for ROBO across 1200 retail stores worldwide

• vSAN All-Flash for Tier-1 workloads like OLTP/SQL

• vSAN All-Flash for VDI (Full Clones)

• 32 All-Flash nodes split across 4 clusters managing 1.2 PB capacityAmerica’s largest supermarket chain runs Tier-1 Applications and worldwide ROBO infrastructure on vSAN

Challenges

• High cost of fiber-channel SAN

• Legacy 3-tier architecture made it difficult to adopt new technologies like NVMe

fast enough to remain competitive

Benefits

• 20% Lower Cost for All-Flash HCI with latest NVMe technology

• 10x reduction in footprint compared to traditional SAN

• Scalable, simple, fast ROBO solution – critical for driving customer satisfaction

and making retail stores competitive

• America’s largest supermarket chain by

revenue, second-largest general retailer, and

twenty-third largest company

• Fortune 500 Brand

Hardware Infrastructure

• Dell R730XD + Intel P3700 NVMe on 40G Network for Data Center Apps

• Lenovo System X servers for ROBOVMworld 2017 Content: Not fo

r publication or distri

bution

Page 19: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Use Case

• Run thousands of financial modeling & stock trading apps that require high IOPS &

sub-millisecond latency response times

• Applications require “consistent” sub- millisecond latencies in order to meet SLAs

“We want to standardize on “All NVMe

platforms” in our datacenter and vSAN on

Dell with P3700 is the right step to do that”

- IT Director

Leading Investment Banking Firm runs Stock Trading & Financial Apps on All Flash vSAN

Challenges

• Unable to meet SLAs for stock trading apps on traditional SAN

• Financial Applications were ”sluggish” due to high and inconsistent latencies on

traditional storage

• Traditional SAN was too expensive with low consolidation ratios for financial apps

Benefits

• SDDC Initiative to go 100% HCI was fulfilled by vSAN

• Early Adopters of vSAN All Flash over NVMe (Intel P3700) to benefit from

consistent and sub-millisecond response times and consistently high IOPS for

financial apps

• 30% cheaper than traditional storage

• Plan to move to “All NVMe Servers” soon

Hardware

• Dell Blades & Rack Servers with Intel P3700 NVMe managing up to 750TB

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 20: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

HCI Now Supports the Needs of All Workloads

10-20% vSAN Market; Emerging workloads expected to increase 3X in 2 years80% of vSAN Market

Storage

Dense

Compute

Intensive

Composable

Infrastructure

Archiving, video streaming,

analytics

Web apps, HPC, real time

analytics, In-memory DB

Data warehouses, Search engines

databases, Log aggregation

Rack Servers Blade Servers Composable Infrastructure

Dell – To be Announced

HPE – Apollo

Cisco – UCS S-series

Dell – FX2

HPE – Moonshot

Cisco – B-Series

Dell – To be Announced

HPE – Synergy

General

Purpose

Use cases BCA, Database, VDI,

ROBO, DR, Test/Dev

Hardware

TypeRack Servers

Supported

Hardware

Examples

Dell – R730XD

HPE – DL 380, 360

Cisco – UCS C-Series

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 21: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Use cases:

• Storage dense workloads such as as Big Data (Apache Hadoop), Log Aggregation (Splunk, Yarn etc), Cloud Native Applications (PCF) in this category.

• File servers e.g. Exchange, Sharepoint

• Object storage

Cisco S3260 with VMware vSAN = PetaBytes of storage

Server Node 2

Server Node 1

Server Node 4

Server Node 3

Up to 960 TB of Raw capacity across 2 S3260 Chassis

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 22: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Cisco UCS B-240 with VMware vSAN – Compute Intensive

22

Ω

Cisco UCS Ready Node

• Targets Compute Intensive

Workloads

• Total of 3 drive slots with B-240

M5 providing 7.6TB per node;

30.4TB on a 4-node cluster• Expect 2x-7x with AF space savings

features ranging from 60.8TB –

121.6TB on a 4-node cluster

• Suits workloads such as VDI,

BCA, Web Applications etc.

without moving to a rack mount

architecture

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 23: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

HPE Synergy is now certified for VMware vSAN - Composable

23

The first composable Infrastructure certified for vSAN

HPE Synergy—A perfect choice for vSAN

A core value prop of vSAN is that it aggregates all local storage disks—both SSD and HDD—

available on the hosts (compute modules) into a single data store shared by all compute modules.

With traditional rack servers, compute and storage do not generally scale independently, but with

HPE Synergy, you can scale storage and compute separately.

This makes it a perfect fit for vSAN solutions, allowing for storage capacity growth without

requiring additional compute resources to host them.

Key Benefits:

Disaggregated storage and compute

HPE Synergy with VMware vSAN provides the flexibility of thinly

provisioning software-defined storage volumes, independent of compute

resources.

Single infrastructure for any workload

HPE Synergy helps enterprises run vSAN in a single infrastructure,

addressing the needs of both traditional and emerging business applications.

High-Speed interconnect between frames

HPE Synergy provides a flat east-west Ethernet topology. This allows iSCSI

storage to be shared on a low-latency server-to-server connection,

including between HPE Synergy frames.

vSAN configuration details for our supported Ready Nodes visit the VMware vSAN Compatibility Guide for HPE

See why HPE Synergy is a winning vSAN solution in the VMware blog

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 24: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

vSAN deployment choices for HPE Synergy

24

No. of

Compute

Modules

Number of

Storage

Modules

Number of

drives in

storage

module

Number of

disk group

Disk group

layout

Type of

deployment

3 1 12 1 1 (SAS-

Cache) + 3

(SATA-

Capacity)

Entry level,

expandable

8 2 80 2 1 (SAS-

Cache) + 4

(SATA-

Capacity)

Storage dense

10 1 40 1 1 (SAS-

Cache) + 3

(SATA-

Capacity)

Compute

intenseVMworld 2017 Content: N

ot for publicatio

n or distribution

Page 25: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Intel Xeon Scalable Processors with VMware vSAN

25

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 26: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Intel Xeon Scalable Processors with vSAN

▪ Intel Xeon Scalable processor systems

– 30 - 50% performance improvement vs. last generation, up to 100% for some

workloads

– Nearly 2x vs. 3 year old systems

▪ Intel Solid-State storage technology enhancements

– NVMe access, NAND flash and 3D-NAND provide higher performance,

density at lower $ / GB

– New Optane storage provides significant performance for

critical applications and workload

▪ VMware vSAN 6.6

– 2.5x VMs per cluster when deployed together, with new Intel® Optane™

SSDs and server platforms

– Combine your vendor of choice with vSAN to extend, not replace, existing

virtualization efforts.

– Intel Select Solutions for VMware vSAN provide workload optimized solutions

26

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 27: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Iomark-VM-HC Benchmark Testing

• Testing Software

– IOmark-VM-HC - Storage specific workload and benchmark for HCI systems to measure storage performance

– Uses concept of workload replay & ‘application sets’

– IOmark-VM – VMmark 2.5 storage onlyworkload

• IOmark-VM-HC – Certifies supports for number of VM’s specified

• 8 IOmark-VM’s = 1 VMmark tile (8 vm’s per tile)

• Iomark-VM Application set

Application Guest OS Storage Capacity / Instance

Microsoft Exchange 2007 Microsoft Windows Server

2008, Enterprise, 64 bit

80 GB

Olio Database SuSE Linux Enterprise Server

11, 64bit

14 GB

Olio Web server SuSE Linux Enterprise 11,

64bit

80 GB

Idle Windows Server Microsoft Windows Server

2003 SP2 Enterprise Edition,

32-bit

10 GB

DVD Store Database SuSE Linux Enterprise 11,

64bit

45 GB

DVD Store Web Server 1 SuSE Linux Enterprise 11,

64bit

10 GB

DVD Store Web Server 2 SuSE Linux Enterprise 11,

64bit

10 GB

DVD Store Web Server 3 SuSE Linux Enterprise 11,

64bit

10 GB

Hypervisor Clone & Deploy N/A - VMware vCenter

required

15 GB

Hypervisor Storage

Migration

N/A - VMware vCenter

required

30 GB

-- -- Total = 305 GB

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 28: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

IOmark-VM Benchmark Testing

• Hardware

Hardware Features Value

Rack Footprint 8U (2U for per R2208WF system)

Number of Nodes 4 node cluster

Number of Drives per Node Cache: 2 Intel DC P4800x Optane / system = 8 total

Capacity: 4 Intel DC P4500 / system = 16 total

CPUs per system / total 2 CPUs (2.7GHz Intel 8168) per system @ 24

Hyperthreaded Cores each, for a total of 8 CPUs with

192 Hyperthreaded Cores for the cluster

Memory 768 GB / node => 3 TB for 4 node)

Networking Ports (1/10 GbE) 8 @ 10GbE Ports (2 Per Node)

28

• vSAN Configuration

vSAN Parameter Value

vSAN version 6.6

Disk groups 2 vSAN disk group per node

Total raw capacity of system under test (SUT)

29 TB (across all 4 nodes + dedupe enabled)

Each disk group used 2 x 2 TB Intel P4500 = 29 TB physical usable for 4 node cluster (capacity tier)

Thin provisioning: Yes

RAID Level(s) RAID 5, 1 (used for different workloads)

Total Cache Capacity: 3 TB (vSAN configuration dependent)

Write Cache: 750 GB / node Optane device (3.0 TB total)

Data Deduplication & Compression Enabled

Network 1 @ 10Gb Ethernet / node (vSAN interconnect)

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 29: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

More than 10x Performance w/ Latest HCI Technology on vSAN

29

80

288

480

800 800

1120

0

200

400

600

800

1000

1200

IOmark-VM’s

SSD + HDD

NVMe + SSD

All-NVMe

Optane + S3520

Optane + P4500

Optane + P4500( No Dedupe)

IOmark-VM Performance: 4-Node HC

Optane + NVMe1st Gen NVMeHybrid HCI

Hybrid HCI

1st Gen NVME

Optane + NVMe

Axis

La

be

l?

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 30: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

vSAN Database Results - TPC-C Profile

• Nearly 2X better performance and 2X lower price / performance

– 89% higher TPM Performance

– 44% lower cost per TPM

30

$0.05

4,828,595

9,116,024

-

1,000,000

2,000,000

3,000,000

4,000,000

5,000,000

6,000,000

7,000,000

8,000,000

9,000,000

10,000,000

Total TPM

Total TPM for 4-Node vSAN

P4600+P4500

Optane+P4500

$0.03

$-

$0.01

$0.01

$0.02

$0.02

$0.03

$0.03

$0.04

$0.04

$0.05

$0.05

$ / TPM HC

$ / TPM 4-Node vSAN

P4600+P4500

Optane+P4500

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 31: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Intel Optane Performance for vSAN 6.6

31

• 70%R 30%W Random 4K workload

• Two Disk Groups each consisting:

• 1x800GB Intel Optane DC P4800x

• 3x800 GB Samsung SAS SSDs

• Max 89.1K IOPS; Latency 6ms (R+W);

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 32: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Optane vs. SAS SSD - IOPS

0

10000

20000

30000

40000

50000

60000

70000

80000

90000

100000

SAS SSD Optane

IOPS

IOPS

32

1.5x IOPS with Optane vs SAS SSDs with 70/30 R:W ratios

with ~1ms latency

• Two Disk Groups with a total of:

• 2x400GB Intel Optane DC

P4800x

• 3x800 GB Samsung SAS SSDs

• 100GB working set per host

• Virtual SAN configured with Space

efficiency features disabled

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 33: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Evolving vSAN to Support Emerging Flash Technologies

33

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 34: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

March 2015

All Flash

64 Node Cluster

2x Hybrid Speed

Sep 2015

Stretched Cluster

5min RPO

2-node ROBO

March 2016

Deduplication

Compression

Quality of Service

vSAN 6.0 vSAN 6.1 vSAN 6.5

Accelerating Innovation

vSAN 5.5 vSAN 6.2

Nov 2016

iSCSI Support

2-Node Direct Connect

Large Capacity Drives

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 35: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Accelerating HCI Innovation

Native Security

Always-On Protection

Enhanced Stretched Clusters

Cloud Analytics

Intelligent Operations

Higher Performance

VUM Integration

ModernInfrastructure

6.6.x

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 36: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

vSAN Is Used For High Performance WorkloadsWhat applications do you run on vSAN today?

Microsoft SharePoint

Microsoft Exchange Server

Microsoft Applications

15%

26%

NoSQL databases (Cassandra, etc.)

Hadoop and other big data applications

NewUse Cases

9%

3%

Source: TechValidate survey of 316 users of VMware vSAN

Microsoft SQL Server

MySQL Databases

Oracle Databases

SAP

Databases

67%

38%

18%

7%

21%VMware Horizon

Citrix Xen Desktop

VDI

10%

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 37: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Typical Business Critical Applications on All Flash and Common Requirements

OLTP

Performance

Need consistent performance

Guarantee low latencies

Provide ease of scaling without overprovisioning

ScaleReduce planning and guesswork

Eliminate overprovisioning

Reduce disruption

AvailabilityMinimize downtime

Assure low RPO/RTO

Simplify maintenance/migration

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 38: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Turbocharging All Flash Performance –Software Enhancements in vSAN

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 39: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

vSAN 6.6 Offers 60% More Performance Than 6.5Improvements are greater as more data services are used

4 Node Cluster 2 Disk Groups/ Node – with Checksum, RAID-5, Deduplication & Compression Enabled

60% More IOPSwith checksum, RAID5 and data services enabled

And 40% latency improvement with checksum, RAID5 and data services enabled

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 40: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

vSAN Performance Enhancements – (vSAN 6.6 & 6.0U3)

40

1. Checksum Optimization:

• Improved checksum algorithms and optimizations to increase

performance on both read and write operations

2. Write buffer & Log Management optimizations:

• More efficient placement of data in write buffer & efficient

management of log entries

• Proactive destaging of data from cache to capacity reduces

impact on resync/rebuild and thereby reduce congestion

3. Deduplication and Compression improvements:

• New approach to ordering of data to be de-staged offers more

predictable performance, esp with sequential writes

4. Object management improvements:

• Efficient memory usage overhead and context switching of

cache and CPU making I/O delivery more efficient

5. Resync Rebuild Improvements

• Intelligent component selection & resync I/O throttling for

improved rebuild performance

vSphere vSAN

vSAN Datastore

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 41: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

All Flash vSAN 6.6 - small working set – 200GB per Host (All Features)

41

6.5 6.6 Improvement

IOPs IOPs IOPs %

100%

Random

Read354051 452896 27.9 %

100%

Random

Write67397 101993 51.3 %

70%

Random

Read134537 206501 53.5 %

100% SEQ

Read18923 18213 No change

100% SEQ

Write2890 3858 33.5 %

Configuration

• Working set size of 200GB per host for random

I/O

• Working set size of 400 GB per host for

sequential I/O

• Cache = 400GB /NVMe and capacity = 2.4TB

(SSD)

• 2 DG per host

• 4 hosts

• All random 4 KB

• All Sequential 256 KB

• 70/30, 4K, Random, All Features

• IOPs per DG = 26K

• Max DG = 3 (factoring in n/w CPU limits))

~ 80K IOPs per Host

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 42: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

All Flash vSAN 6.6 - Large working set – 1.7 TB per host (All Features)

42

6.5 6.6 Improvement

IOPs IOPs IOPs %

100%

Random

Read310301 373911 21 %

100%

Random

Write28443 35615 25 %

70%

Random

Read80362 131426 63.5%

100% SEQ

Read18921 18183 No change

100% SEQ

Write711 694 No Change

Configuration

• Working set size of 1680GB per host for

random I/O

• Working set size of 1680GB per host for

sequential I/O

• Cache = 400GB /NVMe and capacity = 2.4TB

(SSD)

• 2 DG per host

• 4 hosts

• All random 4 KB

• All Sequential 256 KB

• 70/30, 4K, Random, All Features

• IOPs per DG = 17K

• Max DG = 4 (factoring in N/W CPU

limits)), ~ 70K IOPs per Host

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 43: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

All Flash vSAN 6.6 Small Working Set – 70/30/4K/Random Comparison

43

6.5 6.6 Improvement 6.6 Comparative

IOPs IOPs IOPs % IOPs/DG Max DGTotal IOPs/Host

(6.5/6.6)

All Features 134537 206501 53.5% 26K 3 48K/80K

Checksum + R1 212534 368269 73% 46K 3 80K/138K

No Checksum 363502 406428 12% 50K 3 135K/150K

Comparison with different features turned on

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 44: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

All Flash vSAN 6.6 Large Working Set – 70/30/4K/Random Comparison

44

6.5 6.6 Improvement 6.6 Comparative

IOPs IOPs IOPs % IOPs/DG Max DGTotal IOPs/Host

(6.5/6.6)

All Features 80362 131426 63.5% 17K 4 40K/70K

Checksum + R5 119038 186074 56.3%% 23K 3 80K/138K

No Checksum 273372 316590 15% 40K 3 120K

Comparison with different features turned on

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 45: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Future of vSAN All Flash

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 46: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Next-Gen Storage Devices: Summary

46

Overview• Application performance needs are driving evolution of

fast storage such as NVMe & NVDIMM at a decreasing

price point.

• vSAN two tier architecture lacks parallelism & space

efficiency required to to take advantage of these fast

devices

• A single tier design is required for efficient use of

emerging devices like NVDIMMs for performance

oriented workloads.

Why do this?• Make NVMe more cost-effective for performance

oriented workloads

• Leapfrog competition by providing higher performance

& space efficiency with single tier design

• Enable NVDIMM as byte addressable to deliver

extremely high IOPS & micro-second latency for

performance sensitive apps

CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 47: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Enabling vSAN on Next-Gen Storage

vSAN 6.6Cross Cloud

6.5

1. Introduce parallelism in

deduplication to improve overall

performance

2. Make NVMe more cost-effective

for performance oriented workloads

1. Improve performance significantly by

removing 2 tier bottlenecks

2. Improve space efficiency with cache

devices contributing to capacity & better

deduplication with single tier

Enhance existing2 Tier

Introduce new single tier architecture

Support byte-addressable NVDIMM

2017

1. Enable byte addressable NVDIMM

2. Accelerate data services by moving

high touch metadata to NVDIMM

3. Deliver microsecond latencies & high

IOPS for performance sensitive apps

Phase 1 Phase 2 Phase 3

47

1. 6.6 and

6.0u3

performance

enhancement

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 48: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Phase 1: Deduplication Performance Enhancements in 2 tier

48

1. Reduced CPU scheduling overheads• Offload compression and hash calculations to helper threads.

• Reduces overall load on plog (context in which dedup runs) with less thrashing

• Makes dedup more streamlined and more performant.

2. Improved performance with "read ahead" • Elevator algorithm “reads ahead” next 512K blocks while dedup engine is

processing current 512K block for calculating hashes, compressing data etc

• Improves read latency with parallelization (without “read ahead” this is a

sequential operation waiting for the previous task to complete).

• CPU thrashing due to "Read ahead" is mitigated with dedup helper threads

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 49: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Phase 2: Introduce new Single Tier Architecture

49

1. Single tier architecture with all storage devices in a given node pooled together for capacity• Much simpler disk group construct (eliminate tiers)

• Can add faster and slower devices into one single tier

• Provide host level deduplication capability.

2. Highly parallelized architecture to achieve close to raw device bandwidth/IOPS

3. One disk failure doesn’t cause entire disk-groups to be rebuilt• Metadata will be redundantly saved on the local node.

• Only missing data will need to be rebuilt from other nodes

• Reduces re-sync & rebuild traffic, so less impact on both network and storage, enabling faster recovery

from failure.

4. Enable inline dedup/compression/checksum/encryption

5. Flexibility to turn on space efficiency on a per vmdk basis• Provide flexibility to customer for max performance vs space efficiency

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 50: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Phase 3: Support NVDIMM as byte addressable

Architecting vSAN with Persistent DIMMs

1File System purpose built for All Flash. NVDIMM supported as byte-addressable device

2

Optimized architecture for higher IOPS and better space efficiency –

a) Store metadata, reduce write amplification

b) Staging deduplication and compression, checksum tables

c) Provide faster data caching

3 Leverage Large Capacity SSDs more efficiently

4 Tune vSAN algorithms for higher efficiency and performance using NVDIMMs

5 Long Term: Enable NVDIMMs as persistent storage when the densities increase

1. Enable vSAN to take advantage of NVDIMM devices as byte addressable • In single tier mode to store high touch metadata

• Ultra high IOPS & micro second latencies for performance sensitive apps

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 51: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

TECH PREVIEW:vSAN on Persistent Memory - DEMO

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 52: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Demo Configuration

Profile for NVMe

CPU Intel ® Xeon® E5-2687W

v3 @ 3.10GHz 10 cores

/socket, HT

Caching Tier Intel P3700 NVMe

Capacity Tier Intel S3700 SATA SSD

52

Profile for NVDIMM

CPU Intel ® Xeon® E5-2687W

v3 @ 3.10GHz, 10 cores

/socket, HT

Caching

Tier

Persistent Memory

(NVDIMM)

Capacity

Tier

Intel S3700 SATA SSD

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 53: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Demo

53

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 54: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Summary

54

• Leverage vSAN for all workload types

1. Majority of vSAN deployments

are for business critical

applications

2. Next-gen H/W supports specific

use cases

3. Intel Optane provides boost to

your current vSAN implementation

• Turbocharge vSAN to meet your

performance needs

• Highly optimized for Intel Xeon

Scalable Processors & Optane

• Continuous improvements for

next-gen storage

• Future is here: NVDIMM on vSAN

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 55: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

55

Call to Action Slides

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 56: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

Nerd Out With These Key vSAN Activities at VMworld

#HitRefresh on your current data center and discover the possibilities!

Earn VMware digital badges to

showcase your skills

• New 2017 vSAN Specialist

Badge

• Education & Certification Lounge:

VM Village

• Certification Exam Center:

Jasmine EFG, Level 3

Become a

vSAN Specialist

Learn from self-paced and expert

led hands on labs

• vSAN Getting Started Workshop (Expert led)

• VxRail Getting Started (Self paced)

• Self-Paced lab available online 24x7

Practice with

Hands-on-Labs

Discover how to assess if your IT

is a good fit for HCI

• Four Seasons Willow Room/2nd floor

• Open from 11am – 5pm Sun, Mon, and Tue

• Learn more at Assessing & Sizing in STO1500BU

Visit SDDC

Assessment Lounge

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 57: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

3 Easy Ways to Learn More about vSAN

57

• Live at VMworld

• Practical learning of vSAN, VxRail and more

• 24x7 availability online– for free!

vSAN Sizer

vSAN Assessment

New vSAN Tools

• StorageHub.vmware.com

• Reference architectures, off-line demos and more

• Easy search function

• And More!

Storage Hub Technical Library Hands-On Lab

Test drive vSAN

for free today!

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 58: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

HOURS

Sunday, August 27th 1:00pm – 5:00pm Monday, August 28th 11:00pm – 5:00pmTuesday, August 29th 11:00am – 5:00pm

SDDC

ASSESSMENT

LOUNGE

Four Seasons HotelDesert Willow Room

vSphere Optimization Assessments (VOA)

Hybrid Cloud Assessment

Virtual Network Assessment

vSAN Assessment

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 59: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 60: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 61: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

HPE Scalable Persistent Memory

Ideal for:− Enabling in-memory compute with persistence, faster checkpoints

and restores, HTAP, software-defined storage caching tiers and any

workload that could benefit from low-latency DRAM-level performance

Key Features:− DRAM-level performance for fastest performing persistent memory

− Flexible capacity points with capacity up to 1TB

− Complete solution using DRAM for application performance, flash tier

for persistence and backup power for moving data to persistent store

− Up to 13x reduction in database restart time preserving maximum

uptime1

− Up to 27x faster checkpoint operations enabling significantly faster

business operations2

Learn more: https://www.hpe.com/info/persistentmemory

Fastest performing persistent memory at terabyte scale

HPE Scalable Persistent Memory is an integrated

storage solution that runs at memory speeds with

terabyte capacity unlocking new levels of performance

for your business workloads.

1 HPE Internal Labs test. HPE Scalable Persistent Memory, restarting 1TB Database with MSFT SQL Hekaton prototype is as fast as restarting 200GB database, September, 2016. Up to 20x with SAS SSDs.2 TPC-C Benchmark Throughput with Checkpoint (trans/sec). Calculated Time to Checkpoint and Restore a Docker Container running MySQL, compare Persistent Memory vs. SSD, March 31, 2017

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 62: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

HOURS

Sunday, August 27th 1:00pm – 5:00pm Monday, August 28th 11:00pm – 5:00pmTuesday, August 29th 11:00am – 5:00pm

SDDC

ASSESSMENT

LOUNGE

Four Seasons HotelDesert Willow Room

vSphere Optimization Assessments (VOA)

Hybrid Cloud Assessment

Virtual Network Assessment

vSAN Assessment

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 63: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 64: VMworld STO2524BU Turbocharge All Flash vSAN on Next ...€¦ · •This presentation may contain product features that are currently under development. • This overview of new technology

VMworld 2017 Content: Not fo

r publication or distri

bution