© 2011 VMware Inc. All rights reserved Confidential VMware and Cinder Alex Jauch, Product Line...

© 2011 VMware Inc. All rights reserved

Confidential

VMware and Cinder

Alex Jauch, Product Line Manager (@ajauch)

Kartik Bommepally, MTS (Cinder Driver Team)

2 Confidential – Not for External Distribution

OpenStack on VMware


VMware Vision: Software Defined Storage

Software Defined Storage

Software-Defined Storage Vision

Enable new storage tiersEnable DAS & server flash for shared storage along with enterprise SAN/NAS

Enable tight integration with storage ecosystemTighter integrations with broad storage ecosystem through APIs

Deliver policy-based automated storage managementAutomatically enforce per-VM SLAs for all apps across different types of storage

“Gold” Array(s)

“Silver” Array(s)

Distributed Storage

Hard disks

SSD Hard disks

SSD

Availability = 99.99%

DR RTO = 1

“Gold” SLA

Availability = 99%Throughput = 1000 R/s, 20 W/sLatency = 95% under 5 msDR RPO = 1’, RTO = 10’Back up = hourlyCapacity res = 100%

Web Server

Database Server


DR RTO = 1 hour

Max Laten

“Bronze” SLA

Availability = 99%Throughput = 100 R/s,10 W/sLatency = 90% under 10 msDR RPO = 60’, RTO = 360’Back up = weeklySecurity = encryption

Red

uce

Sto

rag

e C

ost

an

d C

om

ple

xity

App Server


Virtual SAN (VSAN)

What is Virtual SAN? Key Features

Converged compute + storage solution

Utilizes DAS and server attached disks

Auto-tiering between SSD and HDD

Intelligent policy driven data placement across the cluster

vCenter-integrated, instant storage provisioning

High performance storage at up to 50% lower cost

Radically Simple Storage – configure and manage without complex workflows

Designed for dynamic scalability and high resiliency

Clusters internal server disks to provide scalable shared storage with

cloud agility and efficiency.

Customer Benefits

vSphere

Virtual SAN

Hard disks

SSD

…………….

Hard disks

SSD Hard disks

SSD

Distributed Storage

Aggregated Datastore

vCenter Server


vSphere

Virtual Volumes

What are Virtual Volumes? Key Features

Existing SAN/NAS systems become VM-aware

Native representation of VMDKs on SAN/NAS

New API for data operations at VMDK granularity

Native representation of VMDKs on storage

Snapshots, replications and other operations at VM granularity on external storage

Works with existing SAN/NAS storage systems

VM level storage SLA enforcement

Current Paradigm

VMDKs on LUNs

LUNs replicated

Virtual Volumes

vSphere

VMDKs on storage systems

VMDK replicated

Customer Benefits

Broad partner ecosystem


What is Policy-based Management?

Storage Policy Based Management (SPBM)

• Simple policies to specify app SLA requirements

• Automation of storage provisioning and VM placement across clusters

• Works for any protocol : block, file and object

• SLA Compliance monitoring & automatic remediation

Key Features

• Drastically simplify storage provisioning

• Management of different storage tiers as one

• Reduce storage cost by optimizing consumption

Software Defined Storage

Enterprise SAN/ NAS

Virtual SAN BLOB Storage


DR RTO = 1 hour

Max Laten

SLA Definitions

Availability = 99.99%DR RTO = 1 hourBack up = dailyStorage capacity = 1 TBPerformance = High I/OSecurity = High


DR RTO = 1 hour

Max Laten

SLA Definitions

Availability = 99%DR RTO = 4 hourBack up = weeklyStorage capacity = 10 TBPerformance = High I/OSecurity = High

Customer Benefits


The Basics: Storage Abstraction in vSphere

The Datastore is the fundamental persistence abstraction.

The VMDK is the Disk abstraction

Storage Policy Based Management (SPBM) is the Control Plane

VMware is Moving Away from LUN based policy and towards VMDK based policy

• For Local Storage, this is done via VSAN

• For Shared Storage, this is done via VVOL

VMware is Moving Away from Raw Device Map (RDM) Disks

Thus, a VMDK Driver for Cinder


Cinder VMDK Driver Work Flow

As with Nova, vSphere Admin Sets Up Capacity Pools

• For Storage this Means Datastores in Havana

• For Icehouse, this will include SPBM

Cloud Admin Creates Cinder Volume Types

• Volume Type is our MetaData Injection Vehicle

Consumer Creates New Cinder Volume

• This Allows us to create meta data

Consumer Attaches Cinder Volume

• We Lazy Create the VMDK Based on VM Target

• VMDK Is Mounted By vSphere Against Target


Volume types and extra specs

Driver allows additional configuration for volume creation via extra specs in the volume type

VMDK type

• Use extra spec key ‘vmware:vmdk_type’

• Legal Values: ‘thin’, ‘thick’ and ‘eagerZeroedThick’

• Default type is ‘thin’

Clone type

• Use extra spec key ‘vmware:clone_type’

• Legal Values: ‘full’ and ‘linked’

• Default type is ‘full’


What the Heck is a “Shadow” VM?

In vSphere There is No “First Class Disk” Object. Yet.

When You Create a VMDK It Must be the Child of a VM

However, Cinder Assumes a First Class Disk

Therefore, A “Shadow” VM is inserted

<<<KARTIK, INSERT SCREEN SHOT HERE OF SHADOW VM>>>


DEMOVMware VMDK Driver for Cinder


Current API Support

Create volume

• Supported VMDK types – thin, thick, eagerZeroedThick

• From scratch

• From glance image

• From an available source volume – full clone and linked clone

• From a snapshot – full clone and linked clone

Attach volume to an instance

Detach volume from an instance

Snapshot an available volume

Delete snapshot of an available volume

Upload an available volume as glance image

Delete volume


Committed Roadmap

Support for Storage Policy Based Management (SPBM)

Fix for SnapShot/Clone Issues with Attached Volumes

Move Core Storage Code into Oslo

Implement Remaining API Items

Incorporate Additional Icehouse APIs

Nova Support for SPBM


Thoughts Beyond Icehouse

Common Meta Data Model Between Cinder and Nova

Support For Application Consistent Snapshots

DR/HA Considerations in Cinder

• How Do we Abstract Availability Zones?

Storage QOS

• How Do We Represent Performance Contracts?

Inter DC Data Mobility Services

Alerting/Policy Violation Support, Ceilometer?

Others?


DemoVMware vSphere

on OpenStackby Scott Lowe

Location: Sponsor Demo Theatre

Date: Wed @ 2 PM

General SessionNavigating the Transition to

Network Virtualization

With Martin Casado

Location: Asia World – Summit Hall 2

Date: Tues @ 12:05 PM

http://vmware.com/go/openstack Day Time Room Title Speaker

Tuesday 2:50 PM

Sky City Marriott - Grand Ballroom C

User Panel: How did you bring OpenStack Cloud to your company

Panel

Tuesday 3:40 PM

Expo Breakout Room 1 Bridging the Gap: Explaining OpenStack to VMware Administrators

Scott Lowe

Wednesday 11:15 AM

Expo Breakout Room 1 OpenStack + VMware: Customer Success Stories & What’s Next

Dan Wendlandt

Wednesday 5:30 PM

Expo Breakout Room 1 Network Virtualization with OpenStack Neutron & VMware NSX

Somik BeheraDimitri Desmidt

Thursday 9:50 AM

Sky City Marriott -Meeting Room 4

Differentiated Services == Differentiated Scheduling

Gary Kotton

Thursday 2:40 PM


Open vSwitch Deep Dive: The Virtual Switch for OpenStack

Eric LopezJustin Pettit

Thursday 3:30PM

Sky City Marriott -Meeting Room 4

Bridging the Gap: Cinder and vSphere Alex JauchKartik Bommepally

Thursday 5:20 PM


How to Write a Neutron Plugin, If You Really Need To

Salvatore Armando

Friday 11:00 AM

Sky City Marriott - Grand Ballroom A&B

Hands-on with OpenStack + vSphere Gary Kotton

Friday 1:30 PM

Sky City Marriott - Grand Ballroom A&B

OpenStack Networking Hands-on Lab Eric LopezAaron Rosen

Learn More!

http://vmware.com/go/openstack


Thank You!

© 2011 VMware Inc. All rights reserved Confidential VMware and Cinder Alex Jauch, Product Line...

Documents

Transcript of © 2011 VMware Inc. All rights reserved Confidential VMware and Cinder Alex Jauch, Product Line...