VMware and Cinder

© 2011 VMware Inc. All rights reserved

Confidential

VMware and CinderAlex Jauch, Product Line Manager (@ajauch)

Kartik Bommepally, MTS (Cinder Driver Team)

2 Confidential – Not for External Distribution

OpenStack on VMware


VMware Vision: Software Defined Storage

Software Defined Storage

Software-Defined Storage Vision

Enable new storage tiersEnable DAS & server flash for shared storage along with enterprise SAN/NAS

Enable tight integration with storage ecosystemTighter integrations with broad storage ecosystem through APIs

Deliver policy-based automated storage managementAutomatically enforce per-VM SLAs for all apps across different types of storage

“Gold” Array(s)

“Silver” Array(s)

Distributed Storage

Hard disks

SSD Hard disks

SSD

Availability = 99.99%DR RTO = 1

“Gold” SLAAvailability = 99%Throughput = 1000 R/s, 20 W/sLatency = 95% under 5 msDR RPO = 1’, RTO = 10’Back up = hourlyCapacity res = 100%

Web Server

Database Server

Availability = 99.99%

DR RTO = 1 hourMax Laten

“Bronze” SLAAvailability = 99%Throughput = 100 R/s,10 W/sLatency = 90% under 10 msDR RPO = 60’, RTO = 360’Back up = weeklySecurity = encryption

Red

uce

Stor

age

Cos

t and

Com

plex

ity

App Server


Virtual SAN (VSAN)

What is Virtual SAN? Key Features

Converged compute + storage solution Utilizes DAS and server attached disks Auto-tiering between SSD and HDD Intelligent policy driven data placement

across the cluster vCenter-integrated, instant storage

provisioning

High performance storage at up to 50% lower cost

Radically Simple Storage – configure and manage without complex workflows

Designed for dynamic scalability and high resiliency

Clusters internal server disks to provide scalable shared storage with

cloud agility and efficiency.

Customer Benefits

vSphere

Virtual SAN

Hard disks

SSD

…………….

Hard disks

SSD Hard disks

SSD

Distributed Storage Aggregated Datastore

vCenter Server


vSphere

Virtual Volumes

What are Virtual Volumes? Key Features

Existing SAN/NAS systems become VM-aware

Native representation of VMDKs on SAN/NAS

New API for data operations at VMDK granularity

Native representation of VMDKs on storage

Snapshots, replications and other operations at VM granularity on external storage

Works with existing SAN/NAS storage systems

VM level storage SLA enforcement

Current Paradigm

VMDKs on LUNs

LUNs replicated

Virtual Volumes

vSphere

VMDKs on storage systems

VMDK replicated

Customer Benefits

Broad partner ecosystem


What is Policy-based Management?

Storage Policy Based Management (SPBM)

• Simple policies to specify app SLA requirements

• Automation of storage provisioning and VM placement across clusters

• Works for any protocol : block, file and object

• SLA Compliance monitoring & automatic remediation

Key Features

• Drastically simplify storage provisioning• Management of different storage tiers

as one• Reduce storage cost by optimizing

consumption

Software Defined Storage

Enterprise SAN/ NAS

Virtual SAN BLOB Storage



SLA DefinitionsAvailability = 99.99%DR RTO = 1 hourBack up = dailyStorage capacity = 1 TBPerformance = High I/OSecurity = High



SLA DefinitionsAvailability = 99%DR RTO = 4 hourBack up = weeklyStorage capacity = 10 TBPerformance = High I/OSecurity = High

Customer Benefits


The Basics: Storage Abstraction in vSphere

The Datastore is the fundamental persistence abstraction. The VMDK is the Disk abstraction Storage Policy Based Management (SPBM) is the Control Plane VMware is Moving Away from LUN based policy and towards

VMDK based policy• For Local Storage, this is done via VSAN

• For Shared Storage, this is done via VVOL

VMware is Moving Away from Raw Device Map (RDM) Disks Thus, a VMDK Driver for Cinder


Cinder VMDK Driver Work Flow

As with Nova, vSphere Admin Sets Up Capacity Pools• For Storage this Means Datastores in Havana

• For Icehouse, this will include SPBM

Cloud Admin Creates Cinder Volume Types• Volume Type is our MetaData Injection Vehicle

Consumer Creates New Cinder Volume• This Allows us to create meta data

Consumer Attaches Cinder Volume• We Lazy Create the VMDK Based on VM Target

• VMDK Is Mounted By vSphere Against Target


Volume types and extra specs

Driver allows additional configuration for volume creation via extra specs in the volume type

VMDK type• Use extra spec key ‘vmware:vmdk_type’

• Legal Values: ‘thin’, ‘thick’ and ‘eagerZeroedThick’ • Default type is ‘thin’

Clone type• Use extra spec key ‘vmware:clone_type’ • Legal Values: ‘full’ and ‘linked’• Default type is ‘full’


What the Heck is a “Shadow” VM?

In vSphere There is No “First Class Disk” Object. Yet. When You Create a VMDK It Must be the Child of a VM However, Cinder Assumes a First Class Disk Therefore, A “Shadow” VM is inserted <<<KARTIK, INSERT SCREEN SHOT HERE OF SHADOW VM>>>


DEMOVMware VMDK Driver for Cinder


Current API Support

Create volume• Supported VMDK types – thin, thick, eagerZeroedThick

• From scratch

• From glance image

• From an available source volume – full clone and linked clone

• From a snapshot – full clone and linked clone

Attach volume to an instance Detach volume from an instance Snapshot an available volume Delete snapshot of an available volume Upload an available volume as glance image Delete volume


Committed Roadmap

Support for Storage Policy Based Management (SPBM) Fix for SnapShot/Clone Issues with Attached Volumes Move Core Storage Code into Oslo Implement Remaining API Items Incorporate Additional Icehouse APIs Nova Support for SPBM


Thoughts Beyond Icehouse

Common Meta Data Model Between Cinder and Nova Support For Application Consistent Snapshots DR/HA Considerations in Cinder

• How Do we Abstract Availability Zones?

Storage QOS• How Do We Represent Performance Contracts?

Inter DC Data Mobility Services Alerting/Policy Violation Support, Ceilometer? Others?


DemoVMware vSphere

on OpenStackby Scott Lowe

Location: Sponsor Demo Theatre

Date: Wed @ 2 PM

General SessionNavigating the Transition to

Network Virtualization

With Martin Casado

Location: Asia World – Summit Hall 2

Date: Tues @ 12:05 PM

http://vmware.com/go/openstack Day Time Room Title Speaker

Tuesday 2:50 PM

Sky City Marriott - Grand Ballroom C

User Panel: How did you bring OpenStack Cloud to your company

Panel

Tuesday 3:40 PM

Expo Breakout Room 1 Bridging the Gap: Explaining OpenStack to VMware Administrators

Scott Lowe

Wednesday 11:15 AM

Expo Breakout Room 1 OpenStack + VMware: Customer Success Stories & What’s Next

Dan Wendlandt

Wednesday 5:30 PM

Expo Breakout Room 1 Network Virtualization with OpenStack Neutron & VMware NSX

Somik BeheraDimitri Desmidt

Thursday 9:50 AM

Sky City Marriott -Meeting Room 4

Differentiated Services == Differentiated Scheduling

Gary Kotton

Thursday 2:40 PM


Open vSwitch Deep Dive: The Virtual Switch for OpenStack

Eric LopezJustin Pettit

Thursday 3:30PM

Sky City Marriott -Meeting Room 4

Bridging the Gap: Cinder and vSphere Alex JauchKartik Bommepally

Thursday 5:20 PM


How to Write a Neutron Plugin, If You Really Need To

Salvatore Armando

Friday 11:00 AM

Sky City Marriott - Grand Ballroom A&B

Hands-on with OpenStack + vSphere Gary Kotton

Friday 1:30 PM

Sky City Marriott - Grand Ballroom A&B

OpenStack Networking Hands-on Lab Eric LopezAaron Rosen

Learn More!

http://vmware.com/go/openstack


Thank You!

VMware and Cinder

Documents

Transcript of VMware and Cinder