EMC & OpenStack: A View from Withinvfokus.no/wp-content/uploads/2013/06/EMC-OpenStack.pdf · Data ....

1 © Copyright 2013 EMC Corporation. All rights reserved.

EMC & OpenStack: A View from Within

Edgar StPierre Sr. Consulting Solutions Architect


Roadmap Information Disclaimer EMC makes no representation and undertakes no obligations with

regard to product planning information, anticipated product characteristics, performance specifications, or anticipated release dates (collectively, “Roadmap Information”).

Roadmap Information is provided by EMC as an accommodation to the recipient solely for purposes of discussion and without intending to be bound thereby.

Roadmap information is EMC Restricted Confidential and is provided under the terms, conditions and restrictions defined in the EMC Non-Disclosure Agreement in place with your organization.


Agenda

EMC Storage and OpenStack – Strategy Overview

An OpenStack Technology Review

EMC Participation And Contribution

EMC Value-Add


Mission Statement "To produce the ubiquitous Open Source cloud computing platform that will meet the needs of public and private cloud providers regardless of size, by being simple to implement and massively scalable."

Source: OpenStack Foundation


OpenStack: Open Source Cloud OS

Public clouds – level the playing field against “the big three”

– Major Opportunists: Rackspace, HP – And many more…

Private clouds – open the door to many distributors

– Canonical, Red Hat, SUSE, Rackspace, and a host of others…

– And create opportunity for customers to manage lower cost, and ultimately flexible, private clouds

Virtual Data

Center

Virtual Data

Center

Virtual Data

Center

Virtual Data

Center

Virtual Data

Center

Virtual Data

Center

…


Resource disaggregation fundamental to Software Defined Data Centers Virtualized Data Centers

Favorite Cloud OS & Configuration Mgmt System

Favorite Hypervisor CPU Pool Mem Pool

Network Virtualizer IP Pool Service Pool

Storage Virtualizer Storage Pool1 Storage Pool2

VM


Disaggregation of Storage Resources

Disaggregation at host level – Roll-your-own storage nodes with services

based on a DFS or LVM – All storage and data services on storage

node – This is SDDC goal for many apps

Disaggregation at array level – Not as flexible/ubiquitous as disaggregation

at host level – But: proven, performant, and inherently

resilient – Storage arrays have been disaggregating

disks for years – Array-based storage & data services – This is topic for today

OpenStack

DFS/LVM

Hypervisor

VM VM


“Just say yes” EMC Strategy For CloudOS Options

Across Variety Of CloudOS Platforms

Variety of Solutions Within Each CloudOS Platform

Continuously Evolve Solutions To Support Customer Options


OpenStack Technology Review


The OpenStack Layer Cake

Administration

IAM (Keystone)

Metrics (Ceilometer)

OpenStack API (Both a native REST API plus an EC2-compatible API)

Admin APIs

3rd Party Monitoring

Tools

GUI (Horizon)

Python CLIs (Separate projects)

Images (Glance)

Object (Swift)

Compute (Nova)

Storage (Cinder)

Network (Quantum)

Messaging (RabbitMQ)

Database (MySQL)

Policy Scheduling

Orchestration

Policy Scheduling

Orchestration

Policy Scheduling

Orchestration

App Orchestration (Heat)

Adapters Adapters Adapters

Policy Scheduling

Orchestration

Adapters

Presentation

Control Logic

Resources Integration


Creating An Ephemeral VM

Images (Glance)

Object (Swift)

Compute (Nova)

Storage (Cinder)

Network (Quantum)


Client

KVM

VM

Swift / NFS

3. GET image 4. GET image

5. GET image

6. Upload 7. Load

2. Allocate Network

8. Boot

1. POST /{tenant_id}/servers (…, imageRef, …)


Attaching A Persistent Block Volume

Images (Glance)

Object (Swift)

Compute (Nova)

Storage (Cinder)

Network (Quantum)


Client 1. POST /{tenant_id}/volumes

KVM

VM

4. Init Connection

6. Attach device

3. POST /{tenant_id}/servers/{server_id}/os-volume_attachments (…, volume_id,… )

2. Create volume

5. Map volume

7. iSCSI discover


Cinder Persistent Volume Functions Supported Functions:

Create/Delete Block Volume

Initialize/Terminate Connection (From Nova, Performs Map/Mask)

Create/Delete Snapshot

Create Cloned Volume

Create Volume From Snapshot

Copy Volume To/From Image

New: Backup/Restore Volume

OpenStack

KVM

VM

Volume

Driver

Compute Manager

Compute Virt Driver Volume

Manager

1. “create volume” 2. “attach volume”

3. initialize_connection

1

3

2

libvirt

Nova

Cinder


Internet

Controller Node

(common services)

Compute Nodes

(Nova)

Cloud Mgmt

VM Data

An Example OpenStack Deployment

Controller Node

(common services)

HA

Image Service Nodes (Glance)

Storage Nodes

(Cinder)

Network Nodes

(Quantum)

Configuration Mgmt System


EMC Participation And Contribution


EMC’s Commitment To OpenStack Joined OpenStack Foundation As “Corporate”

Sponsor In Dec 2012 – http://www.openstack.org/foundation/companies/ – http://gigaom.com/cloud/emc-follows-vmware-rest-of-world-into-openstack/

Contributed VNX/VMAX iSCSI Adapters Into Grizzly Build In Dec 2012

Joined Rackspace “Alamo” Quality Assurance And “Private Cloud” Certification Program In Jan 2013

– http://www.rackspace.com/blog/rackspace-private-cloud-certification-program-combines-product-innovation-and-enterprise-stability/

Engaged Other Distro Leaders: – Canonical/Ubuntu, SUSE, Red Hat

http://www.openstack.org/foundation/companies/

http://gigaom.com/cloud/emc-follows-vmware-rest-of-world-into-openstack/

http://www.rackspace.com/blog/rackspace-private-cloud-certification-program-combines-product-innovation-and-enterprise-stability/

http://www.rackspace.com/blog/rackspace-private-cloud-certification-program-combines-product-innovation-and-enterprise-stability/


EMC Contributions To Date Post-Folsom Release (Dec 2012)

(For Use In Current Distro Programs) – VNX iSCSI – VMAX iSCSI

Grizzly Release (April 2013) – VNX iSCSI – VMAX iSCSI


Compute Node

System Requirements

Host for driver install: Ubuntu 12.04 or later

Solutions Enabler: SMI-S 4.5.1 and higher

VMAX Requirements

Microcode: 5875 for most VMAX – 5876 for VMAX10K

Masking view for Compute host(s) including 6 gatekeepers mapped to each Compute host

VMAX/VMAXe storage pool for Cinder use must be created before using the VMAX/VMAXe Cinder driver

VMAX Constraints

CreateVolumeFromSnapshot not supported

VMAX / System Requirements OpenStack

KVM

VM

Volume Driver

Compute Manager

Compute Virt Driver

Volume Manager

libvirt

Nova

Cinder

Compute Node

Compute Node Masking Views VMAX

Solutions Enabler*

SMIS

*Solutions Enabler may be run as a SUSE VM, or on a standalone server. Each Solutions Enabler supports multiple backend arrays.


System Requirements

Host for driver install: Ubuntu 12.04 or later

Solutions Enabler: SMI-S 4.5.1 and higher

VNX Requirements

Flare 31 or higher

Compute hosts registered with VNX – Via iscsiadm

VNX Storage Pool created on array for Cinder to use (Thin LUN’s only)

VNX / System Requirements

Compute Node

OpenStack

KVM

VM

Volume Driver

Compute Manager

Compute Virt Driver

Volume Manager

libvirt

Nova

Cinder

Compute Node

Solutions Enabler*

SMIS

Compute Node

Register

VNX

*Solutions Enabler may be run as an ESX VM, or on a standalone server. Each Solutions Enabler supports multiple backend arrays.


EMC Best Practices

Run EMC Volume Drivers Anywhere – Each Driver Is An Independent ‘cinder-volume’ Service – Low CPU/IO Requirements – Run On Controller Node For Active/Passive HA – However: Future Backup Considerations Will Change This – Scale Practice: Run “storage controller nodes” as VMs

Best Practices For Access Protocols: – iSCSI For VNX – NFS For Isilon (Havana) – FC For VMAX

Best Practice White Papers Are Work In Progress


What’s Next

More Products

More Protocols

More Partners

More Functionality


How To Access EMC Adapters Via OpenStack Foundation, Effective April

2013 – https://github.com/openstack/cinder/tree/mas

ter/cinder/volume/drivers/emc

Via Rackspace “Alamo” Certification Program – http://www.rackspace.com/knowledge_center/

article/implementing-openstack-cinder-with-emc-storage-on-the-rackspace-private-cloud-software

Via Other Distributions As They Become Available – Including VARs and ISVs

https://github.com/openstack/cinder/tree/master/cinder/volume/drivers/emc

https://github.com/openstack/cinder/tree/master/cinder/volume/drivers/emc

http://www.rackspace.com/knowledge_center/article/implementing-openstack-cinder-with-emc-storage-on-the-rackspace-private-cloud-software





EMC Value-Add


EMC Technology In OpenStack First Things First: Storage Platforms Available For Use

– EMC Storage Hardware For Building Private Clouds – Include Hooks For Snapshot (And Backup in Havana)

EMC Value Add – Enterprise Class Storage And Services – Highly Available Infrastructure – Deliver Value Above And Beyond Via Advanced Capabilities

Avenues For Advanced Capabilities* – Consistency Groups – Integrated Backup Policy And Scheduling – Remote Replication

*These features are not committed; we’re looking at all the obvious choices and gathering feedback


Advanced Capability Delivery

Initially: – Partners – VARs/ISVs – Customers

Where it makes sense – Contribute Upstream Into OpenStack


Wrap up


Resources Technical Resources

– Datasheets – Implementation Guides – Knowledge Center Articles – Certification Program Test Results – Reference Architectures – Blogs

EMC World Resources – ESG OpenStack Kiosk – OpenStack Demo – See ViPR Demo In ASD Boot

For more information on OpenStack, please refer to the following links:

– http://one.emc.com/clearspace/community/active/everything_openstack

– http://virtualgeek.typepad.com/ – http://chucksblog.emc.com/ – http://openstack.org/start

http://one.emc.com/clearspace/community/active/everything_openstack

http://one.emc.com/clearspace/community/active/everything_openstack

http://virtualgeek.typepad.com/

http://chucksblog.emc.com/

http://openstack.org/start


Wrap Up: EMC and OpenStack EMC Embraces Multiple Cloud OS Frameworks

EMC Is Active In The OpenStack Cinder Project

Cinder Volume Drivers Available Now

Through 2013: – More Feature & Driver Contributions To Havana Release – In Some Cases: EAP May Be Available For Havana capabilities

Stay Tuned as EMC Delivers On Advanced Capabilities

EMC & OpenStack: A View from Withinvfokus.no/wp-content/uploads/2013/06/EMC-OpenStack.pdf · Data ....

Documents

Transcript of EMC & OpenStack: A View from Withinvfokus.no/wp-content/uploads/2013/06/EMC-OpenStack.pdf · Data ....