EMC with Mirantis Openstack

1EMC CONFIDENTIAL—INTERNAL USE ONLYEMC CONFIDENTIAL—INTERNAL USE ONLY

EMC OPENSTACK CLOUD SOLUTIONS REFERENCE ARCHITECTURE WITH MIRANTIS OPENSTACK PLATFORM


IT AS A SERVICE DELIVERS BUSINESS AGILITY

IT as a ServiceBroker & Builder

New Business ModelNew Technology Architecture

New Operation models and rolesCost Efficiency

CULTURE

Open Source

AgileApps

Big Data

TECH BUSINESS

DevOpsMobile Apps

Customer Data

Speed


OpenStack As An Enabler For Transformation

Metering Engine

Service Catalog

Orchestration Engine

User Portal

Policy Engine

Dev-OpsNew Roles

AgileProcesses

New Apps

Application Fabric

Data Fabric

Lends itself nicely to3rd Platform Apps

Developer Friendly

Cloud Software Platform a

foundation for SDDC

enablement

API provide capability to

Automate Services for Cost

Effective Operations.

Need new skill sets and roles

PaaS

SOFTWARE DEFINED DCTRANSFORMATION

Service APIs


Why OpenStack?

COST SAVINGSOPERATIONAL EFFICIENCY

OPEN PLATFORM

CHOICE OF TECHNOLOGY

INNOVATE AND COMPETE

source: OpenStack User Survey, 2014http://superuser.openstack.org/articles/openstack-user-survey-insights-november-2014


What Is OpenStack?

• Flexible and modular architecture. Foundation for a Software Defined DC.

• Delivering IaaS service : compute, networking & storage services and more.

• Analogous to the Linux kernel (very tunable)

• All services are expose via API (Infra as code)


NEW USE CASESDigital ExperienceReal-time Analytics

EXISTING APPLICATION INVENTORY &

STRATEGY

Application RightFit

SOFTWARE DEFINED

DATACENTER

3RD GEN APPS AND DATA PLATFORM

Re-write / Replace

Leave in place/Retire

Refactor / Migrate

PLATFORM 2.0

PLATFORM 2.5

PLATFORM 3.0

PLATFORM 1.0


Platform Definition

No-SQL

Components inMonolithic Applications

Components re-architectedloosely coupled, elastic, fault

tolerant

Relational In Memory, Distributed

Kernel Virtualization Kernel Virtualization / Containers

Pla

tform

2P

latfo

rm 3


Personas

Administrators responsible for managing and maintaining an IT infrastructure (in a private cloud) Years of experience with Unix and Linux systems administration. Manages IT infrastructure, hypervisors and Cloud platform. Interested in how to deal with failure (planned, unplanned), maintenance of system and utilization.

Enterprise Admin

Cloud Admin

Proficient in administering Unix and Linux systems. Competent shell and Python programmer. Early adopter of Puppet. Already using AWS for IaaS service

Dev-OpsHave been using AWS for a while. Primarily developing web applications for internal usage. API driven. Will integrate with the CI/CD tools and open to OpenSource.

Clear and efficient catalogue to manage the infra lifecycle

Need a catalogue or CLI for initial deployment rest done via API calls

Management interface for utilization, quotas etc. APIs to integrate into tools


OpenStack Framework

• Currently 14 integrated projects within OpenStack

• All these projects communicate via public API’s

• Quite a few new projects focused on Mgmt and Operations

• Service have behavioral compatibility with AWS

Horizon

Dashboard

Swift

object store

Glance

image store

Nova

compute node

Cinder

volume service

Keystone

identity service

Heat

Orchestration

Celiometer telemetry service

Trove

database

Neutron

networking

S3 EC2 EBS vPC RDSAMI

IAMCloud Formation


OpenStack DriversEMC Integration: OpenStack

Delivers On Speed And

Space

Flash Performance

Low $ Per Transaction

Any Workload

Hyper Converged, S/W Defined

Use Your Hardware

Broad Portfolio

Fit Your Environment

Evolve With Your Cloud

Reduce Deployment

Costs

File or BlockHybrid

Software Defined

Efficient Management

Isilon

Data Lake

Scale out File and Object

System


TECHNICAL EVIDENCE SOLUTION REFERENCE ARCHITECTURE WITH MIRANTIS – JUNO RELEASE


EMC + Mirantis Technical Evidence

Storage Arrays

Certified & Validated Designs

Partner Tools Integration

Cooperative Support

Joint Services

EMC

• Solution Focused

• Partnered with Mirantis and provide Validated reference designs.

• Integrated with Mirantis tool set to enable better manageability.

• Joint Service and Support


Mirantis OpenStack

• The most robust OpenStack distribution on the market

• Fuel takes the guesswork out of deployment

• Broad choice of fully-tested technologies

Simply download, boot, and deploy Mirantis OpenStack


Distro: Production-Ready Packages

• Fundamental components– Core OpenStack – Key Projects– Plug-ins & Drivers

• Continuous verificationand community contribution

– Solid Reference Architecture– Continuous Integration and Delivery– Real-world operation at scale


EMC Reference Architecture with Mirantis OpenStack

Cinder Drivers


Solution ComponentsCapability Components SupportedHardware VNX

XTREMIOSCALEIO

- iSCSI, FC, - iSCSI, FC- SDC

Software Mirantis Open Stack Juno Release

Software Cinder Block Driver Juno Release

Software CentOS Operating system v6.5 kernel (2.3.2)

Software KVM Hypervisor in the CentOS Kernel

Software Tools Mirantis Fuel Version 6.0


Logical Architecture


Fuel: Deployment and Management• GUI driven experience for

– Automated deployment of OpenStack– Guided configuration & management

• Flexible technology choices

• Production-ready HA deployment

• Health validation– Network verification– Deployment validation– Cloud health checks


• Unified Block and File Storage system

• Cinder Supported Protocols – FC and iSCSI

• Supports all the main volume operations.

• FAST, FastCache, FC SAN Zoning.

• Integrated into OpenStack trunk

VNX

Unified Hybrid Storage for the Mid-Range

UNIFIED All mixed workloadsAll access protocols

HYBRID Optimized for

FLASHBenefits of tiered

storage

PRICE OPTIMIZEDLowest $/IO

Lowest $/GB

Technology Leadership

Multicore Optimized

Designed for Virtualization

Unified StorageFile and Block

OpenStack CinderCinder Driver

$ cinder type-create "AutoTieringVolume" $ cinder type-key "AutoTieringVolume" set storagetype:tiering=Auto fast_support=True fast_cache_enabled=True


Cinder.Conf - VNX

enabled_backends=vnxiscsistorage_vnx_pool_name = Pool_01_SASsan_ip = 10.10.72.41storage_vnx_security_file_dir = /etc/secfile/array1naviseccli_path = /opt/Navisphere/bin/navisecclivolume_driver = cinder.volume.drivers.emc.emc_cli_fc.EMCCLIFCDriverdestroy_empty_storage_group = Falseinitiator_auto_registration = TrueVolume_backend_name=vnx_40

FC Driver

Enabled_backends=vnxfcstorage_vnx_pool_name = Pool_02_SASsan_ip = 10.10.72.41storage_vnx_security_file_dir = /etc/secfile/array1storage_vnx_authentication_type = globalnaviseccli_path = /opt/Navisphere/bin/navisecclivolume_driver=cinder.volume.drivers.emc.emc_cli_iscsi.EMCCLIISCSIDriverdestroy_empty_storage_group = Falsevolume_backend_name = vnx_41

iSCSI Driver

Location : /etc/cinder/cinder.conf

• Specify the volume drivers in the cinder.conf file

• Restart cinder-volume service to make any configuration change to take effect.


VNX: Deployment Architecture

iSCSI FC


• All Flash array ideal for High Performance

• Scale Out Architecture – Scale storage resources together with cloud

infra

• Supported Protocols:– FC and iSCSI

• Provide support for main Volume Operations

• Integrated into OpenStack trunk

XTREMIO


Cinder.conf - XIO

enabled_backends = XtremIO[XtremIO]volume_driver = cinder.volume.drivers.emc.xtremio XtremIOFibreChannelDriversan_ip = 10.10.10.20san_login = adminsan_password = 223344volume_backend_name = XtremIO_FC

enabled_backends = XtremIO[XtremIO]volume_driver = cinder.volume.drivers.emc.xtremio XtremIOIscsiDriversan_ip = 10.10.10.20san_login = adminsan_password = 223344volume_backend_name = XtremIO_iSCSI

FC Driver

iSCSI Driver


XTREMIO: Deployment Architecture

iSCSI FC


ScaleIO – Block services

• Hyperscale Converged Server SAN Solution for Commodity Platforms

– Software runs on physical & virtual

• Four Key Components– SDC, SDS, MDM, GATEWAY

• Driver executes volume operations thru the REST Gateway to backend ScaleIO Components

• Available from GitHub

SDC

Metadata Mgr(MDM)

Applications(NOVA)

SDS

Cinder Volume

GATEWAY

Driver

SDS SDS

Commodity Platforms


Cinder.conf - ScaleIO

enabled_backends = ScaleIO

[ScaleIO]volume_driver=cinder.volume.drivers.emc.scaleio.ScaleIODrivercinder_scaleio_config_file=/etc/cinder/cinder_scaleio.config

SDS Driver


SCALEIO : Deployment Architecture


Certified Volume OperationsVNX Extreme IO Scale IO

Create, Delete, Extend Volume Create, Delete, Extend Volume Create, Delete, Extend Volume

Snapshot volume , Delete snapshots Snapshot volume , Delete snapshots Snapshot volume , Delete snapshots

List volume and snapshots List volume and snapshots List volume and snapshots

Attach, Detach volume Attach, Detach volume Attach, Detach volume

Create volume from snapshot Create volume from snapshot Create volume from snapshot

Copy image to volume and volume to image



Clone Volume Clone Volume Clone Volume

Create volume with backend Create volume with backend

Migrate volume, Retype a volume

Create and Delete Consistency Groups

Create and Delete Consistency Group Snapshots

https://wiki.openstack.org/wiki/CinderSupportMatrix


EMC OPENSTACK CLOUD SOLUTION CINDER FUNCTIONALITY


Cinder – Block Storage Service

• Persistent block level storage devices for use with OpenStack compute instances.

• Manages the creation, attaching and detaching of the block devices to servers

• Block storage volumes are fully integrated into OpenStack Compute and the Dashboard allowing for cloud users to manage their own storage needs.

• Snapshots are supported and can be restored or used to create a new block storage volume.


Cinder Capabilities• Volumes:

– Allocated block storage resources that can be attached to instances as secondary storage or they can be used as the root store to boot instances. Volumes are persistent R/W block storage devices most commonly attached to the compute node through iSCSI.

• Snapshots :– A read-only point in time copy of a volume. The snapshot can be created from a

volume that is currently in use (through the use of --force True) or in an available state. The snapshot can then be used to create a new volume through create from snapshot.

• Backups:– An archived copy of a volume currently stored in OpenStack Object Storage (swift).


• Attached to instances as secondary storage

• Can be used as root store to boot instances

• Persistent R/W Block storage

• Manage volume lifecycle– Create, Delete, Extend volumes– Attach/Detach Volume

• Ability to create different volume type.

Click icon to add picture

Cinder Capabilities : VOLUME


• A read-only point in time copy of a volume

• Create snapshots, Delete snapshots

• Make volume out of the created Snapshots

Click icon to add picture

Cinder Capabilities : Snapshots


• Backup Operations is an admin task and done via CLI today

• Backup is to Swift (Object).

• Find the volume you want to backup.

– Create backup of a volume– Make sure of backup container.– Restore the volume

CINDER Capabilities - BACKUP

$ cinder backup-create “volume_id”

$ swift list

$ cinder backup-restore “BACKUP_ID”

$ cinder list


Consistency Groups• Today in Cinder, every operation happens at the volume level.

Consistency Groups (CGs) enable – Data Protection (snapshots and backups) – Disaster Recovery (remote replication)

• Consistency Group function– Leverages volumes of same type to be part of CG so can be snapshot/backed up– Enable Cinder to leverage volume replication feature available in the storage

backends (drivers).– Orchestration layer above Cinder that understands which volumes should be grouped

together.


Consistency Groups

• Caveats– Allow for snapshot of multiple volumes – Make sure the “storage platform” supports consistency group (ex: VNX)– Can set Consistency groups only via CLI ; no support from Portal yet– Certain operations are not permitted if a volume is in a consistency group

• Volume Migration, Volume Re-Type, Volume deletion.• A consistency group has to deleted as whole with all volumes and same

for volume snapshots.


• High availability for Cinder – Deploy a Multi-Node with HA OpenStack

environment.

– Cinder services can be installed on each controller and provide high availability in case of a controller reboot or loss.

– If a controller is lost all control plane functions are lost the data plane works.

High Availability

Controller-1Controller-2

Message Q

Database

API Services

Identity

Image

Blk Storage

Dashboard


• Admins have the capability to group tenants– Using Projects– Map specific users who can access the

project.

• Quotas can be set for operational limits– Enforced per tenant (project) level

• Number of volumes• Number of volume gigabytes allowed per• Number of Block Storage snapshots allowed

Projects and Quotas


• Configuration File: Cinder.confenabled_backends=XtremeIO, VNX[XtremeIO]volume_driver = cinder.volume.drivers.emc.xtremio XtremIOIscsiDriver volume_backend_name=xtremIO_40

[lVNX]storage_vnx_pool_name = Pool_01_SASvolume_driver=cinder.volume.drivers.emc.emc_cli_iscsi.EMCCLIISCSIDrivervolume_backend_name=vnx_41

• Map the backend to volume types$ cinder type-create "HighPerf”$ cinder type-key "HighPerf” volume_backend_name=xtremeIO_40

$ cinder type-create ”MedPerf”$ cinder type-key ”MedPerf” volume_backend_name=vnx_41

MULTI-BACKEND SUPPORT

Cinder-Volume

High Perf Med Perf

Cinder-driver

Cinder-driver


• Log files used by Block Storage– Log file of each Block Storage service is stored in

the /var/log/cinder/ directory of the host

– Most Block Storage errors are caused by incorrect volume configurations that result in volume creation failures. To resolve failures, review logs:

• cinder-api log (/var/log/cinder/api.log)• cinder-volume log (/var/log/cinder/volume.log)

• Forward the logs to syslog server

Logging - Cinder

OpenStack Controller + Data Plane

Local log files

Rsyslog pull

Logstash

ElasticsSearch

Kibana

http://docs.openstack.org/openstack-ops/content/logging_monitoring.html





• Volume Stats– Health, Size, Usage.– Thresholds for alarms

• The data can be used by external systems for

– Metering/chargeback– Monitoring.

Monitoring - CEILOMETER

Notification BUS

Volume

Notification Agents Collectors

External Systems

http://docs.openstack.org/openstack-ops/content/index.html




Volume Type

$ cinder type-create "ThickVolume"$ cinder type-create "ThinVolume"$ cinder type-create "DeduplicatedVolume"$ cinder type-create "CompressedVolume"$ cinder type-key "ThickVolume" set storagetype:provisioning=thick$ cinder type-key "ThinVolume" set storagetype:provisioning=thin$ cinder type-key "DeduplicatedVolume" set storagetype:provisioning=deduplicated deduplication_support=True$ cinder type-key "CompressedVolume" set storagetype:provisioning=compressed compression_support=True

$ cinder type-create "HighPerf"$ cinder type-key "HighPerf" set storagetype:pool=Pool_02_SASFLASH volume_backend_name=vnx_41

• User wants to create a volume on a certain storage pool, a volume type with an extra spec specified the storage pool should be created first, then the user can use this volume type to create the volume.


CINDER ARCHITECTURE WALK THRUCINDER FUNCTIONALITY


Conceptual Architecture

Glance

Cinder

Neutron

Nova

KeyStone

Horizon

Swift

Backup volumes in

HeatOrchestrate

Directs services

Metering

Celiometer

Provides Auth for

Poll Data From

Storage Lifecycle• Create Volume• Attach Volume• Snapshot Volume

13

2

4


Cinder Architectural Overview

Cinder Client

Cinder API

Cinder Scheduler Cinder Volume Cinder BackupCinder-driver

REST

AMPQ AMPQ

Cinder-driver

sql

Volume Functions• Create• Extend• Delete• Attach• Detach• Volume Types

Snapshot Functions• Create• Delete• Update• Volume from Snapshot

Backup Functions• Backup• Restore• Delete


Cinder Architecture Building Blocks• Cinder API

– A WSGI app that authenticates and routes requests throughout the Block Storage service. It supports the OpenStack APIs

• Cinder Scheduler– Schedules and routes requests to the appropriate volume service. Depending upon

THE configuration, could be simple round-robin scheduling or it can be more sophisticated through the use of the Filter Scheduler. The Filter Scheduler is the default and enables filters on things like Capacity, Availability Zone, Volume Types, and Custom filters

• Cinder Volume– Manages Block Storage devices, specifically the back-end devices themselves

• Cinder Backup– Provides a means to back up a Block Storage volume to OpenStack Object Storage.


Logical Flow


Authentication - Keystone

• Provide credentials to authenticate to the system.

• Admin• User

• Credentials used by all services to talk to each other


Self Service Portal - Horizon


Volume Creation - Cinder

Group volumes based on performance

SIze

Data VolumeBoot Volume

Defaults to Nova-AZ if notspecified


Volume Types

Volume Type

Size

Availability Zone


Managing the volumes

Increase the volume sizeDelete the volumesCreates snapshots of volumes


Launching an instance- Nova

Flavor

Count

Image

• Initiate creation of an instance.

• Based on flavor• Based on number• Based on AZ


Attaching a volume to an instance


Snapshot

Create a volume from a snap

56© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.

References

• EMC Mirantis Reference Architecture design– https://www.emc.com/collateral/technical-documentation/h13933-emc-mira

ntis-openstack-ra.pdf

• Configuration guide – http

://docs.openstack.org/juno/config-reference/content/ch_configuring-openstack-block-storage.html

• Fuel– https://wiki.openstack.org/wiki/Fuel

https://www.emc.com/collateral/technical-documentation/h13933-emc-mirantis-openstack-ra.pdf



http://docs.openstack.org/juno/config-reference/content/ch_configuring-openstack-block-storage.html




https://wiki.openstack.org/wiki/Fuel

https://wiki.openstack.org/wiki/Fuel

EMC with Mirantis Openstack

Software

Transcript of EMC with Mirantis Openstack