Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

26

Transcript of Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

Page 1: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage
Page 2: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

Mirantis Overview

● Leading OpenStack

distribution

● Plan, architect,

implement with focus

on business outcomes

● Fully managed

OpenStack with up

to 99.99% SLA

guarantee

● Clouds, tooling, and

Ops Team 100%

focused on

OpenStack success

● Co-manage for a fixed

period

● Train and certify customer

ops team on your terms

● Transfer to customer

support

Build Operate Transfer

#1 $200M Source of the source

code: Top contributor Mitaka Release

Well funded

700+ Employees

Page 3: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

• Open Source: Huge community of supporters ensuring low costs

• Enable: Modular, scalable and flexible utilities offering efficiency and agility

• Decoupling: complete hardware vendor independence and no vendor lock-in

• Integrated: Scale out Storage (e.g. ScaleIO, ECS) and Software Defined Networking

• Interoperability: Open-Source APIs offer full manageability in hybrid IT landscapes

• Proven: Operated at many companies clouds (AT&T, Volkswagen, …)

• Ease of integration: supported by all major vendors (e.g. Dell EMC, VMware, HP, …)

Why Mirantis?

Page 4: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

• Proven at joint Customers

• Broad Integration: Pluggable support for ScaleIO, XtremIO, Unity, VNX

• Validated: EMC Storage Solutions with Mirantis OpenStack reference architecture

https://www.mirantis.com/partners/dell-emc/

Dell EMC and Mirantis

Page 5: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

• Web/Cloud native apps: Microservices, containerized, User generated content

• Data analytics: In memory processing (Kafka, Spark), batch processing (Hadoop)

• Telco: Network function virtualization (NFV), Cloudify orchestration

• Upcoming: IoT, HPC

Use Cases of OpenStack

Page 6: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

https://codedellemc.com

Page 7: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

What is Dell EMC ScaleIO?

• Installs on industry-standard x86 servers that run databases,

hypervisors, or any other applications

• Aggregate applications servers’ local disks

• Add storage and/or compute on the fly

Software that uses application servers to create an elastic, scalable, and resilient server SAN at a fraction of the cost and complexity of traditional SANs

ScaleIO Software

Minimal footprint:

• 1 GB RAM

• Max 10% cpu for all HDD configurations

• Max 20% cpu for all flash configurations

Big results!

Page 8: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

© Copyright 2015 EMC Corporation. All rights reserved.

ENTERPRISE FEATURES

SNMP &

Call Home

OpenStack, vSphere, Xen,

Hyper-V, Bare metal Windows &

Linux

Data-at-Rest-Encryption

& Certificate

Authentication

Protection Domains &

QoS Controls

DRAM Cache &

Read Flash Cache

Checksum &

NDU Rack Level

High Availability

Automatic

Rebalance &

Rebuild

Thin Provisioning Writeable

Snapshots &

DR with RecoverPoint

APP 1

APP 2

APP 3

PERFORMANCE INTEROPERABILITY MONITORING FAULT TOLERANCE RESILIENCY

MULTI-TENANCY PROTECTION SECURITY ELASTICITY EFFICIENCY

Page 9: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

• ScaleIO integrated with OpenStack since Havana

• Full contribution and integration since Liberty

• Cinder (block) & Nova (compute) drivers

• Mirantis Fuel Plugins

• Canonical Juju Charms

• More partner extensions to come…

SCALEIO & OPENSTACK

Page 10: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

OPENSTACK EXTENSIONS FOR SCALEIO

• Why create the extensions? – Orchestrates ScaleIO deployments along with all other OpenStack components

– Makes storage much simpler to deploy

– Provides the user with a unified experience

– Enables OpenStack customers to get to production with ScaleIO faster

• What do they do? – Deploys all components of ScaleIO with few inputs

– Deployment is done using the native framework of that distribution

– Deploys ScaleIO in a consistent way that should provide stability to the entire

deployment

Page 11: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

PARTNER EXTENSIONS

Page 12: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

Key ScaleIO Software Defined Storage takeaways: • Reliable

– Rock solid Software Defined Storage which easily support 5x9’s or higher levels of availability. Easy to manage and upgrade.

• Flexible – Scale-up & down, support multiple environments: VMware, Hyper-V, OpenStack & bare metal with one

solution.

– Easy to scale, supporting cloud infrastructure requirements

• High Performance with tiny footprint: http://www.storagereview.com/node/5992 – Fastest most scalable storage solution, virtually no limits, sub ms RT with SSD/Flash

– Predictable performance no matter the application type (scale-out & scale-up!)

– 10-20% cpu & memory 10’s of MB’s to a few GB drives record breaking performance

• Highly scalable – Start small grow big without worry

– Scale compute & storage independently

• Tremendous value – 505% ROI -> source IDC paper https://www.emc.com/collateral/white-papers/idc-business-value-of-vxrack-

and-scaleio.pdf

Page 13: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

What is ECS ?

Turnkey

Appliance

Dedicated Hybrid

Cloud ECS Software

Multi-tenant Storage

Cloud

Page 14: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

Magic Quadrant for Distributed File Systems and Object

Storage

– October 2016

Dell EMC has two products that are included in this research:

Dell EMC Isilon and Dell EMC Elastic Cloud Storage (ECS). With

Isilon, a mature scale-out NAS product with deployment across

many enterprises and service provider verticals and

geographies, end users consolidate large datasets onto one

distributed file system for high scalability and throughput. ECS is

a platform that supports object, NFS and Hadoop Distributed File

System (HDFS), with the ability to store billions of objects for

cloud-native applications.

https://www.gartner.com/doc/reprints?id=1-

3HYASF6&ct=160919&st=sb

Gartner Magic Quadrant

Page 15: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

2MB Buffered Writer

Box-Carting High performance and low overhead for both small and large objects

15

A A

A

Store

objects in

chunks on

disks Add parity

Delete

original

chunks

In memory

Requests

Page 16: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

Geo Capabilities High durability with a low overhead

16

A

A

B

B

C

A

PUT obj1 (1 MB)

PUT obj2

GET obj1 GET obj1

Replicate

the 128 MB

container

XOR reduction obj1 (1 MB) Read the

Object from

Site-1

Cache the

128 MB chunk Read from

the cache

B

Page 17: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

Multi-Protocol Support Access the same data from any access method

17

• Atmos: version 2.0

support for upgrade

• CAS: SDK v3.1.54 or

later support for upgrade

• Swift: byte range update

within an object

• Retentions

• Keystone integration:

drop-in replacement for

OpenStack Swift

• Primary file system with

native Ambari 2.2

integration

• Byte range updates

• Retentions

• Metadata search

extension

• NFS v3

• Global namespace with

global locking

XXXXX

Page 18: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

Remove the cost and complexity of external databases

18

Save objects with metadata

Search objects using GPS coordinates, image resolution, …

/?query=x-amz-meta-image-gps-latitude>50&…

Metadata search

Page 19: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

– Integration with Open Stack Keystone V3

API

– ECS consumes keystone tenancy and

identity model › ECS Swift registers as service with Keystone

› Enforcement of service policies

– A drop-in replacement for OpenStack Swift

– A repository for Glance images

– A target for Cinder backups

Features

Key Benefits

ECS & Openstack

Page 20: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

What about PaaS & Linux containers NoSQL is often the first option used to store unstructured content

Linux

containers

Page 21: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

But is NOSQL the right solution ? Not really

• NOSQL DB are designed to store XML documents,

metadata, …

• But, they are not efficient to store unstructured content (ex:

they protect data by creating several replicas)

• And they are in the data path

• Object storage is the de facto solution

Page 22: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

XXX

XX

Sensors

Distributed messaging system

Analytic frameworks

Web servers

Code

Artifacts

Images

Images

App servers

Logs

Backups

Page 23: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

XXX

XX

Sensors

Distributed messaging system

Analytic frameworks

Web servers

Code

Artifacts

Images

Images

App servers

Logs

Backups

Page 24: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

Cloud Optimization for Service Providers

CHALLENGES

• Rising access time

• High document processing time

• A large number of documents

• Growing size of documents

“The most impressive thing with

ECS was the fact that real-life

performance appeared twice as

high and more effective.

Vadim V. Chicherini

Data Center Director

Tenzor

Video Testimonial

RESULTS

• 1 million clients with hundreds of millions of

files

• Reduced latency

• Improved SLAs to customers

• Improved data center performance

Page 25: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

Questions ?

Page 26: Speed up Digital Transformation with Openstack Cloud & Software Defined Storage