Speed up Digital Transformation with Openstack Cloud & Software Defined Storage
-
Upload
matthew-sheppard -
Category
Technology
-
view
64 -
download
1
Transcript of Speed up Digital Transformation with Openstack Cloud & Software Defined Storage
Mirantis Overview
● Leading OpenStack
distribution
● Plan, architect,
implement with focus
on business outcomes
● Fully managed
OpenStack with up
to 99.99% SLA
guarantee
● Clouds, tooling, and
Ops Team 100%
focused on
OpenStack success
● Co-manage for a fixed
period
● Train and certify customer
ops team on your terms
● Transfer to customer
support
Build Operate Transfer
#1 $200M Source of the source
code: Top contributor Mitaka Release
Well funded
700+ Employees
• Open Source: Huge community of supporters ensuring low costs
• Enable: Modular, scalable and flexible utilities offering efficiency and agility
• Decoupling: complete hardware vendor independence and no vendor lock-in
• Integrated: Scale out Storage (e.g. ScaleIO, ECS) and Software Defined Networking
• Interoperability: Open-Source APIs offer full manageability in hybrid IT landscapes
• Proven: Operated at many companies clouds (AT&T, Volkswagen, …)
• Ease of integration: supported by all major vendors (e.g. Dell EMC, VMware, HP, …)
Why Mirantis?
• Proven at joint Customers
• Broad Integration: Pluggable support for ScaleIO, XtremIO, Unity, VNX
• Validated: EMC Storage Solutions with Mirantis OpenStack reference architecture
https://www.mirantis.com/partners/dell-emc/
Dell EMC and Mirantis
• Web/Cloud native apps: Microservices, containerized, User generated content
• Data analytics: In memory processing (Kafka, Spark), batch processing (Hadoop)
• Telco: Network function virtualization (NFV), Cloudify orchestration
• Upcoming: IoT, HPC
Use Cases of OpenStack
https://codedellemc.com
What is Dell EMC ScaleIO?
• Installs on industry-standard x86 servers that run databases,
hypervisors, or any other applications
• Aggregate applications servers’ local disks
• Add storage and/or compute on the fly
Software that uses application servers to create an elastic, scalable, and resilient server SAN at a fraction of the cost and complexity of traditional SANs
ScaleIO Software
Minimal footprint:
• 1 GB RAM
• Max 10% cpu for all HDD configurations
• Max 20% cpu for all flash configurations
Big results!
© Copyright 2015 EMC Corporation. All rights reserved.
ENTERPRISE FEATURES
SNMP &
Call Home
OpenStack, vSphere, Xen,
Hyper-V, Bare metal Windows &
Linux
Data-at-Rest-Encryption
& Certificate
Authentication
Protection Domains &
QoS Controls
DRAM Cache &
Read Flash Cache
Checksum &
NDU Rack Level
High Availability
Automatic
Rebalance &
Rebuild
Thin Provisioning Writeable
Snapshots &
DR with RecoverPoint
APP 1
APP 2
APP 3
PERFORMANCE INTEROPERABILITY MONITORING FAULT TOLERANCE RESILIENCY
MULTI-TENANCY PROTECTION SECURITY ELASTICITY EFFICIENCY
• ScaleIO integrated with OpenStack since Havana
• Full contribution and integration since Liberty
• Cinder (block) & Nova (compute) drivers
• Mirantis Fuel Plugins
• Canonical Juju Charms
• More partner extensions to come…
SCALEIO & OPENSTACK
OPENSTACK EXTENSIONS FOR SCALEIO
• Why create the extensions? – Orchestrates ScaleIO deployments along with all other OpenStack components
– Makes storage much simpler to deploy
– Provides the user with a unified experience
– Enables OpenStack customers to get to production with ScaleIO faster
• What do they do? – Deploys all components of ScaleIO with few inputs
– Deployment is done using the native framework of that distribution
– Deploys ScaleIO in a consistent way that should provide stability to the entire
deployment
PARTNER EXTENSIONS
Key ScaleIO Software Defined Storage takeaways: • Reliable
– Rock solid Software Defined Storage which easily support 5x9’s or higher levels of availability. Easy to manage and upgrade.
• Flexible – Scale-up & down, support multiple environments: VMware, Hyper-V, OpenStack & bare metal with one
solution.
– Easy to scale, supporting cloud infrastructure requirements
• High Performance with tiny footprint: http://www.storagereview.com/node/5992 – Fastest most scalable storage solution, virtually no limits, sub ms RT with SSD/Flash
– Predictable performance no matter the application type (scale-out & scale-up!)
– 10-20% cpu & memory 10’s of MB’s to a few GB drives record breaking performance
• Highly scalable – Start small grow big without worry
– Scale compute & storage independently
• Tremendous value – 505% ROI -> source IDC paper https://www.emc.com/collateral/white-papers/idc-business-value-of-vxrack-
and-scaleio.pdf
What is ECS ?
Turnkey
Appliance
Dedicated Hybrid
Cloud ECS Software
Multi-tenant Storage
Cloud
Magic Quadrant for Distributed File Systems and Object
Storage
– October 2016
Dell EMC has two products that are included in this research:
Dell EMC Isilon and Dell EMC Elastic Cloud Storage (ECS). With
Isilon, a mature scale-out NAS product with deployment across
many enterprises and service provider verticals and
geographies, end users consolidate large datasets onto one
distributed file system for high scalability and throughput. ECS is
a platform that supports object, NFS and Hadoop Distributed File
System (HDFS), with the ability to store billions of objects for
cloud-native applications.
https://www.gartner.com/doc/reprints?id=1-
3HYASF6&ct=160919&st=sb
Gartner Magic Quadrant
2MB Buffered Writer
Box-Carting High performance and low overhead for both small and large objects
15
A A
A
Store
objects in
chunks on
disks Add parity
Delete
original
chunks
In memory
Requests
Geo Capabilities High durability with a low overhead
16
A
A
B
B
C
A
PUT obj1 (1 MB)
PUT obj2
GET obj1 GET obj1
Replicate
the 128 MB
container
XOR reduction obj1 (1 MB) Read the
Object from
Site-1
Cache the
128 MB chunk Read from
the cache
B
Multi-Protocol Support Access the same data from any access method
17
• Atmos: version 2.0
support for upgrade
• CAS: SDK v3.1.54 or
later support for upgrade
• Swift: byte range update
within an object
• Retentions
• Keystone integration:
drop-in replacement for
OpenStack Swift
• Primary file system with
native Ambari 2.2
integration
• Byte range updates
• Retentions
• Metadata search
extension
• NFS v3
• Global namespace with
global locking
XXXXX
Remove the cost and complexity of external databases
18
Save objects with metadata
Search objects using GPS coordinates, image resolution, …
/?query=x-amz-meta-image-gps-latitude>50&…
Metadata search
– Integration with Open Stack Keystone V3
API
– ECS consumes keystone tenancy and
identity model › ECS Swift registers as service with Keystone
› Enforcement of service policies
– A drop-in replacement for OpenStack Swift
– A repository for Glance images
– A target for Cinder backups
Features
Key Benefits
ECS & Openstack
What about PaaS & Linux containers NoSQL is often the first option used to store unstructured content
Linux
containers
But is NOSQL the right solution ? Not really
• NOSQL DB are designed to store XML documents,
metadata, …
• But, they are not efficient to store unstructured content (ex:
they protect data by creating several replicas)
• And they are in the data path
• Object storage is the de facto solution
XXX
XX
Sensors
Distributed messaging system
Analytic frameworks
Web servers
Code
Artifacts
Images
Images
App servers
Logs
Backups
XXX
XX
Sensors
Distributed messaging system
Analytic frameworks
Web servers
Code
Artifacts
Images
Images
App servers
Logs
Backups
Cloud Optimization for Service Providers
CHALLENGES
• Rising access time
• High document processing time
• A large number of documents
• Growing size of documents
“The most impressive thing with
ECS was the fact that real-life
performance appeared twice as
high and more effective.
Vadim V. Chicherini
Data Center Director
Tenzor
Video Testimonial
RESULTS
• 1 million clients with hundreds of millions of
files
• Reduced latency
• Improved SLAs to customers
• Improved data center performance
Questions ?