Why Software Defined Storage is Critical for Your IT Strategy

October 4, 2016 | Jakarta, ASEAN

WHY SOFTWARE-DEFINED STORAGE IS CRITICAL

FOR YOUR IT STRATEGY

Rahul Vijayan

Senior Solutions Architect, ASEAN, Red Hat

Development

Model

Application

Architecture

Deployment

& Packaging

Application

InfrastructureStorage

Waterfall

Agile

DevOps

Monolithic

N-tier

Microservices

Virtual Services

Containers

Bare Metal

Hosted

Hybrid Cloud

Data Center

Scale Out

Software-Defined

Storage

Scale Up

DATA CENTER EVOLUTION

EVOLUTION

Virtualize

KVM

RHV

RHV-S (Hyper-Converged)

ITaaS

OpenStack

Ansible

Cloud Forms

DevOps

Containers

OpenShift

Hybrid Cloud

Software Defined Storage

BI-MODAL

HYPERVISOR

OS

APP

OS

APP

OS

APP

Backup

OS

APP

SWIFT

REST

OBJECT

APP

CON

OS OS OS

APP

CON

APP

CON

APP

CON

APP

CON

APP

CON

iSCSI

FILE

NFS

MODE 1 MODE 2

SVR SVR SVR

NFS NFS

SVR SVR SVR

NFS NFS NFS

FILE

SDS

CIFSNFS

OSP

KVM

OS

APP

OS

SVR SVR

OS

APP APP

CLOUD FORMS / ANSIBLE – Dashboard, Self-Service, Config Management, Automation, Orchestration

RHV-S

SDS

RDB

OBJECT

iSCSI

FILE

NFS

CINDER

CAPACITY

PERFORMANC

E

NEXT-GENTRADITIONAL

WORKLOADS

FileOpenStack

Virtualization

ContainersHPC

Analytics

Object

Storage

Web Apps

DevOps

NoSQL

Hadoop

Broadcast

Content

DeliveryMedical

Imaging

CCTV

Archive

Backup

RDBM

S

RED HAT STORAGE PORTFOLIO

PHYSICAL VIRTUAL PRIVATE CLOUD CONTAINERS PUBLIC CLOUD

Red Hat Enterprise Linux + KVM

o Basic KVM hypervisor.

o No centralized management.

o Max 4 VMs per host.

o No enterprise features.

Red Hat Virtualization

o Centralized management for KVM,

compute, network, storage.

o Unlimited VMs per host.

o Enterprise features: HA, DR, Live

Migration.

WHAT IS RED HAT VIRTUALIZATION?

QUMRANET

ACQUISITION

2009 2012 2014 2016

2010 2013 2015

RHEV BEATS

VMWARE

on the

SPECvirt_sc2010

benchmark on both

speed and scale

RHEV 3.0

More solution

partners

RESTful API

Memory

overcommit

RHEV 3.1, 3.2

Windows guests

NUMA

collaboration with

HP

RHEV 3.3, 3.4

OpenStack Neutron

integration

Hot Plug CPU

Affinity

management

IBM Power support

RHEV 3.5

Integration with

Red Hat Satellite

RHV 4.0

10th product

release

RHEV 3.6

v-2-v tool, Migrate

workloads directly

from vSphere into

RHEV_M

RED HAT VIRTUALIZATION MILESTONES

RED HAT VIRTUALIZATION CUSTOMERS

o Software only with Reference

Architecture and deployment tool (L.A.)

o 3-node POD with 3-way replica, Self-

Hosted Engine

o Ansible based gdeploy tool (RHGS

3.1.3)

o Red Hat Directory Services

o Native File Server Capabilities

o Consolidated Backup to Central DC

RED HAT VIRTUALIZATION-S

HYPER-CONVERGED

RED HAT VIRTUALIZATION-S

Component Small Medium Large

Server Chassis 2u 2u 3u

CPU 2 x 6c - e5 2630 v2 2 x 6c - E5-2620 v3 2 x 8c - E5-2630 v3

RAM 64 128 256

Network 2 x 10Gb, 1 x 1Gb, 1 x IPMI 2 x 10Gb, 1 x 1Gb, 1 x IPMI 2 x 10Gb, 2 x 1Gb, 1 x IPMI

RAID RAID-6, FBWC, 1GB RAID-6, FBWC, 1GB RAID-6, FBWC, 2GB

HDD’s 8 - 6+2 12 - 8+2, 1-2HS 16 - 10+2, 1-4HS

HDD Type 3.5” SAS 7K 3.5” SAS 7K 3.5” SAS 7K

SSD/NVMe (optional) 1-2 1-2 1-2

Usable Capacity 12TB - 48TB 16TB - 64TB 20TB - 80TB

o Modular IaaS Architecture

o Easily scale-out

o 1,000's → 10,000's → 100k's of VMs

o Automation, Orchestration, Provisioning

o Public cloud-like capabilities for datacenter

o Removes vendor lock-in

WHAT IS OPENSTACK?

CEPH WITH OPENSTACK

CEPH & OPENSTACK

HYPER-CONVERGED

Server #1

KVM Hypervisor

Nova Compute

Cinder Volume

Server #2

KVM Hypervisor

Nova Compute

Cinder Volume

Server #3

KVM Hypervisor

Nova Compute

Cinder Volume

Server #N

KVM Hypervisor

Nova Compute

Cinder Volume

o 64TB Ceph included

o Cloud Forms included

o Backup snapshots

o Scaled API – Cinder backup

decoupled from Cinder volume

o Volume Replication API

o CephFS native driver - manila

RED HAT CLOUD FORMS

RED HAT CEPH

Workload IO Profiles

WorkloadExamples

Searchable Examples

Workload IOCharacteristics

HardwareCharacteristics

IOPS• MySQL

• MariaDB• PostgreSQL

• Medallia • High IOPS/GB• Low latency

• Compute servers

• 10GbE• NVMe SSD

Balanced/Throughput

• Digital media

serving

• Server virtualization(OpenStack Cinder)

• Bloomberg

• Target

• Walmart• Facebook

• High MB/s• Larger sequential IO

• Storage servers

• 10GbE to 40GbE• HDD/SSD

Capacity-Archive

• Digital media

archive

• Object archive• Big Data archive

• Yahoo• CERN

• Low cost/GB

• Sequential IO

• 90/10 write/read mix

• Dense storage servers

• 40GbE• HDD

CEPH CUSTOMER EXAMPLES

CONTAINERS (WHAT)

o Offers persistent storage to

applications running in containers

o Applications and storage can co-exist

on the same hardware

o Allows for higher server utilization and

lowers operational costs

o Storage generates only 3%–10%

overhead on converged servers

CONTAINER-CONVERGED - APLO

CONTAINERNGINIX

CONTAINERMASTER

Node 2 Node 3

Node 1

Node 4

NGINIX

CONTAINER

POSTGRES

CONTAINER

Deploys storage alongside

applications in containers

Lowers TCO by increasing

utilization of resources

Unifies container and storage

orchestration

Allows for rapid adjustments to

compute/storage ratio

IO Profile IOPS

4K 100% Random Read 1.35 Million

4K 100% Random Reads 1.15 Million

4K 100% Random Write 200K

4K 70% / 30% Read/Write OLTP Mix 452K

5* SuperMicro servers

Each with 4 NVMe cards

72 cores , 128 GB RAM

PERFORMANCE NUMBERS

IO Profile IOPS

4K Random read 1.1 Million

64K Random read 198K

256K Random read 25.9K

4K Random write 54K

Single IF100

8 OSD nodes

8 * 64 TB OSD's

0

0.01

0.02

0.03

0.04

0.05

0.06

0.07

RGT-200(SF) RGT-200(LF) RGT-400(LF) RGC-200 RGC-400

$ per GB per month

Premium Premium + QCT Standard Standard + QCT AWS Isilon VNX

STORAGE ECONOMICS

QCT: 3 year basic warranty, ex freight and tax.

Backup VOD Digitization

Medical Records Active ArchivesSync and Share

Surveillance Photos DB Dumps

GENERIC WORKLOADS

CCTV SOLUTION

Monitoring Stations

IP Cameras

Video

Management

Server

Remote MonitoringRemote Sites

Off-Site

Replica

BROADCAST SOLUTION

Satellite

Content Delivery

Server

Rendering, Compositing,

Transcoding

Mobile IPTV

WANAuto

Tiering

Playout

Servers

Content Creation and Editing

Remote Branches

Content Ingestion

Cloud

Digital TV

Workflow

Content Distribution

bit.ly/cephtestdrive bit.ly/glustertestdrive

TEST DRIVES

Point 1 on Red Hat Consulting…

Point 2 on Red Hat Partners…

VIRTUALIZATION. KVM. RHV. OPENSTACK. NFV. STORAGE. CONTAINERS.

DEVOPS.

RED HAT CONSULTING & PARTNERS

DISCOVERY SESSIONS WORKSHOPS IMPLEMENTATION

Establish a unified

culture and strategy

Construct environments

and development

pipelines

Design microservices

and containerized

applications

Establish and adapt

security, compliance,

scaling and monitoring

standards

Improve operational

efficiency, scalability and

flexibility

partner.redhat.com

plus.google.com/+RedHat

linkedin.com/company/red-hat

youtube.com/user/RedHatVideos

facebook.com/redhatinc

twitter.com/RedHatNews

THANK YOU

Why Software Defined Storage is Critical for Your IT Strategy

Technology

Transcript of Why Software Defined Storage is Critical for Your IT Strategy