IBM® Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

download IBM® Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

of 70

Transcript of IBM® Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    1/70

    2013 IBM Corporation

    Creating Better Storage Efficienciesthrough Virtualization, Compression andFlash Technology

    Richard Swain IT Storage Specialist

    Friday, May 31, 2013

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    2/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    17 years in IT 10 in Storage

    Certified Storage Specialist

    Netapp Certified Technologist

    Microsoft Certified Professional

    Blog: The Storage TankTwitter: IBMRich

    [email protected]

    2

    Richard (Rich) SwainIT Storage Specialist

    http://localhost/var/www/apps/conversion/tmp/scratch_1/thestoragetank.wordpress.comhttp://localhost/var/www/apps/conversion/tmp/scratch_1/thestoragetank.wordpress.com
  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    3/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    3

    Moores Law, Gordon Moore Co-Founder of IntelThe number of transistors on integrated circuits doublesapproximately every two years

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    4/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    4

    Kryders Law: Mark Kryder, CTO SeagtateThe density of hard drives increases by a factor of 1,000 every10.5 years (doubling every 13 months).

    next goal:a terabit per

    square inch

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    5/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    5

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    6/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    6

    Moore vs Kyder Results

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    7/70 2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    7

    Capacity VS Throughput

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    8/70 2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    Demand for storage is continuing to rise

    Drives are becoming larger and out pacing the processing power

    Throughput is not scaling compared to drive size

    As drives become larger, fewer drives can be used driving down total IOPS

    8

    What does this all mean?

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    9/70 2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    9

    Virtualization

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    10/70 2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    Whats a Storage hypervisor?

    Server hypervisorhas a well understood value connotation Pooled physical resources are consumed by virtual machines resulting in

    high asset utilization

    Virtual machines are mobile giving CIOs their choice of physical serverdevice

    A common set of value capabilities and centralized management are

    provided for virtual machines regardless of what physical server they aresitting on

    Storage hypervisor is a rapidly emerging way of describing the samevalue points in a storage context

    On Intel systems

    server virtualization platform (VMware vSphere or Red Hat EV) and

    server virtualization management (VMWare vCenter or Red Hat EV Manager)

    On Power systems

    server virtualization platform (IBM PowerVM) and

    server virtualization management (IBM Director VMControl)

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    11/70 2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    Pooled Physical Resources

    Dramatically improve utilization

    of your physical storage assets

    How? Pooled physical

    resources from virtually any disk

    array vendor or tier

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    12/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    Common Capabilities

    Deliver tier-1 service regardless

    of hardware choice

    How? Common capabilities

    delivered by the storage

    hypervisor

    I/O caching, thin

    provisioning, automated

    tiering, application-integrated

    snapshot and mirroring,

    mobility-driven disruption

    avoidance

    The desired service is delivered by

    the Storage hypervisor independent

    of the underlying hardware platform.

    SLA (Service Level Agreement) is

    encapsulated with the data in a

    virtual volume.

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    13/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    Mobility

    Balance workload, manage lease

    termination, improve datacenter

    performance

    How? Mobility of virtual volumes

    between any physical disk arrays

    Move on the fly, snapshot or

    mirror between arrays

    In a single physical

    datacenter or across twophysical datacenters up to

    300km apart

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    14/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    Centralized Management

    Optimize your people for the

    challenges of day-to-day

    operations

    How? Centralized management

    Visualization, health,

    capacity, performance

    Storage services catalog,

    automated provisioning, pay-

    per-use

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    15/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    15

    Compression

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    16/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    IBM Real-time Compression

    Primary Storage Efficiency

    Compelling Compression rates

    Reduces your overall cost per

    TB Immediate results!

    Compression Capability

    0%

    50%

    100%

    85%

    Databases E-Mail

    85%

    50%

    Virtual Servers

    75%

    85%

    TextDatabaseLogs

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    17/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    Integrated IBM Real-time Compression

    Expected Compress ion Rat ios

    Uses same proven Random-

    Access Compression Engine

    (RACE) as IBM RTC Appliances

    Delivers very similar levels ofcompression

    IBM Compresstimator tool can

    be used to evaluate expected

    compression benefits

    DB2 and Oracle databasesUp to

    80%

    Virtual

    Servers(VMware)

    Linux virtual

    OSes

    Up to

    70%

    Windows

    virtual OSes

    Up to

    50%

    Office

    2003Up to

    60%

    2007 or later

    Up to

    20%

    CAD/CAMUp to

    70%

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    18/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    Integrated IBM Real-time Compression

    986 982

    2459

    987 988

    2926

    0

    500

    1000

    1500

    2000

    2500

    3000

    3500

    Oracle TPC-C DB2 TPC-C Exchange

    Jetstress

    IOPS

    No Compression Compressed

    Comp ress ion wi thout Comprom ise

    Compress active

    primary data

    Operates immediately

    and does not require

    additional reserve space

    Increase value of new

    and old storage

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    19/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    Storwize V7000

    with Real-time

    Compression delivers

    up to 4x compressionwhile maintaining

    VMware and

    Application

    performance

    VMware Vmark Performance Benchmarks

    MailServer Score MailServer Qos

    OLIO QosOLIO Score

    19

    Compression Without Compromise VMware

    Uncompressed

    Compressed

    Measured Score(Performance)

    0

    100

    200

    300

    400

    Uncompressed

    Compressed

    Uncompressed

    Compressed

    0

    1000

    2000

    3000

    4000

    Measured Score

    (Performance)

    0

    10

    20

    30

    40

    50

    Measured Qos(Response Time)

    Uncompressed

    Compressed

    Measured Qos

    (Response Time)

    010203040

    506070

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    20/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    0

    .8

    1.2

    .4

    The benchmark was performed using a Storwize V7000 system with 48 x 300GB SAS disks. 1.2TB database with 700

    concurrent clients were used in the benchmark. The same test was performed

    with compressed volumes and non-compressed volumes.

    Stock Level

    ResponseTimein

    Seconds

    Delivery Order Status

    No Compression - 96 disks1.144

    .857

    .468

    Database Performance

    Storwize V7000 with

    Real-time

    Compression delivers

    up to 5x compression

    while maintaining or

    improving database

    transaction responsetime and overall

    business throughput

    Compressed 48 disks

    .701.665

    .385.46

    .20

    .501

    Compressed 6 Flash Drives

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    21/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    Must decompress

    entire file to editNo need to decompress

    data to modify data

    No application

    performance impact

    The only storage

    compression solution

    that works in real time

    on active data

    Traditional Approaches Real-time Compression

    100 byte update

    1 MBchunk

    Much more I/O

    No way to make real-time

    Much more CPUwork

    Network impact

    Real-time Compression - Performance Differentiation

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    22/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    22

    SystemFlash

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    23/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    Target the bottleneck in the IT stack

    In the past 10 years:

    CPU speed performance increased ~8-10x

    DRAM speed performance increased ~7-9x

    Network speed performance increased ~100x

    Bus speed performance increased ~20x

    Disk speed performance increased ONLY 1.2x

    Storage disk speed is the bottleneck thats slowing everything else in the IT stack

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    24/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    Flash delivers performance and value to boost the critical applications

    running your business

    Extreme performance: Serve customers faster

    MicoLatency: Gain competitive advantage

    Macro efficiency: Do morethings at once

    Low TCO: Save money and boostvalueEnterprise reliability: Go the distance

    Eliminate the storage-tier bottleneck and drive efficiency

    across the entire data path!

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    25/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    Flash use cases

    Consolidation End-user experience

    maximization

    Price/performance

    economics attainment

    Developer timeoptimization

    Applicationscalability

    Footprintminimization

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    26/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    85% reduction

    in batch processing

    times

    90% reduction

    In OLTP times

    25-100 s latency

    for deterministic

    performance

    80% reduction

    In energy usage

    Flash benefits

    75% reduction

    in footprint

    Store one petabyte inone floor tile, add

    compression and add

    up to 100% more

    Enterprise

    reliability

    High availability,2D RAIDTM and

    Variable Stripe

    RAIDTM (VSR)

    Boost performance/efficiency without re-architecting applications or the

    storage infrastructure

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    27/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    Compare flash performance / efficiency

    Performance Flash can service up to 5.9M IOPS

    Disk requires over 98 racks of 15K RPM drives

    Nearly a 200:1 performance/capacity advantage

    Density

    Flash provides 500TB of usable capacity

    Disk requires almost 4.5 racks of 600GB drives

    Nearly a 9:1 capacity/rack space advantage

    Environmental

    Flash uses

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    28/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    Flash works now

    Supplement your existing infrastructure

    Assign flash the heaviest, most critical workload

    Decrease overall response times

    Increase efficiency/utilization across the IT stack

    Completely eliminate storage performance issues

    So whos using flash now? How has it helped their business?

    Remove the IO bottleneck!

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    29/70

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    30/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    Storage disk latency drives CPU utilization/efficiency lower

    1. Issue I/O request (~ 100 s)

    2. Wait for I/O to be serviced (~ 5,000 s)

    3. Process I/O (~ 100 s)

    Time to process 1 I/O request = 100 s + 5,000 s + 100 s = 5,200 s

    CPU utilization = Wait time / Processing time = 200 / 5,200 = ~4%

    Time

    Processing

    ~100s ~100s

    Waiting

    ~5000 s

    CPU state

    1 I/O request

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    31/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    Time

    Processing

    ~100s ~100s

    Waiting

    ~200 s

    CPU state

    1 I/O request

    1. Issue I/O request (~ 100 s)

    2. Wait for I/O to be serviced (~ 200 s)

    3. Process I/O (~ 100 s)

    Time to process 1 I/O request = 100 s + 200 s + 100 s = 400 s

    CPU utilization = Wait time / Processing time = 200 / 400 = ~50%

    Flashs microlatency drives CPU utilization/efficiency higher

    Speed application

    response up to 12x

    simply by changing

    storage latency!

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    32/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    The real cost of latency

    The world's biggest e-tailer estimates that

    every millisecond delay to its online service

    costs it $4.8 million in lost sales

    Source: Richard Irving Capacity Magazine

    In the financial sector, which relies on ultra-

    low-latency networks to drive low-risk,high-volume trading profits, a 1 millisecond

    (ms) advantage could be worth upwards of

    $100 million a year

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    33/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    33

    SVC, RTC & SystemFlash

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    34/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    34

    IBM Smarter Storage is an approach for the design and deploymentof storage

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    35/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    35

    IBM XIVTM

    Virtual

    Disk

    Virtual

    Disk

    Virtual

    Disk

    Virtual

    Disk

    SAN

    SAN Volume Controller

    Advanced Copy Services

    Storage Pool

    HP

    EM

    CDS4000

    DS8000

    HDS

    Combine the capacity

    from multiple arrays into a

    single pool of storage

    Apply common

    copy services

    across the storage

    pool

    Manage the storage

    pool from a central

    point

    Make changes to the

    storage without

    disrupting host

    applications

    Flexibility to auto or

    manually migrate full

    volumes to meet needs

    SAN Volume Controller is a key element of IBM Smarter Storage

    Virtualize IBM and non-IBM disk systems to increase uti l ization by up to 30%

    SVC is designed to pool storage volumes into a reservoir of capacity forcentralized management. SVC

    helps to hide the boundariesamong disk systems, which simplify managementand enables customers

    to focus on managing storage as a resource to meet business requirements and not as a set of boxes.

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    36/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    36

    SVC 6.4 Supported Environments

    * Confirm all supported configurations at ibm.com/storage/support/2145and click on

    Support

    8Gbps SAN fabric

    HPMA, EMAMSA, EVA,XP, P9500,3Par

    HitachiLightningThunderTagmaStoreAMS, WMS,USP, USP-VVSP

    EMCCLARiiON

    CX4,

    Symmetrix,

    DMX, VMAX,

    VNX, VNXe

    Microsoft

    WindowsHyper-V

    IBM Power

    IBM AIXIBM i 6.1

    (VIOS)

    Solaris

    HP-UX 11i

    Tru64OpenVMS

    Citrix Xen

    Server

    IBMBladeCenter

    Flex System

    PureFlex

    SANContinuous CopyMultiple Cluster Mirror

    Metro/Global Mirror

    Stretched Cluster

    VMware

    vSphere 4, 5

    Point-in-time CopyFull volume, Copy on write256 targets,Incremental, Cascaded, Reverse,Snapshots, FlashCopy Mgr

    NovellNetWare

    OES2

    SunStorageTek

    StorEdge

    IBM

    DSDS3000, DS4000

    DS5000, DS6000

    DS8000

    1024Hosts

    IBMN series

    Storwize V7000

    NetAppFAS

    XioTechEmprise

    SGI IRIXIBM TS7650GProtecTIER

    Gateway

    FujitsuEternus

    NexSANSATABeast

    NECiStorage

    BullStoreway

    Thin Provisioning

    Virtual Disk Mirroring

    Apple

    Mac OS

    IBM

    XIV

    DCS9XXX

    IBM

    z/VSEz/VM

    z/Linux

    iSCSI or FCOE1Gb or 10Gb

    CompellentFluid Data

    Violin

    Linux

    (Intel/Power/z)

    RHEL 4/5/6

    SUSE 9/10/11

    Internal SSDEasy Tier

    TMSRamSAN

    PillarAxiom

    Real-time Compression

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    37/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    37

    20032145-4F24 node

    1.1 1.2 2.1 3.1 4.1 4.2 4.3 5.1 6.1

    10 Years of SVC history; A Continuous Evolution

    6.2

    20048 nodes

    20042145-8F2VSSGDS

    2006

    Global Mirror

    Multi-target

    FlashCopy

    2008

    Thin provisioning

    vDisk Mirroring

    SVC Entry Edition

    2010Storwize V7000New GUIEasy Tier

    20052145-8F4

    2007

    2145-8G4

    FlashCopy

    enhancements

    2009

    2145-CF8

    SSD support

    3 site Mirror

    > 2TB VDiskSplit cluster

    iSCSI

    Zero detect

    2011

    2145-CG8

    VAAI

    >2 TB MDisk

    Performancemonitor

    Flash Copy

    enhancements

    6.2 6.4

    2012

    Real-time

    CompressionNon-disruptive

    volume moveFCoE

    4 way Storwize

    V7000 clustering

    6.3

    2011

    Storwize V7000Unified

    Mixed Replication

    Longer distancesplit cluster

    Native LDAP

    New Global Mirror

    option

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    38/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    38

    SVC 2145-CG8 engine based on IBM System x3550 M3 server (1U) Intel Xeon 5600 (Westmere) 2.53 GHz quad-core processor 24GB of cache Four 8Gbps FC ports

    Supports up to four internal 146GB SSDs

    Optional 10 Gb Ethernet support for 10 Gb iSCSI host attachment and future FCoEsupport

    Two 10Gb ports per storage engine Storage engine supports 10Gb iSCSI or internal SSDs but not both Factory install or nondisruptive field upgrade

    Engines may be intermixed in pairs with other engines in SVC clusters Mixing engine types in a cluster results in volume throughput characteristics of the

    engine type in that I/O group

    Cluster non-disruptive upgrade capability may be used to replace older engines withCG8 engines

    Replaces the SVC 2145-CF8 engine

    3838

    IBM System Storage SAN Volume Controller

    10Gbps

    iSCSI

    1Gbps

    iSCSI

    8Gb

    ps

    FC

    10Gbps iSCSI

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    39/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    39

    IBM Easy Tier delivers optimized high performance

    Dynamically re-distributes active data

    across a hybrid storage pool of Solid-State Devices (SSDs) & hard disks basedon workload characteristics

    Monitors access to extents and analyseshistory to promote hot extents anddemote inactive ones

    Supports both internal SSDs and SSDs in

    virtualized disk systems

    Helps improve storage system

    performance

    Helps reduce cost by automatically

    placing only most active data on SSD,

    reducing need for SSD capacity

    Easy Tier can improve throughput up to200%and reduce response time up to

    30%with only about 10%of total capacity

    on SSD*

    SSD HDD

    Host Volumes & Extents

    Hybrid storage pool

    Automatic extent migration

    Host Host Host

    * IBM measurements

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    40/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    40

    Improving Application Test with SEFC

    Production systems often have many testsystems that are replicas of production

    SAP is known for often having large number

    of copies

    Using thin provisioned FlashCopy to create

    replicas could significantly reduce storage

    In this example, use fully-allocated test

    master to isolate test systems from

    production disk

    Production and test could be on separate

    disk systems

    Test master can be used to reset test virtual disks after test runs

    Implementation uses snapshots, cascaded, and multi-target FC

    This example uses around 2x production data

    Compare with 5x for regular FlashCopy

    SE

    FAFA

    SE

    SE

    SE

    Production

    Testmaster

    copy

    Test

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    41/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    41

    SVC stores two copies of a virtual disk, usually on separate disk systems

    SVC maintains both copies in sync and writes to both copies If disk supporting one copy fails, SVC provides continuous data access

    by using other copy

    Copies are automatically resynchronized after repair

    Intended to protect critical data against failure of a disk system or diskarray

    A local high availability function, not a disaster recovery function Copies can be split

    Either copy can continue as production copy

    Either or both copies may be space-efficient

    Virtual Disk Mirroring

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    42/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    42

    Greater Flexibility for Remote Mirror

    Global Mirror or Metro Mirror

    SVC remote mirror now supports replication to/from

    Storwize V7000 systems

    Enables lower cost DR configurations by mirroring

    directly to Storwize V7000 disk system without need

    for second SVC system

    Provides options to redeploy existing storage toextend life and enhance value

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    43/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    43

    2-site Stretched Cluster

    Improved Data Protection with SVC Enhanced Stretched Cluster

    Improve availability, load-balance, and

    deliver real-time remote data access bydistributing applications and their data

    across multiple sites.

    Seamless server / storage failover when

    used in conjunction with server or

    hypervisor clustering (such as VMware or

    PowerVM)

    Up to 300km between sites (3x EMC VPLEX)

    Metro or Global Mirror

    4-site Disaster Recovery For combined high availability and disasterrecovery needs, synchronously or

    asynchronously mirror data over long

    distances between two high-availability

    stretch clusters.

    High Availability High Availability

    Disaster Recovery

    Data center 1 Data center 2

    Server Cluster 1 Server Cluster 2

    SVC

    Stretched-cluster Stretched

    virtual volume

    Failover

    Data center 1 Data center 2

    Server Cluster 1 Server Cluster 2

    Stretched

    virtual volume

    Failover

    Data center 1 Data center 2

    Server Cluster 1 Server Cluster 2

    Stretched

    virtual volume

    Failover

    Up to

    300km

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    44/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    44

    IBM SAN Volume Controller Enhancements

    Integrated IBM Real-time Compression

    Improves efficiency with up to 80% reduction in physical disk space

    required enabling up to 5x data in the same space

    Lower rack space, power, and cooling

    Applicable to much wider range of data than alternative options

    Significantly enhanced value for existing storage Nondisruptive volume move

    Rebalance workload across complete systems without disruption

    Support for Fiber Channel over Ethernet (FCoE)

    Supports next-generation converged data center networking

    Continuing SVC leadership in storage vir tuali zation

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    45/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    45

    Nondisruptive Volume Move

    SVC supports moving a volume

    without disruption from one storagepool to another

    Includes moving between

    internal and external virtualized

    storage

    A volume is presented to servers by

    a single I/O group

    Now,a volume can be movedfrom one I/O group to another

    without disruption to

    applications

    Supports load balancing across an

    entire system

    Helpful when adding I/O groups toan SVC system

    Initially supported with RedHat 6.1

    and SLES 11

    Working on AIX, VMware,

    Windows 2008

    Control EnclosureControl Enclosure

    Move virtualvolume

    Move volume between storage pools

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    46/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    46

    SVC FCoE Support

    SVC offers extensive support for FCoE enabling full use of converged

    networks

    Also supports migration from Fibre Channel networks

    SVC supports FCoE with 10Gb Ethernet ports on Model CG8 engines

    Existing SVC engines may be upgraded with 10Gb Ethernet without

    disruption

    These ports may be used simultaneously for both FCoE and iSCSI

    server attachment

    SVC supports FCoE for all the same functions that FC is supported

    FC Host connected to SVC (either FC or FCoE ports)

    FCoE Host connected to SVC (either FC or FCoE ports)

    SVC (FC or FCoE ports) connected to storage system FC ports

    SVC (FC or FCoE ports) connected to storage system FCoE ports In an SVC system, communication among I/O groups using any

    combination of FC and FCoE ports

    For remote mirroring, between systems using any combination of FC

    and FCoE

    C S ff C

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    47/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    47

    Compression Without CompromiseEnhancing SVC to Deliver Extraordinary Efficiency

    Introducing IBM SAN Volume Controller Real-time Compression

    Innovative, easy-to-use compression fully integrated into SVC

    High performance implementation supports active primary workloads

    Real-time Compression builds on storage efficiency advantages of SVC

    SVC Real-time Compression delivers up to 50% or better compressionfor data that is not already compressed

    Compression helps reduce

    Storage purchase costs

    Rack space

    Power and cooling

    Software costs for additional functions

    Compression can help freeze storage growth or delay needfor additional purchases

    C ti B tt St Effi i i th h Vi t li ti C i d Fl h T h l

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    48/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    48

    Compression Without CompromiseVariable Sized Compression Enhances Performance and Efficiency

    RACE flips this approach, taking a variable datastream and producing a fixed output

    Compressed volume has a consistent logical

    layout

    Temporal locality: data thats accessed together

    is compressed together

    Variable sized input chunks get bettercompression

    Less data is compressed and decompressed

    Fewer disk I/Os

    Better performance

    Original I/O

    Map

    Real-time Compression

    Compressed

    volume

    Variable input Fixed output

    100 byteupdate

    1 MBchunk

    TraditionalCompression

    IBM Real-timeCompression

    1 MB Read 0 MB Read

    1 MB Decompress 0 MB Decompress

    100 ByteUpdate

    0 ByteUpdate

    1 MBCompress

    100 ByteCompress

    1 MB Write

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    49/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    49

    Compression Without CompromiseEasy to Understand: Effectiveness

    Compression effectiveness displayed for system overall, pools, and volumes

    Creating Better Storage Efficiencies thro gh Virt ali ation Compression and Flash Technolog

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    50/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    IBM Flash Portfolio

    Shipped over72 Petabytes of Flash

    storage in 2012

    Broad array of products to fit a wide

    variety of client needs

    Varying capacity and performanceto match client workloads

    Several form factors to fit into

    varying needs of datacenter real

    estate

    IBM FlashSystem

    EXP30 Ultra SSD Drawer eXFlash IBM High IOPS Adapters

    Storwize V7000

    DS5000

    DS8000

    XIV

    IBM Delivers Flash-Based Products in all Segments

    Creating Better Storage Efficiencies through Virtualization Compression and Flash Technology

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    51/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    IBM Flash Portfolio Hybrid Storage Systems

    Catering to clients requiring large capacity,

    performance and enterprise features

    Optimizes the broad scope of storage workloads

    that exist in todays complex data centers.

    Enables systems to scale to more than 2.3

    Petabytes (PB) and support multiple drive tiers.

    Dynamically optimizes performance for single- and

    multi-tiered systems with IBM System Storage

    Easy Tier and other self-tuning features.

    Creating Better Storage Efficiencies through Virtualization Compression and Flash Technology

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    52/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    IBM Flash Portfolio Direct Attach Flash Storage

    In-Server Flash Storage for workloads with a

    performance focus

    SSD I/O Drawers and RAIDed Flash solutions

    such as eXFlash for applications requiring to

    balance performance, serviceability and

    availability

    PCIe Flash and SSD adapters positioned forlow

    latency in-server applications

    SSDs enabling high-speed system booting, data

    caching and superior serviceability

    Creating Better Storage Efficiencies through Virtualization Compression and Flash Technology

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    53/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    IBM FlashSystem 720 / FlashSystem 820High performance, low latency, high reliability solution to turbocharge your business

    Designed for running multitenant heterogeneous (mixed workload)applications that require built-in high availabil i tyfeatures

    Transactional (OLTP) databases

    Analytical (OLAP) databases

    Virtualization & virtual desktop infrastructure (VDI)

    High performance computing (HPC)

    Cloud infrastructure, private and public

    SLC (720)/eMLC (820)

    5,10, 20 TB w/ High Availability

    (6,12, 24 TB non HA)

    525K (720/820) IOPS

    5 (720) / 4 (820) GB/s Bandwidth

    Variable Stripe RAID to protect

    against chip failure

    Redundancy for power, data, and

    management

    2D Flash RAID eliminates single

    point of failures

    Available integrated spare flash

    card limiting down time

    Error Correcting Code

    (ECC) at chip level

    1U form factor- minimal footprint

    for best of breed ROI

    Two dual-port 8 Gb Fibre

    Channel controllers or dual-port

    40Gb QDR InfiniBand controllers

    Hot swappable flash modules

    Low power500 watts (720) / 450

    watts(820)

    Low Latency 100/25 s (720)

    110/25 s (820) Read/Write

    Purpose-built, highly parallel

    design

    Maximize host CPU efficiency

    and productivity

    Extreme Performance Macro EfficiencyMicroLatency Enterprise Reliability

    Creating Better Storage Efficiencies through Virtualization Compression and Flash Technology

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    54/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    IBM FlashSystem 720 / FlashSystem 820 Architecture

    Redundant Power

    Supplies

    Redundant Fans

    12 Flash Modules

    (10+1+1)

    1U Chassis

    N+1 batteries

    Redundant

    Management

    Control

    Processors

    Redundant

    RAID controllers

    Two Dual-Ported 8 Gb/s FC or

    40 Gb/s QDR IB Interfaces

    Creating Better Storage Efficiencies through Virtualization Compression and Flash Technology

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    55/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    IBM FlashSystem 710 / FlashSystem 810Speed up critical applications and make decisions faster

    SLC (710) / eMLC (810)

    1-5 TB or 2-10 TB

    570K (710) / 550K (810) IOPS

    5 GB/s (710)/ 4 GB/s (810)

    Bandwidth

    Variable Stripe RAID to protect

    against chip failure

    Redundant power supplies with

    active failover protection against

    single-source power issues

    Error Correcting Code (ECC) at

    chip level

    Available integrated spare flash

    card

    1U form factor- minimal footprint for

    best of breed ROI

    Two dual-port 8 Gb Fibre

    Channel controllers or dual-port

    40Gb QDR InfiniBand controllers

    Low power450 watts (710) / 400

    watts(810)

    Available hot-swapable flash

    modules in 720/820

    Accelerate read-heavy enterprise storage area network (SAN)applications

    Data warehouses and online analytical processing (OLAP) databases

    Sequential data collection

    Large centralized databases

    Content delivery networks

    Rendering and video editing

    Modeling and simulation

    Low latency 100/60 s (710) and

    110 / 60 s (810) Read/Write

    Purpose-built, highly parallel

    design

    Maximize host CPU efficiency

    and productivity

    Extreme Performance Macro EfficiencyMicroLatency Enterprise Reliability

    Creating Better Storage Efficiencies through Virtualization Compression and Flash Technology

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    56/70

    2013 IBM Corporation

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

    IBM FlashSystem 710 / FlashSystem 810 Architecture

    Redundant Power

    Supplies

    Redundant Fans

    4-21 Flash Modules

    (including optional spare)1U Chassis

    N+1 batteries

    Management

    Control

    Processors

    Two Dual-Ported 8 Gb/s FC or

    40 Gb/s QDR IB Interfaces

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    57/70

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    58/70

    2013 IBM Corporation

    g g g , p gy

    Storage Virtualization at its Finest

    Sprint had a lot of

    heterogeneity in their storage

    environment with low

    utilization

    Started at 35%

    Achieved 82% utilization

    Started at 70% T1 / 30%T2

    Achieved 30% T1 / 70% T2

    Storage maintenance costs

    have been reduced 60% YoY

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    59/70

    2013 IBM Corporation

    g g g , p gy

    59

    Business challengesExtreme media streaming requirement

    SolutionImplement a high-impact, nondisruptive

    RamSan solution which was installed in asingle day

    UFC knocks out production bottlenecks with

    IBM flash

    With flash, streaming batch jobs completed up to 70 percent faster and improved performance

    and efficiency on other disk storage platforms by 40 percent!

    Flash has just completely eliminated [bottlenecks].

    Everythings flowing smoothly.

    Mike Saindon, Production Engineer

    Before we put the flash in, we couldnt use our asset

    management system to its maximum capacity and intent.Christy King, Vice President of Digital, Technology and R&D

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    60/70

    2013 IBM Corporation

    g g g p gy

    60

    Business challengesAccelerate nightly backups to

    meet windows

    SolutionImplement flash instead of

    adding 200 high performance

    disks

    Penn State slashes backup time by 80 percentthe TMS RamSan delivers vastly better IOPS performance than

    two hundred 15K disk drives

    Flash instantly increased perfomance in nightly backups 6x

    while reducing power consumption by 90 percent!

    We literally just turned it on and thats

    all the performance tuning we did. It

    just worked out of the box.

    Theyre very well made and a verymature product.

    Jason Holmes, Lead System Admin

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    61/70

    2013 IBM Corporation

    Banco Azteca integrates flash into its SAN for increased

    performance in its credit processing business

    Business challengesSpeed up application

    processing without

    architectural changes

    SolutionIntegrate flash seamlessly into

    the existing infrastructure

    Flash integrated seamlessly into a production SAN while delivering an order of magnitude better

    response time!

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    62/70

    2013 IBM Corporation62

    Conclusions, Q&A

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    63/70

    2013 IBM Corporation

    Thank you

    63

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    64/70

    2013 IBM Corporation64

    This is the headline, 22 point Arial - IBM Edge2013 Red

    The headline should not be resized or moved

    The headline should always use lower case, other than the first letter

    It should not have more than two lines (which may expand to three lines after translation)

    When a headline is two lines long, choose a division that is grammatically logical and

    aesthetically pleasing

    Ideally, the top line should be moderately longer than the lower line

    Avoid dividing articles from nouns, prepositions from prepositional phrases,

    verbs from nouns, etc.

    The text above the headline is called the running header, Arial 10pt. Regular

    This text can be changed in View > Master > Slide Master

    Source: If applicable, describe source origin

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    65/70

    2013 IBM Corporation65

    The bullets on the page should be clear and concise

    Use the Tab key (or increase indent button) to obtain the proper indents and bullets.

    Use 16 point Arial body text as the minimum type size.

    The line spacing has been carefully chosen to introduce a balance between text

    and white space (1 Lines for line spacing, .2 Lines before paragraph spacing) and should be

    checked for consistency.

    On a white background, body text should appear in black and should be set in upper and

    lower case.

    Where required you can use indents as follows

    Second level

    Third level

    Source: If applicable, describe source origin

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    66/70

    2013 IBM Corporation66

    This template is set to US English throughout

    To change the language settings:

    Make sure you are in normal view View > Normal (from the command menu)

    Click anywhere in the text box

    Now select everything by using Edit > Select All or Ctrl A

    The language can now be set to your local language by using Tools > Language,

    and selecting the language you require from the available languages.

    If you want to create a local language version of this template, then you should also set the

    language on the Slide Master, Title Master, Notes Master and Handout Master as well and

    save the file as a Document Template. To make it appear as a standard template save it to

    the location of your MS Office templates, this location varies according to the version of

    Windows you are using.

    Source: If applicable, describe source origin

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    67/70

    2013 IBM Corporation67

    Footers

    Footers can be used if necessary fordates, confidential material, etc.

    The Footer text has the standard form

    and

    The contents of the fields

    and can be set using the

    View > Header and Footer command The Edge2013 branding in the lower right cornershould be preserved whenever

    possible, however, it is permissible to remove or hide it on select pages where it

    interferes with full-page charts, tables, etc.

    A Section Header template page is included, and can be used to bring more event

    branding to presentations

    There are 4 fixed elements on each page which should not be changed The IBM Logo

    The horizontal rule

    Page number location

    The IBM copyright statement

    Source: If applicable, describe source origin

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    68/70

    2013 IBM Corporation68

    Sample sectionheader page

    Repeat presentation title here

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    69/70

    2013 IBM Corporation69

    Basic alignment

    This template has the GRID on as a default

    Use the snap objects to grid to align objects

    Set to 0.1 inches or 0.254 cm

    Use drawing guides to help align if needed

    First Box

    ASecond Box

    BThird Box

    C

    Fourth Box

    D

    Fifth Box

    E

    Grids help objects to be spaced evenly, aligned and

    consistent in size

    Source: If applicable, describe source origin

    Grids help objects to be spaced evenly, aligned and

    consistent in size

    Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology

  • 7/27/2019 IBM Edge2013 - Storage Efficiencies through Virtualization Compression and Flash

    70/70

    Color palette

    A color palette has been selected and keyed to basic elements such as headline type in

    Edge Orange and basic text in black.

    Hyperlinks have been keyed to blue. Visited hyperlinks have been keyed to purple.

    There is also a palette for accent colors, including orange, aqua and yellow-green. Other

    color selections can be made, but should be limited so that our presentations match

    consistently. The color palettes have been built into the templates (numbers refer to RGB values).

    0

    0

    0

    240

    78

    55

    113

    191

    167

    127

    28

    125

    255

    207

    1

    255

    100

    0

    153

    0

    204

    http://www.ibm.com/http://www.ibm.com/