Osys AG | Hofwiesenstrasse 350 | 8050 Zürich

Telefon +41 44 317 18 19 | Fax +41 44 317 18 20 | office@osys.ch | www.osys.ch © 2012

Flash Storage Trends

Osys Techtalk

Werner Eggli

Senior IT Specialist | werner.eggli@osys.ch

September 2013

- Überblick Storage Technologie

- IBM Flash Systems

- Einsatz von Flash Technologie in IBM Storage Systemen

- Überblick Storage Technologie

Seite 4

Capacity Growth

Seite 5

Disk History

1956 IBM RAMAC

first disk drive in the world

approx. 5 MB storage,

1200 rpm

access time > 600ms

weight > 1ooo kg

1956 to 2013

12.5 times increase in RPM

240‘000 times increase in capacity (vs. SAS/1.2TB)

Seite 6

Hard Disk

RPM Latency (ms)

Seek (ms) IO/s *

FC/SAS 15000 2 4 167

FC/SAS 10000 3 5 125

SATA/SAS 7200 4.2 9 76

- Performance Entwicklung

- Performance heute: * 100% Random

IO Rate per GB und Hard Disk Drive Generation

0.1

1

10

100

1000

1985 1990 1995 2000 2005 2010

IOPS/GB

15k RPM

10k RPM

Desktop 5400 & 7200

<= 7200 RPM

Seit 1990 um Faktor 100 schlechter

Seite 7

Annual Areal Density Growth Disk

Seite 8

- ATA, SATA, FATA, SAS (2.0), FC-Platten - 3 ½ Zoll vs. 2 ½ Zoll Formfaktor - GMR (Giant Magneto-Resistance) stark ausgereizt

Hard Disk

Heat Assisted

Magnetic

Recording (HAMR)

Bit Patterned Media

(BPM)

Hard Disk - Roadmap

Disk Technologie

Seite 9

Annual Areal Density Growth Rate Scenarios

Seite 10

Demo Hardware Platform

Press release on Jan 22, 2010: http://www.zurich.ibm.com/news/10/storage.html

Perpendicular Recording (senkrechte Bitanordnung)

Ultrafeine Barium-Ferrit-Medien ohne Metallaufdampfen

Reduktion der Spurabweichung auf unter 25 nm

Spurbreite auf unter 0.45 µm (Faktor 25)

Erhöhung S/L-Geschwindigkeit um Faktor 38

Archivierung und Langzeitdatenspeicherung

riesige Kassettenkapazitäten stromloser austauschbarer Datenträger

Linear Tape File System LTFS

Tape Demonstration – 35 TB Kassette

Seite 11

Entwicklung der letzten 10 Jahre

In the last 10 years:

CPU Performance 8 - 10x increase

DRAM Speed 7- 9x

Network Speed 100x

Bus Speed 20x

Disk Speed 1.2X …and everything waits

Source: IBM and Industry Estimates

Seite 12

SLC = Single Level Cell

1 Bit per Zelle

100.000 Schreibzyklen

eMLC = Enterprise MLC

2 Bit per Zelle

30.000 Schreibzyklen

MLC = Multi Level Cell

2 Bit per Zelle

3.000 Schreibzyklen

TLC = Triple Level Cell

3 Bit per Zelle

1.000 Schreibzyklen

Aufbau einer Flash Speicherzelle mit Floating Gate

Oxydschicht Control Gate Floating Gate

Drain Source

P-Schicht

N-Schicht N-Schicht

0

10

20

30

40

50

60

70

80

90

100

MLC eMLC SLC

P/E

Cyc

les

(Th

ou

san

ds)

Flash Type

Typical Chip Endurance

Flash Technologie

Seite 13

Reale Haltbarkeit ist Device abhängig

Kalkulierbare Haltbarkeit:

SLC Flash Konfiguration 10 TB, 1 GBps Schreiben

eMLC Flash Konfiguration 10 TB, 1 GBps Schreiben

MLC Flash Konfiguration 10 TB, 1GBps Schreiben

EnduranceYearsGBps

TB7.31

1

000,10010

EnduranceYearsGBps

TB5.9

1

000,3010

yearathanLessGBps

TB

1

000,310

Seite 14

Flash Preisentwicklung per GB

• SLC Chips halten 35 x länger vs. MLC und 3 x länger vs. eMLC

• Preis SLC vs. eMLC 2:1

• Preis SLC vs. MLC 8:1

• eMLC Chips halten 10 x länger vs. MLC

• Preis 4:1 vs. MLC

Seite 15 ibm.com\storage\flash

Solid State Disk Drive Performance Comparison

Seite 16

Flash V-NAND (Samsung Announcement 13. AUG 2013)

Seite 17

Leistungsklasse Flash

Antwortzeiten

1ns 500µs

1000ns

1µs

500ns

1ms 1000µs

DRAM

L1 L2 .. LX

Kosten

Leistungsklasse „Flash“

Storage Class Memory SCM

(PCM, Phase Change Memory)

Flashspeicher

Seite 18

• Magnetic Pattern auf Nano-Drähten

• Permalloy (FeNi-Legierung)

• Leistung im Nano-Sekunden Bereich

• Fast keinen Stromverbrauch

• Dreidimensionale Chip Technologie

• 100 Bits per Draht, mehrere

...Millionen.Drähte per Chip

• 100-1000 fach höhere Kapazitäten zu

...Flash Memories

Stuart Parkin

•Louis Neel Medaille (2009)

•IUPAP-Award (2009)

(International Union of Pure and Applied Physics-magnetism)

Racetrack Memory Chips

Seite 19

Neuordnung der Speicherhierarchie Storage Class Memory (SCM)

Archivierung

CPU RAM DISK

CPU SCM (PCM)

TAPE

RAM

CPU DISK FC, SATA, SAS

TAPE 2013

1980

2018+

Aktiver Speicher Memory Logik

TAPE DISK

SATA/SAS

FLASH RAM

Memory like … storage like

Seite 20

• Consumer disk and enterprise tape will persist for the foreseeable future

• Flash will come into its own

• Flash may drive out enterprise disk, and if it doesn’t, SCM will

• When will SCM arrive?

That will depend on the path the NAND industry takes after the 16-20nm node…

• 3-D NAND succeeds: new NVMs (such as PCM, RRAM, STT-RAM) will develop

slowly, driven only by SCM/embedded market

• 3-D NAND fails or is late: one new NVM will be driven rapidly by NAND market

• If the latter, SCM could become the dominant storage technology by 2020

• The application software stack will be redesigned to utilize SCM-enabled

persistent memory

What does the future hold?

- Überblick Storage Technologie

- IBM Flash Systems

Seite 22

Tape-Libraries

Jaguar LTO

V7000 / V7000U

XIV

VTL-Systeme

SVC V3700

DS8870

Management Tivoli SW

Flex-Systems

Infrastrukutur

und Software

Storwize

Familiy

Enterprise

Systeme

Data Protection-

Retention

IBM Storage Portfolio Q2 2013

Seite 23

300+ Customers

In over 50

countries

30+ Patents

Strong IP Base

34 Year History

Deep Expertise

Recognized

by IBM Research

PROVEN FLASH TECHNOLOGY LEADER

Why TMS?

Seite 24

Accelerate critical applications and unleash the power of performance

IBM FlashSystem

offers extreme performance, low latency

and enterprise attributes to handle fast

moving operational data in real time

Completing the Flash Pyramid with All-Flash Arrays

Seite 25

•Shipped over 72 Petabytes of Flash storage in 2012

•Broad array of products to fit a wide variety of client needs

•Varying capacity and performance to match client workloads

•Several form factors to fit into varying needs of datacenter real estate

EXP30 Ultra SSD Drawer eXFlash IBM High IOPS Adapters

Storwize

V7000/3700

DS8000

IBM Delivers Flash-Based Products in all Segments

IBM FlashSystem

XIV

IBM Flash Portfolio

Seite 26

Tape HDD

Form Factor

SSD

PCIe SSD

Seconds

5-15 milliseconds

~1 milliseconds

< 1 millisecond

IBM FlashSystem

100 microseconds

…consistent latency

1U up to 20TB

1 second =

1 million microseconds

Systems Comparison

Seite 27

I/O Serviced by Disk

1. Issue I/O request ~ 100 μs

2. Wait for I/O to be serviced ~ 5,000 μs

3. Process I/O ~ 100 μs

Time to process 1 I/O request = 200 μs + 5,000 μs = 5,200 μs

CPU Utilization = Wait time / Processing time = 200 / 5,200 = ~4%

Time

Processing ~100 µs ~100 µs

Waiting ~5,000 µs

1 I/O Request

CPU State

I/O Serviced by IBM FlashSystem

1. Issue I/O request ~ 100 μs

2. Wait for I/O to be serviced ~ 200 μs

3. Process I/O ~ 100 μs

Time to process 1 I/O request = 200 μs + 200 μs = 400 μs

CPU Utilization = Wait time / Processing time = 200 / 400 = 50% Time

Processing ~100 µs ~100 µs

Waiting ~200 µs

1 I/O Request

CPU State

12X Application benefit: CPU and

Application Efficiency Gain

Microsecond latency maximizes CPU utilization and efficiency

Seite 30

SLC Flash eMLC Flash

Model 710 720 810 820

Usable

Capacity 1-5 TB

(1 TB increments)

5 or 10 TB (6 or 12 TB RAID 0)

2-10 TB (2 TB increments)

10 or 20 TB (12 or 24 TB RAID 0)

Latency

(R/W) 90/25 us 90/25 us 110/25 us 110/25 us

IOPS 450K 500K 400K 450K

Bandwidth 4 GB/s 5 GB/s 4 GB/s 4 GB/s

Interfaces 4x 8Gbit FC or 4x 40Gbit IB 4x 8Gbit FC or 4x 40Gbit IB

Data

Protection VSR™

2D Flash

RAID™ (inc. VSR™)

VSR™ 2D Flash

RAID™ (inc. VSR™)

All units 1U form factor, less than 500 Watts

IBM/TMS Shared Flash Systems

Seite 31

• 1 Petabyte: 1 Floor Tile

• 100 microsecond latency

• 22 Million IOPS

• 210 GB/s

• 12.6 KW power

Less power than the

average 200TB array

22 Million IOPS Alternative

1 Rack

1 Petabyte, 1 rack. What it means

- Überblick Storage Technologie

- IBM Flash Systems

- Einsatz von Flash Technologie in IBM Storage Systemen

Seite 33

Delivered with IBM on-site Integration Extreme Performance Enterprise Capabilities

SAN Volume Controller

Extreme Performance with IBM MicroLatency™

All Flash 20 TB RAIDed data capacity

Macro Efficiency 1U form factor

Variable Stripe RAID and 2-D RAID for Enterprise Reliability

IBM FlashSystem 820

Business Continuity with Copy Services

Flash Copy for Backup & Optimal Workload Availability

$/TB Value with Thin Provisioning & Real Time

Compression

Drive Storage Efficiency with Easy Tier

High performance enterprise class featured solution

Skalierbar bis 1.3M IOPs für höchste Anforderungen an Performance, Funktionalität und Zuverlässigkeit

IBM FlashSystem Solution

Seite 34

OLTP Databases

– Financial, gaming, real-time billing, trading, real-time monitoring, query

acceleration (DB2/Oracle), etc.

Analytical applications (OLAP)

– Business intelligence, batch processing, ERP systems, reporting,

massive data feeds, etc.

Virtual Infrastructures

– VDI, Consolidated virtual infrastructures, user profiles, etc.

HPC/Computational Applications

– Simulation, modeling, rendering, FS metadata, scratch space, video on

demand, thread efficiency, etc.

Cloud-scale Infrastructures

– On-demand computing, content distribution, web, caching, metadata,

GPFS, active file management, etc.

Financial Government E-Commerce HPC Telecom

Application Sweet Spots: Do More, Do it Faster!

Seite 35

Manual Data Placement

• Best performance

Easy Tier

• Best capacity efficiency

Preferred Read

• Massive acceleration and preserves storage investment

IBM Flash Deployment Strategies Review

Seite 36

Vollautomatisches Verfahren, das die Zugriffe auf jeden Datenblock fortwährend analysiert und zwischen den vorhandenen Speicher-Klassen verschiebt und so eine optimale Verteilung der gespeicherten Daten über die vorhandenen Speicher-Ressourcen sicherstellt. Steht sowohl für Speichersysteme als auch für die IBM Speicher-Virtualisierungs-Lösung zur Verfügung so dass auch ein Tiering zwischen verschiedenen Speichersystemen möglich wird. Für Easy Tier/DS8870 stehen Schnittstellen zur Verfügung, mit denen Administratoren und Applikationen Einfluß auf die Daten- platzierung nehmen und so die Leistungs- fähigkeit der Systeme zusätzlich optimieren können.

SSD RAID Array(s)

FC/SAS RAID Array(s)

SATA RAID Array(s)

Easy Tier

Application

Data Placement

IBM Easy Tier

Selbstoptimierende Speicher-Infrastrukturen

Seite 37

IBM Storwize Family

Seite 38

Benefits – performance, high availability

SVC stores two copies of a volume (copy0/copy1)

– Reads from primary copy (c0) - “Preferred Read”

– Writes to both copies (c0 and c1)

– Primary copy may be dynamically changed

– Easy to use – just add a copy to an existing volume

Single volume presented to host server

A local high availability function

– Each copy of the volume is on a separate storage system

– If disk supporting one copy is unavailable, SVC provides continuous data access from the other copy

– Copies are automatically resynchronized when disk is available again

Copies can be split

– Either copy can continue as production copy

Either or both copies may be thin-provisioned

– Efficient utilization of FlashSystem

Write to both copies

SVC

IBM FlashSystem 820

Legacy or new

disk storage in

SVC

environment

Server

SVC Volume Mirroring & Preferred Read

“The IBM FlashSystem solution also allows us to identify and address potential customer issues faster, helping us to maintain and build our subscriber numbers—which is absolutely the most critical metric in our industry.”

-Karim Abdullah, Director of IT Operations Enterprise Data Center Shared Services, Sprint Nextel

Sprint drives 45-times performance improvement!

The need Sprint Nextel call-center operatives need fast, reliable access to data on accounts, usage and billing.

The solution Sprint Nextel deployed nine IBM® FlashSystem™ 820 solutions with a total of 150 TB of eMLC flash, virtualized and managed through IBM System Storage® SAN Volume Controller.

The benefit • Cut latency by 10x • Reduced Energy

Consumption • Easy integration into

existing environment

Click here to read full story.

Seite 40 40

XIV SSD Read Cache

SSD field upgrade

– XIV Gen3 hardware is SSD ready

– In order to activate SSD feature, all modules must have SSD feature installed

– XIV Gen3 v11.1 required, no downtime required

SSD maintenance - no data loss

– Can be phased out, tested, replaced

and phased in

– Only contains read data

• XIV redundant data scheme unchanged

– We do not protect this data in any way - no

need

– Reads are redirected

RAM

SSD as

CACHE

Non-SSD

Drives

System Module

Seite 41

Core ERP (IOPS) CRM and Financial DB Workload

70/30/8k

Medical Record App Server (RT) Healthcare EMR Workload

100% random IO

DB2 Brokerage (IOPS)

Heavy Random Brokerage

90/10, Mixed block IO

84% Random Read Miss

Websphere Datastore (IOPS) Web 2.0 OLTP Workload

80/20/4k

Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here.

Outstanding Applications Performance with SSD Caching

41

Seite 43

Greater Exploitation of Flash

All-HDD

Hybrid with Easy Tier

All-flash

5-15 milliseconds

~ 1 millisecond

< 1 millisecond

Enterprise-class DS8000 flash evolution

Seite 44

IBM Power p / DS8000 integration

Easy Tier Server is an architecture: A Host flash-cache based on IBM research technology

using IBM flash hardware (Easy Tier Caching Client)

Easy Tier based algorithms for automatic application

aware system-wide optimization (Easy Tier / Easy Tier

Caching Server)

A proprietary protocol provides in band (SAN)

communication and coherency

Hosts (Caching Clients) Work independently to cache their applications IO

streams providing real-time performance enhancement

Use the Cooperative Caching protocol to have

cooperative system-aware caching that interfaces with

IBM Storage running the Cooperative Caching Server

Host

Caching

Client

IBM Server IBM Server

Host

Caching

Client

Easy Tier

Caching

Server

DS8870

Flash

Cache

SAN

Flash

Cache

SSD

HDD

Easy Tier 5 - Easy Tier Server Overview

Seite 45

1,056 15k hard disk drives (today)

224 flash drives (today)

146GB 15k (RAID 10)

2Q13All-Flash (RAID 5)

YE13 All-Flash (RAID 5)

Usable Capacity 72TB usable performance optimized comparison point

Raw Capacity 1.72x 1x 1x

Response Time ~ 1ms ~ 0.3ms ~ 0.1ms

Floor space 1.33x 1X 0.66x

Energy Usage 13.9kw 5.7kw ~ 5.0kw

¢ / GB / IOP 1x ~ 1x < 1x

224 flash drives (4Q13)

DS8800 All Flash: Today and Tomorrow

Seite 46

Tape tier storage: – Improve cost structure of Easy Tier

storage

– Maximize performance / cost benefit

– Automatically migrate idle extents to tape

tier

– Extents restore to disk when accessed

– Perfect for medical photos, digital library,

Cloud, & video streaming applications

Benefits – Eliminate the management cost of

archive/restore process

• Tape data appear as online to users

– Reduce $/GB

– Reduce energy expense

– Reduce floor space usage

Performance and Efficiency- 1H14

SSD

Enterprise Disk

Nearline Disk

Tape

Easy T

ier D

ata

Movem

ent

DS8000

Tape Storage for Easy Tier (planned)

Seite 47