Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My...

26
Val Bercovici Technology & Strategy Office of the CTO Who Moved My Bits?

Transcript of Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My...

Page 1: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

Val Bercovici Technology & Strategy Office of the CTO

Who Moved My Bits?

Page 2: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

Val Bercovici @valb00

Page 3: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?
Page 4: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

Research Layer Cake

Social Mobile Analytics Cloud

Storage Ramifications

Supply Chain Trends

Page 5: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

History – Storage Concentration

5

Access Latency

$$$ DISK

DRAM 2005

Nearline

Enterprise Short Stroke

NetApp, EMC, etc.

TAPE

Page 6: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

Trend – Storage diversity

6

Access Latency

$$$

DISK

DRAM

TAPE

2015 SCM?

FLASH SLC

eMLC MLC cMLC

TLC Nearline

Cloud Archive

Spin down

Performance

Capacity

?

Page 7: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

The new Bible

7

Slides: http://www.eclipsecon.org/2013/sites/eclipsecon.org.2013/files/OGrady_the-new-kingmakers-eclipsecon.pdf

E-Book: http://try.newrelic.com/rs/newrelic/images/The_New_Kingmaker.pdf

Page 8: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

8

Page 9: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

Wither SQL/ACID? (Big) Data Trends

Page 10: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

Data models originating from App Svcs offer in-built data mgnt features & granular SLAs

Physical Infrastructure

10

Application Development/Deployment (PaaS)

Devel Services Versioning Messaging Security/Id

entity

Emerging Architecture for App Development

Runtime Data Services

PaaS platforms bundle wide range of data services with pure app middleware features

File/Block Object Key-Value Columnar Relational Document Batch

Unified Infrastructure Orchestration Security | Provisioning | SLA Monitoring | Logging

Infra as a Service platforms offer storage management for free/fee

Storage (Disk/Flash) Server

Network

Physical infrastructure formally abstracted as all data/infra management is S/W defined

VMWare

VMWare App

Services

Data Services

Infra Services

Infra

Dedicated

VMWare App Stack Amazon

App Stack New app platforms are offering flexible data models for: Operational Efficiency Performance at scale

Page 11: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

Beyond the Hype

Page 12: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

Software Defined Everything

Page 13: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

OpenStack

Shared Files

Compute

Image Object Storage

Block Storage

Clustered Data ONTAP

Image

Networking

Shared Services

E/EF-Series FlashRay StorageGRID

Image

Object Storage

Object Storage

Block Storage

Block Storage

Compute

Persistent, rapid, space-efficient instances

Shared Files

Shared FileSystems

Page 14: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

SNIA NVMe / Programming TWG https://snia.org/forums/sssi/nvmp

Page 15: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

Enterprise Application Landscape

15

Application

Traditional Current/ Evolving Emerging Future PaaS

(CloudFoundry, Heroku, …)

Data Model

Block, File Key-Value Store

Columnar, Document,

Graph Polyglot

NoSQL NewSQL

Page 16: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

NetApp Application Managers: Context

16

NFS/ Block/ LRSE

cDOT

Application

Data Model

Server-side Persistence Store

Server

NetApp Application Manager

Operating System

Hypervisor

NAM Cluster

Page 17: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

Wither OSI? Networking Trends

Software Defined Networks

Network: 1.Virtualization 2.Correctness 3. Abstraction

Page 18: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

Future Networks? EthernetPCIMemory

Page 19: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

Wither Disk ? and later Wither Flash ??

19

1M

100K

10K

1K

100

10

1

Page 20: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

Why Storage Class Memory means the end of traditional Storage Networking. DRAM ≈ 20ns latency Assume 50ns SCM access time (DRAM speed) PCIe, InfiniBand latency ≈ 1 μsec = 21x latency Speed of light in optical fiber ≈ .65 ft / nsec

20

+

5’ server rack

5 ft = 15nsec = 1.75x penalty

10 ft = 30nsec = 2.5x penalty

+ 40 ft = 120nsec = 6x penalty

storage appliance

Page 21: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

New Data Center Storage Stack Circa 2017

21

Shared Storage

Distributed / Parallel Processing

Compute Node

Cache Node

Compute Node

Cache Node

Compute Node

Cache Node

Compute Node

Cache Node

Compute Node

Cache Node

Independent scaling

Persistence / Intelligent Caching Layer

Data Globally Managed by

Federated / Shared Storage

SCM

Mem Mem Interconnect

Host Cache

SW

XaaS

Page 22: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

Looking Back in order to

Look Forward!

Page 23: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

Historical Context

http://antranik.org/using-moores-law-to-predict-future-memory-trends/

Page 24: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

Science (Fiction?) http://www.singularity.com/charts/page70.html

Page 25: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?

IBM Watson – Circa 2010! (SCM + Fast Interconnect + Hadoop)

http://en.wikipedia.org/wiki/Watson_(computer)

Page 26: Who Moved My Bits? - SNIA · Val Bercovici Technology & Strategy . Office of the CTO . Who Moved My Bits?