19 Sep.2012 Anil Vasudeva - SNIA · Anil Vasudeva . President & Chief Analyst . IMEX Research.com...

2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.

Object Storage Key to Unstructured-Data Infrastructure

19 Sep.2012

Anil Vasudeva President & Chief Analyst

IMEX Research.com (408) 268-0800 (408) 489-0800 cell

[email protected]


Harnessing Unstructured Data

2

Majority of data growth is being driven by unstructured data and billions of large objects

Information is at the center of New Wave of opportunity

80% of world’s data is unstructured driven by rise in Mobility devices, collaboration machine generated data.

Data Sources

Store/Access Infrastructure

Long Term Retention


Object Storage - Goals

3

Sou

rce:

IBM


© 2010-11 IMEX Research, Copying.

4 4

Dat

a: IM

EX R

esea

rch

& Pa

nasa

s

Collaboration Information

Instantly available On Boot Ups

Commercial Mktg. Data

Medical Data Diagnostics

Rendered (Texture & Polygons) Stored Data-Very Read Intensive

Entertainment- Data Repository

Most Accessed Videos Very Read Intensive

Historical Data

Decision Support

Targets for Object Storage

Wall St/Financials/ Federal/State/CityData Geo-Resources Maps


Object Storage - Fundamentals

• Object Storage: • Data repository of billions of Objects

• Key Architecture: • Separation of Metadata and Data

• Implementation Goals: • Flat Namespace • Infinite Scalability • Elasticity • Cost-efficiency • Data durability • Distributed System • No Single point of failure


Tiers of Storage and Evolution

Primary (FC) Secondary (Tape)

$$$$ + Very Fast $ + Slow speed Storage 90’s

Higher capacity Higher performance

Structured and Unstructured Data Backup and Archive Data

$$$$ + Very Fast $$$ + Medium $$ + Medium $$ + Medium $ + Slow speed

Storage 2000

Primary(SAN) Secondary Primary (NAS) Secondary (NAS) Unstructured Files, Active Archives Snapshots, D2D BU and DR Tape BU Structured Data

Cloud NAS Cloud Backup/DR Cloud Archive Structured Data

$$$$ + Very Fast $$ + fast $ + Medium $ + Medium

Storage 2011+

Enterprise Object Storage Primary(SSD)

Sou

rce:

PA

nzur

a


Three Types of Storage

7

HTTP, SOAP, Torrent, XCAM, CAS, Object, WebDev

Object & App VHD, DICOM, Cloud, APIs

File Based NFS,CIFS, AFP, pNFS

Block Based LUNs, VTL

Ethernet/DCB FCoE/iSCSI

Fibre Channel

Shared SAS

Front End Tiered Storage & Protocols

Multi-protocol/Unified Storage System Gateway

or Appliance


Object vs. Block based Storage

8

Block Based Protocol (SCSI, ATA)

Fixed-sized blocks

Mixed data & Metadata

Block-based Storage System

Object-based Storage System

Variable-sized Objects

Data & associated Metadata

Object storage Protocol (OSD,ReST etc.)


Innovation: Next Generation Storage

Direct attached

Storage moved to the LAN

Storage distributed in the cloud

APPLICATION

FILE SYSTEM

CACHE

APPLICATION

CACHE

FILE SYSTEM

APPLICATION

ETHERNET

SSD

FILE SYSTEM

INTERNET FIBER

ETHERNET

LAST 20 YEARS NEXT 20 YEARS

Sour

ce:P

Anzu

ra


Hierarchical vs Flat Storage Schema

10


Object Storage Goals -1

11

• Reduce the cost and complexity of unstructured data storage infrastructure.

• Auto-manage unstructured data (documents, emails, presentations, audio files, messages..)

• Upload once, access from any geographic regions. (WORM)

• Unlimited File Size. Upload files of virtually any size

• Keep integrity of files intact, in flight. • Data Consistency: Changes made to a file in one

location immediately available at all locations


Object Storage – Goals 2

12

• True Global Namespace: Leverage automated geo-positional routing for increased performance and consistency.

• Self-Healing Data Integrity - continuously conduct MD5 hash checks on the data and if a problem is detected, have the system repair the file automatically.

• Self-Provisioning: Provision your own storage as needed.


Object Storage Positioning

13

DAS NAS

SAN

Object

Petabytes of Unstructured Data

Massive Archives that are Active

High

Low

256

App

Nod

es

Scal

e

Management Autonomic Manual 80TB/Admin


Why Object Storage - 1

14

· Object-based storage supports shared tenancy. Objects have their own custom metadata functioning as fairly autonomous data instances - can carry access policies to support multi-tenancy - a big aspect of the relevance of object storage to public cloud infrastructures. · Object storage lends itself well to low-cost, grid like architectures. Object storage is well-suited to run on a loosely federated set of low-cost, industry-standard servers acting as nodes in a cluster. Cluster easy to expand by adding nodes - automated data layout rebalance the system to incorporate them. This drives the low acquisition cost and lower OPEX..


Why Object Storage - 2

15

Object storage can support massive scalability. In both the total capacity within a system and the number of files or objects to be stored. Within specified policies system can sprawl nearly indefinitely. More metadata means more custom control over data. With file storage systems, you get file type, creation date, and last-accessed date. Object Storage.expands the Metadata and automatically and consistently tackles traditional storage challenges such as tiering, security, migration, redundancy, and deletion. Data is inherently WORM in most object systems. Saved object data is tagged with a unique identifier, guaranteeing the immutability of that object. To modify an object, you create a new, and keep versioning history - a natural fit for archiving and records management applications with guarantee that data has not been modified or tampered with.


Object Storage - Implementation

16

In implementing object storage: • A unique identifier assigned to each piece of data • Identifier allows servers or users to get access to

Object without any knowledge of where data is physically stored.

• Data can be broken into chunks, stored anywhere worldwide, can move within a system and have multiple copies.

• Object tag ensures that right piece of data is returned and verifies integrity of that data.


Market Sizing – Object Storage

17

2010 2020

25

Scale-Out

NAS

SAN

*Includes HW, SW, File System, Backup, High Availability & Management

Rev

enue

s $

Bill

ions

*


Centralized Storage using Public/Private Cloud

Global File System (App Intelligence) R/W Perf ACL AD G.

CIFS/NFS G. Locking G.NS

Cloud Storage Controller (Unlimited Capacity)

Virt/Phy 10Gbps SSD Cache IOPS Replication Encryption RAID-DP Snapshots

G. Mgmt G. Dedup

Performance Protection

Global Local Efficient

London New York Tokyo

F5 Networks

Riverbed

Cleversafe

HDS

StorSimple

IBM Cloud

TwinStrata Nasuni

Data Direct Networks DreamHost

Rackspace

Gluster NetApp/ByCast Dell

Sour

ce:P

Anzu

ra

http://www.amplidata.com/


Object Storage Key to Unstructured-Data Infrastructure

19 Sep.2012

Anil Vasudeva President & Chief Analyst

IMEX Research.com (408) 268-0800 (408) 489-0800 cell

[email protected]

19 Sep.2012 Anil Vasudeva - SNIA · Anil Vasudeva . President & Chief Analyst . IMEX Research.com...

Documents

Transcript of 19 Sep.2012 Anil Vasudeva - SNIA · Anil Vasudeva . President & Chief Analyst . IMEX Research.com...