© Copyright Nexenta 2012

OPENSTORAGE WITH OPENSTACK

BRAD STONE GM,

NEXENTA CHINA

1

Enterprise Storage

• Storage is 40% of an enterprise IT’s budget

• Market leaders are EMC, IBM and NetApp

Enterprise Storage Continues to Grow

Storage Trends

• Commodity components replacing specialized hardware for data storage

• Storage virtualization – Commoditize by abstracting physical attributes

• Global economic downturn putting pressure on capital and energy costs – Motivation to buy newer, more energy-efficient

hardware

“More data will be stored in the next three years than in the previous 40,000” - Berkeley’s School of Management (2010)

New use cases for data

Machine-generated files

Video surveillance

What is OpenStorage?

a) Storage software is open source

b) No vendor lock-in; components no longer need to all come from the same vendor

c) Open data formats

d) All of the above

e) Some of the above

Top Reasons to use Open Source Software

• Avoid vendor lock-in

• Lower costs

• Competitive advantage

• Improve quality

Brief Biased History of OpenStorage

• 1991: Linux kernel publicly announced • 2004: Google MapReduce paper • 2005: linux-iscsi and open-iscsi projects merge • 2005: OpenSolaris released • 2008: Nexenta ships first commercial product • 2008: Sun FISHworks storage appliance released • 2010: OpenStack Nova released • 2010: OpenStorage Summit features storage

software vendors and commodity hardware • 2013: OpenStorage Summit in China!

NEXENTASTOR: A CASE STUDY FOR OPENSTORAGE

What is NexentaStor?

iSCSI

SAS

FC

AoE

InfiniBand

CIFS

iSCSI NFS

FC

Software-based, unified storage appliance

Leading OpenStorage solution

• Runs on standard hardware

Key features:

• 128-bit architecture

• Unlimited file size & snaps

• Synchronous and asynchronous replication (including replication to OpenStack Swift)

Superior storage for virtualized environments

File and Block Access

Nexenta is a private company with an office in Beijing!

Storage Pooling

11

Discover logical disks Determine RAID requirements

Pool-A Pool-B Create storage pools

Create datasets Assign properties (e.g. de-dup) Share (NFS, CIFS, iSCSI, FC)

NFS iSCSI CIFS NFS

De-duplication

Block-based

• In-line de-duplication

– Verify option

• In-flight de-duplication

– No verify option

Existing data can easily be de-duped via NexentaStor’s auto-tier capability

Flexibility De-duplication options can vary - Per volume - Per dataset - Per replication service

Compression

• Compression done in-line at time of write • Enabled by default

– Leverages typically idle processing power – Can improve overall I/O performance

• Compresses only if at least 12% benefit • Many algorithms supported

– LZJB for loss-less compression – GZIP 0-9 – Extensible

• Compression algorithm can be changed on-the-fly – Affects future writes

Block support

• iSCSI and FibreChannel supported

– SCSI multi-pathing supported for each

• Storage efficiency

– Compression

– Cloning

– De-duplication

– Thin provisioning

• Support for variable block sizes

Technical Advantages Description Limit

Number of data volumes on a system 264

Maximum size of a data volume 278 bytes

Number of file systems in a data volume 264

Maximum size of a file system 264 bytes

Number of devices in a data volume 264

Number of files in a directory 256

Maximum file size 264 bytes

Number of attributes of a file 248

Maximum size of any attribute 264 bytes

Number of snapshots of a file system 264

15

Self-healing

• NexentaStor doesn’t blindly trust the data

• Relies on 256-bit checksums on every block

• Transparently return only the good data to the user

• Use the good data to fix the bad copy

16

X

0100110101

0110110101

Prevents silent data corruption

Self-healing

Data checked before it is returned to user

Good copy used to fix the bad copy of data

Triple-parity RAID • Disk capacities doubling, but disk throughput not increasing at same rate

– Result is longer time to recover from bit errors

– More likely that you can be recovering from two bit errors at once

– Data can then be at risk during recovery period

NexentaStor provides triple-parity RAID Available with NexentaStor since 2009

Healthcare

Finance

Education

Technology

Internet

Media

More

A Broad set of Customers and Partners Customers Premier Partners

Cloud Hosting and Telecom

20

in Asia

Cloud services do not require cloud storage

OpenStorage Adoption

2009 2010 2011 2012 2013 2014

Universities

R&D

Hosting, cloud compute, private cloud, virtualization

VDI

Governments

Finance

NEXENTA AND OPENSTACK

Cloud Storage Use Cases

• Storage for cloud applications

• File replication of critical data for disaster recovery

• Off-site backup for power and floorspace benefits in the datacenter

• Geographically dispersed teams that need to write to centralized storage for long-term data access

• Long-term deep data archives

OpenStack Nova

• OpenStack

– Open source cloud computing project

– Started by Rackspace and NASA

– Now more than 150 participating companies

• OpenStack the largest open source cloud community

• OpenStack Nova targets cloud computing

– Includes a storage component

Nova Orchestrates Volume Provisioning

• Provisions LUNs

• Interacts with storage systems

• Assigns volumes to compute nodes

• Ensures LUNs are assigned to at most one VM at a time

Currently only iSCSI is supported by OpenStack Nova (not FibreChannel)

Simplified Nova Architecture

Rabbit MQ

Nova Manage

Nova API

Nova Compute

Nova Network

Nova Schedule

Nova Database

Nova Volume NexentaStor

Nova driver(s)

Volume Controller

/etc/nova/nova.conf

Nova and NexentaStor

Nova Manage

Nova API

Nova Database

Nova Volume NexentaStor

Nova driver(s)

Volume Controller

/etc/nova/nova.conf 2. Lookup in configuration file to determine which driver to use

3. Driver talks to NexentaStor to create volume 4. NexentaStor creates volume

5. Volume Controller updates database with volume details

1. Request to create a volume

6. Request to attach volume to a VM

Virtual machine

NexentaStor cloning can be used to create a new Nova volume from a snapshot

• Implementation complete and available

• Initially tested with OpenStack Diablo release

• Only Netapp and Nexenta have provided Nova storage drivers

• Wiki posted:

– http://wiki.openstack.org/NexentaVolumeDriver

• Next: Test with Cinder

Nexenta Nova Driver – Project Status

28 Nexenta Systems Inc. CONFIDENTIAL

What is Cloud Storage?

• Provide storage as a service

• Treat data as object or chunks

• Improves ability to access unstructured data

• Files divided into objects and stored across multiple systems

• Defacto standard transports

– Amazon S3, Google Storage, OpenStack Swift

Benefits of Object Storage

• Scalable capacity

• Relocation on demand (disaster recovery)

• Access data anywhere

Cloud Storage

• OpenStack Swift contributor

• OpenStack Swift

– Running Swift on NexentaStor

– Technology preview downloadable from Nexenta website

• Contributed Local File System patch to Swift

– Leverage self-healing and advanced RAID of NexentaStor

NexentaStor’s Unified Architecture

HDD SSD FC iSCSI

Block Device Driver

Pooled Storage Layer

Transactional Object Layer

ZFS Volume Emulator ZFS Posix Layer

Dump Swap iSCSI FC Raw CIFS NFS ZFS

Unified Appliance

iSCSI, FibreChannel, SAS, AoE

File

Swift Container Server

Swift Account Server

Swift Object Server

Object Storage

Block

Nexenta’s LFS Swift Patch

• Modifies Swift ring builder logic

• Allows a file system with Nexenta’s self-healing to be counted as two replicas

• Can save network bandwidth when initially storing data

• Can save network bandwidth by creating replacement replicas less often

WHERE IS OPENSTORAGE HEADING?

Next Generation Cloud

• Nexenta is active in the cloud storage community

• Defining the next generation of OpenStorage

– Enabling exabyte deployments!

• OpenStack Nova will be extending its capability to map generic volumes to iSCSI for guest VMs to access, not just the virtualized boot volume

• Interface between this new Volume service and Nexentastor Appliance should be unchanged

OpenStack Nova Extensions

37 Nexenta Systems Inc. CONFIDENTIAL

THANK YOU!!