SAS & SATA Combine to Change the Storage Market

Harry Mason - Director Industry Marketing, LSI CorporationMarty Czekalski - Interface & Emerging Architecture Program Manager, Seagate Technology

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 22

SNIA Legal Notice

The material contained in this tutorial is copyrighted by the SNIA. Member companies and individuals may use this material in presentations and literature under the following conditions:

Any slide or slides used must be reproduced without modificationThe SNIA must be acknowledged as source of any material used in the body of any document containing material from these presentations.

This presentation is a project of the SNIA Education Committee.

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 3

Abstract

SAS & SATA Combine to Change the Storage MarketSerial Attached SCSI (SAS) allows systems to be built that accommodates large numbers of either SAS and/or SATA hard disk drives. This presentation, intended for OEM, System Builders and End-Users, describes the capabilities of the SAS interface, how it’s designed to interoperate with SATA drives and when combined, how these technologies can be combined to deliver some very compelling storage solutions.

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 4

SAS: The Evolutionary Tale….

Evolution:

- Replaces Ultra320 - Preserves Legacy

SCSI Software- Renews the SCSI

Roadmap- Continues the

Market Transition to Serial Interfaces

CPU

Storage

Interface

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 5

Ultra320 SCSI Replacement?

Customer Choice

ScalableFuture Architected

Preserve Legacy SCSI

Cost Equivalence w/SCSI

Performance

3.5” & 2.5” Form Factors

1000’s of Connections

Every-unit-ItemEconomics

Multi-protocolPlug Compatible

Preserves 20+ Years of SCSI Middleware

●Dual-ported●Point-to-Point

Wide-Ports

Reliability

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 6

Blind Mating and Hot Pluggable

SATA Disk Connectors:• Suitable for Both 3.5” and 2.5” Storage Devices • Includes data and voltage connections• Hot-Pluggable (staggered pins)• Blind Mating

Enclosure

~3msec

Drive

Vcc

VccStaged Power

3.3V 5V R 12VRx TxData Voltage Pins

Grounds

Pre-charge

Key

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 7

SAS/SATA Compatibility

Disk Drive Connectors

SAS

SATA Port B

SAS Connector Flip Side

Accommodates both SAS & SATA Drives

Pluggable

☻SAS Backplane Connector

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 8

World-wide HDD Shipments:

0

10

20

30

40

50

60

2008 2009 2010 2011 2012

FC

SCSI

SAS

SATA

FC/SAS <10K RPM

E n t e r p r i s e A p p l i c a t i o n s (2 0 0 8 -2 0 12 )A l l F o r m -F a c t o r s b y I n t e r f a c e

(M’s)

Source:IDC

A significant percentage of SATA in the enterprise will be deployed on SAS

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved.

Application Intelligence

9

Storage Growth & Innovation Drives Customer Choices

Prevailing wisdom: Storage Consolidation was accomplished through networked storage solutions (NAS and SAN)

Virtualization

Direct Attached Storage

Networked AttachedStorage

Virtualization & Live Migration drive Networked Storage

Application intelligence driving applications back to DAS to reduce cost and complexity

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 10

Applications Get Smarter

Applications gaining intelligenceApplications growing new capabilities without requiring SAN storage modelHigh-availability clustering through application based local replicationDisaster recovery through application based remote replicationGreater performance through tight integration with storage subsystems

Messaging Applications:Reduced I/O load profile reduces per user spindle count requirements,

Reduce costs and/or enabling greater per server capabilities (user count/mailbox size)

Clustering techniques, like Cluster Continuous Replication (CCR) and Standby Continuous Replication (SCR), enable robust fault-tolerant deployments for DAS deployments

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 11

The Direct Attached Storage (DAS) Revival

New DAS technologies are more powerful than everSerial Attached SCSI (SAS) and Serial Attached ATA (SATA) deliver a new level of performance and costImproved application architectures coupled with these interfaces, improves economics of storageReduced latency important for SSDs

SAS based storage deliver high performance and high capacity storage for messaging deployments.

SAS JBODs coupled with CCR and SRC capabilities, deliver a new level of price performance for messaging environments

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 12

Who Consumes Enterprise Drives?DAS deployments

(Drive Interfaces by volume)

SAN & NAS deployments(Drive interfaces by volume)

2001 approximately 70%(SCSI, P-ATA)

approximately 30%(FC, SCSI, P-ATA)

2007 approximately 70%(SAS, SCSI, SATA)

approximately 30%(FC, SAS, SATA)

2013 TBD %

(6Gb/s SAS, SATA)TBD %

(6Gb/s SAS, SATA)

Market Drivers

Application Intelligence,Price, Power, PerformanceDAS & S/W Improvements

Flash

VirtualizationEase of Use

Pervasive Networks

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 13

SAS’s Unique Attributes

CompellingSolutions

Performance

Density (power)

Scalability

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 14

SAS: Bandwidth Aggregation

Wide-Port (x4) yields 48Gb/s Full Duplex!Each SAS Link (Rx and Tx)

3Gb/s 6Gb/s (full-duplex)6Gb/s 12Gb/s (full-duplex)

Wide PortsCombine SAS links (6Gb/s SAS)

2 ports – 24Gb/s (full duplex)4 ports – 48Gb/s (full-duplex)

Concurrency Brings Higher PerformanceMultiple concurrent I/O’s

(lots of drives operating concurrently)

Performance

Theoretical Bandwidth DOUBLES with 6Gb/s SAS!

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 15

0

5

10

15

20

25

30

35

2007 2008 2009 2010 2011 2012

2.5"

3.5"

Form Factor TransitionDensity

Source: IDC

(M’s)

SAS: Enterprise Form Factor Transition

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 16

Industry Compacts Storage

SAS & Small Form Factor (SFF)SFF increases density

Scale & expand in same spaceIdeal for Blade System Deployment

SFF Drives Consume 50% less Power than 3.5”counterparts

Save on volatile energy costsGrowth without pulling in extra power dropsLower heat loads & air-conditioning costs at equivalent performance

– Caution – Power per rack can still increase due to density increase

Higher Performance and Potentially Lower CostMultiple concurrent I/O’s (lots of drives operating concurrently)Lower TCO through common infrastructure

Additional AdvantagesRAID 5 or 6 on a 1U serverImproved Hard Disk Drive reliabilitySAS & SATA Drives in Common Drive Carrier

Density

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 17

Connector Types

SAS 4X ConnectorMini SAS 4X Connector

InfiniBand Style

Preferred External Connection Scheme

Density

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 18

Scaling outside the Server

SASController

and/or

SAS Cables

Expand Your DAS Capabilities

Cascaded Enclosures

Density

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 19

SAS: Improving Density and Airflow

Dramatically Improves Connectivity, Density & Airflow

Up to 160 SAS Links per 1u Rack!

SATA/SAS CableVS Parallel

External & Internal SAS 1.1 Mini SAS

(4x & 4i)

Highly Scalable ArchitectureConnectivity and Bandwidth

Density

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 20

Self Configuring Expanders Extend SAS

1st Gen SAS DiscoveryVendor Unique ZoningLimited to 128Discovery Executed by Initiator end-devices

Complicated large topologies Problematic for zoning

2nd Gen SAS DiscoveryStandardized ZoningExpanded to 1KDiscovery executed by SAS Expanders

Reduces time to discover large topologiesEnables zoning of the topologyAllows table-to-table routing

Enables Richer SAS Topologies

Hosts(Initiators)

Expanders

Serial Attached SCSI or SATA disk drives(Targets)

Scalability

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 21

w

Expanders – Scaling SAS Architecture

SASHBAs

SAS Expander Complex(packaged view)

SAS Expander Complex (internal view)

Scalability

Various JBODs

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 22

Cascading Enclosures

= Universal Connection (required at both end points)

= IN – Connects to universal or OUT port

= OUT – Connects to Universal or IN port

JBOD Enclosure

IN OUT

JBOD Enclosure

IN OUT

Server

End Device

Server

End Device

/ /

SASExpander

SASExpander

SAS HBA

SAS HBA

/Scalability

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 23

SAS Expander(s)

Shared Storage Example SAS Zoning

Greenis Zone 1

Redis Zone 2

4

4

2

4

2

Sees a total of 16 drives

Sees a total of 20 drives

8 - 2.5” Drives

12 - 3.5” Drives

8 - 2.5” Drives

Solutions

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 24

Scalable, Sharable DASSAS Value Proposition & Positioning

Performance Low Cost Distance

Fibre Channel X X

GbE iSCSI X X

10 GbE iSCSI X X

SAS X X

Significant market segment underserved by SAN alternativesSame room, modest scale (to few 10s of server & storage endpoints)Compliments Application Intelligence and Application MessagingEnhances Clustered Applications

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 25

Switched SAS ApplicationsRAID Array Drive Expansion

Blade Storage Mid-plane I/F

Lower Cost

Higher Bandwidth

Shareable DASSolutions

LSI

SASx36

SAS Switch

LSI

SAS1068

LSI SASx36

RAID Ctlr

LSI

SAS1068

LSI SASx36

RAID CtlrLSI

SASx36

SAS Switch

LSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

Blade Server

Daughter Card

External Storage

LSI

SASx36

SAS Switch

LSI

SASx36SASx36

SAS Switch

LSI

SAS1068

LSI SASx36

RAID Ctlr

SAS ROC SASx36

RAID Ctlr

LSI

SAS1068

LSI SASx36

RAID Ctlr

SAS ROC SASx36

RAID CtlrLSI

SASx36

SAS Switch

LSI

SASx36SASx36

SAS Switch

LSI

SAS1064

RaleighBlade Server

Daughter Card

LSI

SAS1064

LSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter Card

LSI

SAS1064

LSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter Card

LSI

SAS1064

LSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter Card

LSI

SAS1064

LSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter Card

LSI

SAS1064

LSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter Card

LSI

SAS1064

LSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter Card

LSI

SAS1064

LSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter Card

LSI

SAS1064

LSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter Card

LSI

SAS1064

LSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter Card

LSI

SAS1064

LSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter Card

LSI

SAS1064

LSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter Card

LSI

SAS1064

LSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

RaleighBlade Server

Daughter Card

LSI

SAS1064

LSI

SAS1064

RaleighBlade Server

Daughter CardLSI

SAS1064

Blade Server

Daughter Card

LSI

SAS1064SAScontroller

Blade Server

Daughter Card

External Storage

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 26

Demonstrates the extremely high throughput available with

standard high-volume components

6Gb/s SAS Demonstration

System ComponentsOne Quad-Core processorPCI-Express 2.03 – 6Gb/s SAS Controllers30 Drives – (2.5” 6Gb/s 15K RPM, JBOD)Workstation motherboard using latest CPU & chipsetWindows 2003

Solutions

PerformanceIometer Throughput Benchmarks

2KB sequential read or write

– 1,000,000 IOPs

256KB sequential read or write

– 6.5 GB/s

i7

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 27

What’s coming?

High Capacity SAS - Simplifies SAS ArchitectureSAS interface on High Capacity Drives, 2 TB and higherArchitecturally more efficient, Improves Enterprise System Integrity Minimizes impact of Multi-host emulation

6Gb/s SAS - Double transfer rate Decision Feedback Equalization Improves 6Gb/s SignalingData Integrity Initiative (DII) Expander ZoningSpread spectrum clockingMultiplexing (Optional)

Solid State Disks (SSD)Random performance improves read performance (10x to 100x)Early stages of market adoptionLeverages existing middleware infrastructureHigh demonstrated performance with further optimizations expected

Connectivity Roadmap

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved.

SAS Connectivity Objectives

Drive market consistencySimplify cable and connector options Provide managed connectivity standardsProvide converged high-density connectivityProvide active copper solution to 20mProvide optical solution to 100mSupport 6Gb/s SAS deploymentsExtensible to 12Gb/s SAS deployments

28

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved.

QSFP Optical(SFF-8436)Available

6-10 Meters

20 Meters

100 Meters

SAS-1/SAS 1.0 SAS-2 SAS 2.1 SAS-3

Mini-SAS (SFF-8088)Active CopperAvailable - (6Gb/s Limit)

SAS - Advanced Connectivity Roadmap

Suitable options, generally

acknowledged as short term solutions for “homogeneous”

deployments.

Mini-SAS HD (SFF-8643)

Unmanaged

Managed *

IB (SFF-8470)

Mini-SAS HD (SFF-8643/8644)

Optical (x4 & x8)

Active Copper (x4 & x8)

Passive Copper (x4 & x8)

•Based upon QSFP management scheme supported within SFF

Mini-SAS (SFF-8088)

29

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 30

Additional Info Available at:

T10 (Serial Attached SCSI Spec development)http://www.t10.org

SCSI Trade Associationhttp://www.scsita.org

Serial Storage Wirehttp://www.serialstoragewire.com

SATA I/Ohttp://www.sata-io.org

SAS and SATA Combine to Change the Storage Market © 2009 Storage Networking Industry Association. All Rights Reserved. 31

Q&A / Feedback

Please send any questions or comments on this presentation to SNIA: tracknetworking@snia.org

Many thanks to the following individuals for their contributions to this tutorial.

SNIA Education Committee

SCSI Trade Association (STA) Marty Czekalski SATA I/O Working Group David So Rich Johnson Howie Goldstein Chris Lionetti Joe White Jay Neer Bruce Grieshaber Tom Hammond-Doel Nancy Clay