Fibre Channel technologies - Storage Networking Industry ... · Fibre Channel Technologies ... –...
Transcript of Fibre Channel technologies - Storage Networking Industry ... · Fibre Channel Technologies ... –...
EDUCATION
Fibre Channel Technologies“Current & Future”
Presenters: Dr. M. K. Jibbe, LSI Logic (ESG)Tom Hammod-Doel, LSI Logic (ESG)Steven Wilson, Brocade Communications Systems, Inc.
2/28/2007
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
2
SNIA Legal Notice
• The material contained in this tutorial is copyrighted by the SNIA.
• Member companies and individuals may use this material in presentations and literature under the following conditions:– Any slide or slides used must be reproduced without modification– The SNIA must be acknowledged as source of any material used in the
body of any document containing material from these presentations.
• This presentation is a project of the SNIA Education Committee.
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
3
The objectives of this tutorial are:• Provide the user with a Primer on Fibre Channel • Project the market outlook and roadmap of Fibre
Channel • Share what is New in Fibre Channel Standards for
Protocols APIs, and Management.
Abstract
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
4
What can FC provide today?
1. Flexible, Scalable relative to Topologies, Speed, Performance, Distance, Node connectivity and Low cost
2. Communication and Data Overhead (Framing, Data Communication, Latency, Efficiency, Routing Control, and Access Control),
3. Redundancy, Availability, and Failover, 4. Applicability in SAN (Easy of use), with large IT User
Base
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
5
FC Topologies
Switched FabricUp to 2/24 ports in a switched interconnectMultiple concurrent communications for high aggregate
throughout • Fibre channel supports a 24-bit address space
Provides 2 ^24 addressesFC routing is done based on NPort ID
assigned on login (24-bit addressing consisting of Domain ID, Area ID, and Device ID)
• FC Device ports are uniquely identified by a MAC ID (Worldwide Name)• Address lookup is provided by the Fabric Switch using the Name Server portion of Directory Services
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
6
FC Topologies
Arbitrated Loop → Up to 127 ports on a shared loop
Point-to-Point → Two ports on a dedicated link
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
7
Topology Comparison
Note 1: Frame Delivery Ordering is switch implementation dependent
Note 1
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
8
Flexibility and Scalability
• Uses a common transport mechanism to support:– Physical interface types: Multi/Single Mode Fiber, and Cu– Traditional Channels: SCSI, IPI3, SBCCS, and HIPPI– Traditional Networks: IP, IEEE 802, and ATM
• High-speed -100/200/400/800/1200 MB/s, Reliable data transmission:– 100/200/400/800/1200 MB/s– BER < 10-12
• Provide scalability of performance and cost• Encourage industry support through open standards• Designed to fulfill the needs of SANs
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
9
Speed
Established in late 1980s, first standardized by ANSI T11 in 1994 • 4GFC & 10GFC TODAY! 8GFC & 20GFC in 12 – 18 months
– ISL rates to keep step with edge rates at 2.5x-3x bandwidth premium over edge rates– 4G edge uses 10G ISL, 8G edge uses 20G ISL, 16G edge uses 40G ISL, etc..
• $9.9B Fibre Channel SAN Market in 2007 & growing faster than total storage market• Over 50% of all external storage is FC and over 90% of all SAN is FC• TB of FC: 604K 2005, 1.4M 2007, forecast to hit 4.4M Terabytes of FC storage by 2010 (50%
CAGR)• FC Switch and HBA port count growing at 35% CAGR• 4GFC at the same price as 2GFC and 1Gb/s Ethernet• 4GFC is plug-compatible with 1 and 2GFC (devices auto negotiate w/o user intervention)• Applications are driving higher data rates (i.e. Video, back-up times; more data to backup, less
time to do it)• R/W operations on 4GFC HBAs show dramatic improvements with 98.5% real utilization on
saturated lines• Serial SCSI; FCP protocol• Minimal error rates for network technology• Credit-based flow control (no dropped frames)
1997Fibre Channel
1GFC Fibre Channel SANs
2GFC Fibre Channel
8/16GFCFibre Channel4/10GFC
Fibre Channel
1999
2001
2004
Future
1997Fibre Channel
1GFC Fibre Channel SANs
2GFC Fibre Channel
8/16GFCFibre Channel4/10GFC
Fibre Channel
1999
2001
2004
Future
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
10
Maximum Distance
• 2 Km distance with Multi- mode Fibre• 10 Km distance with Single Mode Fibre• 5000 Km distance with FC over IP
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
11
Frames
• Flexibility – Fly by Frame handling – Out of order
• Speed• Routing
Transmission Words2112
Where frame is being sent to
Where the frame came from
Frame Control fieldSequential count of frames
Responder Exchange ID
4 24 4 4
Data FieldFrame Header Optional
HeadersPayload
(information being transported)Fill
BytesFill
Wor
d
Fill
Wor
d
Sta r
t- of-f
ram
e
E nd-
o f-fr
ame
Fill
Wor
d
Fill
Wor
d
Fill
Wor
d
CR
C
Frame type and content/function
Class-specific control information
Protocol Type in this frame
Sequence this frame belongs to
Originator Exchange ID
Multi-purpose parameter field
R_CTL
CS_CTL
TYPE
SEQ_ID DF_CTL
OX_ID
Destination Address (D_ID)
Source Address (S_ID)
Frame Control (F_CTL)
SEQ_CNT
RX_ID
Parameter Field (PARM)
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
12
Data Traffic with Exchanges
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
13
Establishing Operating Environment
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
14
Flow Control: Access Control, Latency, and Efficiency
Login Buffer to Buffer• Node to Fabric• Fabric to Node
Login Node to NodeFlow control is credit based
• Buffer-To-Buffer Credit• Control pace of frame transmission• Each R_RDY received increments the
available BB_Credit valueLatency
• Across a single switch, average latencies are less than 400 nanoseconds.
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
15
FC Routing
- Connect Any to Any- Maximize Connectivity- Simplex and Duplex
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
16
FC Access Control
Provide AccessibilitySoft Zoning: Employs the Name Server to limit the information returned to an initiator in response to a query. Hard Zoning: Enforced by the Fabric
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
17
Redundancy, Availability, and Failover
- Multi-Path- Full Redundancy- Path Failover
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
18
FC Products Dominant in Enterprise Datacenter
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
19
Detailed RAID Storage:Array Module with Different Drive Technologies
There’s a lot more under the Fibre Channel hood than appearances reveal:
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
20
FC Product Performance – IOPS: Host Interface – Drive Interface
Drive Type
Dual4 GFC
Quad4 GFC
Future8 GFC
Burst I/O rate cache reads (512 byte) 125K 125K 200K
Sustained I/O ratedisk reads (4k – R5) FC 40k 40k 80K
SAS 70K
SATA 12K
Sustained I/O ratedisk writes (4k- R5) - CMD FC 9k 9k 15K
SAS 8K 10K 12K
SATA 2K 2K 4K
Number of drives required for benchmark test and code thread
FC, SAS, / SATA
96D / 8T 96D / 8T 96D / 8T
- FC continues to evolve with different technologies
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
21
FC Product Performance –MB/sec
Drive Type
DualFC
QuadFC
Future8 GFC
Sustained throughputcache read (512k) 1600 MB/s 1800 MB/s 3000 MB/s
Sustained throughput disk read (512k) FC 850 MB/s 850 MB/s 1600MB/s
SAS 800 MB/s 800 MB/s 1200 MB/sSATA 800 MB/s 800 MB/s 900 MB/s
Sustained throughput disk write (512k) FC 800 MB/s 800 MB/s 1600 MB/s
Cache mirroring disabled SAS 750 MB/s 750 MB/s 750 MB/s
Cache mirroring disabled SATA 750 MB/s 750 MB/s 750 MB/s
Number of drives required for benchmark
test and code threadFC 48D / 8T 48D / 8T 48D / 8T
- FC continues to evolve with different technologies
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
22
Current Cost Comparison Table
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
23
What’s New?
A Roadmap to the Future!
The report of my deathwas an exaggeration.
Fibre Channel is Here to Stay.
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
24
Continuous SAN Market Growth
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
25
FC has been the major storage system interconnect since the mid 90s• FC dominates the SAN and external storage market place
How will FC continue to Meet customers’ evolving needs?• Faster speeds• Bandwidth/Cost leadership• Investment protection• Additional capabilities• Lower cost solutions• Simplified solutions (Plug-n-play)
Fibre Channel’s Continuous Evolution
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
26
Continuous Back-EndMarket Growth
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
27
FCIA Fibre Channel Speeds –3 Connection TypesFC specifies 3 connection types
• FC-Base2 • FC-Base10 • FC-BaseT• All speeds of each type Auto-negotiate best
speed w/o any user intervention!• Each speed within its connection type is
backward compatible 2 generations!
FC-Base2• Predominant FC interconnect• Used for fabric Edge and ISL• Also used for Disk and Tape Drives• All speeds single lane serial streams• Optics and copper cabling, SFP/SSF
FC-Base10• Used for ISL (2.5x-3x bandwidth of edge)• 4G Edge/10G ISL migrates to 8G Edge/20G ISL
migrates to 16G Edge/40G ISL, etc
FC-BaseT• FC using Cat5e/6/6a infrastructures• Copper only (Cat5e/6/6a cables)• RJ-45 connector• User can use FC without changing any existing
or new Ethernet cabling!
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
28
FCIA Fibre Channel Speed Roadmap
*Base2 used throughout all applications for Fibre Channel infrastructure and devices. Each speed maintains backward compatibility at least two previous generations (I.e., 4GFC backward compatible to 2GFC and 1GFC)**Base10 commonly used for ISLs, core connections, and other high speed applications demanding maximum bandwidth. ***BaseT used in common Ethernet copper infrastructures incorporating CAT5e/6/6a cables and RJ-45 connectors†Line Rate: All Base2 speeds are single-lane serial stream ‡Dates: Future dates estimated
Courtesy of FCIA
1GFC 200 1.0625 19962GFC 400 2.125 20004GFC 800 4.25 20038GFC 1600 8.5 200616GFC 3200 17 2009
ProductNaming
Throughput(MBps)
Line Rate(GBaud)†
T11 Spec TechnicallyCompleted (Year)‡
Market Availability(Year)‡
19972001200520082011
Base2*
32GFC 6400 34 201264GFC 12800 68 2016
128GFC 25600 136 2020
Market DemandMarket DemandMarket Demand
Base10**
10GFC 2400 10.52 2003 200420GFC 4800 21.04 2007 200840GFC 9600 42.08 TBD Market Demand80GFC 19200 84.16 TBD Market Demand160GFC 38400 168.32 TBD Market Demand
BaseT***
1GFC 200 1.0625 2006 20072GFC 400 2.125 2006 20074GFC 800 4.25 2006 20078GFC 1600 8.5 TBD Market Demand10GFC 2400 10.52 TBD Market Demand
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
29
FCIA “Condensed” Roadmap (Speed Gb/s)• FC-Base2 (Edge, Backend, and ISL)
– 1GFC, 2GFC, 4GFC shipping today– 8GFC Ships in 12-18 months – 16GFC, 32GFC, 64GFC, 128GFC
• FC-Base10 (ISL)– 10GFC shipping today– 20GFC ships in 12-18 months – 40GFC, 80GFC, 160GFC
• 100GFC under study (leverage IEEE 802.3 work)• FC-BaseT (Edge)
– new 2006 standard for Ethernet RJ45 Cat5/6 copper)– 1GFC, 2GFC, 4GFCF, ships in 12-18 months– 8GFC, 10GFC
• 8GFC follows typical FC trend• 10G follows typical Ethernet trend
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
30
Fibre Channel Is Being Improved According To Real Customer Requirements
• New Fibre Channel Standards for– Management And Ease Of Use– Operational Flexibility and
Scalability– Security
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
31
Management Improvements
• Fabric Device Management Interface– HBA Information Can Be Retrieved From The Fabric
• Fibre Channel Open Management– SMI-S– SNMP MIB Development
• Improvements to the Fabric Configuration Server– Advanced Topology Discovery and Bulk Data Retrieval
• Common Transport– Session Semantics Have Been Added
• Diagnostic Tools– FC Trace Route and Ping
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
32
Operational Flexibility
• FAIS: Fabric Application Interface Specification– Allows fabric to host certain applications
• Event Server– More Granular Event Registration
• Virtual Channels– Enables Traffic Differentiation On Links
• Enhanced Commit Service– Fabric Locking More Granular
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
33
Operational Flexibility
• Frame Tagging– Enables Virtual Fabrics
• Routing Architectures and Models– Allows Devices On Distinct Fabrics To Communicate Without a
Merge
• FC-SATA: SATA Tunneling over FC– Brings native tiered storage to FC– FC SATA: An FC-4 mapping of the Serial ATA storage interface
protocol to Fibre Channel
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
34
Operational Flexibility
• What Is NPIV?– Acronym for N-port ID virtualization.
– Additional attribute of an F-port.
– FLOGI request allocated the base PID 0xddaa00.
– FDISC(SID=0) requests allocate virtual PIDs: 0xddaa01, 0xddaa02,
0xddaa03 …
– Used by multiple virtual machines emulated on a physical machine.
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
35
NPIV OverviewVirtual Machine
OS Instance
OS Instance
OS Instance
OS Instance
FLOGI (FFFFFE, HWWNN, HWWPN)
FLOGI ACC: Base PID: 0xddaa00
FDISC (SID=0, VWWNN1, VWWPN1)
FDISC ACC: VPID0: 0xddaa01
FDISC (SID=0, VWWNN2, VWWPN2)
FDISC ACC: VPID: 0xddaa02
FDISC (SID=0, VWWNN3, VWWPN3)
FDISC ACC: VPID: 0xddaa03
FDISC (SID=0, VWWNN4, VWWPN4)
FDISC ACC: VPID: 0xddaa04
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
36
Storage Virtualization
• Three types of storage virtualization
Refer to SNIA Virtualization Tutorials
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
37
Fabric Based Virtualization
• FC-Fabric Application Interface Specification (FAIS)
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
38
Virtual Channels• ISL buffer credits are assigned to traffic flows to provide
Quality of Service (QoS) between switches
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
39
Virtual Fabric Tagging
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
40
Inter-Fabric Routing
Layer 2 – SwitchingFSPF = Fabric Shortest Path First
ISL = Inter-Switch Link
Layer 3 – RoutingIFRSPF – Inter-Fabric Routing
Shortest Path FirstIFR = Inter-Fabric Router
Simple Routing
1 2
3
4 5
6
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
41
FC-SATA Configuration
FC-SATA
SATA Storage
Shelf
map to SATA FIS,wrap in FC-SATA
SATA FIS
FC-SATA
Virtualize, or simply pass through
SATA FIS
FC-SATA
SCSI Storage
Shelf
Server
Server
Server
FAST RAIDSwitch
FCP
SCSIFCP
FCP
SCSI
ATA
SATA FIS
SATA FIS
FC-SATA
FC-SATA payloads
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
42
Security
• FC-SP Has Completed Letter Ballot and Will Soon Be A Standard
• Addresses– Infrastructure (Passwords, PKI, Secrets)– Authentication (FCAP, DH-CHAP, FCPAP)– Authorization (Security Policies)– Data Integrity (Hash, Keyed-Hash, Signatures, ESP)– Confidentiality (ESP)– Policy Distribution
Refer to SNIA FC-SP Tutorial
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
43
Fibre Channel: The Storage of Business
Dominates the SAN market todayFibre Channel has a clear roadmap to provide:
• Higher performance• Additional capabilities (Security, Tiered Storage, Intelligence…)• Enablers for new markets
Easy to learn, use and implementProtects and future proofs storage investmentsComprehensive end to end solution
Fibre Channel Meets the Challenge
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
44
Q&A / Feedback
• Please send any questions or comments on this presentation to
SNIA: [email protected]
Many thanks to the following individuals for their contributions to this tutorial.
SNIA Education Committee
Dr. M. K. JibbeSkip JonesSteve WilsonTom Hammod-DoelHoward GoldsteinRobert Peglar
EDUCATION
Fibre Channel Technologies© 2007 Storage Networking Industry Association. All Rights Reserved.
45
Continue Your SNIA Education Experience At SNW• Attend Hands-On Labs in:
Data ClassificationKey to Service Level Management
Data Security and Protection Data Assurance Solutions to Meet Corporate
RequirementsIP Storage
iSCSI, Your IP SANStorage Management
Manage Storage or Be Managed By ItStorage Virtualization
Increasing ProductivityZero to SAN
• Fibre Channel Connectivity in No Time
Sessions begin Monday afternoon, April 16 and continue through Wednesday, April 18. All sessions in Emma/Maggie/Annie, 3rd
Floor of the Hyatt Manchester.Registration at the SNW Registration area