ISCSI Storage: Momentum, Deployments and Future Claude Lorenson, Ph.D. Senior Product Manager...
-
Upload
nelson-wilkerson -
Category
Documents
-
view
221 -
download
0
Transcript of ISCSI Storage: Momentum, Deployments and Future Claude Lorenson, Ph.D. Senior Product Manager...
iSCSI Storage: Momentum, Deployments and Future
Claude Lorenson, Ph.D.Senior Product ManagerWindows Serverclor @ microsoft.comMicrosoft Corporation
Suzanne Morgan Program ManagerWDEG sumorgan @ microsoft.comMicrosoft Corporation
Session OutlineSession Outline
Part 1 iSCSI Storage MomentumiSCSI definedIndustry trends Emerging iSCSI-NAS technologyPlatform Support and Architecture
Future Microsoft’s iSCSI Roadmap
Part 2 iSCSI Deployments Customers
iSCSI Case Study: Video
City of Everett: Exchange Consolidation
Partners Broadcom: iSCSI boot
EqualLogic: iSCSI SAN/NAS
Session GoalsSession Goals
Attendees should leave this session with the following:
A better understanding iSCSI fits into the storage solution landscape
A better understanding of how iSCSI integrates into the Windows platform
A better understanding of the Windows applications that are supported on iSCSI
A better understanding of how iSCSI can benefit SMB and enterprise environments
A better understanding of customer deployments
iSCSI Defined: What Is iSCSI?iSCSI Defined: What Is iSCSI?
iSCSI = internet Small Computer System Interface An interconnect protocol that:
Is designed for storage area networks (SANs) Supports the block-based storage needs of database applications Is TCP/IP basedEstablishes and manages connections between IP-based storage devices, hosts and clientsIs based on familiar and ubiquitous open standards Provides advanced IP routing, management, and security tools
iSCSI Defined: An Alternative to FC SAN?iSCSI Defined: An Alternative to FC SAN?
A non-Fibre Channel means of deploying storage networks Low intangible costs (management, training, deployment)No inherent distance limitations on the protocolFlexible topologyEasy to use with multi-vendor storage devicesEasy to scale to large number of devices
DAS Direct Attached Storage
High TCOInflexible
NASNetwork Attached Storage
File storage traffic over LAN
SAN Storage Area Network
Optimized for block data transmissionSeparation of LAN from storage traffic
Industry Trends: What’s Driving StorageIndustry Trends: What’s Driving StorageNetwork Deployments?Network Deployments?
Escalating capacity needsFederal regulationsGrowing email databasesFile storage requirements doubling every 1-2 years
Need for flexible storage provisioning and data sharingNeed for improved data protection
2008 Open Systems External Storage
DAS17%
FAS83%2003 Open Systems
External Storage
FAS59%
DAS41%
Source: IDC, July 2004
Analyst predictions:
Industry Trends: Factors Slowing SAN AdoptionIndustry Trends: Factors Slowing SAN Adoption
Actual SAN adoption far lower than respondents hadpredicted in 2002. Why?
Perceived as too costly, even in large organizations
SMBs do not have the staff or the expertise to support a SAN
IDC: Networked Storage Opportunities, August 2004
Reasons for Not Buying a SAN
NAS preferred, 11%
SANs too complex, 14% DAS is adequate,
14%
Too few staff, 17%
SANs too expensive, 29%
Other, 5% Too little storage,
10%
Industry Trends: iSCSI Impact on SAN PurchasesIndustry Trends: iSCSI Impact on SAN Purchases
Organizations are constrained by: Limited budgets
Hiring freezes or cutbacks
Increased storage requirements
iSCSI SANs capitalize on:Existing LAN and WAN infrastructures
Existing staff expertise
iSCSI perceptions will drive new SAN purchasesAccording to the IDC, most potential buyers believe:
It will be easy to learn iSCSI
Same staff can be used for network and storage
Allows buyers to use standard network equipment for storage network
iSCSI products are likely to cost less than FC over time
iSCSI products are likely to be less expensive to manage over time
iSCSI products will have the same or better performance as FC
IDC: Worldwide iSCSI Forecast and Analysis, 2003-2007: Storage Networks Embrace IP , September 2003
Industry Trends: SAN Adoption - Growth AreasIndustry Trends: SAN Adoption - Growth Areas
Among those involved in the purchase of SAN solutions or employed at a company using/planning to use SAN solutions (N= 332): What types of SAN technologies are currently in place at your
company and what technologies is your company planning to use 12 months from now?
Source: Infoworld Test Center Research Report - Storage 2004
9%
11%
10%
35%
14%
36%
2%
7%
7%
12%
13%
22%
49%47%
iFCP
FCIP
NDMP
4 GB Fibre Channel
Ficon/ESCON
iSCSI/Ethernet
2 GB Fibre Channel
Currently
12 Mos. FromNow
Users have pent-up demand for iSCSI/IP based storageFull range of price points and brands are required torealize potential
Industry Trends: iSCSI Market Share ForecastsIndustry Trends: iSCSI Market Share Forecasts
2008 Open Systems External Storage
DAS17%
NAS17%
iSCSI15%
SAN (FC)51%
2003 Open Systems External Storage
DAS41%
NAS12%
iSCSI0%
SAN (FC)47%
Source: IDC, July 2004
iSCSI: A disruptive technology Especially with low cost SATA disks and LAN switches
Total market for iSCSI-based disk arrays: 2003: $216 M
2007: $4.9 B
Total market for iSCSI-based switches:2003: $27.9 M
2007: $1.15 B
Industry Trends: iSCSI AwarenessIndustry Trends: iSCSI Awareness
Slowly increasing 2002: 66% of IDC survey respondents heard of iSCSI
2004: 73%
In general, awareness is higher The larger the total installed storage capacity
When there are more than 10 servers/10 IT staff
Potential buyer interest is highest in large organizationsBuyer group: mean of 273 switch ports
Non-buyer group: mean of 67 (Source: IDC Sept 2003)
Many smaller businesses deterred by high cost disk arrays($25K-$100K)
US market currently has an estimated 8% iSCSISAN installations
Currently mid-market (30-300 installed servers) leads the installations (Source: IDC, August 2004)
Industry Trends: iSCSI SAN - Growth AreasIndustry Trends: iSCSI SAN - Growth Areas
iSCSI SAN Revenue by Price Band
0
200
400
600
800
1000
Band 1 Band 2 Band 3 Band 4 Band 5 Band 6 Band 7
Disk Storage Systems Price Band
Rev
enu
es (
$M) 2004
2005
2006
2007
2008
Band 1: $1k-$4.9k
Band 2: $5k-$9.9k
Band 3: $10k-$14.9k
Band 4: $15k-$49.9k
Band 5: $50k-$149.9k
Band 6: $150k-$299.9k
Band 7: $300k-$500k
1286% CAGR
249% CAGR
175% CAGR
WINDOWS has a high attach rate in these price bands
Source: IDC Worldwide Disk Storage Systems 2004-2008 Forecast and Analysis
Industry Trends: How Will iSCSI be Used? Industry Trends: How Will iSCSI be Used?
Large enterprises with installed Fibre Channel SANs no longer resistant to iSCSI SANsNow looking for less complex solutions
Tiered storage solutions is now an enterprise goal
Seeing the value of multiple SANs
Storage Magazine survey (October 2004):
Industry Trends: iSCSI Application Preferences Industry Trends: iSCSI Application Preferences
Application Type FC iSCSI
Mission critical enterprise applications 64.6% 32.6%
ERP, CRM and other databases 64.1% 35.5%
Clustered storage 59.7% 37.2%
Rapid restoration off disk drives 59.0% 37.4%
Tier 2 enterprise applications 57.0% 39.4%
Departmental SANs 48.8% 47.9%
Web servers/web sites 47.0% 49.6%
E-mail 45.8% 51.1%
Archiving of data 44.9% 52.1%
File and Print Services 44.6% 52.4%
Off site disaster recovery 43.4% 54.0%
Backup 41.7% 54.9%
General storage 38.8% 58.0%
Remote offices 38.0% 59.2%
Low usage applications 35.7% 61.6%
Source: IDC, August 2004
Industry Trends: Analyst View of Storage MarketIndustry Trends: Analyst View of Storage Market
Enterprise Mission Critical Applications
SAN
SAN
OLTP / ERPFinancial Data
Business Critical AppsEmail & Collaboration
Departmental & Remote DatabasesDocument Imaging & Content MgtLead Mgt. & Customer Databases
Medical Data ManagementScientific Data CollectionN
AS/
SAN
NA
S/SA
N
Workgroup Applications
DA
SD
AS
Microsoft Office Apps, Dept. File Sharing
ESG Storage PyramidRange of applications that need SAN functionality
Until iSCSI, too costly
Industry Trends: Analyst View of theIndustry Trends: Analyst View of theStorage Market (con't)Storage Market (con't)
Departments
Workgroups
$50K
$20K
3TB
1TB
Mis
sion
Crit
ical
Mis
sion
Impo
rtan
t
DataCenters
FC-SAN
NAS
DAS
IP-SAN
Gartner Storage PyramidEnvironments will continueto grow CAGR 80%
A new storage pyramidby 2006
10% of the industry will be using FC-SAN
40% IP-SAN
50% DAS
Windows & iSCSI: MomentumWindows & iSCSI: Momentum
In a survey of Storage Magazine readers (October 2004), Windows was the preferred host platform choice for iSCSI SANs:
Worldwide external disk storage (terabytes sold) for iSCSI SANs
Windows Unix Linux Other Total
531 432 60 25 1048
51% 41% 6% 2% 100%
IDC, Worldwide Disk Storage Systems 2004-2008 Forecast and Analysis, August 2004
Windows & iSCSI: NAS or iSCSI?Windows & iSCSI: NAS or iSCSI? Application NAS iSCSI
Enterprise Class Database Oracle using NFS (special edition)
X (all vendors)
Small SQL Applications (see KB article) X X
Small Business Line Applications-small data transactions
X X
Microsoft Exchange 2003 (<1500 users)(requires feature pack)
X X
Microsoft Exchange 2003 (>1500 users) X
Microsoft Exchange 2000 X
Microsoft Exchange 5.5 X X
File System / Print Servers X X
Windows SharePoint Services X
Large Streaming Data Transactions X
Consolidated Storage Management X X
Consolidated Backup X X
Ease of Implementation / Administration (for single device)
X
Windows & iSCSI: Emerging iSCSI-NAS DevicesWindows & iSCSI: Emerging iSCSI-NAS Devices
Adding iSCSI capabilities to NAS devices
Key advantagesConsolidated networked storage
File, print, and application storage services on a single NAS platform
Single platform to manage, expand, protect.
Leverages well-understood Ethernet technology using low-cost components
Windows Storage Server OEMs are taking advantage of the many 3rd party targets available:
HP NAS 500s, 1200s, 1500s, 2000s
Fujitsu-Siemens FibreCAT N20i 1 TB, SATA drives
Very economical iSCSI target capabilities
Other vendors to follow soon
Windows & iSCSI: Emerging iSCSI-NASWindows & iSCSI: Emerging iSCSI-NASDevices (con't)Devices (con't)
Provide best-of-breed entry-level storage consolidationNAS traditionally for file serving to clients; application servers traditionally host storage internally (DAS)
iSCSI-NAS devices
Allow consolidatation of client and application data in a NAS storage server
Create a storage tier to serve both client and application tiers
No Fibre-Channel SAN required for block-level data
Windows & iSCSI: Application SupportWindows & iSCSI: Application Support
Exchange, SQL, and Windows SharePoint Services are supported on iSCSI SANs
Note: hardware components, including iSCSI hardware, must be logo’d in their device category
Exchange, SQL, SharePoint Services can all be installed on an iSCSI disk
For detailed information on how to configure the Microsoft iSCSI initiator with Exchange and SQL
See the iSCSI user’s guide
For more information on iSCSI support, see: 317173 – Exchange support with SANs
833770 – Support for SQL Server 2000 on iSCSI technology components
Windows & iSCSI: ArchitectureWindows & iSCSI: Architecture
Complete iSCSI architecture for Microsoft platformsWindows Server 2003 Windows Storage Server 2003 Windows 2000Windows XP
Architecture includes:iSCSI software initiator
Responsible for moving storage data over the network For use with standard NIC
Initiator Service Manages all iSCSI initiators, providing uniform storage management
Provides device discovery and management capabilities Manages security (includes iSNS client)Initiates and terminates iSCSI sessions
Management applications Command line interface (CLI)Control panel application (provides most common iSCSI operations)
Windows & iSCSI: Architecture DetailsWindows & iSCSI: Architecture Details
NIC
MultifunctionCard
iSCSI HBA
SoftwareInitiator
Bus Driver+Miniports
MiniportDriver
InitiatorService
iSNSClient
WM
I
HardwareHardwareDriversDriversManagementManagementApplicationsApplications
iSCSICLI
Security
DeviceManager
Perf.Monitor
MgmtApps
Ne
two
rkN
etw
ork
Microsoft iSCSIMicrosoft iSCSI
Microsoft WindowsMicrosoft Windows
VendorVendor
Windows & iSCSI: SecurityWindows & iSCSI: Security
Microsoft iSCSI architecture integrates security iSCSI Software Initiator uses built-in IPsec
IPsec for encryption
Internet Key Exchange (IKE)
CHAP for authentication
Microsoft iSCSI Service providesA common interface for all implementations
A security interface for management applications
Interface with Windows IPsec
Caching of keys
Wire-speed IPsec Hardware supporting this should be available in 2005
Native IPsec supportMore iSCSI targets are beginning to offer this
iSCSI Logo Program for Various TargetsiSCSI Logo Program for Various Targets
iSCSI target devicesStorage arraysBridge devicesHost Bus Adapters Media changers
Testing ProtocolThe target OS (abstracted) is tested to ensure that:
It responds correctly to SCSI an iSCSI protocol and commandsIt interoperates with the Microsoft iSCSI initiator/service
iSCSI specification compatibility/complianceCHAP Digest
SCSI complianceSBC, SMC, SPC-2 and SPC-3
Note that except for control LUNs, signing drivers for iSCSI arrays/bridges is excluded from the iSCSI logo program
As of 4/2005, over 120 iSCSI hardware targets qualified
Windows & iSCSI: FutureWindows & iSCSI: FutureMicrosoft’s iSCSI Roadmap
Microsoft iSCSI Software Initiator v2.0 Integrate MPIO with iSCSI
Support and integration withVDS (requires VDS 1.1)
x64 support
Supportability and Deployments enhancements
Auto-discovery
Support for IPv6
Q1200Q120055
LonghorLonghornn
Storage Management Integration (next version)Integration of iSCSI & iSNS withActive Directory and Radius
Winsock Kernel Support (RDMA)
Storage Explorer User Interface
Centralized Management of iSCSI & Fibre Channel targets
Integrates the Microsoft MPIO high availability multipathing solution
Supports logo’d block storage devices
Designed to work with all SPC-2 or later compliant targets
MS MPIO DDK includes iSCSI DSM source
The iSCSI-MPIO solution enablesMultiple connections per session
Multiple load balance policies and failover policies
Persistent ISID across reboots
Portal hopping for target rediscovery
Attempt connection to alternate portals in the event of lost connection
Error Recovery Levels 1 & 2 for tapes and high availability scenarios
Windows & iSCSI: Next GenerationWindows & iSCSI: Next GenerationVersion 2.0Version 2.0
Windows & iSCSI: Next GenerationWindows & iSCSI: Next GenerationVersion 2.0 (Con't)Version 2.0 (Con't)
Provides x64 support
Enhances supportability and deploymentImproved event log messages
Eventlog using WMI
Event Tracing
Unattended Setup
Enhancements to iSCSICLI & iSCSI GUI
Auto discovery of iSNS server using DHCP
Enhancements to iSCSI WMI provider
IPv6
Windows & iSCSI: Longhorn IntegrationWindows & iSCSI: Longhorn Integration(Next Version)(Next Version)
Project Goals: Persist iSCSI security and other configuration information
Data access
Storage device management
Provide: A centralized management interface
The infrastructure to distribute configuration information securelyIntegration with Active Directory
Infrastructure to centralize secure authenticationIntegration with RADIUS
Accounting with RADIUSiSCSI login and configuration changes
High availabilityFabric management
Community ResourcesCommunity Resources
Windows Hardware & Driver Central (WHDC)www.microsoft.com/whdc/default.mspx
Technical Communitieswww.microsoft.com/communities/products/default.mspx
Non-Microsoft Community Siteswww.microsoft.com/communities/related/default.mspx
Microsoft Public Newsgroupswww.microsoft.com/communities/newsgroups
Technical Chats and Webcastswww.microsoft.com/communities/chats/default.mspx
www.microsoft.com/webcasts
Microsoft Blogswww.microsoft.com/communities/blogs