Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product...

30
Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft Corporation

Transcript of Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product...

Page 1: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Emergence of Windows as the Leading Platform for Storage

Claude Lorenson, Ph.D.Senior Product ManagerWindows Server Division clor @ microsoft.comMicrosoft Corporation

Page 2: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Session OutlineSession Outline

Storage Challenges

Current and Future Storage Trends

Windows Storage Integration New technologies

Market Impact

Customer benefits

Opportunities and Partners Solutions

Strategy and Vision

Page 3: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Session GoalsSession Goals

Attendees should leave this session withthe following:

Understanding of the role of Windows in storage environments

Knowing the integration points of the Windows platform with storage hardware

A clear view of the opportunities in developing solutions for the Windows platform

Understanding the key initiatives moving forward

Page 4: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Optical PlatformOptical Platform Client/ConsumerClient/Consumer

Storage FabricsStorage Fabrics Server/EnterpriseServer/Enterprise

Personal StoragePersonal Storage Client/ConsumerClient/Consumer

Preferred Preferred Storage PlatformStorage Platform Partner/CustomerPartner/Customer

Storage Devices: Key Windows StrategiesStorage Devices: Key Windows Strategies

Timely, comprehensive, quality platform support for optical devices

Optimized platform features enabling new customer scenarios in Personal Storage

Leading platform supporting storage fabricsLeading platform supporting storage fabrics

Preferred platform for developing, integrating, and deploying storage devices

Page 5: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Storage Pressures Storage Pressures

Storage growth estimates: 60-100% per yearGrowth of e-business, e-commerce, and e-mail now common for organizations to manage many TB of data

Mission critical data must be continuously available

Regulations require long-term archiving

More storage-intensive applications on market

Storage and Security are the #1 pain points for the IT community (shared the #1 spot)

Managing storage growth effectively is a challenge

Adding more DASincreases complexity

doesn’t solve many data protection/high availability problems

Page 6: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Current Storage TrendsCurrent Storage Trends

Costs of managing storage can be 10X the cost of storage

DAS management costs and scalability issues have helped increase the popularity of networked storage

2003 Open Systems External Storage

DAS41%

FAS59%

90¢

70¢

50¢

30¢

10¢DASDAS NASNAS SANSAN

2008 Open Systems External Storage

DAS17%

FAS83%

Sources: McKinsey and IDC

Page 7: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Current Storage TrendsCurrent Storage Trends

Storage consolidation in the center, caches at the edgesBranch offices with no administrative staff

Disk replacing tape for backupAutomated backups, admin-less restores

Fast recovery from viruses

Management costs dominating acquisition costsAppliances, consolidation, virtualization reduce acquisition costs

Security, compliance, help desk, SLA’s all require people

Systems adding automatic failure detection and self-healing

Data moving to richer specialized storage platformsEmail, SAP, SQL, Document Management Systems, CAS

Page 8: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Future Storage TrendsFuture Storage Trends

HardwareNew form factors - storage bricks, consumer NAS, new disk formats

SoftwareInformation Lifecycle becomes a reality

Compliance paves the way for Reference Data platforms

Global peer to peer storage

ManagementAccess to my data from anywhere

Application centric storage management

Self healing systems

Seamless scale-out

Fuller security model: encryption, tamper proofing

Page 9: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Bring high end storage features into the platform and make them available to everyoneDeliver best of breed storage solutions by utilizing a great partner eco-systemDifferentiate by delivering end-to-end scenarios

Microsoft StorageMicrosoft Storage

Deliver simple, affordable, and manageable storage solutions through investments in platform, solutions, and partners.

Strategy

Mission

Products

Page 10: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Windows Storage IntegrationWindows Storage Integration

Architecture and Platform Development Has Responded to Storage Trends in the Industry

Page 11: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Storage Integration: Windows Server 2003Storage Integration: Windows Server 2003

With integrated storage, Windows Server 2003 facilitates:Data Protection and Recovery

Volume Shadow Copy Services (VSS)ASR (Automated System Recovery)

Availability, Scalability, and PerformanceMultipath IO (MPIO)Distributed File System (DFS) File and System Performance (SMB, NFS, Chkdsk, Vrfydsk)

Interoperability and Management Support for both iSCSI and Fibre Channel Virtual Disk Service (VDS)SAN Integration

SAN BootFlexible Volume MountingStorportHBA APIFibre Channel Information Tool

Hardware Partners Are Key Enablers for These Solutions

Page 12: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Storage Integration: Windows Server 2003 SP1Storage Integration: Windows Server 2003 SP1

With SP1, Windows Server 2003 supports LUNs of size greater than 2TB

Maximum NTFS Filesystem size: 256TB

Maximum Basic/Dynamic Volume size: 273 Bytes

Who benefits?Our premier server partners

Storage array vendors, many of whom support LUN> 2TB

Customers with large file applications like video-based applications, geo-exploration that want to stay on Windows

Page 13: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Impact on Market Trends: Impact on Market Trends: Storage Revenue per Operating System

According to IDC 2004, Windows is the number one platform for all key metrics:

Total storage

External storage

External RAID storage

Source: Worldwide Disk Storage Systems 2004-2008 Forecast and Analysis (IDC, 2004)

Page 14: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Impact on Market Trends: Impact on Market Trends: Data Center Growthby Platform

Annual price/performance improvements (est.)

Mainframe 15%-20%

RISC (Unix) 20%-30%

Intel (Windows/Linux) 30%-40%

Multi-tier application architectures

Drives Wintel/Lintel application and Webserver deployment

Unix recedes to back-end DBMS tier

Windows surpasses proprietary Unix in 2007

Data Center Capacity Growth: 2002-12

Data Center Capacity Growth: 2002-12

0x

5x

10x

15x

20x

25x

30x

2002 2007 2012

13x (20%)

251x (26%)

74x (51%)

2.6x (3%)

z/OS Windows Linux Unix

(% o

f cap

acity

)

Meta Group Data

Page 15: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Impact on Market Trends: Impact on Market Trends: Fibre Channel Market

Based on past data, IDC forecasts that Windows will overtake Unix as the leader in hosting Fibre Channel SAN storage

Worldwide External Disk Storage Systems for Fibre Channel SAN

015,00030,00045,00060,00075,00090,000

2001 2002 2003

Year

Tera

byte

s Windows

Unix

Linux

Source: Worldwide Disk Storage Systems 2004-2008 Forecast and Analysis (IDC, 2004)

Page 16: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Impact on Market Trends: Impact on Market Trends: iSCSI SAN Market

Worldwide external disk storage (terabytes sold) for iSCSI SANs in 2003

In a survey of Storage Magazine readers (October 2004), Windows was the preferred host platform choice for iSCSI SANs:

Windows Unix Linux Other Total

531 432 60 25 1048

51% 41% 6% 2% 100%IDC, Worldwide Disk Storage Systems 2004-2008 Forecast and Analysis, August 2004

Page 17: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

New Technologies: Customer BenefitsNew Technologies: Customer Benefits

Technologies in Windows Server 2003 enables new scenarios

New capabilities to restore data in seconds instead of hours (VSS)

Simpler SAN management, one look and feel for all arrays (VDS)

Easier maintenance and troubleshooting for HBA drivers and firmware (Storport)

Easier support and deployment of high availability solutions (MPIO)

Provide choice for storage architecture (iSCSI)

Page 18: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

New Technologies: Customer AdoptionNew Technologies: Customer Adoption

The new technologies are an upgrade trigger Regional Law Office

Moved from Novell to W2K3 to better integrate on SAN

Digital Content ProviderMoved from W2k on DAS to W2K3 on SAN take advantage of VSS restore

Large Internet-based service providerMoved most servers to W2K3 take advantage of iSCSI and VSS restore for Exchange

Large Financial InstitutionMoved from W2K on DAS to W2K3 on SAN to take advantage of quick restore with VSS

Page 19: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Intersections with the Hardware IndustryIntersections with the Hardware Industry

Working jointly with the industry to ease the complexityof storage networks

Interoperability

Reliability

Management

Security

Performance

Goal is to integrate storage capabilities into the operating system

Alignment of the Windows platform and hardware capabilities

Enable new classes of applications to use these capabilities

Enable vendors to take advantage of their value-added functions

Make sure end-to-end scenarios are covered

Page 20: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

W2K – DAS W2K3 - DAS W2K3 - SAN

AD DBSize

330 GB* 165 GB 165 GB

Backup Time

19 hours* 4.75 hours 5 minutes

(2 - 3 sec db freeze)

Restore Time

19 hours* more than 4.75 hours

10 minutes

DC Promo Time

7 to 10 days* 2 to 3 days 59 minutes

Forest Recovery

10+ days* 3+ days 1h +

~ 20 minutes/DC

W2K3 results on a 19 Million object Active Directory at a large financial institution

* Estimated results based on testing and implementation by other groups

Fast Recovery: DFast Recovery: DAS vs SAN Comparison forWindows 2000 Server vs Windows Server 2003Windows 2000 Server vs Windows Server 2003

Page 21: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Fast Recovery with Exchange at MicrosoftFast Recovery with Exchange at MicrosoftUsing VSS Hardware ProviderUsing VSS Hardware ProviderFast Recovery with Exchange at MicrosoftFast Recovery with Exchange at MicrosoftUsing VSS Hardware ProviderUsing VSS Hardware Provider

Page 22: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Windows 2003 Hosts

Switch

Simpler ManagementSimpler ManagementVDS – Virtual Disk Service

No user visible changes

Manage DAS AND SAN storage

Storage resource provisioning

ManagementConsole

DAS

SAN

Software and hardwareRAID Management

Create, Grow, Delete LUN

RAID stacking

Service handlesSubsystem Discovery

Formatting

Hardware LUN masking

Management enabler

Page 23: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Partner VDS Adoption:Partner VDS Adoption: QLogic SANSurfer

VSD Manager

Features:SAN Component discovery

Intuitive console for simple array management

Manage heterogeneous storage subsystems

Configure and monitor storage resources

Virtualization of hardware and software logical volumes

Fault analysisMonitoring of SAN devices

Volume status

Performance monitoring

Health

Page 24: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

High Availability SolutionsHigh Availability SolutionsMPIO Deployment

Fabric BFabric B

Brocade 3800Brocade 3800

Fabric AFabric A

Brocade 3800Brocade 3800

HAB0HAB0HAB0HAB0

HAB4HAB4HAB4HAB4

HAB2HAB2HAB2HAB2

HAB6HAB6HAB6HAB6

Xiotech MagnitudeXiotech MagnitudeFirmware v10.01Firmware v10.01

Xiotech MagnitudeXiotech MagnitudeFirmware v10.01Firmware v10.01

Compaq DL360/DL380 ServersCompaq DL360/DL380 ServersWindows 2000/2003Windows 2000/2003

QLogic 2200FQLogic 2200F

Compaq DL360/DL380 ServersCompaq DL360/DL380 ServersWindows 2000/2003Windows 2000/2003

QLogic 2200FQLogic 2200F

Running:•SQL•Exchange•Citrix•Liberty

Key featuresRemove single points of failure

HBA’s, switches, storage controllers

Failover and FailbackMove I/O to alternate path if primary fails

Return to primary path after recovery

Support multiple load balancing and failover/failback policies

Page 25: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Storage Solution Flexibility Storage Solution Flexibility

Windows enables both Fibre Channel and iSCSI solutions

Provides customer choice

Enables multi-tier storage solutions

Enables WAN solutions

iSCSI solutions are:Easy to deploy and manage

Leverage well known IP technologies

Lower support costs

Page 26: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

OEM

ODM

SI

IHV

ISV

Systems & Storage Components

Software

Networking

Services

Utility

High-end

Modular

NAS (high and low-end)

Virtualization

Storage Management

Backup, etc.

FC Storage

IP Storage

FCIP

Microsoft Storage Industry

Storage Partner Ecosystem

All o

thers

(inc

lud

ing

no

n-

storag

e partn

ers)

Major/Strategic Industry Players

Larger Ecosystem

PartnersPartners

Page 27: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Next Wave Storage Solution Initiatives Next Wave Storage Solution Initiatives

Small and medium businessesSimple SAN initiative aims to simplify SANs for the small and midsize market

Program qualification forSimple SAN solution components

Simple SAN complete solutions

Large/Enterprise marketWorking on storage security and better interoperability

Microsoft leadership Listening to customers, partners, industry

Making storage infrastructure a better fit with industry standards and partner needs

Leading on providing a programmatic framework for storage vendors to leverage their solutions on the Windows platform

Promotion of industry standards such as WS-Management for a more structured approach to storage management

Page 28: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Call to ActionCall to Action

Find out the details on integrating with VSSand VDS APIs and with MPIO DDK

Integrate with VDS1.1 beta

Get to know the requirements for different types of hardware to be compatible with the Windows Simple SAN program

Read the technical white papers related on the storage technologies

Page 29: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Community ResourcesCommunity Resources

Windows Hardware & Driver Central (WHDC)www.microsoft.com/whdc/default.mspx

Technical Communitieswww.microsoft.com/communities/products/default.mspx

Non-Microsoft Community Siteswww.microsoft.com/communities/related/default.mspx

Microsoft Public Newsgroupswww.microsoft.com/communities/newsgroups

Technical Chats and Webcastswww.microsoft.com/communities/chats/default.mspx

www.microsoft.com/webcasts

Microsoft Blogswww.microsoft.com/communities/blogs

Page 30: Emergence of Windows as the Leading Platform for Storage Claude Lorenson, Ph.D. Senior Product Manager Windows Server Division clor @ microsoft.com Microsoft.

Additional ResourcesAdditional Resources

simpsan @ microsoft.com for Simple SAN program question

Web Resources:Whitepapers: http://www.microsoft.com/windowsserversystem/storage/default.mspx

iSCSI download: http://www.microsoft.com/downloads/details.aspx?FamilyId=12CB3C1A-15D6-4585-B385-BEFD1319F825&displaylang=en

Related SessionsiSCSI Momentum, Deployments and Future

The Storage Platform: Defining Leadership

Simplifying SAN Deployments on Windows