Build an Enterprise Storage Solution with Windows Server 2012 R2
description
Transcript of Build an Enterprise Storage Solution with Windows Server 2012 R2
| Basel
Build an Enterprise Storage Solution with Windows Server 2012 R2Walter PitrofSr. Technology Solution ProfessionalMicrosoft SwitzerlandEmail: [email protected]
Customers Discuss Storage•Lower the cost of storage
•Ease of File, Performance of Block
•No Downtime Servicing
•Help me secure my data
•Fully Leverage Storage Array Capabilities
•Native Access to SAN from VM with redundant IO (MPIO)
•Scalable Virtual Disks
•Storage Metering
File System
File system enhancements
• Rapid recovery from file system corruption without affecting availability
• Resilient against power outage corruption• Periodic checksum validation of file system
metadata• Improved data integrity protection• Ideal for file server volumes
NTFS improvements
• Rapid recovery from file system corruption without affecting availability
• Data corruption virtually eliminated through allocate-on-write
• Period checksum validation of file system meta-data• Seamless data integrity protection
Resilient File System (ReFS)
CHKDSK• Seconds to fix corrupted data• No offline time when used with CSV• Disk scanning process separated from repair
process• Online scanning with volume and offline repair
1 2 3050
100150200250300350400
Series1 Series2Source: “Microsoft Internal Testing"
http://blogs.msdn.com/b/b8/archive/2012/05/09/redesigning-chkdsk-and-the-new-ntfs-health-model.aspx
Storage Performance
Windows Server 2008 R2
Windows Server 2012
250,000 IOPs 1,000,000+ IOPs
Industry Leading IO Performance• VM storage performance on
par with native• Performance scales linearly
with increase in virtual processors
• Windows Server 2012 Hyper-V can virtualize over 99% of the world’s SQL Server.
Hyper-V: Over 1 Millions IOPs from a Single VM
VHDX
Features• Storage capacity up to 64 TBs• Corruption protection during power
failures• Optimal structure alignment for large-
sector disks
Benefits• Increases storage capacity• Protects data• Helps to ensure quality performance
on large-sector disks
New virtual hard disk format
VHDX
Large allocations and 1 MB aligned
Header region
Data region (large allocations and 1 MB aligned)
Metadata region (small allocations and unaligned)
Intent logBlock
Allocation Table (BAT)
Metadata table
User data blocks
Sector bitmap blocks
User metadata
File metadataHeader
VHDX Perf: 32KB Random Writes
Queue Depth 16
IOPS
10%10%
1 2 380000
90000
100000
110000
120000
130000
140000
150000
160000 Series1 Series2
Storage Spaces
New Approach to Storage
StorageSpaces
Cost-Effective Business Critical Storage
File Based
Storage
High Performance SMB Protocol for Hyper-V Storage over Ethernet networks
Strategic shifts to reducing storage costs with Windows Server 2012 Software-Defined Storage
• Virtualization of storage with Storage Pools and Storage Spaces
• Storage resilience and availability with commodity hardware
• Resiliency and data redundancy throughn-way mirroring (clustered or unclustered) or parity mode (unclustered)
• Utilization optimized through thin and trim provisioning and enclosure awareness
• Integration with other Windows Server 2012 R2 capabilities
• Serial Attached SCSI (SAS) and Serial AT Attachment (SATA) interconnects
Storage Spaces
WindowsVirtualizedStorage
Windows Application Server or File ServerPhysical or virtualized deployments
PhysicalStorage
(Shared) SAS or SATA
Integrated with otherWindows Server 2012 capabilities
Storage PoolStorage Pool
File Server Administration
ConsoleHyper-V
Cluster Shared Volume
Failover Clustering
SMB Multichannel
NFS Windows Storage Mgmt.
NTFS (3.0,4.1) SMB Direct
Storage Space Storage Space Storage Space
http://technet.microsoft.com/en-us/library/dn387076.aspx
Storage Space
Reduced Mean Time To Recovery (MTTR)
Mirror Spaces Rebuild Parallelized Recovery
Increased Throughput
Dual parity: Stores two copies of the parity information on a parity space,
which helps protect rom two simultaneous physical disk failures and optimizes storage efficiency.
Utilization of spare capacity: Hot Spare no longer necessary in R2
Automatically rebuild storage spaces from storage pool free space
Performance improvements to radically reduce MTTR
Rebuild Metric MeasurementData Rebuilt 2,400 GBTime Taken 49 minRebuild Throughput
> 800 MB/s3TB HDDs, 2-way, 4-column Mirror Space
Source: Internal Testing, No Foreground Activity
Data Deduplicati
on
Efficient storage through Data Deduplication
VHD Library
Software Deployment
ShareGeneral File
ShareUser Home Folder
(My Docs)0% 20% 40% 60% 80% 100%Average savings with Data Deduplication by workload
type
Maximize capacity by removing duplicate data• 2:1 with file shares, 20:1 with virtual
storage• Less data to back up, archive, and
migrateIncreased scale and performance• Low CPU and memory impact • Configurable compression schedule• Transparent to primary server
workloadImproved reliability and integrity• Redundant metadata and critical
data• Checksums and integrity checks• Increase availability through
redundancyFaster file download times with BranchCache
Source: “Microsoft Internal Testing"
Evaluating Deduplication
Storage tiering
Storage tieringImproved storage cost-performance with industry-standard hardwareUse solid-state drives (SSD) and hard-disk drives (HDD) in tiered storage spaceCan “pin” high priority files to the SSD tier
Hard Disk Drives (HDD)
Hot data
Cold data
Solid State Drives (SSD)
Storage Spaces
Storage tiering
Write-Back Caching
Write-Back Caching (WBC)Complements TieringTiering – Balances capacity & performanceWBC – Short-term absorption of I/O bursts
Seamless Integration & ManagementUtilizes available SSD capacity from poolWBC enabled by defaultConfigurable through PowerShell
Hyper-V Compute Nodes
Storage Space
HDD TierCold Data
SSD Tier & WBC
Hot Data
400GB EMLC SAS SSD
4TB 7200RPM SAS HDD
Reads/Writes Accumulates Data Activity
Seamless Integration
Storage Deployment Approaches
Storage Deployment Approaches
Balanced
• Mix of HDD & SSD
• High Capacity HDDs
• High Performance SSDs
• Best IOPS/$
How to build a deployment with:• 16 TB Capacity• 180,000 IOPS (4k,
random)
HDD Only Deployment• Meet Capacity with 6
HDDs• Miss IOPS by 179,100
SSD Only Deployment• Miss Capacity by 12.8
TB• Meet IOPS with 4 SSDs
Balanced Deployment:• Meet Capacity with 6
HDDs• Meet IOPS with 4 SSDs
Option Capacity IOPS Cost
SSD Only (20)
16 TB 1,000,000
$60,000
Mixed(6 + 4)
21.2 TB 200,900 $14,100
?3TB SAS HDDs, 150 IOPS, $350 MSRP
800GB SAS SSDs, 50,000 IOPS, $3,000 MSRP
DemoStorage SpacesStorage tieringDeduplication
Server Message Block
(SMB) 3.0
Top-to-bottom performance analysis and tuning
• SMB server optimization• New tracing instrumentation to identify
bottlenecks• Substantial refactoring of SBM2 client
as wellWindows Server 2012 at 98% of DAS transactional performance
• Identical servers and storage• 28 x 10KRPM HDD
SMB SMB + DAS0
500
1000
1500
2000
2500
3000
3500
4000
4500
1175 (27%)
4270 (98%) 4315 (100%)
SQL TPC-C transactions/second
SMB 3.0 Direct-attached storage (DAS) Equivalence
Network fault tolerance with SMB Multichannel
NetworkSMBclient
SMBserver
Filecopy
NIC NIC
NIC NIC
Filecopy
• Automatic detection and use of multiple network connections between SMB client and server
• Helps server applications be resilient to network failure
• Transparent Failover with recovery of network failure if another connection is unavailable
• Improved throughput• Bandwidth aggregation through NIC
Teaming• Multiple nodes/CPUs for network
processing with RSS-capable network adapters
• Automatic configuration with very little administrative overhead
DemoSMB Multichannel
File Client
SMB ClientSMBBuffe
r
File ServerApplication
NIC Driver
Transport Protocol Driver
With RDMA
Improved network performance through SMB Direct (RDMA*)
Without RDMA
Application
NIC Driver
SMB ServerSMB Client
Transport Protocol Driver
NIC Driver
TransportProtocol Driver
AppBuffe
r
SMBBuffe
r
OSBuffe
r
Driver
Buffer
SMBBuffe
r
OSBuffe
r
Driver
Buffer
SMB Server
NIC Driver
TransportProtocol Driver
AppBuffe
r
SMBBuffe
r
rNIC* rNIC* NIC AdapterBuffer NICAdapter
BufferAdapterBuffer
AdapterBuffer
iWARP
InfiniBand
• Higher performance through offloading of network I/O processing onto network adapter
• High throughput with low latency and ability to take advantage of high-speed networks (such as InfiniBand and iWARP)
• Remote storage at the speed of direct storage
• Transfer rate of around 50 Gbs on a single NIC port
• Compatible with SMB Multichannel for load balancing and failover *Remote Direct Memory Access *e.g. Intel® NetEffect™ Server Cluster Adapter Family
http://workinghardinit.wordpress.com/2013/06/14/verifying-smb-3-0-multichannelrdma-is-working-in-windows-server-2012-r2/
Hyper-V Live Migration over SMBSMB as a transport for Live Migration of VMs
Delivers the power of SMB to provide: RDMA (SMB Direct) Steaming over multiple NICs (SMB Multichannel)Provides highest bandwidth and lowest latency
Live migration can stream over multiple
networks for improved bandwidth
Live Migration can take advantage of
high speed networking
RDMA enables offloading CPU
resources to NIC during live migration
1 2 30
10
20
30
40
50
60
70
Live Migration Times
Seco
nds
SMB Direct Performance Enhancements(R2)
Scale-out File Server
SMB Direct
Hyper-V
VHD50% improvement for small IO workloads
Efficiency
Increased efficiency and density of hosting workloads with small I/O’s such as OLTP database in a VM Optimizes 40Gbps Ethernet and 56Gbps InfiniBand
Performance
50% improvement for small IO workloads with SMB over RDMAIncreased 8KB IOPs from ~300K IOPS to ~450K IOPS per interface
http://technet.microsoft.com/en-us/library/hh831474.aspx
SMB
Scale-out File Server
Hyper-V host
Optimized Rebalancing of Scale-out File Server Scale-Out File Server clients are now redirected to
the “best” node for access Avoids unnecessary redirection traffic Driven by ownership of Cluster Shared Volumes SMB connections managed per share
No longer per file server Dynamically moves as CSV volume ownership
changes Clustering is now also balancing CSV volumes automatically
Automatic behavior, no administrator action
File Server 2File Server 1Storage Spaces
\\SOFS\Share2
Share1 Share2 Share1 Share2
CSV and SMB shares automatically rebalanced
Improved network efficiency through
drastically reducing redirection traffic
DemoSMB 3.0 – File CopySMB 3.0 – IOPs
Windows File Server Cluster Solution PartnersCertified Storage Spaces HardwareHigh-Performance Servers and Storage
http://www.raidinc.com/ http://www.dataonstorage.com/http://www.fujitsu.com/fts/
http://www.quantaqct.com/
http://www.supermicro.com/
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a
commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.