Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced...
Transcript of Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced...
![Page 1: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/1.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Hyper-V Storage Performance and Scaling
Joe Dai, Liang Yang Microsoft
![Page 2: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/2.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Survey: Top Impediment To Increased Virtualization?
Storage 45 % Memory 35 % Network 27 % CPU 0 %
*Microsoft Internal Marketing Study
2
![Page 3: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/3.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Hyper-V Enables Multiple Storage Options At Flexible Price-Performance Points That Offer Continuously Availability & High Scalability
3
Agenda
![Page 4: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/4.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
New Hyper-V Storage Options
4
![Page 5: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/5.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
New Storage Options
5
External Storage Arrays
Remote File Servers
Storage Spaces
New in Windows Server 2012
![Page 6: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/6.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
External Storage Arrays
Virtual Fibre Channel Extends Fibre Channel Into VM’s High Performance Workloads Guest Clustering Exposes SAN Functionality
Utilizes NPIV Functionality Support
Host: Windows Server 2012 Updated NPIV HBA Driver
Guest: Windows Server 2008 or Newer
Live Migration Just Works
6
SAN
Hyper-V Host
VM VM
WWN
vHBA
WWN
vHBA
NPIV HBA
![Page 7: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/7.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Remote File Servers
Supports All Existing Scenarios
Enables New Scenarios Shared Nothing Live
Migration Cross-Cluster Live
Migration
Requires SMB 3.0
7
File Server
Hyper-V Host
VM VM
SMB Share
VHD VHDX
![Page 8: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/8.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Storage Spaces
Device Pooling Thin Provisioning Resiliency
Simple Space Mirror Space Parity Space
8
JBOD
Hyper-V Host
VM VM
Pool Space
VHDX
Space
VHD
![Page 9: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/9.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Clustered PCI RAID
Host Hardware RAID In A Cluster
Resiliency To Node Failure LUN Fails Over
Resiliency To Disk Failure RAID
9
Shared JBOD SAS
Clustered
Hyper-V Host
Hyper-V Host
Cluster Shared Volume
PCI RAID
PCI RAID
SAS
![Page 10: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/10.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Hyper-V Storage Stack Improvements
10
![Page 11: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/11.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
VHDX Offloaded Data Transfer Unmap IO Scaling
11
Storage Stack Improvements
![Page 12: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/12.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
New Virtual Hard Disk Format Latest Spec 1.0: Bing: VHDX Format Specification
12
VHDX
![Page 13: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/13.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
13
VHDX
Large Sector
Support
Enhanced Perf
Larger Block Sizes
Embed Custom
Metadata
User Defined
Metadata
Larger Virtual Disks
Enhanced Resiliency
![Page 14: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/14.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
32KB Random Writes
14
IOPS
![Page 15: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/15.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
1MB Sequential Writes
15
25% 25%
![Page 16: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/16.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Offloaded Data Transfer (ODX)
VMs Can Fully Leverage ODX Enabled Hardware
Reduce Maintenance Time Merge, Mirror, VHD/VHDX
Creation
16
SAN
Hyper-V Host
VM
LUN LUN
VHD Stack
Token Toke
n
![Page 17: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/17.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Unmap
Unmaps are passed from VM to Physical Layer
Increased Storage Efficiency in the Entire Storage Stack
Supported on: VHDX and PassThru Disks Virtual SCSI, FC, and IDE
17
SAN
Hyper-V Host
VM
Pool Space VHDX
![Page 18: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/18.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
IO Scaling
Liang Yang
18
![Page 19: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/19.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Hyper-V Bottlenecks in Windows Server 2008 R2
19
![Page 20: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/20.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Hyper-V I/O Scaling in Windows Server 2012
20
Virtual Storage Stack
VM Device
Device
![Page 21: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/21.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Hyper-V Multi-Channel Boosts VM Performance
21
VM performance scales nicely with increased number of VM VPs VM remains perfectly responsive even under most intensive workloads.
![Page 22: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/22.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Experimental Performance Data
22
Both synthetic and TPC-E results show significant improvement.
![Page 23: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/23.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Hyper-V Multi-Channel With Flexible Settings
23
Advanced users can fine tune up multi-channel settings in VM for optimal performance
Maximum number of channels per VM is tied up to the number of VPs to minimize the memory overhead(of small VMs) on host and other VMs.
VP count 1 2 4 8 16 32 48 64 Default channels
1 1 1 1 1 2 3 4
Maximum channels
1 1 1 2 4 8 12 16
Maximum memory per device
10MB 10MB 10MB 20MB 40MB 80MB 120MB 160MB
![Page 24: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/24.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
One Million IOPS Virtual Machine Demo
Host Configurations(total cost excluding server: ~$10,000) Server(1x): Dell R910 Intel Xeon E7-4850(Quad Westmere-EX 10 core with HT) 80 CPUs 256G RAM SSDs(40x): Intel 520 SATA 180GB 2.5” SATA III MLC HBAs(5x): LSI PCIe Gen. 2 Mustang 9205-8e Storage Enclosures(8x): StarTech 4 Bay 2.5” 6Gbps SAS/SATA Mobile Rack Backplane
VM Configurations: 64 vCPUs, 32G vRAM, Virtual SCSI Controller(1x), Passthru(40x)
24
![Page 25: Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum](https://reader031.fdocuments.in/reader031/viewer/2022011910/5f83ad2c46f3781ac135bdbd/html5/thumbnails/25.jpg)
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Thank You.
25