Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any...

53

Transcript of Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any...

Page 1: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.
Page 2: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Stretching Failover Clusters and Using Storage Replica for Disaster Recovery in Windows Server vNext

Ned PyleSr. PM, Microsoft Corporation

CDP-B352

Page 3: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Me me me meeeeeFile Server and Cluster TeamI get around8 years in MS support8 years IT shops and consulting US Marine Infantry

The “Storage Replication PM”DFSR, FRS (really!), and now… something new

AskDS and FileCab [email protected]

Page 4: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

What is a disaster?

Page 5: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Sometimes you need more than a rack

Page 6: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Storage Replica is here

Page 7: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Storage Replica

ReplicationBlock-level, volume-basedSynchronous & Asynchronous SMB3 transport

FlexibilityAny Windows volumeAny fixed disk storageAny storage fabric

ManagementFailover Cluster ManagerWindows PowerShellWMIEnd to end MS Storage Stack

Page 8: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Demo

Proof that this is not vapor

Page 9: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Technical Preview Scenarios

NODE1 in HVCLUS

SR over SMB3

NODE3 in HVCLUS

Stretch Cluster

NODE2 in HVCLUS NODE4 in HVCLUS

Man

hatt

an D

C

Jers

ey C

ity D

C

SRV1

SR over SMB3

SRV2

Server to Server

Man

hatt

an D

C

Jers

ey C

ity D

C

Page 10: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

What is block replication?

Page 11: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Blocks, not filesThis is not DFSRReplicating storage blocks underneath the NTFS or ReFS volumeDon’t care if files are in useWrite IOs are all that matter to Storage Replica

Page 12: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Driver layeringMonaco Site

Source SR ServerNice Site

Destination SR Server

SMB Server

File System Filters

NTFS/ REFS

VolSnap Filter

BitLocker Filter

Volume Manager

Partition Manager

Disk Driver

Disk

Partition Manager

Disk Driver

Disk

SR SR

Page 13: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Synchronous workflow

Applications(local or remote)

Source ServerNode (SR)

DataLog

1

t 2

Destination ServerNode (SR)

DataLog

t1 3

2

5

4

Page 14: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Asynchronous workflow

Applications(local or remote)

Source ServerNode (SR)

DataLog

1

t 2

Destination ServerNode (SR)

DataLog

t1 5

4

3

6

Page 15: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Requirements & Recommendations

Page 16: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

RequirementsActive Directory (for SMB)No need for Schema updates, AD objects, certain AD functional levels, etc. Uses Kerberos, not NTLM or certificates

≥1 Gbps network between serversDisks GPT, not MBR Yes: JBOD, iSCSI, Local (non-cluster) SCSI or SATA, or SANNo: USB external arrays, thumb drives, tapes, 5.25” floppy disks, etc.Same disk geometry (see guide)Free space for logs on a Windows NTFS/ReFS volumeNo %systemroot% or page file

Firewall ports SMB, WS-MAN

Most “setup isn’t working” emails I get

are from not understanding these

requirementsEspecially MBR, from using Gen1

VMs!

JBOD: “Just a Bunch of Disks.” In Microsoftland, usually a serially-attached SCSI enclosure using

Storage Spaces

Page 17: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Recommendations for SynchronousNetwork latency≤5ms round trip averageAssuming the light speed vacuum ideal, 5ms is ~1500km round trip But reality steps in: optical fiber reduces by 35%, you cross switches, routers, firewalls, etc. – likely ≥2X latent at that rangeDark fiber and 10GBASE have logistical and financial limitsEnd result: most customers end up 30-50km (or stay within the campus)

Disk latencyPerfmon (logical disk) and DISKSPDUse micro benchmarks before and after SR – not in Technical Preview, though!

Log sizing and backingSSD (if you want it to really work!)Larger logs allow faster recovery from larger outages, but cost spaceThese are very strong

recommendations ;)

Page 18: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Recommendations for AsynchronousNetwork latencyDoesn’t matter

Disk latencySame as previous slide

Log sizing and backingSame as previous slide

Page 19: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

PhilosophyAsync crash consistency versus application consistencyWe guarantee a mountable volumeYour app guarantees a usable file

SnapshotsWhoops, this is broken in Technical Preview

Accept that async means possible data lossWe have no RPO dial in Technical Preview

How much money is your data worth?

Page 20: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Good ideas for anyoneDrivers drivers drivers!Filters filters filters!Learn your performance envelopes

Page 21: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

What are the options?

Hyper-V Replica

Yes NA Yes (VMs hosting file servers)

No Yes (VMs hosting SQL)

Yes (VMs hosting apps & servers)

VM SYSVOL File Server MS Exchange SQL Server Other Applications

Storage Replica

Yes No Yes (bare metal or VMs)

No Yes (VMs hosting SQL)

Yes (VMs hosting apps & servers)

SQL Server AlwaysOn FCIs

NA NA NA NA Yes NA

MS Exchange DAG

NA NA NA Yes NA NA

DFS Replication

No Yes Yes No No No

FRS Never Upgrade to DFSR, soon

Don’t do it Are you crazy? What? No! Hahaha, you are funny

SQL Server AlwaysOn AG

NA NA NA NA Yes NA

Your “other application” vendors must state support – we cannot.

Page 22: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

What Storage Replica is notStorage Replica is not “shared nothing” clusteringStorage Replica is not a backupWe will happily replicate the deletion of all data!

Storage Replica is not DFSRNot file-levelNot multi-masterNot multi-endpointNot low-bandwidth

Storage Replica is therefore not a general branch office solution

We mean it!

Page 23: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

While we’re on the subject of offices and users…

Page 24: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Marketing view

Page 25: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Your view

Page 26: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

TopologyStretch ClusterServer-to-serverNo 1-manyNo a-b-cNo a-b-c-d

Cluster-to-cluster is comingBut not possible in Technical Preview

Fun fact: You can also create server-to-selfYou are on your own, pal

Page 27: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Stretch Clusters

Page 28: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Stretch ClustersSynchronous onlyAsymmetric storageTwo sites, two sets of shared storageCluster storage: CSV or role-assigned

Manage with FCMOr Windows PowerShell

Increase cluster DR capabilities Hyper-V and General Use File Server are the main use cases in the Technical PreviewNot Scale Out File Server

SR-SRV01

SAN/JBOD/iSCSI

Redm

ond

Site

SR-SRV02 SR-SRV03

SAN/JBOD/iSCSI

Belle

vue

Site

SR-SRV04Cluster

Asymmetric

shared storage

Internode network

connectivity

Page 29: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Familiar Failover Cluster Manager GUI

Page 30: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Configure and manage1. Add a source data disk to a role or CSV2. Enable replication on that source data

disk3. Select a source log4. Select a destination data disk5. Select a destination log6. Done. Really!

We’ve already changed this to 2,4,3,5 and altered nearly every word.

Page 31: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Demo

Failover Cluster Manager Provisioning and Failover

Page 32: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Server to Server

Page 33: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Server to ServerSynchronous or asynchronousAny type of fixed disk storage (see previous rules)Configure and manage with Windows PowerShellDesigned explicitly to increase the DR capabilities of a serverCluster to cluster is coming

File Server is the main use cases in the Technical Preview

Ideally, no one ever uses this. Cluster to cluster is far more resilient.

Page 34: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Windows PowerShellModule: WVRGet-SRGroupGet-SRPartnershipNew-SRGroupNew-SRPartnership (Create)Remove-SRGroupRemove-SRPartnershipSet-SRGroupSet-SRPartnership (change direction)Suspend-SRGroupSync-SRGroup

Page 35: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Demo

Server to Server provisioning

Page 36: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

A deeper look

Page 37: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Non-clustered Architecture

SR CIM Provider (WvrCimProv.dll in WMIv2 instance)

SMB 3

NTFS/REFS CLFS Log

SR Service (WvrSvc.exe)

SR Filter Driver (wvrf.sys)

Registry SMB 3

Page 38: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Clustered Architecture

SR Service (WvrSvc.exe)

SMB 3

NTFS/REFS CLFS Log

SR CIM Provider (WvrCimProv.dll in WMIv2 instance)

SR Filter Driver (wvrf.sys) SMB 3

Windows Failover Cluster Service

SR Cluster Resource (wvrres.dll)

Page 39: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

SMB 3.1 transportUsing the scalability and perf built into SMBSMB MultichannelSMB Direct (RDMA)Encryption and signing

Page 40: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Replication metadataHidden disk partitionHidden logsAlways write through to disk

Registry (“real” and cluster hive)HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\WVRHKEY_LOCAL_MACHINE\Cluster\WVR

Page 41: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

SupportabilityPerformance CountersDozens of useful countersMade many improvements since Technical Preview

Event LogsHundreds of clear, guided, low-noise eventsMade many improvements since Technical Preview

WPP Tracing Booo! Requires calling MS.If we do our events right, you will never need it

Page 42: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Known issues with Technical PreviewRemoval of replicationPowerShell remotingPerformanceFinicky FCM The ^%# name

Y

AX B

The Step-By-Step guide covers all of this!

Page 43: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

The big finish

Page 44: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

ComingMicrosoft Azure Site Recovery orchestrationCluster-to-clusterPerformanceEase of managementMigrationInventory

As always: believe it when you see it

Page 45: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Get the guide!Technical Preview Step-by-Step Guide: Storage Replicahttp://go.microsoft.com/fwlink/?LinkID=514902

Or search: filecab blog storage replica

Page 46: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Storage Sessions in chronological order

CDP-B323: Delivering Predictable Storage Performance with Storage Quality of Service in Windows Server vNext (Wednesday Oct 29 8:30 AM)

CDP-B339: Leveraging SAN Replication for Enterprise-Grade Disaster Recovery with Microsoft Azure Site Recovery and System Center 2012 R2 (Wednesday Oct 29 3.15 PM)

CDP-B349: Storage Management in a Hybrid Cloud Environment with Windows Server and System Center (Thursday Oct 30 3.15 PM)

CDP-B325: Designing Scale-Out File Server with DAS Storage in Windows (Friday Oct 31 8.30 am)

Related content

Find me at the Storage booth!

Page 48: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Come visit us in the Microsoft Solutions Experience (MSE)!Look for the Cloud and Datacenter Platform area TechExpo Hall 7

For more informationWindows Server Technical Previewhttp://technet.microsoft.com/library/dn765472.aspx

Windows Server

Microsoft Azure

Microsoft Azurehttp://azure.microsoft.com/en-us/

System Center

System Center Technical Previewhttp://technet.microsoft.com/en-us/library/hh546785.aspx

Azure Pack Azure Packhttp://www.microsoft.com/en-us/server-cloud/products/windows-azure-pack

Page 49: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Azure

Implementing Microsoft Azure Infrastructure Solutions

Classroomtraining

Exams

+

(Coming soon)Microsoft Azure Fundamentals

Developing Microsoft Azure Solutions

MOC

10979

Implementing Microsoft Azure Infrastructure Solutions

Onlinetraining

(Coming soon)Architecting Microsoft Azure Solutions

(Coming soon)Architecting Microsoft Azure Solutions

Developing Microsoft Azure Solutions

(Coming soon)Microsoft Azure Fundamentals

http://bit.ly/Azure-Cert

http://bit.ly/Azure-MVA

http://bit.ly/Azure-Train

Get certified for 1/2 the price at TechEd Europe 2014!http://bit.ly/TechEd-CertDeal

2 5 5MOC

20532

MOC

20533

EXAM

532EXAM

533EXAM

534

MVA MVA

Page 50: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Please Complete An Evaluation FormYour input is important!TechEd Schedule Builder CommNet station or PC

TechEd Mobile appPhone or Tablet

QR code

Page 51: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Evaluate this session

Page 52: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

Resources

Learning

Microsoft Certification & Training Resources

www.microsoft.com/learning

Developer Network

http://developer.microsoft.com

TechNet

Resources for IT Professionals

http://microsoft.com/technet

Sessions on Demand

http://channel9.msdn.com/Events/TechEd

Page 53: Replication Block-level, volume-based Synchronous & Asynchronous SMB3 transport Flexibility Any Windows volume Any fixed disk storage Any storage.

© 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.