James Crawshaw, Microsoft Shashank Pawar, Microsoft.

48
The Cloud OS…. …. for Databases James Crawshaw, Microsoft Shashank Pawar, Microsoft DBI323

Transcript of James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Page 1: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

The Cloud OS…. …. for

DatabasesJames Crawshaw, MicrosoftShashank Pawar, Microsoft

DBI323

Page 2: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Objectives

• SQL Server Private Cloud• Arm DBAs with infrastructure knowledge• Improve DBA productivity, so you can add

value to the business

Page 3: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

What we have heard?“We can’t virtualise database workloads”

“We would like to offer chargeback…but its too hard”

“We can’t have our crown jewels in the public cloud”

but….

“We would like to provide the business with an Azure like portal that enables them to create their own databases”

Page 4: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Demo:Deploy databases with Windows Azure Pack

Page 5: James Crawshaw, Microsoft Shashank Pawar, Microsoft.
Page 6: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

6

Consistent experiences across the Cloud OS

VIRTUAL MACHINES

SERVICE MGMT PORTAL & API

WEB SITES SERVICE BUS

Reliable Messaging

Standards Based

Cross Cloud

Fully self-service

Web Application PaaS

Highly Scalable

Dev-ops optimized

Integrated SCC

Fully self-service

IaaS - Elastic Tiers

Virtual Networks

Window and Linux

Gallery of apps

Fully self-service

Azure Consistent

Federated Identities

Active Directory

Standards Based

Device Friendly

ON-PREMISES

SERVICE PROVIDERMICROSOFT

CONSISTENTPLATFORM1

Page 7: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

R2 w/ Service Provider Foundation

Future Services

Service Bus

SQLVMsWebSites

Service Management API

ServicePlansUsers Provider

PortalConsumer

Self-ServicePortal

Web SitesAppsDatabaseVMs

Service ProviderCustomer

Self Service Portal Moves On-Premises

Common Mgt. Experience

Workload Portability

Cloud-Enabled Services Move On-

Premises

Consistent Dev.

Experience

Other Service

sCDN.

Media,, etc.

Caching

Service Bus

SQLVMRole

WebSites

WorkerRole

Service Management API

Web SitesAppsDatabaseVMs

Subscriber Self-

ServicePortal

Windows Azure

Cloud OS Consistent Experiences, delivered by Windows Azure Pack

Page 8: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Let the games begin….

Page 9: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Let’s Whiteboard the infrastructure

Configure and deploy:• Fibre Channel

SAN• Scale-out file

servers from bare metal

• Clustered Hyper-V hosts

Networking• IP address

management• Logical switches• Logical networks• Virtual networks

Delegated capacity for departments

VM

VM

VM

VM

VM

VM

AdditionalService Provider Capacity

VM

VM

Expanding your network / capacity to a service provider

Page 10: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Best Practices: Virtualizing SQL Server

Fabric configuration (compute, storage, network)Host resiliency (high availability & disaster recovery)Virtual machine configurationSQL Server configurationManagement & operation

http://download.microsoft.com/download/6/1/D/61DDE9B6-AB46-48CA-8380-D7714C9CB1AB/Best_Practices_for_Virtualizing_and_Managing_SQL_Server_2012.pdf

Page 11: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Fabric• Hardware• Use SLAT enabled hardware• Intel – VT• AMD - -V

• Storage• Storage Spaces (HBA) vs Array Controller vs SAN• Scale out File Server/SMB 3.0

• Network• Use 10GbE• Use multiple physical adapters per host• NIC Teaming (on the Host)

Page 12: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Demo:Firebreathing dragon

Scaleout file server

Page 13: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Host Resiliency and VM Agility• Clustering

• Cluster Aware Updating

• Storage• Optimize for Random IO• Dedicate disks to SQL• Compute

• Get hardware with offload technologies ie. RSS, DCB, RSC, RDMA

• VM Affinity / Availability sets

• Live Migration• Live Storage Migration• Shared-nothing Live Migration

• Hyper-V Replica• Replicate disk changes to a VHD between sites• A cheaper HA option

Page 14: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

VM Configuration• Operating System

• Configure templates to deploy Windows Server ‘Core’

• SQL Host and Guest CPU• Virtual NUMA

• SQL Memory• Dynamic Memory (manage this in WAP)

• SQL Storage• Virtual Disks

• VHDX -Fixed vs Dynamic sizing (not passthru)• Guest Storage

• SMB 3.0• Virtual Hard disk sharing (Server 2012 R2)

• SQL Network• DVMQ, vRSS• SR-IOV (virtual function on NIC)• QoS /DCB bandwidth management

Page 15: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

SQL Server HADR• HA with Guest Clustering• Use anti affinity to keep VMs on separate hosts

• HA DR with Always On

• SQL Cluster / Clustering • Not limited by virtualization on Hyper-V• all SQL and Hyper-V features available and supported.

• Hyper-V Replica• Async, 30 seconds, 5 & 15 minute sync options• Azure Recovery Services

Page 16: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Demo:System Center Virtual Machine MangerTemplates to help deploy SQL Server

Page 17: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Manageability - System Center• Virtual Machine Manager• Fabric Config• VM management• Dynamic Optimization

• App Controller

• Service manager

• Orchestrator

• Operations Manager – SQL MP

• Data Protection manager

Page 18: James Crawshaw, Microsoft Shashank Pawar, Microsoft.
Page 19: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

SQL Server 2014Private Cloud• Sysprep enhancement• Buffer pool extension• Online operations enhancements• IO Resource Governance

Hybrid Cloud• Deploy DB to Windows Azure VM• SQL Server with Windows Azure storage

integration• Backup to Azure• Cloud Backup -Agent

PrivateCLOUD

HybridCLOUD

Page 20: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Sysprep Enhancement• What’s being delivered

• Extensions to SQL Server Sysprep functionality to support image based deployment of clustered SQL Server instances

• Main benefits• Full automation of SQL Server Failover Cluster deployment scenarios (private and

public cloud)• Reduces deployment times for SQL Server Failover

Clusters• Built on top of SQL Server 2012 SP1 CU2 Sysprep

enhancements • Database Engine• Reporting Services• Analysis Services• Integration Services• Shared features

PrivateCLOUD

CTP2

Page 21: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Buffer Pool Extension• What’s being delivered• Usage of non-volatile drives (SSD) to extend buffer pool

• Main benefits• Improve query performance• No risk of data loss (using clean pages only)• Easy configuration

Example:ALTER SERVER CONFIGURATIONSET BUFFER POOL EXTENSION ON(FILENAME = 'F:\SSDCACHE\EXAMPLE.BPE‘, SIZE = 50 GB)

PrivateCLOUD

CTP1

Page 22: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Demo:SQL Server 2014 IO Resource Governor

Page 23: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Windows Azure Pack

Page 24: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

R2 w/ Service Provider Foundation

Future Services

Service Bus

SQLVMsWebSites

Service Management API

ServicePlansUsers Provider

PortalConsumer

Self-ServicePortal

Web SitesAppsDatabaseVMs

Service ProviderCustomer

Cloud OS Consistent Experiences, delivered by Windows Azure Pack

Page 25: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Service ConsumersConsume infrastructure and apps

from service providers as “off the shelf” solutions

Service ProvidersOffer and administer services

that are provided to customers

self-service administration

acquire capacity on demand

empowered operations

predictable costs

get up & running quickly

extreme focus on cost

maximize per-customer profit

hardware efficiency

automate everything

differentiate on SLAs

Page 26: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Cloud Offerings for Service Consumers

Web Sites Service BusVirtual

Machines Databases

Page 27: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

DemoAzure Pack admin…

Page 28: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Windows Azure-consistent IaaS- User Experience & API

Virtual Machine Roles- Portable- Elastic- Gallery- Windows and Linux Support

Virtual Networks- Site to Site connectivity- Tenant supplied IP addresses

Virtual Machines

Page 29: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

DemoWindows Azure Admin – Add SQL Server Instance

Page 30: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

• Windows Azure consistent PaaS

• User experience

• Provision databases on different plans

• Configure DBO login at time of database creation

• View connection string info

• Resize database

• Delete database

• Support for MySQL database…can add other providers

More will be added by Release time

Databases

Page 31: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

WAP Deployment ArchitectureWindows Azure PackPre-requisites

Windows Server 2012 or higherSQL 2012 SP1 or higherInternet Information Services (IIS).NET 3.5 and 4.0Web Platform Installer18th October………

http://technet.microsoft.com/en-us/library/dn296442.aspx

Service Management API

Management Portal

Service Provider Foundation SPF Web Server

Stamp2

SPF DB

VMM Server 2

VMs

Stamp1

VMM Server 1

Compute Storage Network Compute Storage Network

Service Admin Portal

TenantPortal

PublicEndpoint

TenantAPI

Service Admin API

Page 32: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Enabling Service Providers

AdministrationUsage &

ReportingAutomation

Page 33: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Usage and Reporting

Continuous usage metering per tenant subscription

Per-subscription Billing APIs

IaaS Data Warehouse

Server Inventory Reports

Page 34: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Wow, you totally ROCK!! You set up our Private Cloud

in just one day.

Page 35: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

The Cloud OS: three datacentersModern platform for the world’s apps

DEVELOPMENT MANAGEMENT IDENTITY VIRTUALIZATIONDATA

CUSTOMER

SERVICE PROVIDER

WINDOWS AZURE

1CONSISTENTPLATFORM

Transforms the datacenter

Unlocks insightson any data

Empowers people-centric IT

Enables modern apps

Page 36: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Appendix

Page 37: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Better TogetherSQL Server, Windows Server, System Center

Scaling

Performance

Availability

Storage

Management

Page 38: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Better scaling with Windows ServerTechnical Benefits

Increased virtual processor & memory Allows SQL Server VM to use up to 64 virtual processors & 1 TB of memory

Increased logical processor & memory Allows SQL Server to use up to 640 logical processors & 4 TB of memory

Increased cluster node scalability Supports SQL Server clusters up to 64 nodes

Increased VM density ›Up to 8,000 SQL Server VMs per cluster

›Support for up to 320 logical processors & 4 TB memory

Page 39: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Better performance with Windows ServerTechnical Benefits

Support for NUMA

BUS BUS

QoS – Network Bandwidth Enforcing

Windows NIC Teaming›

SQL Server

Network Card Network Card

Page 40: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Cluster-Aware Updating (CAU)

Windows Server Core

Dynamic Quorum

Better availability with Windows ServerTechnical Benefits

CLUSTER-AWARE UPDATING

Online OnlineUpdating …

Online

Online VHDX resize (Windows Server 2012 R2)

Page 41: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

SMB Support

ReFS Support (SQL Server 2014)

Remote File Share

Better storage with Windows ServerTechnical Benefits

Fiber Channel Support

Tiered Storage Spaces (Windows Server 2012 R2)

http://download.microsoft.com/download/8/0/F/80FCCBEF-BC4D-4B84-950B-07FBE31022B4/ESG-Lab-Validation-Windows-Server-Storage.pdf

HDD Tier

Cold Data

SSD Tier

Hot Data

400GB EMLC SAS SSD

4TB 7200RPM SAS HDD

Reads/Writes Accumulates Data Activity

Tiered Storage Space

SMB Support

Page 42: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Windows Server 2008 R2

Windows Server 2012

250,000 IOPS 1,000,000+ IOPS

Industry Leading IO Performance•VM storage performance on par with native

•Performance scales linearly with increase in virtual processors

•Windows Server 2012 Hyper-V can virtualize over 99% of the world’s SQL Server.

Proof: Over 1 Millions IOPS from a single Hyper-V VM

http://blogs.technet.com/b/schadinio/archive/2012/07/07/over-1-million-iops-from-a-single-vm.aspx

Page 43: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Better management with System Center Technical Benefits

Data Protection Manager

Operations Manager & Advisor• Proactive & reactive monitoring of

SQL Server instances• Early detection & problem resolution of SQL Server issues using

agent-based operations that perform continuous server scanning

Virtual Machine Manager & App Controller • Creation & management of private cloud based on SQL Server

VMs

• Deployment of SQL Server VM across private & public cloud environments

PublicCLOUD Off-Prem

PrivateCLOUD On-Prem

Windows Azure Pack (Windows Server 2012 R2, System Center 2012 R2)

Page 44: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Related content

Download SQL Server 2014 CTP - http://tinyurl.com/k24yuno

Datacenter Virtual Labs - Virtual labs experienceFind us Later At the Microsoft Showcase area

Try SQL Server 2014 on www.windowsazure.com

Learn more about Windows Azure Pack Preview and download the bits at http://aka.ms/azurepack

Page 45: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Track resourcesSQL Server 2012 Virtualising Best Practices - http://tinyurl.com/l2ccsk9 SQL Server Virtualisation Performance ESG Lab Report - http://tinyurl.com/ku3lborComparing Windows Server Hyper-V and VMware vSphereMigrating from VMware: Tools and TipsOverview: Introduction to System Center 2012 R2Microsoft Virtual Academy (online training)Microsoft Assessment and Planning Toolkit (assess environments for azure migration etc)

Page 46: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Developer Network

Resources for Developers

http://msdn.microsoft.com/en-au/

Learning

Virtual Academy

http://www.microsoftvirtualacademy.com/

TechNet

Resources

Sessions on Demand

http://channel9.msdn.com/Events/TechEd/Australia/2013

Resources for IT Professionals

http://technet.microsoft.com/en-au/

Page 47: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

Track Resources • Download the CTP for SQL Server 2014 and accelerate your queries

using In-Memory OLTP - http://technet.microsoft.com/en-us/evalcenter/dn205290.aspx

• Get into the cloud with an Azure account - use SQL database in Windows Azure or take your workload into Azure VM - www.windowsazure.com

• Get big with big data – HDInsight on Azure and grab the latest Power BI featureshttp://www.windowsazure.com/en-us/documentation/services/hdinsight/?fb=en-us

Power BI - www.powerbi.com

Page 48: James Crawshaw, Microsoft Shashank Pawar, Microsoft.

© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.