Cloud Computing: SQL Data Services

Christophe Codourey Consultant BI

Urs MeierPrincipal Consultant

Technology competence Oracle, Microsoft, IBM, Open Source

BusinessIntelligence

Business

Communication

Appl

icatio

n

Develo

pmen

tManagedServices

Existing IT customer

infrastructure

Training

Trivadis Facts & FiguresCurrently 13 locations with over 540 employees

Baden, Basel, Bern, Brugg, Lausanne, Zurich Düsseldorf, Frankfurt, Freiburg, Hamburg, Munich, Stuttgart Vienna

Since January 2008, the Trivadis Group has a qualified majority of shares in MIK AG, based in Brugg

Financially independent and sustainably profitable

Key figures in 2008Consolidated incomeCHF 108 million / EUR 68 millionServices for more than 650 clients in over 1‘600 projectsOver 150 Service Level AgreementsMore than 5'000 training participants per year Research budget: CHF 6.0 million / EUR 3.6 million

Agenda

Azure OverviewSQL Data Services (SDS)SQL Server ↔ SDS CompatibilitySDS Client Applications

Visual Studio & .NET

Microsoft Cloud Services

Azure™ Services Platform

ComputeStorage

Management

• Designed to be: “File System in the cloud” • lowest cost efficient solution for simple

data storage and retrieval in the cloud • can store

• Queues• Blobs• ISAM style, simple Tables

(non-relational)

Microsoft Cloud Services

Azure™ Services Platform

ComputeStorage

Management

Database Data Sync Reference Data

ETL Data Mining Reporting

SDS for the past year

Storage

SQL, Tablesand Rows

T/SQL via TDS

Authority, Container,

Entity

SOAP/REST

Simple Tables, Blobs,

Queues

SOAP/RESTMassive

ArchitecuralChange Key-Value DB

• Existing KnowHow and Applications

• New Web 2.0 and Silverlight Applications• Other Vendors like Amazon

The New SQL Data Services

Familiar SQL Server relational modelUses existing APIs & toolsBuilt for the Cloud with availability and scaleAccessible to all from PHP, Ruby, and Java

Clear Feedback: “I want a database in the Cloud”

Your Apps

Tabular Data Stream(TDS)

SQL Data ServicesTDS Endpoint

ADO.NET

Entity Framework

SQL Server Drivers

Authority, Container,

Entity

SOAP/REST

From CTP 1 to now

Storage

SQL, Tablesand Rows

SQL, Tablesand Rows

Simple Tables, Blobs,

Queues

SOAP/REST

• Existing KnowHow and Applications

• New Web 2.0 and Silverlight Applications• Other Vendors like Amazon

SOAP/REST

Data Services

T/SQL via TDS T/SQL via TDS

Database Choices

Low-cost and zero friction addresses web/dept workloads

Target is 3 to 10 GB DatabasesHigh compatibility with existing SQL Server offering

Reso

urce

s

Dedicated

Shared

Low High“Friction”/Control

SDS (RDBMS)

Value Props:Auto HA, Fault-ToleranceFriction-free scaleSelf-provisioningHigh compatibility

Virtual DB server Logical user database

(LDB) Resource governance @

LDB Security @ LDB

Value Props:XSPs, Server OpsSQL CLR100% compatibility

Roll-your-own HA/DR/scale

Hosted Hosted SQL Server or

other Resource governance @

VM Security @ DB Server/OS

On-premise SQL Server or other s/w on-

premise Resource governance @ machine Security @ DB Server/OS

Value Props:Full h/w control –

size/scale100% compatibilityRoll-your-own

HA/DR/scale

Database

Server

Service Provisioning ModelEach account has

a billing relationship with Microsoftowns one or more virtual servers

Each server has one or more databases including virtual mastereach database limited in size one or more logins

Each database has one or more SQL users

Account

Server

Database Server=server1.data.database.windows.netDatabase=testDBLogin=JeanDupont[@server1] (maps to

testuser)

SQL Server vs. SQL Data Services • Master

• AdventureWorks• Northwind• Pubs

• Master

• Pubs• Northwind

• Adventureworks

SQL Server(on premises)

• Master• AdventureWorks• Northwind• Pubs

SQL Data Services

Instances and DatabasesOne SQL Server instance per physical machineMultiple databases per instance

Randomly distributed by infrastructureRessource sharing

Scalable HA technologyAutomatic replication and failover

Provisioning, metering and billing infrastructure

Machine 5SQL Instance

SQL DBsDB5 DB1 DB3 DB2

Provisioning (databases, accounts, roles…), Metering, and Billing

Machine 6SQL Instance

SQL DBsDB1 DB6 DB2 DB3

Machine 4SQL Instance

SQL DBsDB3 DB4

Machine 7SQL Instance

SQL DBDB4 DB5

Scalability and Availability: Fabric, Failover, Replication, and Load Balancing

Reading DataSelect * from Customer

Primary(for Customer)

New Primary(for Customer)

Writing DataUpdate CustomerSet Priority = 1

Primary(for Customer)

TDS GatewayFront-end Node

Protocol Parser

Gateway Logic

TDSSession

1

Front-end NodeProtocol Parser

Gateway LogicTDS

Session 2

Architecture

Master ClusterMaster Node

Data Node Components

Partition Manager

Master Node

Data Node Components

Partition Manager

1

2

4

5

6

7

8

Utility LayerAccount

DatabaseBilling/Usage

Database

Service PlatformMonitori

ngLoad

BalancingNode

Provisioning

Roles

3

Machine 5SQL Instance

SQL DBDB5 DB1 DB3 DB2

Scalability and Availability: Fabric, Failover, Replication, and Load balancing

Machine 6SQL Instance

SQL DBDB1 DB6 DB2 DB3

Machine 4SQL Instance

SQL DBDB3 DB4

Machine 7SQL Instance

SQL DBDB4 DB5

Scalability and Availability: Fabric, Failover, Replication, and Load balancing

Authority, Container,

Entity

SOAP/REST

SDS from now on

Storage

SQL, Tablesand Rows

SQL, Tablesand Rows

Simple Tables, Blobs,

Queues

SOAP/REST

• Existing KnowHow and Applications

• New Web 2.0 and Silverlight Applications• Other Vendors like Amazon

T/SQL via TDS T/SQL via TDSidentical?

Example of SQL CompatibilityIn Scope for v1 (likely)

Tables, indexes and viewsStored ProceduresTriggersConstraintsTable variables, session temp tables (#t)…

Out of Scope for v1 (likely)

Distributed Trans/QueryCLRService BrokerSpatialPhysical server or catalog DDL and viewsGlobal tables(##t)?Traditional Backup / Restore

Management ToolsAPI for provisioning

WebSQL Server Management Studio (SSMS)

Basically available, but will have obviously some restrictions

e.g. no sp_configure Standard Query Tools

Security ModelUses regular SQL security model

Authenticate logins, map to users and rolesAuthorize users and roles to SQL objects

Limited to standard SQL Auth loginsUsername + password

EncryptionTDS supports SSLNo database encryption at all in V1

TDE Encryption Functions

How Scalable is SDS?Scalability comes at cost of consistency

ACID (Atomicity, Consistency, Isolation, Durability)Write n nodes on Commit, read from max. n nodes

BASE (Basically available, soft state, eventually consistent)

Write n nodes on Commit synchronize more nodes laterRead on more than n nodes

SDS V1 Implements (a very) ACID model

Write 3 nodesRead 1 node

ScalabilityScale Performance

Leader electionSDS fabric can switch the primary node for a database to a less busy node

SDS may throttle your session if it takes too much resourcesBYOP (bring your own partitioning)

Scale Size of DatabaseCurrent offering is targeted at departmental databasesBYOP (bring your own partitioning)

SDS Client ApplicationsClients connect directly to a database

Cannot hop across DBsAny database client library for SQL Server can be also used for SDS

ODBC, OLE DB, ADO.NET Provider for SQL Server

ADO.NET Entity FrameworkADO.NET Data Services (Astoria)

LINQ to SQL PHP native SQL Client…

Cloud

SDS Client Apps

SDS DatabaseTDS + TSQL Model

Windows Azure ComputeREST

(Astoria)ADO.Net* +

EF

Browser

HTT

P

Application

SQL Client*TD

S

* Client access enabled using TDS for ODBC, ADO.Net, OLEDB, PHP-SQL, Ruby, …

Data

Cen

ter Web Srv

SQL Client*

HTT

P+RE

ST

Application

REST Client*

Web AppSQL Client*

HTT

P+SO

AP

Application

SOAP Client*

Tabular Data Stream (TDS)“Code far” scenario

TDS is not designed for high latency networks

Recommendation Batch SQL statements Use Functions/Stored Procedures

Table valuein parametersare very handy

Microsoft Cloud Services

Azure™ Services Platform

ComputeStorage

Management

Database Data Sync Reference Data

ETL Data Mining Reporting

Extending SQL Data Platform to Cloud

SQL Data Services (SDS)Database-as-a-Service

Data SyncReference Data

Reporting

Business Intelligenc

e

Symmetric Programming Model Data Hub Aggregation

Initial services – core RDBMS capabilities as a service (SDS), Data Sync and Data HubFuture Offerings

Additional data platform capabilities as a service: BI/DSS, DWNew services: Reference Data, Secure Data Hub

Data Hub / Sync Services

On Premises Assets and Data

Mobile Users

SQL Services (Opportunities and Futures)

ScalabilityPartitioned databasesGeo-location and geo-redundancy

FlexibilityDistributed querySupport for multiple levels of hardware and software isolation

SecurityFuture AD FederationWLID, etc as alternate authentication protocolsEncryption

Release Plan

Invitation CTP – On-board invitation-only customers + some current

Public CTP – On-board all early adoptersCommercial Availability with Windows Azure in 2009

MIX ‘09

TechEd

InvitationCTP

Public CTP

Commercial Availability

Migration

Mar 09

May 09 Jul 09 Nov 09

Sep 09

Apr 09

Jun 09 Aug 09

Oct 09

PDC

InternalAdoption

Quick Wins with SDSHigh Availability

Including Data Hub ScenarioFast and easy Deployment

Ideally “Code near” scenario with Web apps

Well known programming modelLow learning curve

ReliabilityConfidence that data will not be lostReplication, back-up

Defined SLA, at which Cost (?)

Want to Know More?Team Blog

http://blogs.msdn.com/ssds

MSDN Development Centerhttp://msdn.microsoft.com/en-us/sqlserver/dataservices

Register @ the Azure start portalhttp://www.azure.com

Visitez notre stand et

participez au concours

Prix

Save the date for tech·days next year!14 – 15 avril 2010, CICG

Classic Sponsoring Partners

Premium Sponsoring Partners