David Shutt Software Architect Microsoft Corporation.

Case Study: One Code Base On Premises and On LineMicrosoft Dynamics CRM

David ShuttSoftware ArchitectMicrosoft Corporation

VisionAnalyze and Plan TechnologyTeam Process and OrganizationMeasure

Case Study: One Code BaseCase Study of Bridging On Premises & Online

• Write once• Deploy anywhere

• Non goal: On Premises Quirks

Vision: The Power of Choice

On Premises

CRM Online(Microsoft

Hosted)

Partner Hosted

Analyze and Plan

Iterate Existing Code Base

New Code Base SeparateOn Premises & On Line Code

Prior Release Compatibility

Good Initial effort Initial + Ongoing Effort

Symmetry for Choice

Good Good Ongoing Effort

Engineering Maximize existing investment

Leave Legacy behind

Parallel code bases

Recommendation Preferred when architecture and quality allows

When legacy code isn’t easily adapted

Online specific infrastructure (e.g. Billing, Customer Support, Operational)

Analyze Security: Surface AreaPrior Release

SQL

Web UI

Web Client

Outlook Client

Excel

BizLogic

WebSvcAPI

SQL ReportingServices

Plan: Security: Surface AreaStrategy: wrap non hardened components

SQL

Web UI

Web Client

Outlook Client

Excel

Biz Logic

WebSvcAPI

SQLReportingServices

Analyze ScalePrior Release: Single Tenant

Application ServerTenant 1




Application ServerTenant N

…

Analyze ScalePrior Release: Single Tenant with Virtualization

Application ServerTenants 1-10




Application ServerTenants xx-yy

…

Plan ScaleNew Release: Multi Tenant





Application ServerTenants xxx-yyy

…

Analyze Provisioning & AvailabilityPrior Release: State in Multiple Places

Tenant Data

Tenant UI

Tenant code

Tenant Semantic Meta

Data

Tenant Registry

Application Server

Tenant UI

Tenant Code

Tenant Registry

…Application Server N

Plan Provisioning and AvailabilityCentralize State to enable Server Farms

Tenant Data & Meta Data (UI, code, entity def)

SQL

Application ServerCached State only

…Application Server NCached State only

Analyze Scale: Single Tenant MemoryPrior Release

CRM V3 Application Server

Native Semantic MetaData (1)

Managed Semantic MetaData (2) UI MetaData

CRM V3 Workflow Server

Native Semantic MetaData (3)

Plan Scale: Multi Tenant Memory

CRM V4 Application Server

‘Core’ MetaData Delta#1

Delta#2

DeltaN

Complex Test Matrix Deployment models – On Premises, Online,

Partner Hosted Authentication – AD, Basic, Windows LiveID Versions of External Dependencies

Server: OS, IIS, .NET CLR, Exchange, SQL Server Client: OS, Browser, Office/Outlook

Unify Development and Test Infrastructure Automate Deployment and Testing Centralize and Dedicate Resources

Process: Agility in TestingChallenge and Best Practices

Process: Extending the Delivery Team

Product Dev Support

On Premises Customer

Online Customer

Sustaining Engineerin

g

Business Operations

Data Center

Operations

Online ServicingProduct

Operations

Hosting Partner

Customer Satisfaction includes operations, sustaining engineering, & support teams

Customer support responsibilities differ across channels

On Premises

Partner

Measure: ScaleSingle and Multi Tenant

Description Server Spec Tenants per App server

Connections Bottleneck

V3 single Tenant 6 App: 8G, 1x1SQL: 128G, 16x2

1 6,000 SQL


1 24,000 SQL

Description Server Spec Tenants per App server

Connections Bottleneck


1 2,000 SQL

V4 multi Tenant theoretical

2 App: 16G, 2x4SQL: 32G, 2x4

400 x 5 2,000 SQL

V4 multi Tenant 2 App: 16G, 2x4SQL: 32G, 2x4

200 x5 App

Alpha @ scale: sudden transition from healthy to cached configuration expired

Q1: Why did configuration polling fail? A1: Polling thread CPU starved Q2: Why was CPU usage high? A2: .NET Garbage Collector Q3: Why was Garbage Collector so busy? A3: Finalization Queue very long Q4: What objects are in the queue?

Measure: Scale Cascading Failures

Measure: ScaleFunctional correctness does not guarantee scale public void BadScale()

{ // Get thread's windows identity. WindowsIdentity identity =

WindowsIdentity.GetCurrent(true); if(null != identity) { // Do Work with identity return; } else { // Invalid user -- throw

exception... } }

Measure: ScaleCoding Example for Scalability

public void GoodScale() { WindowsIdentity identity; try { identity =

WindowsIdentity.GetCurrent(true);

// Do work with the identity object.

} finally { identity.Dispose(); } }

Measure: ScaleEarly results with improved code

Multi tenant memory at scale, after applying fix to CRM code itself [other code still to do]

Counter Prior New Improvement

Gen0 Heap(short lived)

340MB 180MB 47%

Gen2 heap (Long Lived)

3.39GB 1.8GB 46%

Large Object Heap

3.83GB 2.76GB 28%

Total Bytes in all heaps

7.25GB 4.66GB 35%

Online Service provides instant feedback Noticed during Beta, fixed prior to Release

Measure: Disk SpaceLesson: Local vs Global Optimization

Observation Cause Mitigation

Many rows in queue Aggressive Scheduling Less frequent by default; Scheduled Purge jobs

Save intermediate state for debugging

Less frequent; save only when tracing enabled

Large rows in queue Save state for debugging Configurable; save only when tracing enabled

Save state past useful life

Update to shorten; purge

Format inefficient Revise format

Technology Build for Online, On Premises as simple case Be flexible to keep or replace components Iterate, limit initial scope Adopt existing Online-ready technology

Process Plan and Scope before you start Analyze ROI for work required Evangelize Architecture and Best Practices

within team Agility - Organizational and Process

One Code Base: Lessons

Azure Services Platform

Microsoft Dynamics CRM Online

Microsoft SharePoint Services

Microsoft Dynamics CRM & the Azure Services Platform

Microsoft Dynamics CRM Online http://crm.dynamics.com

Microsoft Dynamics CRM V4 Performance Whitepapers http://www.microsoft.com/downloads/details.

aspx?FamilyId=5852B14A-394C-4898-8374-CAF5E6479EB0&displaylang=en

PDC BB32: Rapid Business Application Development with Dynamics CRM

PDC BB08: Microsoft Dynamics CRM: Appealing Business Applications

One Code BaseLinks

http://crm.dynamics.com/

http://www.microsoft.com/downloads/details.aspx?FamilyId=5852B14A-394C-4898-8374-CAF5E6479EB0&displaylang=en



Evals & Recordings

Please fill

out your

evaluation for

this session at:

This session will be available as a recording at:

www.microsoftpdc.com

Please use the microphones provided

Q&A

© 2008 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market

conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

David Shutt Software Architect Microsoft Corporation.

Documents

Transcript of David Shutt Software Architect Microsoft Corporation.