Leveraging The Clouds For Reliable Web Applications Presentation

© 2007 RightScale Inc. All rights reserved. RightScale Company Confidential1

Thorsten von EickenCTO RightScale


Fully automated on-demand provisioning of compute resources

1. Inf inite comput ing resources2. Available on-demand3. Pay per use4. Delivered across the Internet


Compute infrast ructure is undif ferent iated heavy lif t ing

Demand is hard to predict

Peak usage much higher than average


Applicat ions in the Cloud

Plat forms in the Cloud

Infrast ructure in the Cloud


Examples: SaaSofferingsSalesforce.comGoogle appsEbay

hardware

platform

applicationdata

User Cloud

CRM appOffice appsCommunication apps


Examples:Google App EngineForce.comRackspace Mosso

hardware

platform

application

data

User Cloud

RailsPythonJava.Net


Examples:Amazon Web ServicesFlexiscaleGoGridand many more to come

hardware

platform

application

data

User Cloud

ServersStorageNetworkLoad balancing


Infrast ructure cloudsj ust providebuilding blocks!

RightScale: automate server deploymentfrom server ready to server in product ion


Up-front costs

Peak vs. average

Dev & Test

Gridtime

hardwareload

time

peak loadaverage load

load

mon tue wed thu fri sat sun

clone


Automated infrast ructureOn-demand provisioning, pay-per useAPIs allowing higher levels of automat ion

Automated configurat ionFrom boot to product ion on auto-pilotCloning/ replicat ion of set -ups

Automated managementMonitoring, alerts, SLAs -> act ions

cloudinfrastructure

RightScale CloudManagement

Platform


MySQLmaster

MySQLslave

App Srvr App Srvr

replication

Apache Apache

www.mysite.com

HAproxy HAproxy

2x load balancers2x app serversMysql master/ slave


MySQLmaster

MySQLslave

App Srvr App Srvr

replication

Apache Apache

www.mysite.com

HAproxy HAproxy

App Srvr1/array

App SrvrN/array

Scale-upApp server load > 50%Maj orit y vot ingAdd app serversTie into load bal & db

Scale-downApp server load < 20%Maj orit y vot ing


Load exceeds threshold

Additional servers operational

Load drops below thresholdAdditional servers terminated


~8 cpu minutesfor each video


in 3.5 days80 to 3500 servers


MySQLmaster

MySQLslave

App Srvr App Srvr

Apache Apache

www.mysite.com

HAproxy HAproxy

App Srvr1/array

App SrvrN/array

MySQLmaster

MySQLslave

App Srvr App Srvr

Apache Apache

test.mysite.com

HAproxy HAproxy

App Srvr1/array

App SrvrN/array

clone


Up-front costs

Peak vs. average

Dev & Test

Gridtime

hardwareload

time

peak loadaverage load

load

mon tue wed thu fri sat sun

clone


TechnologyAutomat ionArchitectures

Securit yRedundancy / service level agreements


Regulatory complianceSarbanes-Oxley, PCI, SAS-70, ISO17799,

Needed:Security audit statements provided by cloud vendors

Status: when?Note Amazon s Security Whitepaper


Value of SLAsMonetary damagesDefinit ion of acceptable service

Redundancy through cloud-portabilit yShif t resources!

within a cloudacross clouds

No free lunch: costs vary


Amazon Web ServicesLinux & Solaris ServersDisk VolumesPersistent StorageWork Queues

FlexiScale UKLinux & Windows ServersDisk Volumes

GoGridLinux & Windows ServersDisk VolumesLoad balancing


Amazon Web ServicesLinux & Solaris ServersDisk VolumesPersistent StorageWork Queues

FlexiScale UKLinux & Windows ServersDisk Volumes

GoGridLinux & Windows ServersDisk VolumesLoad balancing

RightScale Cloud Management Plat form


MySQLmaster

MySQLslave

App Srvr App Srvr

Apache Apache

www.mysite.com

HAproxy HAproxy

App Srvr1/array

App SrvrN/array

MySQLmaster

MySQLslave

App Srvr App Srvr

Apache Apache

dr.mysite.com

HAproxy HAproxy

App Srvr1/array

App SrvrN/array

Primary deployment DR deployment


Zone 2Zone 1

MySQLmaster

MySQLslave

App Srvr

LB1 LB3

App Srvr App Srvr

LB2


How Similar are the various Clouds?It depends

Server persistency, IP address mapping, load balancing, disk volumes reassignment ,

Converging!RightScale approach: templates and tools

Same building blocks and librariesTools to help bridge dif ferences(Not a lowest common denominator approach)


Servers on-demandDisk Volumes on-demandMult iple datacentersReassign IPs / VIPs across datacentersMult iple geographiesMult iple providers

Automat ion tying it all together


Dashboardw/ automat ionReady-to-go applicat ion stacks

Fully customizable and extensibleSet -up help & supportSupport for mult iple cloudsAutomat ion driven by monitoring and alerts

Leveraging The Clouds For Reliable Web Applications Presentation

Technology

Transcript of Leveraging The Clouds For Reliable Web Applications Presentation