Download - Scalability delivering the promise of the cloud

Transcript
Page 1: Scalability   delivering the promise of the cloud

Scaling the Cloud with PaaSScaling the Cloud with PaaS

John WetherillHo Ming LiJune 26, 2013

Page 2: Scalability   delivering the promise of the cloud

Today’s Speakers

John Wetherill Developer Evangelist

Ho Ming Li Cloud Engineer

Page 3: Scalability   delivering the promise of the cloud

Topics

Scaling in the Cloud

Scaling with PaaS

Measurement Tools

Best Practices/Antipatterns

Scaling in the Hybrid Cloud

Page 4: Scalability   delivering the promise of the cloud

Recent Events

Page 5: Scalability   delivering the promise of the cloud
Page 6: Scalability   delivering the promise of the cloud
Page 7: Scalability   delivering the promise of the cloud

often painfulnot always necessaryfrequently overdone

prerequisite: understanding

Scaling

Page 8: Scalability   delivering the promise of the cloud

scale from day onescale early and often

always profile before optimize

Practices

Page 9: Scalability   delivering the promise of the cloud

Scaling with Stackato

Page 10: Scalability   delivering the promise of the cloud

Using PaaS to Scale

Resource limits/management

load balancing

instant app scaling

auto-scaling

clustering and role distribution

performance monitoring

log aggregation

lxc containers

Page 11: Scalability   delivering the promise of the cloud

Resource Management

resources can be capped

per user and per app

memory/disk/URIs

log drains

services

Page 12: Scalability   delivering the promise of the cloud

Demo: resource caps

Page 13: Scalability   delivering the promise of the cloud

Load Balancing

automatically configured/enabled

round-robin between app instances

handles udp and tcp traffic

any port or protocol

Page 14: Scalability   delivering the promise of the cloud
Page 15: Scalability   delivering the promise of the cloud

Instant App Scaling

one-click spawn multiple instances

rapid launch by copying existing instance

adjust resource allocation too

scriptable, can be automated

can trigger “autoscaling” events

Page 16: Scalability   delivering the promise of the cloud

Demo: app scaling

Page 17: Scalability   delivering the promise of the cloud

Clustering / Role Distribution

multiple coordinating nodes

scale out

can be configured by CLI, API, or web ui

roles are assigned to individual nodes

multiple role instances (eg 3 routers)

Page 18: Scalability   delivering the promise of the cloud

Demo: Clustering

Page 19: Scalability   delivering the promise of the cloud

Log Aggregation

collect all logs from all app instances

forward to aggregation service

no SPOF

logs available via web ui, command line, and REST API

log streams can be filtered and formatted

can generate json logs

Page 20: Scalability   delivering the promise of the cloud

Demo: Logging to Loggly

Page 21: Scalability   delivering the promise of the cloud

Performance and Health Monitoring

monitor performance data

transactions / applications / websites

simple integration with third-party tools like New Relic

graphical view of cloud performance and resource usage

can trigger REST calls based on performance characteristics

scriptable, customizable

Page 22: Scalability   delivering the promise of the cloud

Demo: Stackato and New Relic

Page 23: Scalability   delivering the promise of the cloud

LXC Containers

safe isolation between applications

namespaces: processes, network, mount-points, hostname

port uniqueness, isolation, iptables

allows packing as many app instances into a VM as possible

Page 24: Scalability   delivering the promise of the cloud

Thank you!Thank you!

Any questions?Any questions?

John WetherillJohn Wetherill

Developer Evangelist, ActiveStateDeveloper Evangelist, [email protected]

@bcferrycoder

Ho Ming LiHo Ming Li

Cloud Engineer, Cloud Engineer, [email protected]

@HoReaL

Page 25: Scalability   delivering the promise of the cloud

Today’s Presenters:

Page 26: Scalability   delivering the promise of the cloud

Scaling Practices

measure

stateless

websockets

REST

Page 27: Scalability   delivering the promise of the cloud

Scaling Practices

meter monitor measure

quantify

session store - but no sticky session

scale out

mature optimization