Designing for rapid release goto 2012

DESIGNING FOR RAPID RELEASE

Sam Newman

ThoughtWorks

@samnewmanGOTO: Aarhus 2012

We’re hiring...


We’re hiring...

Not Him


We’re hiring...


Why is rapid release important?


What criteria influence design?



Scaling



Scaling

Durability



Scaling

Durability

Geographical



Scaling

Durability

Geographical

Compliance



Scaling

Durability

TechnologyGeographical

Compliance



Scaling

Durability

Performance

TechnologyGeographical

Compliance


What about making it easy to release?


Make it quick to make a change



Make it quick to deploy the change



Make it quick to deploy the change

Reduce the risk of releasing


MusikShopv1


MusikShopv2


v23 v9 v14v1

MusikShop


v23 v9 v14v2

MusikShop


The Same Change...


The Same Change...

...resulting in very different deployments


...


...

Each release is a rollback point


...


and a data gathering point


...


and a data gathering point

and a release process practiced often is more likely to work and to be efficient


Small, Incremental Releases FTW!


So how do we design our systems to allow

for small changes?


MusikShop


MusikShop

RekomendLib


MusikShop

RekomendLib

Invoice Creation


MusikShop

RekomendLib

Invoice Creation

...


MusikShop

RekomendLib

Invoice Creation

String Utils

...


MusikShop

RekomendLib

Invoice Creation

String Utils

...

Small units - easier to reason about


MusikShop

RekomendLib

Invoice Creation

String Utils

...

Small units - easier to reason about

Fast CI turnaround cycles


MusikShop v1


MusikShop v1

RekomendLib v134


MusikShop v1

RekomendLib v134

RekomendLib v200


MusikShop v1

RekomendLib v134

MusikShop v2

RekomendLib v200


MusikShop v1

RekomendLib v134

Change to a statically linked library = new deployment of the application

MusikShop v2

RekomendLib v200


MusikShop v1


MusikShop v1

Rekomender v124


MusikShop v1

Rekomender v124

Rekomender v200


MusikShop v1

Rekomender v124


MusikShop v1

Rekomender v124

Rekomender v200


MusikShop v1

Rekomender v124

Rekomender v200

Smoke Test


MusikShop v1

Rekomender v124

Rekomender v200

Smoke Test

Showcase


MusikShop v1

Rekomender v124

Rekomender v200

Smoke Test

Showcase

Blue/Green Deployments


What can stop blue/green deployments?


User


MusikShop v1

User


MusikShop v1

User

State


MusikShop v1 MusikShop v2

User

State


MusikShop v1 MusikShop v2

Avoid stateful services

User

State


Expensive Hardware!


Manual Circuit Breaker

MusikShop v1

Rekomender v124

www.MusikShop

Take That

Queens Of The Stone Age

Snoop Dogg

We Rekomend ‘The Brakes’!



MusikShop v1

Rekomender v124

www.MusikShop

Take That


Snoop Dogg

We Rekomend ‘The Brakes’!We Can’t Rekomend

Right Now!



MusikShop v1

Rekomender v124

Rekomender v200

www.MusikShop

Take That


Snoop Dogg


Right Now!



MusikShop v1

Rekomender v124

Rekomender v200 Smoke Test

www.MusikShop

Take That


Snoop Dogg


Right Now!



MusikShop v1

Rekomender v124

Rekomender v200 Smoke Test

www.MusikShop

Take That


Snoop Dogg



Async Behaviour

MusikShop v1

Rekomender v124

www.MusikShop

Take That


Snoop Dogg



Async Behaviour

MusikShop v1www.MusikShop

Take That


Snoop Dogg



Async Behaviour

MusikShop v1www.MusikShop

Take That


Snoop Dogg

We Rekomend ‘The Brakes’!Waiting...


Async Behaviour

MusikShop v1

Rekomender v200

www.MusikShop

Take That


Snoop Dogg

We Rekomend ‘The Brakes’!Waiting...


Async Behaviour

MusikShop v1

Rekomender v200

www.MusikShop

Take That


Snoop Dogg



Things to watch for...


The Trifle


The Trifle

Musik Web


The Trifle

Musik Web

Persistence


The Spider


The Spider

CD Ordering System


The Spider

CD Ordering System

Whitemail System


The Spider

CD Ordering System

Whitemail System Data Wharehouse


The Spider

CD Ordering System


3rd Party Supplier


The Spider

CD Ordering System


3rd Party SupplierFinance System


The Spider

CD Ordering System


3rd Party SupplierFinance SystemDumb System 4

Dumb System 1 Dumb System 2

Dumb System 3


“A set of capabilities on an endpoint”


Add to cart


Add to cart

Checkout


Add to cart

Checkout

View Latest Releases


Add to cart

Checkout


Search


Add to cart

Checkout


Search

Listen To Previews


Add to cart

CheckoutView Latest

Releases

Search

Listen To Previews


Add to cart

CheckoutView Latest

Releases

Search

Listen To Previews

Shopping Cart Catalog

Music Library


Model Services Based On Your Business

Domain


MusikShop

v1

Reko.v9


MusikShop

v1

Reko.v9

Reko.v10

MusikShop

v1

Internal Change


MusikShop

v1

Reko.v9

Reko.v10

MusikShop

v1

Internal Change Expansion

Reko.v10

MusikShop

v1


MusikShop

v1

Reko.v9

Reko.v10

MusikShop

v1

MusikShop

v2

Reko.v10

Internal Change Expansion Interface

Change

Reko.v10

MusikShop

v1


Rekomender V9

v1

MusikShop


Rekomender V9

v1

MusikShop

Non-breaking expansion is to be preferred - but if you can’t...


Rekomender V9

v1

MusikShop

v2



Rekomender V9

v1

MusikShop

v2

iOS App

Consider maintaining multiple service endpoints



Service B

Service A

Shared Lib v1

Shared Lib v1


Service B

Service A

Shared Lib v1

Shared Lib v1

Shared Lib v2


Service B

Service A

Shared Lib v1

Shared Lib v1

Shared Lib v2

Beware of shared serialization protocols


Service B

Service A

Shared Lib v1

Shared Lib v1

Shared Lib v2


WSDL-binding


Service B

Service A

Shared Lib v1

Shared Lib v1

Shared Lib v2


WSDL-bindingJAXB


Service B

Service A

Shared Lib v1

Shared Lib v1

Shared Lib v2


WSDL-bindingJAXB

Java Serialization


RFC 761


Postel’s Law: “Be conservative in what you do, be liberal in

what you expect“


MusikShop Rekomender

Consumer Driven Contracts


DATABASES!


DATA IS COOL


DATABASES ARE EVIL


RekomenderMusikShop

DB Schema


RekomenderMusikShop

Schema Schema

DB Instance


RekomenderMusikShop

Schema Schema

DB Instance

Each service owns its own data


RekomenderMusikShop

RDMS RDMS


RekomenderMusikShop

RDMS RDMSRiak


Riak

Rekomender

RDBMS


Riak

Rekomender

RDBMS

Release 1: Dual Write


Riak

Rekomender

RDBMS


Release 2: Read from Riak


Riak

Rekomender


Release 2: Read from Riak

Release 3: Retire RDMS


MusikShop

Rekomender


MusikShop

Rekomender AceSuggest


MusikShop

Rekomender AceSuggest

Dark Launching!


Decompose Your Systems

Model Your Domain

Get Interfaces Right

Seperate Deployment From Release


Questions?


Thanks!

@samnewman

We’re hiring!

Designing for rapid release goto 2012

Documents

Transcript of Designing for rapid release goto 2012