Principles of microservices velocity

PRINCIPLES OF MICROSERVICESSam Newman Velocity Santa Clara, May 2015

@samnewman@velocityconf

Sam Newman

Building MicroservicesDESIGNING FINE-GRAINED SYSTEMS

Accounts

Returns

Invoicing

Shipping

Inventory

Customer Service

Accounts

Returns

Invoicing

Shipping

Inventory

Customer Service

Small Autonomous services that work together

@samnewman@velocityconf5

Show Gilt, Groupon, Netflix, Amazon

@samnewman@velocityconf http://www.12factor.net/

Strategic Goals Architectural

Principles Design and Delivery

Practices

Enable scalable business More customers/transactions Self-service for customers

Support entry into new markets Flexible operational processes New products and operational processes

Support innovation in existing markets Flexible operational processes New products and operational processes

Reduce inertia Make choices that favour rapid feedback and change, with reduced dependencies across teams.

Eliminate accidental complexity Aggressively retire and replace unnecessarily complex processes, systems, and integrations so that we can focus on the essential complexity.

Consistent interfaces and data flows Eliminate duplication of data and create clear systems of record, with consistent integration interfaces.

No silver bullets Off the shelf solutions deliver early value but create inertia and accidental complexity.

Standard REST/HTTP

Encapsulate legacy

Eliminate integration databases

Consolidate and cleanse data

Published integration model

Small independent Services

Continuous deployment

Minimal customisation of COTS/SAAS

Small Autonomous services that work together

Principles Of Microservices

Modelled Around Business Domain

Culture Of Automation

Culture Of Automation Hide Implementation

Details

Decentralise All The Things

Details

Deploy Independently

Details

Consumer First

Details

Isolate Failure Deploy Independently

Consumer First

Details

Highly Observable

Consumer First

Details

Highly Observable

Consumer First

Presentation

Business Logic

Data Access

Presentation

Business Logic

Data Access

Presentation

Business Logic

Data Access

Accounts

Returns

Invoicing

Shipping

Inventory

Customer Service

Accounts

Returns

Invoicing

Shipping

Inventory

Customer Service

Accounts

Returns

Invoicing

Shipping

Inventory

Customer Service

Accounts

Returns

Invoicing

Shipping

Inventory

Customer Service

Accounts

Returns

Invoicing

Shipping

Inventory

Customer Service

13https://www.flickr.com/photos/glimeend/5692801655/

Register a new customer

Oil Change

Emission Test

Oil Change

Emission Test

Replace Tire

Oil Change

Order parts

Emission Test

Replace Tire

Oil Change

Order parts

Emission Test

Replace Tire

Oil Change

Send an invoice

Order parts

Emission Test

Replace Tire

Oil Change

Send an invoiceMake a repair

Order parts

Emission Test

Replace Tire

Oil Change

Send an invoiceMake a repair

Contact a customer

Order parts

Emission TestReplace Tire

Oil Change

Send an invoice

Make a repairContact a customer

Customer Management

Maintenance

Inventory

Details

Highly Observable

Consumer First

Details

Highly Observable

Consumer First

3 Months

2 Microservices

3 Months

2 Microservices

12 Months

10 Microservices

3 Months

2 Microservices

12 Months

10 Microservices

18 Months

60 Microservices

Infrastructure Automation

Automated Testing

Continuous Delivery

Automated Testing

Details

Highly Observable

✔ ✔

Consumer First

Hide Implementation Details

Highly Observable

✔ ✔

Consumer First

HIDE YOUR DATABASE

@samnewman@velocityconfhttp://martinfowler.com/bliki/images/boundedContext/sketch.png

BOUNDED CONTEXTS

Client LibraryClient LibraryClient Library

Client Library

BE CAREFUL OF CLIENT LIBRARIES

Client Library

Details

Highly Observable

✔ ✔ ✔

Consumer First

Details

Highly Observable

✔ ✔ ✔

Consumer First

What is autonomy?

Giving people as much freedom as possible to do the job at hand

What is autonomy?

Giving people as much freedom as possible to do the job at hand

DEVOLUTION?

SELF-SERVICE

https://www.flickr.com/photos/katsrcool/15184711908/

@samnewman@velocityconfhttp://tech.gilt.com/post/102628539834/making-architecture-work-in-microservice

SHARED GOVERNANCE

OWNER-OPERATOR

https://www.flickr.com/photos/stevendepolo/5939055612

INTERNAL OPEN SOURCE

DUMB-PIPES, SMART ENDPOINTS

Magical Mystery Bus

Customer Enrolment

Create Customer

Record

Customer Enrolment

Create Customer

Record

Customer Enrolment

Create Loyalty Account

Create Customer

Record

Customer Enrolment

Dispatch Welcome Pack

Create Customer

Record

Customer Enrolment

Send Welcome Email

Create Customer

Record

Customer Enrolment

Send Welcome Email

Completed

ORCHESTRATION

Customer Service

create

ORCHESTRATION

Customer Service

create

Loyalty Bank

create

ORCHESTRATION

Customer Service

create

Loyalty Bank

create

Emailsend email

ORCHESTRATION

Customer Service

create

Loyalty Bank

create

Emailsend email

Whitemailsend package

ORCHESTRATION

CHOREOGRAPHED

Customer Servicecreate

CHOREOGRAPHED

customer created

CHOREOGRAPHED

customer created

Loyalty Bank

CHOREOGRAPHED

customer created

Loyalty Bank

CHOREOGRAPHED

customer created

Loyalty Bank

Whitemail

CHOREOGRAPHED

customer created

Loyalty Bank

Whitemail

Reporting Dashboard

CHOREOGRAPHY OVER ORCHESTRATION

Details

Highly Observable

✔ ✔ ✔

Decentralise All The Things ✔

Consumer First

Details

Highly Observable

✔ ✔ ✔

Consumer First

ONE SERVICE PER-HOST

Service

ONE SERVICE PER-HOST

Service

Service Service

CONSUMER-DRIVEN CONTRACTS

Shipping Inventory

Expectations

Shipping Inventory

Expectations

Shipping Inventory

Expectations

Shipping Inventory

Expectations

Shipping Inventory

https://github.com/realestate-com-au/pact

CO-EXIST ENDPOINTS

Customer Service

Shipping

CO-EXIST ENDPOINTS

Customer Service

Shipping

CO-EXIST ENDPOINTS

Customer Service

Shipping

CO-EXIST ENDPOINTS

Customer Service

Shipping

Details

Isolate Failure

Highly Observable

✔ ✔ ✔

Deploy Independently✔Consumer First

Details

Isolate Failure

Highly Observable

✔ ✔ ✔

Deploy Independently✔Consumer First

DOCUMENTATION

API GATEWAYS

SERVICE DISCOVERY

HUMANE REGISTRIES

Details

Isolate Failure

Highly Observable

✔ ✔ ✔

Deploy Independently✔Consumer First✔

Details

Isolate Failure

Highly Observable

✔ ✔ ✔

Deploy Independently✔Consumer First✔

AVOID THE DISTRIBUTED SINGLE POINT OF FAILURE!

Strangler App

Legacy App

Legacy AppLegacy App

Strangler App

Legacy App

Requests

Legacy App

Strangler App

Legacy App

Requests

Legacy App

Strangler App

Legacy App

Requests

Legacy App

Strangler App

Legacy App

Requests

Legacy App

30 - 60 Concurrent Requests

Strangler App

Legacy App

Requests

Legacy App

> 800 Concurrent Requests

Strangler App

Legacy App

Requests

Legacy App

> 800 Concurrent Requests

Strangler App

Legacy App Legacy App Legacy App

Thread Pool

Strangler App

Thread Pool

Failing…slowly!

Strangler App

Thread Pool

Failing…slowly!

Strangler App

Thread Pool

Failing…slowly!

Thread-pool exhausted

Strangler App

Thread Pool

Failing…slowly!

No requests to other downstream apps

Strangler App

Thread Pool

Failing…slowly!

Strangler App

Thread Pool

Failing…slowly!

Requests Building Up

Strangler App

Thread Pool

Strangler App

Fix Timeouts

Thread Pool

Strangler App

Fix Timeouts

Thread Pool

Strangler App

Fix Timeouts

Thread Pool Thread PoolThread Pool

Strangler App

Fix Timeouts

Thread Pool Thread PoolThread PoolBulkhead

Downstream Connections

Strangler App

Fix Timeouts

Strangler App

Fix Timeouts

Circuit Breakers

Details

Highly Observable

✔ ✔ ✔

Deploy Independently✔Isolate Failure✔ Consumer First✔

Details

Highly Observable

✔ ✔ ✔

Deploy Independently✔Isolate Failure✔ Consumer First✔

STATS PAGES

AGGREGATION

LOGSSTATS

AGGREGATION

CORRELATION IDS

ID 8964

CORRELATION IDS

ID 8964

SEMANTIC MONITORING

Details

Consumer First

Details

Consumer First

Details

Highly Observable

Consumer First

Sam Newman

Building MicroservicesDESIGNING FINE-GRAINED SYSTEMS

http://buildingmicroservices.com/

Office Hours

(well, 30mins)

Office Hours

12.30pm on Thursday

(well, 30mins)

http://lanyrd.com/profile/samnewman/

Sam Newman @samnewman

THANKS!

Principles of microservices velocity

Business

Transcript of Principles of microservices velocity

Microservices for Java Architects - AgileConnection · •Lambda / API Gateway is a deployment option for microservices –No differences in design principles •Single purpose •Self-contained

Microservices Done Right: Key Ingredients for Microservices Success

How HP Transformed its Architecture with Microservices and ... · Microservices SLA contracts API contracts. Why microservices? The answer is: Velocity. B C A D E Complex sync across

What's Better than Microservices? Serverless Microservices.

MICROSERVICES ORCHESTRATIONS WITH BPM · 4 The principles of microservices Challenges in microservices architectures Microservices orchestrators Real-world practice use case Conclusion

Principles of Microservices - NDC 2014

Equipment and Acceleration - Kishore Karuppaswamy · PDF fileG. Velocity sensors ... Displacement, velocity, and acceleration are products of ... degrees-of-freedom systems, the principles

AppSec & Microservices - Velocity 2016

Microservices Modularity · ... microservices architecture. ... Liferay Database. Domain Model

Applying microservices principles to front end

Microservices: Principles and in Practice

FromtheMonolithto% Microservices: … · 2015-05-27 · Java / Scala ! microservices . Evolutionto%% Microservices8 • The Monolith • The Microservices Ecosystem • Migrating

Empowering Digital Transformation with Microservices€¦ · What are Microservices Monolith vs Microservices Use Case Microservices solution & Best practices Q & A . Dave Chen Principal

MICROSERVICES ARE NOT WORTH THE TROUBLE..?? · Microservices reinforce modular structure, particularly important for large teams Microservices are decoupled by definition Microservices

Microservices Practitioner Summit Jan '15 - Microservices Practitioner Summit - Framing Microservices - Richard Li

Decision-Making in High-Velocity Environments: The Importance of Guiding Principles

Building microservices .net - Dublin Microservices UG 20160928

IT Architecture: From SOA To Microservices GruppoSella).pdf · From SOA To Microservices Agenda • Why? • Culture • Technology • Principles & Practices.

Position, Velocity, & Acceleration - Powering Silicon · PDF filePosition, Velocity, & Acceleration San José State ... Sensing Principles vs. Measurement ... A wide variety of Hall

Microservices Security, Container Runtime Security, MITRE ... · APIs Security. APIs are the front door to Microservices. Today we focus on Microservices Security. The Microservices