Turn-key CD

Metrics to GuideAgile Fluency, Continuous Delivery and Product Teams

Wouter Lagerweij@wouterla

Michiel Rook@michieltcs

Turn-key CD

Goodhart’s Law

https://en.wikipedia.org/wiki/Goodhart's_law

“When a measure becomes a target,It ceases to be a good measure”

No metric without a goal

Do you want to be predictable?

Or fast?

Agile Fluency is a trademark of James Shore and Diana Larsen.

Agile Fluency: Focus⭐ Team culture focus, common goals, progress from business perspective

‘Scrum’

⭐⭐ Team skills focus, deliver at market cadance

‘Continuous Delivery’

⭐⭐⭐ Organisational structure focus, teams work on product goals

‘Product Teams’

⭐⭐⭐⭐ Organisational culture focus, teams work on organisation wide goals

Agile Fluency: Team Metrics⭐ -> Focus: Working together, team and portfolio priorities

⭐⭐ -> Capability: Delivery speed and quality

⭐⭐⭐ -> Value: Product success

⭐ ‘Basic Agile’ Goal: Focus● WIP● Cycle time

⭐ Work in ProgressMetric: WIP

Distance: Direct

Scale: Individual, Team, Department, Organisation

Actionable: Yes

Feedback Cycle: From minutes to years

Team measurements:● How many features is any

team working on?● How many projects?

Practices:● Scrum (Sprints) ● Kanban (WIP limits)● King/Servant pattern● Sprint Goal● Velocity● Pairing● Mob programming

Stop Starting, Start Finishing

⭐ Work in ProgressMetric: WIP

Distance: Direct

Scale: Individual, Team, Department, Organisation

Actionable: Yes

Feedback Cycle: From minutes to year

Organisational measurements:● How many projects are active?● How many are planned?

(portfolio)● How long is the backlog?

Practices:● Project WIP● Iterative development● Agile Portfolio Management

(⭐⭐)● Product focus over project

focus (⭐⭐⭐)● Set-based design (⭐⭐)

Stop Starting, Start Finishing

⭐ Goal: FocusMetric: Cycle time

Distance: (in)direct

Scale: Team, Department, Organisation

Actionable: Yes

Feedback Cycle: From days to years

⭐ Cycle-timeMetric: Cycle-time

Distance: (In)direct

Scale: Team, Department, Organisation

Actionable: Yes

Feedback Cycle: From days to years

Team measurements:● How long for one feature from

start of development to production?

● How long for a project or product?

Practices:● Minimizing story size● Iterative development● Left-shifting QA● Optimizing process (remove

handovers, waiting times)● Increasing capability

(automation, quality, ⭐⭐)

⭐ Cycle-timeMetric: Cycle-time

Distance: (In)direct

Scale: Team, Department, Organisation

Actionable: Yes

Feedback Cycle: From weeks to years

Organisational measurements:● How long for one feature from

inception to production?● How long for a project or

product?

Practices:● Iterative development● Left-shifting development● Lean Startup / Lean UX (⭐⭐)● Product vs project

development (⭐⭐)

⭐⭐ ‘Continuous Delivery’: Capability● Deployment frequency

“How often do we deploy to production?”

● Lead time for changes

“How much time from developer code check-in to running in production?”

● Mean time to recover

“How long between detection of production issue and resolving it”

● Change failure rate

“How often does a deployment fail?”

⭐⭐ ‘Continuous Delivery’: Capability

https://leanpub.com/measuringcontinuousdeliveryContinuous Delivery book on Amazon

⭐⭐ ‘Continuous Delivery’: Capability● Deployment frequency

“Twice a year”

● Lead time for changes

● Mean time to recover

● Change failure rate

⭐⭐ ‘Continuous Delivery’: Capability● Deployment frequency

“Twice a year”

● Lead time for changes

“Three months”

● Mean time to recover

● Change failure rate

⭐⭐ ‘Continuous Delivery’: Capability● Deployment frequency

“Twice a year”

● Lead time for changes

“One day”

● Mean time to recover

● Change failure rate

⭐⭐⭐ ‘Product Teams’: Value

⭐⭐⭐ ‘Product Teams’: Value

http://ronjeffries.com/xprog/articles/value-is-what-you-like/

“Value is what you like”-- Ron Jeffries

⭐⭐⭐ ‘Product Teams’: Value

“What is your business model?”-- Me, repeatedly

⭐⭐⭐ ‘Product Teams’: Value● Web: Pirate metrics!● Internal applications: UX analytics

⭐⭐⭐ ‘Product Teams’: Value

http://500hats.typepad.com/500blogs/2007/06/internet-market.html | The Startup Owner’s Manual

⭐⭐⭐ ‘Product Teams’: Value

http://startitup.co/guides/374/aarrr-startup-metrics

Turn-key CD

Thanks!Get in touch...

Wouter Lagerweij@wouterlawouter@make.io

Michiel Rook@michieltcs

michiel@make.io