Steve Lawrence - Agile Metrics
-
Upload
agilenz-conference -
Category
Software
-
view
117 -
download
2
description
Transcript of Steve Lawrence - Agile Metrics
![Page 1: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/1.jpg)
Agile MetricsSteve LawrenceSlice Consulting Pty Ltd
Your pic
![Page 2: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/2.jpg)
flickr.com/angelabethell/
STEVELAWRENCE
@goriansteve
![Page 3: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/3.jpg)
A Metrics talk by Steve Lawrence
![Page 4: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/4.jpg)
“ “When done correctly; an economic
framework will shine a bright light into all the dark corners of product
development
Don Reinertsen, The Principles of Product Development FlowVapor trail
Establish an Economic Framework
Our overall goal is to influence economic outcomes
Our most important decisions involve tradeoffs between multiple measures of performance
![Page 5: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/5.jpg)
Why do we want to capture metrics
What is the purpose
How will they be used
Who are they for
![Page 6: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/6.jpg)
Why Metrics?To support decision making processes
Measure Value (Product) or Process
To affirm and reinforce Lean and Agile principles
To measure outcomes
To follow trends, not numbers
Reveal, rather than conceal, context and significant variables
Provide fuel for meaningful conversation
![Page 7: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/7.jpg)
At the current churn rate, 75% of the S&P will be replaced by 2027
![Page 8: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/8.jpg)
If a measurement happens at all, it is because it must have some conceivable effect on decision and behavior. If we can't identify what decisions could be affected by a proposed measurement and how that measurement could change them, then the measurement simply has no value.
“How to Measure Anything” By Douglas W. Hubbard
““
![Page 9: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/9.jpg)
What For?
Support organisational objectives
Optimise learning
Should be simple, big & visible
Well-understood and easily adopted
Guide actions and decisions
“Escape Velocity” By Geoffrey Moore
![Page 10: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/10.jpg)
Bad Metrics
Collected because they always have been
Encourage gaming of the system
Result in bad behavior
Ignore the system
Don’t align with the Why!!
@goriansteve
![Page 11: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/11.jpg)
1. Using metrics as levers2. Using a convenient metric (rather than one
that provides critical insight)
3. Bad analysis4. Motivating people to hide
information5. Too costly measures6. Too many measures (information overload)
7. Too few measures (unbalanced)
The Seven Deadly Sins of Agile Measurement
Larry Maccherone, Rally Software
![Page 12: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/12.jpg)
Types of Metrics
Internal vs. External
Qualitative vs. Quantitative
System Efficiency vs. Local Efficiency
Hypotheses, Experiments, and Little Bets
![Page 13: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/13.jpg)
Some Common Measures
![Page 14: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/14.jpg)
estimatingwe are not so good at
Remember
![Page 15: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/15.jpg)
comparisonwe are good at
ww
w.cp
cstrate
gy.co
m
![Page 16: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/16.jpg)
Productivity Metrics
Value Points Delivered per Time Period
Cost per Value Point
Concept To Cash
Revenue per Employee
Lead Time per Story
Mean Time to Ticket Resolution
SLA Achievement Metrics
Velocity
![Page 17: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/17.jpg)
![Page 18: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/18.jpg)
i-x
J-A
10-1
![Page 19: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/19.jpg)
Stable Teams Creates an almost 2:1 difference in throughput in Teams that are 95% or more dedicated compared to teams that are less than 50% dedicated.
AND60% better productivity40% better predictability60% better responsiveness.
![Page 20: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/20.jpg)
Predictability
Say / Do Ratio
Velocity Variance
Cycle Time per Story Point
Feature Comparison
Epic Comparison
flickr.com/uggboy
![Page 21: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/21.jpg)
Customer Satisfaction
Net Promoter Score Trending
Customer Satisfaction Trending
Repeats / Renewals
flickr.com/amne//
![Page 22: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/22.jpg)
Quality
Maintenance Complexity
Trending
Defect Density
Issue Re-introduction Rate
Defect Arrival / Kill Rate
Unit Test Coverage
Auto Functional Test Coverage
flickr.com/ivyfield/
![Page 23: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/23.jpg)
Employee Satisfaction
Employee Satisfaction Trending (surveys)
Attrition Rates
Pain Scale
Retrospective Outcomes
![Page 24: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/24.jpg)
Responsiveness
Cycle Time per Story
Lead Time per Story
Queue / Batch Size
Average Impediment Lifetime
Mean Time to Release
Mean Time to Fixflickr.com/y500
![Page 25: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/25.jpg)
By themselves Metrics don’t tell the story. Trends Do!!
![Page 26: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/26.jpg)
Velocity - a guide not a target
![Page 27: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/27.jpg)
How Velocity Works
Whoa - What does your velocity look like over the last 3 iterations?
Well over the last 3 iterations we completed 45, 80 and 70 story points.
This iteration we completed 90 story points and next iteration we will do 160
Ok, so what has changed in your team or your work that makes you think you can achieve 160 story points?
Nothing, but to satisfy our customer we have to.
![Page 28: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/28.jpg)
Velocity
poor cadence, unpredictable
![Page 29: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/29.jpg)
Velocity
better cadence, more predictable
![Page 30: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/30.jpg)
Program Velocity?
23 points per sprint
235 points per sprint
Team A
Team B
![Page 31: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/31.jpg)
Examples of BadnessI want the ‘Blue’ team to work on my projects because their velocity is higher
I want to compare the output of people in the Team
We committed to 120 points and completed them all and carried forward 30?
HUH
As a manager I have to constantly drive my teams to ensure they meet the goals ‘we’ set
![Page 32: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/32.jpg)
Burndown Charts
@goriansteve #agileaus
![Page 33: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/33.jpg)
Manage Flow - Watch your WIP
![Page 34: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/34.jpg)
Lean Start Up: Experiments
“Lean Start Up” By Eric Ries
![Page 35: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/35.jpg)
Proposed Solution
The Lean Canvas 30-Jun-2014Iteration #1
Impact Mapping Communications Plan
Problem Conceptual Solution
NotesUnique Value PropositionSingle, clear, compelling message that states why the solution will be different and worth experimentation
Metrics Outcomes
This is a sample text, insert your
own text,
This is a sample text, insert your
own text,
This is a sample text, insert your
own text,
Tasks
This is a sample text, insert your own
text,
Lean Canvas is adapted from The Business Model Canvas (http://www.businessmodelgeneration.com) and is licensed under the Creative Commons Attribution-Share Alike 3.0 Un-ported License.
PRODUCT
Sample text
Sample Text
FeatureSample
Text
Sample Text
FeatureDelta
Anticipated Improvement
Sample Text
Sample text
Sample Text
Deploy / Pivot / RIP
Top features
This is a sample text, insert your
own text,
TasksTasks
TasksTasks
Tasks
Feature
TasksTasks
Tasks
Expected Outcome
Relative Size S/M/L
Learnings
![Page 36: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/36.jpg)
V0.81
![Page 37: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/37.jpg)
WSJF Prioritising
user value + time value + RR | OE
job size
“Images used with permission of Scaled Agile, Inc. See ScaledAgileFramework.com for more information
![Page 38: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/38.jpg)
Feature User Business
Value
Time Criticality
Risk Reduction/Opportuni
ty Enablement
Cost of Delay
Job Size
WSJF
Presentation5 8 6 19 10 1.90
Sales Proposal 10 10 9 29 7 4.14
Remote Training
feedback 3 3 3 9 4 2.25
My Example
![Page 39: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/39.jpg)
Value
Time
In our experience no single sensitivity is more eye-opening than cost of delay
Don Reinertsen, The Principles of Product Development Flow
“
Cost of Delay
“
![Page 40: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/40.jpg)
AGILE EVM
Measures Schedule and Performance – not Value
Forecasts in financial units
Expects everything to be defined up front
No Assertion of Quality
PV, EV, CPI, SPI, ETC, EAC
![Page 41: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/41.jpg)
Capacity Planning as a Metric
![Page 42: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/42.jpg)
Waiting Times more than double as utilisation moves from 80% to 90% and double again as it moves from 90% to 95%
Don Reinertsen, The Principles of Product Development Flow
![Page 43: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/43.jpg)
![Page 44: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/44.jpg)
Control Queues Not Capacity Utilisation
Don Reinertsen, The Principles of Product Development Flow
Waiting on SME’s Longer Cycle Times
Waiting on Sign Offs Increased Risk
Management Reviews More Variability
Big Upfront Analysis More Overhead
Waiting on Releases Lower Quality
Waiting More Administration
Waiting Less Motivation
Waiting Flow On effects
![Page 45: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/45.jpg)
![Page 46: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/46.jpg)
![Page 47: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/47.jpg)
Why do we want to capture metrics What decisions or behaviours do you wish to impact
How will they be usedLever or to facilitate feedback
Who will use the metricsAre the metrics fit for purpose
@goriansteve
![Page 48: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/48.jpg)
Why do we want to capture metrics
What is the purpose
How will they be used
Who are they for
![Page 50: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/50.jpg)
![Page 51: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/51.jpg)
Defect Density
My Hypothesis = 95-100%
![Page 52: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/52.jpg)
Draw 2 parallel lines
![Page 53: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/53.jpg)
At one end of the parallel lines, draw a line at right
angles to them
![Page 54: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/54.jpg)
At the other end of the parallel lines, draw an
inverted V
![Page 55: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/55.jpg)
At one end of the inverted V, draw 2 parallel lines
![Page 56: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/56.jpg)
On the end of the parallel lines you just drew, draw a line at right angles to them
![Page 57: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/57.jpg)
![Page 58: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/58.jpg)
Customer collaboration over contract negotiation
Individuals and interactions over processes and tools
Better Outcomes
![Page 59: Steve Lawrence - Agile Metrics](https://reader033.fdocuments.in/reader033/viewer/2022061302/5491da2ab479590c3a8b4bb7/html5/thumbnails/59.jpg)
Steve LawrenceSlice Consulting Pty Ltd
Your pic
Thanks for listening…