Agile MetricsAgile Metrics

Alimenkou MikalaiAlimenkou Mikalai

27.09.200827.09.2008

IntroductionIntroduction

"Tell me how you will measure me and I will tell you how I will behave"

- Eliyahu Goldratt

”If you can’t measure it, you can’t improve it”

- Lord Kelvin

Metrics VS Diagnostics Metrics VS Diagnostics

Metrics UsesMetrics Uses

Understand real ROIUnderstand real ROI Plan market strategies, product Plan market strategies, product

releasesreleases Fail fast and save moneyFail fast and save money Identify and mitigate business risksIdentify and mitigate business risks Estimate new projectsEstimate new projects Award bonuses to developersAward bonuses to developers

Why Do We Measure?Why Do We Measure?

To informTo inform To compareTo compare To motivateTo motivate To understandTo understand To improveTo improve To protectTo protect

Why Metrics Are So Why Metrics Are So Important?Important?

Great help for retrospectivesGreat help for retrospectives Continuously gives feedbackContinuously gives feedback Help to have healthy code baseHelp to have healthy code base To refactor code To refactor code To be able to do frequent releasesTo be able to do frequent releases Show issues earlyShow issues early

Metrics ApproachesMetrics Approaches

Using wrong Using wrong metricsmetrics

No metrics at allNo metrics at all Using right metricsUsing right metrics

Useless MetricsUseless Metrics

Total lines of codeTotal lines of code Line of code per developerLine of code per developer Total number of completed tasksTotal number of completed tasks Total time workedTotal time worked Bugs fixedBugs fixed

Business MetricsBusiness Metrics

RTF (Running Tested Features)RTF (Running Tested Features) Earned Business Value (EBV)Earned Business Value (EBV) Net Present Value (NPV)Net Present Value (NPV) Internal Rate of Return (IRR)Internal Rate of Return (IRR) Return on Investment (ROI)Return on Investment (ROI)

RTF BasicsRTF Basics

Running – shipped in a productRunning – shipped in a product Tested – continuously pass acceptance Tested – continuously pass acceptance

teststests Features – real customer given Features – real customer given

featuresfeatures

RTF AgilityRTF Agility

RTF requires feature count to grow from first RTF requires feature count to grow from first day so team is focused on featuresday so team is focused on features

RTF requires feature count to grow RTF requires feature count to grow continuously continuously so team integrates oftenso team integrates often

RTF requires features to be tested RTF requires features to be tested so team has contract with the customerso team has contract with the customer

RTF requires tests continue to pass RTF requires tests continue to pass so tests are automatedso tests are automated

RTF requires to grow smoothly RTF requires to grow smoothly so design will need to be cleanso design will need to be clean

RTF SmellsRTF Smells

RTF is zero from start during some RTF is zero from start during some sprintssprints

RTF starts fast and then slow downRTF starts fast and then slow down RTF behaves like yoyoRTF behaves like yoyo RTF grows too quicklyRTF grows too quickly

EBV BasicsEBV Basics

Each story has its own Each story has its own relative weight relative weight assigned by product assigned by product ownerowner

Each story has binary Each story has binary status: done/not donestatus: done/not done

EBV calculated as sum EBV calculated as sum of weights for done of weights for done storiesstories

EBV AgilityEBV Agility

Focus on business value so no big Focus on business value so no big upfront designupfront design

Don’t work on layers, but on featuresDon’t work on layers, but on features Customer sees value immediatelyCustomer sees value immediately Features prioritizing instrumentFeatures prioritizing instrument Help planning releases and demosHelp planning releases and demos

Business Metrics ToolsBusiness Metrics Tools

Agile task management tool/plug-inAgile task management tool/plug-in Issues management systemIssues management system MS ExcelMS Excel

Code MetricsCode Metrics

Cyclomatic complexityCyclomatic complexity Best practices violationBest practices violation Coding standards violationCoding standards violation Possible bugsPossible bugs Code duplicationCode duplication Code coverageCode coverage Dead codeDead code Tests qualityTests quality

Code Metrics ToolsCode Metrics Tools

CheckstyleCheckstyle PMD/CPDPMD/CPD JesterJester FindbugsFindbugs SimianSimian Maven site plug-inMaven site plug-in Intellij IDEA inspectionsIntellij IDEA inspections

Checkstyle SampleCheckstyle Sample

PMD SamplePMD Sample

Findbugs SampleFindbugs Sample

Maven Site Plug-in SampleMaven Site Plug-in Sample

Intellij IDEA Inspections Intellij IDEA Inspections SampleSample

Design MetricsDesign Metrics

Code dependenciesCode dependencies Incoming (Affering Coupling)Incoming (Affering Coupling) Outgoing (Efferent Coupling)Outgoing (Efferent Coupling)

AbstractnessAbstractness Number of abstract classes and interfacesNumber of abstract classes and interfaces Number of concrete classesNumber of concrete classes

Design Metrics ToolsDesign Metrics Tools

JDependJDepend Eclipse CAP plug-Eclipse CAP plug-

inin

JDepend SampleJDepend Sample

Process MetricsProcess Metrics

Agile practice maturityAgile practice maturity Obstacles cleared per iterationObstacles cleared per iteration Obstacles carried over the next iterationObstacles carried over the next iteration User stories carried over the next User stories carried over the next

iterationiteration Defects carried over the next iterationDefects carried over the next iteration Team member loadingTeam member loading VelocityVelocity Backlog sizeBacklog size

VelocityVelocity

Classic velocityClassic velocity Speed velocitySpeed velocity Interruptions per dayInterruptions per day

Backlog SizeBacklog Size

Process Metrics ToolsProcess Metrics Tools

Issues management systemIssues management system Special agile tools/plug-insSpecial agile tools/plug-ins Physical task management toolsPhysical task management tools MS ExcelMS Excel

Automation MetricsAutomation Metrics

Code coverageCode coverage Number of builds per dayNumber of builds per day Time taken per buildTime taken per build Number of failed/success buildsNumber of failed/success builds Trends in code metricsTrends in code metrics

Automation Metrics ToolsAutomation Metrics Tools

Continuous integration toolsContinuous integration tools CruiseControlCruiseControl TeamCityTeamCity BambooBamboo HudsonHudson ContinuumContinuum

CoberturaCobertura CloverClover Maven dashboard plug-inMaven dashboard plug-in

TeamCity SampleTeamCity Sample

Cobertura SampleCobertura Sample

Testing MetricsTesting Metrics

Acceptance tests per storyAcceptance tests per story Defects count per storyDefects count per story Tests time to runTests time to run Tests run frequencyTests run frequency Manual tests per storyManual tests per story Automation percentAutomation percent Time to fix testsTime to fix tests

Testing Metrics ToolsTesting Metrics Tools

FitNesseFitNesse ConcordionConcordion SeleniumSelenium Issues management systemIssues management system Testing automation toolsTesting automation tools

Other MetricsOther Metrics

WTFs per minuteWTFs per minute VCS ActivityVCS Activity

Metrics Evaluation ChecklistMetrics Evaluation Checklist

Example: Business Value Example: Business Value DeliveredDelivered

Example: VelocityExample: Velocity

Best PracticesBest Practices

Don’t produce metrics that no one wantsDon’t produce metrics that no one wants Be honest about metrics usageBe honest about metrics usage Don’t use metrics to compare teamsDon’t use metrics to compare teams Use metrics as a basis of discussionUse metrics as a basis of discussion Don’t demoralize team with metricsDon’t demoralize team with metrics Take team state into account when Take team state into account when

selecting metricsselecting metrics Don’t select hard produced metricsDon’t select hard produced metrics

Best PracticesBest Practices

Measure outcomes, not outputsMeasure outcomes, not outputs Measure results, not activityMeasure results, not activity Measure work items done, not time Measure work items done, not time

spent per taskspent per task Follow trends, not numbersFollow trends, not numbers

Best PracticesBest Practices

Don’t measure something just because Don’t measure something just because you canyou can

Use just enough set of metricsUse just enough set of metrics Use metrics that are easy to collectUse metrics that are easy to collect Share metrics to get feedbackShare metrics to get feedback Different metrics for product and Different metrics for product and

processprocess