Monitoring Quality Metrics to Know When to Ship

© 2010 Seapine Software, Inc. All rights reserved.

Monitoring Quality Metrics to Know When to Ship

Seapine ALM Tour

Huntsville, Alabama

Peter VarholSolutions Evangelist, Seapine Software


Agenda

• Why we don’t know when to ship

• How we can know when to ship

• Data, reports, and shipping

• Demonstration

• Really knowing when to ship


When the schedule tells us to

We All Know When to Ship



• The schedule isn’t a good metric for shipping

• We don’t know if the software is ready

• In fact,

• What does “ready to ship” really mean?

• And if we don’t know what it is, we can’t measure it.



• Ready to ship may mean:

• All features seem to be working properly

• Failures aren’t replicable

• We think it’s ready

• But there are more objective indicators:

• No P0 or P1 bugs

• New bug count is asymptotic

• All functional tests execute for 10 consecutive days



• Any definition will do:

• As long as it meets our needs

• And can be measured

• You need:

• A platform for data collection

• The ability to analyze data and create ongoing reports

• The ability to perform ad hoc queries

• The ability to share reports and data



• Data tells you when to ship

• You need reports on your data

• TestTrack provides a powerful facility for defining reports

• Built-in reports

• Custom reports

• Easily creatable

• Live charts


Building Reports in TestTrack Pro

• Open versus Closed defects

• Defects by type

• Defects by priority

• Live charts

• Custom reports


Open Versus Closed Defects


Defects by Type


Custom Reports


Live Charts

• Live charts visually display information in real time:

• Within the TestTrack dashboard

• In a separate window

• Useful for:

• Sharing changing data across the team

• Focusing on the most important data


Live Charts


Summary

• Define your criteria for shipping

• Determine information you need about that criteria

• Generate reports and live charts

• Now you know when to ship


Thank you

Monitoring Quality Metrics to Know When to Ship

Technology

Transcript of Monitoring Quality Metrics to Know When to Ship