Metrics & Reports from Test Teams (QA)

STC JULY 2014

MUSH HONDA

Agenda

• What is a Report?

• What are Metrics?

• Reasons for Collecting Data

• The Metrics Lifecycle

• How do we establish Metrics?

• Examples

2

Definition of Report

Wikipedia: A report or account is any informational work (usually of writing, speech, television, or film) made with the specific intention of relaying information or recounting certain events in a widely presentable form.

Verb: 1. give a spoken or written account of something that one has observed, heard, done, or investigated

3

Definition of Metrics

(Software) Metrics

Continuous measurement-

based technique

Applied to s/w development

process & products

Supply timely & meaningful Information

To Improve process & products

4

- Paul Goodman (founder member of ESPI)

Data Collection & Reporting

• Major reasons:

– Understand Process, Product and Service

– Evaluate Process, Product & Service

– Control Process with Triggers

– Predict future values of Project attributes

• Goals:

– Establish Baseline

– Examine Task & Process Relationships

– Target Improvement efforts

– Improve project estimation

5

• Daily

• Weekly

• Monthly

• Quarterly

• By Sprint

• By Release

• By Product Feature / User Story

6

Typical Report Frequency

Reports Help understand:

Schedule Information

Level of Product Quality

Team Challenges & Mitigation Options

Metrics Lifecycle

Define & Prioritize

Identify Data to Capture

Communicate to Team(s)

Capture & Verify Data

Analyze & Process Data

Report & Revise Metric

7

Establishing Metrics

Standard Metrics

Schedule

Productivity

Product Quality

Semi-Custom Metrics

SDLC based

Scope / Team Size based granularity

Client Success Factors

Client Objectives driven Combination of Process

& Product Quality

8

Example: Daily Report

9

Example: Monthly Report

10

© 2014 HCMC Software Testing Club

Thank You