Testing Lessons from Hockey (The World's Greatest Sport)

47
AmiBug.Com, Inc. © Robert Sabourin, 2013 17-Jan-14 Slide 1 Testing Lessons from Hockey (The World's Greatest Sport) Robert Sabourin President & Principal consultant AmiBug.Com, Inc. Montreal, Canada [email protected]

Transcript of Testing Lessons from Hockey (The World's Greatest Sport)

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 2

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 3

Testing Lessons from Hockey

• Overview

– Learning, Metaphors

– The Players

– The Coaches

– The Fans

– The Score Board

– The Standings

– The Big Picture

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 4

Welcome to Toronto

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 6

Learning and Metaphors

• Teaching

• Learning

• Retaining

• Applying knowledge

• Share experiences

• Don’t get carried away …

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 8

Forward Games Played

Goals

Assists

Points

Penalty Minutes

Some History Junior

Professional

International

Averages

Highs and Lows

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 10

Testing Bugs

Bugs by type

Show stoppers

Bug isolation %

Estimate/Actual

Development Defect Density

Function points

K-LOCs

Dev/Rework

Estimate/Actual

History Agility – Context

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 11

Testing Cards

AMIBUG

WINGS

AMIBUG

WINGS

Collard

AMIBUG

WINGS

AMIBUG

WINGS

Bolton

AMIBUG

WINGS

AMIBUG

WINGS

Copeland

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 12

Paraphernalia

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 13

The Players Hockey Roles Testing Roles

Center Test Analyst

Wing Scripted Tester

Defense Man Test Automation

Goalie Explorer

Captain Subject Matter

Penalty Killer Security tester

Goon Load tester

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 14

The Players Hall of Fame

Meyers

Beizer

Collard

Gelperin

AMIBUG WINGS

AMIBUG WINGS

AMIBUG WINGS

AMIBUG WINGS

AmiBug.Com, Inc.

Learning how to play hockey?

© Robert Sabourin, 2013 17-Jan-14 Slide 16

Years of dedication

and perseverance

by hockey Moms

and hockey Dads

AmiBug.Com, Inc.

Learning how to play hockey?

© Robert Sabourin, 2013 17-Jan-14 Slide 17

Hone your craft …

• Practise

• Practise

• And then

• Practise

some more …

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 19

The Coaches

• Team building – Hiring winners

– Player Development

– Junior Leagues, Training

• Management – Strategy, Tactics, Implementation

– Progress and status

• Feedback – Encouragement

– Redirect

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 20

The Coaches

• Direct the play play

– Line changes

– Defend players

– Argue with refs

– Motivate

– Drill

– Pull the goalie

– Bridge to stakeholders

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 21

The Test Lead

• Team building – Hiring winners

– Tester Development

– Training

• Management – Strategy, Tactics, Implementation

– Progress and status

• Feedback – Breakfast of champions

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 22

The Fans

• Hockey Fans – Watch games

– Buy the tickets

– Eat the food

– Exhibit loyalty

– Provide feedback

– Important stakeholders

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 23

The Hockey Fan

• Feedback – Anxiety

– Excitement

– Stress

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 24

The Hockey Fan

• Feedback – Applaud Progress

– Cheer success

– Boo the other team

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 25

Raving Fans of Testers

• Developers

• Database Admin

• Managers

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 26

Raving Fans of Testers

• Customers

• End Users

• Business Stakeholders

AmiBug.Com, Inc.

Keep it clean

© Robert Sabourin, 2013 17-Jan-14 Slide 27

Know the rules

Make the rules

Break the rules

Respect stakeholders

Play well with others

AmiBug.Com, Inc.

Keep it clean

© Robert Sabourin, 2013 17-Jan-14 Slide 28

Checking?

AmiBug.Com, Inc.

Keep it clean

© Robert Sabourin, 2013 17-Jan-14 Slide 29

Testing?

AmiBug.Com, Inc.

Keep it clean

© Robert Sabourin, 2013 17-Jan-14 Slide 30

Learning?

AmiBug.Com, Inc.

Keep it clean

© Robert Sabourin, 2013 17-Jan-14 Slide 31

Controlled environment

Clean surface

Prepared

Ready to play

AmiBug.Com, Inc.

The Right Gear

© Robert Sabourin, 2013 17-Jan-14 Slide 32

Helmet

Mask

Gloves

Pads

Skates

Stick

Other stuff

AmiBug.Com, Inc.

Getting Started

© Robert Sabourin, 2013 17-Jan-14 Slide 33

Face off

All ready

Get control

Understand

what you are

up against

Go for it

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 34

Hockey Score Board

• Visible to all – Score

– Period

– Time

– Key incidents

– Penalty time

– Ads

– Out of town scores

– Excitement

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 35

Testing Score Board

• Generally – Time

– Bugs

– Priority, Severity

• Regress – Confidence

– Pass Fail

• Exploratory – Opportunities

– On charter time %

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 36

Urgent

Severe

Urgent

Not Severe

Not Urgent

Severe

Not Urgent

Not Severe

Bug Sweet Spot

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 37

Testing Scoreboard

• Progress in the Project – When in project? Phase

– Bugs counts by severity, priority

– Objectives identified, elaborated

– Exploratory Test charters identified

– Tests run, passed, failed, blocked

– Test Project Statistics

– Testing effort done, effort to go

– Running totals (of all counts)

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 38

Testing Scoreboard

• Feedback – Big, Visible, Obvious

– Focus of attention

– Great place for Ads!

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 39

Testing Scoreboard

0

50

100

150

200

250

01/1

1/9

8

01/1

8/9

8

01/2

5/9

8

02/0

1/9

8

02/0

8/9

8

02/1

5/9

8

02/2

2/9

8

03/0

1/9

8

03/0

8/9

8

03/1

5/9

8

03/2

2/9

8

03/2

9/9

8

04/0

5/9

8

04/1

2/9

8

04/1

9/9

8

04/2

6/9

8

05/0

3/9

8

05/1

0/9

8

05/1

7/9

8

05/2

4/9

8

05/3

1/9

8

06/0

7/9

8

06/1

4/9

8

06/2

1/9

8

06/2

8/9

8

07/0

5/9

8

07/1

2/9

8

07/1

9/9

8

07/2

6/9

8

08/0

2/9

8

08/0

9/9

8

08/1

6/9

8

08/2

3/9

8

08/3

0/9

8

09/0

6/9

8

09/1

3/9

8

09/2

0/9

8

09/2

7/9

8

10/0

4/9

8

10/1

1/9

8

10/1

8/9

8

10/2

5/9

8

11/0

1/9

8

11/0

8/9

8

11/1

5/9

8

11/2

2/9

8

11/2

9/9

8

12/0

6/9

8

12/1

3/9

8

01/1

4/9

9

01/1

8/9

9

01/2

5/9

9

02/0

1/9

9

02/0

8/9

9

Open P1 & P2 Bugs Bugs Pending validation (Corrigé)

Trend Chart

Open Bugs

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 40

Hockey Standings

• How is the team doing? – Games played

– Games at hand

– Total Wins

– Total Loses

– Relative placement

– Division standing

– League standing

– Attendance

– Profit

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 41

Testing Project Standings

• How is the project doing? – Progress toward goals

– On Time – Quality – Budget

– Comparing all projects

– To go / Done effort

– Estimation accuracy

– Work breakdown

– Effort distributions

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 42

Testing Project Standings

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 43

Hockey Big Picture

• Is the franchise healthy? – Revenues

– Expenses

– Profit

– Loss

– Contracts

– Media

– Civic responsibility

– Capital

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 44

Hockey Big Picture

• How is the franchise doing? – Value

– External factors

– Supply

– Demand

– Opportunity

– Image

– Brand

– Revenue

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 45

Testing Big Picture

• Is the company healthy? – Revenues

– Expenses

– Profit

– Loss

– Contracts

– Media

– Civic responsibility

– Capital

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 46

The Big Picture

• How is testing adding value to the organization?

– More sales revenue

– Fewer support calls

– Lower development cost

– Competitive time to market

– Best of breed technology

– Accountable and auditable!

– Attracts top talent, Fun team

– All know how testing ties to corporate values

AmiBug.Com, Inc.

© Robert Sabourin, 2013 17-Jan-14 Slide 47

Thank You

Questions?