STARCANADA 2013 Keynote: Testing Lessons from Hockey (The World’s Greatest Sport)

47
AmiBug.Com, Inc. © Robert Sabourin, 2013 Jan 1, 2022 Slide 1 Testing Lessons from Hockey (The World's Greatest Sport) Robert Sabourin President & Principal consultant AmiBug.Com, Inc. Montreal, Canada [email protected]

description

Over the years, Rob Sabourin has drawn important testing lessons from diverse sources including the great detectives, the Simpsons, Hollywood movies, comic book superheroes, and the hospital delivery room. Now Rob scores big with breakaway testing ideas from hockey, Canada’s national sport. Like star hockey players, testers develop skills and continuously adapt and perfect them. Like team “stats,” test metrics show how performance impacts business. Like the penalty box, a smoke test keeps flaky builds out of play. Like Zambonis, testers must reset environments to a known state. Hockey play-by-play commentary makes the game come alive. Likewise, test play-by-play commentary highlights critical skills and tactics for quickly finding bugs that matter. Hockey leagues foster contrasting styles of play. Context factors foster contrasting styles of testing. Rob shows how hockey camps can be a model for tester training regimes. Great hockey requires the right equipment—skates, sticks, helmets, and pads. Great testers leverage the right tools—scripts, simulators, analyzers, probes, and viewers—to find a wide range of problems quickly. Rob’s lessons from hockey can help you test better and faster and score by finding great bugs.

Transcript of STARCANADA 2013 Keynote: Testing Lessons from Hockey (The World’s Greatest Sport)

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 1

Testing Lessons from

Hockey

(The World's Greatest

Sport)Robert Sabourin

President & Principal consultant

AmiBug.Com, Inc.

Montreal, Canada

[email protected]

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 2

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 3

Testing Lessons from Hockey

• Overview– Learning, Metaphors– The Players– The Coaches– The Fans– The Score Board– The Standings– The Big Picture

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 4

Welcome to Toronto

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 5

1967 Stanley Cup

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 6

Learning and Metaphors

• Teaching

• Learning

• Retaining

• Applying knowledge

• Share experiences

• Don’t get carried away …

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 7

The Players

• Hockey cards

• Name & Position

• Achievements– History & highlights– Statistics & context

• Gum

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 8

Forward Games Played

Goals

Assists

Points

Penalty Minutes

Some History Junior

Professional

International

Averages

Highs and Lows

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 9

Goalie Games Played

Wins

Losses

Ties

Minutes Played

Goals Against

Shut Outs

Goals Against Average

Save %

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 10

Testing Bugs

Bugs by type

Show stoppers

Bug isolation %

Estimate/Actual

Development Defect Density

Function points

K-LOCs

Dev/Rework

Estimate/Actual

History Agility – Context

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 11

Testing Cards

AMIBUG WINGS

AMIBUG WINGS

Collard

AMIBUG WINGS

AMIBUG WINGS

Bolton

AMIBUG WINGS

AMIBUG WINGS

Copeland

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 12

Paraphernalia

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 13

The PlayersHockey Roles Testing Roles

Center Test Analyst

Wing Scripted Tester

Defense Man Test Automation

Goalie Explorer

Captain Subject Matter

Penalty Killer Security tester

Goon Load tester

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 14

The PlayersHall of Fame

Meyers

Beizer

Collard

Gelperin

AMIBUG WINGS

AMIBUG WINGS

AMIBUG WINGS

AMIBUG WINGS

AmiBug.Com, Inc.

Learning how to play hockey?

© Robert Sabourin, 2013Apr 10, 2023 Slide 15

Watching others might help explain some of the rules

AmiBug.Com, Inc.

Learning how to play hockey?

© Robert Sabourin, 2013Apr 10, 2023 Slide 16

Years of dedication and perseverance by hockey Moms and hockey Dads

AmiBug.Com, Inc.

Learning how to play hockey?

© Robert Sabourin, 2013Apr 10, 2023 Slide 17

Hone your craft …• Practise• Practise• And then• Practise

some more …

AmiBug.Com, Inc.

The Play by Play

© Robert Sabourin, 2013Apr 10, 2023 Slide 18

He ShootsHe Scores!

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 19

The Coaches

• Team building– Hiring winners– Player Development– Junior Leagues, Training

• Management– Strategy, Tactics, Implementation– Progress and status

• Feedback– Encouragement– Redirect

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 20

The Coaches

• Direct the play play– Line changes– Defend players– Argue with refs– Motivate– Drill– Pull the goalie– Bridge to stakeholders

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 21

The Test Lead

• Team building– Hiring winners– Tester Development– Training

• Management– Strategy, Tactics, Implementation– Progress and status

• Feedback– Breakfast of champions

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 22

The Fans

• Hockey Fans– Watch games– Buy the tickets– Eat the food– Exhibit loyalty– Provide feedback– Important stakeholders

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 23

The Hockey Fan

• Feedback– Anxiety– Excitement– Stress

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 24

The Hockey Fan

• Feedback– Applaud Progress– Cheer success– Boo the other team

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 25

Raving Fans of Testers

• Developers• Database Admin• Managers

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 26

Raving Fans of Testers

• Customers• End Users• Business Stakeholders

AmiBug.Com, Inc.

Keep it clean

© Robert Sabourin, 2013Apr 10, 2023 Slide 27

Know the rulesMake the rulesBreak the rules

Respect stakeholders

Play well with others

AmiBug.Com, Inc.

Keep it clean

© Robert Sabourin, 2013Apr 10, 2023 Slide 28

Checking?

AmiBug.Com, Inc.

Keep it clean

© Robert Sabourin, 2013Apr 10, 2023 Slide 29

Testing?

AmiBug.Com, Inc.

Keep it clean

© Robert Sabourin, 2013Apr 10, 2023 Slide 30

Learning?

AmiBug.Com, Inc.

Keep it clean

© Robert Sabourin, 2013Apr 10, 2023 Slide 31

Controlled environment

Clean surface

Prepared

Ready to play

AmiBug.Com, Inc.

The Right Gear

© Robert Sabourin, 2013Apr 10, 2023 Slide 32

HelmetMaskGlovesPadsSkatesStickOther stuff

AmiBug.Com, Inc.

Getting Started

© Robert Sabourin, 2013Apr 10, 2023 Slide 33

Face offAll readyGet controlUnderstand what you are up againstGo for it

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 34

Hockey Score Board

• Visible to all– Score– Period– Time– Key incidents– Penalty time– Ads– Out of town scores– Excitement

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 35

Testing Score Board

• Generally– Time– Bugs

– Priority, Severity

• Regress– Confidence– Pass Fail

• Exploratory– Opportunities– On charter time %

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 36

UrgentSevere

UrgentNot Severe

Not UrgentSevere

Not UrgentNot Severe

Bug Sweet Spot

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 37

Testing Scoreboard

• Progress in the Project– When in project? Phase– Bugs counts by severity, priority– Objectives identified, elaborated– Exploratory Test charters identified– Tests run, passed, failed, blocked– Test Project Statistics– Testing effort done, effort to go– Running totals (of all counts)

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 38

Testing Scoreboard

• Feedback– Big, Visible, Obvious– Focus of attention– Great place for Ads!

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 39

Testing Scoreboard

0

50

100

150

200

250

01/1

1/9

8

01/1

8/9

8

01/2

5/9

8

02/0

1/9

8

02/0

8/9

8

02/1

5/9

8

02/2

2/9

8

03/0

1/9

8

03/0

8/9

8

03/1

5/9

8

03/2

2/9

8

03/2

9/9

8

04/0

5/9

8

04/1

2/9

8

04/1

9/9

8

04/2

6/9

8

05/0

3/9

8

05/1

0/9

8

05/1

7/9

8

05/2

4/9

8

05/3

1/9

8

06/0

7/9

8

06/1

4/9

8

06/2

1/9

8

06/2

8/9

8

07/0

5/9

8

07/1

2/9

8

07/1

9/9

8

07/2

6/9

8

08/0

2/9

8

08/0

9/9

8

08/1

6/9

8

08/2

3/9

8

08/3

0/9

8

09/0

6/9

8

09/1

3/9

8

09/2

0/9

8

09/2

7/9

8

10/0

4/9

8

10/1

1/9

8

10/1

8/9

8

10/2

5/9

8

11/0

1/9

8

11/0

8/9

8

11/1

5/9

8

11/2

2/9

8

11/2

9/9

8

12/0

6/9

8

12/1

3/9

8

01/1

4/9

9

01/1

8/9

9

01/2

5/9

9

02/0

1/9

9

02/0

8/9

9

Open P1 & P2 Bugs Bugs Pending validation (Corrigé)

Trend ChartOpen Bugs

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 40

Hockey Standings

• How is the team doing?– Games played– Games at hand– Total Wins– Total Loses– Relative placement– Division standing– League standing– Attendance– Profit

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 41

Testing Project Standings

• How is the project doing?– Progress toward goals

– On Time – Quality – Budget– Comparing all projects

– To go / Done effort– Estimation accuracy

– Work breakdown– Effort distributions

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 42

Testing Project Standings

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 43

Hockey Big Picture

• Is the franchise healthy?– Revenues– Expenses– Profit– Loss– Contracts– Media– Civic responsibility– Capital

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 44

Hockey Big Picture

• How is the franchise doing?– Value– External factors– Supply– Demand– Opportunity– Image– Brand– Revenue

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 45

Testing Big Picture

• Is the company healthy?– Revenues– Expenses– Profit– Loss– Contracts– Media– Civic responsibility– Capital

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 46

The Big Picture

• How is testing adding value to the organization?

– More sales revenue– Fewer support calls– Lower development cost– Competitive time to market– Best of breed technology– Accountable and auditable!– Attracts top talent, Fun team– All know how testing ties to corporate values

AmiBug.Com, Inc.

© Robert Sabourin, 2013Apr 10, 2023 Slide 47

Thank You

Questions?