The Changing Face of Test Management in an Agile World

42
The Changing Face of Test Management A reflection on test management, past, present and future Ben Williams & Tom Roden #StarEast

Transcript of The Changing Face of Test Management in an Agile World

Page 1: The Changing Face of Test Management in an Agile World

The Changing Face of Test Management

A reflection on test management, past, present and future

Ben Williams & Tom Roden  #StarEast

Page 2: The Changing Face of Test Management in an Agile World

About Us

Ben Williams – Agile Coach @13enWilliams

Tom Roden – Agile Coach & Test <something> @TommRoden

Page 3: The Changing Face of Test Management in an Agile World

“As agile methods continue to replace traditional, the role of test manager will cease to exist.

Test managers will cover a different role, with a broader scope, utilising a different skillset.

Teams will assume more accountability for test activities, above and beyond what they may have done in the past”

Our Hypothesis

Page 4: The Changing Face of Test Management in an Agile World

Test manager is not the same as

Test management

Page 5: The Changing Face of Test Management in an Agile World

Test management of the past (parody)

Page 6: The Changing Face of Test Management in an Agile World

Analysis

Blue sky, thought showering ideation

Development

Implement

All conceivable testing

Utterly  Immovable  Live Date

All conceivable testing, hey maybe even unit testing ☺

Test Planning

Page 7: The Changing Face of Test Management in an Agile World

1. Random dev-test ratio estimation

2. The narrow-band faux-Delphi

3. The project manager Pareto

Test Estimation Techniques

Page 8: The Changing Face of Test Management in an Agile World

Exploratory testing =

Smoke testing =

Stress testing =

Penetration testing =

We say… They hear…

Page 9: The Changing Face of Test Management in an Agile World

Step 1. Remove brain

Step 2. Login to Quality Centre

Step 3. Follow 67 more steps of set-up and screen navigation, but don’t look at how the application is behaving

Step 4. Test fails for reason unrelated to test step

Step 5. Step 4 does not compute with script, loop thru step 4 until sickness or darkness descends

If the test didn’t find the defect, does the defect really exist?

Stay On Target

Page 10: The Changing Face of Test Management in an Agile World

Test Management of the Present (at a junction?)

Page 11: The Changing Face of Test Management in an Agile World

Our underlying assumptions

Page 12: The Changing Face of Test Management in an Agile World

Agile is still on the increase

Computer  Weekly  Jobs,  8th  November  2012

Page 13: The Changing Face of Test Management in an Agile World

There is no prescribed Test Manager role in Agile methods

Page 14: The Changing Face of Test Management in an Agile World

What does this mean?

Page 15: The Changing Face of Test Management in an Agile World

What are the choices for traditional test managers?

Page 16: The Changing Face of Test Management in an Agile World

Stay in the market for traditional Test Management?

http://rontalk.com/

Page 17: The Changing Face of Test Management in an Agile World

Get into another profession entirely?

http://byrev.org/

Page 18: The Changing Face of Test Management in an Agile World

Make the voyage into Agile?

Page 19: The Changing Face of Test Management in an Agile World

Any other options

?

Page 20: The Changing Face of Test Management in an Agile World

Exploring the move to Agile…

What roles are there in Agile?Feature Team

Member  

Product Owner   Scrum Master  

Coach?   Project Manager?  

Test Manager?  

Development Manager?  

?

Page 21: The Changing Face of Test Management in an Agile World

We did a survey…

Page 22: The Changing Face of Test Management in an Agile World

Has the role changed?• 90% have experienced a change in responsibilities

How many have experienced a change?

lots  of  peoplealmost  no-­‐one

Page 23: The Changing Face of Test Management in an Agile World

People reported an increase in…– Coaching practices & techniques – Mentoring – Stakeholder Management – Cross team knowledge

Page 24: The Changing Face of Test Management in an Agile World

People reported a decrease in…– Planning – Reporting – Test Strategies – Project admin – Project and Programme Management – Reviewing Documentation

Page 25: The Changing Face of Test Management in an Agile World

People reported no change in…– Budgeting & Staffing

– Training

– Governance & project assurance

– Reviewing tests

– Unblocking

– Metrics & instrumentation

Page 26: The Changing Face of Test Management in an Agile World

Test Management of the Future

Page 27: The Changing Face of Test Management in an Agile World

“As agile methods continue to replace traditional, the role of test manager will cease to exist.

Test managers will cover a different role, with a broader scope, utilising a different skillset.

Teams will assume more accountability for test activities, above and beyond what they may have done in the past”

Our Hypothesis

Page 28: The Changing Face of Test Management in an Agile World

It Makes an interesting workshop

Page 29: The Changing Face of Test Management in an Agile World

Inside the team or

Outside the team

Page 30: The Changing Face of Test Management in an Agile World

Defect management?

Inside the team Outside the team

Page 31: The Changing Face of Test Management in an Agile World

Test Automation?

Inside the team Outside the team

Page 32: The Changing Face of Test Management in an Agile World
Page 33: The Changing Face of Test Management in an Agile World

Test Tool Selection?

Inside the team Outside the team

Page 34: The Changing Face of Test Management in an Agile World

Principles & Strategy?

Inside the team Outside the team

Page 35: The Changing Face of Test Management in an Agile World

Principles of Testing

Source – Tom Roden & Paul Wilford 2013, SQS

Page 36: The Changing Face of Test Management in an Agile World

Building self-regulation

Page 37: The Changing Face of Test Management in an Agile World

Other areas to consider…• Remove testing obstacles

• Stimulate improvement in Testing

• Foster a collective quality conscience

• Converge and disperse knowledge

• Help make Testing visible

• Instrument the hell out of stuff

• Get in there and test, pair, run spec workshops

• Mentoring, coaching and extended learning

• Talent acquisition and skills liquidity

Page 38: The Changing Face of Test Management in an Agile World

In order that you ensure quality As a team member I want you to be responsible for a lot more

Page 39: The Changing Face of Test Management in an Agile World

There should be no-one with the job title

Test Manager in Agile Organisations!!!

Page 40: The Changing Face of Test Management in an Agile World

This isn’t Management

Page 41: The Changing Face of Test Management in an Agile World

Test “Managers”, the point is…

Stop Managing Start enabling!!!

Page 42: The Changing Face of Test Management in an Agile World

What do YOU do?

Ben Williams – [email protected] @13enWilliams

Tom Roden – [email protected] @TommRoden