Test improvement for Agile/Scrum

36
Test Improvement for Agile Jeroen Mengerink [email protected] & Edze Knol [email protected]

Transcript of Test improvement for Agile/Scrum

Page 1: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

Test Improvement for Agile

Jeroen Mengerink [email protected]

&

Edze Knol [email protected]

Page 2: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

2

Agenda

• Agile

• Scrum

• Test improvement roadmap

• Assessment model

• Key areas

Page 3: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

3

What is Agile?

agile /’æd3aIl; NAmE ’æd3l/ adj.

1 able to move quickly and easily SYN nimble: a strong and agile athlete 2 able to think quickly and in an intelligent way: an agile mind / brain

(source: Oxford Advanced Learner’s dictionary)

Page 4: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

4

Agile Manifesto

• Individuals and interactions over processes and tools

• Working software over comprehensive documentation

• Customer collaboration over contract negotiation

• Responding to change over following a plan

That is, while there is value in the items on the right,

we value the items on the left more.

(source: http://www.agilemanifesto.org/)

Page 5: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

5

Agenda

• Agile

• Scrum

• Test improvement roadmap

• Assessment model

• Key areas

Page 6: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

6

Scrum

Goals:

• Raise the effectiveness of the team

• Guard the progress of the team

• Solve impediments

• Guard the project progress

• Minimizing of project risks

Scrum is an iterative and incremental method for managing software

projects and product or application development

Page 7: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

7

Scrum

Page 8: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

8

Agile/Scrum

Agile

• Set of basic ideas

• Little overhead

• Focussed on people

Scrum

• Process management

• Short iterations

• Multidisciplinairy teams

Page 9: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

9

Agenda

• Agile

• Scrum

• Test improvement roadmap

• Assessment model

• Key areas

Page 10: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

10

Test Improvement Roadmap

Awareness & Commitment & Buy-in

Goal, scope and approach

Assessment

Implement improvement

actions Plan

Define improvement

actions Evaluation

Page 11: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

11

Assessment

“If you don’t know where you are, a map won’t help.” (Watts Humphrey)

Page 12: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

12

Improvement suggestions

• Improvement suggestions describe “How to improve”

– From testing perspective

– From Agile perspective

– For each key area

• Provide related information

• Based on practice and current setting

Page 13: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

13

Agile Scrum Structured

Evolution of testing

Pioneering

Structured

Agile

Time

Str

uctu

red

N

ot

str

uctu

red

Page 14: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

14

Agenda

• Agile

• Scrum

• Test improvement roadmap

• Assessment model

• Key areas

Page 15: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

15

Assessment model

Key Area Structured Scrum Agile

Stakeholder commitment

Planning & Estimation

People

Interaction

Teamwork

Test process

Test management

Test profession

Test automation

Regression & E2E testing

Defect management

Test environment

Page 16: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

16

Assessment model

• First level is not just initial like in other models

• Each key area has a number of checkpoints

• Checkpoints are continuous

– Next maturity level builds on previous level

Page 17: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

17

Agenda

• Agile

• Scrum

• Test improvement roadmap

• Assessment model

• Key areas

Page 18: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

18

Teamwork

expertise

verbreding

T

Page 19: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

19

Teamwork

expertise

verbreding

T

Page 20: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

20

Traditional teams A

nal

ysis

an

d d

esig

n

• Business analyst 1

• Business analyst 2

• Business analyst 3

• Business analyst 4

Dev

elo

pm

ent • Developer 1

• Developer 2

• Developer 3

• Developer 4

Test

ing • Tester 1

• Tester 2

• Tester 3

• Tester 4

Page 21: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

21

Agile teams A

nal

ysis

an

d d

esig

n

• Business analyst 1

• Business analyst 2

• Business analyst 3

• Business analyst 4

Dev

elo

pm

ent • Developer 1

• Developer 2

• Developer 3

• Developer 4

Test

ing • Tester 1

• Tester 2

• Tester 3

• Tester 4

Team 1

Team 2

Team 3

Team 4

Page 22: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

22

Teamwork

Divided by specialisation

Structured

Multi- disciplinairy

Working together

Scrum

Agile

Page 23: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

23

Structured Scrum

Agile

Teamwork

QA = Test QA = Team

QA = Whole team effort

Page 24: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

24

Teamwork

• Respect and trust each other

• Commitment as a team

– Work towards a team goal

• Help each other where possible

• Evaluate and improve often

Page 25: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

25

Test management

What to manage?

Page 26: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

26

Structured Scrum

Agile

Test management

Rigid management by the test manager

Some level of direction

Test manager?

Self-managing teams &

Agile test manager

Page 27: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

27

Structured Scrum

Agile

Test management

Project view Sprint view Multilevel view

Page 28: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

28

Test management

• People management

– Provide people for the teams

– Coach and train the people

• Agile and the used method (mostly Scrum)

• Testing

– Facilitate knowledge sharing

Page 29: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

29

Test management

• People management

– Provide people for the teams

– Coach and train the people

• Agile and the used method (mostly Scrum)

• Testing

– Facilitate knowledge sharing

• Generic test approach / strategy

• Release planning

• Keep the big picture (helicopter view)

Page 30: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

30

Generic test approach / strategy

• Training and coaching

• Defect management

• Risk analysis

• Non-functionals

• E2E testing

• Tooling and automation

• Environment management

• Metrics and reporting

• …

Page 31: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

31

Generic test approach / strategy

Generic test approach / strategy

Risks Maturity

Skills Product

Size Time

Culture

Bandw

idth

Page 32: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

32

Defect management

“Defect tracking is a form of waste … ”

Page 33: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

33

Structured Scrum

Agile

Defect management

Log to communicate

Less logging, more

face-to-face

communi-cation

Log when needed

Page 34: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

34

Defect management

• Factors that influence whether a defect is recorded and if so, the amount of information that needs to be recorded:

– Co-location

– Maturity of team

– Number of defects

– Organisational influence

– Drive for metrics

– Size of development

– Complexity of development

Page 35: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

35

Example assessment result

Key Area Structured Scrum Agile

Stakeholder commitment

Planning & Estimation

People

Interaction

Teamwork

Test process

Test management

Test profession

Test automation

Regression & E2E testing

Defect management

Test environment

Page 36: Test improvement for Agile/Scrum

logo van Flair 17-12-2010

Polteq logo_RGB.png

R G B

35 30 96 Blauw

232 62 38 Rood

108 174 68 Groen

36

Questions

Key Area Structured Scrum Agile

Stakeholder commitment

Planning & Estimation

People

Interaction

Teamwork

Test process

Test management

Test profession

Test automation

Regression & E2E testing

Defect management

Test environment