Test improvement for Agile/Scrum
Transcript of Test improvement for Agile/Scrum
logo van Flair 17-12-2010
Polteq logo_RGB.png
Test Improvement for Agile
Jeroen Mengerink [email protected]
&
Edze Knol [email protected]
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
2
Agenda
• Agile
• Scrum
• Test improvement roadmap
• Assessment model
• Key areas
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
3
What is Agile?
agile /’æd3aIl; NAmE ’æd3l/ adj.
1 able to move quickly and easily SYN nimble: a strong and agile athlete 2 able to think quickly and in an intelligent way: an agile mind / brain
(source: Oxford Advanced Learner’s dictionary)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
4
Agile Manifesto
• Individuals and interactions over processes and tools
• Working software over comprehensive documentation
• Customer collaboration over contract negotiation
• Responding to change over following a plan
That is, while there is value in the items on the right,
we value the items on the left more.
(source: http://www.agilemanifesto.org/)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
5
Agenda
• Agile
• Scrum
• Test improvement roadmap
• Assessment model
• Key areas
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
6
Scrum
Goals:
• Raise the effectiveness of the team
• Guard the progress of the team
• Solve impediments
• Guard the project progress
• Minimizing of project risks
Scrum is an iterative and incremental method for managing software
projects and product or application development
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
7
Scrum
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
8
Agile/Scrum
Agile
• Set of basic ideas
• Little overhead
• Focussed on people
Scrum
• Process management
• Short iterations
• Multidisciplinairy teams
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
9
Agenda
• Agile
• Scrum
• Test improvement roadmap
• Assessment model
• Key areas
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
10
Test Improvement Roadmap
Awareness & Commitment & Buy-in
Goal, scope and approach
Assessment
Implement improvement
actions Plan
Define improvement
actions Evaluation
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
11
Assessment
“If you don’t know where you are, a map won’t help.” (Watts Humphrey)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
12
Improvement suggestions
• Improvement suggestions describe “How to improve”
– From testing perspective
– From Agile perspective
– For each key area
• Provide related information
• Based on practice and current setting
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
13
Agile Scrum Structured
Evolution of testing
Pioneering
Structured
Agile
Time
Str
uctu
red
N
ot
str
uctu
red
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
14
Agenda
• Agile
• Scrum
• Test improvement roadmap
• Assessment model
• Key areas
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
15
Assessment model
Key Area Structured Scrum Agile
Stakeholder commitment
Planning & Estimation
People
Interaction
Teamwork
Test process
Test management
Test profession
Test automation
Regression & E2E testing
Defect management
Test environment
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
16
Assessment model
• First level is not just initial like in other models
• Each key area has a number of checkpoints
• Checkpoints are continuous
– Next maturity level builds on previous level
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
17
Agenda
• Agile
• Scrum
• Test improvement roadmap
• Assessment model
• Key areas
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
18
Teamwork
expertise
verbreding
T
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
19
Teamwork
expertise
verbreding
T
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
20
Traditional teams A
nal
ysis
an
d d
esig
n
• Business analyst 1
• Business analyst 2
• Business analyst 3
• Business analyst 4
Dev
elo
pm
ent • Developer 1
• Developer 2
• Developer 3
• Developer 4
Test
ing • Tester 1
• Tester 2
• Tester 3
• Tester 4
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
21
Agile teams A
nal
ysis
an
d d
esig
n
• Business analyst 1
• Business analyst 2
• Business analyst 3
• Business analyst 4
Dev
elo
pm
ent • Developer 1
• Developer 2
• Developer 3
• Developer 4
Test
ing • Tester 1
• Tester 2
• Tester 3
• Tester 4
Team 1
Team 2
Team 3
Team 4
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
22
Teamwork
Divided by specialisation
Structured
Multi- disciplinairy
Working together
Scrum
Agile
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
23
Structured Scrum
Agile
Teamwork
QA = Test QA = Team
QA = Whole team effort
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
24
Teamwork
• Respect and trust each other
• Commitment as a team
– Work towards a team goal
• Help each other where possible
• Evaluate and improve often
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
25
Test management
What to manage?
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
26
Structured Scrum
Agile
Test management
Rigid management by the test manager
Some level of direction
Test manager?
Self-managing teams &
Agile test manager
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
27
Structured Scrum
Agile
Test management
Project view Sprint view Multilevel view
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
28
Test management
• People management
– Provide people for the teams
– Coach and train the people
• Agile and the used method (mostly Scrum)
• Testing
– Facilitate knowledge sharing
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
29
Test management
• People management
– Provide people for the teams
– Coach and train the people
• Agile and the used method (mostly Scrum)
• Testing
– Facilitate knowledge sharing
• Generic test approach / strategy
• Release planning
• Keep the big picture (helicopter view)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
30
Generic test approach / strategy
• Training and coaching
• Defect management
• Risk analysis
• Non-functionals
• E2E testing
• Tooling and automation
• Environment management
• Metrics and reporting
• …
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
31
Generic test approach / strategy
Generic test approach / strategy
Risks Maturity
Skills Product
Size Time
Culture
Bandw
idth
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
32
Defect management
“Defect tracking is a form of waste … ”
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
33
Structured Scrum
Agile
Defect management
Log to communicate
Less logging, more
face-to-face
communi-cation
Log when needed
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
34
Defect management
• Factors that influence whether a defect is recorded and if so, the amount of information that needs to be recorded:
– Co-location
– Maturity of team
– Number of defects
– Organisational influence
– Drive for metrics
– Size of development
– Complexity of development
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
35
Example assessment result
Key Area Structured Scrum Agile
Stakeholder commitment
Planning & Estimation
People
Interaction
Teamwork
Test process
Test management
Test profession
Test automation
Regression & E2E testing
Defect management
Test environment
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
36
Questions
Key Area Structured Scrum Agile
Stakeholder commitment
Planning & Estimation
People
Interaction
Teamwork
Test process
Test management
Test profession
Test automation
Regression & E2E testing
Defect management
Test environment