Agile QA 2.0

39
Agile QA 2.0 @aceconf @mattphilip

description

This is the talk that I gave at the 2013 Agile Central Europe Conference in Krakow, Poland, Apr. 15-16.

Transcript of Agile QA 2.0

Page 1: Agile QA 2.0

Agile QA 2.0

@aceconf @mattphilip

Page 2: Agile QA 2.0
Page 3: Agile QA 2.0
Page 4: Agile QA 2.0

Why this talk?

1.  Agile QA 1.0 never made it past “staging”

Page 5: Agile QA 2.0

Why this talk?

1.  Agile QA 1.0 never made it past “staging”

2.  Call-to-action to reinvigorate the state of the practice

Page 6: Agile QA 2.0

Why this talk?

1.  Agile QA 1.0 never made it past “staging”

2.  Call-to-action to reinvigorate the state of the practice

3.  Work together to come up with better ways

Page 7: Agile QA 2.0

So what have

we learned?

-- Barry Boehm (1981)

Page 8: Agile QA 2.0

Eliminate the need for massive

inspection by building quality into the

product in the first place.

-- Edwards Deming (1982)

So what have

we learned?

Page 9: Agile QA 2.0

Handoffs are waste.

-- Mary Poppendieck (2003)

So what have

we learned?

Page 10: Agile QA 2.0

Move testing to the

front of the

development process

-- Agile Testing (2009)

So what have

we learned?

Page 11: Agile QA 2.0

Kanban doesn’t mean a return to

waterfall.

-- David Anderson (paraphrase, 2013)

So what have

we learned?

Page 12: Agile QA 2.0

So of course what do our card walls look like?

Page 13: Agile QA 2.0
Page 14: Agile QA 2.0
Page 15: Agile QA 2.0
Page 16: Agile QA 2.0
Page 17: Agile QA 2.0
Page 18: Agile QA 2.0
Page 19: Agile QA 2.0

How did this happen?

We simply repeat the same process that we've always done

QAs aren’t assertive enough to ask for change

We figure that, if we don’t, the QA won't have anything to do (resource efficiency)

#1

#2

#3

Page 20: Agile QA 2.0

But why is this

a problem?

End-‐of-‐cycle testing (mini waterfalls)

#1 Creates too long a feedback loop #2 Virtually ensures that our testing efforts are

misaligned with value  #3 Reinforces gatekeeper role (oppositional) #4 Creates inefficient test suite

Page 21: Agile QA 2.0

But why is this

a problem?

Limits options to checking through GUI

Creates inefficient test suite

Which leads to this

Page 22: Agile QA 2.0

So how do

we remedy

these problems?

Page 23: Agile QA 2.0
Page 24: Agile QA 2.0

Remedies Bring QA Forward #1 Bring QA forward

* QA and devs collaborate to determine the right places to test

Page 25: Agile QA 2.0

Remedies QA and devs collaborate to determine the right place to test

#1 Bring QA forward

Many here

Some here

A few here

Page 26: Agile QA 2.0

Remedies Bring QA Forward #1 Bring QA forward

* QA and devs collaborate to determine the right places to test

* Specify acceptance tests up-front

(Acceptance-Test-Driven Development)

Page 27: Agile QA 2.0

Remedies Acceptance-‐Test-‐Driven Development

DevelopmentIterations

Development Engine

Write Story and Scenarios

Business Showcase

Story Testing

Story Planning Session

BA / QA Signoff on Dev Box

Daily BA/QA demo

Tester

Dev

BA

TesterDev

Tester BADev

Tester BADev

BABusiness

Tester

Start Here

System Testing

Implement Functionality

BABusiness

Implement Automated Acceptance Tests

Dev

End Development Iteration

Start Development Iteration

#1 Bring QA forward

Page 28: Agile QA 2.0

Remedies Bring QA Forward #1 Bring QA forward

* QA and devs collaborate to determine the right places to test

* Testing efforts are aligned with business

needs and risk * Specify acceptance tests up-front

(Acceptance-Test-Driven Development)

Page 29: Agile QA 2.0

Remedies Re-‐start by mapping your done list to the wall #1 Bring QA forward #2 Map done list to the wall

* Simple value-stream * Lets the team take a conscious role in

defining its wall

Page 30: Agile QA 2.0

Remedies Include QA in Work-‐In-‐Progress Limits #1 Bring QA forward #2 Map done list to the wall #3 Include QA in WIP limits

Expand this… … to

include this

* Encourages whole-team approach

Page 31: Agile QA 2.0

Where do our biggest handoffs occur?

Here?

Here?

Page 32: Agile QA 2.0
Page 33: Agile QA 2.0

Other considerations Quality Advocacy Quality Advocacy * Consultative

* Service provider * Enabling and informing (not gatekeeping) * Big picture-oriented * Polyskilled and skill sharer * Courageous

Page 34: Agile QA 2.0

Other considerations Integrated QA: QA is nowhere – and everywhere

Quality Advocacy Integrated QA

* Remove Test/QA as a separate column altogether * QA provides real-time, zero-cycle-time feedback * Decouples what from who,

decreases bottleneck * Commits devs and testers

toward same goal: working, tested software

Page 35: Agile QA 2.0

So do we have a place for

any kind of end-of-cycle testing?

Page 36: Agile QA 2.0
Page 37: Agile QA 2.0

Other considerations Exploratory Testing as First-‐Class Practice Quality Advocacy Integrated QA Exploratory testing

* Not simply “clickin’ around” but highly-skilled discipline

* Anyone with the right skill, independence can do it * Model it on the wall

Page 38: Agile QA 2.0

So what are you

going to do starting Wednesday?

Page 39: Agile QA 2.0

References

§  Alister Scott, http://watirmelon.com/2013/02/28/the-new-qa-the-quality-advocate/

§  Barry Boehm, Software Engineering Economics

§  Martin Fowler, http://martinfowler.com/bliki/TestPyramid.html

§  InfoQ, http://www.infoq.com/articles/David-Anderson-Kanban

§  Deming Institute, http://deming.org/

[email protected]

@mattphilip