Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile...

55
Agile testing with Test Condition Workshops Ian Ross - [email protected]

Transcript of Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile...

Page 1: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Agile testing with

Test Condition Workshops

Ian Ross - [email protected]

Page 2: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Ambush testing

Page 3: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

“ Not my problem - the holes in the other side

of the boat! ”

Page 4: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Ten years ago this yearFeb 11-13 2001 at the Snowbird lodge in the Wasatch mountains

Page 5: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items
Page 6: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Technical Social

Drivers of approaches

Page 7: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Technology Driven

RedGreenRe-factor

Page 8: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

People Driven

Page 9: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

People DrivenIdeas

Page 10: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

People DrivenBDD, ATDD, Fitnesse

Page 11: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

People Driven

Page 12: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Integrating Approaches

Page 13: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Quadrant model Business Facing

Tech Facing

Supporting the team

Critique the product

Automated

Automated &

ManualManual

Tools

Unit Tests

FunctionalTests

Exploratory & Usability

Tests

Security & Performance

“Agile Testing” – Lisa Crispin and Janet Gregory

Page 14: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

What should be tested?

Testing performedRequired testing

Risk WasteEffective testing

Page 15: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

What should be tested?

Testing performedRequired testing

Risk WasteEffective testing

Page 16: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

What should be tested?

Testing performedRequired testing

Risk WasteEffective testing

Page 17: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

What should be tested?

Testing performedRequired testing

Risk WasteEffective testing

Page 18: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Different views

Bob the BA

Page 19: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Different views

Dave the dev

Page 20: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Different views

Paul & Pete the testers

Page 21: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Different views

Page 22: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Different views

Page 23: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Different views

Page 24: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Different views

Page 25: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Agile makes some things harder

Page 26: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

= Fuzzy requirements

Less defined Requirements ...

Page 27: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

= Fuzzy requirements

Less defined Requirements ...

Page 28: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

But tests must be objective

Tests

Page 29: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

So they can provide...

Tests Actionable Insight

Page 30: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Big gap between

TestsFuzzy requirements

Page 31: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Test Conditions

TestsFuzzy requirements

Test Conditions

Page 32: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Test Conditions

TestsFuzzy requirements

Test ConditionsWorkshop

Page 33: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

TestsFuzzy requirements Test Conditions

“What” “How”

Workshop

“Who”

Actionable Insight

Page 34: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Test Conditions

TestsFuzzy requirements

Page 35: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Questions

TestsFuzzy requirements

Page 36: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Assumptions

TestsFuzzy requirements

Page 37: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

TestsFuzzy requirements

T/C’s Given-When-Then

Page 38: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

TestsFuzzy requirements

T/C’s Given-When-Then

Given - Some preconditions

When - the Trigger event occurs

Then - the expected outcome

Page 39: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

TestsFuzzy requirements

On the same page

Page 40: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

TestsFuzzy requirements Test Conditions

“What” “How”

Workshop

“Who”

Actionable Insight

Page 41: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

TestsFuzzy requirements Test Conditions

“What” “How”

Workshop

“Who”

Actionable Insight

Page 42: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

TestsFuzzy requirements Test Conditions

“What” “How”

Workshop

“Who”

Actionable Insight

Cheap Costly

Page 43: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

TestsFuzzy requirements Test Conditions

“What” “How”

Workshop

“Who”

Actionable Insight

Whiteboard Typed into Excel Later teams move to using a DB

Data Base

Page 44: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Whiteboard Typed into Excel Later teams move to using a DB

Data Base

Page 45: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

?

A

Given When ThenThere are no items in

the shopping cartCustomer clicks

“Purchase” button for a book which is in

stock

1x Book is add to shopping cart. Book is held - prevent selling

it twice.

“Customer clicks

“Purchase” button for a book which is in

stock

Dialog with “out of stock” message and offering customer

option of putting book on back order.

Expire ‘held’ books after 20

minutes

Do we need to test card/DB

interface with the ‘Sticky

session’ load balancing ?

Page 46: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

ID

Page 47: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Indexes

Page 48: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

<Tag />

<Tag /><Tag />

Indexes

Page 49: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

G-W-T

Page 50: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

Link to Tests

Page 51: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

TestsFuzzy requirements Test Conditions

Workshop

Whiteboard Typed into Excel Later teams move to using a DB

Data Base

Page 52: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

TestsFuzzy requirements Test Conditions

“What” “How”

Workshop

“Who”

Actionable Insight

Business

Tech

Supporting Critique the

Automa

Auto& Man

Tool

Unit Tests

FunctionalTests

Exploratory & Usability

Tests

Security & Performance

Page 53: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

TestsFuzzy requirements Test Conditions

“What” “How”

Workshop

“Who”

Actionable Insight

Page 54: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

TestsFuzzy requirements Actionable Insight

Questions?

Page 55: Agile testing with Test Condition Workshops - ANZTB Ross - Agile Testing and Test... · “Agile Testing” – Lisa Crispin and Janet Gregory. ... Given When Then There are no items

TestsFuzzy requirements Actionable Insight

Thank you!