Sharing testing with non-testers in an agile team...

40
Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing with non-testers in an agile team Nordic Testing Days 2015 Katrina Clokie @katrina_tester

Transcript of Sharing testing with non-testers in an agile team...

Page 1: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Sharing testing with non-testers in an agile team

Nordic Testing Days 2015

Katrina Clokie @katrina_tester

Page 2: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Sharing testing with non-testers in an agile team

Katrina Clokie @katrina_tester

Introduction Visualising

Strategy

Visual

Modelling

Session Based

Test

Management

Page 3: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Context

• Test consultant embedded in a scrum team for three days a week

• Create cross-skilled resources by training the existing team of

developers, business analysts and subject matter experts in testing

• Specialist financial domain

• Team was University educated

> Economics & Finance

> Mathematics

> Computer Science

Page 4: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

100% Automation

Page 5: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Testing 101 Workshop

Page 6: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Introduction Visualising

Strategy

Visual

Modelling

Session Based

Test

Management

Sharing testing with non-testers in an agile team

Katrina Clokie @katrina_tester

Page 7: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Testing 101 Workshop

Page 8: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

IDEA PRODUCTION

Page 9: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

In our test strategy and we’re doing it

In our test strategy and we’re not doing it

Not in our test strategy, but should be

Page 10: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Disaster

Recovery Unit

Testing

Exploratory

Testing

Component

Testing

Integration

Testing

System

Testing

Automated

Testing

Regression

Testing

Specification

Workshops

SME

Interaction

SpecFlow

Testing

Manual

Testing

Mind Maps

Package

Testing

End-to-End

Testing

Acceptance

Testing

Manual

Testing

Security

Testing

Availability

Operations

Performance

Testing

Usability

Release

Testing

Parallel

Testing

In our test strategy and we’re doing it

In our test strategy and we’re not doing it

Not in our test strategy, but should be Read more: http://tiny.cc/teststrategyretro

Page 11: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Disaster

Recovery Unit

Testing

Exploratory

Testing

Component

Testing

Integration

Testing

System

Testing

Automated

Testing

Regression

Testing

Specification

Workshops

SME

Interaction

SpecFlow

Testing

Manual

Testing

Mind Maps

Package

Testing

End-to-End

Testing

Acceptance

Testing

Manual

Testing

Security

Testing

Availability

Operations

Performance

Testing

Usability

Release

Testing

Parallel

Testing

In our test strategy and we’re doing it

In our test strategy and we’re not doing it

Not in our test strategy, but should be Read more: http://tiny.cc/teststrategyretro

Page 12: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Disaster

Recovery Unit

Testing

Exploratory

Testing

Component

Testing

Integration

Testing

System

Testing

Automated

Testing

Regression

Testing

Specification

Workshops

SME

Interaction

SpecFlow

Testing

Manual

Testing

Mind Maps

Package

Testing

End-to-End

Testing

Acceptance

Testing

Manual

Testing

Security

Testing

Availability

Operations

Performance

Testing

Usability

Release

Testing

Parallel

Testing

In our test strategy and we’re doing it

In our test strategy and we’re not doing it

Not in our test strategy, but should be Read more: http://tiny.cc/teststrategyretro

Page 13: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Disaster

Recovery Unit

Testing

Exploratory

Testing

Component

Testing

Integration

Testing

System

Testing

Automated

Testing

Regression

Testing

Specification

Workshops

SME

Interaction

SpecFlow

Testing

Manual

Testing

Mind Maps

Package

Testing

End-to-End

Testing

Acceptance

Testing

Manual

Testing

Security

Testing

Availability

Operations

Performance

Testing

Usability

Release

Testing

Parallel

Testing

In our test strategy and we’re doing it

In our test strategy and we’re not doing it

Not in our test strategy, but should be Read more: http://tiny.cc/teststrategyretro

Page 14: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Disaster

Recovery Unit

Testing

Exploratory

Testing

Component

Testing

Integration

Testing

System

Testing

Automated

Testing

Regression

Testing

Specification

Workshops

SME

Interaction

SpecFlow

Testing

Manual

Testing

Mind Maps

Package

Testing

End-to-End

Testing

Acceptance

Testing

Manual

Testing

Security

Testing

Availability

Operations

Performance

Testing

Usability

Release

Testing

Parallel

Testing

In our test strategy and we’re doing it

In our test strategy and we’re not doing it

Not in our test strategy, but should be Read more: http://tiny.cc/teststrategyretro

Page 15: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Page 16: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Page 17: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Page 18: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Starting Together

Page 19: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Introduction Visualising

Strategy

Visual

Modelling

Session Based

Test

Management

Sharing testing with non-testers in an agile team

Katrina Clokie @katrina_tester

Page 20: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Think Talk Act

Page 21: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

What do you think this does?

Page 22: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Does everyone agree that’s all?

Page 23: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

How are you going to test this?

Page 24: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Are you happy that this testing will mean the story is done?

Page 25: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Test Ideas

• That the acceptance criteria are met

• That each function does what it is supposed to do (positive testing)

• The problems that each function could have (negative testing)

• Input data for typical, boundary and invalid cases

• Output data for typical, boundary and invalid cases

• A flow through the system, with functions in different orders

Reference: Bach, James (2013). Heuristic Test Strategy Model

Page 26: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Page 27: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

What should we automate?

• What matters most?

• Are there any problems with high impact?

• Are there any problems with high probability?

Reference: Marick, Brian (1998). When should a test be automated?

Page 28: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Page 29: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

The greatest enemy of knowledge is not ignorance, but the illusion of knowledge

Stephen Hawking

Page 30: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Introduction Visualising

Strategy

Visual

Modelling

Session Based

Test

Management

Sharing testing with non-testers in an agile team

Katrina Clokie @katrina_tester

Page 31: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Manual Testing Tasks

Page 32: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Session Based Test Management

Page 33: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Page 34: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Peer Review

Page 35: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

What happened?

• Multiple manual testing tasks for a story

• Focused investigation with consistent reporting

• Review improved testing by creating competition

• Increased SME confidence in testing by the team

• Reduced duplication

Page 36: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Conclusion

Page 37: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Disaster

Recovery Unit

Testing

Exploratory

Testing

Component

Testing

Integration

Testing

System

Testing

Automated

Testing

Regression

Testing

Specification

Workshops

SME

Interaction

SpecFlow

Testing

Manual

Testing

Mind Maps

Package

Testing

End-to-End

Testing

Acceptance

Testing

Manual

Testing

Security

Testing

Availability

Operations

Performance

Testing

Usability

Release

Testing

Parallel

Testing

In our test strategy and we’re doing it

In our test strategy and we’re not doing it

Not in our test strategy, but should be Read more: http://tiny.cc/teststrategyretro

Page 38: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Page 39: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Session Based Test Management

Page 40: Sharing testing with non-testers in an agile team …nordictestingdays.eu/files/files/katrina_clokie-sharing...Commercial in Confidence | Assurity Consulting Limited 2013 Sharing testing

Commercial in Confidence | Assurity Consulting Limited 2013

Sharing testing with non-testers in an agile team

Nordic Testing Days 2015

Katrina Clokie @katrina_tester