Software Testing How has agile changed the game? Karen Greaves.

18
Software Testing How has agile changed the game? Karen Greaves

Transcript of Software Testing How has agile changed the game? Karen Greaves.

Page 1: Software Testing How has agile changed the game? Karen Greaves.

Software Testing

How has agile changed

the game?

Karen Greaves

Page 2: Software Testing How has agile changed the game? Karen Greaves.

Why?

Page 3: Software Testing How has agile changed the game? Karen Greaves.

• Building the system right

• Compare against a specificationValidation

• Building the right system

• Compare against customer needsVerification

Page 4: Software Testing How has agile changed the game? Karen Greaves.

Cost of fixing a defect

Page 5: Software Testing How has agile changed the game? Karen Greaves.

Test Early

Page 6: Software Testing How has agile changed the game? Karen Greaves.

HOWTO: Test Early

Testers involved in Sprint PlanningTesters work from day 1 of the sprintDone includes testing & fixingDon’t let developers get aheadTeam signs off each story

Page 7: Software Testing How has agile changed the game? Karen Greaves.

Cost vs Benefit of Automation

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 250

50

100

150

200

250

300

Automated Testing

Manual Testing

Number of Test Executions

Rela

tive C

ost

Page 8: Software Testing How has agile changed the game? Karen Greaves.

Automate

Page 9: Software Testing How has agile changed the game? Karen Greaves.

HOWTO: AutomationMake automation part of every storyEveryone runs automated testsQuick to run & interpretFlexible to runDon’t automate once off testsAutomate things you do everydayAutomate sanity tests

Page 10: Software Testing How has agile changed the game? Karen Greaves.

Defect Yield

High YieldAverage YieldLow Yield

Time Testing

Defe

cts

Fou

nd

Page 11: Software Testing How has agile changed the game? Karen Greaves.

Test Smarter

Page 12: Software Testing How has agile changed the game? Karen Greaves.

HOWTO: Test Smarter

White or grey box testingUnderstand where bugs could existTrust developersStatic testingUse fundamental techniques

Page 13: Software Testing How has agile changed the game? Karen Greaves.

Test Fundamentals

Pair wise / All pairs testingEquivalence partitioningBoundary case analysisDependency maps for regressionSeparate functional testing from load testing

Page 14: Software Testing How has agile changed the game? Karen Greaves.

TrackingWhen should you log a bug?How many defects states?Priority and severity?The importance of classifying bugsClean out your defect system regularly

Page 15: Software Testing How has agile changed the game? Karen Greaves.

Test Reporting

System status at a glance Test depthDefect trends

Working software over comprehensive documentation

Page 16: Software Testing How has agile changed the game? Karen Greaves.

Technical stuff you need to know

Version ControlBuild ProcessInstallers and UpgradesEnvironments

Page 17: Software Testing How has agile changed the game? Karen Greaves.

Implications of agile

Build the right systemTest EarlyAutomate TestingTest SmarterQuality is everyone’s concern

Page 18: Software Testing How has agile changed the game? Karen Greaves.