Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion...
Transcript of Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion...
![Page 1: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/1.jpg)
Agile, Testing, and Quality: Looking Back, Moving Forward
Elisabeth Hendrickson
Quality Tree Software, Inc.
www.qualitytree.com
Last updated October 28, 2009Copyright © 2009 Quality Tree Software, Inc.
This work is licensed under the Creative Commons Attribution 3.0 United States License. View a copy of this license.
![Page 2: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/2.jpg)
Presented at PNSQC 2004Elisabeth HendricksonQuality Tree Software, Inc.www.qualitytree.com
![Page 3: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/3.jpg)
New (or New-ish) in 2004
Agile Fusion (2003)
Watir released (2004)
Martin Fowler posts “Mocks Aren’t Stubs” (2004)
Ken Schwaber, Agile Project Management with Scrum (2004)
Agile-Testing Yahoo! Group Started (2001)
![Page 4: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/4.jpg)
2005
The Agile Development Conference and XP/Agile Universe Merged into the Agile20XX Conference series.
Rick Mugridge and Ward Cunningham, Fit for Developing Software.
First Agile Open Conference (Belgium)
![Page 5: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/5.jpg)
2006
Dan North's article introducing BDD published in Better Software Magazine.
Selenium & Selenium RC Released.
Green Pepper Released.
Jonathan Kohl posts “Post-Agilism.”
RSpec Released.
![Page 6: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/6.jpg)
2007
First Agile Open Northwest & Agile Open CA Conferences
Lasse Koskela Test Driven
Jim Shore and Shane Warden, Art of Agile
TD-DT Summit
Concordion Released
Agile Alliance Functional Testing Tools program founded, first meeting
Kanban takes root
![Page 7: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/7.jpg)
2008
Cucumber released
Robot Framework open sourced
Slim update to Fitnesse
UX Community descends on Agile2008 conference. Alan
�Cooper keynotes.
Twist released (early access)
![Page 8: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/8.jpg)
2009
Gojko Adzic, Bridging the Communication Gap
David Chelimsky, Dave Astels, et al The RSpec Book
Adam Goucher and Tim Riley, Beautiful Testing
Software Craftsmanship Conference
Lisa Crispin and Janet Gregory, Agile Testing
Brian Marick starts the Artisanal Retro-Futurism crossed with Team-Scale Anarcho-Syndicalism (ARxTA) Movement
Agile Skills Project Launched
![Page 9: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/9.jpg)
Evidence of Widespread Adoption
Methods and Tools Surveyhttp://www.methodsandtools.com/dynpoll/oldpoll.php?Agile2
In 2005, 55% reported investigating, piloting, implementing/deployed Agile
In 2008 that number was up to 70%
2008 Dr. Dobbs Agile Adoption Surveyhttp://www.ambysoft.com/surveys/agileFebruary2008.html
“69% of respondents indicated that their organizations are doing one or more agile projects”
![Page 10: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/10.jpg)
Agile is Mainstream
Source: Geoffrey Moore, Crossing the Chasm
Innovators
EarlyAdopters
Chasm
EarlyMajority
LateMajority
Laggards
Time
AgileAdoption
![Page 11: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/11.jpg)
And That Means… ?
![Page 12: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/12.jpg)
Well, er, no…
We can’t do a full regression within the
Sprint!
And we have too many more
stories to do.
That’s because it’s a legacy
system with no automation.
Because the business insists they all have to be delivered this
sprint.
![Page 13: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/13.jpg)
Agile Diluted
frAgile
ScrumBut
Scrummerfall
![Page 14: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/14.jpg)
Eight Key Testing Practices in Agile
ATDD TDD Exploratory Testing
Collective Test
Ownership
Automated Unit Tests
Automated System Tests
Continuous Integration
RehearseDelivery
![Page 15: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/15.jpg)
Acceptance-Test Driven Development (ATDD)
![Page 16: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/16.jpg)
Automated System-Level Regression Tests
• Are business-facing, written by various members of the team in collaboration
• Express expectations about externally verifiable behavior
• Represent executable requirements
![Page 17: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/17.jpg)
Test Driven Development (TDD)
![Page 18: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/18.jpg)
Automated Unit Tests
• Are code-facing, written by programmers to support the coding effort
• Express expectations of the internal behavior of the code
• Isolate element(s) under test
• Execute quickly and often
![Page 19: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/19.jpg)
Exploratory Testing
Simultaneously…
…learning about the software
…designing tests
…executing tests
using feedback from the last
test to inform the next
(See Jon and James Bach’s work on Session-Based ET)
![Page 20: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/20.jpg)
Collective Test Ownership
![Page 21: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/21.jpg)
Continuous Integration (CI)
CI tools do automated builds, execute tests, and report the results
Developers practicing CI merge their changes locally & execute tests before checking in
![Page 22: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/22.jpg)
Rehearse Delivery
Until we ship or deploy,we don’t know what
impediments we’ll runinto on release.
![Page 23: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/23.jpg)
Consider Certainty v. Time
Within a Release
Within a Sprint
![Page 24: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/24.jpg)
What Does Agile Really Mean?
Agile software teams…
…Deliver value in the form of releasable software at frequent regular intervals (at least monthly)…
…At a sustainable pace…
…While adapting to the changing needs of the business.
![Page 25: Agile, Testing, and Quality: Looking Back, Moving ForwardNew (or New-ish) in 2004 Agile Fusion (2003) Watir released (2004) Martin Fowler posts “Mocks Aren’t Stubs” (2004) Ken](https://reader033.fdocuments.in/reader033/viewer/2022060405/5f0f174f7e708231d442720c/html5/thumbnails/25.jpg)
And the Future?
Practices…
Methods…
Communities…
Tools…