Agile Testing in the Real World - RBCS,...

Agile Testing in the Real WorldMoving Beyond Theory to Achieve Practicality

[NEED PICTURE HERE]

Agile Testing in the Real WorldThere are lots of books, articles, and webinars about how great Agile isHowever, those often describe purist approaches that adhere to the Agile ManifestoThis webinar isn’t about that pure world, but rather about what happens when Agile theory meets the real worldIn the real world, companies are coming up with interesting and creative ways to adapt Agile practicesThis creates various opportunities, challenges, risks, and benefits for testing and qualityIn this webinar, we examine those…

Agile Testing in the Real Worldwww.rbcs-us.com

Copyright (c) RBCS 2008-2013

www.rbcs-us.com

http://www.rbcs-us.com/

What Does Agile Look Like?



www.rbcs-us.com


Agile Is the Opposite of What?




Agile Test ToolsGood stuff, mostly free

x-UnitJenkinsCucumberRubySeleniumFitnessePlus various static code analysis (e.g., Crap4J) and code coverage tools…

Not all is goodJira and Rally are not designed by or for testersOften used as bug and test management tools




Agile Test MetricsTests completedRisks addressed (in risk-based testing)Bugs found and fixedSome organizations don’t measure bugs during sprints (loss of visibility)Velocity of sprint (user stories completed)




Agile Testing ChallengesVolume and speed of changeRemaining effective in short iterationsIncreased regression riskInconsistent or inadequate unit testingPoor, changing, and missing test oraclesA shifting test basisMeeting overloadOver-commitment in the sprintsSprint team siloingThe Agile hype cycle and high expectationsFor more, check out my recorded webinar on this topic




Agile Testing OpportunitiesAutomated unit testingStatic code analysisCode coverageContinuous integrationAutomated functional testingRequirements (user story) reviewsTest (acceptance criteria) reviewsReasonable workloadControl of technical debt (via “fix bugs first”)For more, check out my recorded webinar on this topic




Testing in “Agilish” LifecyclesOne RBCS client has a “train” lifecycle

Train never stopsReleases are never delayedSeven week overlapping cycle (three week releases)

Is this Agile? Purist vs. pragmatist




Agile Testing for Systems-of-SystemsSystem testing of each iterationSystem integration testing by separate teamStabilization sprint at the end to fix bugsIs this Agile? Purist vs. pragmatist



Testing for Customized Enterprise Software




Agile on Outsourced ProjectsSome Agile founders (e.g., Alistair Cockburn) say collocation is essentialHowever, many of our clients are doing a lot of outsourced testing and developmentSome of these clients are trying to use AgileSome are succeeding, some are notAn on-site point-of-contact is key to success




Tester Skill Implications of AgileIn the United States, the trend is towards requiring programming skill in testersThis trend seems to be expanding worldwideThis is especially important on Agile projectsNot only is programming skill needed, but test automation skills are also essentialAnother important issue is personality

Extroverts generally like Agile because of the emphasis on talking over analysisIntroverts often find Agile harder to adapt to, and some report feeling “bulldozed” by extroverts




Agile Test Team Organization OptionsFully embedded, testers in each sprint team Fully independent, testers assigned at the end of each iterationMatrixed, testers assigned throughout sprint, but part of independent team Let’s examine each of these options…




Fully Embedded




Fully Independent




Matrixed



Agile and QualityDoes Agile result in greater quality?Jury is still outThe use of proven (long before the Agile Manifesto) best practices is promisingHowever, the tendency not to measure defects during sprints obscures the situationSome report better quality (e.g., Jones), but metrics are limitedSome of the “proof by assertion” in this area is unhelpful to conducting an objective discussion




ConclusionsAgile lifecycles are distinct from sequential lifecycles, in ways that affect testing and qualityA variety of test tools are available for Agile (and non-Agile) teamsMetrics programs may be taking a step backward in Agile projectsAgile lifecycles create testing challenges and opportunitiesThere are many different—and successful—implementations of Agile lifecyclesOpinions differ on whether Agile works on outsourced projects, but many are tryingAgile lifecycles have strong implications for tester skillsCarefully choose organizational options for Agile test teamsAgile’s effect on quality remains unclear, but anecdotal reports are promising






For almost twenty years, RBCS has delivered consulting, outsourcing and training services to clients looking to improve their software and hardware testing and quality. Employing the industry’s most experienced and recognized consultants, RBCS trains and improves test groups, tests products, and provides expert test staff for hundreds of clients worldwide. Ranging from Fortune 20 companies to start-ups, RBCS clients save time and money through improved product development, decreased tech support calls, improved corporate reputation and more. To learn more about RBCS, visit www.rbcs-us.com.Address: RBCS, Inc.

31520 Beck RoadBulverde, TX 78163-3911USA

Phone: +1 (830) 438-4830E-mail: [email protected]: www.rbcs-us.com

To Contact RBCS



mailto:[email protected]

Agile Testing in the Real World - RBCS,...

Documents

Transcript of Agile Testing in the Real World - RBCS,...