GIANCARLO BISCEGLIA • SENIOR QA MANAGER • @GIANCARLOBISC

How to Build in Quality from Day 1 using

Lean QA and Agile Testing

MAURIZIO MANCINI • AGILE COACH/AGILE EVANGELIST/QA DIRECTOR • @QAANDPROCESSGUY

• Big cool statistic

• 2,569

• Add-Ons in Marketplace

Not Business as Usual

QA works closely with the Dev Teams to help deliver a quality product to all end users.

James Whittaker

QA is there to enable developers to build better software.

James Whittaker

Test in Quality

PODEV

BAQA

DEVOPS

Build in Quality from the Start!

Quality is Free!

Valuable Features

Is this world possible?

We are…Maurizio Mancini

• Senior QA Manager• 15+ years of software engineering experience

Giancarlo Bisceglia

• Agile Coach, Agile Evangelist, and QA Director• 25+ years of software engineering experience

Head of Product A

Product Owner

Scrum Master

Developers

QA

User Experience

DevOPS

Head of Product B

Product Owner

Scrum Master

Developers

QA

User Experience

DevOPS

Head of Product C

Product Owner

Scrum Master

Developers

QA

User Experience

DevOPS

QAGUILD Lead

LeadLead

What this QA Guild was Testing

Tools We Used

Quality is a Team Sport

Agile Team Structure and Quality Article

http://tinyurl.com/pe79dzj

Lean QA

The core idea is to maximize customer value while minimizing waste. Simply, lean means creating more value for customers with fewer resources.L E A N . O R G

“

”

The 3 M’s of LeanOVERBURDEN

WASTE

UNEVENNESSMUDA

MURIMURA

WASTE

Sources of Waste in Testing

WASTE

Excessive Documentation

Test Everything

Find all the Bugs

Complete Regressions

Automate Everything

End to End Testing

Test Everything

Find all the Bugs

Risk Based Testing

System Risk Assessment5 High

4 Test Scope Items

Test Scope Items

3 Moderate

2 Test Scope Items

1 Low

1 2 3 4 5

Like

lihoo

d

Impact

Trying to Find all the Bugs

Cost of Finding and Fixing a Bug

LIVE

100

10

100

10

Bug 1 - Hard to Find

Bug 2 - Easier to Find

50 50

AfterBefore

Agile Testing

Is It?

Test Early

Test Often

PODEV

BAQA

DEVOPS

Test the Right Stuff

Use Optimal Methods

How we Build in Quality

• Big cool statistic

• 2,569

• Add-Ons in Marketplace

Technical ?

• Big cool statistic

• 2,569

• Add-Ons in Marketplace

Does the scrum master stand alone ?

Process

Big DiffAgile

Incremental & Iterative Development

Let’s be honest

Definition of Done:

Have a plan to tackle test automation

Test Automation:Needs to be planned in a sprint

Manual Regressions:

Make sure everyone agrees

Development

Feature Dev Release MasterNew Feature

Merge Dev Changes

Merge Feature to Dev

Ready for Release

Deploy to Production

Hot Fix

Feature Branching Strategy

Feature Dev Release Master Hot Fix

Deploy to Production

Urgent Bug Fix

Merge Fix to ReleaseMerge Fix to Dev

Hot Fix Branching Strategy

Leverage Continuous Integration

The Team

Testing

No limits

Breakdown the Test Effort Unit and

IntegrationAutomated

Functional TestsManual (UI/UX) Performance BDD UAT

Tests

Owner Developers QA EngineersQA Engineers QA Analysts

Product Owner

QA Engineers Product Owner QA Analysts

Type White Box Black Box Black Box Black Box Black Box

Complexity Focus

Low Level

Correctness Maintainable

Negative tests TDD

Mid Level

Extreme cases Negative tests UI Regression Failure tests

Mid Level

Positive tests SIT

Exploratory

High Level

Scalability Robustness Reliability

High Level

Business Flows BDD/ATDD

Environment CI driven automated deployments

Feature Dev Release Master Hot Fix

Testing We Use by Branch

Manual Exploratory

Performance (Optional)

Manual SIT

UAT

Unit

Automated Functional

Manual Exploratory

UAT UAT

Performance

Unit Unit

Automated Functional

Automated Functional

Automated Functional

Automated Functional

Traceability with Atlassian

Requirements are maintained in Confluence

Traceability starts with requirements in Confluence

and Epics linked in JIRA Software

Traceability Continues with links to User Stories in JIRA Software

All Sub-Tasks Tracked

JIRA Software is the Hub

JIRA Software sprint details

Commit and Code Review Details

Communication Is Key

Notifications are Key

Test Results Directly in JIRA Software Test Case Details Too

Is it possible in your world?

You will never convince people to work towards this goal.

“ ”

That will never happen here, our culture is just not right.“ ”

We just don’t have the time to do it right…“ ”

Would you rather…

Do it right the first time

Hack it and get it out

Or

Work on delivering valuable features to our

customers

Re-work

and fix bugs

Or

Spend precious budget delivering

value to our company

Spend precious budget on rework

Or

Be on a team that is proud to stand behind

their software

Be on a team that is ashamed of their

softwareOr

Key Takeaways

Reduce Waste in Testing…

Continuous Integration is Essential

Test Automation is Essential

Build in Quality rather than

Test it in

PO

BA

QA

Full Traceability with Atlassian and TestRail

Test Results Directly in JIRA Software

Thank you!

GIANCARLO BISCEGLIA • SENIOR QA MANAGER • @GIANCARLOBISC

Agile Team Structure and Quality Article

http://tinyurl.com/pe79dzj

MAURIZIO MANCINI • AGILE COACH/AGILE EVANGELIST/QA DIRECTOR • @QAANDPROCESSGUY

Sourceshttps://notforprintmag.files.wordpress.com/2012/02/imagine2.jpg

https://upload.wikimedia.org/wikipedia/commons/6/6f/100_sculpture.jpg

http://www.flickr.com/photos/36495803@N05/8463683689 - Money

https://upload.wikimedia.org/wikipedia/commons/9/99/Flickr_-_Official_U.S._Navy_Imagery_-_Commander_exchanges_thumbs_up_signals_after_pre-flight_checks..jpg

https://upload.wikimedia.org/wikipedia/commons/2/28/Duct-tape_Moving_Van.jpg

https://farm3.staticflickr.com/2348/2061072441_e3ca379d19_o_d.jpg - Burning Moneyhttps://upload.wikimedia.org/wikipedia/commons/thumb/a/ad/Centreville_High_School_(Virginia)_1998_%C2%B7_DD-SP-99-04111.JPEG/1280px-Centreville_High_School_(Virginia)_1998_%C2%B7_DD-SP-99-04111.JPEG

http://s3.amazonaws.com/media.wbur.org/wordpress/11/files/2014/09/0926_Sydney-Swans-Richmond-624×367.jpg

http://www.cf-promotion.it/img/lomb2.jpg

http://www.debbiemyerscommunications.com/writing.jpg

http://www.sportevai.it/file/2014/12/F1.jpg

http://www.cyclebradford.org.uk/wp-content/uploads/2012/08/breeze-in-the-park.jpg

Sourceshttps://dgraphicstyle.files.wordpress.com/2013/04/el-arte-de-comprender.jpg

http://i.cbc.ca/1.3032607.1429034973!/cpImage/httpImage/image.jpg_gen/derivatives/16×9_620/top-toys-20091116.jpg

http://www.wallpapersis.com/wallpapers/2014/10/ferrari-458-italia-car-485×728.jpghttps://s-media-cache-ak0.pinimg.com/236x/b1/1e/0a/b11e0ac8970fca0fccdac35d1f9e58a0.jpghttp://www.britsonpole.com/wp-content/uploads/2010/03/podium.jpghttp://10pix.ru/wp-content/uploads/2015/02/121.pnghttp://amonika.com/wp-content/uploads/2012/01/Definition-of-a-third-world-country-AMonika.com_.jpghttps://unbreakablepo.files.wordpress.com/2010/06/bulletproofpostpo.jpghttp://www.excella.com/wp-content/uploads/2012/11/123rf-RugbyScrum2.jpg

http://www.theplaidzebra.com/france-just-made-it-illegal-for-supermarkets-to-waste-food-punishable-by-75000-or-jail/http://www.looknreview.com/wp-content/uploads/2015/06/samsung-mobiles-8.jpghttp://www.geeky-gadgets.com/wp-content/uploads/2013/11/iphone-5s2.jpghttp://www.imore.com/sites/imore.com/files/styles/large/public/topic_images/2014/topic_ipad_air_ipad_mini_0.png?itok=053pCsJ2http://comp-neo.ru/images/stories/webdesign.jpg