Introduction to Improve Customer Feedback QASymphony … · – Exploratory testing vs. testing...
Transcript of Introduction to Improve Customer Feedback QASymphony … · – Exploratory testing vs. testing...
September 25, 2015
Introduction to QASymphony for [INSERT COMPANY NAME]
Improve Customer Feedback with Exploratory Testing
Kevin Dunne
Exploratory testing:
1. Drives higher quality than scripted testing
2. Improves morale across testers
3. Improves customer feedback & communication
A 2007 controlled study found that:
– Testing with test cases vs. exploratory testing take almost 7 times longer, due to the amount of time needed to write the tests and report results on them
– Exploratory testing vs. testing with test cases finds more defects, and does not miss many (if any) critical or severe defects in comparison to test case testing
– Testing with test cases causes more false defect reports vs. exploratory testing
Study link:
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.167.3696&rep=rep1&type=pdf
Increase Quality
Workplace choice improves the employee experience, and adding exploratory testing to the mix allows testers to have choice many times per day
Boost Tester Morale
Exploratory testing replaces the real user interaction that is removed by manual test cases with prescriptive steps:
Customers don’t use the test cases or requirements – they use the application!
Increase Customer Feedback & Communication
Manual Scripted Testing Exploratory Testing
Exploratory test charters require much more engagement and thought from testers than traditional manual tests. The difference is:
Charter
Investigate the trial signup workflow for QASymphony as a new visitor to the site and that the tester is both able to sign up with valid criteria as well as with invalid criteria
Test Case
What’s the difference?
Step Description Expected Result
Visit www.qasymphony.com Validate home page loads properly
Click “Free Trial” button Validate trial sign up page loads properly
Enter “Kevin Dunne” in name box Validate green check box appearse
Etc. etc.
1. Parallel test planning, test design, and test execution
2. Specific yet flexible
3. Aligned towards investigation of potential opportunities
4. Values depth and attention to detail during testing
5. Fosters knowledge sharing and awareness
What is exploratory testing?
1. Paired Testing – real time, in person feedback from tester (or product owner) to developer
2. Team Based ET – collaboration between product, test, and development
3. UAT – solidify feedback loop from the business back into development team
4. Beta Testing – build communication from users back into development team
5. Replacing Traditional Testing – drive collaboration inside the testing organization between manual and automated testers
How to Incorporate Exploratory Testing
Questions?
Kevin [email protected]
Twitter: @kevindunneQALinkedin: www.linkedin.com/in/kevindunneQA
Blog: http://www.qasymphony.com/blog/