AutomatedQA

38
1

Transcript of AutomatedQA

Page 1: AutomatedQA

1

Page 2: AutomatedQA

The presenters today are:

Steve Miller – 25 years of experience with software development / testing and Software Planner expert.

Gregg Sporar – 25 years of experience with software development / code reviews and Code Collaborator expert.

2

Page 3: AutomatedQA

Stick around at the end of the webinar -- we will provide a link for you to fill out a survey.

If you fill that out, you will be entered into a drawing for a FREE Flip Video Camcorder – to be mailed on Friday March 26.

3

Page 4: AutomatedQA

We will be recording the session and will distribute the recorded session via email

Feel free to ask any questions using the Q&A panel

4

Page 5: AutomatedQA

8 Best Practices1. Identify the major causes of Project Slippage

2. Create great requirements

3. Create better estimates

4. Implement Requirements / Test Case Traceability

5. Implement Testing Best Practices

6. Reduce defects using Peer Code Reviews

7. Implement best practices for managing defects

8. Drive lifecycle management from key metrics

5

Page 6: AutomatedQA

Keys to Success: Process Improvement Intelligent Use of Tools

Tools we will show Today: Software Planner – for Application Lifecycle Management Code Collaborator – for Peer Code Review TestComplete – for test automation Jing – for recording screen actions for defect management

6

Page 7: AutomatedQA

For today’s webinar, we will use an Orders Application for our examples.

This sample application is used to illustrate how to manage software releases.

Hands On – Review the Orders Application and how this project was set up in Software Planner

7

Page 8: AutomatedQA

8

Page 9: AutomatedQA

Best Practice 1Before we can improve releases, we must understand what causes slippages. Major contributors are:

Poorly defined requirements resulting in poor estimates

Too many defects discovered during the QA phase

Lack of best practice techniques for managing all phases of the software lifecycle

9

Page 10: AutomatedQA

Best Practice 2A great requirement has these elements:

Succinct yet descriptive narrative

Explicit list of business rules

Prototype

10

Page 11: AutomatedQA

11

Requirement: OA-0002 Add New Order

Description: Allow adding of a customer order. Orders can come from many places. They can come from downloads from the website, Google searches, trade shows, etc. Regardless of how the order comes in, process it the same way. Invalid orders should not be processed.

Business Rules: Allow entry of these fields: Customer Name, Product, Quantity, Price Per Unit, Discount, Total, Date, Address, Credit Card Info.

Page 12: AutomatedQA

12

Hands On – Review the revised (good) requirement in Software Planner

Succinct yet descriptive narrative

Explicit list of business rules

Prototype

Page 13: AutomatedQA

13

Page 14: AutomatedQA

14

Page 15: AutomatedQA

Best Practice 3To define better estimates, you must:

Start with a good requirement

Decompose the requirement into tasks

Build in buffers based on past experiences

Identify tasks for testing, documentation, and other tasks that are often forgotten

15

Page 16: AutomatedQA

16

Hands On – View how we decomposed the requirement into tasks using Software Planner – providing a much better estimate

Page 17: AutomatedQA

17

Page 18: AutomatedQA

Best Practice 4A few simple best practices will dramatically increase quality:

Create test cases directly from the requirement (linking them) to ensure good traceability and test coverage

Create both positive and negative test cases

Automate as many of the regression tests as possible –this allows you to run them more often and without tying up testing resources

18

Page 19: AutomatedQA

19

Page 20: AutomatedQA

20

Hands On – View how we used Software Planner to create positive and negative test cases for the Order Entry requirement (OA-0002) and how we used Traceability to ensure we had good test coverage

Page 21: AutomatedQA

Best Practice 5

Want the best kept secret in regards to improving the quality of code received for QA testing?

Publish your test cases to the developers early during their coding process!

Automate your Regression Test Cases

Implement Testing Best Practices:

http://www.softwareplanner.com/TestBestPractices.pdf

21

Page 22: AutomatedQA

22

Hands On – View the Testing Best Practice Document. Illustrate how to automate test cases using TestComplete.

Page 23: AutomatedQA

23

Page 24: AutomatedQA

The Earlier You Find the Bug, The Easier and Less Expensive It Is to Fix

24

Page 25: AutomatedQA

25

Before Code Review

Bugs Remaining

463

Bugs Remaining

321

Bugs Remaining

194

0

100

200

300

400

500

After

Development

After

QA/Test

($200/fix)

After

Customer

($1000/fix)

Bu

gs

Rem

ain

ing

in t

he

Ap

plic

atio

n

Cost of fixing bugs: $174k

+ Cost of 194 latent bugs: $194k

Total Cost: $368k

??

?

What if we had Peer Review?

Page 26: AutomatedQA

26

After Code Review

Bugs Remaining

463

Bugs Remaining

180

Bugs Remaining

113

Bugs Remaining

32

0

100

200

300

400

500

After

Development

After

Code Review

($25/fix)

After

QA/Test

($200/fix)

After

Customer

($1000/fix)

Bu

gs R

em

ain

ing

in

th

e A

pp

licati

on

Cost of fixing bugs: $120k

+ Cost of 32 latent bugs: $ 32k

Total Cost: $152k

$152k, down from $368k

32,

down

from 194

Page 27: AutomatedQA

27

Page 28: AutomatedQA

To See More, Sign Up for a Code Collaborator Webinar:

http://smartbear.com/webinar-schedule.php

28

Page 29: AutomatedQA

The key is to reduce rework of defects

Ensure defects can be reproduced - Use Jing (www.jingproject.com) to record your screen actions

Automatically create defects from failed test cases

Use threaded discussions on the defect to discuss what has been fixed

Keep track of defect rework analytics

29

Page 30: AutomatedQA

30

Page 31: AutomatedQA

31

Page 32: AutomatedQA

32

Page 33: AutomatedQA

33

Page 34: AutomatedQA

34

Page 35: AutomatedQA

35

Page 36: AutomatedQA

1. Identified the major causes of Project Slippage

2. Demonstrated how to create great requirements

3. Identified how to create better estimates

4. Explained Requirements / Test Case Traceability

5. Discussed Other Testing Best Practices

6. Discussed reducing defects using Peer Code Reviews

7. Discussed best practices for managing defects

8. Illustrated important metrics for managing lifecycle

36

Page 37: AutomatedQA

We will send out the recorded session later this week.

Please fill out the survey (Free Flip Camcorder Drawing)http://www.SoftwarePlanner.com/Survey23

Sign up for a free trial of Software Planner athttp://www.SoftwarePlanner.com

Sign up for a free trial of Code Collaborator at http://www.CodeCollaborator.com

Sign up for a free trial of TestComplete at http://www.TestComplete.com

Questions?

37

Page 38: AutomatedQA

Thanks again for your time today!

Contact Information(Request Personalized Demos or ask questions)

+1 (978) 236-7900 [email protected]

38