QualiTest - Results Based Testing

Post on 15-Jul-2015

164 views 0 download

Transcript of QualiTest - Results Based Testing

Results Based Testing U s i n g G a i n - S h a r i n g P r i c e M o d e l

Results Based Testing

2

Results Based Testing (RBT) is a new software testing pricing model that sets forth the expected value to be delivered by the testing teams

When to Utilize RBT

3

Results Based Testing usually involves 3 elements:

RBT is normally utilized when part or all of the software testing process is outsourced to a third party and a core contractual SLA together with a pricing mechanism sets the exact payment made at each level

A Scope of Work

A Contractual SLA

A Pricing Mechanism

Results Based Pricing Model

4

Results Based testing is the only gain-sharing approach in which long term interest are perfectly aligned

The model encourages: • Collaboration• Creative problem solving

The Pricing ModelThe basic pricing model is Managed Testing Services based on a pre-defined rate card with only a certain amount paid while the final calculation of the cost is made once actual results are calculated

KPI Menu

5

QualiTest offers a menu of several Key Process Indicators (KPI) that the customer can select to have implemented

Focus Should be on 2 Main Questions

6

• What percentage of the defects should be found by testing?

• What is the cost spent in order to achieve the above goal?

In order to measure the percentage of defects found by testing (a type of test Coverage KPI vs. the escaped defects KPI):

• Report of defects during testing and evaluate severity

• Document Issues/Tickets raised by customers after release and evaluate severity

Measuring Test Coverage KPI

7

Measuring the test coverage is done by dividing the amount of defects found by the testing provider with the amount of defects found by the users of the system.

Testing Budget Calculator

8

The Testing Budget Calculator is a formula used to define the testing budget required for testing a system or a version of a system

These factors are included when identifying the parameters that affect a testing budget:

• Overall development budget• Development effort in man days • Type of Project• Estimated number of product versions• Scope of Testing• Efforts spent in previous versions• Number of interfaces or integrated systems• Duration of Testing

Coverage Adjustment

9

The following adjustments are made based on the actual test coverage KPI:

• If the actual coverage meets the expected results – a reward of up to 10% of the total actual cost is given to the provider

• If the actual coverage is below the expected results – a penalty of up to 30% of the total actual cost is given to the provider

Conclusion

1

0

Results Based Testing enables QualiTest to:

Aligns QualiTest and the Customer to meet Business

Goals

Allows QualiTest to Innovate and Improve the

Process

Provides a Framework for

Continuous Improvement

Measures QualiTest’s Testing

Performance

Provides the Customer Flexibility

Thank You !

w w w . Q u a l i Te s t G r o u p . c o m