QualiTest - Results Based Testing

11
Results Based Testing Using Gain-Sharing Price Model

Transcript of QualiTest - Results Based Testing

Page 1: QualiTest - Results Based Testing

Results Based Testing U s i n g G a i n - S h a r i n g P r i c e M o d e l

Page 2: QualiTest - Results Based Testing

Results Based Testing

2

Results Based Testing (RBT) is a new software testing pricing model that sets forth the expected value to be delivered by the testing teams

Page 3: QualiTest - Results Based Testing

When to Utilize RBT

3

Results Based Testing usually involves 3 elements:

RBT is normally utilized when part or all of the software testing process is outsourced to a third party and a core contractual SLA together with a pricing mechanism sets the exact payment made at each level

A Scope of Work

A Contractual SLA

A Pricing Mechanism

Page 4: QualiTest - Results Based Testing

Results Based Pricing Model

4

Results Based testing is the only gain-sharing approach in which long term interest are perfectly aligned

The model encourages: • Collaboration• Creative problem solving

The Pricing ModelThe basic pricing model is Managed Testing Services based on a pre-defined rate card with only a certain amount paid while the final calculation of the cost is made once actual results are calculated

Page 5: QualiTest - Results Based Testing

KPI Menu

5

QualiTest offers a menu of several Key Process Indicators (KPI) that the customer can select to have implemented

Page 6: QualiTest - Results Based Testing

Focus Should be on 2 Main Questions

6

• What percentage of the defects should be found by testing?

• What is the cost spent in order to achieve the above goal?

Page 7: QualiTest - Results Based Testing

In order to measure the percentage of defects found by testing (a type of test Coverage KPI vs. the escaped defects KPI):

• Report of defects during testing and evaluate severity

• Document Issues/Tickets raised by customers after release and evaluate severity

Measuring Test Coverage KPI

7

Measuring the test coverage is done by dividing the amount of defects found by the testing provider with the amount of defects found by the users of the system.

Page 8: QualiTest - Results Based Testing

Testing Budget Calculator

8

The Testing Budget Calculator is a formula used to define the testing budget required for testing a system or a version of a system

These factors are included when identifying the parameters that affect a testing budget:

• Overall development budget• Development effort in man days • Type of Project• Estimated number of product versions• Scope of Testing• Efforts spent in previous versions• Number of interfaces or integrated systems• Duration of Testing

Page 9: QualiTest - Results Based Testing

Coverage Adjustment

9

The following adjustments are made based on the actual test coverage KPI:

• If the actual coverage meets the expected results – a reward of up to 10% of the total actual cost is given to the provider

• If the actual coverage is below the expected results – a penalty of up to 30% of the total actual cost is given to the provider

Page 10: QualiTest - Results Based Testing

Conclusion

1

0

Results Based Testing enables QualiTest to:

Aligns QualiTest and the Customer to meet Business

Goals

Allows QualiTest to Innovate and Improve the

Process

Provides a Framework for

Continuous Improvement

Measures QualiTest’s Testing

Performance

Provides the Customer Flexibility

Page 11: QualiTest - Results Based Testing

Thank You !

w w w . Q u a l i Te s t G r o u p . c o m