Empirical Investigation of the Effect of V&V and Agile Software Development on Software Quality Improvement using a Pilot Study

Dipl.-Ing. Mag. Mag. Bernhard Riedl

2Bernhard Riedl

”Beware of bugs in the above code;I have only proved it correct, not tried it.”

Donald E. Knuth

”If anything can go wrong, it will.”Edward A. Murphy

3Bernhard Riedl

Topics

• Motivation• Introduction

– Agile Processes / PairProgramming– Techniques

• Evaluation– Hypotheses– Pilot Study– Results

• Agile Inspection and Implementation Process• Follow-Up

4Bernhard Riedl

Time

Agile

Agile Processes

Time

Iterative

Project Management

(PM)

&

RiskManagement

(RM)

Analysis (A)

Design (D)

Implementation (I)

Test (T)

Quality Assurance

(QA)Time

Sequential

5Bernhard Riedl

Techniques with priorized Use-Cases

• Usage-based Reading, UBR (Biffl et al., Thelin et al., Winkler et al.)– reading through artifacts

• Usage-based Testing, UBT-i bzw. TDI– replicated version of UBT (Andersson et al.)– finding matching equivalence class– create test-cases for inspection

• Usage-based Implementing, UBI– PairProgramming (Williams et al., Cockburn et al.)– detecting faults while implementing

6Bernhard Riedl

Hypotheses 1/2

7Bernhard Riedl

Hypotheses 2/2

Design Document

Source-Code

UBR X

UBT-i X

UBI X

8Bernhard Riedl

Results

EffortEffectivenessSource-Code

high UBIUBI

team UBR+UBT-i

low UBR, UBT-i UBR, UBT-i

9Bernhard Riedl

Agile Inspection and Implementation Process

10Bernhard Riedl

Follow-Up

• Winkler, D., Riedl, B. and Biffl, S. “Improvement of Design Specifications with Inspection and Testing”, Proceedings of Euromicro 2005.