1test10b

Software Testing

Necessary to measure and certify quality in software

2test10b

Why Software Testing?

Shows actual behavior of software– proofs are based on abstraction– proofs may have errors

May use 20% of total development effort– important to make good use of effort– testers often don’t make good selection of tests

Can not do exhaustive testing

3test10b

Terminology (IEEE Glossary)

Failure – external behavior is incorrect

Fault– discrepancy in code that causes a failure

Error – 1. Human mistake that caused fault– 2. All of above

4test10b

Fault, Failure, or Error?

A. returns wrong value B. forgot a special case C. If (a = b) in C++

5test10b

Test Phase Matching Component Integration System Acceptance

Performance of whole system

Interfaces User Modules

6test10b

Test Plans

Specified during requirement phase Based on requirements

– Black Box Testing

7test10b

Class Discussion

What are the advantages of test plans written right after the requirements are available?

8test10b

IEEE Standard for Software Test Documentation

IEEE Std 829-1983

11test10b

partial contents of aTest Plan (IEEE Standard)

identifier introduction test items (what is to

be tested) features

– to be tested– not to be tested

methodology

pass/fail criteria suspension criteria deliverables responsibilities schedule contingency plans approvals

12test10b

Other test documents

test-case specification– inputs, outputs, procedures

test-procedure specification test log test-incident report test-summary report

13test10b

L10bS11 - Individual Task

Write a test plan for B&B software– Any section that you feel is not applicable,

write n/a

15 pts, due Tuesday, 9am (on and off)

Questions

Questions