Acceptance testing is a user-run test that demonstrates the application’s ability to meet the original business objectives and system requirements and usually consists of a subset of system tests.Source : Wiilliam E. Lewis , Software Testing and Continuous Quality Improvement, 2nd edition,2005

“… acceptance testing certifies that the software system satisfies the original requirements.”Source : Wiilliam E Lewis , Software Testing and Continuous Quality Improvement, 2nd edition, 2005

Acceptance testing is defined as that testing, which when completed successfully, will result in the customer accepting the software and giving us their money.

Source : Lee Copeland , A Practitioner’s guide to Software Test Design, 2004

Definition

COMP8130 V&V - User Acceptance Test (UAT) 2-17

We have identified several keywords related to UAT: final step before rolling out the application, final stage of testing in application, fitness purposes, meet acceptance criteria, meet the original business objectives and system

requirements. readiness for operational use.

Therefore, we conclude that the User Acceptance Testing is : “ A final testing phase that is conducted during the life cycle of

software development, in order to determine whether the developed system meets the agreed requirements and to evaluate the readiness for operational use ” .

Definition ( cont..)

COMP8130 V&V - User Acceptance Test (UAT) 3-17

Testing Types

Software Testing and Continuous Quality Improvement, Wiilliam E Lewis

COMP8130 V&V - User Acceptance Test (UAT) 4-17

It is performed after the software has successfully completed systems testing

A formal UAT is not compulsory, when the end users are satisfied with the other system tests and have been involved continuously throughout the development lifecycle (implicitly conduct acceptance test)

The Use of UAT

COMP8130 V&V - User Acceptance Test (UAT) 5-17

Some steps when doing the UAT : User Acceptance Test Planning Designing UAT Test Cases Review/Approve Acceptance Test Plan Executing Test Cases Documenting the defects found during UAT Resolving the Defects Fixing Sign Off

UAT Activities

COMP8130 V&V - User Acceptance Test (UAT) 6-17

Test plan - outlines the testing strategy (Acceptance Testing, Entry and Fail Criteria, Test Execution Team, Test Script Developer)

Test cases - guides the team to effectively test the application

Test Log - records all the test cases executed and the actual results

User Sign Off - indicates that the customer are satisfied with the product.

UAT Deliverables

COMP8130 V&V - User Acceptance Test (UAT) 7-17

Structured testing:Conducted based on the test plan and test

procedures. It consists various tests against agreed

requirements.

Unstructured testing:A test that is conducted by not referring to

the test planIt is a free form test which tests the

software with the idea of breaking it.

UAT Methodologies

COMP8130 V&V - User Acceptance Test (UAT) 8-17

Advantageswritten statements of expected behaviourprovides repeatabilitycost effective technique to deliver a high quality

of product a risk mitigation strategy

Disadvantagestesting coverage limitationrequires more efforts and expense during the

preparation testing executions

Structured Testing

COMP8130 V&V - User Acceptance Test (UAT) 9-17

AdvantagesFlexibility in detecting system anomaliesit does not require much effort on the

preparation phase of testing

DisadvantagesIn general,errors could not be reproduceddifficult to measure the success criteria of the

testing activitytest coverage is unknown

Unstructured Testing

COMP8130 V&V - User Acceptance Test (UAT) 10-17

Team Leader Test Analyst User Representative Testers Test Observers

COMP8130 V&V - User Acceptance Test (UAT) 11-17

UAT Team Members

Insufficient number of testers Inexperienced user representative Incompetent Testers

Issues of UAT Management

COMP8130 V&V - User Acceptance Test (UAT) 12-17

Ideal User acceptance TesterBackground

Has the experience of user operations and in the use of IT facilities, independent thinker

Skills good communicator, need to expect system to fail

Independence not involved in the IT project and also in the user specifications, need to be a self-starter.

Attitude need to be an optimistic thinker, neutral, need to be analytical.

Availability Fully dedicated in doing the Tests

Types of User Acceptance Tester

COMP8130 V&V - User Acceptance Test (UAT) 13-17

Typical User Acceptance TesterBackground

Involved in the IT project and also in the user specifications

Skills Non technical and technical persons

Attitude Pragmatic

Availability

Testing is not the main job

Types of User Acceptance Tester ( Cont..)

COMP8130 V&V - User Acceptance Test (UAT) 14-17

Reasons why it is not possible to find Ideal User acceptance tester

Lack of Software Project Management Knowledge Not always possible to have independent User

Acceptance testers Generally, testing is not their main job Too busy with operational activities

COMP8130 V&V - User Acceptance Test (UAT) 15-17

Teamwork is essential We are not good at finding errors in our own

work A successful test is one that finds errors Define testing criteria when defining business

requirements Detachment - during development testers can

“look but not touch” (review only) Not everyone does testing well It’s almost never right at the first time

Rules of Thumb for UAT

COMP8130 V&V - User Acceptance Test (UAT) 16-17

The user acceptance test as the last testing phase process is important to evaluate the software deliverable against the users’ requirements.

When customers have already involved in development activities and implicitly implementing acceptance test, UAT is not a compulsory step to accomplish. However if we conduct UAT, this will take satisfaction in product deliverable for both of user and vendor

There are several phases in conducting user acceptance test activities, such as planning, designing test cases, forming a testing team, executing test cases, documenting defects, resolving the issues, and signing off the test.

Moreover, UAT can be conducted either in structured or unstructured ways.

For several reasons, it is not possible to have ideal User Acceptance tester

Summary

COMP8130 V&V - User Acceptance Test (UAT) 17-17

Thank You