Systematic Test Design A Smarter Strategy?5a+ BF6 AF1 Enter person with valid email address already...

23
Systematic Test Design A Smarter Strategy? Richard Mash Capgemini

Transcript of Systematic Test Design A Smarter Strategy?5a+ BF6 AF1 Enter person with valid email address already...

  • Systematic Test Design

    – A Smarter Strategy?

    Richard Mash

    Capgemini

  • Systematic Test Design –

    A Smarter Strategy?

    Richard Mash

    Senior Test Manager

    (UK Test Processes & Methods)

  • Capgemini Technology Services© 2005 Capgemini - All rights reserved

    Eurostar 2005

    Objectives

    The objectives today are to:

    Describe a systematic approach to test design

    Identify the benefits that we gained

    • Test case review effort and defects

    To „plant some ideas‟ for ways that you could do similarly

    Describe how tools can help

    • (common tools and test tools)

  • Capgemini Technology Services© 2005 Capgemini - All rights reserved

    Eurostar 2005

    Content

    Content

    Context

    Why we needed a systematic approach

    The Design Process

    • 3 Steps

    • Process Automation

    Lessons Learned

    Benefits

  • Capgemini Technology Services© 2005 Capgemini - All rights reserved

    Eurostar 2005

    Context

    Projects

    Customer driven

    • Changing Requirements

    Bespoke

    Large – 6-24 months & 5-10 testers

    Fixed Price

    • Time Limited

    • Cost Limited

    • Overrun ➙ profitability, pay, bonus!

    Variable resources

    Use Case based specifications

  • Capgemini Technology Services© 2005 Capgemini - All rights reserved

    Eurostar 2005

    Systematic Test Design

    The Problem

    Iteration Test

    PlanUse Case

    Specification

    Test Case

    DesignTest Case

    DesignTest Case

    DesignTest Design

    Test Case

    DesignTest Case

    DesignTest Case

    DesignQA Review

    Complex UC = 10 Days Design (300 Test Cases)

    Test Design Tools constraining us

  • Capgemini Technology Services© 2005 Capgemini - All rights reserved

    Eurostar 2005

    Systematic Test Design

    Aims

    • Reduce „misspent‟ effort

    • Reduce QA effort

    • Systematic Process

    • Possibility for automatingTest Case

    DesignTest Case

    DesignTest Case

    Design

    Test Design

    Iteration Test

    PlanUse Case

    Specification

    ?QA Review

    Test Design

    QA Review?

    Test Case

    DesignTest Case

    DesignTest Case

    Design

  • Capgemini Technology Services© 2005 Capgemini - All rights reserved

    Eurostar 2005

    Systematic Test Design

    The Solution

    Test Case

    DesignTest Case

    DesignHigh LevelTest Case

    Design

    Control Points QA Review

    Target – Maximum Duration 1 Day

    + address need to break down Use Cases

    Iteration Test

    PlanUse Case

    Specification

    Test Case

    DesignTest Case

    DesignHigh LevelTest Case

    Design

    1.

    OutlineTest

    Design

    Test Case

    DesignTest Case

    DesignHigh Level Test Case

    Design

    Test Case

    DesignTest Case

    DesignHigh LevelTest Case

    Design

    QA Review

    Test Case

    DesignDesign

    High LevelTest Case

    2.

    DetailedTest

    Cases

    DetailedTest

    Design

    3.

  • Capgemini Technology Services© 2005 Capgemini - All rights reserved

    Eurostar 2005

    Control Points

    Examine specification for ‘Control Points’

    Inputs & Actions& Pre-Conditions

    Test Steps

    Outputs &Post-Conditions

    Verifications

    Conditions & Business Rules

    Variations ofInputs / Outputs

  • Capgemini Technology Services© 2005 Capgemini - All rights reserved

    Eurostar 2005

    Control Points

    Record Control Points

    Numeric Reference

    Link variants of same I/O

    Cross References

    Use Case Steps & Rules

    Alphabetic Suffix

    Distinguish variants ofsame condition

    Conditions with Steps & Verifications

    Splitting

    e.g. 2a2b

    e.g. BF2AF1.2

  • Capgemini Technology Services© 2005 Capgemini - All rights reserved

    Eurostar 2005

    ?

    4. The Actor enters the information and selects the option to continue.

    5. The System validates that all mandatory details have been entered, and all details have been

    entered in the correct format [BR2].

    5.1. IF mandatory details have not been provided and/or details have been entered in the incorrect

    format the system displays an error message informing the Actor of the mandatory details

    that must be provided and/or the invalid details that must be re-entered. [MSG0019]

    5.1.1. The Actor acknowledges the message and the Use Case resumes at Basic Flow Step 2.

    6. The System validates that a Person does not exist with the Email address provided.

    6.1. IF an existing Person is found with the Email address provided, refer to AF1.

    7. The system invokes UC96 Perform Postcode Address Lookup to search for the address

    corresponding to the Post code entered.

    8. The System populates the address fields with the selected matching address and the Use Case

    resumes at Step 9 of the Basic Flow.

    8.1. IF no address matches the Post code entered, the system informs the Actor there are no

    matching addresses, and prompts the Actor to confirm they have entered the correct Postcode

    [MSG0049].

    8.1.1. The Actor acknowledges the message indicating that the Post code they have entered is

    correct and the Use Case resumes at Step 9 of the Basic Flow making editable the

    Address fields to be populated by the Actor.

    8.1.1.1. IF the Actor acknowledges the message indicating that the Post code they have

    entered is incorrect, the Use Case resumes at Step 2 of the Basic Flow.

    8.2. IF there are matching addresses but the Actor does not select one, the Use Case resumes at

    Step 9 of the Basic Flow without populating the address but making editable the Address

    fields.

    Control Points(Example)

  • Capgemini Technology Services© 2005 Capgemini - All rights reserved

    Eurostar 2005

    4. The Actor enters the information and selects the option to continue.

    5. The System validates that all mandatory details have been entered, and all details have been

    entered in the correct format [BR2].

    5.1. IF mandatory details have not been provided and/or details have been entered in the incorrect

    format the system displays an error message informing the Actor of the mandatory details

    that must be provided and/or the invalid details that must be re-entered. [MSG0019]

    5.1.1. The Actor acknowledges the message and the Use Case resumes at Basic Flow Step 2.

    6. The System validates that a Person does not exist with the Email address provided.

    6.1. IF an existing Person is found with the Email address provided, refer to AF1.

    7. The system invokes UC96 Perform Postcode Address Lookup to search for the address

    corresponding to the Post code entered.

    8. The System populates the address fields with the selected matching address and the Use Case

    resumes at Step 9 of the Basic Flow.

    8.1. IF no address matches the Post code entered, the system informs the Actor there are no

    matching addresses, and prompts the Actor to confirm they have entered the correct Postcode

    [MSG0049].

    8.1.1. The Actor acknowledges the message indicating that the Post code they have entered is

    correct and the Use Case resumes at Step 9 of the Basic Flow making editable the

    Address fields to be populated by the Actor.

    8.1.1.1. IF the Actor acknowledges the message indicating that the Post code they have

    entered is incorrect, the Use Case resumes at Step 2 of the Basic Flow.

    8.2. IF there are matching addresses but the Actor does not select one, the Use Case resumes at

    Step 9 of the Basic Flow without populating the address but making editable the Address

    fields.

    ?

    Control Points(Example)

    Control

    Point Id Step

    Next

    Step

    Included

    in Test

    Case Condition

    Business

    Rule /

    PreCond

    3a+ BF4 BF5 User selects option to continue TC1

    4a- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with < 5 characters BR2 TC6

    4b- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with > 7 characters BR2 TC6

    4c- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with > 5 and < 7 characters where 1st character is

    numeric BR2 TC6

    4d+ BF5 BF6

    Verify that entry is accepted when you enter PostCode

    for UK with > 5 and < 7 characters where 1st character is

    alphabetic BR2 TC1

    4e- BF5 End Verify that French postcode with 5 numerics is accepted BR2 TC6

    4f- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with < 5 numerics BR2 TC6

    4g- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with > 5 numerics BR2 TC6

    4h- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with 5 characters including non- numerics BR2 TC2

    5a+ BF6 AF1

    Enter person with valid email address already

    registered TC1

    5b+ BF6 BF7 Enter person without email address already registered TC2

    6a+ BF8 BF9

    Verify that addresses are displayed where a valid post

    code is entered which matches address

    6b- BF8 BF8.1.1

    Verify that MSG0049 is displayed when post code is

    entered for which there are no matching addresses

    7a+ BF8 BF9

    Verify that when user responds to MSG0049 confirming

    PostCode is correct then address fields are made

    enterable

    7b+ BF8 BF2

    User responds to MSG0049 confirming PostCode is not

    correct and reenters post code

    8a+ BF8 BF9

    Verify that when user selects an address then the screen

    address fields are populated

    8b+ BF8 BF9

    Verify that when user does not accept an address then

    screen address fields are made enterable

    9a+ BF10 BF11

    Enter Position, Business Name, Address, Subub, Town,

    County, Language Preference, Daytime Phone Numer,

    Evening Phone Number, Mobile Phone Number, 'How

    did You Find Out Question', Contact By ABC Rep?

    (Default No)

    10a+ BF10 BF11

    Verify that where user selects 'How Did You Find out?'

    then fields Trade Sector and Christie and Co Office are

    displayed.

    11a- BF11 End

    Verify that Address, Town, Language, one of phone

    numbers, 'How Did You Find Out' - are mandatory and

    MSG0023 displayed if not entered

    11b- BF11 End

    Verify that where user selects 'How Did You Find out?'

    then fields Trade Sector and Christie and Co Office are

    displayed and mandatory and MSG0023 displayed if not

    entered

    11c- BF11 End

    Verify that Title, Forename, Surname, Email Address,

    Confirmation Email Address, Country are mandatory and

    MSG0023 displayed if not entered.

    12a+ BF11 BF12

    Verify that where user selected option to be contacted

    by ABC rep then system generates reminder SGE0023.

    Control

    Point Id Step

    Next

    Step

    Included

    in Test

    Case Condition

    Business

    Rule /

    PreCond

    3a+ BF4 BF5 User selects option to continue TC1

    4a- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with < 5 characters BR2 TC6

    4b- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with > 7 characters BR2 TC6

    4c- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with > 5 and < 7 characters where 1st character is

    numeric BR2 TC6

    4d+ BF5 BF6

    Verify that entry is accepted when you enter PostCode

    for UK with > 5 and < 7 characters where 1st character is

    alphabetic BR2 TC1

    4e- BF5 End Verify that French postcode with 5 numerics is accepted BR2 TC6

    4f- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with < 5 numerics BR2 TC6

    4g- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with > 5 numerics BR2 TC6

    4h- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with 5 characters including non- numerics BR2 TC2

    5a+ BF6 AF1

    Enter person with valid email address already

    registered TC1

    5b+ BF6 BF7 Enter person without email address already registered TC2

    6a+ BF8 BF9

    Verify that addresses are displayed where a valid post

    code is entered which matches address

    6b- BF8 BF8.1.1

    Verify that MSG0049 is displayed when post code is

    entered for which there are no matching addresses

    7a+ BF8 BF9

    Verify that when user responds to MSG0049 confirming

    PostCode is correct then address fields are made

    enterable

    7b+ BF8 BF2

    User responds to MSG0049 confirming PostCode is not

    correct and reenters post code

    8a+ BF8 BF9

    Verify that when user selects an address then the screen

    address fields are populated

    8b+ BF8 BF9

    Verify that when user does not accept an address then

    screen address fields are made enterable

    9a+ BF10 BF11

    Enter Position, Business Name, Address, Subub, Town,

    County, Language Preference, Daytime Phone Numer,

    Evening Phone Number, Mobile Phone Number, 'How

    did You Find Out Question', Contact By ABC Rep?

    (Default No)

    10a+ BF10 BF11

    Verify that where user selects 'How Did You Find out?'

    then fields Trade Sector and Christie and Co Office are

    displayed.

    11a- BF11 End

    Verify that Address, Town, Language, one of phone

    numbers, 'How Did You Find Out' - are mandatory and

    MSG0023 displayed if not entered

    11b- BF11 End

    Verify that where user selects 'How Did You Find out?'

    then fields Trade Sector and Christie and Co Office are

    displayed and mandatory and MSG0023 displayed if not

    entered

    11c- BF11 End

    Verify that Title, Forename, Surname, Email Address,

    Confirmation Email Address, Country are mandatory and

    MSG0023 displayed if not entered.

    12a+ BF11 BF12

    Verify that where user selected option to be contacted

    by ABC rep then system generates reminder SGE0023.

    Control

    Point Id Step

    Next

    Step

    Included

    in Test

    Case Condition

    Business

    Rule /

    PreCond

    3a+ BF4 BF5 User selects option to continue TC1

    4a- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with < 5 characters BR2 TC6

    4b- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with > 7 characters BR2 TC6

    4c- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with > 5 and < 7 characters where 1st character is

    numeric BR2 TC6

    4d+ BF5 BF6

    Verify that entry is accepted when you enter PostCode

    for UK with > 5 and < 7 characters where 1st character is

    alphabetic BR2 TC1

    4e- BF5 End Verify that French postcode with 5 numerics is accepted BR2 TC6

    4f- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with < 5 numerics BR2 TC6

    4g- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with > 5 numerics BR2 TC6

    4h- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with 5 characters including non- numerics BR2 TC2

    5a+ BF6 AF1

    Enter person with valid email address already

    registered TC1

    5b+ BF6 BF7 Enter person without email address already registered TC2

    6a+ BF8 BF9

    Verify that addresses are displayed where a valid post

    code is entered which matches address

    6b- BF8 BF8.1.1

    Verify that MSG0049 is displayed when post code is

    entered for which there are no matching addresses

    7a+ BF8 BF9

    Verify that when user responds to MSG0049 confirming

    PostCode is correct then address fields are made

    enterable

    7b+ BF8 BF2

    User responds to MSG0049 confirming PostCode is not

    correct and reenters post code

    8a+ BF8 BF9

    Verify that when user selects an address then the screen

    address fields are populated

    8b+ BF8 BF9

    Verify that when user does not accept an address then

    screen address fields are made enterable

    9a+ BF10 BF11

    Enter Position, Business Name, Address, Subub, Town,

    County, Language Preference, Daytime Phone Numer,

    Evening Phone Number, Mobile Phone Number, 'How

    did You Find Out Question', Contact By ABC Rep?

    (Default No)

    10a+ BF10 BF11

    Verify that where user selects 'How Did You Find out?'

    then fields Trade Sector and Christie and Co Office are

    displayed.

    11a- BF11 End

    Verify that Address, Town, Language, one of phone

    numbers, 'How Did You Find Out' - are mandatory and

    MSG0023 displayed if not entered

    11b- BF11 End

    Verify that where user selects 'How Did You Find out?'

    then fields Trade Sector and Christie and Co Office are

    displayed and mandatory and MSG0023 displayed if not

    entered

    11c- BF11 End

    Verify that Title, Forename, Surname, Email Address,

    Confirmation Email Address, Country are mandatory and

    MSG0023 displayed if not entered.

    12a+ BF11 BF12

    Verify that where user selected option to be contacted

    by ABC rep then system generates reminder SGE0023.

    Control

    Point Id Step

    Next

    Step

    Included

    in Test

    Case Condition

    Business

    Rule /

    PreCond

    3a+ BF4 BF5 User selects option to continue TC1

    4a- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with < 5 characters BR2 TC6

    4b- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with > 7 characters BR2 TC6

    4c- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with > 5 and < 7 characters where 1st character is

    numeric BR2 TC6

    4d+ BF5 BF6

    Verify that entry is accepted when you enter PostCode

    for UK with > 5 and < 7 characters where 1st character is

    alphabetic BR2 TC1

    4e- BF5 End Verify that French postcode with 5 numerics is accepted BR2 TC6

    4f- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with < 5 numerics BR2 TC6

    4g- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with > 5 numerics BR2 TC6

    4h- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with 5 characters including non- numerics BR2 TC2

    5a+ BF6 AF1

    Enter person with valid email address already

    registered TC1

    5b+ BF6 BF7 Enter person without email address already registered TC2

    6a+ BF8 BF9

    Verify that addresses are displayed where a valid post

    code is entered which matches address

    6b- BF8 BF8.1.1

    Verify that MSG0049 is displayed when post code is

    entered for which there are no matching addresses

    7a+ BF8 BF9

    Verify that when user responds to MSG0049 confirming

    PostCode is correct then address fields are made

    enterable

    7b+ BF8 BF2

    User responds to MSG0049 confirming PostCode is not

    correct and reenters post code

    8a+ BF8 BF9

    Verify that when user selects an address then the screen

    address fields are populated

    8b+ BF8 BF9

    Verify that when user does not accept an address then

    screen address fields are made enterable

    9a+ BF10 BF11

    Enter Position, Business Name, Address, Subub, Town,

    County, Language Preference, Daytime Phone Numer,

    Evening Phone Number, Mobile Phone Number, 'How

    did You Find Out Question', Contact By ABC Rep?

    (Default No)

    10a+ BF10 BF11

    Verify that where user selects 'How Did You Find out?'

    then fields Trade Sector and Christie and Co Office are

    displayed.

    11a- BF11 End

    Verify that Address, Town, Language, one of phone

    numbers, 'How Did You Find Out' - are mandatory and

    MSG0023 displayed if not entered

    11b- BF11 End

    Verify that where user selects 'How Did You Find out?'

    then fields Trade Sector and Christie and Co Office are

    displayed and mandatory and MSG0023 displayed if not

    entered

    11c- BF11 End

    Verify that Title, Forename, Surname, Email Address,

    Confirmation Email Address, Country are mandatory and

    MSG0023 displayed if not entered.

    12a+ BF11 BF12

    Verify that where user selected option to be contacted

    by ABC rep then system generates reminder SGE0023.

    Control

    Point Id Step

    Next

    Step

    Included

    in Test

    Case Condition

    Business

    Rule /

    PreCond

    3a+ BF4 BF5 User selects option to continue TC1

    4a- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with < 5 characters BR2 TC6

    4b- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with > 7 characters BR2 TC6

    4c- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with > 5 and < 7 characters where 1st character is

    numeric BR2 TC6

    4d+ BF5 BF6

    Verify that entry is accepted when you enter PostCode

    for UK with > 5 and < 7 characters where 1st character is

    alphabetic BR2 TC1

    4e- BF5 End Verify that French postcode with 5 numerics is accepted BR2 TC6

    4f- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with < 5 numerics BR2 TC6

    4g- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with > 5 numerics BR2 TC6

    4h- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with 5 characters including non- numerics BR2 TC2

    5a+ BF6 AF1

    Enter person with valid email address already

    registered TC1

    5b+ BF6 BF7 Enter person without email address already registered TC2

    6a+ BF8 BF9

    Verify that addresses are displayed where a valid post

    code is entered which matches address

    6b- BF8 BF8.1.1

    Verify that MSG0049 is displayed when post code is

    entered for which there are no matching addresses

    7a+ BF8 BF9

    Verify that when user responds to MSG0049 confirming

    PostCode is correct then address fields are made

    enterable

    7b+ BF8 BF2

    User responds to MSG0049 confirming PostCode is not

    correct and reenters post code

    8a+ BF8 BF9

    Verify that when user selects an address then the screen

    address fields are populated

    8b+ BF8 BF9

    Verify that when user does not accept an address then

    screen address fields are made enterable

    9a+ BF10 BF11

    Enter Position, Business Name, Address, Subub, Town,

    County, Language Preference, Daytime Phone Numer,

    Evening Phone Number, Mobile Phone Number, 'How

    did You Find Out Question', Contact By ABC Rep?

    (Default No)

    10a+ BF10 BF11

    Verify that where user selects 'How Did You Find out?'

    then fields Trade Sector and Christie and Co Office are

    displayed.

    11a- BF11 End

    Verify that Address, Town, Language, one of phone

    numbers, 'How Did You Find Out' - are mandatory and

    MSG0023 displayed if not entered

    11b- BF11 End

    Verify that where user selects 'How Did You Find out?'

    then fields Trade Sector and Christie and Co Office are

    displayed and mandatory and MSG0023 displayed if not

    entered

    11c- BF11 End

    Verify that Title, Forename, Surname, Email Address,

    Confirmation Email Address, Country are mandatory and

    MSG0023 displayed if not entered.

    12a+ BF11 BF12

    Verify that where user selected option to be contacted

    by ABC rep then system generates reminder SGE0023.

    Control

    Point Id Step

    Next

    Step

    Included

    in Test

    Case Condition

    Business

    Rule /

    PreCond

    3a+ BF4 BF5 User selects option to continue TC1

    4a- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with < 5 characters BR2 TC6

    4b- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with > 7 characters BR2 TC6

    4c- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with > 5 and < 7 characters where 1st character is

    numeric BR2 TC6

    4d+ BF5 BF6

    Verify that entry is accepted when you enter PostCode

    for UK with > 5 and < 7 characters where 1st character is

    alphabetic BR2 TC1

    4e- BF5 End Verify that French postcode with 5 numerics is accepted BR2 TC6

    4f- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with < 5 numerics BR2 TC6

    4g- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with > 5 numerics BR2 TC6

    4h- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with 5 characters including non- numerics BR2 TC2

    5a+ BF6 AF1

    Enter person with valid email address already

    registered TC1

    5b+ BF6 BF7 Enter person without email address already registered TC2

    6a+ BF8 BF9

    Verify that addresses are displayed where a valid post

    code is entered which matches address

    6b- BF8 BF8.1.1

    Verify that MSG0049 is displayed when post code is

    entered for which there are no matching addresses

    7a+ BF8 BF9

    Verify that when user responds to MSG0049 confirming

    PostCode is correct then address fields are made

    enterable

    7b+ BF8 BF2

    User responds to MSG0049 confirming PostCode is not

    correct and reenters post code

    8a+ BF8 BF9

    Verify that when user selects an address then the screen

    address fields are populated

    8b+ BF8 BF9

    Verify that when user does not accept an address then

    screen address fields are made enterable

    9a+ BF10 BF11

    Enter Position, Business Name, Address, Subub, Town,

    County, Language Preference, Daytime Phone Numer,

    Evening Phone Number, Mobile Phone Number, 'How

    did You Find Out Question', Contact By ABC Rep?

    (Default No)

    10a+ BF10 BF11

    Verify that where user selects 'How Did You Find out?'

    then fields Trade Sector and Christie and Co Office are

    displayed.

    11a- BF11 End

    Verify that Address, Town, Language, one of phone

    numbers, 'How Did You Find Out' - are mandatory and

    MSG0023 displayed if not entered

    11b- BF11 End

    Verify that where user selects 'How Did You Find out?'

    then fields Trade Sector and Christie and Co Office are

    displayed and mandatory and MSG0023 displayed if not

    entered

    11c- BF11 End

    Verify that Title, Forename, Surname, Email Address,

    Confirmation Email Address, Country are mandatory and

    MSG0023 displayed if not entered.

    12a+ BF11 BF12

    Verify that where user selected option to be contacted

    by ABC rep then system generates reminder SGE0023.

    Table formatshould be

    appropriatefor test tool

  • Capgemini Technology Services© 2005 Capgemini - All rights reserved

    Eurostar 2005

    Control Points

    Iteration Test

    PlanUse Case

    Specification

    Easier / Faster verification 435 Rqmts Errors

    Benefits

  • Capgemini Technology Services© 2005 Capgemini - All rights reserved

    Eurostar 2005

    High Level Test Cases

    Assemble Control Points into Test Cases

    • One from each set per test case (exception for multiple negative tests)

    • Highlight first-time use in BOLD (➙ Objective of test case)

    • Update Control Points sheet with Test Case Id

    • Control Points may or may not be re-used

    • Check for efficiency

  • Capgemini Technology Services© 2005 Capgemini - All rights reserved

    Eurostar 2005

    Control

    Point Id Step

    Next

    Step

    Test

    Case Condition

    Business

    Rule /

    PreCond

    1a+ BF1 BF2 User selects option to Register

    2a+ BF2 BF3

    User enters Title, Forename, Surname, Emai, Email Confirmation, Country, Other Country, Post Code,

    Accept Terms and Conditions, Accept Contact by ABC, Agree to Sharing Details, Option to Continue

    3a+ BF4 BF5 User selects option to continue

    4a- BF5 End Verify MSG0019 is displayed when you enter PostCode for UK with < 5 characters BR2

    4b- BF5 End Verify MSG0019 is displayed when you enter PostCode for UK with > 7 characters BR2

    4c- BF5 End

    Verify MSG0019 is displayed when you enter PostCode for UK with > 5 and < 7 characters where 1st

    character is numeric BR2

    4d+ BF5 BF6

    Verify that entry is accepted when you enter PostCode for UK with > 5 and < 7 characters where 1st

    character is alphabetic BR2

    4e+ BF5 End Verify that French postcode with 5 numerics is accepted BR2

    4f- BF5 End Verify MSG0019 is displayed when you enter French postcode with < 5 numerics BR2

    4g- BF5 End Verify MSG0019 is displayed when you enter French postcode with > 5 numerics BR2

    4h- BF5 End Verify MSG0019 is displayed when you enter French postcode with 5 characters including non- numerics BR2

    5a+ BF6 AF1 Enter person with valid email address already registered

    5b+ BF6 BF7 Enter person without email address already registered

    6a+ BF8 BF9 Verify that addresses are displayed where a valid post code is entered which matches address

    6b- BF8 BF8.1.1 Verify that MSG0049 is displayed when post code is entered for which there are no matching addresses

    7a+ BF8 BF9

    Verify that when user responds to MSG0049 confirming PostCode is correct then address fields are made

    enterable

    7b+ BF8 BF2 User responds to MSG0049 confirming PostCode is not correct and reenters post code

    8a+ BF8 BF9 Verify that when user selects an address then the screen address fields are populated

    8b+ BF8 BF9 Verify that when user does not accept an address then screen address fields are made enterable

    9a+ BF10 BF11

    Enter Position, Business Name, Address, Subub, Town, County, Language Preference, Daytime Phone

    Numer, Evening Phone Number, Mobile Phone Number, 'How did You Find Out Question', Contact By ABC

    Rep? (Default No)

    10a+ BF10 BF11

    Verify that where user selects 'How Did You Find out?' then fields Trade Sector and Christie and Co Office

    are displayed.

    11a- BF11 End

    Verify that Address, Town, Language, one of phone numbers, 'How Did You Find Out' - are mandatory and

    MSG0023 displayed if not entered

    11b- BF11 End

    Verify that where user selects 'How Did You Find out?' then fields Trade Sector and Christie and Co Office

    are displayed and mandatory and MSG0023 displayed if not entered

    11c- BF11 End

    Verify that Title, Forename, Surname, Email Address, Confirmation Email Address, Country are mandatory

    and MSG0023 displayed if not entered.

    12a+ BF11 BF12

    Verify that where user selected option to be contacted by ABC rep then system generates reminder

    SGE0023.

    13a+ BF12 BF13 Verify that System displays read only summary of details entered.

    7i- BF8 AF05.1 TC19

    Identify Subcontractors working activities are (I) the installation of security systems, including burglar alarms, closed

    circuit televsion and public address systems.

    8a+ BF11 BF12 TC1 Subcontractor confirms the Correspondence address retrieved

    8b+ BF11 AF06.1 TC2 Subcontractor does not confirm the Correspondence address retrieved

    9a+ BF17 BF18 TC1 Subcontractor indicates he has not previously received any payments and has no verification number

    9b+ BF17 AF11.01TC2 Subcontractor indicates that he has previously received payments

    10a+ BF18 BF19 TC1 Subcontractor selects Gross Tax Treatment

    10b+ BF18 AF08.1 TC2 Subcontractor selects Net Tax Treatment

    11a+ BF19 BF20 TC1 Use Subcontractor for whom there is no Agent record held against the SubContractor on ODS

    11b+ BF19 AF07.1 TC3 Use Subcontractor for whom there is an Agent record held against the SubContractor on ODS

    12a+ BF20 BF21 TC1 Verify that the system has created the Subcontractor record?

    13a+ BF23 BF24 TC1 Subcontractor confirms 12 month activity history

    13b+ BF23 AF09.1 TC3 Subcontractor does not have a full 12 month activity history

    14a+ BF24 BF25 TC1 Contractor confirms Trading in the UK status BRUL62

    14b- BF24 ? Contractor does not confirm Trading in the UK Status BRUL62

    15a+ BF25 BF26 TC1

    Subcontractor is Individual application passing the standard turnover test - Individual turnover >= £30k during period up

    to 12 months preceding date of application BRUL77

    High Level Test Cases(Example)

    FLOW - Basic/Alt BF/AF1 BF BF BF BF BF BF BF BF BF BF Basic Flow

    Test Case Ref

    Test

    Case1

    Test

    Case2

    Test

    Case3

    Test

    Case4

    Test

    Case5

    Test

    Case6

    Test

    Case7

    Test

    Case8

    Test

    Case9

    Test

    Case10

    Test

    Case 11

    Test Case 12

    Priority 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+

    2a+ 2a+ 2a+ 2a+ 2a+ 2a+ 2a+

    3a+ 3a+ 3a+ 3a+ 3a+ 3a+ 3a+

    Steps/Verifications 4d+ 4e+ 4e+ 4e+ 4e+ 4a- 4b- 4c- 4f- 4g- 4h-

    5a+ 5b+ 5b+ 5b+ 5b+ 4b-

    (AF1) 6a+ 6a+ 6b+ 6b+ 4c-

    8a+ 8b+ 7a+ 7b+ 4f-

    9a+ 9a+ 9a+ 9a+ 4g-

    10a+ 11a- 4h-

    12a+ 11b-

    13a+ 11c-

    FLOW - Basic/Alt BF/AF1 BF BF BF BF BF BF BF BF BF BF Basic Flow

    Test Case Ref

    Test

    Case1

    Test

    Case2

    Test

    Case3

    Test

    Case4

    Test

    Case5

    Test

    Case6

    Test

    Case7

    Test

    Case8

    Test

    Case9

    Test

    Case10

    Test

    Case 11

    Test Case 12

    Priority 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+

    2a+ 2a+ 2a+ 2a+ 2a+ 2a+ 2a+

    3a+ 3a+ 3a+ 3a+ 3a+ 3a+ 3a+

    Steps/Verifications 4d+ 4e+ 4e+ 4e+ 4e+ 4a- 4b- 4c- 4f- 4g- 4h-

    5a+ 5b+ 5b+ 5b+ 5b+ 4b-

    (AF1) 6a+ 6a+ 6b+ 6b+ 4c-

    8a+ 8b+ 7a+ 7b+ 4f-

    9a+ 9a+ 9a+ 9a+ 4g-

    10a+ 11a- 4h-

    12a+ 11b-

    13a+ 11c-

    TC1

    TC1

    TC1

    TC1

    TC1

    TC4

    TC4

    TC5

    TC2

    TC2

    TC2

    TC2TC3

    TC6

    TC6

    TC6

    TC6TC6

    TC6

    X X

    FLOW - Basic/Alt BF/AF1 BF BF BF BF BF BF BF BF BF BF Basic Flow

    Test Case Ref

    Test

    Case1

    Test

    Case2

    Test

    Case3

    Test

    Case4

    Test

    Case5

    Test

    Case6

    Test

    Case7

    Test

    Case8

    Test

    Case9

    Test

    Case10

    Test

    Case 11

    Test Case 12

    Priority 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+

    2a+ 2a+ 2a+ 2a+ 2a+ 2a+ 2a+

    3a+ 3a+ 3a+ 3a+ 3a+ 3a+ 3a+

    Steps/Verifications 4d+ 4e+ 4e+ 4e+ 4e+ 4a- 4b- 4c- 4f- 4g- 4h-

    5a+ 5b+ 5b+ 5b+ 5b+ 4b-

    (AF1) 6a+ 6a+ 6b+ 6b+ 4c-

    8a+ 8b+ 7a+ 7b+ 4f-

    9a+ 9a+ 9a+ 9a+ 4g-

    10a+ 13a+ 11a- 4h-

    12a+ 11b-

    13a+ 11c-

  • Capgemini Technology Services© 2005 Capgemini - All rights reserved

    Eurostar 2005

    High Level Test Cases

    Benefits

    Coverage – conditions, rules

    Identify repetition

    Focus on objective(s) of each test case

    Consistency

    Negatives

    Abstract

  • Capgemini Technology Services© 2005 Capgemini - All rights reserved

    Eurostar 2005

    Detailed Test Cases

    Check Control Points

    Clear „Steps‟ or „Verifications‟?

    Executable test actions?

    Automated Script/Macro

    Find / Replace - references by Control Point text

    Update Control Points sheet with Test Case Numbers

    Transfer from Excel into Rational TestManager & mark key steps/verifications

  • Capgemini Technology Services© 2005 Capgemini - All rights reserved

    Eurostar 2005

    Detailed Test Case Design(Example)

    FLOW - Basic/Alt BF/AF1 BF BF BF BF BF BF BF BF BF BF Basic Flow

    Test Case Ref

    Test

    Case1

    Test

    Case2

    Test

    Case3

    Test

    Case4

    Test

    Case5

    Test

    Case6

    Test

    Case7

    Test

    Case8

    Test

    Case9

    Test

    Case10

    Test

    Case 11

    Test Case 12

    Priority 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+

    2a+ 2a+ 2a+ 2a+ 2a+ 2a+ 2a+

    3a+ 3a+ 3a+ 3a+ 3a+ 3a+ 3a+

    Steps/Verifications 4d+ 4e+ 4e+ 4e+ 4e+ 4a- 4b- 4c- 4f- 4g- 4h-

    5a+ 5b+ 5b+ 5b+ 5b+ 4b-

    (AF1) 6a+ 6a+ 6b+ 6b+ 4c-

    8a+ 8b+ 7a+ 7b+ 4f-

    9a+ 9a+ 9a+ 9a+ 4g-

    10a+ 11a- 4h-

    12a+ 11b-

    13a+ 11c-

    Control

    Point Id Step

    Next

    Step

    Included

    in Test

    Case Condition

    Business

    Rule /

    PreCond

    3a+ BF4 BF5 User selects option to continue TC1

    4a- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with < 5 characters BR2 TC6

    4b- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with > 7 characters BR2 TC6

    4c- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with > 5 and < 7 characters where 1st character is

    numeric BR2 TC6

    4d+ BF5 BF6

    Verify that entry is accepted when you enter PostCode

    for UK with > 5 and < 7 characters where 1st character is

    alphabetic BR2 TC1

    4e- BF5 End Verify that French postcode with 5 numerics is accepted BR2 TC6

    4f- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with < 5 numerics BR2 TC6

    4g- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with > 5 numerics BR2 TC6

    4h- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with 5 characters including non- numerics BR2 TC2

    5a+ BF6 AF1

    Enter person with valid email address already

    registered TC1

    5b+ BF6 BF7 Enter person without email address already registered TC2

    6a+ BF8 BF9

    Verify that addresses are displayed where a valid post

    code is entered which matches address

    6b- BF8 BF8.1.1

    Verify that MSG0049 is displayed when post code is

    entered for which there are no matching addresses

    7a+ BF8 BF9

    Verify that when user responds to MSG0049 confirming

    PostCode is correct then address fields are made

    enterable

    7b+ BF8 BF2

    User responds to MSG0049 confirming PostCode is not

    correct and reenters post code

    8a+ BF8 BF9

    Verify that when user selects an address then the screen

    address fields are populated

    8b+ BF8 BF9

    Verify that when user does not accept an address then

    screen address fields are made enterable

    9a+ BF10 BF11

    Enter Position, Business Name, Address, Subub, Town,

    County, Language Preference, Daytime Phone Numer,

    Evening Phone Number, Mobile Phone Number, 'How

    did You Find Out Question', Contact By ABC Rep?

    (Default No)

    10a+ BF10 BF11

    Verify that where user selects 'How Did You Find out?'

    then fields Trade Sector and Christie and Co Office are

    displayed.

    11a- BF11 End

    Verify that Address, Town, Language, one of phone

    numbers, 'How Did You Find Out' - are mandatory and

    MSG0023 displayed if not entered

    11b- BF11 End

    Verify that where user selects 'How Did You Find out?'

    then fields Trade Sector and Christie and Co Office are

    displayed and mandatory and MSG0023 displayed if not

    entered

    11c- BF11 End

    Verify that Title, Forename, Surname, Email Address,

    Confirmation Email Address, Country are mandatory and

    MSG0023 displayed if not entered.

    12a+ BF11 BF12

    Verify that where user selected option to be contacted

    by ABC rep then system generates reminder SGE0023.

    Control

    Point Id Step

    Next

    Step

    Included

    in Test

    Case Condition

    Business

    Rule /

    PreCond

    3a+ BF4 BF5 User selects option to continue TC1

    4a- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with < 5 characters BR2 TC6

    4b- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with > 7 characters BR2 TC6

    4c- BF5 End

    Verify MSG0019 is displayed when you enter PostCode

    for UK with > 5 and < 7 characters where 1st character is

    numeric BR2 TC6

    4d+ BF5 BF6

    Verify that entry is accepted when you enter PostCode

    for UK with > 5 and < 7 characters where 1st character is

    alphabetic BR2 TC1

    4e- BF5 End Verify that French postcode with 5 numerics is accepted BR2 TC6

    4f- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with < 5 numerics BR2 TC6

    4g- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with > 5 numerics BR2 TC6

    4h- BF5 End

    Verify MSG0019 is displayed when you enter French

    postcode with 5 characters including non- numerics BR2 TC2

    5a+ BF6 AF1

    Enter person with valid email address already

    registered TC1

    5b+ BF6 BF7 Enter person without email address already registered TC2

    6a+ BF8 BF9

    Verify that addresses are displayed where a valid post

    code is entered which matches address

    6b- BF8 BF8.1.1

    Verify that MSG0049 is displayed when post code is

    entered for which there are no matching addresses

    7a+ BF8 BF9

    Verify that when user responds to MSG0049 confirming

    PostCode is correct then address fields are made

    enterable

    7b+ BF8 BF2

    User responds to MSG0049 confirming PostCode is not

    correct and reenters post code

    8a+ BF8 BF9

    Verify that when user selects an address then the screen

    address fields are populated

    8b+ BF8 BF9

    Verify that when user does not accept an address then

    screen address fields are made enterable

    9a+ BF10 BF11

    Enter Position, Business Name, Address, Subub, Town,

    County, Language Preference, Daytime Phone Numer,

    Evening Phone Number, Mobile Phone Number, 'How

    did You Find Out Question', Contact By ABC Rep?

    (Default No)

    10a+ BF10 BF11

    Verify that where user selects 'How Did You Find out?'

    then fields Trade Sector and Christie and Co Office are

    displayed.

    11a- BF11 End

    Verify that Address, Town, Language, one of phone

    numbers, 'How Did You Find Out' - are mandatory and

    MSG0023 displayed if not entered

    11b- BF11 End

    Verify that where user selects 'How Did You Find out?'

    then fields Trade Sector and Christie and Co Office are

    displayed and mandatory and MSG0023 displayed if not

    entered

    11c- BF11 End

    Verify that Title, Forename, Surname, Email Address,

    Confirmation Email Address, Country are mandatory and

    MSG0023 displayed if not entered.

    12a+ BF11 BF12

    Verify that where user selected option to be contacted

    by ABC rep then system generates reminder SGE0023.

  • Capgemini Technology Services© 2005 Capgemini - All rights reserved

    Eurostar 2005

    Detailed Test Case Design(Example)

    FLOW - Basic/Alt BF/AF1 BF BF BF BF BF BF BF BF BF BF Basic Flow

    Test Case Ref

    Test

    Case1

    Test

    Case2

    Test

    Case3

    Test

    Case4

    Test

    Case5

    Test

    Case6

    Test

    Case7

    Test

    Case8

    Test

    Case9

    Test

    Case10

    Test

    Case 11

    Test Case 12

    Priority 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+

    2a+ 2a+ 2a+ 2a+ 2a+ 2a+ 2a+

    3a+ 3a+ 3a+ 3a+ 3a+ 3a+ 3a+

    Steps/Verifications 4d+ 4e+ 4e+ 4e+ 4e+ 4a- 4b- 4c- 4f- 4g- 4h-

    5a+ 5b+ 5b+ 5b+ 5b+ 4b-

    (AF1) 6a+ 6a+ 6b+ 6b+ 4c-

    8a+ 8b+ 7a+ 7b+ 4f-

    9a+ 9a+ 9a+ 9a+ 4g-

    10a+ 11a- 4h-

    12a+ 11b-

    13a+ 11c-

    Index Number 2 3

    TestManager Test sys-UC001-fnc-002 sys-UC001-fnc-003

    Priority (1- High, 2-

    Medium, 3-Low) Priority 1 Priority 2 Alt Flow 1 Alt Flow 2 Alt Flow 3Flow (Basic Flow /

    AF01 etc) BF BF2 BF2 BF2

    AF1.1 BF3 BF3

    Test Case Summary

    Valid basic flow - French Post Code, person

    without email address previously registered. User

    selects 'How did you find out?'

    Valid Basic Flow - user does not accept address

    displayed for post code AF1.2 AF2.1 BF4

    AF2.2 AF3.1

    Test Case Steps User selects option to Register User selects option to Register AF2.3 AF3.2

    User enters Title, Forename, Surname,

    Emai, Email Confirmation, Country, Other

    Country, Post Code, Accept Terms and

    Conditions, Accept Contact by ABC, Agree to

    Sharing Details, Option to Continue

    User enters Title, Forename, Surname, Emai,

    Email Confirmation, Country, Other Country,

    Post Code, Accept Terms and Conditions,

    Accept Contact by ABC, Agree to Sharing

    Details, Option to Continue AF3.3

    User selects option to continue User selects option to continue

    Verify that French postcode with 5 numerics

    is accepted?

    Verify that French postcode with 5 numerics is

    accepted?

    Enter person without email address already

    registered

    Enter person without email address already

    registered

    Verify that addresses are displayed where a

    valid post code is entered which matches

    address?

    Verify that addresses are displayed where a valid

    post code is entered which matches address?

    Verify that when user selects an address

    then the screen address fields are

    populated?

    Verify that when user does not accept an

    address then screen address fields are

    made enterable

    Enter Position, Business Name, Address,

    Subub, Town, County, Language

    Preference, Daytime Phone Numer, Evening

    Phone Number, Mobile Phone Number, 'How

    did You Find Out Question', Contact By ABC

    Rep? (Default No)

    Enter Position, Business Name, Address,

    Subub, Town, County, Language Preference,

    Daytime Phone Numer, Evening Phone Number,

    Mobile Phone Number, 'How did You Find Out

    Question', Contact By ABC Rep? (Default No)

    Verify that where user selects 'How Did You

    Find out?' then fields Trade Sector and ABC

    Offices are displayed.?

    Verify that System displays read only summary

    of details entered.?

    Verify that where user selected option to be

    contacted by ABC rep then system generates

    reminder SGE0023.?

    Verify that System displays read only

    summary of details entered.?

  • Capgemini Technology Services© 2005 Capgemini - All rights reserved

    Eurostar 2005

    Lessons Learned

    Lessons Learned

    • Flow charts

    • Single Flows

    • Over-complex

    • Referencing

    • Over-large test cases

    • Test Data – Embedded or external?

  • Capgemini Technology Services© 2005 Capgemini - All rights reserved

    Eurostar 2005

    Tips

    Expect changes

    • Address one at a time

    • Do we need to do this?

    • Could we do it smarter?

    • Is it repetitive ➙ automation?

    Focus on “Why?” before “How?”

    Tools

    • Does it do what I need?

    • Can I use what I already have?

  • Capgemini Technology Services© 2005 Capgemini - All rights reserved

    Eurostar 2005

    Benefits

    Traceability – easier to implement change

    Consistency – easier to share work

    Metrics & Estimation

    Easier to QA -

  • Systematic Test Design –

    A Smarter Strategy?

    [email protected]

    For us -

    “Definitely”

    Try it!