© Telcordia Technologies 2004 – All Rights Reserved AETG Web Service Tutorial AETG is a service...

© Telcordia Technologies 2004 – All Rights Reserved

AETG Web Service Tutorial

AETG is a service mark of Telcordia Technologies.Telcordia Technologies - Licensed MaterialAccess to this tutorial is provided solely to the registered users who have agreed to access and use the AETG Web Service according to the terms of the “Click-on license agreement” accepted during the registration process.

Page – 2


AETG Web Service

Create tests for:– Communications protocols– Feature interaction– Interoperability– Graphical User Interfaces (GUIs)– Contracts– etc.

Improves tester productivity by allowing a tester to create more, higher quality tests

Page – 3


AETG Web Service

WHAT - Helps testers design test sets. – Is especially helpful where combinatorial explosion of

input combinations is a problem. HOW - Tester provides input parameters and

parameter values. – AETG Web provides test cases with a specific value

for each parameter. AETG Web lets you choose the degree of

interaction between the parameters– E.g., degree of interaction = 2 means pair-wise

combinations

Page – 4


Example Scenario, part 1

Call Processing– Consider testing telephone-switch software – A call has the following characteristics:

Call Type: one of Local, Long Distance, International Billing: one of Caller, Collect, 800 Access: one of Loop, ISDN, PBX Result: one of Success, Busy, Blocked

– This scenario uses 4 input parameters, each with 3 possible values

Just using valid values in this example All combinations are valid.

Page – 5


Example Scenario, part 2

Each call characteristic is called a field– The AETG term for a test parameter

Values and relationships among fields appear in a relation

– The AETG term for a collection of fields that together model a test scenario

The AETG model that you will build in this tutorial will have:

– 4 fields (“call type”, etc.)– 1 relation with the 3 values for each field (“local”, etc.)

This basic example does not use any compounds or constraints

Page – 6


Numbers of Tests

Consider just 2 parameters: Call Type and Billing– Each has 3 distinct values. We need 3 x 3 = 9 tests to

test all possible combinations of two parameters. Consider all 4 parameters

– Testing all possible combinations of the 4 parameters requires 3 x 3 x 3 x 3 = 81 tests.

AETG Web can cover all pair-wise combinations of these 4 parameters with only 9 tests.

Page – 7


Using the AETG Web Service for the Example

In the basic tutorial you will– Create a Test Specification (TS)

Specify fields Specify relations (field interactions) Specify valid values

No invalid values

– Generate test sets– View, download, and print test sets

Page – 8


AETG Web Service - Access

Access URLhttp://aetgweb.argreenhouse.com

– Note that all access to the service uses secure http (i.e., https)

Any modern web browser should work– E.g., Firefox, Internet Explorer, Netscape, Mozilla

Page – 9


Click on “Log In”underRegisteredUsers

Access to user documentation requires login.

Please checkthe news page occasionally.

Home Page

Page – 10


Enter your user name & password to start a new session.

Please do not bookmark this page.

Note the “lock” icon in the browser.

Login Page

Page – 11


Bookmark this page!

Welcome Page

Page – 12


Steps to create a New Test Specification

1. Pick a name and create an empty test specification

2. Open the test specification for edit

3. Create all required fields in the spec

4. Create a relation

5. Select fields for that relation

6. Enter values for each field in the relation

Refer to Section 2 : Starting a Test Generation Session in the User Manual

Page – 13


This page shows folders and test specifications that you have defined.

Links allow you to create, delete, rename, etc.

Manage Specifications

Page – 14


Enter a new name (“calls”) and click on the “Add” link to create an empty test specification.

Enter name for the new specification

Page – 15


Select the specification name in the list box and click on the “Edit” link to open it.

Edit the newly created specification

Page – 16


Enter each field name, and click on the “Add” link.

Field names from the example:

Call_TypeBillingAccessResult

Create fields in the test specification

Page – 17


Fields created in the test specification

Page – 18


Enter a relation name, then click on the “Add” link.

Create a relation in the test specification

Page – 19


Next, click on the “Select Components” link to add fields to the relation.

Empty relation created in the test specification

Page – 20


Select all the fields, click on the >>Add>>” link.

Select fields for the newly created relation

Page – 21


All fields are now in the “Used” column. Click on the “Submit Selections” link at the bottom to save the changes.

Fields selected for the newly created relation

Page – 22


Click on the “Edit values” link next.

Relation with fields

Page – 23


Enter values, one per line, in the text boxes.

Click on the “Submit values” link to save changes.

Enter values for fields in the relation

Page – 24


Click on the “Generate tests” link next.

Generate tests

Page – 25


Output from test generator (top)

Next slide, please.

Page – 26


Click on the “View all test cases” link next.

Output from test generator (scrolled down)

Page – 27


Click on the “XML” link to view as XML.

Overview of generated tests

Page – 28


XML is easily processed by programs, such as in a test harness.

View generated tests as XML

Page – 29


View generated tests as spreadsheet (“DIF”)

Click on the “DIF” link from the results overview page to save or view the tests in spreadsheet format.

Page – 30


Duplicate Values

For performance, load balancing, or user data simulation purposes, we may want to ensure that certain values are represented more often than others

AETG Web will accept duplicate values for a parameter. Duplicate values are treated as if they are distinct.

Page – 31


Exercise

Modify the relation by inserting a duplicate value 800 for the parameter billing, then generate tests

– How many valid tuples does it find?– Are there more tests?– Does 800 occur more often than other values?

Remove the duplicate value & submit the relation.

Page – 32


Test Seeds

Seeds are used to specify tests that must be in the test set (for example, you specify pairwise interaction, but you want a particular triple to be in the test set)

Page – 33


Add seed tests

Click on the “Edit seeds” link to specify seed tests.

Page – 34


Choose values for seed tests

Use the pull-down selection boxes to choose a value for each member of the seed tuple, then click on the “Submit values” link to save changes.

Then click “Generate Tests”

Page – 35


Re-generate to include seed tests

Pairs covered by the seed are taken into account, so the addition of this seed test does not increase the total number of cases.

Choosing a different seed can cause the generator to require 9 or even 10 cases. The starting point has a big influence.

Page – 36


Generated tests with a seed test

The seed is the last test. Note that the valid tests are different from those created without the seed.

Page – 37


Exercises

Create a second seed for the relation, view the spec, and generate tests

Delete the seeds for the relation Generate tests for Interaction degree of

– 3 (triples)– 1 (no pair-wise coverage requested)

Note how many tests are created in each case

© Telcordia Technologies 2004 – All Rights Reserved AETG Web Service Tutorial AETG is a service...

Documents

Transcript of © Telcordia Technologies 2004 – All Rights Reserved AETG Web Service Tutorial AETG is a service...