Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client...

23
Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CT for Client Testing Press SPACE to advance through the slides.

Transcript of Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client...

Page 1: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

Unified Architecture TrainingCompliance Test Tool (UACTT)

Introduction to the UA CTTfor Client Testing

Press SPACE to advance through the slides.

Page 2: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

• Introduction

• Familiarization of User Interface

• Finding Help

• Test Tool Configuration

• Testing & Debugging

• Script Customization and Advanced Debugging

• Next Steps

UACTT Training - ClientContents

Page 3: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

© 2012 OPC Foundation 3

UACTT Training - ClientIntroduction (1 of 3)

What is it? A specialized UA Server & Client (hybrid)

designed to test a UA Client for compliance.

Where is it? http://www.opcfoundation.org/ua/ctt

Who can get it? OPC Foundation Corporate Members

What is tested? UA Servers and/or UA Clients

Coverage? Most base/core services.

Several UA profiles, more coming soon…

Extensible? Yes, you can add your own tests.

Easy to use? Yes, once you’ve learned the basics.

4/19/2012

UACTT

Your UA Server

Your UA Client

You

Page 4: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

© 2012 OPC Foundation 4

UACTT Training - ClientIntroduction (2 of 3)

4/19/2012

How it works: Each Service is tested manually to see:

a. if a service-call is made correctly

b. if the client handles valid responses correctly

c. if the client handles invalid responses correctly

Test authors? Compliance Working Group

Developers? Compliance Working Group

Can I help? Absolutely! We always need help creating test-

cases and test-scripts, and for testing.

Contact [email protected]

Page 5: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

© 2012 OPC Foundation 5

UACTT Training - ClientIntroduction (3 of 3)

How do I pass? Your product must pass all tests in all selected

profiles and/or conformance units.

Am I Certified? Passing the UACTT does not mean you are certified

by the OPC Foundation. It means that your product is

ready for certification in a Test Lab.

CTT used in Lab? The Certification Test Labs use the same

version.

Use CTT When? The best time is during product development. All UA

products must pass the UACTT prior to release.

Additional Help: Complete help-documentation is provided with the

UACTT. Test-case documentation is also provided.

4/19/2012

Page 6: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

© 2012 OPC Foundation

6

UACTT Training - ClientLaunching UACTT (1 of 1)

4/19/2012

Windows Vista/7:Start > All Programs > OPC Foundation >Unified Architecture > Compliance Test Tool > Compliance Test Tool (CTT)

Windows 8:Start > Compliance Test Tool (CTT)

Page 7: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

© 2012 OPC Foundation 7

UACTT Training - ClientFamiliarization (1 of 4)

4/19/2012

There are (by default) 3 “widgets” to the right:• Help: quick access to documentation• Objects: simple listing of UA object names• Object Properties: simple listing of properties and methods of the currently

selected object.

Page 8: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

© 2012 OPC Foundation 8

UACTT Training - ClientFamiliarization (2 of 4)

4/19/2012

There are (by default) 3 “widgets” to the left:• Profiles: A list of all UA Client Profiles.• Conformance Units: A list of all UA Client Conformance Units and of all test-scripts.• Library: An area where reusable script components are stored.

Page 9: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

© 2012 OPC Foundation 9

UACTT Training - ClientFamiliarization (3 of 4)

4/19/2012

There are (by default) 3 “widgets” at the bottom:• Results: a hierarchical audit-log of test activities and results.• Script Output: a verbose trace of test-script activity.• Trace: a generalized trace of UACTT activity.

UA Service calls are listed here

See the complete details of each Service call

request and response here

Page 10: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

© 2012 OPC Foundation 10

UACTT Training - ClientFamiliarization (4 of 4)

4/19/2012

The Client Trace widget contains a powerful Filter capability for selecting which UA calls to list in the trace.Checked services are displayed; unchecked are hidden (but still logged).

Page 11: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

© 2012 OPC Foundation 11

UACTT Training - ClientFinding Help (1 of 2)

4/19/2012

Complete documentation is available from the Contents option in the Help menu. Documentation includes a user-guide and other useful testing tips.

Page 12: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

© 2012 OPC Foundation 12

UACTT Training - ClientFinding Help (2 of 2)

4/19/2012

All test-cases used by the Lab are exported into HTML pages that are available with the UACTT. Test-case documentation can be launched from the main documentation or from the Help widget.

Page 13: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

© 2012 OPC Foundation

13

Normally, a Client connects to a Server directly. When using the UACTT we must force the Client to connect to the CTT; the CTT will connect to the UA Server – as a proxy.

UACTT Training - ClientTest Tool Configuration (1 of 6)

Normal Client/Server relationship Using CTT as a Gateway

4/19/2012

UACTT

Your UA Server

Your UA Client

The CTT acts as a “pass through”

Your UA Server

Your UA Client

You

You

Page 14: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

© 2012 OPC Foundation 14

After launching the UACTT you must create a new Project. You must choose a Server or Client project type, and then specify the project name and save-location.

UACTT Training - ClientTest Tool Configuration (2 of 6)

4/19/2012

The newly created CTT project contains a copy of all test-scripts, script library, and a

certificate store.

Page 15: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

© 2012 OPC Foundation 15

We must configure the CTT to connect to the UA Server and also to expose an endpoint for the UA Client…

UACTT Training - ServerTest Tool Configuration (3 of 6)

4/19/2012

Step 3. Click the OK button.

Step 1. Enter the EndPoint URL for the UA Server you

want to consume data from.

Note: The Advanced folder contains settings that can be

ignored.

Step 2. Copy the “Endpoint URL” value and paste it into your Client.

Page 16: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

Here’s a real-world setup using the OPC Foundation DataAccess sample Server & Client… (a) DA Client to CTT (Endpoint URL); (b) CTT to DA Server (Underlying Server URL).

UACTT Training - ServerTest Tool Configuration (4 of 6)

4/19/2012 © 2012 OPC Foundation 16

Page 17: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

© 2012 OPC Foundation 17

Your Client will probably call FindServer or GetEndpoints and then bypass the CTT. To avoid this we must modify FindServers/GetEndpoints so all EndpointUrls’ point to the CTT.

UACTT Training - ServerTest Tool Configuration (5 of 6)

4/19/2012

Step 1. Open (double-click) Start-FindServers-Intercept.js

from the Library

Step 2. Click Execute current script…

Step 3. In your UA Client: make your connection to the

UA CTT endpoint…

Step 4. The UA CTT will inject its own Endpoint into

FindServers and GetEndpoints

Page 18: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

© 2012 OPC Foundation 18

You UA Client should now be connected to your UA Server via the UA CTT…

UACTT Training - ServerTest Tool Configuration (6 of 6)

4/19/2012

Page 19: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

© 2012 OPC Foundation 19

First, test a UA Client’s normal behavior, such as a Read operation and observe the behavior…

UACTT Training - ClientTesting & Debugging (1 of x)

4/19/2012

Step 1. Observe the natural “call” made

by the UA Client.

Step 2. Double-click a script to be used for testing…

Step 3. Click Execute current script…

Step 4. Invoke the Read operation in your UA Client and observe the

behavior of your UA Client.Here, the purple line indicates the UACTT has modified the original

server response (to force an error).

Page 20: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

When ready to move onto the next UA Service call to test, you will probably need to clear the event handler to prevent further injections. Here’s how…

UACTT Training – ClientTesting & Debugging (2 of x)

Step 1. Double-click DetachHandlers.js…

Step 2. Click Execute current script…

Step 3. Open your next script (for testing) in the next

[applicable] conformance unit.

Page 21: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

© 2012 OPC Foundation 21

You can add your own scripts to a conformance unit! Here’s how…

UACTT Training - ClientScript Customization

4/19/2012

Page 22: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

© 2012 OPC Foundation 22

UACTT Training - ServerNext Steps…

Once your UA Client passes all applicable tests:

• Conduct Interoperability Testing

• Conduct Behavior Testing

• Conduct Resource-efficiency Testing

• Request Certification in the Test Lab:http://www.opcfoundation.org/Compliance-Certification/A1-Application.pdf

4/19/2012

This information is available in the

CTT Test-Cases help pages.

Page 23: Unified Architecture Training Compliance Test Tool (UACTT) Introduction to the UA CTT for Client Testing Press SPACE to advance through the slides.

Download: www.opcfoundation.org/ua/ctt

Certification: www.opcfoundation.org/certification

Lab Testing: http://www.opcfoundation.org/lab/signup

Bug Tracker: www.opcfoundation.org/mantis

Contact: [email protected]

UACTT Training - ClientThe End!