Application Testing Suite 12.2 New Features & …...13 ATS 12.2 New Features and Updates: Oracle...

1

Application Testing Suite

12.2 New Features & Updates

Yutaka Takatsu

ATS Group Product Manager

Oracle Enterprise Manager - ATS

2

ATS 12.2 - New Features and Updates: OpenScript Functional Testing

• OpenScript - JD Edwards Functional Testing Module • Provides JD Edwards EnterpriseOne Functional-Specific Application Programming Interface (API)

• OpenScript - Command Line Tools Interface OSCLTI Compiler : Compile Scripts from CLI. No need to open script in OpenScript UI for re-compilation

OSCLTI Asset Updater : Add/Change Assets from CLI. No need to open script & configure assets in OpenScript UI

• Functional Testing Support for Linux Command-Line Playback in Firefox • Playback pre-recorded Web & ADF functional test scripts from the command-line interface on Linux through a Firefox browser

• OpenScript - OpenScript -Capture Screenshots Options • Allows users to select either to capture entire screen, or only browser content

• OpenScript - Capture Screenshot on Failure • New Option to capture entire screen at the time of the failure that helps you analyze the root cause of the failure

• OpenScript - Assets Tab • Provides a single click access to the Assets configuration dialog to add/edit script assets

• OpenScript - ADF Functional Testing DVT (Data Visualization Tool) Control Support • Validation on ADF Gauge, Record & Playback click action and validation on ADF Graph components

• Support for Firefox 10 ESR

3

ATS 12.2 New Features and Updates: OpenScript JD Edwards Functional

Testing Module

• New JD Edwards Functional Testing module for testing JD Edwards EnterpriseOne applications 9.0 and 9.1 with Grid Controls

• Provides JD Edwards EnterpriseOne Functional-Specific Application Programming Interface (API).

• Extension module to the OpenScript Web Functional Test Module

• Easier script creation with better record/playback that reduces your manual scripting time when testing JDE EOne application with Grid Controls

• Supported browsers are Internet Explorer (for Recording JDE EOne 9.0 and 9.1) and FireFox (for JDE EOne 9.1)

Select JD Edwards

EnterpriseOne Module in

the Test Wizard to create

your functional testing script

Actions made on JDE ONE

Grid components are captured

as EOne commands

eone command in Java Code

View.

Actions made on NON- Grid

components are captured as

Web commands

4

ATS 12.2 - New Features and Updates: OpenScript Command Line Tools

Interface

• An umbrella interface for running OpenScript command-line tools that include: OSCLTI Compiler : Compile Scripts from CLI. No need to open script in OpenScript UI for re-compilation


5

No Change

No Re-Compilation

File Modified


Interface - OSCLTI Compiler

OSCLTI Compiler use case: “You have a command Line based testing

framework. Due to an environment change, you

need to modify the URL in all of your 100 scripts”

Changes are not taking effect when you

run scripts from the command line. This

is because re-compilation is required

when scripts are modified.

This can be done using 3rd party tools

like GREP to find and replace the URL

in all script.java files. However, this

requires re-compilation.



Using OpenScript CLI, perform mass

compilation that updates all the script

under specified folder .

Because already re-compiled, all 100

scripts are running in the command line

wit the updated URL.

osclti compile

-rootFolder

"D:\OracleATS\OFT\Work" Why am I happy? I can do this WITHOUT opening each of the 100 scripts in OpenScript UI

6


Interface - OSCLTI Asset Updater

OSCLTI Asset Updater use case: “You have a requirement to add a new databank

file, and change the location of existing script

asset to all of your 100 scripts.”

This can be done in OpenScript UI, by

opening each script and apply change

manually to update assets. However you

don’t want to repeat this 100 times.



Using OpenScript CLI, perform

mass update that adds new or

changes existing assets to all the

scripts under specified folder .

osclti updateAssets -add -

rootFolder

"D:\OracleATS\OFT\" -type

databank -asset

alias=data1:Default/DataB

ank/data1.csv

Why am I happy? I can do this WITHOUT opening each of the 100 scripts in OpenScript UI

New databank was added and script

location was changed, for all 100 scripts

7

ATS 12.2 - New Features and Updates: Functional Testing Support for Linux

Command-Line Playback in Firefox

• Playback pre-recorded Web and ADF functional test scripts from the command-line interface on Linux through a Firefox browser

• Oracle ATS agent should be installed on the Linux server at a minimum.

• Playback ONLY feature. Recording and Debugging require Windows system.

• Mount the remote OpenScript script repository (Windows shared directory) on Linux before running the Web or ADF script.

• Supported command line options are described in OpenScript User's Guide, Appendix A: Script Command Line Reference.

Make sure OATS Helper Service is running !

//To START Oracle ATS Helper service:

sudo /sbin/service OracleATSHelper start

//To STOP Oracle ATS Helper service:

sudo /sbin/service OracleATSHelper stop

//To RESTART Oracle ATS Helper service:

sudo /sbin/service OracleATSHelper restart

//To CHECK Oracle ATS Helper service status:

sudo /sbin/service OracleATSHelper status

Playback Functional Testing scripts

in FireFox browser in Linux

8

ATS 12.2 - New Features and Updates: OpenScript -Capture Screenshots

Options

In 12.2, Capture Screenshot allows you

to select to capture either entire screen,

or browser content only

Browser Content Only

Entire screen

• New options for Capture Screenshots in OpenScript preference (Functional Testing)

• Allows users to select either to capture entire screen, or only browser content, for recording and playback

• Only Capture Browser Content : Provides easier analysis by comparing screenshots of browser only contents for recording and playback

• Capture Entire Screen : Captures Entire screen to include the browser’s status bar messages, or non-browser factors for extended analysis

Easier to compare as screenshots do not include

extra desktop contents!

Captures browser’s status-bar, or Non-browser

factors that can affect the playback status

9

In prior to 12.2, Screenshots are captured

when a page is loaded. (WaitForPage ).

But what you really want to know is what

happened at the time of the failure

ATS 12.2 - New Features and Updates: OpenScript - Capture Screenshot on

Failure

When “Capture entire screen on fail” is

checked, OpenScript saves the screenshot

at the time of the script failure which helps

you finding the root cause of the failure.

• New Option “Capture entire screen on fail” in the OpenScript preference

• Captures Screenshot of the entire screen at the time of the script failure

• Provides visual information on what happened to the application

• Helps you analyze the root cause of the failure Screenshot at the time of the failure.

“hey, the button was disabled..”

10

ATS 12.2 - New Features and Updates: OpenScript - AssetsTab

Prior to12.2, Script assets

were configured in a

separate dialog

12.1

• 12.2 Provides New “Assets” tab within a Script pane

• Single click access to the Assets configuration dialog to add/edit script assets.

• More convenient design for users frequently update script assets.

Click Script select Script properties.. Open dialog, click

Assets...

12.2 provides quick access

to the Script assts, by new

“Assets” Tab

12.2 A single click from the script view, to configure

script assets.

11

ATS 12.2 - New Features and Updates: OpenScript - ADF Functional Testing

DVT (Data Visualization Tool) Control Support

Record click action and verify

Graph objects

Verify Graph objects with

Object Test

• ADF DVT Control Support provides: • Validation on ADF Gauge and ADF Graph components.

• Record & Playback click action on ADF Graph components

ADFDVTGauge: Verify the object attributes

(no action recording)

ADFDVTGraph : Record “click” action and Verify

the object attributes

12

ATS 12.2 - New Features and Updates: OpenScript Other Updates

• Support for Firefox Browser10 Extended Support Release

• Automatically Dismiss Javascript Alert Dialogs during the playback

OpenScript 12.2 supports FireFox

10 ESR for recording and playback

Functional Testing scripts

New option to automatically

Dismiss javascript alert

dialogs during the playback

Automatically Dismiss JS Alert Dialogs

Support for Firefox 10 ESR for functional Testing

13

ATS 12.2 New Features and Updates: Oracle Load Testing and Oracle Test Manager

• Block Scenarios Module • Add scripts and script blocks that contain one or more scripts as well as child blocks.

• Create complex scenarios, with multiple execution paths

• Configure distribution of the execution paths by percentage (% ) and Iterations (x2, x3..)

• Oracle Load Testing Hardware Estimation • Provides an estimate of the hardware requirements for a given scenario.

• Generates a report that determines how much h/w will likely be required to run the specified load test scenario, and how

to modify the session configurations to run more Virtual Users on one machine.

• Supported load testing modules in 12.2: Web/HTTP, Oracle Fusion/ADF, Oracle Siebel, Oracle EBS/Forms.

• Oracle Load Testing Support for Functional Test Scripts

• Playback functional test scripts as part of an Oracle Load Testing application scenario.

• Hyperion & PeopleSoft Load Module • Easier load testing script creation for testing Oracle PeopleSoft & Hyperion applications.

• Includes new PeopleSoft / Hyperion Correlation Libraries that provide enhancements to Web/HTTP load testing scripts.

• Oracle Test Manager Administrator role-based field security settings

14

ATS 12.2 New Features and Updates: Oracle Load Testing- Block Scenarios

Module

• Add scripts and script blocks that contain one or more scripts as well as child blocks.

• Create complex scenarios, with multiple execution paths

• Configure distribution of the execution paths by percentage (% ) and Iterations (x2, x3..)

Create Block Scenario Script

In Parent Block, 70 % of

the time the Search runs

twice, and 30 % chance

Child Block will run

In Child Block, there is a

40 % chance the

ViewPortofolio runs, and

a 60% chance that the

ViewSummary will run

In the Block XML Tree, Add scripts, functions and blocks to the Block Tree, and configure the

distribution of the paths by percentage and iterations

Always Run Login once

Always Run Logout once

NOTE: Distribution is random within blocks. However running a scenario in OLT to generate

a large enough sample size, the results should be close to the specified percentages.

Add scripts, and dedicated function library scripts to the block script as script assets.

15

ATS 12.2 New Features and Updates: Oracle Load Testing - Hardware

Estimation

• Provides an estimate of the hardware requirements for a given scenario.

• Generates a report that determines how much h/w will likely be required to run the specified load test scenario,

and how to modify the session configurations to run more Virtual Users on one machine.


Select a Scenario and click Estimate. Agent runs

the scripts in the background and collect s H/W

consumption data for a single VU per scenario.

OLT estimates the H/W consumption for

the # of Vus and thinktime specified

in the scenario. Click View Report to

display the report in the Report Tab.

Estimated consumption for each script running on the corresponding agent

Hardware configuration for each agent (CPU, RAM, Network bandwidth)

Estimated number of required machines, and suggested

configurations for better performance

Idle resources in the agent system

NOTE: HW estimation tool is not suitable for block scenario

scripts which has more than one execution path in a single script

16

Why is HW estimation Tool Useful? See Manual HW estimation Before 12.2 (Below shows the easiest HW sizing estimation method before 12.2)

In 12.2, HW estimation tool will do all the hard work for you!

• A question “what hardware is needed in order to run X number of Virtual Users” involves

many factors (script type & size, delay settings etc.), and is not an easy one to answer.

• Key configuration needed to identify is the “max JVM heap size” in OLT scenario. Basically, you

need to find out the total memory size required for agent machines, to run your load test.

• First measure a heap size required for a single VU for a given scenario. Then you can estimate

the total heap required : heap per single VU x Total # of VUs = Total heap size required.

• How can you measure a heap per single VU? You can run a load test by setting a small heap

size and see where it maxes out . For example, run a session with agent heap set to1GB,

although you know that is not enough to run your scenario.

• Say your test session was terminated by Out of Memory error when it reached a total # of 500

VU. From this test data, you can estimate 1000MB divided by 500VU = 2MB (1000/500=2) of

heap required per single VU.

• If you want to run a 3000 VU test with the same scenario, (same set of scripts with the same

delay settings), you can estimate that 6 GB (2MB x 3000VU = 6GB) is required for the total

agent heap.

• You need to prepare for agent systems with total RAM greater than 6GB in size.

Total Agent

MEMORY ?

OLT Server OLT Agent AUT

OUT OF

MEMORY

@ 500 VUs

1G Agent

Heap

1000MB divided by 500VU = 2MB

A Single VU requires 2 MB heap

for this scenario

OLT Server OLT Agent AUT

To run3000 VUs

6GB Agent Heap

is required

Note: Alternatively monitoring can be done

by profiling agent resource consumption

using JRockit Mission Control.

17

ATS 12.2 New Features and Updates: Oracle Load Testing - Hardware

Estimation

• Provides an estimate of the hardware requirements for a given scenario.

• Generates a report that determines how much h/w will likely be required to run the specified load test scenario,

and how to modify the session configurations to run more Virtual Users on one machine.


Select a Scenario and click Estimate. Agent runs

the scripts in the background and collect s H/W

consumption data for a single VU per scenario.

OLT estimates the H/W consumption for

the # of Vus and thinktime specified

in the scenario. Click View Report to

display the report in the Report Tab.

Estimated consumption for each script running on the corresponding agent

Hardware configuration for each agent (CPU, RAM, Network bandwidth)

Estimated number of required machines, and suggested

configurations for better performance

Idle resources in the agent system

NOTE: HW estimation tool is not suitable for block scenario

scripts which has more than one execution path in a single script

18

ATS 12.2 New Features and Updates: Oracle Load Testing - Support for Functional

Test Scripts • Playback functional test scripts as part of an Oracle Load Testing application scenario.

• Linux: Firefox browser and VNC required

Windows: OLT server must run on Windows 2008 R2 in order to use this feature. RDP service is also required

Functional Test Scripts

show up in Blue icon

Load Test Scripts show up

in Green icon

View Functional Scripts

running in a RDP window

• Measure end-user response time (such as Stop watch Time) by running a functional testing script in a load session.

• Enable easier debugging when VUs fail with script errors, by looking at the browser contents.

• Use as an alternative to OTM to run multiple Test Cases.

Using the feature you can..

19

ATS 12.2 New Features and Updates: Oracle Load Testing -PeopleSoft &

Hyperion Load Testing Accelerators

• Easier load testing script creation for testing Oracle PeopleSoft & Hyperion applications.

• Includes new PeopleSoft / Hyperion Correlation Libraries that provide enhancements to Web/HTTP load testing scripts.

regular expression patterns for the selected correlation rules that will be auto-correlated during the recording

NEW!

NEW!

Correlation libraries include pre-configured variables for

parameters specific to PeopleSoft & Hyperion Applications

20

Restrict permissions for “Owner”

filed in ATS Administrator A User who has a QA Engineer role

signs in to Oracle Test Manager

Only QA Manager can

modify the field

“Owner” field is disabled, while he can

modify the other fields in the window

ATS 12.2 New Features and Updates: Oracle Test Manager Administrator -

Oracle Test Manager role-based field security

• Allows Oracle Test Manager administrator to specify which roles have read/write permissions and which roles have

read-only permission for specific fields.

• When adding or editing fields or field options, a Permissions link in the dialog box provide access to the

Permissions settings for the selected field or field option.

21

Oracle Application Testing Video Trainings

More on ATS, please visit Oracle Application Testing Suite 12.x Video Training Series

in Oracle Learning Library from the URL:

http://apex.oracle.com/pls/apex/f?p=44785:24:0::::P24_CONTENT_ID,P24_PREV_PAGE:6587,1

Available ATS contents

Functional Testing:

Oracle OpenScript for Functional Testing Overview

Load Testing:

Oracle Load Testing Overview

OpenScript for Load Testing Script Troubleshooting

OpenScript for Load Testing Hands-on Lab Exercise

Test Management

Oracle Test Manager Overview

http://apex.oracle.com/pls/apex/f?p=44785:24:0::::P24_CONTENT_ID,P24_PREV_PAGE:6587,1

22

Thank you!

Application Testing Suite 12.2 New Features & …...13 ATS 12.2 New Features and Updates: Oracle...

Documents

Transcript of Application Testing Suite 12.2 New Features & …...13 ATS 12.2 New Features and Updates: Oracle...