© Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration...

21
© Copyright 2006-2014, Inflectra Corporation Page: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

Transcript of © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration...

Page 1: © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

© Copyright 2006-2014, Inflectra Corporation Page: 1

Product OverviewTest Automation Integration for SpiraTest® and SpiraTeam®

Page 2: © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

© Copyright 2006-2014, Inflectra Corporation Page: 2

Contents

Test Automation Overview Remote Launch Walkthrough Setting up SpiraTest / SpiraTeam Overview of Available Engines

QuickTest Professional Froglogic Squish TestComplete Selenium Remote-Control SmarteScript Soap-UI FitNesse LoadRunner NeoLoad

Page 3: © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

© Copyright 2006-2014, Inflectra Corporation Page: 3

Test Automation Overview

Automated test scripts are a valuable way to perform regression testing on applications to ensure that new features or bug fixes don’t break existing functionality.

They typically supplement manual testing which is more efficient at the testing of new features and capabilities.

For complete test coverage you need to perform the same automated tests across a complete spectrum of platforms, browsers, devices and environments.

Using RemoteLaunch® with SpiraTest / SpiraTeam allows you to manage the automated testing process. Track the automated tests against the project’s requirements Have a holistic view of manual and automated testing

Page 4: © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

© Copyright 2006-2014, Inflectra Corporation Page: 4

Test Automation Architecture

You install RemoteLaunch on each computer (called a host) that will be running automated tests, for example:

SpiraTest®Repository

Host #1Windows 2008

IE 8.0

Host #2Windows VistaMozilla Firefox

Host #3Ubuntu Linux

Google Chrome

RemoteLaunch®

RemoteLaunch®

RemoteLaunchX®

ManualTester #3

ManualTester #2

ManualTester #1

Page 5: © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

© Copyright 2006-2014, Inflectra Corporation Page: 5

Test Automation - Installation

Install RemoteLaunch® on each of the automation hosts that will be running automated tests

Install the appropriate plugins for the different automation engines that will be running on that host Configure the plug-in if necessary

Assign a unique name (called the token) to the host Point the instance of RemoteLaunch to your SpiraTest

server and set the polling interval

Installation

Page 6: © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

© Copyright 2006-2014, Inflectra Corporation Page: 6

Test Automation - Configuration

Create the list of automation hosts inside SpiraTest Should include all computers have RemoteLaunch installed

Create the list of automation engines inside SpiraTest Should include all the automation engines that have a plug-in

installed inside RemoteLaunch

Test that all instances of RemoteLaunch can connect to SpiraTest

Installation Configure

Page 7: © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

© Copyright 2006-2014, Inflectra Corporation Page: 7

Test Automation – Test Scripts

Either create new test cases in SpiraTest or reuse existing manual test cases for test automation: Select the automation engine that will be used for the script Either upload the script into the test case or provide a link to it

Add parameters to the test case They can be used to change how the test script operates

Make sure that the test cases are mapped to the appropriate requirements and releases in SpiraTest

Installation ConfigureTest Script

Creation

Page 8: © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

© Copyright 2006-2014, Inflectra Corporation Page: 8

Test Automation – Test Scheduling

Create one or more test sets in SpiraTest to hold the automated test cases

Add the automated test cases to the test set and if appropriate specify the parameter values to pass to the test case

Specify the automation host that will run the test set and what date/time it should be executed

Installation ConfigureTest Script

CreationTest

Scheduling

Page 9: © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

© Copyright 2006-2014, Inflectra Corporation Page: 9

Test Automation – Test Execution

RemoteLaunch instances will periodically contact the SpiraTest server to see when the next test needs to be executed

When the planned date/time of the test set is reached, RemoteLaunch will activate, launch the test automation tool, capture the results and transmit back to SpiraTest

The testing results are stored in SpiraTest and the test status of the test cases and requirements will be updated

Installation ConfigureTest Script

CreationTest

SchedulingExecution

Page 10: © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

© Copyright 2006-2011, Inflectra Corporation Page: 10

RemoteLaunch Walk-Through

Page 11: © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

© Copyright 2006-2014, Inflectra Corporation Page: 11

Installation and Configuration

Install RemoteLaunch on each of the automation hosts

Specify the SpiraTest server to connect to

Configure the polling interval and other execution parameters

Page 12: © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

© Copyright 2006-2014, Inflectra Corporation Page: 12

Status Display

The Status tab will display the current status of Remote Launch: Idle Executing a test Paused

You can force RemoteLaunch to immediately launch a test set in its queue before the planned date/time

Page 13: © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

© Copyright 2006-2014, Inflectra Corporation Page: 13

Test Execution Engines

The plug-ins for the different test automation engines should be copied into the “extensions” folder

The plug-ins will be displayed in the “About Spira RemoteLaunch” dialog box

You can configure plug-in specific parameters inside RemoteLaunch

Page 14: © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

© Copyright 2006-2014, Inflectra Corporation

RemoteLaunchX – Cross-Platform Automation

In addition to RemoteLaunch® that runs on Microsoft Windows, there is RemoteLaunchX™ that is written in 100% Java and can be used on: Linux (Ubuntu, Redhat, etc.) Mac OS X Any platform that can run Java 1.7+

Page: 14

#This file contains the configuration data used by the RemoteLaunch-X #Spira connection informationserver-url = http://vm-win2012r2/SpiraTeamserver-login = fredbloggsserver-password = PleaseChange #The automation host tokenhost-token = MyHost1 #The regular expressions for each of the possible execution statusespass-regex = .*fail-regex = .*(Error|Fail|Fatal).*caution-regex = .*(Warning|Caution).*blocked-regex = .*(Blocked).*

Page 15: © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

© Copyright 2006-2011, Inflectra Corporation Page: 15

Setting up SpiraTest / SpiraTeam

Page 16: © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

© Copyright 2006-2014, Inflectra Corporation Page: 16

Test Automation Engines - Configuration

The various automated test engines that will be used in SpiraTest need to be configured to match the plug-ins installed in RemoteLaunch.

Page 17: © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

© Copyright 2006-2014, Inflectra Corporation Page: 17

Test Automation Hosts - Configuration

The automated test scripts managed in SpiraTest / SpiraTeam can be either executed on the local machine or scheduled for execution on a series of remote hosts.

The local machine and/or remote hosts must all be running an instance of RemoteLaunch ® that is pointing o the central SpiraTest / SpiraTeam server.

Page 18: © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

© Copyright 2006-2014, Inflectra Corporation Page: 18

Test Cases – Attaching Scripts

You attach test automation scripts to existing test cases in SpiraTest / SpiraTeam. The results of the test execution will be reported back as automated Test Runs in SpiraTest / SpiraTeam.

Page 19: © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

© Copyright 2006-2014, Inflectra Corporation Page: 19

Test Sets – Scheduling for Automation

You create a test set per automation host, add the automated test cases and then specify the execution date / time.

Page 20: © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

© Copyright 2006-2011, Inflectra Corporation Page: 20

Available Engines

Page 21: © Copyright 2006-2014, Inflectra CorporationPage: 1 Product Overview Test Automation Integration for SpiraTest® and SpiraTeam®

© Copyright 2006-2014, Inflectra Corporation Page: 21

Automated Functional Testing Tools

RemoteLaunch® can integrate with a variety of automated functional and load testing tools.

Functional Testing: HP QuickTest Pro™ Selenium Remote-Control SmartBear TestComplete™ Froglogic Squish® SmarteScript™ FitNesse Eviware SoapUI

Performance/Load Testing: HP LoadRunner load-testing system Neotys load testing system