Automatic Query Test With RSTT - Webinar Presentation

5/13/2018 Automatic Query Test With RSTT - Webinar Presentation - slidepdf.com

http://slidepdf.com/reader/full/automatic-query-test-with-rstt-webinar-presentation 1/50

Aut om at i c Tes tof Quer i esw i t h RS Trac e Too lTobias KaufmannSAP AG

Walldorf, August 2007



Overview

Prerequisites

Trace

CATT Trace

Test PackageTest Job

Test Result

Summary



SAP AG 2007, Automatic Test of Queries / Tobias Kaufmann / 3

Mot iva t ion

Current Situation

SAP ensures correctness of standard test cases

Standard test cases do not cover all customer test cases

Customer test cases require testing in customer system

Proposed Situation

Trace Tool is used to record navigation steps and data of customer-specific Queries

Trace Tool is used to compare actual data with recorded referencedata

Reduce manual test effort for customer




Use cases

After applying Notes or Support Packages

Ensure runnable Queries (no syntax error)

Ensure correctness of Query results

After loading Data (InfoProvider and Master Data)

Ensure correctness of cache and/or BI Accelerator

Warm-up OLAP cache




Autom at ic T est o f Quer ies

General Procedure

1. Prepare Test by recording navigation steps and reference data

2. Apply Notes or Support Packages

3. Replay Test

Transaction RS Trace Tool (transaction code RSTT)

Definitions

Trace is a sequence of navigation stepswith Checkable Program Objects

CATT Trace is a Trace

with recorded Reference Data Test Package bundles several CATT Traces

Test Job is a scheduled jobwith Test Package

Test Package

Test Job

CATT Trace

Trace




Reference Dat a and Focus of Test

Comparison of Reference Data and actual Data

Fix Master and InfoProvider Data is required

Fix Metadata (definition of Query, InfoObject, etc.) is required

Restrict to specific date (e.g. restrict to 2006 or 2005)

Restrict to specific characteristic values (master data)

Scope of Test

OLAP functionality (incl. figures and ABAP syntax)

Productive or test system

No BEx Web (ABAP and Java Runtime) functionality

No BEx Analyzer (Excel) functionality

Use transaction RSRT2 (HTML view) to record navigation steps




Det a i led Procedure (1)

Trace

CATT Trace

Test Package

Test Job

NotesSupport Packages

Query

2. Record navigation steps3. Create CATT Trace

based on Trace

5. Bundle CATTTraces to Test Package

4. RecordReference

Data

6. Schedule TestPackage in Test Job

8. Apply Notes orSupport Packages

10. Analyze Log ofTest Job

11. Identify erroneous

CATT Trace

12. Check erroneousCATT Trace manually

1. Activate User for Tracing

InfoProvider /Master Data

9. RunningTest Job

7. Load InfoProvideror Master Data




Det a i led Procedure (2)

Prepare Test

1. Activate User for Tracing using transaction RSTT

2. Record navigation steps in query as Trace

3. Create CATT Trace based on Trace

4. Record Reference Data of CATT Trace

5. Bundle CATT Traces to Test Package

6. Schedule Test Package in Test Job

Change System

7. Load InfoProvider or Master Data


Execute Test

8. Check CATT Traces by running Test Job

9. Analyze Log of Test Job

10. Identify erroneous CATT Tracewith log and reporting

11. Check erroneous CATT Trace manually

Test Package

Test Job

CATT Trace

Trace

Test Job

CATT Trace

Query

Data

Support Packages



Overview

Prerequisites

Trace

CATT Trace


Test Result

Summary




Prerequis i tes

Technical Content

Used to stored Test Results

InfoCube 0RSTT_C01

Query 0RSTT_C01_Q002

These objects are activated automatically

Master data (text of messages) must be activated manually with report

RSTT_TCT_MDLOAD

Basic Settings

Start transaction RSTT for one time initialization

1. Press Basis Settings

2. Choose Reporting,

Planning and OLAPTechnology asApplication Area

3. Check onTrace Execution inNew Roll Area

2

3

1



Overview

Prerequisites

Trace

CATT Trace


Test Result

Summary




User Ac t iva t ion w i th T ransac t ion RSTT

Trace is a sequence

of navigation steps

1. Press Trace Tool

2. Check on Activationfor Test Generation

3. Press Activate

4. User will appear inlist of Trace Users

2

3

4

Test Package

Test Job

CATT Trace

Trace

1




Rec ord Nav igat i on St ep of Query as Trac e (1)

1. Start transaction

RSRT22. Enter Query

3. Choose HTML asQuery Display

4. Press Execute

Using Value helpcreates additionalTrace with own TraceID

4

1

Test Package

Test Job

CATT Trace

Trace




Rec ord Nav igat i on St ep of Query as Trac e (2)

1. Navigate

2. Drill down

3. Filter

4. …

Test Package

Test Job

CATT Trace

Trace




View Trace (1)

1. Select Traces

2. New Trace appears inHistory

3. Press Display to viewdetails

Traces shows History

of current user Trace Collection

shows complete listof all Traces

2

3

1

Test Package

Test Job

CATT Trace

Trace




View Trace (2)

Traces contain a

sequence ofnavigation steps

Each navigation stepis represented by oneor more CheckableProgram Objects

Traces without

Checkable ProgramObjects could not beused for testing(e.g. RRW3_WEBRFC)

Test Package

Test Job

CATT Trace

Trace



Overview

Prerequisites

Trace

CATT Trace


Test Result

Summary




Creat e CATT Trac e using Wizard

CATT Trace is a Trace

with recordedReference Data

1. Press CATT Tool

2. Click on Wizard

3. Select Trace

4. Press Next step 3

4

1

Test Package

Test Job

CATT Trace

Trace

2




Speci fy St andard At t r ibut es

1. Enter Trace ID (*)

2. Enter Description

3. Choose BI BusinessExplorer asApplication Layer

4. Choose OLAP Traceas Trace type

(required to specifyTest Context; seenext step)

5. Press Next step

(*) Own Trace ID helps towork with wildcards(see Test Package)

5

4

1

Test Package

Test Job

CATT Trace

Trace

32




Speci fy Test Contex t (opt ional )

1. Choose Topic of Test

and relatedFunctionality

2. Press Insert

3. Press Next step

2

3

1

Test Package

Test Job

CATT Trace

Trace

Optional




Select Dat a Objec t (opt ional )

Usage of default

setting isrecommended

1. Select ProgramObject

2. Press Display

3. View Data Objects4. Press Next step

2

4

1

Test Package

Test Job

CATT Trace

TraceDefault setting – noaction required

3




Rec ord Reference Dat a

1. Press Record

2. Status will changeto green andProgram Objectswill have content

3. Press icon to viewReference Data(see next slide)

4. Press Next step

Test Package

Test Job

CATT Trace

Trace

1

2

3

3

4




View Reference Data

1. Choose Previous or

Next Check Position2. Press Back to

return to Wizard

Test Package

Test Job

CATT Trace

Trace

2

1




Save CATT Trac e

1. View summary of

settings2. Press Save

Test Package

Test Job

CATT Trace

Trace

1

2




Work ing w i th CATT Traces

1. Click on CATT Traces

2. Press button toperform action

Check executes CATTTrace in Check Mode(run query andcompare to ReferenceData)

Useful for problemanalysis

Change allowsrecording ofReference Data again

Accept new state

Test Package

Test Job

CATT Trace

Trace

1

2



Overview

Prerequisites

Trace

CATT Trace


Test Result

Summary




Create Tes t Pack age

Test Package bundles

several CATT Traces

1. Press CATT Tool

2. Click on TestPackages

3. Enter name of Test

Package4. Press button Create

Test Package

Test Job

CATT Trace

Trace

34

2

1




Trace Selec t ion


2. Enter Trace ID or…

3. Use MultipleSelection to chooseseveral Trace IDs

Wildcards are

possible and resolvedinto several Trace IDsat execution time, i.e.new Trace IDs will beadded automatically

See register TraceList

Test Package

Test Job

CATT Trace

Trace

2 3

1




Play Mode Select ion

1. Click on register Play

Mode Selection2. Choose one or more

combination of Read,Cache and AggregateMode

Play Modedeterminate under

which conditions aTrace is performed

If fields left empty, allmodes are executed(i.e., 3 * 3 * 3 = 27combinations areexecuted)

Test Package

Test Job

CATT Trace

Trace

2

1




Trace L is t

1. Click on register

Trace List List of all Trace IDs

appears that fit to theselection under TraceSelect

See register TraceSelect

2. Press button Save tostore Test Package

Test Package

Test Job

CATT Trace

Trace

1

2



Overview

Prerequisites

Trace

CATT Trace


Test Result

Summary




Create Tes t J ob

Test Job is a

scheduled jobperforming CATT-Traces in one TestPackage

1. Press CATT Tool

2. Click on Test Jobs

3. Enter name of TestJob

4. Press button Create

Test Package

CATT Trace

Trace

34

2

1

Test Job




Parameters


2. Select Test Package3. Select Process Mode

Check Mode isrecommended

Play Mode is onlyuseful for ABAP

syntax check4. Check on Execute

Traces in Parallel toaccelerate execution

Test Package

Test Job

CATT Trace

Trace

2

3

1

4




Time Set t ings

1. Click on register Time

Settings2. Choose Execution

Mode

Use ExecuteImmediately to checkTest Job

3. Press button Save

Test Package

Test Job

CATT Trace

Trace

2

1

3




Logs

1. Click on register

Logs2. Press on button Job

Log to view details ofJob (e.g. progress ofexecution)

3. Column Currentshows actual step of

job (press Refresh)

See next section howto view Test LogResults

Test Package

Test Job

CATT Trace

Trace

2

1

3




Execu t e Test J ob

1. Choose existing Test

Job2. Press button Execute

Job will be instantlyreleased for batchprocessing

Test Package

Test Job

CATT Trace

Trace

2

1



Overview

Prerequisites

Trace

CATT Trace


Test Result

Summary




System Changes

Two kind of changes to system could cause errors...

1. Data Changes

Load InfoProvider Data Set filter to time period

Load Master Data Set filter to characteristic values

Change of Meta Data Record Reference Data again

To avoid errors cause by changed data…

Define Traces with fix filter to be independent of InfoProvider andMaster Data load or

Record Reference Data again before applying coding changes

2. Coding Changes

Apply Notes or Support Packages

Traces must be without error before to identify a coding error




View Test Log Resul ts (1)

Display Test Job

1. Click on registerLogs

2. Use keyboard toscroll to columnReporting

3. Press icon

Test Package

Test Job

CATT Trace

Trace

2

3

1




View Test Log Resul ts (2)

Test log results are

stored into InfoCube0RSTT_C01

Test log results canbe viewed with Query0RSTT_C01_Q002

1. Use navigation to drilldown to Trace ID, etc.

2. Remove filtered LogGUID to view allresults

Test Package

Test Job

CATT Trace

Trace

1

2




Analyze Test Log Resul t (1)

In case of an error...

1. Click on CATT Traces

2. Enter Trace ID retrievedby Test Log Result

3. Press button Check

4. Choose Check Mode asProcess Mode

5. Press button Execute

… (see next slide)

1

2

3

4

5

Test Package

Test Job

CATT Trace

Trace




6. View Overview

7. Click on iconAnalysis

8. Compare CATTData (actual) withReference Data

Analyze Test Log Resul t (2)

Test Packages

Test Jobs

CATT Trace

Trace

6

7

8



Overview

Prerequisites

Trace

CATT Trace


Test Result

Summary




Summary

RS Trace Tool allows…

Checking correctness of Query results

After applying Notes or Support Packages

Additional help

Documentation

Outlook

Reference Data

Scope of Test

http://help.sap.com/saphelp_nw2004s/helpdata/en/42/ed1942bcb35433e10000000a155106/frameset.htm

http://help.sap.com/saphelp_nw2004s/helpdata/en/42/ed1942bcb35433e10000000a155106/frameset.htm




Out loo k Referenc e Dat a

Current Situation

Reference data should be restrict to specific date and/or characteristicvalues (master data)

Reference data could be updated only on CATT Trace level(i.e. several CATT Traces must be updated manually)

Situation with SPS 13 (BI ABAP SP 15)

Reference data could be recorded on Test Job level(i.e. several CATT Traces are updated with one click)

Test Job

CATT Trace




Out loo k Referenc e Dat a

Procedure in SPS 13 (BI ABAP SP 15)

Prepare Test by recording navigation steps

1. Record reference data (define current state of system as correct)


3. Replay Test

Choose REF Mode asProcess Mode to recorednew reference data

Test Package

Test Job

CATT Trace

Trace




Out loo k Scop e of Test

Current Situation

OLAP functionality (incl. figures and ABAP syntax)

Productive or test system

No BEx Web (ABAP and Java Runtime) functionality

Planned Situation

Enable Trace for BEx Web (Java Runtime) functionality Record navigation steps in BEx Web

Ensure correctness of layer BI Consumer Services (BICS)

Ensure correctness of Java Runtime (no exceptions)




Copyr ight 2006 SAP AG. Al l Right s Reserved

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information contained herein may bechanged without prior notice.

Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors.

Microsoft, Windows, Outlook, and PowerPoint are registered trademarks of Microsoft Corporation.

IBM, DB2, DB2 Universal Database, OS/2, Parallel Sysplex, MVS/ESA, AIX, S/390, AS/400, OS/390, OS/400, iSeries, pSeries, xSeries, zSeries, System i, System i5, System p,System p5, System x, System z, System z9, z/OS, AFP, Intelligent Miner, WebSphere, Netfinity, Tivoli, Informix, i5/OS, POWER, POWER5, POWER5+, OpenPower and PowerPC aretrademarks or registered trademarks of IBM Corporation.

Adobe, the Adobe logo, Acrobat, PostScript, and Reader are either trademarks or registered trademarks of Adobe Systems Incorporated in the United States and/or other countries.

Oracle is a registered trademark of Oracle Corporation.

UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group.

Citrix, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, and MultiWin are trademarks or registered trademarks of Citrix Systems, Inc.

HTML, XML, XHTML and W3C are trademarks or registered trademarks of W3C ® , World Wide Web Consortium, Massachusetts Institute of Technology.

Java is a registered trademark of Sun Microsystems, Inc.

JavaScript is a registered trademark of Sun Microsystems, Inc., used under license for technology invented and implemented by Netscape.

MaxDB is a trademark of MySQL AB, Sweden.

SAP, R/3, mySAP, mySAP.com, xApps, xApp, SAP NetWeaver, and other SAP products and services mentioned herein as well as their respective logos are trademarks or registeredtrademarks of SAP AG in Germany and in several other countries all over the world. All other product and service names mentioned are the trademarks of their respective companies.Data contained in this document serves informational purposes only. National product specifications may vary.

The information in this document is proprietary to SAP. No part of this document may be reproduced, copied, or transmitted in any form or for any purpose without the express priorwritten permission of SAP AG.

This document is a preliminary version and not subject to your license agreement or any other agreement with SAP. This document contains only intended strategies, developments,and functionalities of the SAP® product and is not intended to be binding upon SAP to any particular course of business, product strategy, and/or development. Please note that thisdocument is subject to change and may be changed by SAP at any time without notice.

SAP assumes no responsibility for errors or omissions in this document. SAP does not warrant the accuracy or completeness of the information, text, graphics, links, or other itemscontained within this material. This document is provided without a warranty of any kind, either express or implied, including but not limited to the implied warranties of merchantability,fitness for a particular purpose, or non-infringement.

SAP shall have no liability for damages of any kind including without limitation direct, special, indirect, or consequential damages that may result from the use of these materials. Thislimitation shall not apply in cases of intent or gross negligence.

The statutory liability for personal injury and defective products is not affected. SAP has no control over the information that you may access through the use of hot links contained inthese materials and does not endorse your use of third-party Web pages nor provide any warranty whatsoever relating to third-party Web pages.




Copyrigh t 2006 SAP AG. A l le Recht e vorbeha l ten

Weitergabe und Vervielfältigung dieser Publikation oder von Teilen daraus sind, zu welchem Zweck und in welcher Form auch immer, ohne die ausdrückliche schriftlicheGenehmigung durch SAP AG nicht gestattet. In dieser Publikation enthaltene Informationen können ohne vorherige Ankündigung geändert werden.

Die von SAP AG oder deren Vertriebsfirmen angebotenen Softwareprodukte können Softwarekomponenten auch anderer Softwarehersteller enthalten.

Microsoft ® , WINDOWS ® , NT ® , EXCEL ® , Word ® , PowerPoint ® und SQL Server ® sind eingetragene Marken der Microsoft Corporation.

IBM, DB2, DB2 Universal Database, OS/2, Parallel Sysplex, MVS/ESA, AIX, S/390, AS/400, OS/390, OS/400, iSeries, pSeries, xSeries, zSeries, System i, System i5, System p,System p5, System x, System z, System z9, z/OS, AFP, Intelligent Miner, WebSphere, Netfinity, Tivoli, Informix, i5/OS, POWER, POWER5, POWER5+, OpenPower und PowerPCsind Marken oder eingetragene Marken der IBM Corporation.

Adobe, das Adobe Logo, Acrobat, PostScript und Reader sind Marken oder eingetragene Marken von Adobe Systems Inc. in den USA und/oder anderen Ländern.

ORACLE ® ist eine eingetragene Marke der ORACLE Corporation.

UNIX ® , X/Open ® , OSF/1 ® und Motif ® sind eingetragene Marken der Open Group.

Citrix ® , das Citrix-Logo, ICA ® , Program Neighborhood ® , MetaFrame ® , WinFrame ® , VideoFrame ® , MultiWin ® und andere hier erwähnte Namen von Citrix-Produkten sind Marken vonCitrix Systems, Inc.

HTML, DHTML, XML, XHTML sind Marken oder eingetragene Marken des W3C ® , World Wide Web Consortium, Massachusetts Institute of Technology.

JAVA ® ist eine eingetragene Marke der Sun Microsystems, Inc.

JAVASCRIPT ® ist eine eingetragene Marke der Sun Microsystems, Inc., verwendet unter der Lizenz der von Netscape entwickelten und implementierten Technologie.

MaxDB ist eine Marke von MySQL AB, Schweden.

SAP, R/3, mySAP, mySAP.com, xApps, xApp, SAP NetWeaver, und weitere im Text erwähnte SAP-Produkte und -Dienstleistungen sowie die entsprechenden Logos sind Markenoder eingetragene Marken der SAP AG in Deutschland und anderen Ländern weltweit. Alle anderen Namen von Produkten und Dienstleistungen sind Marken der jeweiligen Firmen.Die Angaben im Text sind unverbindlich und dienen lediglich zu Informationszwecken. Produkte können länderspezifische Unterschiede aufweisen.

Die in dieser Publikation enthaltene Information ist Eigentum der SAP. Weitergabe und Vervielfältigung dieser Publikation oder von Teilen daraus sind, zu welchem Zweck und inwelcher Form auch immer, nur mit ausdrücklicher schriftlicher Genehmigung durch SAP AG gestattet.

Bei dieser Publikation handelt es sich um eine vorläufige Version, die nicht Ihrem gültigen Lizenzvertrag oder anderen Vereinbarungen mit SAP unterliegt. Diese Publikation enthältnur vorgesehene Strategien, Entwicklungen und Funktionen des SAP ® -Produkts. SAP entsteht aus dieser Publikation keine Verpflichtung zu einer bestimmten Geschäfts- oder

Produktstrategie und/oder bestimmten Entwicklungen. Diese Publikation kann von SAP jederzeit ohne vorherige Ankündigung geändert werden.SAP übernimmt keine Haftung für Fehler oder Auslassungen in dieser Publikation. Des Weiteren übernimmt SAP keine Garantiefür die Exaktheit oder Vollständigkeit derInformationen, Texte, Grafiken, Links und sonstigen in dieser Publikation enthaltenen Elementen. Diese Publikation wird ohne jegliche Gewähr, weder ausdrücklich nochstillschweigend, bereitgestellt. Dies gilt u. a., aber nicht ausschließlich, hinsichtlich der Gewährleistung der Marktgängigkeit und der Eignung für einen bestimmten Zweck sowie für dieGewährleistung der Nichtverletzung geltenden Rechts.

SAP haftet nicht für entstandene Schäden. Dies gilt u. a. und uneingeschränkt für konkrete, besondere und mittelbare Schäden oder Folgeschäden, die aus der Nutzung dieserMaterialien entstehen können. Diese Einschränkung gilt nicht bei Vorsatz oder grober Fahrlässigkeit.

Die gesetzliche Haftung bei Personenschäden oder Produkthaftung bleibt unberührt. Die Informationen, auf die Sie möglicherweise über die in diesem Material enthaltenen Hotlinkszugreifen, unterliegen nicht dem Einfluss von SAP, und SAP unterstützt nicht die Nutzung von Internetseiten Dritter durch Sie und gibt keinerlei Gewährleistungen oder Zusagen überInternetseiten Dritter ab.




B

1. X

Test Packages

Test Jobs

CATT Trace

Trace

2

3

1

Automatic Query Test With RSTT - Webinar Presentation

Documents

Transcript of Automatic Query Test With RSTT - Webinar Presentation