E2E Integration Testing

62
E2E Integration Testing October 2008 Product Management E2E Solution Operations Active Global Support (AGS) SAP AG

Transcript of E2E Integration Testing

Page 1: E2E Integration Testing

E2E Integration Testing

October 2008

Product Management E2E Solution OperationsActive Global Support (AGS)SAP AG

Page 2: E2E Integration Testing

© SAP 2008 / Page 2

Disclaimer

This presentation outlines our general product direction and should not berelied on in making a purchase decision. This presentation is not subject toyour license agreement or any other agreement with SAP. SAP has noobligation to pursue any course of business outlined in this presentation or todevelop or release any functionality mentioned in this presentation. Thispresentation and SAP's strategy and possible future developments aresubject to change and may be changed by SAP at any time for any reasonwithout notice. This document is provided without a warranty of any kind,either express or implied, including but not limited to, the implied warrantiesof merchantability, fitness for a particular purpose, or non-infringement. SAPassumes no responsibility for errors or omissions in this document, except ifsuch damages were caused by SAP intentionally or grossly negligent.

Page 3: E2E Integration Testing

© SAP 2008 / Page 3

1. SAP’s approach to End-to-End Integration Testing

2. Test Capabilities Option 1

3. Test Capabilities Option 2

4. SAP Testing Services

Agenda

Page 4: E2E Integration Testing

© SAP 2008 / Page 4

SAP Solution Manager Enterprise EditionFrom Awareness to Action

SAP is aware of customer pain points. Pain points are addressed by best practices:SAP Standards for E2E Solution Operations.

SAP has compiled best practices for E2E Solution Operations basedon the experience from customer engagements over three decades.

Implementation methodology forE2E Solution Operations: Run SAP.

Require-ments

Design

Deploy

Build &Test

Optimize

Operate

ApplicationManagement

Require-ments

Design

Deploy

Build &Test

Optimize

Operate

ApplicationManagement

SAP Solution Manager provides allcapabilities for E2E Solution Operations.

ChangeManagement

SolutionUpdates

Problemanalysis

Monitoring Softwarelogistics

IntegrationValidation

IntegrationTesting

InnovationManagement

Transparency onProcesses & Apps

IncidentManagement

Improvements of processes,components and solutionsMaintenance of

SAP Solutions

Root CauseAnalysis

Monitoring of mission-critical processes

Deployment ofsolution updates

IntegrationValidation

IntegrationTesting

InnovationManagement

Identification of criticalbusiness processes

IncidentManagement

Page 5: E2E Integration Testing

© SAP 2008 / Page 5

Changing SAP Solutions

Customer pain points

2

3

1 Tests in heterogeneoussystem landscapes

Change Impact Analysis

Test Data Management

E2E Integration Tests of business processes in systemenvironments interfacing SAP with non-SAP solutions

Indentification of critical business processes affected bychange events such as SAP Support Packages

No test recommendations for SAP Enhancement Packages

Test Systems with outdated test data

Productive System copy is too expensive and rework intensive

Creation of appropriate test data for automated test cases

4 Test AutomationCreation of automated test cases is time consuming andexpensive to maintain via skilled QA specialists

Automated test cases get damaged by change events andneed time consuming repair by QA Specialist

Page 6: E2E Integration Testing

© SAP 2008 / Page 6More information about the Run SAP Methodology for E2E Solution Operations at: http://service.sap.com/runsap

Methodology

E2E Solution Operations methodology for theongoing management of end-to-end solutions

Run SAP methodology to implement end-to-endsolution operations including SAP standards,best practices, roadmap, training, certification,services and tools for E2E solution operations

Test ProcessFrom change events and change impact analysis

via test planning and test execution

to deployment of changes in production system

Test Capabilities

SAP Solution Manager acts as central point ofaccess to SAP and 3rd Party test capabilities

… as well as additional capabilities like E2EIntegration Validation and defect management

Business Blueprint

Test Planning Test Execution Apply Changesto ProductionChange Impact

AnalysisSAP Solution

Update

New SAPSolution

SAP Solution Manager

Managing Changes is Critical for Business AgilityMethodology, Test Process and Test Capabilities

Page 7: E2E Integration Testing

© SAP 2008 / Page 7

Q Gate

Designto

Build

Q Gate

Buildto

Test

Q Gate

Testto

DeployRequirements

from businessDepartments

OptimizeBuild Test Deploy

Extend SolutionSAP UpdatesCustom Dev.Partner solutions

Unit Tests

Prepare SolutionOperations

Solution DocuEnablement ofStandards forSolution Operations

Transports in Cycles Final Transport

Execution ofFunctional andUser AcceptanceTests

Incident& Problem

Mgm

t. and RootC

ause Analysis

Data ConsistencyChecks

Performance TestsFunctional andtechnicalblueprint

Functional andtechnicalfeasibility

Handover to Production

Prepare TestsTest ScopeIdentificationTest RequirementsTest System SetupTest Planning

Incident& Problem

Mgm

t. and RootC

ause Analysis

Requirements

Design

Collaboration and Project Controlling

Quality ManagementThe Quality Management process for SAP centric Solutions

Page 8: E2E Integration Testing

© SAP 2008 / Page 8

E2E Integration Testing of SAP SolutionsTest Process embedded in the SAP Application Lifecycle

Business Blueprint

Test PlanningSystem Setup Test Execution Deploy Changes

to Production

Change ImpactAnalysis

Business BlueprintUpdate

Identification ofBusinessProcesses affectedby SAP SolutionUpdates

Recommendationof businessprocesses forregression tests

SAP SupportPackages

SAP EnhancementPackages

Custom Code

Customizingchanges

Planning of TestCases

Test Catalogssetup

Compilation ofTest Packagesand assigment toTesters

Setup of TestSystem

Creation of TestData

Test Scope Identification

Manual tests

Automated tests

IntegrationValidation

IncidentManagement

Apply changesthroughtransports fromTest toProductionsystem

Apply SP‘s orEhP‘s

Type of Change

SAP SolutionUpdate

New SAPSolution

Implementation ofnew SAP Solution

Business BlueprintDesignSolutionConfiguration

Page 9: E2E Integration Testing

© SAP 2008 / Page 9

E2E Integration Testing of SAP Solutions

SAP Solution Manager

All SAP test capabilities are provided andtightly integrated with SAP Solution Manager

Risk-based Test Planning

Identification of business processes affectedby SAP Solution changes

Provide choices to SAP customers

Customers can use SAP capabilities and 3rdParty Test Suites in combination

All required Interfaces will be provided overtime

Guiding Principles

Page 10: E2E Integration Testing

© SAP 2008 / Page 10

E2E Integration Testing of SAP SolutionsTest Capabilities

Customers have various options

Test Option 1Test capabilities provided by SAP SolutionManager with integration of testautomation tools from partners

Recommended for SAP-centric customers

Test Option 2Test capabilities provided by SAPSolution Manager, SAP QualityCenter by HP and SAP TAO

Recommended for customers withheterogeneous system landscape

Page 11: E2E Integration Testing

© SAP 2008 / Page 11

1. SAP’s approach to End-to-End Integration Testing

2. Test Capabilities Option 1

3. Test Capabilities Option 2

4. SAP Testing Services

Agenda

Page 12: E2E Integration Testing

© SAP 2008 / Page 12

Option 1

E2E Integration Testing of SAP SolutionsOptions for SAP Customers

Business Blueprint

Test PlanningTest System Setup

Test Execution Apply Changesto Production

Change ImpactAnalysis

SAP SolutionUpdate

New SAPSolution

Solution ManagerTest Workbench

Test planning

Solution ManagerBusiness Blueprint

Solution ManagerTest Workbench

Manual testing

Solution ManagereCATT

Solution ManagerBusiness ProcessChange Analyzer *

Application-logic Tests

TestPartner

QTP

eCATT

UI based Tests

* planned for Q4 2008

Setup of businessprocess catalog

Businessrequirements

Identification ofprocesses affectedby code / customizingchanges

Admin ofautomated tests

SAP TDMS

Setup of leantest systems

QTP

Test Scope IdentificationType of Change

Automated Tests

Page 13: E2E Integration Testing

© SAP 2008 / Page 13

E2E Integration Testing of SAP SolutionsSAP Solution Manager: Business Blueprint

Documentation of Business Processes

Bus.Process Hierarchy

Process HierarchyScenarioBusiness ProcessBus. Process Step

Graphical and textualdescription of businessprocessBusiness requirementsprovided by businessusers as input for testrequirementsAssignment of SAPTransaction / ReportAssignment of testsTraining MaterialLink to configuration

Page 14: E2E Integration Testing

© SAP 2008 / Page 14

E2E Integration Testing of SAP SolutionsSAP Solution Manager: Business Process Change Analyzer

Change Impact Analysis Test Planning Test ExecutionSAP

SolutionUpdate

Identification ofbusiness processesaffected by change

Risk-based TestRecommendation

Check / creation ofTest Cases

Test Plan updateand Test Packagecreation

Manual Tests

Automated Tests via3rd Party Test Suitesor SAP eCATT

Customer Pain PointSAP Solution updates occur frequently

SAP triggered: Support Packs, Enhancement PacksCustomer triggered: Custom code, Customizing

Which business processes are affected by planned change?

Approach

Page 15: E2E Integration Testing

© SAP 2008 / Page 15

E2E Integration Testing of SAP SolutionsSAP Solution Manager: Business Process Change Analyzer

Scenario: Order to CashSales OrderDeliveryGoods IssueBilling

Scenario: Procure to Pay…

Customer executes Business Process

Preparation

Business Blueprint

Identificationof criticalBusiness

Processes

Background trace records all used SAP objectsCode: Function Modules, Module Pools, …

Tables: Configuration, Master Data, …

Technical Bill of Material (T-BOM) assignment toBusiness Process of Business Blueprint

AnalysisCustomer plans SAP Solution Update including:

SAP Support Packs

SAP EnhancementPackageCustom CodeExtentionsModifications

Customizing changes

Business Process Change Analyzer (BPCA)

“Which criticalBusiness Processes

will be affected?”

Scenario: Order to CashSales Order code changeDeliveryGoods Issue UI changeBilling

Scenario: Procure to PayCreate PO customizing change

BenefitsIdentification of affected Business ProcessesRisk-based test scope recommendationAutomatic test plan generation

Page 16: E2E Integration Testing

© SAP 2008 / Page 16

SAP Test Data Migration Server (SAP TDMS)

MotivationPain point: test system setup via copy of entire SAP production system not suitableGoal 1: fast creation of lean test system with production like environment, but reduced volumeGoal 2: transfer of specific test data such as posted documents and master data

SAP TDMS

Typical SAP TDMS Use CasesCreate separate TDMS client in development environment

Create a slim test system with a reduced set of data for upgrade testing purposes

Business Process Library: quickly populate maintenance systems with small data sets based onbusiness objects

Create multiple TDMS clients with differing data volumes in DEV as master clients to supply test ortraining systems recurringly, e.g. for resetting purposes

Create initial master shell and place in transport path to be used as starting point for target system build

Page 17: E2E Integration Testing

© SAP 2008 / Page 17

Business Process Library – Approach

Predefined business object and process data selection scenariosMaster data onlySelective transactional data with dependent master dataComplete business processes / test cases

Covers key areas in ERP and industry solutionsData extraction based on built-in relationship knowledgeSimple integration of customer data und customer developmentOptional scrambling of sensitive data during extraction (customizable)

Page 18: E2E Integration Testing

© SAP 2008 / Page 18

SAP TDMS – BPL: ExampleSales Order

Main Business Objects:

Sales Order

Sales Document

Customer

Materials

Conditions

Provides selective Sales Order data withdepending objects (including masterdata)

Page 19: E2E Integration Testing

© SAP 2008 / Page 19

Excerpt of Existing SAP TDMS Customers

Horiba, Ltd.

Zentraldienst der Polizei

Weyerhaeuser

Effem ServicesIncorporated

Yell Ltd.

Cemex Central, S.A. deC.V.

Autodesk, Inc.

Wincor NixdorfInternational GmbH

AstraZeneca

Ulta Salon, Cosmetics &Fragrance

Johnson & Johnson

EADS DeutschlandGmbH

J. Crew Group Inc.

AllgemeinesKrankenhaus Wien

REWE

Pacific Coast BuildingProducts

nordIT GmbH

Linde AGGenentech, Inc.Co-Operative BulkHandling Ltd.

Kyocera MitaCorporation

Otafuku Sauce Co.,Ltd.

Nortel Networks LimitedHoneywell International,Inc.

Eastman ChemicalCompany

Saskatchewan PowerCorporation

Leopold Kostal GmbH& Co. KG

Respironics, Inc.Forest Laboratories, Inc.Husky Energy Inc.ColesWeidmüller

Pratt & Whitney CanadaInc.Mahindra Mahindra

ADCTelecommunications,

Inc.Electricity Supply BoardVNG Verbundnetz Gas

AG

BOC Group Plc.Diageo Plc.First EnergyPirelli & C. S.p.A.Kimberly Clark

Agilent Technologies,Inc.CenterPoint Energy, Inc.City Power

Johannesburg (Pty) Ltd.Migros-

Genossenschafts-BundISE Innomotive

Systems Europe GmbH

UPM-Kymmene OyjGoodrich CorporationAir LiquideJumbo Markt AGW.W. Grainger, Inc.

Puget Sound Energy,Inc.Baldor Electric CompanyPick 'n Pay Retailers

(Pty) Ltd.Bundesamt für Bauten

und LogistikE.I. DuPont de

Nemours & Co., Inc.

T-Mobile USA, Inc.MarsWalMartKnorr-BremseEon AG

School Board of PolkCounty

Stadtwerke DüsseldorfAG

Holcim Group SupportLtd.

OesterreichischeKontrollbank

KLA-TencorCorporation

PetrobrasGie CegetelKao CorporationSmithfield FoodsDegussa AG

Federal Prison IndustriesDisney WorldwideServices, Inc.Service Birmingham Ltd.The Coca-Cola

CompanyKommunalkredit Austria

AG

IGTSolectron CorporationAstellasTelekom Austria AGBurberry Limited

Nordson CorporationNippon Paper IndustriesCo., Ltd.

British Nuclear FuelsPlc.

SPAR Österr.Warenhandels AG

HeidelbergerDruckmaschinen

Homebase LimitedMicrosoft CorporationVodafone Group Plc.Solvay SAEndress & Hauser

R.J. Reynolds TobaccoCompany

Anheuser-BuschCompanies, Inc.

GB Gas HoldingsLimited

Provinzial NordWestHoldingBehr GmbH & Co. KG

WorldbankEMI Group Plc.Bekaert N.V.Edeka AGSchaeffler KG

Bold = SAP Reference Program

Page 20: E2E Integration Testing

© SAP 2008 / Page 20

Option 1

E2E Integration Testing of SAP SolutionsOptions for SAP Customers

Business Blueprint

Test PlanningTest System Setup

Test Execution Apply Changesto Production

Change ImpactAnalysis

SAP SolutionUpdate

New SAPSolution

Solution ManagerTest Workbench

Test planning

Solution ManagerBusiness Blueprint

Solution ManagerTest Workbench

Manual testing

Solution ManagereCATT

Solution ManagerBusiness ProcessChange Analyzer *

Application-logic Tests

TestPartner

QTP

eCATT

UI based Tests

* planned for Q4 2008

Setup of businessprocess catalog

Businessrequirements

Identification ofprocesses affectedby code / customizingchanges

Admin ofautomated tests

SAP TDMS

Setup of leantest systems

QTP

Test Scope IdentificationType of Change

Automated Tests

Page 21: E2E Integration Testing

© SAP 2008 / Page 21

SAP Solution ManagerNew Workcenter for E2E Integration Testing

Status Reporting

Workcenter: Role-specific entry point for all test related activities

Test Coordinator

Quality Expert

Tester

VP of Q&A

Page 22: E2E Integration Testing

© SAP 2008 / Page 22

SAP Solution ManagerTest Management via SAP Test Workbench

SAP Test Workbench

Test Plan: Generation from BusinessProcess Hierarchy (Blueprint)Test Cases: Definition of manual andautomated Test CasesTest Packages: automatic generation oftest packages and distribution to testersExecution of manual and automatedtestsIncident Management: Service DeskintegrationReporting: Comprehensive test statusreporting including SAP BI

Page 23: E2E Integration Testing

© SAP 2008 / Page 23

SAP Solution ManagerSAP Test Workbench: Test Sequences

Test Plan

Test Package Tester 1

Tester 2Test Case 1

Test Case 2Test Case 3 Tester 3

Classic approach:

Several Testers (Tester Pool)are assigned to severalTest Cases (Test Package)

New approach:

In addition to classic approachyou can assign directly a TestCase to a Tester and thesequence of test cases canbe process as workflow

Test Plan

Test Package Tester 1

Tester 2Create Sales Order

Create Outb. Del.

Create Billing Doc. Tester 3

1.2.

3.

Example: As soon Test Case 1 successfully tested by Tester 1, Tester 2 will be notified that Test Case 2 is ready to be tested

Benefit: Allows to define cross area end-to-end integration test scenarios where testerswith different skills need to test in the right sequence.

Page 24: E2E Integration Testing

© SAP 2008 / Page 24

SAP Solution ManagerSAP Test Workbench: Test Sequences - Execution

Worklist of tester 1 - 1st test case of each test sequence is ready to test1 Processing of first test case andsetting status to ‘OK’

2

2nd test case of sequence #1 is ready to test3

Tester assigned to 2nd test of sequence #1 gets an E-Mail notification4

Page 25: E2E Integration Testing

© SAP 2008 / Page 25

Workflow Based on Test Plan Status

Tester‘s worklist before release of test plan1

Testers receives E-Mail notification3

Test Coordinator sets test plan status to released2

Tester‘s worklist after release of test plan – ready for test4

Page 26: E2E Integration Testing

© SAP 2008 / Page 26

SAP Solution ManagerSAP Test Workbench: Test Plan - Release Status Schema

Test plan is closed forchangesTest plan is closed forexecution

Test plan is open forchangesTest plan is closed forexecution

Test plan is closed forchangesTest plan is open forexecution

ProtectedNew Released

Example to highlight the benefit for test plans

After TestBefore Test During TestPhase

Status

Impact

Automated E-Mail notificationto all Tester

that test execution phaseis started

Automated E-Mail notificationto all Tester

that Test execution phase has ended

This can be combined with a Digital Signature strategy for compliance reason, wherethe Test Coordinator need to sign relevant status changes

Page 27: E2E Integration Testing

© SAP 2008 / Page 27

Option 1

E2E Integration Testing of SAP SolutionsOptions for SAP Customers

Business Blueprint

Test PlanningTest System Setup

Test Execution Apply Changesto Production

Change ImpactAnalysis

SAP SolutionUpdate

New SAPSolution

Solution ManagerTest Workbench

Test planning

Solution ManagerBusiness Blueprint

Solution ManagerTest Workbench

Manual testing

Solution ManagereCATT

Solution ManagerBusiness ProcessChange Analyzer *

Application-logic Tests

TestPartner

QTP

eCATT

UI based Tests

* planned for Q4 2008

Setup of businessprocess catalog

Businessrequirements

Identification ofprocesses affectedby code / customizingchanges

Admin ofautomated tests

SAP TDMS

Setup of leantest systems

QTP

Test Scope IdentificationType of Change

Automated Tests

Page 28: E2E Integration Testing

© SAP 2008 / Page 28

E2E Integration Testing of SAP SolutionsTest Automation via SAP eCATT

Testing of complex business process scenarios like Order-to-Cash and Procure-to-PayAdvanced functionality to test backend business logic(function modules, eSOA services, test result verification at SAP table / database level, result comparison with previous runs, …)

Central definition via SAP Test Workbench combined with execution in distributed systemsCentral repository for test dataIntegration of 3rd party test automation tools for UI-based tests, e.g. CRM, Enterprise Portal

Strengths

Sales Order Billing &Payment Receipts

Return &Complaint Handling

Delivery &ShipmentBusiness Processes

eCATT Test Automation eCATTScript 1

eCATTScript 2

eCATTScript 3

eCATTScript 4

Test Data Container

SAP System Landscape

Landscape 1 (Dev)

Landscape 2 (Test)

ParameterParameter Parameter

CRM Test 2CRM Test 2 R/3 Test 2R/3 Test 2 ERP Test 2ERP Test 2

CRM Dev 1CRM Dev 1 R/3 Dev 1R/3 Dev 1 ERP Dev 1ERP Dev 1

Import

included in1 eCATTMaster Script

Page 29: E2E Integration Testing

© SAP 2008 / Page 29

eCATT Test ConfigurationComposite Processes and Applications

SAP HCM

Packaged Solutions andDeployment View

Functional andProcess Component View

Product DataManagement

LeadProcessing

Sales OrderProcessing

OpportunityProcessing

PersonelAdministration

PayrollProcessing

DemandPlanning

Service PartsPlanning

SAP ERP

SAP CRM

SAP SCM

CompositesHigher flexibility and fasterapplication lifecycle lowers potentialfor automated testing (Effort BenefitRatio)Different UI technologies(Web Dynpro, Adobe Forms, …) tobe supported by test tools

Application LandscapeDecoupled UI from back-end allowsdecoupling of test activitiesHigh potential for automatedregression testing of Web-Serviceswithout UI

Web-Services

Calls

E2E Integration Testing of SAP SolutionsTest aspects of eSOA based Composite Applications

Page 30: E2E Integration Testing

© SAP 2008 / Page 30

E2E Integration Testing of SAP SolutionsTest aspects of eSOA based Composite Applications

Decoupled UI from back-end allows decoupling of test activities in same test frameworkTesting the Web Service in parallel of implementing / changin the CompositesSeveral variants of test data for both steps

Testing of Backend WebServices via eCATT

Implement/Change of Backend

Web Services

Implement/ChangeComposite

Application

Testing of CompositeApplication

SAP Solution Manager

Business Blueprint

SAP Solution ManagerBusiness Process Change

Analyzer*

SAP Solution Manager

Test WorkbenchSAP Solution Manager

Test Workbench

HP: QTPCPWR:TestPartner

SAP Solution ManagereCATT

UI based Tests

eCATT:ApplicationLogic Tests

Backend Tests

SAP TDMS

Automated TestsManual TestsTest PlanningTest Scope Identification

Test Prep. and Planning

Page 31: E2E Integration Testing

© SAP 2008 / Page 31

E2E Integration Testing of SAP SolutionsTest aspects of eSOA based Composite Applications

Intregrated E2E Regression TestingReusage of test dataSeveral variants of test data for all phases

Testing of Backend WebServices via eCATT

Implement/Change of Backend

Web Services

Implement/ChangeComposite

ApplicationTesting of Composite

Application

Repeat test with several variantsincl. negative tests

FurtherChecks

Test Prep. and Planning

SAP Solution Manager

Business Blueprint

SAP Solution ManagerBusiness Process Change

Analyzer*

SAP Solution Manager

Test WorkbenchSAP Solution Manager

Test Workbench

HP: QTPCPWR:TestPartner

SAP Solution ManagereCATT

UI based Tests

eCATT:ApplicationLogic Tests

Backend Tests

SAP TDMS

Automated TestsManual TestsTest PlanningTest Scope Identification

Page 32: E2E Integration Testing

© SAP 2008 / Page 32

BackendSystem Web

Services

E2E Integration Testing of SAP SolutionsComposite Applications Example for Order to Cash

Sales OrderProcessing

OutboundDelivery

Customer Service Rep

Billing

Customer Service RepWarehouse Clerk

Customer built composites:based on SAP Composite: e.g. Inventory Level Replenishment (xILR) * - Simplified View

FindCustomer

ViewCustomer

Details

FindCustomer

spec. Products

Read/UpdateCustomer

spec. Products

CreateSales Order

*Details on: https://wiki.sdn.sap.com/wiki/display/ESpackages/Order+to+Cash

Step 1 Step 2 Step 3 Step 4 Step 5 Step 6 Step 7 Step 8 Step 9

Webservice Calls

Customer ID Customer ID Product ID

Customer ID

Product ID

Customer ID

Product ID

Customer ID

Product ID

Customer ID

Product ID

Customer ID

Data Flow

Page 33: E2E Integration Testing

© SAP 2008 / Page 33

eCATT Test configuration

BackendSystem

*Details on: https://wiki.sdn.sap.com/wiki/display/ESpackages/Order+to+Cash

Step 2 Step 3 Step 4 Step 5 Step 9

Webservice Calls

Test Scripts

Test Data Containers

Test ParameterImport Export Import Export Import Export Import Export Import Export

Check

Import Export

Test Variants

Customer Product

WebServices Find

Customer

ViewCustomer

Details

FindCustomer

spec. Products

Read/UpdateCustomer

spec. Products

CreateSales Order

Customer NameCustomer Name Product NameProduct Name QuantityQuantity Expected priceExpected price

E2E Integration Testing of SAP SolutionsTesting a Service enabled Business Process using SAP eCATT

Page 34: E2E Integration Testing

© SAP 2008 / Page 34

1. SAP’s approach to End-to-End Integration Testing

2. Test Capabilities Option 1

3. Test Capabilities Option 2

4. SAP Testing Services

Agenda

Page 35: E2E Integration Testing

© SAP 2008 / Page 35

E2E Integration Testing of SAP SolutionsTest capabilities for functional testing

Business Blueprint

Test RequirementsTest Planning

Test Execution Deploy Changesto Production

Change ImpactAnalysis

SAP SolutionUpdate

New SAPSolution

Functional test capabilities for SAP customer with heterogeneous solution landscape

Quality CenterTest requirementsTest planning

Solution ManagerBusiness Blueprint

Solution ManagerBusiness ProcessChange Analyzer *

Quality Center

Quality Center

SAP TAOAccelerated testcomponent generation

SAP TDMS

Setup of leantest systems

Test Scope IdentificationType of Change

Identification ofbusiness processesaffected by code /customizing changes

Setup of businessprocess hierarchy

Business requirements

Test LabDefect management

Business Process TestsQuick Test Pro

LoadRunnerPerformance Tests

* planned for Q4 2008

Page 36: E2E Integration Testing

© SAP 2008 / Page 36

SAP Solution ManagerSAP Solution Manager Adapter for SAP Quality Center by HP

SAP Solution ManagerAdapter

SAP Quality Center by HP

SAP Solution Manager Adapter for SAP Quality Center by HPintegrates application lifecycle management capabilities of SAP

Solution Manager with test planning and test execution capabilities ofSAP Quality Center by HP

OutboundBusiness BlueprintBus.Requirements

InboundTest ResultsDefects

Page 37: E2E Integration Testing

© SAP 2008 / Page 37

SAP Quality Center by HPRequirements Management

Key benefitsAllow business analysts,testers and developers tocollaborate on applicationrequirementsAssess overall risk to thebusiness through real-timevisibility of test coverageand associated defects

Key capabilitiesTrack multiple requirementstypes and analyzerequirements changeimpactFull traceability fromrequirements to tests anddefectsLeverage existing assets inMS Word

Define multiple requirements types and interdependencies

Page 38: E2E Integration Testing

© SAP 2008 / Page 38

SAP Quality Center by HPRequirements Management – Test Planning

Automatically generate Test Cases from SAP Business Blueprint

3

21 Select business process structure Wizard to create test plan structure and test cases

Test Plan with (empty) test cases linked totest requirements.

Page 39: E2E Integration Testing

© SAP 2008 / Page 39

SAP Quality Center by HPRequirements Management

Key benefitsAllow business analysts,testers and developers tocollaborate on applicationrequirementsAssess overall risk to thebusiness through real-timevisibility of test coverageand associated defects

Key capabilitiesTrack multiple requirementstypes and analyzerequirements change impactFull traceability fromrequirements to tests anddefectsLeverage existing assets inMS Word

Define multiple requirements types and interdependencies

Page 40: E2E Integration Testing

© SAP 2008 / Page 40

SAP Quality Center by HPTest Planning

Key benefitsManage test strategiesand processes based onbusiness riskEnable centralizedmanagement of manualand automated test assetsEnsure all business criticalrequirements are plannedfor testing

Key capabilitiesDevelop, manage and planmanual and automatedtests including custom testtypesOut –of-the-box integrationwith QuickTest Pro,LoadRunner, …Real-time test status andprogress reportingBidirectional traceabilityallows trackingrequirement and defectcoverage

Manage test cases based on business and test requirements

Page 41: E2E Integration Testing

© SAP 2008 / Page 41

SAP Quality Center by HPTest Lab

Definition of Execution Flow (test case sequence)

Page 42: E2E Integration Testing

© SAP 2008 / Page 42

SAP Quality Center by HPTest Lab and Defects

Test Case execution

Defect creation

Page 43: E2E Integration Testing

© SAP 2008 / Page 43

SAP Quality Center by HPDefects

Defect reporting

Defect reporting

Page 44: E2E Integration Testing

© SAP 2008 / Page 44

SAP Quality Center by HPReport, Graphs and Dashboards

Key benefitsMake business decisionsbased upon holistic viewacross allquality initiativesAllocate resources based uponcurrent progress and status ofapplication releasesReport progress on test cycles

Key capabilitiesCustom, role-based, shareablereportsCoverage graphs with drilldown capabilityMS Word and Excel formats toshare data with non-QC users

Real time progress, status and release views

Page 45: E2E Integration Testing

© SAP 2008 / Page 45

SAP Loadrunner by HPPerformance Testing

Key benefitsEasy-to-use solutionMost comprehensive environmentsupportIntegrated analysis with transactionbreakdown analysis under loadRich analysis engine, includingautomatic correlation

Key capabilitiesReplaces real users with thousands of“virtual” usersGenerates accurate, measurable andrepeatable load on the system from asingle point of controlPinpoints bottlenecks in the system

Emulates production workloads on an IT system

Page 46: E2E Integration Testing

© SAP 2008 / Page 46

E2E Integration Testing of SAP SolutionsTest capabilities for functional testing

Business Blueprint

Test RequirementsTest Planning

Test Execution Deploy Changesto Production

Change ImpactAnalysis

SAP SolutionUpdate

New SAPSolution

Functional test capabilities for SAP customer with heterogeneous solution landscape

Quality CenterTest requirementsTest planning

Solution ManagerBusiness Blueprint

Solution ManagerBusiness ProcessChange Analyzer *

Quality Center

Quality Center

SAP TAOAccelerated testcomponent generation

SAP TDMS

Setup of leantest systems

Test Scope IdentificationType of Change

Identification ofbusiness processesaffected by code /customizing changes

Setup of businessprocess hierarchy

Business requirements

Test LabDefect management

Business Process TestsQuick Test Pro

LoadRunnerPerformance Tests

* planned for Q4 2008

Page 47: E2E Integration Testing

© SAP 2008 / Page 47

SAP TAOMission, Approach, Integration and Customer Benefits

Customer SAP LandscapeCustomer SAP Landscape

Integration

Changing the testing paradigm from manualtesting to „Testing by Composition“

Reducing costs and risks for testing after SAPsolution updates

Automatic generation of test components forSAP business processes via SAP TAO

Composition of automated test cases viastandard functionality of SAP Quality Center byHP

Approach

Mission

HP Quality Suite (QC, BPT, QTP)

SAP Solution Manager

SAP TAO

Application lifecycle management

Test component generation

Test planning, test case composition and testexecution

Customer Benefits1. Reduced effort for

maintaining automatedbusiness process tests

2. Reduced risk due tobetter testing coverage

3. Increased capacity toabsorb /manage change

4. Tight integration withSAP Solution Manager

Customer Benefits1. Reduced effort for

maintaining automatedbusiness process tests

2. Reduced risk due tobetter testing coverage

3. Increased capacity toabsorb /manage change

4. Tight integration withSAP Solution Manager

Page 48: E2E Integration Testing

© SAP 2008 / Page 48

SAP TAO Frontend

SAP TAO Agent

Customer SAP Test Systems

User selects Business Processes

Automatic inspection of SAP Transactions

Automatic generation of Test Components

CRMCRMR/3R/3ERPERP SAP Business Process

SAP Quality Center by HP

4

1

2

3

Inspect

Upload to Quality Center

5 User composes Test Case

Test Case execution6

SAP TAOApproach for accelerated Test Case Composition

Page 49: E2E Integration Testing

© SAP 2008 / Page 49

drag & drop

Composition ofautomated test cases

Based on SAP TAOtest components

SAP TAO and Quality Center (BPT)Composition of automated test cases

Page 50: E2E Integration Testing

© SAP 2008 / Page 50

Execution ofautomated test cases

QTP simulates thebevaviour of anenduser

SAP TAO and Quality Center (QTP)Execution of automated test cases

Page 51: E2E Integration Testing

© SAP 2008 / Page 51

SAP TAOApproach for Test Case update after SAP Solution change

Quality Center TestComponent Library TEST

CASE

TESTCAS

E

TESTCAS

E

TESTCAS

E TESTCAS

E

CHANGED

CHANGED

CHANGEDX XX

Page 52: E2E Integration Testing

© SAP 2008 / Page 52

SAP TAOApproach for Test Case update after SAP Solution change

Quality Center TestComponent Library TEST

CASE

TESTCAS

E

TESTCAS

E

TESTCAS

E TESTCAS

E

CHANGED

CHANGED

CHANGEDX XX

Re-Inspection of impacted SAP Transactions

Update ofTesting Components

Test Cases are Up to Date !Test can be executed successfully

POTENTIALLY :Maintain Process Flow / Test Data

2

Identify impactedSAP Transactions *

13

4

* Planned for SAP Solution Manager 7.0 SP18

Page 53: E2E Integration Testing

© SAP 2008 / Page 53

1. Customer changes SAP Solution

2. SAP Business Process Change Analyzer identifies affected Business Processes

3. Re-inspection of damaged Test Components with SAP TAO

4. Upload to Quality Center and semi-automatic update of Test Case

5. Add test data – if required

6. Test cases ready for execution

Accelerated Update of damaged Test Cases

SAP TAO helps customers to lower maintenance costs ofautomated business process tests

SAP TAOApproach for Test Case update after SAP Solution change

Page 54: E2E Integration Testing

© SAP 2008 / Page 54

SAP TAOCapabilities SAP TAO Release 1.0

ScopeAssignment of Business Processes via list of SAP Transactions

Test Component generationSAP TAO Inspection: Automatic background inspection of SAPGUI basedTransactions and generation of Test ComponentsSAP TAO UI Scanner: Frontend scanning of user selected SAPGUIuser-interfaces

Integration with SAP Quality Center by HPAutomatic Upload of Test Components to Quality Center

OtherPre-build generic test components available in Quality CenterLanguages: English

Page 55: E2E Integration Testing

© SAP 2008 / Page 55

SAP TAO Roadmap

SAP TAO 1.0June 2007

SAP TAO 2.0planned for Q3 2009 (1)

SAP TAO Patch 1.0.10Aug 2008

Functionality: Generation oftest components for SAPGUIbased transactions via SAPTAO Inspector and UIscanner. Consolidation of testcomponents. Upload to SAPQuality Center by HP.

Regional availability: NorthAmerica - extended to allregions in March 2008.

Improvements

Software correction andimproved user handling

New user guide

Extendeddocumentation fordelivered SAP TAO testcomponents

Streamlined SAP TAOuser-interface: UIScanner integrated inSAP TAO Frontend

This document contains intended strategies, developments and/or functionality and is not intended to bebinding upon SAP to any particular course of business, product strategy and/or development. Please notethat this document is subject to change and may be changed by SAP at any time without notice.

Status: planned

Planned functionality

Process Flow Analyzer forstreamlined identification andgeneration of test components

Change Analysis for automatedtest cases based on SAP TAOvia Business Process ChangeAnalyzer

Improved handling of SAP TAOconsolidation

1) SAP TAO delivery dates are subject to change and will becoupled with SAP Solution Manager 7.0 SPs or EhPs

2) An additional Function Pack might be shipped before SAPTAO Release 2.0

Notes:

Page 56: E2E Integration Testing

© SAP 2008 / Page 56

SAP TAO

Customer Benefits

Automated Business Process TestingAccelerated way to automate business process testing

Lower RiskLower risk after SAP Solution updates due to better testing coverageIncreased capacity to manage change

Lower Maintenance CostsComponent-based Test Cases allows accelerated update of damaged test cases

IntegrationTight integration between SAP Solution Manager, SAP TAO and SAP QualityCenter by HP

Page 57: E2E Integration Testing

© SAP 2008 / Page 57

E2E Integration Testing of SAP SolutionsTest Capabilities

Customers have various options

Test Option 1Test capabilities provided by SAP SolutionManager with integration of testautomation tools from partners

Recommended for SAP-centric customers

Test Option 2Test capabilities provided by SAPSolution Manager, SAP QualityCenter by HP and SAP TAO

Recommended for customers withheterogeneous system landscape

Page 58: E2E Integration Testing

© SAP 2008 / Page 58

1. SAP’s approach to End-to-End Integration Testing

2. Test Capabilities Option 1

3. Test Capabilities Option 2

4. SAP Testing Services

Agenda

Page 59: E2E Integration Testing

© SAP 2008 / Page 59

Global Testing Solutions

Our mission is to...

…provide Testing Services/Solutions

…deliver Functional & Performance Testing

…support and maintain customer testingenvironments

Page 60: E2E Integration Testing

© SAP 2008 / Page 60

Global Testing Solutions

Target Testing Services Portfolio

2

1

3

4

5

6

7

Advisory & StrategyQA & Test Advisory, Audit, Methodology, Approach &Strategy Services

Test Project ManagementDay-to-day Delivery Management

Test Analysis & POCTest Analysis & Execution

Performance TestingDelivery Frameworks, Script Analysis, Build Out &Execution

Functional AutomationAutomation Frameworks, Script Analysis, Build Out &Execution

Environment ManagementChange Configuration & Release Management, Data& Environment Solutions, Visualization etc.

Training & EnablementSAP Test Solution Training & Partner Enablement

Contact: Martin KanissGlobal Testing Portfolio Lead, [email protected]

Page 61: E2E Integration Testing

© SAP 2008 / Page 61

InformationE2E Integration Testing: http://service.sap.com/testingSAP TAO: http://service.sap.com/saptaoSAP Solution Manager: http://service.sap.com/solutionmanager

SAP Solution Manager e-learning material: http://service.sap.com/rkt-solman

E2E Integration Testing of SAP SolutionsInformation and SAP Contacts

Regional SAP ContactsAmericas

[email protected] Product Information and Solution [email protected] Professional Services

[email protected] Product Information and Solution [email protected] Professional [email protected] Professional Services

[email protected] Product Information and Solution Sales

Page 62: E2E Integration Testing

© SAP 2008 / Page 62

Copyright 2008 SAP AGAll Rights Reserved

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information contained herein may be changedwithout prior notice.

Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors.

SAP, R/3, xApps, xApp, SAP NetWeaver, Duet, SAP Business ByDesign, ByDesign, PartnerEdge and other SAP products and services mentioned herein as well as their respective logos aretrademarks or registered trademarks of SAP AG in Germany and in several other countries all over the world. All other product and service names mentioned and associated logos displayed arethe trademarks of their respective companies. Data contained in this document serves informational purposes only. National product specifications may vary.

The information in this document is proprietary to SAP. No part of this document may be reproduced, copied, or transmitted in any form or for any purpose without the express prior writtenpermission of SAP AG. This document is a preliminary version and not subject to your license agreement or any other agreement with SAP. This document contains only intended strategies,developments, and functionalities of the SAP® product and is not intended to be binding upon SAP to any particular course of business, product strategy, and/or development. Please note thatthis document is subject to change and may be changed by SAP at any time without notice. SAP assumes no responsibility for errors or omissions in this document. SAP does not warrant theaccuracy or completeness of the information, text, graphics, links, or other items contained within this material. This document is provided without a warranty of any kind, either express orimplied, including but not limited to the implied warranties of merchantability, fitness for a particular purpose, or non-infringement.

SAP shall have no liability for damages of any kind including without limitation direct, special, indirect, or consequential damages that may result from the use of these materials. This limitationshall not apply in cases of intent or gross negligence.

The statutory liability for personal injury and defective products is not affected. SAP has no control over the information that you may access through the use of hot links contained in thesematerials and does not endorse your use of third-party Web pages nor provide any warranty whatsoever relating to third-party Web pages.

Weitergabe und Vervielfältigung dieser Publikation oder von Teilen daraus sind, zu welchem Zweck und in welcher Form auch immer, ohne die ausdrückliche schriftliche Genehmigung durchSAP AG nicht gestattet. In dieser Publikation enthaltene Informationen können ohne vorherige Ankündigung geändert werden.

Einige von der SAP AG und deren Vertriebspartnern vertriebene Softwareprodukte können Softwarekomponenten umfassen, die Eigentum anderer Softwarehersteller sind.

SAP, R/3, xApps, xApp, SAP NetWeaver, Duet, SAP Business ByDesign, ByDesign, PartnerEdge und andere in diesem Dokument erwähnte SAP-Produkte und Services sowie diedazugehörigen Logos sind Marken oder eingetragene Marken der SAP AG in Deutschland und in mehreren anderen Ländern weltweit. Alle anderen in diesem Dokument erwähnten Namen vonProdukten und Services sowie die damit verbundenen Firmenlogos sind Marken der jeweiligen Unternehmen. Die Angaben im Text sind unverbindlich und dienen lediglich zuInformationszwecken. Produkte können länderspezifische Unterschiede aufweisen.

Die in dieser Publikation enthaltene Information ist Eigentum der SAP. Weitergabe und Vervielfältigung dieser Publikation oder von Teilen daraus sind, zu welchem Zweck und in welcher Formauch immer, nur mit ausdrücklicher schriftlicher Genehmigung durch SAP AG gestattet. Bei dieser Publikation handelt es sich um eine vorläufige Version, die nicht Ihrem gültigen Lizenzvertragoder anderen Vereinbarungen mit SAP unterliegt. Diese Publikation enthält nur vorgesehene Strategien, Entwicklungen und Funktionen des SAP®-Produkts. SAP entsteht aus dieserPublikation keine Verpflichtung zu einer bestimmten Geschäfts- oder Produktstrategie und/oder bestimmten Entwicklungen. Diese Publikation kann von SAP jederzeit ohne vorherigeAnkündigung geändert werden.

SAP übernimmt keine Haftung für Fehler oder Auslassungen in dieser Publikation. Des Weiteren übernimmt SAP keine Garantie für die Exaktheit oder Vollständigkeit der Informationen, Texte,Grafiken, Links und sonstigen in dieser Publikation enthaltenen Elementen. Diese Publikation wird ohne jegliche Gewähr, weder ausdrücklich noch stillschweigend, bereitgestellt. Dies gilt u. a.,aber nicht ausschließlich, hinsichtlich der Gewährleistung der Marktgängigkeit und der Eignung für einen bestimmten Zweck sowie für die Gewährleistung der Nichtverletzung geltenden Rechts.SAP haftet nicht für entstandene Schäden. Dies gilt u. a. und uneingeschränkt für konkrete, besondere und mittelbare Schäden oder Folgeschäden, die aus der Nutzung dieser Materialienentstehen können. Diese Einschränkung gilt nicht bei Vorsatz oder grober Fahrlässigkeit.

Die gesetzliche Haftung bei Personenschäden oder Produkthaftung bleibt unberührt. Die Informationen, auf die Sie möglicherweise über die in diesem Material enthaltenen Hotlinks zugreifen,unterliegen nicht dem Einfluss von SAP, und SAP unterstützt nicht die Nutzung von Internetseiten Dritter durch Sie und gibt keinerlei Gewährleistungen oder Zusagen über InternetseitenDritter ab.

Alle Rechte vorbehalten.