Accelerate. Innovate. Automate. - Sogeti.nl SAP Testen TOSCA... · Technology Integration Optimize...

3/23/2015

1

© 2015 TRICENTIS GmbH. All rights reserved. 1

Accelerate. Innovate. Automate.

1© 2013 TRICENTIS Technology & Consulting GmbH. All rights reserved.

Tosca for

TRICENTIS | Ernst Jan Smit


Pick two?

Time-to-market

Cost Quality

Logos: Tricentis customer base, extract

Most of our customers need to optimize

all three project dimension!

3/23/2015

2

© 2014 Tricentis GmbH. All rights reserved. 6

25%

Source: TRICENTIS® customer projects

Effort/# of test cases

100%

0%

50%

Test Case

Specification

Manual Testing

(Execution)

Automated Testing

(Setup, Maintenance

and Execution)

risk coverage

What‘s the problem? A typical test project

Automation levels are low

because of it’s difficult to

automate!

If you don’t know how much

risk coverage you have,

you’ll end up with

far too many test cases!

Not effective enough

Not efficient enough

?

COM_B19


Top 3 Pain-Points in Testing

Time-to-

marketCost Quality

1 Too many test cases

with insufficient/

unclear risk coverage

TestCase Quality

affected affectedaffected

2 Required test data is

missing or requires

high generation effort

Missing Test Data


3 Manual testing No test automation in

place, key-users can’t

deliver required manual

test


3/23/2015

3


Automation – not without a foundation!

A methodological, structural basis is

needed for test automation – otherwise

it will just get bogged down

Sustainability, next to efficiency and

effectiveness, is the most essential

criterion for success


3+ Steps to Optimized Testing

Optimize Automate

Test Case Quality

1

Avoid redundancies

Maximized, measurable contribution to

risk coverage for each test case

3/23/2015

4



Optimize Automate

Test Case Quality

1

Test Data Provisioning

2

Tailored test data

Automated provisioning and

management



Test

Automation

3

… using the right test access

(UI/nonUI)

… model-based to solve the

maintenance problem

Optimize Automate

Test Case Quality

1

Test Data Provisioning

2

3/23/2015

5


Adobe Flex

E2E Test Automation with Tosca

ERP

CRM

SRM

SCM

PLM

Enterprise

Portal

SAP

BusinessObjectsTM

SAP HANA®

Mobile

EPM (BPC)


Tricentis Tosca Testsuite

Virtualize – Orchestrated Service Virtualization

Technology Integration

Optimize

Risk Coverage

Optimizer

Manage

Test Data

Provisioning

Automate

Model-Based Test

Automation

Target Applications

Reporting & Dashboard

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&docid=CmI0SR1COvcYnM&tbnid=WkP6tlRFLsHbcM:&ved=0CAUQjRw&url=http://www.w3.org/html/logo/&ei=D9YGUfiyGsmS2QXdtIHoBQ&bvm=bv.41524429,d.b2I&psig=AFQjCNEyNo7p0IGHrylUxHdmIRR0tRPa6A&ust=1359488911849033

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&docid=CmI0SR1COvcYnM&tbnid=WkP6tlRFLsHbcM:&ved=0CAUQjRw&url=http://www.w3.org/html/logo/&ei=D9YGUfiyGsmS2QXdtIHoBQ&bvm=bv.41524429,d.b2I&psig=AFQjCNEyNo7p0IGHrylUxHdmIRR0tRPa6A&ust=1359488911849033

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&docid=TLIzC2mn8gPlHM&tbnid=bn9fPxBVGTU5IM:&ved=0CAUQjRw&url=http://blogs.adobe.com/digitalmedia/2011/06/build-mobile-apps-for-android-devices-blackberry-playbook-iphone-and-ipad-today/flex-logo/&ei=Z9YGUbH7OaWc2AXLt4DwDA&bvm=bv.41524429,d.b2I&psig=AFQjCNGrUTrehr_YN4q0V6PX0BTp6vYrcA&ust=1359489000352392

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&docid=TLIzC2mn8gPlHM&tbnid=bn9fPxBVGTU5IM:&ved=0CAUQjRw&url=http://blogs.adobe.com/digitalmedia/2011/06/build-mobile-apps-for-android-devices-blackberry-playbook-iphone-and-ipad-today/flex-logo/&ei=Z9YGUbH7OaWc2AXLt4DwDA&bvm=bv.41524429,d.b2I&psig=AFQjCNGrUTrehr_YN4q0V6PX0BTp6vYrcA&ust=1359489000352392

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&docid=Dahds4I1bTO-HM&tbnid=L0I6PaUoPv-PqM:&ved=&url=http://saphack.wordpress.com/&ei=J-QGUYuTKsqY2AWuvoG4AQ&bvm=bv.41524429,d.b2I&psig=AFQjCNF12iow1kEq5b7LvrdnAxn-6Cbong&ust=1359492520023440

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&docid=Dahds4I1bTO-HM&tbnid=L0I6PaUoPv-PqM:&ved=&url=http://saphack.wordpress.com/&ei=J-QGUYuTKsqY2AWuvoG4AQ&bvm=bv.41524429,d.b2I&psig=AFQjCNF12iow1kEq5b7LvrdnAxn-6Cbong&ust=1359492520023440

3/23/2015

6


Virtualize – Service Virtualization & Orchestration

Manage

Test Data

Provisioning

Automate

Model-Based Test

Automation



Aligns business priorities to test planning & execution

Generates the fewest test cases to maximize risk coverage

Shifts focus from Test Coverage to Risk Coverage

Optimize

Risk Coverage

Optimizer


Coverage of business risks is key

Order2Cash is a complex process with multiple steps, systems

and departments involved, including sales, service, finance, engineering,

operations, and logistics.

A customer orders

some items from

your company by

creating a sales

order.

Your company

decides to deliver

the items ordered

by the customer.

This is recorded

by creating a

outbound delivery

document.

Once the items

are available for

sending to the

customer, you

post goods

issue which

reduces your

inventory and

puts the delivery

in transit. This

will create a

material

document.

You finally

create a sales

billing document.

This will have a

corresponding

accounting

document

created

Now you can

check the whole

document flow and

compare the order

against saved

master order

Picking is a

process where

you guide the

system to take

the required

goods from

warehouse.

Transfer order is

created.

Example

Create Sales Order

VL01n VL02n VF01 VF03LT03

Outbound Delivery

Transfer Order forDelivery

Post Goods Issue

Billing Document

Check Document

Flow

VA01

3/23/2015

7


Coverage of business risks is key

Sales Organization

Material/Product

Customer Type

Order Type

Count

14

15

5

2

Total # Test Cases

x

x

x

=2,100

M-1000

Customer

EU

Standard

Order

FRA

Channel 10

TC 1 TC 2

F01

Customer

nonEU

Rush Order

FRA

Channel 16

…TC 148

M05

Customer

EU

Standard

Order

Standard

FRA

…TC 2100

Quantity 0

Dunning 3

Rush Order

HAM

Group 13

33

Required TCs

Risk Coverage 33%11% 95%

Create Sales OrderVA01


No time to test all combinations!

Create Sales Order


Outbound Delivery


Post Goods Issue

Billing Document

Check Document

Flow

VA01

2,100 1,200 1,380 290 2,450 650x x x x x =

33

16

18

8

32

11

+

+

+

+

+ = 118

1.60604E+18

Max out risk coverage whilst

minimizing test efforts. * … awarded by the scientific community

3/23/2015

8

© 2015 Tricentis. All rights reserved. 20

Test Case & Data Design


Linear Q SM - TestCases with max. effectiveness

100 %

Test coverage

Effort

50 %0 %

Exponential

increase

Linear increase up to near

100 % test coverage

3/23/2015

9


Source: Customer Projects TRICENTIS®

Total effort/costs

100%

0%

50%

Test Case

Specification

25%

Manual

Test

Execution

75%

Automation

Finding

and

Preparing

Test Data

Execution

of

Test Cases

50 - 75% of manual

execution costs!insufficient control of

test data

Synthetic Test Data Engine



Automate

Model-Based Test

Automation


Optimize

Risk Coverage

Optimizer

Manage

Test Data

Provisioning


Provides tailored test data basis for test execution

Reduces effort in manual test execution by 40 – 50 %

Stateful test data management is key for high automation rates

3/23/2015

10


The magic triangle of test efficiency

Automatic TestCase execution

Automatic creation/adaptation of test data

objects




Manage

Test Data

Provisioning

Optimize

Risk Coverage

Optimizer

Automate

Model-Based Test

Automation


Enables extreme automation (rates > 90%)

Covers UI and nonUI test automation

Enables seamless transition from manual to automated testing

3/23/2015

11


The Maintenance Problem

Example:

“…select invoice with the car registration number VIC-3456”

CheckBox Click,

“/usr/cntlCONTAINER/she

llcont/

shell[2]/chbx[1,3]”

Does your business unit understand this instruction?

Is this instruction stable?

Checkbox Name Reg Number Invoice

John Smith NSW-1234 90035560

Jim Courier NSW-2345 90035561

John Cook VIC-3456 90035562

Tim Rebhorn VIC-4567 90035563

Dale Howard WA-5678 90035564

Frank Rose WA-6789 90035565


Model Based Test Automation

CheckBox Click,

“/usr/cntlCONTAINER/she

llcont/

shell[2]/chbx[1,3]”

Example:

Do you understand the business instruction?

Do you remember it?

“…select invoice with the car registration number VIC-3456”

3/23/2015

12


No time for scripting

Create Sales Order

VA01

© 2015 TRICENTIS GmbH. All rights reserved. 30Source: Automated Tosca Test Case, Order2Cash

No time for scripting

Tr

List of SAP Transactions

1. VA01 Create Sales Order

2. VL01n Create Delivery Note for Sales Order

3. LT03 Create Transfer Order for Delivery

4. VL02n Change Outbound Delivery

5. VF01 Create Billing Document

6. VF03 Display Billing Document

Create Sales Order


Outbound Delivery


Post Goods Issue

Billing Document

Check Document

Flow

VA01

Our customers achieve unprecedented automation rates

with no need for programmers.

3/23/2015

13


System Under Test

Test Cases

Model(s)

Technologydecoupling

Business

SAP Test Automation Architecture

SAP GUI

SAP Application

Server

SAP WebGUI


SAP Fiori


TOSCA

SAP

TOSCA Next Gen SAP Accelerator Package

NextGen Package

MM

SD

PP

QM

PMPS

FICO

Asset

Costing

3/23/2015

14


• 671 SAP Transaction are automated in vanilla SAP application

• The automated test scripts can be easily tailored to suit

customer requirements

• Automated Change Impact Analyzer would help to identify the

gap between vanilla and customer SAP landscape.

• Enabling Auto remediation feature will help to correct the Test

scripts.

• The test data needs to be changed as per customer

requirements for test execution.

TOSCA Next Gen SAP Accelerator Features


Modules

• Comprehensive unique modules

• No redundancies

• Easy to maintain

12 Modules

serves 3 Transaction

with no redundancies

3/23/2015

15


Test Cases – Structure

Test Cases are stored according to SAP Menu hierarchy


Test Configuration

SAP Solution Manager 7.1 (or higher) Tricentis Tosca TestSuite

Test CaseExt. TestCase

Test PackageExecution List

Execution Log

Execute Test Script

Execution Status

Most Powerful Integration with SAP Solman

Service Desk

Synchronisation

Test Case Design

Requirements

Create Solman Testscript

IncidentCreate linked incident

Business Blueprint

Dyn. TBOMs Create Dynamic TBOM

Business Process

Change AnalyzerSubmit Execution List

3/23/2015

16


Top 3 Pain-Points - Summary

1 TestCase Quality

2 Missing Test Data

3 Manual testing

Reduced number of test casesOptimize

Risk Coverage

Optimizer

Highest risk coverage

Pain-Points Tosca Testsuite Your benefits

Manage

Test Data

Provisioning

Tailored test data

Never run out of them

Automate

Model-Based Test

Automation

Business readable

Avoid maintenance trap

Accelerated set-up (transaction re-use)


Requirement Phase

Plan & DesignTest case

developmentExecution

Analysis & Closure

• Analysis of the requirements

• Review the requirement specifications (RS)

• Manage changes to the RS

• Establish traceability

• Review & Sign off

• Breaking the requirement to modules

• Design test scenarios

• Prepare the test plan

• Automation feasibility & framework

• Plan tools usage

• Design test cases• Gather Test data

requirements• Partial

Automation• Update

traceability• Upload Test

cases to QC• Identify

automation TCs

• Assign Test cases to consultants by SAP Modules

• Execute manual test cases

• Co-ordinate with SAP Consultants to complete End to End Test

• Log defects• Retest• Perform partial

automation • Record test results

• Co-ordinate with SAP Consultants to on Test Completion results

• Potential Defects retesting

• Generate the report for Manual test and Auto execution

• Test Artifacts

Traditional Testing Vs TOSCA Next GenTraditional Testing

TOSCA SAP Next Gen - An efficient and effective way of testing

Requirement Phase

Plan, Design & Develop

ExecutionAnalysis &

Closure

Understand client SAP Landscape & Modules

Deploy Next Gen SAP Work pack

Analyze customer landscape with TOCSA Next Gen Accelerator

Extract relevant Automated Tcode from Next Gen

Review & Sign off

Auto Remediate transactions to customer SAP Environment

Link Transactions to test scenarios

Auto End to End Test scripts

Maximize AutomationMinimal Manual Test

cases Integrated

o Test Datao Identify Risko Apply OA

Sync with Auto upload to test management tools

Un attended Test execution

Log defectsAnalysisAuto Re-testRecord test resultsTest Closure Business User

Involvement

Test

Coordination

Test Coverage

Multiple Test

Runs

3/23/2015

17


More information

Please contact:

Ernst Jan Smit

Sales Manager Benelux

Tricentis NL BV

Prins Bernhardplein 200, 1097 JB Amsterdam, The Netherlands

o - +43 1 263 2409, m - +31 6 11 533103

e – [email protected]

© 2015 TRICENTIS GmbH. All rights reserved. 4848© 2013 TRICENTIS Technology & Consulting GmbH. All rights reserved.

Thank you!

http://www.tricentis.com/

mailto:[email protected]

Accelerate. Innovate. Automate. - Sogeti.nl SAP Testen TOSCA... · Technology Integration Optimize...

Documents

Transcript of Accelerate. Innovate. Automate. - Sogeti.nl SAP Testen TOSCA... · Technology Integration Optimize...