Jose Ruiz Specialist Quality & Security Adrian Batyk ... Ruiz –Specialist Quality & Security...

Optimice sus Entornos de Prueba con Datos de

ProducciónJose Ruiz – Specialist Quality & Security

Adrian Batyk – Senior Consultant

2© 2015 SAP SE or an SAP affiliate company. All rights reserved.

Jose RuizEspecialista en Calidad y SeguridadSAP

Solution Architect at HP Corp Performance engineer at HSBC

Focus on IT Quality Management

I like to play the guitarI love reading booksMeet new people

3© 2015 SAP SE or an SAP affiliate company. All rights reserved.

Adrian Matias BatykSLO/DMS ConsultantSAP

Solution Architect at SLO

TDMS Expert

I like to play the footballI love watching movies

© 2015 SAP SE or an SAP affiliate company. All rights reserved. 4Customer

Agenda

Situación Común en clientes

Test Data Migration Server(TDMS)

Beneficios

Casos de Éxito


Situación Común en Clientes


Situaciones comunes de TI

How can you be sure that business applications are highly functioning and support the business

strategy ?

Technology changes Business process changes Compliance requirements

Eff

ort Ongoing

Change

Events

Time

Discrete

Change

Events

New Implemention

New Processes

Consolidation

Upgrades

Custom DevelopmentSupport Pack


Reto: Igualar los ambientes preproductivos…


Hallazgos

Componente Detalle

Infraestructura• La BD de Preproducción mide 5TB, es igual a Producción en tamaño

• Cada planchado se requiere incrementar recursos

Seguridad• La BD es una copia fiel de producción, no son enmascarados los datos

• La nomina se copia sin enmascaramiento, es un riesgo

Tiempo

• Hoy en día requieren hasta 5 días para actualizar el ambiente pre productivo y la penúltima

vez fue hace 3 años, por lo mismo no se realiza frecuentemente

• El equipo de Basis se dedica a esta tarea junto al DBA

• Se tiene que dedicar como mínimo 1 semana para la generación de datos de Desarrollo y

Pruebas

Operaciones


Test Data Migration Server


Typical Scenario

No easy way to bring

current data to DEV

Full Copies

1.5 TB

1.5 TB1.5 TB

200 GBStale

data

In a nut shell

Storage

Costs

Resources

Time

Efficiency

Process

Security directly contributes to the

success of your business.

PRD/100

QAS/100TRN/100

DEV/100

Current Situation


SAP Test Data Migration Server softwareBusiness requirements

LoB Heads / Functional Teams

o Require current data in DEV & Q/A system to speed up time-

to-market of new functionality

o Responsible for application support -> need a way to replicate

data from PRD for troubleshooting

o Own the data – need to protect sensitive data

Q/A & Testing Teams

o Depend on current data for testing and quality assurance

SAP Basis Teams

o Interested in ways to simplify/automate setup & refresh of

SAP systems/clients

IT Infrastructure Teams

o Responsible for system landscape management, therefore

interested in controlling cost of running/supporting it

o Need to support project activities by providing project systems

o Need to ensure sensitive data is adequately protected


Product Description

With SAP Test Data Migration Server (SAP TDMS), you can:

● Reduce the footprint of your non-production environment and minimize infrastructure and maintenance expenses

- by creating lean, easy-to-maintain systems using current extracts of business data

● Enable functional teams to extract and transfer data for troubleshooting and testing purposes

- by transferring small amount data using business objects

● Maximize the effectiveness of your development, test, or training activities

- by providing current data frequently to test systems.

● Comply with data privacy laws

- by scrambling your sensitive production data

● Migrate data across non-connected data centers

- by using the file transfer technique

● Transition to SAP innovations such as SAP Business Suite powered by SAP HANA on premise or on Enterprise Cloud

SAP Test Data Migration Server (SAP TDMS) is a high-speed data extraction tool that transfers relevant business data

from your SAP production system to your development, test, quality assurance, or training system.


SAP Test Data Migration Server softwareData reduction – time slice scenario

Assumption

80-90% of the production data is stored in 10-20% of

client-dependent tables

Data volume reduction

In order to reduce the overall volume, only few tables

need to be reduced (still 800+ tables)

All other tables (master and configuration data) are

migrated entirely

Customer-individual tables are transferred in full –

If time stamp on table, TDMS automatically reduces

them

Some tables are excluded from transfer by default:

– E.g. change documents, user tables, etc.

(customizable)

Transaction Data

Administration Data Configuration Data

Master Data

Client DB – Before data reduction

Client DB – After data reduction (80%)

Storage Savings

Transaction Data

Configuration Data

Master Data

Administration Data


High-level Architecture

RFC Connection RFC Connection

Sender System Control/Central System Receiver System

1. Data

Selection

(cluster)

2. Data Deletion

4. Scrambled Data3. Data Transfer

File(s)

Scrambled Data


Main Features

Web-based Interface Solution Manager Integration Fiori App

Shell Creation Data Scrambling Full Client Transfer File-based Transfer

GTS

Reduced

post-transfer

processing

activities

Seamless

integration

with other

applications

Full Transfer of

Client-Specific Data

Time-based

Reduction

SAP Live Cache

reduced by Date

and Planning

Version

Demand Planning

for BI

APO data reduced

based on time

Full Transfer of


Data import

through Files

SCMCRM

Time-Based

Reduction

Transfer

of Master

Data and

Customizing

Full Transfer of


Data import

through Files

BW

Time-Based Data

Reduction for

Individual Info

Areas

Data import

through Files

PSA Data

Eliminated

HCM

E-Recruiting

Process and Forms

Transfer of PA Data

Transfer PA & PD

Data in one Step

Stand-alone

Scrambling

Country-Specific

Scrambling content

Payroll & Time

Comparison

Data import

through Files

ERP

Time-Based

Reduction

Company Code and

Time-Based

Reduction

Transfer

of Master

Data and

Customizing

Business Process

Library

Stand-alone

Scrambling

Data Scarmbling

content

Data import through

Files

Full Transfer of


SRM

Time-based

Reduction

Transfer of

master data and

Customizing

Consistent

document flow

Full Transfer of

Client-Specific

Data

Data import

through Files

IS

Object-Based

reduction for

SAP Banking

Object-Based

reduction for

SAP CRM for

Utilities

Object-Based

reduction for

SAP Retail

Object-Based

reduction for

SAP Utilities

Time-Based

Reduction for

SAP Oil & Gas

(Downstream)


SAP Test Data Migration Server software Business Process Library (BPL) - Excerpt

Master Data

Business Partner

Business Partner (IS-U)

Number Range Object

Material

Vendor

Customer

G/L Account A

G/L Account B

Asset (FI-AA)

Functional Location

Equipment

Internal Order

Profit Center

Project (PS)

Cost Center

Purchasing Info Record

Work Center

Material BOM

Transactional Data with Corresponding Master Data

Accounting Document

Purchase Requisition

Purchase Order

Sales Order

Material Document

CO Document

Sales Invoice

Incoming Invoice

Quality Notification

Maintenance Order

Delivery

Physical Inventory Document

Allocation Table (RetaiI)

FI-CA Document

Custom Data

Empty scenario for custom-specific objects

Transactional Data

Purchase Order

Sales Order

Production Order

Process Order

Insurance Object (FS-CD)

Contract (FS-CD)

Loans Contract

Asset (CFM)

Bank Account (BCA)

Contract (IS-U)

Installation (IS-U)

Business Entity (RE-FX)

Delivery

Incoming Invoice

Purchase Requisition

Sales Invoice

Article (Retail)

Insurance Object (FS-CD)

Contract (FS-CD)

Loans Contract

Asset (CFM)

Contact Person


SAP Test Data Migration Server softwareRelease 4.0 – Industry-specific flavors

Based on TDMS time-slice scenario, integration of industry-specific tables in reduction based on time:

– AFS – Apparel & Footwear Solution (ERP) -> In general availability

– DIMP – Discrete Industry and Mill Products (ERP) -> In general availability

– IS Oil & Gas (downstream) -> In general availability

Object-based selection for industry-specific tables in combination with time slice for standard SAP tables:

– Industry Solution for Utilities (ERP & CRM) -> In general availability

– Industry Solution for Banking (Loans & Deposits) -> In general availability

– Industry Solution for Retail (Store Solution) -> In general availability

– Industry Solution for Insurance (ERP) -> Currently in pilot phase

– Industry Solution for Defense (ERP) -> Currently in pilot phase


Utilities ( for ERP and CRM)

Selection options based on:

Business Partner

Contract

Installation

Device

Point of Delivery

BADI Interface (for very flexible selections)

Banking (Loans & Deposits)


Business Partner

Master Contracts

Retail


Store

SAP Test Data Migration Server softwareIndustry-specific flavors


SAP Test Data Migration Server softwareFlexible landscape options - multiple transfers in parallel

Q/A CRM

TDMS Central

PRD CRM

DATA FLOW

Q/A ERP

TDMS Central

PRD ERPTDMS

Control

TDMS

Package 1

TDMS

Package 2

TDMS

Package 3

PRD BW TDMS Central Q/A BW

DATA FLOW

DATA FLOWDATA FLOW

DATA

FLOW

DATA

FLOW

RFC


Typical Use Case Example I : Refresh Of Data In Development

Systems

No easy way to bring

current data to DEV

Full Copies

Selective data copies

possible into DEV

Reduced

copies

PR1100

1.5 TB

QA1100

TRN1100

1.5 TB1.5 TB

DEV1100

200 GB

PR1100

1.5 TB

Before SAP TDMS With SAP TDMS

Stale

data DEV1100/200

500 GBCurrent

data

QA1100

TRN1100

300 GB 300 GB


Step 1:

Reduced copy into flat

file/s

Step 2:

Multiple inserts into different target systems /

clients

330

320

Typical Use Case Example II : Build And Flexibly Refresh Training

Systems

Goal: Provide a repeatable process to build and refresh training clients – as subsets, full copies, and with flat file

option for easy ‘resetting’ capability.

PR1100

1.5 TB

750 GB

300QA1100

1.5 TB

Full Copy

Flat file

TRN1

210

500 GB

200

TRN2

Flexibility


Typical Use Case Example III : Protect Sensitive Data

Sensitive

DataTDMS

ServerSystem Copy Sensitive

Data

Before TDMS

Sensitive

DataTDMS

ServerTDMS Data Scrambling Sensitive

Data

Scrambling

Platform After TDMS

http://www.google.com.au/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&uact=8&ved=0CAcQjRw&url=http://securityaffairs.co/wordpress/11235/hacking/accessing-to-pgp-truecrypt-and-bitlocker-encrypted-containers-with-a-300-tool.html&ei=Jsx_VKrJF8f48QWhoIHICg&psig=AFQjCNHSKltc1gwbPfZDeS3tNLKB-VrvPw&ust=1417747812466744

http://www.google.com.au/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&uact=8&ved=0CAcQjRw&url=http://securityaffairs.co/wordpress/11235/hacking/accessing-to-pgp-truecrypt-and-bitlocker-encrypted-containers-with-a-300-tool.html&ei=Jsx_VKrJF8f48QWhoIHICg&psig=AFQjCNHSKltc1gwbPfZDeS3tNLKB-VrvPw&ust=1417747812466744


Beneficios


Hallazgos Funcionales vs Beneficios

Componente Detalle

Infraestructura• La BD de Preproducción mide 5TB

• Cada planchado se requiere incrementar recursos

• Con TDMS podemos reducir hasta 80% los ambientes pre productivos

Seguridad

• La BD es una copia fiel de producción, no son enmascarados los datos

• La nomina se copia sin enmascaramiento, es un riesgo

• Protección de los datos sensibles de forma automatizada

• Alineación acorde a la ley de protección de datos

Tiempo

• Hoy en día requieren hasta 5 días para actualizar el ambiente pre productivo y la penúltima

vez fue hace 3 años, por lo mismo no se realiza frecuentemente

• El equipo de Basis se dedica a esta tarea junto al DBA

• Se tiene que dedicar como mínimo 1 día para la generación de datos de Desarrollo y

Pruebas

• Con TDMS se obtendrá una reducción de hasta un 60% en el tiempo

• Capacidad de mantener los ambientes preproductivos actualizados

• Reducción de hasta un 50% del tiempo del ciclo de Pruebas

Operaciones


• Reducción (*40%) en los tiempos de preparación de las pruebas:

• Plan• Casos• Datos

• Beneficios Negocio:• Menos riesgo de falla en producción• Asegurar salir en tiempo a producción• Reducción de costos en la operación de SAP

después de la implementación• Reutilizar en futuros Proyectos• Reducción de esfuerzo en el futuro

Beneficios en la implementación de aplicaciones SAP

Instalación

Ciclo 1

Ciclo 2

Ciclo 3

Pruebas Paralelo

Duración Detección y Reparación

9 Semanas de Pruebas (Ejemplo)<Septiembre> <Octubre>

%%

%%

Effo

rt Ongoing ChangeEvents

DiscreteChangeEvents

New ImplementionNew ProcessesConsolidationUpgradesCustom Development

Support Pack

% % %

Pruebas

%

*Benchmark


Casos de Éxito


SAP Test Data Migration Server softwareCustomer examples

Improved quality of test data and testing results

Enabled repeatable process for refreshing nonproduction

systems

Reduced disk requirements by 65%

Reduced system refresh time by 50%

Reduced basis resource needs by 80%

Increased refresh frequency by 65%

Reduced bug-fixing cycle times

Reduced the number of transports

Improved availability of production data in development

environment

Helped create training environment based on specific data

requirements

Reduced database footprint from 25 TB to 3 TB in the non-

production environments

SAP systems are becoming larger and more complex; therefore

robust SAP change management processes are needed to

prevent the introduction of errors

SAP customers should leverage an SAP selective data copy

tool to automate the selection & copying of a subset of data

By introducing such a toolset, SAP customers can take

pressure off the stretched SAP Basis operations team

SAP customers can leverage toolset to scramble and mask

sensitive data

Reduced hardware requirements

Enabled resources to be utilized for innovation

rather than manual system refresh activities

Improved ability to provide data to the business faster and more

accurately

Improved test data in development allows us to catch defects

earlier in the development cycle

Enabled privacy settings for sensitive data


SAP Test Data Migration Server softwareMarket situation - 3,000+ shipments to date


SAP Test Data Migration Server software Market situation - reference customers

../../Atlanta/ALM_Sales_Training_Atlanta_2012/TDMS/2011_SAPPHIRE_Orlando_customer_testimonial_video_-_Harley_Davidson_(wmv).wmv

../../Atlanta/ALM_Sales_Training_Atlanta_2012/TDMS/2011_SAPPHIRE_Orlando_customer_testimonial_video_-_Harley_Davidson_(wmv).wmv

© 2015 SAP SE or an SAP affiliate company. All rights reserved.

Thank you

Adrian Matias BatykDMS/SLO Consultant

SAP Solution Delivery Center

System Landscape Optimization

[email protected]

+54/11/4859-3545

Jose RuizSpecialist Quality & Security

SAP Lac North

[email protected]

+521-55-4443-2625

Jose Ruiz Specialist Quality & Security Adrian Batyk ... Ruiz –Specialist Quality & Security...

Documents

Transcript of Jose Ruiz Specialist Quality & Security Adrian Batyk ... Ruiz –Specialist Quality & Security...