Data Transfer Process

2Company Confidential

Introduction to Data transfer Process

The data transfer process (DTP) is used to transfer data within BI

from a persistent object to another object in accordance with

certain transformations and filters.

In this respect, it replaces the data mart interface and the

InfoPackage. As of SAP NetWeaver 2004s, the InfoPackage only

loads data to the entry layer of BI (PSA).

The data transfer process makes the transfer processes in the

data warehousing layer more transparent. Optimized parallel

processing improves the performance of the transfer process


Data transfer Process

The data transfer process controls the distribution of

data within BI


Features of DTP

With a DTP, data can be transferred either in full

extraction mode or in delta mode.

The DTP controls delta handling and therefore allows

to fill several targets with different deltas from one

source.

The DTP supports in handling data records with errors.

To define a DTP a process chain can be used or define

a DTP for an InfoProvider in an object tree in the Data

Warehousing Workbench.


Creating DTP

• The starting point when creating a DTP is the target into which

we want to transfer data.


Creating DTP Continue..

On the Extraction tab page, specify the parameters



Check Only Get Delta Once, if during the Delta Extraction Mode you want only the latest request to be present in the infoprovider in case the extractor is not capable to provide delta images of the changes in the source. The earlier requests in the cube would needed to be deleted via a delete request in infoprovider step in the process chain.

Optional settings…

Check Get Data by Request, if the source has multiple requests and you would like to transfer data from source to target request by request instead of processing all the request all together.



Determine filter criteria for the delta transfer



Choose Semantic Groups to specify how you to build the data packages that are read from the source. To do this,

determine key fields. Data records that have the same key are combined in one data package.



On the Update tab page, specify the parameters



Types of Error Handling During DTP Load Processes:

1. No update, no reporting (default): If errors occur, the system

terminates the update for the whole data package. The request

is not released for reporting.

2. Update of valid records, no reporting (request with status 'red'):

This option enables update valid records. These records are only

released for reporting after the administrator has checked the invalid

records that were not updated and has released the request manually



3. Update of valid records, reporting possible: You can use the

valid records immediately for reporting. Follow-up actions,

such as adjusting aggregates, are performed automatically.



Specify how many errors can occur before the load process terminates

You can set options for the data to be processed in the Data Target, if no Master Data is maintained for the Transaction Data OR only if Master Data will be maintained before loading the Transaction Data



Setting up parallel processing Type in DTP…

Serial Extraction, Immediate Parallel Processing helps to load the data request from source serially and then process all the requests to the data target in parallel. This should be used for setting parallel processing during loading data into data target.

Serially in Dialog Process (for Debugging) should be used only if you want to simulate the DTP and see if it give expected results. This should be used only for testing DTP.

GOTO > Setting for Batch Manager1

2


Simulating the DTP

To Simulate the execution of the DTP, change the Processing Mode

Place Breakpoints at each step (if required) of DTP processing to verify functioning of the DTP


Scheduling and Monitoring DTP

To monitor the execution of the DTP press

Press to run DTP in background


Error handling with DTP

While loading data records using DTP, error records get

updated into Error Stack of DTP.

Error Stack is physically a type of PSA table, we correct errors

in Error Stack, and then we create Error DTP to load changed

data from Error Stack to Data Target.


Error handling with DTP - Error Stack

A request-based table (PSA table) into which erroneous data

records from a data transfer process are written.

The error stack is used to update the data to the datatarget

once the error is resolved.

At runtime, erroneous data records are written to an error

stack if the error handling for the data transfer process is

activated.


Error handling with DTP - Example for using Error Stack

Updating to Data Store Object Multiple Requests – Error in First

Request.

The Order Number field is the key for the error stack. During

the transformation, data record 02 of request 109882 is

marked as containing errors. In addition to the erroneous data

record, all subsequent data records, including the following

requests, that have the same key are written to the error

stack.


Error handling with DTP - Example for using Error Stack Continue

In this example, data record 01 for request 109883 is written

to the error stack in addition to data record 02 for request

109882.


Error Handling with DTP – Steps to be performed

Failed status of DTP in DTP Process Monitor because of invalid character in records.


Error Handling with DTP – Steps to be performed Continue..

By clicking on Error Stack we can check error records.



Correcting erroneous records in Error Stack by clicking edit

button.


Creating Error DTP from the update tab of standard DTP.




Once Error DTP gets created, we can check the status of Standard

DTP which is changed from create to display, and can also check

the Error DTP under the Object for which we created the standard

DTP.



Here is Error DTP:



Schedule the Error DTP from Execute tab.



In the Error DTP process monitor it’s showing 3 records that we

corrected in Error Stack in earlier steps:



We can also check the status of Standard DTP, it’s also Green now

(without errors).


The records updated status of Standard and Error DTP in the

manage tab of data target.


Data Transfer Process

Documents

Transcript of Data Transfer Process