8/9/2019 CRM Data Extraction Optimization to BI

1/2

CRM Data Extraction Optimization to BI

CRM Datasource extraction issues, data not extracting, extraction is very slow.

In my current project we were extracting data from CRM System for data sources like 0CRM_SRV_PROCESS_I,0CRM_SRV_PROCESS_H etc. As far as my knowledge concerned we dont have setup tables in CRM System. So its more ofa Finance Type extraction. Everything was working fine in Development system but when we transported our data sourcesto QA system it was not fetching any data to BI System that was one problem and the other issue was that once ourdatasources started extracting data the extraction was extremely slow.

Since we need not to fill setup tables we have to extract data directly, so do I started my loads for Datasources0CRM_SRV_PROCESS_I, 0CRM_SRV_PROCESS_H but I end up with having 0 records in QA System where in all things workfine in Development environment, I tried full load as well, checked data in base tables, re-transported the entire

datasources again n again but its all waste as the output was still zero. So there was something more to that thanjust checking data in tables or re-transporting the datasources in QA which stopping me to extract data in BI System. Nowthis is where my analysis started..... SDN, Google and Friends I approached everyone who has done some work in CRM. Butit takes lot of time, energy & client escalations as well to reach to exact problem and this is how we gain experience.

Now I am sharing my experience on what checks we have to made in such cases where standard datasources does notextract data at all without enhancement's and the cases where data extractions are very slow after enhancement.

I. STANDARD DATASOURCE NOT EXTRACTING DATA FROM CRM SYSTEM IN QA:

There are tables in CRM System which stores data about the datasource:

SMOXHEAD- Control Table: BW Adapter 002, SMOXHEAD_S - Shadow Table for Table smoxhead,

These are the tables which stores the Datasource type, Delta status, Selection field function module, mapping functionmodule etc.

In our case this table was somehow not having the entry for the datasource 0CRM_SRV_PROCESS_I & H in our QA system.

This was the very basic reason why we were not able to extract the data in QA system but same was possible in DEV. Nowthis might seems to be very simple reason but it took lot of time n effort to know that :)

The other things we can check for is that datasource should be checked in TCODE BWA5.

Now lets move on the issue

II. DATA Extraction is very slow after enhancement:

Below are points which one needs to keep in mind while writing enhancement code in CRM for the custom fields indatasource:

i) Avoid select statements in loop,

ii) Minimize the use of nested select statements & use for all entries statement instead

iii) During calling of the function module CRM_ORDER_READ(based on requirement) add the below mentioned code to clear

the buffer:CALL FUNCTION 'CRM_ORDER_READ'

IMPORTING =

EXPORTING = .

*******START OF BUFFER CLEAR********

CALL FUNCTION 'CRM_ORDER_INITIALIZE'

EXPORTING

iv_initialize_whole_buffer = 'X'

8/9/2019 CRM Data Extraction Optimization to BI

2/2

EXCEPTIONS

error_occurred = 1

OTHERS = 2.

CALL FUNCTION 'PRC_INIT'.

CALL FUNCTION 'BREL_INIT_BUFFER'.

CALL FUNCTION 'REL_INIT_BUFFER'.*******END OF BUFFER CLEAR********

iv)Since in CRM System everything be it Service order, confirmation etc is business type driven i.e. everything isdifferentiated on the basis of business type, for e.g. business type 'BUS2000116' defines a service order. In TCODE BWA1please check that you have the relevant business type selected in tab 'Selection Conditions', we may have some additionalbusiness type's also mentioned of which data may not be required (purely requirement based) so we can remove thosebusiness type which improves the data extraction process a lot as it has to only extract particular business type data now.

v) There are couples of notes also which deals with these issues, which can be implemented in the system to make theextraction faster:

1. SAP Note 1330249 - Performance 0CRM_SRV_PROCESS_H

2. SAP Note 508008 - Extractor; GUID selection: changing from LDB to rep. framew.

3. SAP Note 520846 - 1O-Extractor: Ranges for the partner fields does not work

4. SAP Note 521299 - 1O extractor: Extraction from CRM to BW is too slow

5. SAP Note 535306 - One order selection module: selection after CREATED_AT

6. SAP Note 564334 - One-Order extraction: Orgnztnl objects as selection fields

7. SAP Note 572695 - BW, initialization of internal table during initial upload

8. SAP Note 590557 - BW, termination with initial load of business transactions

9. SAP Note 593659 - BW, termination of initial area load SALES, conditions

10.SAP Note 595416 - One-Order: selection by CREATED_AT for single value

11.SAP Note 634880 - BW extraction: Missing records during selectn by CREATED_AT

12.SAP Note 639072 - CRM/BW parallel proc. for extracting business transactions

13.SAP Note 653645 - Composite SAP Note performance

14.SAP Note 1122666 - RFW:Parameters maintanence in smofparsfa for performance

vi) The performance could be slow because of the wrong control parameters used for packaging in InfoPackage whileextracting data from CRM System:

Change the package size for the data extraction.

Infopackage (scheduler) > Menu 'Scheduler' > 'DataS. default data transfer' > maintain the value as 1500or 1000 or500(This value is variable)

These are solutions which I did in my project in order to achieve my stated problems and now they are successfully running.I hope it helps a lot of peoples who are also dealing with the similar problems.