BI Apps 7.9.5 - ETL Data Lineage

22
Oracle® Business Intelligence Applications Fusion Edition ETL Data Lineage Guide Release 7.9.5 Copyright 2008, Oracle. All Rights Reserved. How to use this guide 1 ETL mappings are split into two main mappings, SDE mappings and SIL mappings. 2 SDE mappings load the staging tables,then SIL mappings (SILOS, SIL_Vert, PLP) load the fi 3 SILOS SIL mappings are for all sources except Siebel Verticals. SIL_Vert SIL mappings are 4 Staging tables are suffixed with S, so W_AP_XACTS_F is the final table and the staging ta 5 In general mappings are linear, however, some include more complex logic, e.g. Post Load 6 Start by looking at the mappings of product to DAC execution plans to physical warehouse 7 Figure out the associate staging tables and look at the specific source system tab to rev 9 Universal Adapter does not have SQL Overrides 10 Select Target column and click on "Go to SIL" button to navigate to SIL where SDE Target 11 Review the Coverage Matrix to understand which adapters populate which parts of the physi This document is not warranted to be error-free, nor is it subject to any other warranties or expressed orally or implied in law, including implied warranties and conditions of merchantab particular purpose. We specifically disclaim any liability with respect to this document, and are formed either directly or indirectly by this document. This document may not be reproduce form or by any means, electronic or mechanical, for any purpose, without our prior written pe 8 Select SQL Override ID and Click on "Go to SQL Override" button to navigate to SQL used t include details on business logic, etc.

description

data lineage

Transcript of BI Apps 7.9.5 - ETL Data Lineage

Page 1: BI Apps 7.9.5 - ETL Data Lineage

Oracle® Business Intelligence Applications Fusion EditionETL Data Lineage GuideRelease 7.9.5

Copyright 2008, Oracle. All Rights Reserved.

How to use this guide1 ETL mappings are split into two main mappings, SDE mappings and SIL mappings.2 SDE mappings load the staging tables,then SIL mappings (SILOS, SIL_Vert, PLP) load the final physical warehouse tables3 SILOS SIL mappings are for all sources except Siebel Verticals. SIL_Vert SIL mappings are for Siebel Verticals only4 Staging tables are suffixed with S, so W_AP_XACTS_F is the final table and the staging table is W_AP_XACTS_FS5 In general mappings are linear, however, some include more complex logic, e.g. Post Load Processing, combining temp tables, etc.6 Start by looking at the mappings of product to DAC execution plans to physical warehouse table7 Figure out the associate staging tables and look at the specific source system tab to review where the staging tables source data from

9 Universal Adapter does not have SQL Overrides10 Select Target column and click on "Go to SIL" button to navigate to SIL where SDE Target = SIL Source11 Review the Coverage Matrix to understand which adapters populate which parts of the physical data warehouse schema

This document is provided for information purposes only, and the contents hereof are subject to change without notice. This document is not warranted to be error-free, nor is it subject to any other warranties or conditions, whether expressed orally or implied in law, including implied warranties and conditions of merchantability or fitness for a particular purpose. We specifically disclaim any liability with respect to this document, and no contractual obligations are formed either directly or indirectly by this document. This document may not be reproduced or transmitted in any form or by any means, electronic or mechanical, for any purpose, without our prior written permission.

8 Select SQL Override ID and Click on "Go to SQL Override" button to navigate to SQL used to extract data which will include details on business logic, etc.

Page 2: BI Apps 7.9.5 - ETL Data Lineage
Page 3: BI Apps 7.9.5 - ETL Data Lineage

Oracle BI Applications 7.9.5 ReleaseData Lineage Sheet

FOLDER_NAME MAPPING_NAMESDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimension

The data lineage sheet below shows relationships between the ETL Folder, ETL Mapping, OLTP columns and Data Warehouse Columns. It only documents the Source Dependent Extract mappings (SDEs). It also displays which columns are populated with lookup, for

Page 4: BI Apps 7.9.5 - ETL Data Lineage

TARGET_TABLE TARGET_COLW_AP_TERMS_DS ACTIVE_FLGW_AP_TERMS_DS AP_TERM_CODEW_AP_TERMS_DS AP_TERM_DESCW_AP_TERMS_DS AP_TERM_DURATIONW_AP_TERMS_DS AP_TERM_NAMEW_AP_TERMS_DS AUX1_CHANGED_ON_DTW_AP_TERMS_DS AUX2_CHANGED_ON_DTW_AP_TERMS_DS AUX3_CHANGED_ON_DTW_AP_TERMS_DS AUX4_CHANGED_ON_DTW_AP_TERMS_DS CHANGED_BY_IDW_AP_TERMS_DS CHANGED_ON_DTW_AP_TERMS_DS CONDITION_10_TEXTW_AP_TERMS_DS CONDITION_10_TEXTW_AP_TERMS_DS CONDITION_10_TEXTW_AP_TERMS_DS CONDITION_10_TEXTW_AP_TERMS_DS CONDITION_10_TEXTW_AP_TERMS_DS CONDITION_10_TEXTW_AP_TERMS_DS CONDITION_10_TEXTW_AP_TERMS_DS CONDITION_1_TEXTW_AP_TERMS_DS CONDITION_1_TEXTW_AP_TERMS_DS CONDITION_1_TEXTW_AP_TERMS_DS CONDITION_1_TEXTW_AP_TERMS_DS CONDITION_1_TEXT

Page 5: BI Apps 7.9.5 - ETL Data Lineage

TARGETW_AP_TERMS_DS.ACTIVE_FLGW_AP_TERMS_DS.AP_TERM_CODEW_AP_TERMS_DS.AP_TERM_DESCW_AP_TERMS_DS.AP_TERM_DURATIONW_AP_TERMS_DS.AP_TERM_NAMEW_AP_TERMS_DS.AUX1_CHANGED_ON_DTW_AP_TERMS_DS.AUX2_CHANGED_ON_DTW_AP_TERMS_DS.AUX3_CHANGED_ON_DTW_AP_TERMS_DS.AUX4_CHANGED_ON_DTW_AP_TERMS_DS.CHANGED_BY_IDW_AP_TERMS_DS.CHANGED_ON_DTW_AP_TERMS_DS.CONDITION_10_TEXTW_AP_TERMS_DS.CONDITION_10_TEXTW_AP_TERMS_DS.CONDITION_10_TEXTW_AP_TERMS_DS.CONDITION_10_TEXTW_AP_TERMS_DS.CONDITION_10_TEXTW_AP_TERMS_DS.CONDITION_10_TEXTW_AP_TERMS_DS.CONDITION_10_TEXTW_AP_TERMS_DS.CONDITION_1_TEXTW_AP_TERMS_DS.CONDITION_1_TEXTW_AP_TERMS_DS.CONDITION_1_TEXTW_AP_TERMS_DS.CONDITION_1_TEXTW_AP_TERMS_DS.CONDITION_1_TEXT

Page 6: BI Apps 7.9.5 - ETL Data Lineage

SOURCE_TABLE SOURCE_COLAP_TERMS ENABLED_FLAGAP_TERMS TERM_IDAP_TERMS DESCRIPTION

Not Populated - Not ConnectedAP_TERMS NAMEAP_TERMS_LINES LAST_UPDATE_DATE

Not Populated - Not ConnectedNot Populated - Not ConnectedNot Populated - Not Connected

AP_TERMS LAST_UPDATED_BYAP_TERMS LAST_UPDATE_DATEAP_TERMS TERM_IDAP_TERMS_LINES DUE_AMOUNTAP_TERMS_LINES DUE_DAYSAP_TERMS_LINES DUE_DAY_OF_MONTHAP_TERMS_LINES DUE_MONTHS_FORWARDAP_TERMS_LINES DUE_PERCENTAP_TERMS_LINES SEQUENCE_NUMAP_TERMS TERM_IDAP_TERMS_LINES DUE_AMOUNTAP_TERMS_LINES DUE_DAYSAP_TERMS_LINES DUE_DAY_OF_MONTHAP_TERMS_LINES DUE_MONTHS_FORWARD

Page 7: BI Apps 7.9.5 - ETL Data Lineage

SQL_OVERRIDE_IDSDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3

SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3

SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3

Page 8: BI Apps 7.9.5 - ETL Data Lineage

Oracle BI Applications 7.9.5 ReleaseData Lineage Sheet

FOLDER_NAME MAPPING_NAMESILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFact

The data lineage sheet below shows relationships between the ETL Folder, ETL Mapping, OLTP columns and Data Warehouse Columns. It only documents the Source Dependent Extract mappings (SDEs). It also displays which columns are populated with lookup, for

Page 9: BI Apps 7.9.5 - ETL Data Lineage

TARGET_TABLE TARGET_COLW_ACD_EVENT_F ANI_NUMW_ACD_EVENT_F AUX1_CHANGED_ON_DTW_ACD_EVENT_F AUX2_CHANGED_ON_DTW_ACD_EVENT_F AUX3_CHANGED_ON_DTW_ACD_EVENT_F AUX4_CHANGED_ON_DTW_ACD_EVENT_F CALLID_NUMW_ACD_EVENT_F CALL_EVNT_TYPE_WIDW_ACD_EVENT_F CALL_EVNT_TYPE_WIDW_ACD_EVENT_F CALL_EVNT_TYPE_WIDW_ACD_EVENT_F CALL_REASON_WIDW_ACD_EVENT_F CALL_REASON_WIDW_ACD_EVENT_F CALL_REASON_WIDW_ACD_EVENT_F CALL_TYPE_WIDW_ACD_EVENT_F CALL_TYPE_WID

Page 10: BI Apps 7.9.5 - ETL Data Lineage

SOURCEW_ACD_EVENT_FS.ANI_NUMW_ACD_EVENT_FS.AUX1_CHANGED_ON_DTW_ACD_EVENT_FS.AUX2_CHANGED_ON_DTW_ACD_EVENT_FS.AUX3_CHANGED_ON_DTW_ACD_EVENT_FS.AUX4_CHANGED_ON_DTW_ACD_EVENT_FS.CALLID_NUMW_ACD_EVENT_FS.CALL_EVNT_TYPE_IDW_ACD_EVENT_FS.DATASOURCE_NUM_IDW_EVENT_TYPE_D.ROW_WIDW_ACD_EVENT_FS.CALL_REASON_IDW_ACD_EVENT_FS.DATASOURCE_NUM_IDW_REASON_D.ROW_WIDW_ACD_EVENT_FS.CALL_TYPE_IDW_ACD_EVENT_FS.DATASOURCE_NUM_ID

Page 11: BI Apps 7.9.5 - ETL Data Lineage

SOURCE_TABLE SOURCE_COLW_ACD_EVENT_FS ANI_NUMW_ACD_EVENT_FS AUX1_CHANGED_ON_DTW_ACD_EVENT_FS AUX2_CHANGED_ON_DTW_ACD_EVENT_FS AUX3_CHANGED_ON_DTW_ACD_EVENT_FS AUX4_CHANGED_ON_DTW_ACD_EVENT_FS CALLID_NUMW_ACD_EVENT_FS CALL_EVNT_TYPE_IDW_ACD_EVENT_FS DATASOURCE_NUM_IDW_EVENT_TYPE_D ROW_WIDW_ACD_EVENT_FS CALL_REASON_IDW_ACD_EVENT_FS DATASOURCE_NUM_IDW_REASON_D ROW_WIDW_ACD_EVENT_FS CALL_TYPE_IDW_ACD_EVENT_FS DATASOURCE_NUM_ID

Page 12: BI Apps 7.9.5 - ETL Data Lineage

SQL_OVERRIDE_IDSILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.mplt_SIL_ACDEventFact.12.Lkp_W_Event_Type_D_Call_Event_Type_Wid.11SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.mplt_SIL_ACDEventFact.9.Lkp_W_REASON_D_Call_Reason_Wid.11SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3

Page 13: BI Apps 7.9.5 - ETL Data Lineage

Oracle BI Applications 7.9.5 ReleaseSQL Overrides

This sheet below shows the full SQL Override statement contents of the SQL Override IDs from the lineage sheets.SQL_OVERRIDE_ID

PLP.MPLT_GET_ETL_PROC_WID.1.LKP_ETL_PROC_WID.11PLP.mplt_GLBalanceAggrByAcctSegCodes.6.SQ_W_GL_BALANCE_F.3PLP.mplt_PLP_Aggregates.5.LKP_IA_GL_GROUP_ACCTS.11PLP.MPLT_TIME_PERIOD_AGG.1.LKP_PERIOD_START_END_DT.11PLP.MPLT_UNSPECIFIED.3.LKP_ETL_PROC_WID.11PLP.MPLT_UNSPECIFIED.4.LKP_W_PARAM_G_LANG_ID.11PLP.MPLT_UNSPECIFIED.6.LKP_W_PARAM_G.11PLP.MPLT_UNSPECIFIED.9.SQ_W_LST_OF_VAL_G.3PLP.PLP_APBalanceCurrentActivityLoad.5.SQ_W_AP_BALANCE.3PLP.PLP_APBalanceDateUpdate.4.SQ_W_AP_BALANCE.3PLP.PLP_APBalanceFutureActivityLoad.7.SQ_W_AP_BALANCE.3PLP.PLP_APBalanceFutureActivityUpdate.6.SQ_W_AP_BALANCE.3PLP.PLP_APFutureActivityDelete.3.SQ_NU_AP_FUACT.3PLP.PLP_APFutureActivityDerive.11.LKP_AP_FUACT_F_TMP.11PLP.PLP_APFutureActivityDerive.6.SQ_W_AP_BALANCE.3PLP.PLP_APFutureActivityUpdate.4.SQ_W_AP_FUACT.3PLP.PLP_APIncrActivityLoad.6.SQ_PLP_AP_INCR_ACTIVITY_LOAD.3PLP.PLP_APIncrActivityLoad.7.LKP_W_EXCH_RATE_G.11PLP.PLP_APSnapshotInvoiceAging.10.LKP_CUT_OF_DK.11PLP.PLP_APSnapshotInvoiceAging.13.SQ_IA_AP_AGING_INV.3PLP.PLP_APSnapshotInvoiceAging.14.SQ_IA_AP_XACTS.3PLP.PLP_APSnapshotSupplierAgingAggregate.10.SQ_IA_AP_AGING_AGG.3PLP.PLP_APSnapshotSupplierAgingAggregate.8.SQ_IA_AP_AGING_INV.3

Page 14: BI Apps 7.9.5 - ETL Data Lineage

SQL_OVERRIDE

W_GL_BALANCE_...

W_AP_BALANCE_F_TMP.TENANT_IDW_DAY_D.ROW_WID = (SELECT W_DAY_D.ROW_WID FROM W_DAY_D WHERE W_CURRENT_CAL_DAY_CODE = 'Current')W_AP_BALANCE_F_TMP.TENANT_IDW_AP_FUACT_F_TMP.TENANT_IDW_AP_FUACT_F_TMP.ACTIVITY_DT_WID <= (SELECT FSCL_MNTH_END_DT_WID FROM W_FSCL_MONTH_D WHERE W_CURRENT_FSCL_MONTH_CODE = 'Current')

(SELECT FSCL_MNTH_END_DT_WID FROM W_FSCL_MONTH_D WHERE W_CURRENT_FSCL_MONTH_CODE = 'Current')(SELECT FSCL_MNTH_END_DT_WID FROM W_FSCL_MONTH_D WHERE W_CURRENT_FSCL_MONTH_CODE = 'Current')W_AP_XACT_F.TENANT_ID

D.ROW_WID -- W_AP_AGING_INVOICE_A.SNAPSHOT_DT_WID = W_DAY_D.ROW_WIDW_AP_XACT_F.PURCH_INVOICE...W_DAY_D.LAST_DAY_CAL_MNTH_FLG = 'N')SUM(CASE WHEN W_AP_AGING_INVOICE_A.OPEN_BUCKET ...

Page 15: BI Apps 7.9.5 - ETL Data Lineage

W_DAY_D.ROW_WID = (SELECT W_DAY_D.ROW_WID FROM W_DAY_D WHERE W_CURRENT_CAL_DAY_CODE = 'Current')

W_AP_FUACT_F_TMP.ACTIVITY_DT_WID <= (SELECT FSCL_MNTH_END_DT_WID FROM W_FSCL_MONTH_D WHERE W_CURRENT_FSCL_MONTH_CODE = 'Current')

(SELECT FSCL_MNTH_END_DT_WID FROM W_FSCL_MONTH_D WHERE W_CURRENT_FSCL_MONTH_CODE = 'Current')(SELECT FSCL_MNTH_END_DT_WID FROM W_FSCL_MONTH_D WHERE W_CURRENT_FSCL_MONTH_CODE = 'Current')

Page 16: BI Apps 7.9.5 - ETL Data Lineage
Page 17: BI Apps 7.9.5 - ETL Data Lineage
Page 18: BI Apps 7.9.5 - ETL Data Lineage
Page 19: BI Apps 7.9.5 - ETL Data Lineage
Page 20: BI Apps 7.9.5 - ETL Data Lineage