BI Apps 7.9.5 - ETL Data Lineage

Post on 03-Jan-2016

316 views 18 download

description

data lineage

Transcript of BI Apps 7.9.5 - ETL Data Lineage

Oracle® Business Intelligence Applications Fusion EditionETL Data Lineage GuideRelease 7.9.5

Copyright 2008, Oracle. All Rights Reserved.

How to use this guide1 ETL mappings are split into two main mappings, SDE mappings and SIL mappings.2 SDE mappings load the staging tables,then SIL mappings (SILOS, SIL_Vert, PLP) load the final physical warehouse tables3 SILOS SIL mappings are for all sources except Siebel Verticals. SIL_Vert SIL mappings are for Siebel Verticals only4 Staging tables are suffixed with S, so W_AP_XACTS_F is the final table and the staging table is W_AP_XACTS_FS5 In general mappings are linear, however, some include more complex logic, e.g. Post Load Processing, combining temp tables, etc.6 Start by looking at the mappings of product to DAC execution plans to physical warehouse table7 Figure out the associate staging tables and look at the specific source system tab to review where the staging tables source data from

9 Universal Adapter does not have SQL Overrides10 Select Target column and click on "Go to SIL" button to navigate to SIL where SDE Target = SIL Source11 Review the Coverage Matrix to understand which adapters populate which parts of the physical data warehouse schema

This document is provided for information purposes only, and the contents hereof are subject to change without notice. This document is not warranted to be error-free, nor is it subject to any other warranties or conditions, whether expressed orally or implied in law, including implied warranties and conditions of merchantability or fitness for a particular purpose. We specifically disclaim any liability with respect to this document, and no contractual obligations are formed either directly or indirectly by this document. This document may not be reproduced or transmitted in any form or by any means, electronic or mechanical, for any purpose, without our prior written permission.

8 Select SQL Override ID and Click on "Go to SQL Override" button to navigate to SQL used to extract data which will include details on business logic, etc.

Oracle BI Applications 7.9.5 ReleaseData Lineage Sheet

FOLDER_NAME MAPPING_NAMESDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimensionSDE_ORAR12_Adaptor SDE_ORA_APTermsDimension

The data lineage sheet below shows relationships between the ETL Folder, ETL Mapping, OLTP columns and Data Warehouse Columns. It only documents the Source Dependent Extract mappings (SDEs). It also displays which columns are populated with lookup, for

TARGET_TABLE TARGET_COLW_AP_TERMS_DS ACTIVE_FLGW_AP_TERMS_DS AP_TERM_CODEW_AP_TERMS_DS AP_TERM_DESCW_AP_TERMS_DS AP_TERM_DURATIONW_AP_TERMS_DS AP_TERM_NAMEW_AP_TERMS_DS AUX1_CHANGED_ON_DTW_AP_TERMS_DS AUX2_CHANGED_ON_DTW_AP_TERMS_DS AUX3_CHANGED_ON_DTW_AP_TERMS_DS AUX4_CHANGED_ON_DTW_AP_TERMS_DS CHANGED_BY_IDW_AP_TERMS_DS CHANGED_ON_DTW_AP_TERMS_DS CONDITION_10_TEXTW_AP_TERMS_DS CONDITION_10_TEXTW_AP_TERMS_DS CONDITION_10_TEXTW_AP_TERMS_DS CONDITION_10_TEXTW_AP_TERMS_DS CONDITION_10_TEXTW_AP_TERMS_DS CONDITION_10_TEXTW_AP_TERMS_DS CONDITION_10_TEXTW_AP_TERMS_DS CONDITION_1_TEXTW_AP_TERMS_DS CONDITION_1_TEXTW_AP_TERMS_DS CONDITION_1_TEXTW_AP_TERMS_DS CONDITION_1_TEXTW_AP_TERMS_DS CONDITION_1_TEXT

TARGETW_AP_TERMS_DS.ACTIVE_FLGW_AP_TERMS_DS.AP_TERM_CODEW_AP_TERMS_DS.AP_TERM_DESCW_AP_TERMS_DS.AP_TERM_DURATIONW_AP_TERMS_DS.AP_TERM_NAMEW_AP_TERMS_DS.AUX1_CHANGED_ON_DTW_AP_TERMS_DS.AUX2_CHANGED_ON_DTW_AP_TERMS_DS.AUX3_CHANGED_ON_DTW_AP_TERMS_DS.AUX4_CHANGED_ON_DTW_AP_TERMS_DS.CHANGED_BY_IDW_AP_TERMS_DS.CHANGED_ON_DTW_AP_TERMS_DS.CONDITION_10_TEXTW_AP_TERMS_DS.CONDITION_10_TEXTW_AP_TERMS_DS.CONDITION_10_TEXTW_AP_TERMS_DS.CONDITION_10_TEXTW_AP_TERMS_DS.CONDITION_10_TEXTW_AP_TERMS_DS.CONDITION_10_TEXTW_AP_TERMS_DS.CONDITION_10_TEXTW_AP_TERMS_DS.CONDITION_1_TEXTW_AP_TERMS_DS.CONDITION_1_TEXTW_AP_TERMS_DS.CONDITION_1_TEXTW_AP_TERMS_DS.CONDITION_1_TEXTW_AP_TERMS_DS.CONDITION_1_TEXT

SOURCE_TABLE SOURCE_COLAP_TERMS ENABLED_FLAGAP_TERMS TERM_IDAP_TERMS DESCRIPTION

Not Populated - Not ConnectedAP_TERMS NAMEAP_TERMS_LINES LAST_UPDATE_DATE

Not Populated - Not ConnectedNot Populated - Not ConnectedNot Populated - Not Connected

AP_TERMS LAST_UPDATED_BYAP_TERMS LAST_UPDATE_DATEAP_TERMS TERM_IDAP_TERMS_LINES DUE_AMOUNTAP_TERMS_LINES DUE_DAYSAP_TERMS_LINES DUE_DAY_OF_MONTHAP_TERMS_LINES DUE_MONTHS_FORWARDAP_TERMS_LINES DUE_PERCENTAP_TERMS_LINES SEQUENCE_NUMAP_TERMS TERM_IDAP_TERMS_LINES DUE_AMOUNTAP_TERMS_LINES DUE_DAYSAP_TERMS_LINES DUE_DAY_OF_MONTHAP_TERMS_LINES DUE_MONTHS_FORWARD

SQL_OVERRIDE_IDSDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3

SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3

SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3

Oracle BI Applications 7.9.5 ReleaseData Lineage Sheet

FOLDER_NAME MAPPING_NAMESILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFactSILOS SIL_ACDEventFact

The data lineage sheet below shows relationships between the ETL Folder, ETL Mapping, OLTP columns and Data Warehouse Columns. It only documents the Source Dependent Extract mappings (SDEs). It also displays which columns are populated with lookup, for

TARGET_TABLE TARGET_COLW_ACD_EVENT_F ANI_NUMW_ACD_EVENT_F AUX1_CHANGED_ON_DTW_ACD_EVENT_F AUX2_CHANGED_ON_DTW_ACD_EVENT_F AUX3_CHANGED_ON_DTW_ACD_EVENT_F AUX4_CHANGED_ON_DTW_ACD_EVENT_F CALLID_NUMW_ACD_EVENT_F CALL_EVNT_TYPE_WIDW_ACD_EVENT_F CALL_EVNT_TYPE_WIDW_ACD_EVENT_F CALL_EVNT_TYPE_WIDW_ACD_EVENT_F CALL_REASON_WIDW_ACD_EVENT_F CALL_REASON_WIDW_ACD_EVENT_F CALL_REASON_WIDW_ACD_EVENT_F CALL_TYPE_WIDW_ACD_EVENT_F CALL_TYPE_WID

SOURCEW_ACD_EVENT_FS.ANI_NUMW_ACD_EVENT_FS.AUX1_CHANGED_ON_DTW_ACD_EVENT_FS.AUX2_CHANGED_ON_DTW_ACD_EVENT_FS.AUX3_CHANGED_ON_DTW_ACD_EVENT_FS.AUX4_CHANGED_ON_DTW_ACD_EVENT_FS.CALLID_NUMW_ACD_EVENT_FS.CALL_EVNT_TYPE_IDW_ACD_EVENT_FS.DATASOURCE_NUM_IDW_EVENT_TYPE_D.ROW_WIDW_ACD_EVENT_FS.CALL_REASON_IDW_ACD_EVENT_FS.DATASOURCE_NUM_IDW_REASON_D.ROW_WIDW_ACD_EVENT_FS.CALL_TYPE_IDW_ACD_EVENT_FS.DATASOURCE_NUM_ID

SOURCE_TABLE SOURCE_COLW_ACD_EVENT_FS ANI_NUMW_ACD_EVENT_FS AUX1_CHANGED_ON_DTW_ACD_EVENT_FS AUX2_CHANGED_ON_DTW_ACD_EVENT_FS AUX3_CHANGED_ON_DTW_ACD_EVENT_FS AUX4_CHANGED_ON_DTW_ACD_EVENT_FS CALLID_NUMW_ACD_EVENT_FS CALL_EVNT_TYPE_IDW_ACD_EVENT_FS DATASOURCE_NUM_IDW_EVENT_TYPE_D ROW_WIDW_ACD_EVENT_FS CALL_REASON_IDW_ACD_EVENT_FS DATASOURCE_NUM_IDW_REASON_D ROW_WIDW_ACD_EVENT_FS CALL_TYPE_IDW_ACD_EVENT_FS DATASOURCE_NUM_ID

SQL_OVERRIDE_IDSILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.mplt_SIL_ACDEventFact.12.Lkp_W_Event_Type_D_Call_Event_Type_Wid.11SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.mplt_SIL_ACDEventFact.9.Lkp_W_REASON_D_Call_Reason_Wid.11SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3

Oracle BI Applications 7.9.5 ReleaseSQL Overrides

This sheet below shows the full SQL Override statement contents of the SQL Override IDs from the lineage sheets.SQL_OVERRIDE_ID

PLP.MPLT_GET_ETL_PROC_WID.1.LKP_ETL_PROC_WID.11PLP.mplt_GLBalanceAggrByAcctSegCodes.6.SQ_W_GL_BALANCE_F.3PLP.mplt_PLP_Aggregates.5.LKP_IA_GL_GROUP_ACCTS.11PLP.MPLT_TIME_PERIOD_AGG.1.LKP_PERIOD_START_END_DT.11PLP.MPLT_UNSPECIFIED.3.LKP_ETL_PROC_WID.11PLP.MPLT_UNSPECIFIED.4.LKP_W_PARAM_G_LANG_ID.11PLP.MPLT_UNSPECIFIED.6.LKP_W_PARAM_G.11PLP.MPLT_UNSPECIFIED.9.SQ_W_LST_OF_VAL_G.3PLP.PLP_APBalanceCurrentActivityLoad.5.SQ_W_AP_BALANCE.3PLP.PLP_APBalanceDateUpdate.4.SQ_W_AP_BALANCE.3PLP.PLP_APBalanceFutureActivityLoad.7.SQ_W_AP_BALANCE.3PLP.PLP_APBalanceFutureActivityUpdate.6.SQ_W_AP_BALANCE.3PLP.PLP_APFutureActivityDelete.3.SQ_NU_AP_FUACT.3PLP.PLP_APFutureActivityDerive.11.LKP_AP_FUACT_F_TMP.11PLP.PLP_APFutureActivityDerive.6.SQ_W_AP_BALANCE.3PLP.PLP_APFutureActivityUpdate.4.SQ_W_AP_FUACT.3PLP.PLP_APIncrActivityLoad.6.SQ_PLP_AP_INCR_ACTIVITY_LOAD.3PLP.PLP_APIncrActivityLoad.7.LKP_W_EXCH_RATE_G.11PLP.PLP_APSnapshotInvoiceAging.10.LKP_CUT_OF_DK.11PLP.PLP_APSnapshotInvoiceAging.13.SQ_IA_AP_AGING_INV.3PLP.PLP_APSnapshotInvoiceAging.14.SQ_IA_AP_XACTS.3PLP.PLP_APSnapshotSupplierAgingAggregate.10.SQ_IA_AP_AGING_AGG.3PLP.PLP_APSnapshotSupplierAgingAggregate.8.SQ_IA_AP_AGING_INV.3

SQL_OVERRIDE

W_GL_BALANCE_...

W_AP_BALANCE_F_TMP.TENANT_IDW_DAY_D.ROW_WID = (SELECT W_DAY_D.ROW_WID FROM W_DAY_D WHERE W_CURRENT_CAL_DAY_CODE = 'Current')W_AP_BALANCE_F_TMP.TENANT_IDW_AP_FUACT_F_TMP.TENANT_IDW_AP_FUACT_F_TMP.ACTIVITY_DT_WID <= (SELECT FSCL_MNTH_END_DT_WID FROM W_FSCL_MONTH_D WHERE W_CURRENT_FSCL_MONTH_CODE = 'Current')

(SELECT FSCL_MNTH_END_DT_WID FROM W_FSCL_MONTH_D WHERE W_CURRENT_FSCL_MONTH_CODE = 'Current')(SELECT FSCL_MNTH_END_DT_WID FROM W_FSCL_MONTH_D WHERE W_CURRENT_FSCL_MONTH_CODE = 'Current')W_AP_XACT_F.TENANT_ID

D.ROW_WID -- W_AP_AGING_INVOICE_A.SNAPSHOT_DT_WID = W_DAY_D.ROW_WIDW_AP_XACT_F.PURCH_INVOICE...W_DAY_D.LAST_DAY_CAL_MNTH_FLG = 'N')SUM(CASE WHEN W_AP_AGING_INVOICE_A.OPEN_BUCKET ...

W_DAY_D.ROW_WID = (SELECT W_DAY_D.ROW_WID FROM W_DAY_D WHERE W_CURRENT_CAL_DAY_CODE = 'Current')

W_AP_FUACT_F_TMP.ACTIVITY_DT_WID <= (SELECT FSCL_MNTH_END_DT_WID FROM W_FSCL_MONTH_D WHERE W_CURRENT_FSCL_MONTH_CODE = 'Current')

(SELECT FSCL_MNTH_END_DT_WID FROM W_FSCL_MONTH_D WHERE W_CURRENT_FSCL_MONTH_CODE = 'Current')(SELECT FSCL_MNTH_END_DT_WID FROM W_FSCL_MONTH_D WHERE W_CURRENT_FSCL_MONTH_CODE = 'Current')