SFDC ETL Testing

Presenter :Rakesh RanjanHarsh Kumar

SFDC ETL Integration

PwC

Agenda

• Project Architecture ICS implementation• Data flow Power Center implementation• Informatica Cloud –Scenarios and Features• Comparison With Power Center• Limitation Informatica Cloud

2

user(lastmodifiedbyID) != ‘INFA_USER’

and lastModifiedDate >

Execution_Date

(Upsert with ICS Data Sync Jobs)SFDC to Shadow

Informatica

Power

Center

Inbound Files

Oracle Shadow

Shadow to SFDClastmodifiedbyID = ‘INFA_USER’ andlastModifiedDate >Execution_Date(Upsert with ICS Data Sync Jobs)Outbound Files

Informatica Secure Agent

Feedback for updating salesforce IDs in Shadow DB

lastmodifiedbyID = ‘INFA_USER’ AND lastModifiedDate > Execution_DateAND createdate > Last_Execution_Date [Source is SFDC and Updates to Shadow tables using ICS Data Sync Jobs]

Architecture

Confidential- for SDC- India Internal use3

05/02/2023

Flat Files (Excel spread sheet)

Oracle/Microsoft (Staging

Database)

Manual Load

Informatica Power Center

(ETL)

Flat Files (CSV) Flat Files (CSV)

Business review

If Salesforce connector not

Installed

If Salesforce connector Installed

Flat Files (CSV)

Flow

Confidential- for SDC- India Internal usePwC 5

Scenarios

05/02/2023

Mapping – flow of data from Source to Target

Transformation – mapping object that modifies or passes dataActive : can change the number of rows that pass throughPassive : does not change the number of rows

Source Transformation – reads data from source Target Transformation – defines target connection & object for mapping Filter Transformation – filters data out of data flow based on condition Joiner Transformation – joins two related heterogeneous sources based on join on join condition Expression Transformation – calculates values with single row Lookup Transformation – retrieves data from lookup object based on condition


05/02/2023

Scenarios

6

Data Synchronization allows you to synchronize data. For example, data can be synced between flat file (available in pre-defined location) & object in SFDC and vice versa.

InsertUpdateUpsertDeleteOperation Source Target Data Filter Field Mapping Schedule

Filters can be used to select data that matches specific criteria. They can be scheduled to run at any specific time and notified with status upon completion via email


05/02/2023

Scenarios

7

Data Replication allows you to replicate/backup data. For example, data can be replicated from objects in SFDC into a flat file.

Source Target Data Filter ScheduleField Exclusion

We can exclude fields from the extract and can be scheduled to run at any specific time and notified with status upon completion via email


Scenarios

05/02/2023

Task Flow allows to group multiple tasks which can be of different types. It can run immediately or on a schedule.

• We can setup task flows to stop or ignore error/warning and continue with remaining tasks. Tasks are executed in the sequence that’s specified


05/02/2023

Features

9

Contact Validation allows to validate postal addresses, email addresses, and phone numbers.

We can add Geo Code based on postal address and validate phone numbers against Do Not Call Registry

PostalEmailPhone

Validate Definition Source Data Filter Validation Fields Schedule

The Contact Validation application can write all data to a single o/p file. Or, it can write data to two files: high-confidence o/p file (valid) and low-confidence o/p file (invalid)

Output Files


Features

05/02/2023

AccountContact

OpportunityLeadSource Data Filter ScheduleQuality Metrics Scorecard Threshold

Data Assessment allows to measure the quality of Salesforce account, contact, lead, and opportunity data.

Quality metrics allows to perform record level metrics (duplicates) and field level metrics (choose fields for completeness, conformance and address validation).

Scorecard Threshold allows to specify range of values for good (67-100), acceptable (34-66) and unacceptable data quality (0-33)https://youtu.be/Bytnvt1jwQM


05/02/2023

Categories Cloud Power Center

Licensing Per User ConnectionActivity Monitor Y YAuto Mapping Y YField Mapping Y YMapping Reusability Y YTransformations Y YFilter Y YJoins Y YCall Stored procedure N YBatch Schedule Y YData Correctness Y N Attaching Error Records in Email

N Y


05/02/2023

Limitations

• Cannot attach error records in email that is sent as part of email notification.

• When we use Saved Query as source, error records are not generated.

PwC

Questions?

13

SFDC ETL Testing

Documents

Transcript of SFDC ETL Testing