2 designer

111
Informatica Designer An Overview

description

design

Transcript of 2 designer

Page 1: 2 designer

Informatica Designer

An Overview

Page 2: 2 designer

Designer Purpose

Designer is used to create mappings and mapplets to specify how to move and transform data between source and targets

Designer helps create the source definitions, target definitions and transformations to build mappings.

Page 3: 2 designer

Designer Tools

Source Analyzer– Import or create source definitions

Warehouse Designer– Import or create target definitions

Transformation Developer– Used to create reusable transformations

Mapplet Designer– To create reusable Mapplets

Mapping Designer– To create Mappings and non- reusable transformations

Page 4: 2 designer

Transformations

A transformation is an object that performs a specific function in a mapping, such as looking up data or performing calculation or aggregation.

Page 5: 2 designer

Mappings

Mappings represents data flow between source and targets.

Mapping is used by Informatica server to read, transform and load data at the time of execution of an ETL task.

Page 6: 2 designer

Mapplets

It contains a set of transformations and allows you to reuse the transformation logic in multiple mappings. Mapplet can includesource definition also.

Page 7: 2 designer

Launch Designer-Add Repository

Page 8: 2 designer

Connect to the Repository

Page 9: 2 designer

Designer Windows

Navigator

Status Bar Output

Workspace

Page 10: 2 designer

Designer Windows

Navigator. Use to connect to and work in multiple repositories and folders. You can also copy and delete objects and create shortcuts using the Navigator. Workspace. Use to view or edit sources, targets, mapplets, transformations, and mappings. You can work with a single tool at a time in the workspace. You can use the workspace in default or workbook format. Status bar. Displays the status of the operation you perform. Output. Provides details when you perform certain tasks, such as saving your work or validating a mapping. Right-click the Output window to access window options, such as printing output text, saving text to file, and changing the font size.

Page 11: 2 designer

Using Business Documentation

Business documentation provides details about a repository object or transformation expression. The Designer allows you to create and edit links to business documentation that you have developed for repository objects. The documentation must reside on a local machine, network server, or company intranet or internet web site in a Windows environment.

Page 12: 2 designer

Document Formats

You can develop business documentation in HTML, PDF, or any text format, for the following repository objects: Sources and targetsTransformations MappletsMappings

Page 13: 2 designer

Specify Document path (Click on link to open the document)

Page 14: 2 designer

Designer Tasks

Add a RepositoryIn order to access information stored in a repository, Repository definition must be added to the designer.Once repository is added, the repository should be connected in order to access the information in it.

Page 15: 2 designer

Open and Close Folder

Once connected, the folders in repository become available in the left pane of designer window.Once in the folder, the designer tools can be used.Folder can be opened by double clicking it.Folder can be close by selecting it and disconnecting using the disconnect button.

Page 16: 2 designer

Accessing Designer Tools

Page 17: 2 designer

Sources

Sources can be created in source analyzer from:Relational tables, views or synonymsCobol filesFlat Files – Fixed width/delimitedXML SourcesWeb Service Provider

Source definition is usually imported and notcreated as it should match exactly with source.

Page 18: 2 designer

Updating source definitions

Designer propagates the changes to mappings when the source definition changes.Mappings may become invalid in some cases like deleting a column used in mapping.Mappings need to be edited and revalidated in such cases.

Page 19: 2 designer

Import from Database

Page 20: 2 designer

Create ODBC Source

Page 21: 2 designer

Select ODBC Source

Page 22: 2 designer

Select Tables to Insert

Page 23: 2 designer

Source Tables Imported

Page 24: 2 designer

Double Click Table to Modify

Page 25: 2 designer

Exercise

Login to DB:Run Source Table DDL and Data ScriptCreate ODBC SourceImport All Tables (See constraints)

Page 26: 2 designer

Import Flat file Source

Page 27: 2 designer

Flat File: Step1Fixed Width or Delimited

Page 28: 2 designer

Flat File: Step2 Delimiters, Text Qualifier

Page 29: 2 designer

Flat File: Step3Data Types

Page 30: 2 designer

Flat File Source Imported

Page 31: 2 designer

View file definition

Page 32: 2 designer

Columns

Page 33: 2 designer

Properties

Page 34: 2 designer

Metadata Extensions

Page 35: 2 designer

Exercise

Import Flat File Source

FilesCust_Ord.txtProduct_Discount.txt

Page 36: 2 designer

Targets

Targets can be created using Warehouse Designer:

RelationalFlat FileXML

Page 37: 2 designer

Target Creation

Import target definitionCreate based on source definition by dragging source definition to Warehouse analyzerManually create Target DefinitionDesign several related targets and their relationship as a ‘Schema’. This is also used to create Cubes and Dimensions using wizards.

Page 38: 2 designer

Create Target Tables

In case of manual creation/editing of targets, Designer generates DDL and executes it to create target tables.This includes creation of new targets, dropping and creating changed targets or dropping and creation of indexes.

Page 39: 2 designer

Choose Warehouse Designer in Tools

Page 40: 2 designer

Import Target from Database

Page 41: 2 designer

Create ODBC Source

Page 42: 2 designer

Select Tables to be Imported

Page 43: 2 designer

Tables imported into Warehouse Designer

Page 44: 2 designer

Target import from Flat file

Same as source import

Page 45: 2 designer

Exercise-Target

Import from Target Tables from Database

Import from flat file– customer_file.txt

Page 46: 2 designer

Manually create Target

Page 47: 2 designer

Target Created

Page 48: 2 designer

Edit Table

Page 49: 2 designer

Add Columns

Page 50: 2 designer

Create Indexes

Page 51: 2 designer

Metadata Extensions

Page 52: 2 designer

Table Created

Page 53: 2 designer

Generate SQL

Page 54: 2 designer

Edit SQL

Page 55: 2 designer

Execute SQL

Page 56: 2 designer

Compare and Preview Data

Two Sources/Targets or any two objects of same type can be comparedPreview data

Page 57: 2 designer

Select two targets to be compared

Page 58: 2 designer

Column Comparison

Page 59: 2 designer

Preview Data

Page 60: 2 designer

Exercise

Compare Customer Relational target with customer flat file.Preview Source/Target Data

Page 61: 2 designer

Mapping

Mapping is an ETL Program.

Every mapping must contain the following:Source DefinitionTransformationTarget DefinitionConnectorsIt may also contain ‘Mapplets’

Page 62: 2 designer

Creating a Mapping

Create Source, Target and Reusable ObjectsAdd Source and Targets (Drag in to Mapping)Add Transformation and Transform LogicConnect the MappingValidate the MappingSave the Mapping

Page 63: 2 designer

Default Source Transformations in a Mapping

Sources always need Transformations that determine how the data is read and extracted based on its type

Source Qualifier – Relational and Flat FileNormalizer – Cobol SourceApplication Source Qualifier – Application SourceXML Source Qualifier – XML Sources

Page 64: 2 designer

Transformation

Transformation is a repository objectIt generates, modifies and passes dataTransform logic is defined in a transformationInformatica provides pre-built transformsEach transform has certain rules that apply to itTransforms can be created for reuse in multiple mappings

Page 65: 2 designer

Ports

Input Ports – Receive DataOutput Ports – Pass DataInput/Output Ports – Receive data and pass it unchanged

Page 66: 2 designer

Component Ports

Sources - Only Output portsTargets - Only Input PortsMapplets - Input/output portsTransformations – Depends on the transformation and its application

Page 67: 2 designer

Linking Ports

Manual LinkingAutolinking– By Name– By Position

Page 68: 2 designer

Select Mapping Designer

Page 69: 2 designer

Drag Source in a mapping

Page 70: 2 designer

Source Qualifier Transformation

By Default created for Relational and flat file sources

Source qualifier qualifies a relational or flat file source definition in a mapping

Source qualifier represents the rows that Informatica server reads when it executes a session

Source qualifier displays transformation data types. These determine how the source database binds data when server reads it. Do not alter data types in Source qualifier

Page 71: 2 designer

Ports

Page 72: 2 designer

Properties

Page 73: 2 designer

Add Target

Page 74: 2 designer

Autolink Ports

Page 75: 2 designer

Autolink by Name

Page 76: 2 designer

Mapping Created

Page 77: 2 designer

Target Properties

Page 78: 2 designer

Relational Target Properties

Reject truncated and overflow data– Write truncated data to reject file

Update override– Override the default update statement

Pre/Post session SQL

Page 79: 2 designer

Flat file Target Properties

Date/Time Format– Default Date/Time Format

Thousands Separator– Default Thousands Separator for numeric values

Decimal Separator– Default decimal Separator for numeric values

Page 80: 2 designer

Save and Validate

Page 81: 2 designer

Validating Mapping

Port Connection Validation– Required Ports are connected– All connections are valid

Expression ValidationObject Validation– Objects and their instances

Page 82: 2 designer

Copying Objects

Copy objects across foldersCopy objects within folder

Page 83: 2 designer

Creating shortcuts

Shortcuts can be created by dragging objects into the destination shared folder or into mapping.Shortcuts can not be created in non-shared folders

Page 84: 2 designer

Dependencies

Designer allows developer to view dependencies to see the impact of changes being made.Dependencies can be viewed for source, target, transformation, mapplet and mappings.Example: primary key-foreign key dependency

Page 85: 2 designer

View Dependencies

Page 86: 2 designer

Mapping Exercise

Add Customer SourceView Source Qualifier PropertiesAdd Customer TargetManually Link Few PortsAuto link rest of the portsValidate and see validation result/SaveCreate Copy/ShortcutsView dependencies

Page 87: 2 designer

Debugger

Designer provides debugger to execute the mapping to determine the errors and data condition at multiple developer defined break points.

Debugger uses a session on Informatica server

Page 88: 2 designer

Debug Process

Create BreakpointsConfigure the DebuggerRun the debuggerMonitor the debugger– Debug Log– Target Window– Instance Window

Modify Data and Break points

Page 89: 2 designer

Edit Breakpoints

Page 90: 2 designer

Breakpoints

Instance Name– Create a global breakpoint (Applicable on all

rows)– Create against a single transformation

Breakpoint Types– Data

Data condition

– Error

Page 91: 2 designer

Add Global Breakpoints

Page 92: 2 designer

Configure Break Points

Error– No Ports can be specified– Specify no. of errors before stopping

Data– Global

Specify no. of rows to skip before stopping“Any Port” set to IsNull or IsDefaultNo Port condition (Stops at defined row count)

– TransformationSpecify no. of rows to skip before stoppingSpecify Multiple Port Conditions for one BreakpointSpecify Multiple breakpoints

Page 93: 2 designer

Transformation Conditions

Data condition can be applied to following port parameters– Port Value– Row Type (Insert/Update/delete/reject)– Rowid– Any Port (IsNull/IsDefault)

Page 94: 2 designer

Session

Session object defines run time properties of a Mapping.– Connection details– Log file Names– DML operation– Etc.

Session Types– Workflow Session– Debug Session

Page 95: 2 designer

Debugger Session Types

If Informatica server has executed the mapping alreadyExisting non reusable sessionExisting reusable session

If it’s a new execution on the serverNew debug session

Page 96: 2 designer

Configuring The Debugger

Informatica Server and Session TypesSession InformationSession ConfigurationTarget Options

Page 97: 2 designer

Start Debugger

Page 98: 2 designer

Informatica Server and Session Types

Page 99: 2 designer

Session Information-Connection Tab

Page 100: 2 designer

Session Information-Target Properties Tab (Normal/Bulk, Insert/Update/Delete)

Page 101: 2 designer

Session Information-Reader/Writer Tab

Page 102: 2 designer

Transformation Configuration

Page 103: 2 designer

Session Configuration (Source Row Type)

Page 104: 2 designer

Target Options(Discard does not commit data)

Page 105: 2 designer

Continue Debugger

Page 106: 2 designer

Continuing the Debugger

Continue to next break– Continues until encounters a breakpoint

Continue to next instance– Continues until reaches next transformation or encounters a

breakpoint

Step to a specified instance – Continues until reaches the user selected transformation or

encounters a breakpoint– Can not step to sources, targets, unconnected

transformations

Page 107: 2 designer

Monitor

Target DataDebug LogSession Log

Page 108: 2 designer

Modify Data

When debugger pauses, current instance displays in instance window. Users can– Modify output data– Change Null data to Not Null Data– Change Not Null to Null– Modify Row Types (Insert/Update etc.)

Page 109: 2 designer

View Target and Transformation instances

Page 110: 2 designer

View Session log

Page 111: 2 designer

Exercise

Create Global Breakpoint without data conditionRun Debugger