WTX Overview
-
Upload
bhanuprasad-reddy -
Category
Documents
-
view
321 -
download
9
Transcript of WTX Overview
-
8/3/2019 WTX Overview
1/45
WebSphere Transformation Extender(Mercator)
Rajesh MamidiVenkata BrundavanamDate: 11/27/2006
-
8/3/2019 WTX Overview
2/45
2
Agenda
Agenda
EAI
What is WTX (Mercator)
WTX Design Studio Type Designer
Database Interface Designer
Map Designer
Integration Flow Designer
Command Server
Event Server
-
8/3/2019 WTX Overview
3/45
3
SMTP
FlatFiles
ODBCDatabase
VANsEDIFACTX12
FTP
ERP
Legacy
Enterprise Integration
CRM
-
8/3/2019 WTX Overview
4/45
4
Enterprise Integration
-
8/3/2019 WTX Overview
5/45
5
Enterprise Application Integration
Enterprise Application Integration is the process of coordinating theoperations of various applications across an enterprise.
EAI solutions offer the following features:
Reduced development and maintenance cost.
Enhanced performance and reliability
Extension of legacy system lifecycle
Enterprise Integration
-
8/3/2019 WTX Overview
6/45
6
WebSphere TXis a unique data integration technology
for use in Application to Applicationand Business to Business enablement.
A powerful data transformation engine that natively across the enterprise operatingenvironments that has the ability to speak directly to native interfaces and APIs without
the need for coding or re-tooling.
What is WebSphere Transformation Extender (Mercator)?
-
8/3/2019 WTX Overview
7/45
7
The Benefits of Websphere Transformation Extender
Automated processes for integration of data with transactional and operationalsystems
Automated decisions on routing basedon content of messages, eliminatingcostly and time- consuming hand coding
High interoperability within a Service-Oriented Architecture to leverageexisting and future IT enhancements
Compliance with industry andgovernment standards and regulationsgoverning data transfer and integration(EDI, ACORD, AL3, HIPAA, SWIFT)
Legacy-to-AnythingIntegration
Enhanced visibility enablessingle view of key data within
front- and back-officeapplications/systems
EDI-to-AnythingIntegration
Enhanced data connectivitysimplifies the complex andspeeds B2B implementations
Transformation &Routing
Enhanced synchronizationprovides real-time validation
and transformation
-
8/3/2019 WTX Overview
8/45
8
Web Services Enablement
Expose legacy applications containing key dataelements
Use a common methodology for interactionacross apps, data, processes
Leverage mainframe power with Web-basedtechnologies
Automated, complex data transformation androuting across many points of integration
Integrated tools and environment for completeenterprise data integration
Enterprise-wide interoperability supported by anSOA
MAPApplication
Database
File
Application
Database
File
SOAEdition
WebService
WebService
TypeTree
IBM WebSphere DataStage TX Map
Enterprise Data Integration Requirements IBM Websphere DataStage TX Value
-
8/3/2019 WTX Overview
9/45
9
What is Mercator?
-
8/3/2019 WTX Overview
10/45
10
TYPE DESIGNERMAP DESIGNER
COMMAND SERVER
EVENT SERVER
INTEGRATION FLOW DESIGNER
DATABASE INTERFACE DESIGNER
WebSphere TX (Mercator) Components
-
8/3/2019 WTX Overview
11/45
11
Design Studio
Platform-specific transformation engines for production environmentAdapters to integrate with specific types of data sources and targets
DatabasesMessaging systemsPackaged applicationsBusiness integration utilities
ClientDevelopment System
ServerProduction System
Integration Flow Designer to model andmanage transformation workflows
Type Designer to define and import dataobjects
Database Interface Designer togenerate data definitions from metadataimported from database
Map Designer to define datatransformation and routing rules
Transformation engines to develop, testand run transformations in developmentenvironment
WebSphere TX (Mercator) Components
-
8/3/2019 WTX Overview
12/45
12
Modeling the Transformation Process
Flow Events
Timing
Analyze and Define the Data
Interfaces Resources
Apply Integration Rules to Models
Deploy and Manage Processes
Properties
Structure Validation rules
Structure Formats Semantics
Communication Storage Services
Type Designer
Database Interface
Designer
Map Designer
Integration FlowDesigner
-
8/3/2019 WTX Overview
13/45
13
TYPE DESIGNER
Type Designer
-
8/3/2019 WTX Overview
14/45
14
What is Type Tree?
A type tree is a data dictionary that defines how types areclassified.
A type tree describes:
Syntax
Structure
Semantics
Type Designer
-
8/3/2019 WTX Overview
15/45
15
Specify, define and manage Type Trees.
Maintain Type Trees
Properties of data Structure
Data Validation Rules
Different Character Sets
Type Designer
-
8/3/2019 WTX Overview
16/45
16
File
RecordRecord
Record
ComplexSimple
ComplexComplexComplexSimpleSimpleSimple D
a t a
I t e m s
(Input and Output)
Step 1
Step 2
Step 3
Type Designer
-
8/3/2019 WTX Overview
17/45
17
Type Designer
For modeling data objectsStructure/containment of data
Syntax propertiesSemantic validation rules
Graphically design in aType TreeImport or use industry datadefinitions
-
8/3/2019 WTX Overview
18/45
-
8/3/2019 WTX Overview
19/45
19
Building In Additional Validation
Additional validation can be added to check if data, once isolated,matches specific data value or set of values
Use restriction lists to limititem to particular valueor set of values
Use restriction lists to limititem to particular valueor set of values
Use component rules tospecify condition(s) that must
be met for a particularcomponent to be valid
Use component rules tospecify condition(s) that must
be met for a particularcomponent to be valid
-
8/3/2019 WTX Overview
20/45
20
DATABASE INRERFACE DESIGNER
Database Designer
-
8/3/2019 WTX Overview
21/45
21
Database Interface Designer
Specify databases to use for data source or target
Define query statements
Generate type trees for tables/views, queries, and storedprocedures by importing metadata from RDBMS
Identify additional tree definition, mapping andexecution requirements
-
8/3/2019 WTX Overview
22/45
22
Imports metadata about
Queries
Tables
Stored procedures
Database connectivity is supported under the control of Relational Database Management Systems (RDBMS).
Database Designer
-
8/3/2019 WTX Overview
23/45
23
Generating Type Trees from Databases
Type TreeQuery
Database
Type TreeStored Procedure
Database
Type TreeTable/View
Database
2-23
-
8/3/2019 WTX Overview
24/45
24
Database Designer
-
8/3/2019 WTX Overview
25/45
25
MAP DESIGNER
Map Designer
-
8/3/2019 WTX Overview
26/45
26
Map Designer
Create maps to:Validate data from data sourcesIdentify data targetsSpecify data transformation logic (rules)
-
8/3/2019 WTX Overview
27/45
27
The Map Designer is used to:
Create maps to specify the logic necessary to transform theinput data to the desired output data.
Identify the source and data objects of the input data.
Identify the target and data objects of the output data. Specify and build the output data according to the map rules.
Provide information about data validation by generating trace files.
View the run results of the map execution.
Map Designer
-
8/3/2019 WTX Overview
28/45
28
FromWindowFrom
Window
NavigatorNavigator ToWindow
ToWindow
Rule barRule barMap nameMap name
Map source file nameMap source file name
Rule columnRule column
CardsCards
Map Designer
-
8/3/2019 WTX Overview
29/45
29
How DataStage TX Engine Works
1. Validates input data against typetree starting with Input card #1
2. Applies map rules starting withOutput card #1
Input card #1
Input card #2
Output card #1
Output card #2
-
8/3/2019 WTX Overview
30/45
30
Map Designer
-
8/3/2019 WTX Overview
31/45
31
Around 100 Functions Most can be used both
in Component Rules aswell as Mapping Rules
Component Rules evaluate to True or FalseMapping Rules evaluate to some value
Functions - Rules
-
8/3/2019 WTX Overview
32/45
32
INTEGRATION FLOW DESIGNER
Integration Flow Designer
-
8/3/2019 WTX Overview
33/45
33
The integration flow designer (IFD) is a component of theMercator design studio that provides a graphical interface
to combine collection of maps and run them as a singleunit
There are three stages of Using the IFD :
Defining Systems
Verifying Component Relationships
Preparing Systems to Run
Integration Flow Designer
-
8/3/2019 WTX Overview
34/45
34
Define systems that graphically and logicallyorganize transformation workflows into logicalcollections based on requirements
Generate system control information from
system definitions for real-time processing
Define systems that graphically and logicallyorganize transformation workflows into logicalcollections based on requirements
Generate system control information from
system definitions for real-time processing
Integration Flow Designer
-
8/3/2019 WTX Overview
35/45
35
What is a System?
A system is:A set of logically related maps
Assigned to a server on which it will runRun by WTX transformation servers
A system can include:Components that
reference mapsComponents that referenceother systems
-
8/3/2019 WTX Overview
36/45
36
TRANSFORMATION ENGINES
Event & Command Server
-
8/3/2019 WTX Overview
37/45
37
WebSphere DataStage TX Transformation Engines
Command ServerCan be run on variety of
platforms and operatingsystemsPlatform-specificRuns one map at a time
Event Server/LauncherCan be run on variety
of platforms and operatingsystemsPlatform-specificManages execution of systems of maps based ontriggers
Message eventsTime eventsFile state changes
Database triggers
-
8/3/2019 WTX Overview
38/45
38
Command Server is used to execute maps
Command Server
-
8/3/2019 WTX Overview
39/45
39
Command Server
Command Server Output
-
8/3/2019 WTX Overview
40/45
40
The Event Server automates the execution of maps.
The Event Server runs systems of maps that are created andgenerated using the Integration Flow Designer (IFD).
These systems of maps that are generated specifically to runin the Event Server are called Event Server system filessometimes referred to as Event Server control files.
Event Server
-
8/3/2019 WTX Overview
41/45
-
8/3/2019 WTX Overview
42/45
42
Event Server
-
8/3/2019 WTX Overview
43/45
43
WebSphere DataStage TX Administrative Tools
Event Server Administration allows configuration of secure accessrights to monitor and control Event Servers and the DataStage TXsystems they are running
Management Console allows user to view and control the status of transformation workflows running with the Event Server
Event Server Monitor gives detailed information about maps runningwith Event Server
Snapshot Viewer enables analysis of snapshots of Event Serveractivity
Resource Registry defines resource name aliases for data sources andtargets
-
8/3/2019 WTX Overview
44/45
44
Event Server Monitor
Red line indicatesmap failure
Red line indicatesmap failure
Yellow line indicatesmap warning
Yellow line indicatesmap warning
Vertical gridtime intervalVertical gridtime interval
Green line indicatesmap success
Green line indicatesmap success
Server nameServer name
Name of watchName of watch
-
8/3/2019 WTX Overview
45/45
45
Merci
Grazie
Gracias
Obrigado
Danke
Japanese
French
Russian
German
Italian
Spanish
Brazilian Portuguese
Arabic
Traditional Chinese
Simplified Chinese
Thai
Thank You