SOA-13: Introduction to DataXtend ® Semantic Integrator (DX SI) Abstract data management from the...
-
Upload
hector-newman -
Category
Documents
-
view
225 -
download
5
Transcript of SOA-13: Introduction to DataXtend ® Semantic Integrator (DX SI) Abstract data management from the...
SOA-13: Introduction to DataXtend® Semantic Integrator (DX SI)
Abstract data management from the application level using a common data model
© 2008 Progress Software Corporation2 SOA-13: Introduction to DataXtend Semantic Integrator
Agenda
Data challenges in integration solutions
DX SI enables the data layer in integration
DX SI Lifecycle
DX SI Demonstration
© 2008 Progress Software Corporation3 SOA-13: Introduction to DataXtend Semantic Integrator
Traditional approaches to data integration
Message Oriented Middleware
Inventory TT
ProvisioningBillingCMR1 CRM2
CallCenter
DataW/house
TT
ProvisioningBilling
Inventory
CRM1 CRM2
CallCenter
‘Integration Spaghetti’
DataW/house
© 2008 Progress Software Corporation4 SOA-13: Introduction to DataXtend Semantic Integrator
A new approach to data integration
ProvisioningBilling
Inventory
CRM1
TT
CRM2
CallCenter
DataW/house
‘Integration Spaghetti’ Messaged OrientedMiddleware
Inventory TT
ProvisioningBillingCRM1 CRM2
CallCenter
DataW/house
ESB and Semantic Data Integration
Provision-ingBilling
Inventory
CRM1
TT
CRM2
CallCenter
Common Data Model
A common data model enablestransformation of all interfaces to
a single semantic meaning.
© 2008 Progress Software Corporation5 SOA-13: Introduction to DataXtend Semantic Integrator
Can’t We All Just Get Along?
No central management
Costly to modify
Not easily adapted to change
The Problem
Database 2
Database 1
Application 3
Application 2
Database 3
Translation
Translation
Application 1
TranslationTranslation
Translation
Translation
Translation
Translation
Translation
Tran
slatio
n
Tran
slat
ion
Translation
Translation
Translation
Translation
Translation
Tra
nsla
tion
Tra
nsla
tion
Translation
Tran
slatio
n
Tran
slatio
n
Translation Translation
TranslationTranslation
Translation
© 2008 Progress Software Corporation6 SOA-13: Introduction to DataXtend Semantic Integrator
Model Driven Integration
Database 2
Database 1
Application 3
Application 2
Application 1
Database 3
Common Model
The Solution
DistributedTransformation
Engine
Centralized management
Rapid development and deployment
Lower TCO
© 2008 Progress Software Corporation7 SOA-13: Introduction to DataXtend Semantic Integrator
Challenges of Common Model Integration
A good Common Model should be• Comprehensive
• Abstract
• Extensible
But… a comprehensive, abstract model is• Large
• Complex for simple things
• Hard to maintain
DataXtend SI addresses these issues
© 2008 Progress Software Corporation8 SOA-13: Introduction to DataXtend Semantic Integrator
Agenda
Data challenges in integration solutions
DX SI enables the data layer in integration
DX SI Lifecycle
DX SI Demonstration
© 2008 Progress Software Corporation9 SOA-13: Introduction to DataXtend Semantic Integrator
Progress® DataXtend SI
ENTERPRISE SERVICE BUS
NMS Inventory OMS Billing CRM
System Integration Layer- Infrastructure Abstraction
Common Data Model
CustomerProduct
ResourcePartner
Common
Market
ServiceData Interoperability Layer
- Semantic Abstraction
Business Process Layer- Process Abstraction
BPM BAM
- Enables the data layer in Integration
BPM Layer
ESB/EAI Layer
Progress DataXtend SI
Utilizes a
Common Model Semantic
Brokering Model based
Mappings Visual Round-
Trip Testing 360º End-to-End
Impact Analysis Governance
Change and
Lifecycle
Management
© 2008 Progress Software Corporation10 SOA-13: Introduction to DataXtend Semantic Integrator
Visual tool for designing integration
Stateless for scalability
Runs in any Java container
Connects to any bus
DataXtend SI Product Capabilities
Runs in Eclipse
DISTRIBUTEDRUNTIME
CENTRALIZEDDESIGN
GenerateDeploy
TESTING
© 2008 Progress Software Corporation11 SOA-13: Introduction to DataXtend Semantic Integrator
Agenda
Data challenges in integration solutions
DX SI enables the data layer in integration
DX SI Lifecycle
DX SI Demonstration
© 2008 Progress Software Corporation12 SOA-13: Introduction to DataXtend Semantic Integrator
RuntimeAutomate
rules execution
Audit and Validateevery exchange
Lifecycle ManagementManage rules, aggregations
and maps over time
Design Time Import, enrich, define
rules, aggregations and maps needed to exchange valid data between enterprise systems
Change integrations of adaptive infrastructure with build-in change management facilities
The DataXtend SI Lifecycle
© 2008 Progress Software Corporation13 SOA-13: Introduction to DataXtend Semantic Integrator
DataXtend Exchange Model
Import directly from a database
(default validation rules to enforce constraints)
Import directly from XML
Import directly from a WSDL
Import directly from a UML
1080 Classes5000 Classes1000 Classes1020 Classes
Your OwnModel!
Semantic Mappings:Validate DataMatch incompatible dataFlag Data ErrorsConditionally Map
© 2008 Progress Software Corporation14 SOA-13: Introduction to DataXtend Semantic Integrator
DataXtend Common Model Navigator
ComponentViewDetail about the component in tabular form: attributes, types, classes, collections and relationships
Graph ViewShows relationships as lines. Dotted lines represent inheritance while solid lines are containment relationships
Tree ViewAllows you to navigate through the containment hierarchy of the component.
© 2008 Progress Software Corporation15 SOA-13: Introduction to DataXtend Semantic Integrator
Computed AttributesSimplify Common Models for Ease of Use
Contact
Mobile
Type = Home
Type = Work
Type = Mobile
TelephoneCustomer
Centralized design
Virtual attributes simplify models
without deviating from the standard
© 2008 Progress Software Corporation16 SOA-13: Introduction to DataXtend Semantic Integrator
DataXtend Mapping and Rule Designer
All assets are visually mapped to and from the common model
Even complex expressions are
designed without coding
© 2008 Progress Software Corporation17 SOA-13: Introduction to DataXtend Semantic Integrator
DataXtend Tester
© 2008 Progress Software Corporation18 SOA-13: Introduction to DataXtend Semantic Integrator
DataXtend Deployment1: Creating the DX SI service interfaces
Interface wrappers Simplify access to DX SI service interface Build-in to DX SI
IBM SDOs Sonic™ ESB BEA Beehive JMS Java™ Beans EJB Sessions
Create one or more wrappers for every data service
DX SI
Java Runtime
No wrappers. DX SI Java interface is used
Can run standalone orpackaged
build
build
© 2008 Progress Software Corporation19 SOA-13: Introduction to DataXtend Semantic Integrator
DataXtend Deployment2: Packaging
Application and Service packagers
Fully deployable solution generated Build-in packagers to DX SI
Web service, EJB, EAR Supported platforms: JBOSS, IBM, BEA, Oracle®
DX SI
Java Runtime
1. Define wrappers
2. Build
3rd Party IDE
Examples: Sonic Workbench IBM WID BEA Workshop
Application Server BPM Server ESB
3. Package & Deploy
3. Package
© 2008 Progress Software Corporation20 SOA-13: Introduction to DataXtend Semantic Integrator
RuntimeAutomate
rules execution
Audit and Validateevery exchange
Lifecycle ManagementManage rules, aggregations
and maps over time
Design Time Import, enrich, define
rules, aggregations and maps needed to exchange valid data between enterprise systems
Change integrations of adaptive infrastructure with build-in change management facilities
The DataXtend SI Lifecycle
© 2008 Progress Software Corporation21 SOA-13: Introduction to DataXtend Semantic Integrator
DataXtend SI Runtime
DataXtend SI Engine runtime process:1. Input data is mapped to the Common Model
2.Common Model is enriched with extra data if required
3.Data is mapped from Common Model to Data Source (writing)
4.Results are mapped back to the Common Model and Data Services
Rules engine automates validation of the data at all stages
Runtime report is available detailing all issues
© 2008 Progress Software Corporation22 SOA-13: Introduction to DataXtend Semantic Integrator
ESB Solution without DataXtend SI
Goal:• To provide an aggregated
view of a customer’s accounts
Issues• Solution assumes all data
is equivalent i.e. canonical and on the same version, for message and data
• No controls to map data types
– E,g. TVAccounts – maps Mr as ‘0’
– Wireless maps Mr as ‘A’
– To solve requires multiple transformation svcs
• Possibly 10 XForm and Enrichment steps
© 2008 Progress Software Corporation23 SOA-13: Introduction to DataXtend Semantic Integrator
DataXtend SI and ESB
ESB and DX SI• Intermediate services replaced by DX SI• DX SI handles Data and Message layout impedance
– Using XML based invocation framework similar to WS
• 11 Intermediate services to 1
© 2008 Progress Software Corporation24 SOA-13: Introduction to DataXtend Semantic Integrator
RuntimeAutomate
rules execution
Audit and Validateevery exchange
Lifecycle ManagementManage rules, aggregations
and maps over time
Design Time Import, enrich, define
rules, aggregations and maps needed to exchange valid data between enterprise systems
Change integrations of adaptive infrastructure with build-in change management facilities
The DataXtend SI Lifecycle
© 2008 Progress Software Corporation25 SOA-13: Introduction to DataXtend Semantic Integrator
DataXtend SI Lifecycle Management Features
Impact Analysis view and report: Identify interdependencies in a project. An Impact Analysis report provides a snapshot of
an element's current state for future reference.
Comparison of exchange model elements: Provides an interface for comparing elements in the
same project or in different projects.
Synchronize model changes: Allows you to selectively accept changes from one
exchange model into another.
© 2008 Progress Software Corporation26 SOA-13: Introduction to DataXtend Semantic Integrator
Select the DataXtend Impact Analysis tab with an entity selected
The Impact Analysis view displays all entities affected by or related to the entity selected in the Exchange Model editor
You can generate an HTML Impact Analysis Report that displays all entities related to the selected entity
DataXtend SI Impact Analysis
© 2008 Progress Software Corporation27 SOA-13: Introduction to DataXtend Semantic Integrator
Use the Compare Editor to compare: • Entities in the same or in different projects• Two files in the same projectThis example shows how to compare two files in the same project.
DataXtend SI Compare Editor
Changes are highlighted in the Compare Editor
© 2008 Progress Software Corporation28 SOA-13: Introduction to DataXtend Semantic Integrator
You use project synchronization to merge the contents of two exchange models: The current project (the target) and an external project (the source).
You can also use project synchronization to create a new project based on another, exported one.
Synchronizing Model Changes
© 2008 Progress Software Corporation29 SOA-13: Introduction to DataXtend Semantic Integrator
Agenda
Data challenges in integration solutions
DX SI enables the data layer in integration
DX SI Lifecycle
DX SI Demonstration
© 2008 Progress Software Corporation30 SOA-13: Introduction to DataXtend Semantic Integrator
SummaryDX SI Differentiator vs. Traditional Mappers
Comparison with traditional point-to-point message mapping tools
© 2008 Progress Software Corporation31 SOA-13: Introduction to DataXtend Semantic Integrator
In Summary
DataXtend SI reduces costs to create and maintain data transformation
DataXtend SI utilizes a common model
DataXtend SI deploy as a service
© 2008 Progress Software Corporation32 SOA-13: Introduction to DataXtend Semantic Integrator
For More Information, go to…
PSDN• DataXtend SI Product Center
• Documentation
Progress.com• DataXtend SI Home Page
• DataXtend SID Model Browser
© 2008 Progress Software Corporation33 SOA-13: Introduction to DataXtend Semantic Integrator
Relevant Exchange Sessions
SOA-18Combining the Power of Sonic, DataXtend Semantic Integrator, and Actional for SOA Operations
SOA-25 Data Distribution Solutions Using DataXtend Semantic Integrator for Sonic ESB Users
SOA-31Progress SOA Portfolio Roadmap
© 2008 Progress Software Corporation34 SOA-13: Introduction to DataXtend Semantic Integrator
Questions?
© 2008 Progress Software Corporation35 SOA-13: Introduction to DataXtend Semantic Integrator
Thank You
© 2008 Progress Software Corporation36 SOA-13: Introduction to DataXtend Semantic Integrator