IRMAC Enterprise Application Integration Ken Dschankilic, Manager Integration Architecture April 16,...
-
Upload
janel-gray -
Category
Documents
-
view
227 -
download
1
Transcript of IRMAC Enterprise Application Integration Ken Dschankilic, Manager Integration Architecture April 16,...
IRMAC Enterprise Application Integration
Ken Dschankilic, Manager Integration ArchitectureApril 16, 2003
IRMAC Enterprise Application Integration
Ken Dschankilic, Manager Integration ArchitectureApril 16, 2003
Canadian Tire Corporation, Limited
Canadian Tire Corporation, Limited
AgendaAgenda
• Who is Canadian Tire
• EAI Defined
• The Integration Problem
• Integration Frameworks
• Integration Design Patterns
• Dave Callingham’s EAI Components
• Integration at Canadian Tire
• Q & A
• Who is Canadian Tire
• EAI Defined
• The Integration Problem
• Integration Frameworks
• Integration Design Patterns
• Dave Callingham’s EAI Components
• Integration at Canadian Tire
• Q & A
Customer Count: 226.8MMRetail Sales: $7.4 Billion
Customer Count: 226.8MMRetail Sales: $7.4 Billion
Today, we are an inter-related Today, we are an inter-related family of businessesfamily of businesses
Today, we are an inter-related Today, we are an inter-related family of businessesfamily of businesses
Customer Customer Count: Count: 172.1MM172.1MM
Retail Sales: Retail Sales: $5529.5MM$5529.5MM
Customer Count: 1.7MM
Retail Sales: $53.4MM
Customer Count: 1.7MM
Retail Sales: $53.4MMCustomer Count:
4.2MM GOR: $352.3MM
Customer Count: 4.2MM
GOR: $352.3MM
Customer Count:8.7 millionRetail Sales: $510.4MM
Customer Count:8.7 millionRetail Sales: $510.4MM
Customer Count: 40.1MM
Retail Sales: $911.9MM
Customer Count: 40.1MM
Retail Sales: $911.9MM
• $7 billion (CDN) - Canadian Tire Corporation, $7 billion (CDN) - Canadian Tire Corporation, Limited is Canada’s most shopped retailerLimited is Canada’s most shopped retailer
– More than 1,000 retail outlets (Canadian Tire Associate More than 1,000 retail outlets (Canadian Tire Associate Stores, Gas Bars, Mark’s outlets) across CanadaStores, Gas Bars, Mark’s outlets) across Canada
– More than 45,000 employeesMore than 45,000 employees– More than 25 million customer transactions each yearMore than 25 million customer transactions each year– 90% of Canadians shop at a Canadian Tire store, 40% are in 90% of Canadians shop at a Canadian Tire store, 40% are in
our stores every weekour stores every week
• $7 billion (CDN) - Canadian Tire Corporation, $7 billion (CDN) - Canadian Tire Corporation, Limited is Canada’s most shopped retailerLimited is Canada’s most shopped retailer
– More than 1,000 retail outlets (Canadian Tire Associate More than 1,000 retail outlets (Canadian Tire Associate Stores, Gas Bars, Mark’s outlets) across CanadaStores, Gas Bars, Mark’s outlets) across Canada
– More than 45,000 employeesMore than 45,000 employees– More than 25 million customer transactions each yearMore than 25 million customer transactions each year– 90% of Canadians shop at a Canadian Tire store, 40% are in 90% of Canadians shop at a Canadian Tire store, 40% are in
our stores every weekour stores every week
Canadian Tire Corporation, LimitedCanadian Tire Corporation, Limited
– Canadian Tire Petroleum is the country’s largest Canadian Tire Petroleum is the country’s largest independent retailer of gasolineindependent retailer of gasoline
• 203 gas bars 203 gas bars • 21 Simoniz car washes21 Simoniz car washes
– Canadian Tire “Money” is the most widely recognized Canadian Tire “Money” is the most widely recognized loyalty program in Canadian retail loyalty program in Canadian retail
– Canadian Tire Financial Services is the largest non-Canadian Tire Financial Services is the largest non-bank issuer of MasterCard in Canadabank issuer of MasterCard in Canada
– Our website ended 2001 among the country’s top Our website ended 2001 among the country’s top three e-commerce websites three e-commerce websites
– Canadian Tire Petroleum is the country’s largest Canadian Tire Petroleum is the country’s largest independent retailer of gasolineindependent retailer of gasoline
• 203 gas bars 203 gas bars • 21 Simoniz car washes21 Simoniz car washes
– Canadian Tire “Money” is the most widely recognized Canadian Tire “Money” is the most widely recognized loyalty program in Canadian retail loyalty program in Canadian retail
– Canadian Tire Financial Services is the largest non-Canadian Tire Financial Services is the largest non-bank issuer of MasterCard in Canadabank issuer of MasterCard in Canada
– Our website ended 2001 among the country’s top Our website ended 2001 among the country’s top three e-commerce websites three e-commerce websites
Canadian Tire Corporation, LimitedCanadian Tire Corporation, Limited
EAI DefinedEAI Defined
What is Application Integration
• Yankee Group;
…the continuous process of improving the enterprises’ entire information technology base-applications, information, communications, and infrastructure to support the business.
• Gartner Group says;
“Application integration is defined as making independently designed application systems work together.”
• Mercator;
…EAI is the process of integrating different applications to enable an enterprise to communicate with a single voice.
The Integration Problem
“Imagine if you didn’t have common electric outlets and plugs in your house, and every time you bought a new appliance, you had to wire up the appliance to the wires in your wall. And everybody’s wires in everybody’s walls were different. And everybody’s appliance wiring was different. That’s really the way it works today with trying to integrate business software applications.” - Paul Margolis, past chairman of the OAG, Inc.
The Integration Problem
• Multiple, disparate applications• Multiple platforms• Multiple databases• Multiple transaction processors• Multiple data entry points• Multiple versions of the same data• Incompatible business data
Factors Contributing to the Problem
• Application systems are built at different times by different groups operating independently of each other
• Organizations are stuck w/ incompatible architectures and hard-to-maintain, but harder-to-eliminate legacy applications
• Organizations are embracing a buy before build strategy that favours purchased application packages over internal development
IT’s Dirty Little Secret
Planning Systems
Application System C
Application System B
Application System A
Program
Program
Program
Program
Program
Extract
Load
Down load file
screen scrape
Database Replicator
Extract
Down load file
Load
APPC
trans-action
file
Update
Sockets
Extract
Down load file
Load
Load
Extract
Down load file
– Need a systematic approach to the problemNeed a systematic approach to the problem– No E.F. Codd of IntegrationNo E.F. Codd of Integration
• No mathematical basisNo mathematical basis• No relevant academic leadershipNo relevant academic leadership
– Multiple Vendor Specific FrameworksMultiple Vendor Specific Frameworks• unlike DBMS marketplace where DB implementations are unlike DBMS marketplace where DB implementations are
similarsimilar• Integration Software vendors have widely different Integration Software vendors have widely different
implementation frameworksimplementation frameworks
– Need a systematic approach to the problemNeed a systematic approach to the problem– No E.F. Codd of IntegrationNo E.F. Codd of Integration
• No mathematical basisNo mathematical basis• No relevant academic leadershipNo relevant academic leadership
– Multiple Vendor Specific FrameworksMultiple Vendor Specific Frameworks• unlike DBMS marketplace where DB implementations are unlike DBMS marketplace where DB implementations are
similarsimilar• Integration Software vendors have widely different Integration Software vendors have widely different
implementation frameworksimplementation frameworks
Integration FrameworkIntegration Framework
– Standards only recently impact integration design Standards only recently impact integration design patternspatterns
• in the DBMS marketplace, standards were established in the DBMS marketplace, standards were established early in the development life cycleearly in the development life cycle
• in the Integration marketplace, only w/in the last 2 years in the Integration marketplace, only w/in the last 2 years have standards such as XML, Web Services emerged have standards such as XML, Web Services emerged
– Standards only recently impact integration design Standards only recently impact integration design patternspatterns
• in the DBMS marketplace, standards were established in the DBMS marketplace, standards were established early in the development life cycleearly in the development life cycle
• in the Integration marketplace, only w/in the last 2 years in the Integration marketplace, only w/in the last 2 years have standards such as XML, Web Services emerged have standards such as XML, Web Services emerged
Integration FrameworkIntegration Framework
– A Framework is required for integration:A Framework is required for integration:• AdaptersAdapters• TransformationTransformation• Asynchronous messagingAsynchronous messaging• Intelligent RoutingIntelligent Routing• Business Process ManagementBusiness Process Management• Canonical MessagesCanonical Messages
– A Framework is required for integration:A Framework is required for integration:• AdaptersAdapters• TransformationTransformation• Asynchronous messagingAsynchronous messaging• Intelligent RoutingIntelligent Routing• Business Process ManagementBusiness Process Management• Canonical MessagesCanonical Messages
Integration FrameworkIntegration Framework
– 3 Main Patterns to solve the integration problems:3 Main Patterns to solve the integration problems:• Data Consistency Data Consistency
– asynchronous, loosely coupledasynchronous, loosely coupled
• Multi-Step Business ProcessMulti-Step Business Process– asynchronous, loosely coupledasynchronous, loosely coupled
• Composite Application IntegrationComposite Application Integration– synchronous, tightly coupledsynchronous, tightly coupled
– 3 Main Patterns to solve the integration problems:3 Main Patterns to solve the integration problems:• Data Consistency Data Consistency
– asynchronous, loosely coupledasynchronous, loosely coupled
• Multi-Step Business ProcessMulti-Step Business Process– asynchronous, loosely coupledasynchronous, loosely coupled
• Composite Application IntegrationComposite Application Integration– synchronous, tightly coupledsynchronous, tightly coupled
Integration PatternsIntegration Patterns
Data Consistency Pattern
Integration Framework
Add prod 1234
Add item050 1234
Add UPC 17988
Add prod 1234
Multi-Step Business Processes Pattern
IntegrationFramework
Ship Notice981126
Alloc Order981126
Alloc Order981126
StoreOrder 981126
StoreOrder 981126
Ship Notice981126
Composite Application Pattern
Data
Programs
Data
Programs
Data
Programs
New code & dataLegacy Applications
Purchased applicationpackages
Integration Framework
Browser
Place Order
Check Logistics
Check Credit
Check Inventory
Vendor ImplementationsVendor Implementations
Integration at CTCIntegration at CTC
What needed to be fixed
• Organization issues– where does the Competency Centre reside– who does the work
• Methodology– no consistent way to document interfaces
• Exception Management– escalation process of data issues….
Key Data Issues
• Data QualityData Quality• Data ConsistencyData Consistency• Data OwnershipData Ownership• Semantic Knowledge and BehaviourSemantic Knowledge and Behaviour• LatencyLatency• FormatsFormats
Hub and Spoke PatternPoint to Point Hub & Spoke
Hub and spoke organizing principlesHub and spoke organizing principles
1. Don’t connect anything directly to
anything
2. Applications are autonomous and share
no databases directly
3. Knowledge of interconnections removed
from source and targets and moved to
the hub
BenefitsBenefits
1. Operational simplification
2. Adaptation to change
3. Reuse leverage
– 2 Brokers are in place:2 Brokers are in place:• Homegrown Broker supports near-time integration Homegrown Broker supports near-time integration
patternspatterns• Broker is MVS based using MQSeries to connect to Broker is MVS based using MQSeries to connect to
applications on:applications on:– AS/400, NT, DEC/ALPHA, AIX, MVSAS/400, NT, DEC/ALPHA, AIX, MVS
• Mercator supports batch integration patternsMercator supports batch integration patterns– Mercator is used for most of the transformationsMercator is used for most of the transformations
– Bulk data movement is done using homegrown File Bulk data movement is done using homegrown File Transfer/MQSeriesTransfer/MQSeries
– 2 Brokers are in place:2 Brokers are in place:• Homegrown Broker supports near-time integration Homegrown Broker supports near-time integration
patternspatterns• Broker is MVS based using MQSeries to connect to Broker is MVS based using MQSeries to connect to
applications on:applications on:– AS/400, NT, DEC/ALPHA, AIX, MVSAS/400, NT, DEC/ALPHA, AIX, MVS
• Mercator supports batch integration patternsMercator supports batch integration patterns– Mercator is used for most of the transformationsMercator is used for most of the transformations
– Bulk data movement is done using homegrown File Bulk data movement is done using homegrown File Transfer/MQSeriesTransfer/MQSeries
CTC Integration InfrastructureCTC Integration Infrastructure
CTC Integration InfrastructureCTC Integration Infrastructure
• 150+ interfaces150+ interfaces• 40+ w/ re-usable objects (source/target/mapping objects)40+ w/ re-usable objects (source/target/mapping objects)• 45 applications involved in integration with the Broker45 applications involved in integration with the Broker• Real-time messaging a combo of XML and ASCII payloadsReal-time messaging a combo of XML and ASCII payloads• 4000+ FT/MQ per day4000+ FT/MQ per day• 450+ Queue Managers450+ Queue Managers
What Worked• Re-use of infrastructureRe-use of infrastructure
– FT/MQ, MapsFT/MQ, Maps
• Mercator for batch legacy data & recently XML, DB2 & MQ Mercator for batch legacy data & recently XML, DB2 & MQ Adapters (95%)Adapters (95%)
• Messaging - APIs (5%)Messaging - APIs (5%)• Methodology & Design PatternsMethodology & Design Patterns• Competency CentreCompetency Centre• IMS Bridge to unlock legacy transactionsIMS Bridge to unlock legacy transactions• Phased rollout - unplug old-turn on new functions at the Phased rollout - unplug old-turn on new functions at the
hubhub
Canadian Tire Corporation, Limited
Canadian Tire Corporation, Limited
IRMAC Enterprise Application Integration
Ken Dschankilic, Manager Integration ArchitectureApril 16, 2003
IRMAC Enterprise Application Integration
Ken Dschankilic, Manager Integration ArchitectureApril 16, 2003