Fast Track Your Data Warehouse - IBM - United States · PDF fileFast Track Your Data Warehouse...
Transcript of Fast Track Your Data Warehouse - IBM - United States · PDF fileFast Track Your Data Warehouse...
© Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Fast Track Your Data Warehouse
Gary O’ConnellIOD Comes To YouSydney, May 13, 2008
2 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.Fast Track Your Data Warehouse
IBM provides a complete framework to accelerate your Data Warehouse initiatives
Deliver dramatically better information that enables innovation and responsiveness
Save months of effort and hundreds of thousands of dollars
Set the foundation for business optimization
3 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Business Benefits
•
Rolled out to select dealers across the US.
•
Provides better access to up-to-the-minute information to dealers, reducing unnecessary reorders.
•
Leverages the capabilities of data integration for closed-loop operational decision making.
•
Catalyst for the creation of an Integration Center of Excellence (CoE).
Fast Track Your Data Warehouse for Innovation
•
Dealers were unable to enhance customer purchase experience by supplying delivery information at time of purchase
•
Needed to provide dealers with more accurate inventory information
•
Required the integration of external market and parts information with internal order forecasts and shipments in their SCM system.
Challenge
APPROVED FOR EXTERNAL USE
4 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Five Keys To Fast Track Your Data Warehouse
1. Streamline requirements gathering & design
2. Align business users and IT
3. Avoid costly downstream errors and maximize data quality early in your process
4. Maximize productivity and scalability
5. Design flexible information services
5 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
IBM Offers Fast Track Capabilities At Every StepDecrease project time, reduce project risk, promote information reuse
Implementation of Data Integration and Business Intelligence infrastructure
Create enterprise
data warehouse and data mart
designs. Profile source systems
Deploy enterprise data warehouse and
load with trusted data
Deploy reporting data marts and
load with trusted data
Use reporting solution and
business glossary to understand and measure
KPIs
Define business requirements
and glossary of terms
New Business RequirementsNew Business Requirements
Requirements Definition and Assessment of Data Inventory
6 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Typical Data Warehouse Design Process
Costly and slow to developStakeholder approvalIndustry knowledgeFrequent scope changes Minimal of 12-18 months
In-house modeling skills
Inflexible to new requirementsScope doubles every 1½ yearsRepeatable methodology Knowledge retention Data definition consistencyFragmentation and redundancy
Not enabled for dynamic applicationsSynchronization with Master DataInformation Services for applicationsAppropriate real-time capabilities
7 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Streamline Requirements and Design Process Industry Data Models –Top Down Approach
8 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Understand information from a corporate perspective
Share common data definitions
Know that key metrics relate across view points
Meet Compliance reporting
Drive business optimization
Blend data from M&A
Consolidate data marts
Model Management
Model Lifecycle and Governance Methodology
Why Enterprise Models
9 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Business Terminology Data Model −Enterprise-wide vocabulary of business concepts−Provides an organization's view of itself and its industry
Enterprise Data Warehouse (EDW) Model−Data model defines how multiple sources of data should
be consolidated into a single logical structure−Enables real-time business analytics
Business Solution Templates (BST)−Collections of related Key Performance Indicators −Used to create OLAP cubes and/or Data Marts for
Dashboard, Scorecard, Applications or ad-hoc reporting
Industry Data Models: Key Components
10 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.•Customer Interaction Analysis•Customer Investment Profile•Individual Customer Profile•Wallet Share Analysis
Relationship Relationship MarketingMarketing
•Outstandings Analysis •Portfolio Credit Exposure•Security Analysis•Liquidity Risk•Collections Analysis•Insurance Risk Profile
RiskRisk
•Transaction Analysis•Activity Based Costing Analysis•Insurance Product Analysis•Investment Arrangement Analysis
ProfitabilityProfitability
Asset &Asset & LiabilityLiabilityManagementManagement
•Interest Rate Risk Analysis•Credit Risk Profile•Credit Risk Assessment•Credit Risk Mitigation Assessment•Asset Securitization Analysis •Operational Risk Assessment
•European Central Bank Reporting•Financial Capital Adequacy Analysis•Structure Of Regulatory Capital •Foreign Financial Account Analysis•Suspicious Activity Analysis•Transaction Activity Analysis•SOA Balance Sheet Analysis•SOA Cash Flow Analysis•
SOA Statement Of Change In Shareholders' Equity Analysis•
SOA Statement Of Income Analysis
ComplianceCompliance
•Balance Sheet Portfolio Basis Approach Analysis•Balance Sheet Classified Approach Analysis•
Balance Sheet Order Of Liquidity Approach Analysis•Balance Sheet Net Assets Approach Analysis•Cash Flow Direct Analysis•
Cash Flow Indirect Analysis
•Customer Complaints •Delinquency Analysis•Customer Loyalty•Market Analysis
•Campaign Analysis•Cross Sell Analysis•Customer Attrition •Customer Behavior•Lead Analysis
•Product Profitability•Product Analysis•Organization Unit Profitability•Performance Measurement•Business Procedure Performance
•Profitability Analysis•Channel Profitability•Customer Lifetime Value •Customer Profitability•Location Profitability
•Authority Profiling•Credit Risk Analysis•Debt Restructuring •Involved Party Exposure•Location Exposure•Non Performing Loan•Operational Risk Loss Analysis
•Interest Rate Sensitivity •Liquidity Analysis•Short Term Funding Management•Financial Management Accounting
•Net Interest Margin Variance•Structured Finance Analysis•Equity Position Exposure•Position Valuation Analysis
•Cash Flow Direct Financial Institution Analysis•Cash Flow Indirect Financial Institution Analysis•Income Statement By Function Analysis•Income Statement By Nature Analysis•Income Statement Financial Institution Approach Analysis•Statement Of Changes In Equity Analysis
•Capital Allocation Analysis•Capital Procurement•Credit Loss Provision•Funds Maturity Analysis•Income Analysis
Banking DW Business Solution Templates
11 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Business Solution Templates
•
Transaction Analysis•
Activity Based Costing Analysis
•
Insurance Product Analysis•
Investment Arrangement Analysis
•
Profitability Analysis•
Channel Profitability
•
Customer Lifetime Value
•
Customer Profitability•
Location Profitability
•
Product Profitability•
Product Analysis
•
Organization Unit Profitability•
Performance Measurement
•
Business Procedure Performance
12 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Streamline Requirements and Design Process IBM Industry Models Advantage
Ensure the right results with top down approach that starts with business objectives
Speed communication by stating requirements in business terms
Deliver immediate ROI with modular implementation
Utilize as roadmap for new data sources and applications
13 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Align the efforts of IT with the goals of the business
Enable authoring & sharing of business metadata
Provide business context
Establish responsibility for business terms
Subject Matter Experts
Business Users
Business View
Align Business Users and IT to Objectives IBM Information Server Business Glossary
14 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Information
Server
InfoSphere Warehouse
Business Terms
A Common Set of Terms for IT and the Business IBM Information Server Business Glossary
Business Analyst
Data Steward
Developer
Architect
Business Terms
Business Glossary
15 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Melbourne Health Screenshot: Molecular Medicine Informatics Model (MMIM)
•
MMIM provides clinical researchers access to data from disparate existing databases across multiple disease types at multiple institutions, co-located in a virtual repository.
•
Business Glossary describes the contents of each database currently integrated in MMIM
•
Supported data elements are searchable by terms which are then linked to its occurrence across all databases
16 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Popup desktop search & lookup
Works with any desktop app
Increases the reach of glossary
Enables tighter collaboration
Empower Business Users with Context & MeaningInformation Server Business Glossary Anywhere
AvailableNow!
17 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Business Glossary Anywhere with Cognos
1. Highlight term Active and click to look up in Business Glossary
3. Select term to view full details.
2. Candidate terms returned.
18 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Cognos
Business Glossary Anywhere
Info
rmat
ion
Ser
ver
Business Glossary
Business Terms
Align Information with Business Objectives Common Glossary for Business and IT
SAP ECC
MS Word
BOJ Designer
Business Glossary Anywhere
Business Glossary Anywhere
Business Glossary Anywhere
InfoSphere Warehouse
19 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Align Information with Business Objectives Common Glossary for Business and IT
Access to business glossary from any application, at any time
Bring data steward role into focus
Provide visibility into strategic asset
Boost productivity with shared metadata
20 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Business
Glossary
Analyze existing source systems
−
Data-centric analysis for content, quality, and structure
−
Secure, detailed profiling of fields, and relationship analysis across fields and across sources
Enable ongoing measurement and baseline reporting of information quality
Create metadata that describes where information is managed across systems
Other
Product Modules
Data Analysts
Subject Matter Experts
Physical View
Avoid Costly Downstream Errors and Rework Information Server - Information Analyzer
21 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Automate specialized data quality processing−
Ensures clean, standardized, de- duplicated information
−
Enables a single version of the truth
−
Supports global postal verification
Utilize visual tools for designing quality rules and matching logic
Allow quality logic to be deployed seamlessly within ETL, or as shared services
Subject Matter Experts
Visual Match Rule Design
Data Analysts
Maximize Data Quality Information Server - QualityStage
22 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Confidently Use Trusted Information
Information
Server
Business Glossary
Information Analyzer
Metadata
Business Terms
Data Lineage
QualityStage DataStage
Business Rules
Accurate
Complete
In Context
Insightful
23 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.Fast Track Your Data Warehouse For Effectiveness
Business Benefits
•
Integration development costs are 3-6%
of total project budget (industry avg. 10-
40%)
•
Business starting to think in real-time –
data is now provided when and how they want it
•
Quicker response to customer demands through faster application development
•
Leveraging high quality data to exploit future technology and business trends like RFID
•
Marketing and supply chain initiatives throughout the organization to improve customer service and operations
•
Multiple disparate legacy application sources
-
incompatible and inconsistent business data
-
latency issues regarding data delivery
•
Decision making based on compromised data
Challenge
24 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Avoid Costly Errors and Rework Monitor data sources and implement data quality early in process
Understand data source content and structure
Monitor source systems for changes, avoid data degradation
Match and standardize data in-line for real- time feeds
Report on data quality metrics
25 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Utilize the Best Approach for Transformation Information Server - DataStage
Provide codeless visual design of data flows−
Optimized reuse of integration objects
−
Supports batch & real-time operations
−
Produces reusable components that can be shared across projects
Connect to the broadest range of sources
Leverage shared nothing architecture for parallel processing −
Linear scalability
−
Ultimate flexibility
Hundreds of Built-inTransformation Functions
ArchitectsDevelopers
26 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Introducing Information Server FastTrack
Enables metadata-driven business & IT collaboration
Facilitates mapping of sources to targets
Leverages source analysis, Target models, & metadata
Auto-generation of data flow logic & reports
Captures target to source mapping decisions
Flexible reporting
Auto-generates DataStage jobs
Specification
27 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Business Glossary Anywhere
Utilize the Best Approach for Transformation Break through productivity to meet Service Level Agreements
Info
rmat
ion
Ser
ver
InfoSphere Warehouse
Business Glossary
Information AnalyzerData Mart Structures
Business Terms
Target Structures
Source Target
Mappings
QualityStage DataStage Fast Track
28 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.Break Through Productivity
Requirements Analysis
Source System Analysis
Data Cleansing
Transformation Logic Construction
Data Management Services
Application System Connectivity
50+% gain
60+% gain
40+% gain
30+% gain
50+% gain
1 Compared to hand coding –
gathered from IBM project studies
ApproximateProject Effort
20%
20%
20%
10%
10%
100%
20%
50+% gain
29 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
ETL−
Extract, Transform, and Load data
Federation−
Capture data of different types and sources like transient web data
Change Data Capture−
Acquire the changes from a production data source with minimal impact
Replication−
Synchronize two or more databases
Extend The Warehouse With Information Services Robust Capabilities for Right Time Information Delivery
30 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Extend the Warehouse with Information Services Information Server – Information Services Director
Packages information integration logic as services
Insulates developers from underlying sources
Allows these services to be invoked as Enterprise Java Beans or Web services
Provides load balancing & fault tolerance for requests across multiple Information Servers
ArchitectsDevelopers
Rapid SOA Deployment
31 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Extend the Warehouse With Information Services Dynamic Information
Info
rmat
ion
Ser
ver
Business Glossary
Information Analyzer
QualityStage DataStage Fast Track
Operational BI
Dashboards
Analytic Applications
InfoSphere Warehouse
Information Services
32 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Make the Data Warehouse Operational With MDM InfoSphere™ Master Data Management Server
Flexible Entry Options
Start small and grow to a full transaction hub
Rapid Implementation
SOA Ready
Includes a library of 800 pre-packaged business services
Performance & scalability
Highly scalable foundation supports the most extreme environments
Business LevelServices
UI Applications
Data Quality Management
Proactive Business Logic Components
KnowledgeMaster Data
ServicesMaster Data
Database
Operational Applications
Middleware & Business Processes
Data warehouses & Analytics
Data Stewards & MDM Users
IBM InfoSphere Master Data Management Server
33 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
Master Data Integration Is Critical Information Server and Models for Master Data Integration
Combines structured and unstructured information
Provides reliable data quality throughout MDM lifecycle
Delivers modular functionality to solve specific challenges
Decreases overall project risk and time to completion
Accessible through SOA and Metadata foundations ETL EAI EIIInformation Server
Federate
Synchronize
Monitor Data Quality
Transform & Enrich
Standardize & Match
Profile & Understand
Connect & Populate
Service Oriented Architecture
InfoSphere Master Data Management Server
34 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.
A Unified Information Platform Rapid deployment, Significant ROI, and Better Information
Info
rmat
ion
Ser
ver
InfoSphere Warehouse
Business Glossary
Information Analyzer
Data Mart Structures
Business Terms
Target Structures
Source Target
Mappings
QualityStage DataStage Fast Track
Source Target
Mappings
Master Data
Operational BI
Dashboards
Analytic Applications
Information Services
© 2006 IBM Corporation35 Template Documentation 5/21/2008
Bringing the Components Together Proven Best of Breed Technology Assets
Define and synchronize critical information for operations and business insight
Recognized leader in all aspects of Master Data Management
Complete operational master data management cross-domains
Full Product Information Management capabilitiesCreate new business value from
enterprise view of information
Predefined terms, definitions and business analysis
Integrated service, process and data models
Business solutions that can be deployed incrementally
Deliver trusted information as a service
Auditable data quality
Model-driven, metadata-assisted integration
Endless parallel scalability
Build a platform for insight
Look deeper into your data through multidimensional analysis
Anticipate future results with predictive analysis
Reach further by analyzing unstructured content
Faster time to value through pre-integrated components
© 2006 IBM Corporation36 Template Documentation 5/21/2008
An Industry Unique, Pre-Integrated Information Platform
Enables information as a strategic asset
Accelerates client value
Mitigates client risk
Completing The Vision One Integrated Information Platform
IBM Provides the Roadmap for Success!
37 © Copyright IBM Corporation 2007. All Rights Reserved.
Innovation made easy.