End to End Data Quality Framework · PPT file · Web view ·...
Transcript of End to End Data Quality Framework · PPT file · Web view ·...
<Insert Picture Here>
Oracle Customer Hub (UCM) 8.2 Release Overview
Oracle MDM Product Management
Copyright © 2006, Oracle. All rights reserved.2
Oracle Training Materials – Usage Agreement
Use of this Site (“Site”) or Materials constitutes agreement with the following terms and conditions:
1. Oracle Corporation (“Oracle”) is pleased to allow its business partner (“Partner”) to download and copy the information, documents, and the online training courses (collectively, “Materials") found on this Site. The use of the Materials is restricted to the non-commercial, internal training of the Partner’s employees only. The Materials may not be used for training, promotion, or sales to customers or other partners or third parties.
2. All the Materials are trademarks of Oracle and are proprietary information of Oracle. Partner or other third party at no time has any right to resell, redistribute or create derivative works from the Materials.
3. Oracle disclaims any warranties or representations as to the accuracy or completeness of any Materials. Materials are provided "as is" without warranty of any kind, either express or implied, including without limitation warranties of merchantability, fitness for a particular purpose, and non-infringement.
4. Under no circumstances shall Oracle be liable for any loss, damage, liability or expense incurred or suffered which is claimed to have resulted from use of this Site of Materials. As a condition of use of the Materials, Partner agrees to indemnify Oracle from and against any and all actions, claims, losses, damages, liabilities and expenses (including reasonable attorneys' fees) arising out of Partner’s use of the Materials.
Copyright © 2006, Oracle. All rights reserved.3
Disclaimer:This document in any form, software or printed matter, contains proprietary information that is the exclusive property of Oracle. Your access to and use of this confidential material is subject to the terms and conditions of your Oracle Software License and Service Agreement or other applicable contract with Oracle, with which you agree to comply. This document and information contained herein may not be disclosed, copied, reproduced ordistributed to anyone outside Oracle without Oracle’s prior written consent. This document is not part of your license agreement nor can it be incorporated into any contractual agreement with Oracle or its subsidiaries or affiliates. This document is for informational purposes only and is intended solely to assist you in planning for the implementation and upgrade of the product features described. This is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality are always at Oracle’s sole discretion. This document is not considered part of the applicable program documentation. Due to the nature of the product architecture, it may not be possible to safely include all features described in this document without risking significant destabilization of the code.
Purpose:This document provides an overview of features and enhancements included in the Higher Education Constituent Hub (HECH ) for Oracle Customer Hub 8.1.1. It is intended solely to help you assess the business benefits of upgrading your existing Oracle Products to HECH, or implementing completely new Oracle developed products, and planning your I.T. Projects.
1. Oracle and Partner Field Enablement
2. Deep Dive into Customer Hub (UCM) 8.2 Functionality
3. Hands-on Training
4
Training Objectives
Day-19-11am: Kick-off/Introductions, 8.2 Release Overview11-2pm: Data Stewardship 2-3.30pm: List Import 3.30-5pm: Data Governance Manager
Day-28-11.30pm: Data Quality Matching & Address Validation12.30-2.30pm: Data Quality Profiling, Parsing & Standardization Server3-4pm: AIA for Customer MDM4-5pm: Data Relationship Management for Customer Hub
5
2-DayTraining Agenda
Release Overview Agenda
• Business Challenges & Release Objectives• Solution Components
• Customer Hub 8.2 Release Highlights• End-to-End Data Quality• Oracle Application Integration Architecture for MDM 2.5• Oracle Data Governance Manager• Hyperion DRM for Customer Hub
• Key Takeaways
6
Release Overview Agenda
• Business Challenges & Release Objectives• Solution Components
• Customer Hub 8.2 Release Highlights• End-to-End Data Quality• Oracle Application Integration Architecture for MDM 2.5• Oracle Data Governance Manager• Hyperion DRM for Customer Hub
• Key Takeaways
7
MDM Implementation challengesWhat we hear loud and clear
• Achieve material & sustainable data quality improvements• Effort grows exponentially with source
systems / domains covered• Clean the data (Initial load) vs. keep it clean (on-
going operations)• Raising / evolving data quality criteria
• Cost of integration• Intrusive to consuming applications• Legacy applications• Hub web services too granular
• Implement true enterprise data governance• Agree on an enterprise model• Communicate & enforce enterprise data policies• Easily operate and monitor the hub
8
Unclean to clean data(Initial & Delta load)
Operational exchanges Hub / Apps
End-to-EndIntegration
Siebel
EBS
SAP
JDE
Custom
MDM Aware Apps
End-to-End Data Governance
Trusted Master Data
Oracle Customer Hub (UCM) 8.2Pushing the limits of MDM to achieve faster time to value
End-to-EndData Quality
SourceSystems
Siebel
EBS
SAP
JDE
Custom
9
ApplicationIntegration
Architecture
Siebel
EBS
SAP
JDE
Custom
MDM Aware Apps
Hyperion DRM for Customer HubData Governance Manager
MDM AnalyticsSource
Systems
Siebel
EBS
SAP
JDE
Custom
Customer Hub 8.2
OracleData
Quality
New
Oracle Customer Hub (UCM) 8.2The Solution Components
10
Agenda
• Business Challenges & Release Objectives• Solution Components
• Customer Hub 8.2 - Release Highlights• End-to-End Data Quality• Oracle Application Integration Architecture for MDM 2.5• Oracle Data Governance Manager• Hyperion DRM for Customer Hub
• Key Takeaways
11
End to End Data Quality
Customer Hub (UCM) 8.2 – Release HighlightsBest in Class MDM Solution
- Rules based Data Decay
- Real Time Address Validation
- Enhanced Matching- Multi-mode (RT & Batch)- Multi-language, - Multi-source system- Multi-criteria (rules based)- Multiple Address
- High Performance- Session Management- Enhanced Index Management
(Faster Incremental Loads)
End to End Integration
- Expanded WS Library- 50+ Composite Methods
- Expanded PIP Certification- Siebel 8.0, 8.1- EBS 11i10, R12- Interoperability with Order to
Cash and Telco PIP’s
- New Integrations- SAP ECC 6, R/3 4.7
(Jan2010)- Oracle BRM 7.4
- SOA Governance- PIP Auditor, XMAN- Artifact Generator
End to End Data Governance
- Data Governance Manager
- DRM for Customer Hub- Customer Analytical MDM- Advanced Hierarchy
Management
- MDM Analytics- OBIEE Maps & Dashboards
- Enhanced Stewardship- Rules Engine & Household
Survivorship- Household Merge, Guided
Merge, Merge Request- Enhanced Un-Merge/Un-link- Enhanced Suspect Match- New List Import
12
1. Data Governance Manager for MDM Hubs
2. Data Decay Management
3. Wizard based New/Child Entity Mastering
13
Patents
Trusted Customer Data
Web ServicesLibrary
Publish &Subscribe
Transports &Connectors
Authorization
Registry
Profile & Correct
History& Audit
Privacy Mgmt
Events & Policies
List Import Workbench
Identification & Cross-Reference
Source DataHistory
Rules based Survivorship
Parse
Address Validation
Enrich
Manage Decay
Enhanced Match & Merge
Unmerge
Roles & Relationships Party
Vertical VariantsRelated Data
Entities
Hierarchy Mgmt
Data Governance
Manager
Multi-language
Key Components of Oracle Customer Hub (UCM) The source of clean data for your enterprise
Pre-built library of extensible fine grain & composite web service
World class data governance
High performance “heavy duty” import
Robust DQ & unique Knowledge Based MDM offering
Deep & easily configurable yet upgradeable Industry specific schema
14
SourceSystems
Siebel
EBS
SAP
JDE
Custom
Prof
ile
Stan
dard
ize
De-
Dup
Valid
ate
Add
ress
Trusted
Master Data
Oracle Customer Hub (UCM) 8.2The Product Offering – End to End Data Quality
15
End to End Data Quality Framework
Rules Execution Engine
(Workbench)
Rules Manager - Design, Develop & Validation
Relational and Flat Files
Loans
Legacy
ERP
Other
CRM / MDM
Objective:Zero
rejectsCandidatesError Report
Correction Files
Credit Card
Exception Management Process (Data Quality Assistant)ETL
MergedSinglesManual Rêviez
Scorecards & Reporting(Report Viewer)
Corrective
Actions
Analyze / Profile EnrichMatch &
De-duplicateStandardize & Cleanse
OracleData
Quality
16
Profile, Analyze & Identify Initial Assessment: What are the issues?
17
Completeness What data is missing or unusable?
Conformity What data is stored in a non-standard format?
Consistency What data values give conflicting information?
Accuracy What data is incorrect or out of date?
Duplicates What data records or attributes are repeated?
Integrity What data is missing or not referenced?
OracleData
Quality
FunctionalityFeature
Profiling/Pattern Detection
Parsing and Standardization
Address Validation / Cleansing
Matching and Linking
Enrichment
Understand data status & deduce meaning from unstructured patterns
Create structured records from unstructured dataSpot and correct errors; transform to std format
Valid address identification and correction
Spot / eliminate duplicates & identify related entities
Attach additional attributes and categorizations
New Data Quality Offerings
Examples
Name: LN+FN (CHS, KOR, JPN); FN+MN+ PN+LN (Latin); Tel# is null 30%
Address field -> Address Line 1, City, State,…Nationality: US, USA, American-> USA
809 Newel rd, PALO ALTO 94301 -> 809 Newel Road, Palo Alto, CA 94303-3453
Oracle Offering
Universal DQ Connector + D&B connector + AIA
2.4 PIP for Acxiom
ODQ Matching Server
ODQ Address Validation Server
ODQ Parsing & Standardization
Server
ODQ Profiling Server
Haidong Song = 宋海东 =
Haidong Song: “single, 1 child, Summit Estate,
DoNot Mail”
OracleData
Quality
18
Data QualityNew and Enhanced Functionality
1. Rules Engine based Data Decay• Provide proactive Data Quality capabilities leveraging Decay scores• Rules Engine Integration
2. Integrated Address Validation• Real-Time and Batch Support for Address Validation for over 240 Countries• Monitor and Fix fallouts
3. Enhanced Matching• Full Globalization Support with Multi-language support for RT & Batch Matching• Multiple Address Matching• Configure match rules based on source system, RT/Batch, any other criteria.
4. High Performance• Enhanced connector with Session Pool Management• Enhanced Index Management due to Synchronization improvements for faster
processing of Incremental Loads
OracleData
Quality
19
Siebel
EBS
SAP
BRM
Custom
MDM Aware Apps
Match
Sync
Merge
FetchTrusted
Master Data
Oracle Customer Hub (UCM) 8.2The Product Offering – End to End Pre-build Integration
20
Out of the box integration Support for Oracle BRM and SAP with AIA 2.5
Customer Hub
AIA Customer Party EBO
Siebel
JDELegacy
ilex
Retek
BRM
ODS
EBS
SAP
Third Party
Fetch Process: Once candidate selected, returns the entire profile of the customer / prospect
Match Process: returns the list of candidates to a list of selection criteria
Sync Process: Bi-directional data sync between customer hub and applications
123
Merge Process: Publish Merge to all applications4Enrich Process: Customer Hub to AIA connector to enrich consumer data from third party 5
Siebel
EBS
SAP
BRM
Custom
MDM
Aware Apps
Match
Sync
Merge
Fetch
Trusted Master Data
21
Customer Hub PIP for Communications
Siebel
BRM
Revenue Management
Customer Management
• Continue to support the Order Capture flow customer sync to BRM
• Sync Customer updates to BRM from UCM
CustomerHub
UCM 8.2
External Updates (D&B) …
Match / Fetch
& Sync
Sync *
Sync
Siebel
EBS
SAP
BRM
Custom
MDM
Aware Apps
Match
Sync
Merge
Fetch
Trusted Master Data
22
IntegrationNew & Enhanced Functionality
1. Expanded Web Services Library• 50+ Composite Methods
2. Expanded MDM PIP Certification & Interoperability• Siebel 8.0, 8.1 and EBS 11i10, R12• MDM PIP’s with Order to Cash PIP and Communications & Media PIP’s.
3. New Products Integrated via MDM PIP• SAP ECC 6.0 & R/3 4.7 (Feb 2010)• Oracle Billing & Revenue Management (BRM) v7.4
3. SOA Governance and Productivity• PIP Auditor – Provides Technical Governance with 114 rules across 65000 artificats• Enhanced XMAN – Provides Content Governance to do interoperability checks• Enhanced Artifact Generator – Jumpstart integration of new operational systems
Siebel
EBS
SAP
BRM
Custom
MDM
Aware Apps
Match
Sync
Merge
Fetch
Trusted Master Data
23
Oracle Customer Hub (UCM) 8.2The Product Offering – End to End Data Governance
Define Operate Monitor Fix
Trusted Master Data
24
Comprehensive Data Governance Program Components
• Vision and Mission• Alignment with
Corporate Objectives
• Operating Model• Implementation
Plan
• Arbiters and Escalation points• Stakeholders• Roles and Responsibilities • Data Stewards• Decision Rights• Accountability and Ownership
• Standardized methods and data definitions
• Controls• Metadata Management
• Statistics and Analysis• Tracking of progress• Monitoring of issues• Continuous Improvement• Score-carding
• Flexibility to change• Open and common
standards• End to End Data
security / lineage• Data Discovery,
Cleanse, Match, Maintain
• Metadata Management
• Reporting• Integration
• Training and Awareness• Mass – Wiki or Intranet• Individual Updates• Pertinent, specific and
timely• Maintain interest and
commitment
Source – First San Francisco Partners 25
Data Governance Manager• Easy to use hub operations• Centralized administration• Embedded data quality analytics • Tracking source system bad data
sources• Monitoring hub loads• Easy access to all hub engines and
watch & repair applications• Web 2.0 like UI accessing hubs
through web services
26
Hyperion DRM for Customer HubEmbedding Analytical MDM capabilities in Customer Hub
• Sophisticated Management of Operational & Reference (DNB) Hierarchies– Manipulate, Compare, Blend & Merge/Restore Hierarchies
• Enterprise Customer Hierarchy Management, Hierarchy History, Audit & Versioning
27
MDM Analytics Better Insight with Completeness & Accuracy Dashboards
28
Stewardship FeaturesNew and Enhanced Functionality
1. Enhanced Survivorship• Rules Engine Based survivorship to define any rule beyond the seeded Rule Types• New Rule Types – Master Wins / Slave Wins• Data Steward Override of survivorship engine results• Household Survivorship
2. Enhanced Merge• Guided Merge using Task Base UI• Enhanced Suspects Match by posting records as a Suspect awaiting Resolution• Merge Request – Includes Web Services support that provides ability to post merge
request from operational systems• Household Merge
3. Enhanced Un-Merge/Un-link• Un-link of Incoming records that are linked by Data Steward
29
List ImportNew Functionality
1. Empowering Business Users to load data in Hub• Full configurability due to Metadata driven approach• Ability to Pre-define Templates, schedule jobs, monitor status• Flat Files, Excel and XML can be uploaded
2. Incomplete View for Error Resolution• New view to fix incomplete transactions
3. List Import available as a Web Service• Automate batch loads using Web Service• Monitor/Fix the batch loads like any manually loaded job
30
Agenda
• Business Challenges & Release Objectives• Solution Components
• Customer Hub 8.2 Release Highlights• End-to-End Data Quality• Oracle Application Integration Architecture for MDM 2.5• Oracle Data Governance Manager• Hyperion DRM for Customer Hub
• Key Takeaways
31
Oracle MDM helps organization turn their data into corporate assets
Enterprise grade MDM solution
Best in class Customer, Product,
Site, Supplier, Financial and
Analytical hubs
First Data Governance
Solution of the market
Best in class Data Quality: framework for controlled path
to higher DQ levels
Oracle MDM enables fast deployment and one of the lowest TCO solution of the market
MDM pre-integrated (AIA) with Oracle and Non Oracle Apps made MDM Aware
Prevents the need from extensive design and construction work
Fast tracks the implementation
Verticalised MDM solution for Telco, FINS, Public Sector, Retail, High Tech, Manufacturing, Higher Ed, ...
Massively scalable hubs yet easy to install, operate and maintain
32