Data Quality Rules introduction
8
An introduction to Data Quality Rule development Data to Value Ltd. 42-44 Bishopsgate London EC2N 4AH www.datatovalue.co.uk
-
Upload
datatovalue -
Category
Business
-
view
491 -
download
1
description
A brief introduction to Data Quality rule development and implementation covering: - What are Data Quality Rules. - Examples of Data Quality Rules. - What are the benefits of rules. - How can I create my own rules? - What alternate approaches are there to building my own rules? The presentation also includes a very brief overview of our Data Quality Rule services. For more information on this please contact us.
Transcript of Data Quality Rules introduction
An introduction to Data Quality Rule development
Data to Value Ltd.42-44 Bishopsgate
LondonEC2N 4AH
www.datatovalue.co.uk
What are DQ Rules?
Data to Value Ltd, 42-44 Bishopsgate, London EC2N 4AHwww.datatovalue.co.uk
Automated data quality checks.
Essential part of any
coordinated approach to
Information Management.
Pre or Post input.
Many ways to group, classify &
present rules & results.
How are they used & what are benefits?
Data to Value Ltd, 42-44 Bishopsgate, London EC2N 4AHwww.datatovalue.co.uk
Cost savings.
Regulatory Compliance.
Information Security.
Risk reductions.
Enhanced Customer Relationship
Management (CRM)
US0378331005
Data to Value Ltd, 42-44 Bishopsgate, London EC2N 4AHwww.datatovalue.co.uk
Example of a basic DQ ruleISIN – International Securities Identifier Number
12 Characters in length
Alphanumeric
Begins with an ISO country code
Contains a check digit
May contain a related code e.g. CUSIP
Data to Value Ltd, 42-44 Bishopsgate, London EC2N 4AHwww.datatovalue.co.uk
Advanced DQ rules These can involve:
- Checking across data fields – e.g. if field A is X, field B must be A, B or C.
- Matrix Lookups / transformations – e.g. credit rating comparisons.
- Multiple transformation / validation steps.
- Validation against external sources.
- More advanced logic – fuzzy matching etc.
How to start developing rules
Data to Value Ltd, 42-44 Bishopsgate, London EC2N 4AHwww.datatovalue.co.uk
Typical implementation cycle resembles:
- Discovery & analysis.- Testing & enhancement- Definition.- Implementation.- Review.
What are alternatives to DIY?- Data Quality rule repositories &
bureaus.- Standards bodies – e.g. ISO.- Hire an expert consultancy.
Data to Value’s DQ Rule service
Data to Value Ltd, 42-44 Bishopsgate, London EC2N 4AHwww.datatovalue.co.uk
Full on/offsite rule research, development & implementation service.
All rules documented in plain English using a specified metadata standard e.g. your internal Data Dictionary.
Tailored presentation of results at your required level of detail – summary dashboards and/or in depth KPIs.
Choice of Data to Value’s preferred tools or your existing DQ analysis tools (BI tools, profiling tools, reporting tools etc.)
80%
85%
90%
95%
100%Integrity
Completeness
UniquenessConsistency
Conformity
75%
80%
85%
90%
95%
100%
May June July August
Overall Quality Completeness Consistency
Conformity Uniqueness Integrity
-
10,000
20,000
30,000
40,000
50,000
60,000
70,000
80,000
90,000
100,000
May June July August Dept A Dept B Dept C Dept D
Data Quality Scorecard – Product Data May 2013
Commentary:- Data coverage of priority field A increased from 30% to 80%.
- Tier 1 incidents down 30%
- Data Dependency X now live.
- Data Maintenance requirement reduced by 30% over 3 months to date.
- 2 additional power users trained in DQ tool.
- 2 additional Data Stewards within Product Master Data Set.
Status = Green
May DQ dimensions
Latest dependenciesData Maintenance activity
Monthly DQ dimensions
About us
Specialist Information Management Consultancy offering services within:
Over 40 years combined Information Management experience as Executives at blue chip organisations.
Experts at bridging understanding gap between 'the business' and technology within the Information Management space.
Data to Value Ltd, 42-44 Bishopsgate, London EC2N 4AHwww.datatovalue.co.uk
