www.cohesion.com | 877.774.3001
Test Data Management
The Scourge of Testing
www.cohesion.com | 877.774.3001
Introducing Joseph Ours
About Joseph
• Owns development and delivery of Cohesion's Quality Assurance and Testing Services
• More than 15 years of IT experience spanning several industries and roles
• Notable success managing multi-million dollar initiatives while introducing innovative solutions for Fortune 1000 companies, resulting in improved quality, increased client satisfaction, cost avoidance, on-time delivery, and establishing a true team culture
Contacting Me
@justjoehere
614.423.5253
www.linkedin.com/in/josephours
www.cohesion.com | 877.774.3001
What is this about
Purpose of TDM
TDM Lifecycle
Key TDM Lifecycle Aspects
Key TDM Support Roles
www.cohesion.com | 877.774.3001
• Company #1
• 42 Systems needed for E2E testing
• Systems couldn’t talk because data didn’t match
• Project teams added 15% more testing time for test data collection/creation
• 10% of tests could not be executed due to bad data
• All defects had to be investigated as bad data first
• Old data triggered many invalid defects
• Some production defects existed because of unique data in production that wasn’t in a test environment
• Company #2
• Agile teams (6)
• Used automation, ran tests every day/evening
• Created business transactions as a part of testing
• Transactions had a default renewal date
• Actual renewal date hit, test environment came down as it tried to process all the renewals
Quick Examples
www.cohesion.com | 877.774.3001
You manage test data or test data manages you
Test data can impede the overall speed of testing
• Performance testing
• Security testing
Test data affects the ability to conduct types of testing such as:
Why Manage Test Data?
www.cohesion.com | 877.774.3001
Challenges Associated with Test Data?
Labor
Skipped tests
Availability
Security/PII
Storage space
Freshness of data
www.cohesion.com | 877.774.3001
Have you ever tried to test…
• Big Data
• Data Warehouses
• Predictive Analytics
www.cohesion.com | 877.774.3001
Reduce ambiguity in data sourcing and control
Establish roles and responsibilities around test data
Ensure right size test databases that accurately reflect into in business processes
Support comprehensive nonfunctional testing to obtain in user confidence in production performance and scalability
Allow for managing risks associated with test data
Facilitate communicating test data needs
Identify SLA’s for test data turnaround
Why a Test Data Management Strategy
www.cohesion.com | 877.774.3001
Reu
sable
• Standardized
• Modular
• Managed
• Known CIM C
onsu
mab
le
• Quality
• Self-Serve
• Data Catalog
• Fast Acquisition S
cala
ble
• Competency Center
• Operational Efficiency
• Traceable
• Compliance
Mature TDM is…
www.cohesion.com | 877.774.3001
Test Data Management Lifecycle
Analysis Design Creation
Use and Maintenance
Disuse
Governance
www.cohesion.com | 877.774.3001
Permissions
Encryption
Masking
Translation
Governance
Acquisition
Refresh
Maintenance
Scrubbing
Enrichment
Integrity
www.cohesion.com | 877.774.3001
• The simplest phase, with the most work!
Analysis and Design
• Test scenario data needs identified
• Refresh frequency
• Storage needs identified
Analysis
• Implementation of storage infrastructure
• Implementation of TDM tools, if required
• Any data prep work
Design
Analysis Design Creation
Use and Maintenan
ce
Disuse
www.cohesion.com | 877.774.3001
Creation
Reverse migration
• Clone
• Subsetting
Creation through
• UI or API
• Direct injection
Massage
Analysis Design Creation Use and
Maintenance
Disuse
www.cohesion.com | 877.774.3001
Provides Real World Data
Ensures Data Integrity
Entire Book of Business Available
Reduces Data Set Size
Minimizes Security Risks
Covers All Test Scenarios
Fast Acquisition Time for Data
Minimizes Duplicate Data
Creation - Key Evaluation Criteria
www.cohesion.com | 877.774.3001
Reverse Migration
www.cohesion.com | 877.774.3001
Data Creation
www.cohesion.com | 877.774.3001
Massage
www.cohesion.com | 877.774.3001
Reverse Migration Creation Massage
Full
Clone
Subset UI/A
PI
Direct
Injection
Provides Real World Data X X
Ensures Data Integrity X X
Entire Book of Business
Available
X
Reduces Data Set Size X X X X
Minimizes Security Risks X X X
Covers All Test Scenarios X X
Fast Acquisition Time for
Data
X X X
Minimizes Duplicate Data X X
Instantiation Summary
www.cohesion.com | 877.774.3001
Preparation
Validation
Execution
Maintenance
Use of Test Data Analysis Design
Creation Use and
Maintenance
Disuse
www.cohesion.com | 877.774.3001
Archival Deletion Retain
Dis-use Analysis Design
Creation Use and Maintenan
ce Disuse
www.cohesion.com | 877.774.3001
TDM Manager
Application Architect
TDM Architect
Test Lead
Database Administrator
Security and Compliance
Officer
Infrastructure Architect
Key Roles Supporting TDM
www.cohesion.com | 877.774.3001
Improve defect quality
Facilitate test coverage
Reduce labor costs
Manage storage needs
Manage security risks
Recap
Analysis Design
Creation Use and Maintenance Disuse
Governance
Reu
sab
le
•Standardized
•Modular
•Managed
•Known CIM
Co
nsu
mab
le
•Quality
•Self-Serve
•Data Catalog
•Fast Acquisition S
cala
ble
•Competency Center
•Operational Efficiency
•Traceable
•Compliance
TDM Manager
Application Architect
TDM Architect
Test Lead
Database Administrator
Security and Compliance
Officer
Infrastructure Architect
www.cohesion.com | 877.774.3001
Questions?
www.cohesion.com | 877.774.3001
Joseph Ours, MBA, PMP
614.423.5253
www.cohesion.com
@justjoehere
www.linkedin.com/in/josephours