TEST-DRIVEN DATA ANALYSIS
14
TEST-DRIVEN DATA ANALYSIS Do you believe your analytical results? Thanks to: Nicholas Radcliffe http://tdda.info [email protected] Dept of Mathematics, University of Edinburgh
Transcript of TEST-DRIVEN DATA ANALYSIS
TEST-DRIVEN DATA ANALYSISDo you believe your analytical results?
Thanks to:Nicholas Radcliffehttp://[email protected] of Mathematics, University of Edinburgh
The Big Idea
Transfer the ideas of test-driven development
from software development
to data analysis
How
models are really developed
tdda level1: CONSTRAINTS
Look before you leap!
Checking the data conforms to your assumptions before you start.
This is tedious to generalise so there are tools to help...
l Not just the obvious input, but also intermediate and output sets
Tools to automate L1 constraint testsTool Read input Rules Action Flexibility,
Complexity
ArcGIS Input Dialog Existence, schema
Block from starting
Low
RDBMS Table schema
Field constraints, triggers
Rejection Med
TDDA python module
Pandas framework
Regular expression generator
Report Med
FME Attribute Validatortransformer
Choose from built-in rules, custom tests
Report, repair or filter
High
TEST-DRIVEN DATA ANALYSIS
![Data-Driven and Keyword-Driven Test[1]](https://static.fdocuments.in/doc/165x107/577ce76d1a28abf103951d8d/data-driven-and-keyword-driven-test1.jpg)
