Evidence based data analysis

22
Evidence based data analysis Jeff Leek @simplystats

Transcript of Evidence based data analysis

Evidence based data analysis

Jeff Leek

@simplystats

What Roger said but with more pictures.

Jeff Leek

@simplystats

The tools for reproducibility already exist.*

I think that it is ironic that a paper that claims to prove the reliability of the literature had completely messed up the two main figures that represent the core of all its data and its main results.

An analysis can be fully reproducible and still be wrong.

http://bioinformatics.mdanderson.org/Supplements/ReproRsch-All/

Training not tools

Fisher et al. (2014) http://dx.doi.org/10.7717/peerj.589

Fisher et al. (2014) http://dx.doi.org/10.7717/peerj.589

Prevention not treatment

Leek and Peng (2015) doi: 10.1073/pnas.1421412111

Scaling training

1,750,000+Enrolled

Even simple things are hard at scale

Leek and Peng (2015) DOI: 10.1126/science.aaa6146