Significance of statistical significance

10
significant evidence

description

Keynote presentation this classic paper: Sterne JAC, Smith GD (2001) Sifting the evidence - what's wrong with significance tests? British Medical Journal 322: 226-231.

Transcript of Significance of statistical significance

Page 1: Significance of statistical significance

significant evidence

Page 2: Significance of statistical significance

what is a p-value?

when is a p-value appropriate?

what are good solutions?

Page 3: Significance of statistical significance

p-value is the measure of strength of evidence against the null hypothesis.

Smaller values the stronger the evidence against null.

Page 4: Significance of statistical significance

unfortunately, the p-value used in environmental science is the Type I error rate.

Page 5: Significance of statistical significance

why does using p-values matter?

no strength of evidence conveyed, i.e. treatment strength.

Page 6: Significance of statistical significance

why does using p-values matter?

scales up to population level false positives

Page 7: Significance of statistical significance

p-values are acceptable if ... there are not a large population of studies, the experiment is very controlled, and the value is

very, very low.

provides a plausible range.

Page 8: Significance of statistical significance

solutions

present precise p-value

interpret based on context, experiment, & evidence

do not interpret as significant/non-significant

report strength of effects

show confidence intervals

Page 9: Significance of statistical significance

ultimately, the goal is manage & seek evidence

Page 10: Significance of statistical significance

resources

Sterne JAC, Smith GD (2001) Sifting the evidence - what's wrong with significance tests? British Medical Journal 322:

226-231.