Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors...
-
Upload
howard-polley -
Category
Documents
-
view
220 -
download
0
Transcript of Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors...
![Page 1: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/1.jpg)
Stats 95
• Experimental Design– Experimental Design & Lady Tasting Tea– Type I and Type II Errors– Null Hypothesis an Research Hypothesis
![Page 2: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/2.jpg)
Lady Tasting Tea
• How would you design the experiment?• What task would you give her?• What would be the Independent Variable? Dependent
variable? Control condition• How many could she guess right by chance? • What if she can taste the difference, but she makes
mistakes?• Do you know for certain she can? Do you know for
certain she cannot?
![Page 3: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/3.jpg)
Hypotheses
• H0 Null Hypothesis: there is nothing going on, Straw Man, the probability of guessing Tea in Milk is equal to guessing Milk in Tea
• H1 Research Hypothesis: something is going on, probability of correct identification is not equal to guessing between Milk in Tea and Tea in Milk.
![Page 4: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/4.jpg)
NS+N
Hits(response “yes” on signal trial)
Criterion
Internal response
Pro
bab
ilit
y d
ensi
ty
Say “yes”Say “no”
![Page 5: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/5.jpg)
NS+N
Correct rejects(response “no” on no-signal trial)
Criterion
Internal response
Pro
bab
ilit
y d
ensi
ty
Say “yes”Say “no”
![Page 6: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/6.jpg)
NS+N
Misses(response “no” on signal trial)
Criterion
Internal response
Pro
bab
ilit
y d
ensi
ty
Say “yes”Say “no”
![Page 7: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/7.jpg)
NS+N
False Alarms(response “yes” on no-signal trial)
Criterion
Internal response
Pro
bab
ilit
y d
ensi
ty
Say “yes”Say “no”
![Page 8: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/8.jpg)
“What Cold Possibly Go Worng?”: Type I and Type II Errors
Reality
Perception
YES
(Signal + Noise)
NO
(Noise)
YES
(Signal + Noise)Hit
False Alarm (Type I)
False Positive
NO
(Noise)
Miss (Type II)
False NegativeCorrect Rejection
![Page 9: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/9.jpg)
“What Cold Possibly Go Worng?”: Type I and Type II Errors
REALITY of
PREGNANCY
TEST RESULTS
YES NO
“PREGNANT”
(Reject Null)
HIT
(Pregnant & “+” on test)
FALSE ALARM (Type I)
Also called False Positive
(Not Pregnant & “+”)
“NOT PREGNANT”
(Fail to reject the Null)
Miss (Type II)
Also called False Negative
(Pregnant & “-”)
Correct Rejection
(Not Pregnant & “-”)
![Page 10: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/10.jpg)
The End
![Page 11: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/11.jpg)
Statistics in Correlations & Experiments
• Correlations measure Relationship– Strength and direction of relatioship
• Experiments measure the Differences– Statistical significance of the difference
![Page 12: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/12.jpg)
Correlation: Measuring Relationship
• Sir Francis Galton (Uncle to Darwin– Development of behavioral statistics– Father of Eugenics– Science of fingerprints as unique– Retrospective IQ of 200– Drove himself mad just to prove
you could do it– Invented the pocket
![Page 13: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/13.jpg)
13
2.3 The Science of Explanation
• Measuring correlation– more-more/less-less– more-less/less-more
• Correlation coefficient – measure of direction & strength– r = 1– r = -1– r = 0
![Page 14: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/14.jpg)
14
Correlation
• What does correlation coefficient mean?
![Page 15: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/15.jpg)
![Page 16: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/16.jpg)
![Page 17: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/17.jpg)
17
2.3 The Science of Explanation
• Experiment—2 critical features• (1) Manipulation
– independent variable – dependent variable—measured– Control Group Condition (or Variable)– Experimental Group Condition (or Variable)
• (2) Randomization - controls for a 3rd variable (you know exists but are not
interested in)– versus self-selection
![Page 18: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/18.jpg)
Dependent VariablesWithout Demand Charcteristics
• DVs that aren’t subject to biased responses• Examples:– Is a painting in a museum popular?• There will be increased wear on the carpet near it.– Did a dental flossing lecture work?• Students will have cleaner teeth the next day.– Did a safer sex intervention for commercial sexworkers work?• There will be more condoms discarded in the park they work in.
![Page 19: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/19.jpg)
Variation in IV Causes Variation in DV
1. Cause → Effect: whenever IV occurs, outcome DV should result.
Safe sex intervention Condoms in Park
2. Cause absent → Effect absentNo SS intervention no condoms
3. Cause variation → Effect variationMore or better interventions more condoms in park
![Page 20: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/20.jpg)
Experimental & Control Groups• Experimental
Condition: Cause is valid– E.g., drug, alcohol
• Control Condition: cause is invalid– Placebo, juice
• Essence of experiment is to control conditions beforehand
![Page 21: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/21.jpg)
21
The Science of Observation
• Validity—able to draw accurate inferences– construct validity: e.g., describing what intelligence is
and is not, “construct” refers to the “theory”– predictive validity: over time you find X predicts Y
• Reliability—same result each time?
- Test/Re-Test
- Parallel
- Inter-Item
![Page 22: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/22.jpg)
Statistical Significance
• A finding is statistically significant if the data differ from what we would expect from chance alone, if there were, in fact, no actual difference.
• They may not be significant in the sense of big, important differences, but they occurred with a probability below the critical cutoff value, usually a z-score or p < .05
• Reject or Fail to Reject the NULL Hypothesis
![Page 23: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/23.jpg)
Graphing Frequency
Discrete: Histogram Continuous: Frequency Polygon
![Page 24: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/24.jpg)
Stem-and-Leaf: Exam 1 & 3
Selection of ranges & bins like Histogram, but usually simpler.
These plots represent the scores on an exam given to two different sections for the same course.
![Page 25: Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.](https://reader036.fdocuments.in/reader036/viewer/2022062712/56649cb15503460f949766b7/html5/thumbnails/25.jpg)