Interpreting and Generalizing your Results
description
Transcript of Interpreting and Generalizing your Results
![Page 1: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/1.jpg)
Interpreting and Generalizing your Results
Psych 231: Research Methods in Psychology
![Page 2: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/2.jpg)
Announcements
This week in labs: POSTER SESSIONS Jen has final papers available at her office
hours (not in class today) Amanda’s may be done by labs this week
![Page 3: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/3.jpg)
Research Results
Goal of Research– Experiments:
• To establish a cause and effect relationship between independent and dependent variables
– Correlational studies• To determine potential relationships between different
variables
![Page 4: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/4.jpg)
Interpretation of your results
Statistical significance– Tell us if differences or (relationships with
correlations) go beyond what we’d expect by chance
– Don’t tell us anything about what the result really means in theoretical terms
![Page 5: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/5.jpg)
Interpretation of your results
Theoretical Significance– Return to your theory(ies)
• Reject them? • Support (not prove) them?• Revise them?
– What are the limitations of your interpretations?• Are there alternative theories still to test?
– Yes, there are always going to be alternatives (not always good ones)
• Do your results generalize well?
![Page 6: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/6.jpg)
Generalizing results External validity revisited
– What limits/constraints were imposed because of:• the use of experimental control• availability of resources
– Participant factors (who did you test?)• Volunteers • College students• Sex• Culture
– Location/setting factors (where did you test?)• College• Region• Laboratory
![Page 7: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/7.jpg)
Generalizing results– Experimenter factors
• Personality, sex, experience as experiementer
– Experimental items• Do the results only apply to the stimuli that you used, or would
they extend to others– E.g., memory for:
» cat, dog, truck, car, … all concrete objects– Would the same pattern of results be seen for:
» call, dig, truth, cut, … more abstract concepts» cath, dob, trush, caf, … all non words
![Page 8: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/8.jpg)
Threats to external validity as interactions
Generalization as interactions– Does your theory (or anyone else’s) predict an
interaction?– If you collect the appropriate data/controls, you
can do some statistical tests
![Page 9: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/9.jpg)
In defense of college students
Convenient? – Yes, but not because researchers are lazy– Researchers do have limited resources
Criticisms about generalizability need to be backed up with theory and/or data
College students are after all humans Replications with other samples provide a safegaurd
against limited generalizability
![Page 10: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/10.jpg)
Replications Importance of replications
– Demonstrate that the results weren’t a “one time” thing
• Single failure to replicate - don’t panic• Repeated failure to replicate - original results probably
wrong (maybe a Type I error)
![Page 11: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/11.jpg)
Replications Types of replications
– Exact replications• Replication of the research as precisely as possible
– Conceptual replications• Same independent variables, but measured in a
different way– Same conceptual variables, different operational variables
![Page 12: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/12.jpg)
Increasing External Validity Aggregation
– Grouping together data• Over participants• Over stimuli or situations• Over trials or occasions• Over measures (converging operations)
![Page 13: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/13.jpg)
Increasing External Validity Non-reactive measurements
– Unobtrusive measures• Observation without participant awareness
– Naturalistic observation• To validate experimental findings
– Field experiments• Experimentation outside of the lab
![Page 14: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/14.jpg)
Example
Results from Lab studies– Self awareness reduces likelihood of people
engaging in socially undersirable behaviors (e.g., cheating or lying)
![Page 15: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/15.jpg)
Beaman, Klentz, Diener, & Sanum (1979)
![Page 16: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/16.jpg)
“Hi, what’s your name?”
“Hi, what are you dressed as?”
![Page 17: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/17.jpg)
![Page 18: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/18.jpg)
Please take only one piece of candy
![Page 19: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/19.jpg)
![Page 20: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/20.jpg)
![Page 21: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/21.jpg)
The big picture
Generalizing your to the outside world– The bottom of the hourglass– How do these results impact …– Not always stated in the report– But, should always be in the back of your mind.
• why are you doing the research? • why is it important? • who will benefit from this research?
![Page 22: Interpreting and Generalizing your Results](https://reader036.fdocuments.in/reader036/viewer/2022062309/56814883550346895db596bb/html5/thumbnails/22.jpg)
Next time
Review of course