EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam...
-
Upload
shauna-ward -
Category
Documents
-
view
218 -
download
2
Transcript of EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam...
![Page 1: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/1.jpg)
EMiLExperimental Methods in Linguistics
Halszka Bąk
& Rafał Jończyk
Faculty of English, Adam Mickiewicz University
yellow black
worp vs warp
![Page 2: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/2.jpg)
Research origins
![Page 3: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/3.jpg)
Linguistics: magpie research methods.
Psycholinguistics: psychology.
Neurolinguistics: psychology and neuroscience.
![Page 4: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/4.jpg)
Experimental tasks
![Page 5: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/5.jpg)
Lexical Decision task
CatLafilAim: ortography and semantic processing
Presentation duration: 20ms, 150ms, 200ms, 250ms?
Stimuli placement: centre of the screen? Periphery?
depends on your goals!
?
![Page 6: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/6.jpg)
Semantic Decision task
DoctorHospital?DoctorRose?
The coffee was too hot to… DRINK
The coffee was too hot to…EAT
AIM: Processing of meaning/semantics
![Page 7: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/7.jpg)
Word/Picture naming task
![Page 8: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/8.jpg)
![Page 9: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/9.jpg)
![Page 10: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/10.jpg)
![Page 11: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/11.jpg)
![Page 12: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/12.jpg)
![Page 13: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/13.jpg)
![Page 14: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/14.jpg)
![Page 15: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/15.jpg)
Stroop task
RedBlueGreenAim: investigating interference in the RTs of a task; conflict between word meaning and its colour
Emotional Stroop task: captures attention and RTs to emotional vs non-emotional stimuli
Name the colour:death vs idea
![Page 16: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/16.jpg)
Discrimination task
Which face is more happy?
Failla et al. 2003
![Page 17: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/17.jpg)
Dichotic listening task
Aim:
1. selective attention;
2. hemispheric lateralization of sounds and perception
![Page 18: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/18.jpg)
Free-word recall
![Page 19: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/19.jpg)
Word recognition
Dog leaf
yellow leaflet
punk green
cat skin
dead ideal
PNJA death
nurse hospital
workshop doctor
house stick
dog leaf
yellow leaflet
punk green
cat skin
dead ideal
PNJA death
nurse hospital
workshop doctor
house stick
![Page 20: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/20.jpg)
Task 1
tasksheet, page 2 & 3
![Page 21: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/21.jpg)
Types of data &
methods of interpretation
![Page 22: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/22.jpg)
Quantitative data
Reaction/Response Times (RTs):
measured in miliseconds (ms)
influenced by: priming, emotional states, attention, etc.
![Page 23: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/23.jpg)
Quantitative data
Accuracy rates (ACC) or Error rates (ER):
measured in 1s (correct) and 0s (incorrect)
influenced by: bilingualism, fallacies, cognitivedeficits, etc.
![Page 24: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/24.jpg)
Qualitative data
Facial expression
Prosody (speech contour)
Gestures
Body language
Etc.
![Page 25: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/25.jpg)
Physiological data
Galvanic Skin Response (GSR; also Skin Conductance Response (SCRs))Measures skin conductivity in microSiemens (mS)
influenced by: stimulus modality, intensity, etc.
![Page 26: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/26.jpg)
Physiological data
Heart rate (HR)
measured in beats per minute (BPM)
influenced by: stimuli intensity, participant’s health, etc.
![Page 27: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/27.jpg)
Physiological data
EEG: Event-Related Potentials (ERPs):
measured in microVolts / sec
unrivalled temporal rsolution
![Page 28: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/28.jpg)
Physiological Data
Functional Magnetic Resonance Imaging (fMRI):
blood / water diffusion moleculesmeasured in voxels
great spatial resolution
poor temporal resolution
![Page 29: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/29.jpg)
!!!
Your HYPOTHESES determine what TYPES OF DATA you will COLLECT
![Page 30: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/30.jpg)
Task 2
tasksheet, page 3
![Page 31: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/31.jpg)
Research Questions & Hypotheses
![Page 32: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/32.jpg)
Research question
frames a problem to be addressed & resolved in research
![Page 33: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/33.jpg)
Hypothesis
A prediction about a relationship between
Two (or more) variables
![Page 34: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/34.jpg)
A solid hypothesis is…
...TESTABLE
confirm or falsify the hypothesis
…SUPPORTABLE
provide empirical evidence to confirm/falsify the hypothesis
…GROUNDED
ground your hypothesis in theory/previous research
…RELEVANT
fill a gap in the research, resolve inconsistency, etc.
![Page 35: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/35.jpg)
Special case…
…NULL HYPOTHESIS - Nº
No relationship between the variables
It is always there
fail to reject Nº = cannot draw conclusions from your research
![Page 36: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/36.jpg)
Task 3
tasksheet, page 4
![Page 37: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/37.jpg)
Variables
![Page 38: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/38.jpg)
A variable is…?
…something that changes or varies
e.g. among people (IQ, gender, etc.)
![Page 39: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/39.jpg)
Independent variable
the aspect you manipulate to influence the end results
e.g. instruction, types of stimuli, types of participants
priming, etc.
What is the cause of a given phenomenon?
the cause = independent variable
![Page 40: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/40.jpg)
Dependent variable
the end result (hard data)
e.g. RTs, ACC, ER, ERPs, etc.
e.g. the amount of time you choose to spend doing grammar exercises determines your final score on the PNJA exam in June ;)
![Page 41: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/41.jpg)
summing up
HYPOTHESIS: Positive sentence context makes processing of positive words faster and more accurate.
PREDICTION: faster & more accurate processing of ”+” WORDS in ”+” SENTENCE context.
INDEPENDENT VARIABLE: sentence context, word valence.
DEPENDENT VARIABLE: RTs, ACC/ER
TYPE OF RELATIONSHIP: ”+” SENTENCE causes smaller RTs and greater ACC in responses to ”+”WORDS.
![Page 42: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/42.jpg)
Task 4
tasksheet, page 4
![Page 43: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/43.jpg)
Experimental Design
![Page 44: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/44.jpg)
The simple experiment
1. Define hypothesis
2. Specify and define variables.
3. Participants: experimental vs. control groups.
4. Random assignment of participants to groups
5. Collect dependent variable
6. No significant result – no effect, no interpretation
if you cannot randomly assign participants to your different groups, you cannot do a simple
experiment
![Page 45: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/45.jpg)
2 x 2 design
2 independent variables & 2 levels of each variable
(positive; negative) x (congruent; incongruent)
Gloria accidentally poured boiling water over herself and was BURNT / ROMANTIC*
Their honeymoon in the gorgeous scenery of Paris was very ROMANTIC / BURNT*
![Page 46: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/46.jpg)
Reliability & Validity
![Page 47: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/47.jpg)
Validity
Internal
External
Ecological
![Page 48: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/48.jpg)
Internal validity
A B
Your data reflects the reality under investigation:
independent variables and their manipulation
![Page 49: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/49.jpg)
Threats to internal validity
1. Testing: pre-tests may cause biases
2. Instrumentation: pre- and post-tests must match
3. Regression: biased participant selection
4. Confounding variable:
not properly controlled, manipulated or unnoticed
![Page 50: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/50.jpg)
External validity
Results can be generalized to the wider population
![Page 51: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/51.jpg)
Threats to external validity
1. Participant selection: atypical population sample
2. Setting: the context
3. History: a specific historical context
4. Construct effect: a particular construct exists in one group but not in others
![Page 52: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/52.jpg)
Ecological validity
Experiment conducted in an environment
& in circumstances most similar to or exact to a real-life
situation
![Page 53: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/53.jpg)
Reliability
A reliable experiment can be reliably replicated yielding the same results
![Page 54: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/54.jpg)
Task 5
tasksheet, page 5
![Page 55: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/55.jpg)
Errors & biases
![Page 56: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/56.jpg)
Errors
Murphy’s law: Anything that can go wrong will go wrong
Type 1 error:
You’ve done everything right. Got a significant result. The result is statistically a chance accident.
Type 2 error: You’ve done everything right. DID NOT GET A SIGNIFICANT RESULT. The lack of result is statistically a chance accident.
![Page 57: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/57.jpg)
Demons you can fight:Random errors & biases
Everything done right.
No risk of Type1 or Type 2 error…
Still…the result is WRONG
The result is a chance accident due to a randomly occuring external factor…
![Page 58: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/58.jpg)
This is why you need reliable and replicable experiments!
![Page 59: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/59.jpg)
Solution?
Fight! Increase the number of participants
(random error tends to balance out to zero)!
![Page 60: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/60.jpg)
Biases
2 major offenders, 1 major circumstance
![Page 61: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/61.jpg)
Offender 1
Researcher:
”I’m going to get what I expect & publish it in SCIENCE!”
“It is remarkable how often the first interpretations of new evidence have confirmed the preconceptions of its discoverer."
(John Reader. 2011. Missing Links. Oxford University Press)
![Page 62: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/62.jpg)
Offender 2
Participant A:
”I’ll make you look good/bad!” (obeying demand characteristics)
Participant B:
”I’ll make myself look good!” (social desirability bias)
![Page 63: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/63.jpg)
Non-mitigating Circumstance 1
Day 1:
You’re taking part in an important experiment…
Day 2:
So yeah… this… this thing yeah it’s for my thesis and um…
(Check out Mitchell and Jolley. 2010. Research Design Explained. Seventh edition. Pages 129-143)
![Page 64: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/64.jpg)
Task 6
tasksheet, page 1 & 2
![Page 65: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/65.jpg)
Cause and effect in experimental research
(correlation vs. experimentation)
![Page 66: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/66.jpg)
“Correlation does not imply causation”
Correlation Experiments
Reality observed and measuredmanipulated and measured
Fallaciescum hoc ergo propter hoc(no causality implied in correlated observations)
post hoc ergo propter hoc (when internal validity is poor)
Validity Ecological Internal & external
![Page 67: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/67.jpg)
Task 7
tasksheet, page 6
![Page 68: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/68.jpg)
Original research vs.
Replicating experiments.
![Page 69: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/69.jpg)
Original Replication
Point of origin Theory Existing research
ApproachTheory-based, practically creative
Data-driven, practically repetitive
MethodsSelect from all available and viable
Only choose the one used in the study being replicated
Modifications Compromise validityIncrease validity provided that control group is included!
![Page 70: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/70.jpg)
Stimuli & Participantselection
![Page 71: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/71.jpg)
Participants
Ideal case:
a large randomly selected sample from a homogenous population.
Typical case for MA/BA: a minimally valid, inherently somewhat biased sample
Remedy:
a careful selection of hypothesis, inclusion of relevant control pre- and post-tests.
![Page 72: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/72.jpg)
StimuliA happy case:
stimuli exist, have been validated in a thorough and correct validation procedure, and they are available.
An unhappy reality:
a norming study is an absolute, inevitable MUST.
An unhappier reality still: you must create, validate, and norm your own stimuli.
Remedy:
Meta-analyses of existing research (more later), start early.
![Page 73: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/73.jpg)
The experimenter’s conduct
![Page 74: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/74.jpg)
Beware!
Biases
Errors
Self-presentation
Self-care
![Page 75: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/75.jpg)
Ethical considerations
![Page 76: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/76.jpg)
Human Subject Research(HSR)
Linguistic research is a case of HSR.
Seek permissions to proceed with Internal Review Boards (IRBs) and Ethical Committees.
PhD and senior staff:
strongly advised to take a basic HSR course. E.g. CITI course (http://www.citiprogram.org)
![Page 77: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/77.jpg)
Rule of thumb
Don’t hurt people. Emotionally, psychologically, physically.
![Page 78: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/78.jpg)
Tools & Resources
![Page 79: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/79.jpg)
Meta-analytical tables
ask a single study design question, and search through the top-cited papers in the field to see how others have “done it”.
Example:
Question: How many participants should I use?
Literature: Find top-cited 30-50 papers from the past 10 years on the subject.
Table: Bibliography note, participants number, relevant participant variables.
What to do: abstract > introduction (skim) > methods > participants
Result: Overview of the typical number and type of participant in your discipline.
![Page 80: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/80.jpg)
Existing resources
Affective Sciences databases: SEMAINE, BINED, ILHAIRE, SAVEE, ANEW, IADS, IAPS, etc.
Online corpora: COCA, BNL.
Online services: instant.ly, Monkey Surveys, Google Docs, etc.
Existing experiments for replication: e.g. Englelab (http://www.englelab.gatech.edu).
Linguistlist: http://linguistlist.org/
![Page 81: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/81.jpg)
Courses
Coursera: Free of charge.
MIT courses: Free of charge (Coursera, Edx)
CITI courses: Standard Fee 100$. Requirements: Affiliation with a US Institution (https://www.citiprogram.org/)
![Page 82: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/82.jpg)
Bibliography
Field, Andy. 2009. Discovering statistics using SPSS (and sex and drugs and rock’n’roll). Third edition. London: SAGE.
Mitchell, Mark L. and Janina M. Jolley. 2010. Research Design Explained. Seventh edition. Belmont: Wadsworth CENGAGE Learning.
![Page 83: EMiL Experimental Methods in Linguistics Halszka Bąk & Rafał Jończyk Faculty of English, Adam Mickiewicz University yellow black worp vs warp.](https://reader038.fdocuments.in/reader038/viewer/2022110207/56649d145503460f949e935e/html5/thumbnails/83.jpg)
Further recommended reading
Feynman, Richard. 1974. Cargo Cult Science. Caltech commencement address. (http://neurotheory.columbia.edu/~ken/cargo_cult.html) (Date of Access: 02.04.2014)
Feynman, Richard. 1985. Surely you’re joking, Mr. Feynman! Adventures of a curious character. New York: W. W. Norton.
Feynman, Richard. 1988. What do you care what other people think? Further adventures of a curious character. New York: W. W. Norton.
Sagan, Carl. 1995.The Demon-Haunted World: Science as a Candle in the Dark. New York: Random House.