Impaired speech perception in aphasic patients: event-related ...
Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from...
Transcript of Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from...
![Page 1: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/1.jpg)
Non-parametric Tests and some data from aphasic speakers
Vasiliki Koukoulioti
Seminar Methodology and Statistics 19th March 2008
![Page 2: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/2.jpg)
Some facts about non-parametric tests
• When to use non-parametric tests?• What do they measure?• What assumptions do they make?
![Page 3: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/3.jpg)
When to use non-parametric tests?
• When the normality conditions are not met (Moore & McCabe)When the distribution of (at least) one variable
is not normalWhen the number of observations (N) is too
small to assess normality adequatelyWhen the distributions do not have the same
shape
![Page 4: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/4.jpg)
Compare:
![Page 5: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/5.jpg)
Compare:
![Page 6: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/6.jpg)
Moore & McCabe Chapter 14, 5th Edition
![Page 7: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/7.jpg)
What do non-parametric tests measure?
• Parametric tests make inferences about the mean of a sample
• When a distribution is strongly skewedthe center of the population is better represented by the median
Non-parametric tests make hypotheses about the median instead of the mean
![Page 8: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/8.jpg)
Recall:
• Mean µ=∑xi/n
• Median is the midpoint of a distribution, the number such that half the observations are smaller and the other half are larger.
Mean is more sensitive to outliers than the median
![Page 9: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/9.jpg)
![Page 10: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/10.jpg)
But:
• This is so only if the (two or more) distributions have the same shape (practically impossible)
• Actually non-p tests measure whether the values of one distribution are systematically different than the values of the other distribution
![Page 11: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/11.jpg)
Compare:
![Page 12: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/12.jpg)
Hypotheses with non-parametric tests
• One-tailed Hypothesis H0 The two distributions are the sameHa One distribution has values that are
systematically larger• Two-tailed HypothesisH0 The two distributions are the sameHa One distribution has values that are
systematically different (larger or smaller) than the other
![Page 13: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/13.jpg)
What assumptions do non-parametric tests make?
• They are NOT totally assumption-free tests
• The variables must be continuous They can take any possible value within a
given range(very often violated assumption!!!)
![Page 14: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/14.jpg)
Tests to be introduced:
• Wilcoxon Rank-Sum test (Mann-Whitney test)
• Wilcoxon Signed-Rank test• Friedman Anova (x2)
![Page 15: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/15.jpg)
Wilcoxon Rank-Sum test (Mann-Whitney test)-an example
Moore & Mc Cabe
We want to see if weeds have an influence on the amount of yields of corn
![Page 16: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/16.jpg)
Our Hypotheses:
H0 There is no difference in yields between plots with weed and weed free plots
Ha Plots with weed produce systematically fewer yields than weed-free plots
![Page 17: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/17.jpg)
How to perform Wilcoxon Rank Sum test by hand
1) Rank the values
![Page 18: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/18.jpg)
2) Keep track of which sample each value belongs to
![Page 19: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/19.jpg)
3) Sum the ranks for each sample
If H0 is true the sum of ranks for each sample should be exactly the same!
![Page 20: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/20.jpg)
The test statistic W
• W is the sum of the ranks of the one sample
• In this case the sum of ranks for corns with weeds is 23
![Page 21: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/21.jpg)
Moore & McCabe
![Page 22: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/22.jpg)
In this case:
![Page 23: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/23.jpg)
Is it significant?
• W=23 and µW=18, and σW=3.64 • W>µW but only 1.4 SDs [(23-18)/3.64] probably not significant difference We can calculate it
By the tables By the normal approximation (with continuity
correction!!)
![Page 24: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/24.jpg)
![Page 25: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/25.jpg)
Normal approximation-z-score
P(Z≥1.44)=1-0.9251=0.0749 from the tables of the normal curve
![Page 26: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/26.jpg)
Continuity correction!
• Continuity correction assumes that X=23 includes all the values from 22.5 to 23.5
• So here we will calculate the z-score of 22.5 since we want to find P(W≥23)
![Page 27: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/27.jpg)
The experimental design• 2 Groups non-fluent patients (N=3)healthy controls (N=4)• 4 conditions Indicative affirmative (24)Indicative negative (24)Subjunctive affirmative (24)Subjunctive negative (24)
![Page 28: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/28.jpg)
The Greek clause structure (Philippaki-Warburton, 1990;1998)
VP
VoiceP
TenseP
AgrP
FutP
NegP
AspectP
MoodPCP
![Page 29: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/29.jpg)
Wilcoxon Rank-Sum test (Mann-Whitney test)
• Comparison between 2 independent samples – 1 condition (Indicative affirmative)
H0 Both groups perform equallyHa Controls perform better than patients
![Page 30: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/30.jpg)
Data
23P322P222P124C424C324C224C1ScoreParticipant
![Page 31: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/31.jpg)
Distribution of the controls’scores
Boxplot Histogram
![Page 32: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/32.jpg)
Boxplot Histogram
Distribution of the patients’scores
Tests of Normality
,385 3 . ,750 3 ,000scoreStatistic df Sig. Statistic df Sig.
Kolmogorov-Smirnova Shapiro-Wilk
Lilliefors Significance Correctiona.
![Page 33: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/33.jpg)
Ranking
1 22 23 24 24 24 24 1 2 3 4 5 6 7
1.5 1.5
3 5.5 5.5 5.5 5.5
![Page 34: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/34.jpg)
• Because we have a lot of ties we must trust a statistics package!
• Ties influence the exact distribution of the W and the SD of the W must be adjusted
![Page 35: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/35.jpg)
Ranks
4 5,50 22,003 2,00 6,007
groupcontrolspatientsTotal
scoreN Mean Rank Sum of Ranks
Test Statisticsb
,0006,000
-2,366,018
,057a
,029,029,029
Mann-Whitney UWilcoxon WZAsymp. Sig. (2-tailed)Exact Sig. [2*(1-tailedSig.)]Exact Sig. (2-tailed)Exact Sig. (1-tailed)Point Probability
score
Not corrected for ties.a.
Grouping Variable: groupb.
We should accept the Ha that the control group performed systematically better than the patient group
![Page 36: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/36.jpg)
Friedman’s ANOVA
• We want to compare the performance of the aphasic speakers in the 4 condition
• 1 group k conditions• Hypotheses:H0 Patients perform equally in all 4
condition Ha There is a difference in the
performance of patients across conditions
![Page 37: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/37.jpg)
The data
4.54.59.511.5Sum of Ranks213.53.5102323P312341111822P21.51.53412121822P1s.n.s.a.i.n.i.a.s.n.s.a.i.n.i.a.
ranksscores
![Page 38: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/38.jpg)
The test statistic Fr
)1(3)1(
121
2 +−
+
= ∑=
kNRkNk
Fk
jjr
N= sample size, k=number of conditions, Rj=sum of ranks for each conditionP-value from tables of chi-square distribution
![Page 39: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/39.jpg)
Here we have
• Fr=7.6, p>0.05, we accept the H0
![Page 40: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/40.jpg)
Ranks
3,833,171,501,50
indicative affirmativeindicative negativesubjunctive affirmativesubjunctive negative
Mean Rank
We should accept the Ha that the perfromance of the patients is different across conditions
Test Statisticsa
38,143
3,043,021,014
NChi-SquaredfAsymp. Sig.Exact Sig.Point Probability
Friedman Testa.
![Page 41: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/41.jpg)
Post hoc
• There are differences but between which conditions and which direction do they have?
• Wilcoxon signed-rank test• Bonferroni correction (α-level/ number of
comparisons=0.05/6=0.008)
![Page 42: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/42.jpg)
Theory of Wilcoxon‘s sign rank test
03Total
excl02323P3
1.51.5+41822P2
1.51.5+41822P1
-+RanksignDiffi.n.i.a.
![Page 43: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/43.jpg)
![Page 44: Non-parametric Tests and some data from aphasic speakers · Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics ... Hypotheses](https://reader030.fdocuments.in/reader030/viewer/2022040523/5e86d10235c9cf425501a867/html5/thumbnails/44.jpg)
No difference could be found between conditions! Recall that Friedman‘s ANOVA was marginally significant!
Test Statisticsb
-1,414a
,157,500,250,250
ZAsymp. Sig. (2-tailed)Exact Sig. (2-tailed)Exact Sig. (1-tailed)Point Probability
indneg - indaff
Based on positive ranks.a.
Wilcoxon Signed Ranks Testb.
Test Statisticsb
-1,604a
,109,250,125,125
ZAsymp. Sig. (2-tailed)Exact Sig. (2-tailed)Exact Sig. (1-tailed)Point Probability
subjaff - indaff
Based on positive ranks.a.
Wilcoxon Signed Ranks Testb.
Test Statisticsb
-1,604a
,109,250,125,125
ZAsymp. Sig. (2-tailed)Exact Sig. (2-tailed)Exact Sig. (1-tailed)Point Probability
subjneg -indaff
Based on positive ranks.a.
Wilcoxon Signed Ranks Testb.
Test Statisticsb
-1,604a
,109,250,125,125
ZAsymp. Sig. (2-tailed)Exact Sig. (2-tailed)Exact Sig. (1-tailed)Point Probability
subjaff -indneg
Based on positive ranks.a.
Wilcoxon Signed Ranks Testb.
Test Statisticsb
-1,604a
,109,250,125,125
ZAsymp. Sig. (2-tailed)Exact Sig. (2-tailed)Exact Sig. (1-tailed)Point Probability
subjneg -indneg
Based on positive ranks.a.
Wilcoxon Signed Ranks Testb.
Test Statisticsb
-,447a
,6551,000,500,250
ZAsymp. Sig. (2-tailed)Exact Sig. (2-tailed)Exact Sig. (1-tailed)Point Probability
subjneg -subjaff
Based on positive ranks.a.
Wilcoxon Signed Ranks Testb.