Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8:...
Transcript of Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8:...
![Page 1: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/1.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Topic 8: Multivariate Analysis of Variance(MANOVA)
Ying Li
Stockholm University
October 15, 2012
1/30
![Page 2: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/2.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Definition
Def.
MANOVA is used to determine if the categorical independentvariable(s) with two or more levels affect the continues dependentvariables.
• independent variables: categorical
• dependent variables: continues
2/30
![Page 3: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/3.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Geometry of MANOVA
Geometry view of ANOVA
Figure: One dep. variables and one indep. variable
3/30
![Page 4: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/4.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Geometry of MANOVA
Geometry view of MANOVA
Figure: Twp dep. variables and one indep. variable
The greater distance between the two centroid, the greater thedifference between the two groups.
4/30
![Page 5: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/5.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Geometry of MANOVA
Geometry view of MANOVA
Figure: Twp dep. variables and one indep. variable
The greater distance between the two centroid, the greater thedifference between the two groups.
4/30
![Page 6: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/6.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Geometry of MANOVA
Mahalanobis distance (MD)
For aT : (x1, y1) and bT : (x2, y2), the square MD distance isdefined as
MD2 =1
1− r2[(x1 − x2)2
s2x+
(y1 − y2)2
s2y− 2r(x1 − x2)(y1 − y2)
sxsy]
with s2x = var(x), s2y = var(y), r = corr(x, y).
Or in matrixform:
MD2 = (a-b)S−1w (a-b)′
with Sw is the pooled within group covariance between x and y.
5/30
![Page 7: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/7.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Geometry of MANOVA
Mahalanobis distance (MD)
For aT : (x1, y1) and bT : (x2, y2), the square MD distance isdefined as
MD2 =1
1− r2[(x1 − x2)2
s2x+
(y1 − y2)2
s2y− 2r(x1 − x2)(y1 − y2)
sxsy]
with s2x = var(x), s2y = var(y), r = corr(x, y). Or in matrixform:
MD2 = (a-b)S−1w (a-b)′
with Sw is the pooled within group covariance between x and y.
5/30
![Page 8: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/8.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Geometry of MANOVA
6/30
![Page 9: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/9.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Geometry of MANOVA
• Statistical test are available to determine if MD between thetwo centroid is large.
• Geometrically, MANOVA is concerned with determiningwhether the MD between the group centroids is significantlygreater than 0.
7/30
![Page 10: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/10.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Two-group MANOVA
Significance test
• p = 2: two dep. variables y1 y2• G = 2: two groups (two levels)
Hypothesis Test:
H0 :
(µ11µ21
)=
(µ12µ22
)
H1 :
(µ11µ21
)6=(µ12µ22
)where µij : ith variable for jth group.
8/30
![Page 11: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/11.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Two-group MANOVA
Significance test
• p = 2: two dep. variables y1 y2• G = 2: two groups (two levels)
Hypothesis Test:
H0 :
(µ11µ21
)=
(µ12µ22
)
H1 :
(µ11µ21
)6=(µ12µ22
)where µij : ith variable for jth group.
8/30
![Page 12: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/12.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Two-group MANOVA
Significance test
Some statistics connect with MD distance
• Hotelling’s T 2:
T 2 =n1 × n2n1 + n2
MD2
•
F =(n1 + n2 − p− 1)
(n1 + n2 − p)pT 2 ∼ Fp,(n1+n2−p−1)
9/30
![Page 13: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/13.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Two-group MANOVA
Significance test
Some statistics connect with SSCPb/SSCPw
Wilk’s Λ: Λ = |SSCPw||SSCPt| =
∑Gi=1
11+λi
F = (Λ
1− Λ)(n1 + n2 − p− 1
p) ∼ Fp,(n1+n2−p−1)
Pillas’s Trace=∑G
i=1λi
1+λi
Hotelling’s Trace=∑G
i=1 λi
Roy’s largest Root = λmax1+λmax
Note: it can be shown that for the two groups all the abovemeasure are equivalent and can be transformed to T 2 or an F ratio
10/30
![Page 14: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/14.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Two-group MANOVA
Significance test
Some statistics connect with SSCPb/SSCPw
Wilk’s Λ: Λ = |SSCPw||SSCPt| =
∑Gi=1
11+λi
F = (Λ
1− Λ)(n1 + n2 − p− 1
p) ∼ Fp,(n1+n2−p−1)
Pillas’s Trace=∑G
i=1λi
1+λi
Hotelling’s Trace=∑G
i=1 λi
Roy’s largest Root = λmax1+λmax
Note: it can be shown that for the two groups all the abovemeasure are equivalent and can be transformed to T 2 or an F ratio
10/30
![Page 15: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/15.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Two-group MANOVA
Significance test
Some statistics connect with SSCPb/SSCPw
Wilk’s Λ: Λ = |SSCPw||SSCPt| =
∑Gi=1
11+λi
F = (Λ
1− Λ)(n1 + n2 − p− 1
p) ∼ Fp,(n1+n2−p−1)
Pillas’s Trace=∑G
i=1λi
1+λi
Hotelling’s Trace=∑G
i=1 λi
Roy’s largest Root = λmax1+λmax
Note: it can be shown that for the two groups all the abovemeasure are equivalent and can be transformed to T 2 or an F ratio
10/30
![Page 16: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/16.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Two-group MANOVA
Significance test
Some statistics connect with SSCPb/SSCPw
Wilk’s Λ: Λ = |SSCPw||SSCPt| =
∑Gi=1
11+λi
F = (Λ
1− Λ)(n1 + n2 − p− 1
p) ∼ Fp,(n1+n2−p−1)
Pillas’s Trace=∑G
i=1λi
1+λi
Hotelling’s Trace=∑G
i=1 λi
Roy’s largest Root = λmax1+λmax
Note: it can be shown that for the two groups all the abovemeasure are equivalent and can be transformed to T 2 or an F ratio
10/30
![Page 17: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/17.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Two-group MANOVA
Significance test
Having determined that the means of the two groups aresignificantly different.
The next obvious question is: which variables are responsiblefor the difference between the two groups?
To compare the means of each variable for the two groups:T-test.
11/30
![Page 18: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/18.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Two-group MANOVA
Significance test
Having determined that the means of the two groups aresignificantly different.
The next obvious question is: which variables are responsiblefor the difference between the two groups?
To compare the means of each variable for the two groups:T-test.
11/30
![Page 19: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/19.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Two-group MANOVA
Significance test
Having determined that the means of the two groups aresignificantly different.
The next obvious question is: which variables are responsiblefor the difference between the two groups?
To compare the means of each variable for the two groups:T-test.
11/30
![Page 20: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/20.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Two-group MANOVA
Effect size
Effect size can be used to assess the practical significance of thedifference between the groups.Measures:
MD2.
partial eta square (PES)
Λ =SSbSSt
=F × dfb
F × dfb + dfw
12/30
![Page 21: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/21.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Two-group MANOVA
Problem
Example
Group1 x_11 x_21 Group2 x_12 x_22
1 0.158 0.182 13 -0.012 -0.031
2 0.210 0.206 14 0.036 0.053
3 0.207 0.188 15 0.038 0.036
4 0.280 0.236 16 -0.063 -0.074
5 0.197 0.193 17 -0.054 -0.119
6 0.227 0.173 18 0.000 -0.005
7 0.148 0.196 19 0.005 0.039
8 0.254 0.212 20 0.091 0.122
9 0.079 0.147 21 -0.036 -0.072
10 0.149 0.128 22 0.045 0.064
11 0.200 0.150 23 -0.026 -0.024
12 0.187 0.191 24 0.016 0.026
13/30
![Page 22: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/22.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Two-group MANOVA
Problem
x̄1′ = (0.191, 0.184), n1 = 12x̄2′ = (0.003, 0.001), n2 = 12
SSCPt =
(0.265 0.2500.250 0.261
)SSCP1 =
(0.031 0.0120.012 0.010
)SSCP2 =
(0.022 0.0320.032 0.051
)
14/30
![Page 23: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/23.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Multiple-Group MANOVA
p ≥ 2: no. of dep. variables
G ≥ 3: no. of groups
15/30
![Page 24: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/24.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Example
Suppose a medial researcher hypothesizes that a treatmentconsisting of the simultaneous administration of two drugs is moreeffective than a treatment consisting of the administration of onlyone of the drugs.A study is designed in which 20 subjects are randomly divided into4 groups of 5 subjects each.
16/30
![Page 25: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/25.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Group1: subjects are given a placebo.
Group2: subjects are given a combination of two drugs
Group3: subjects are given one of two drugs
Group4: subjects are given the other drug
The effectiveness of the drugs is measured by two responsevariables Y1 and Y2
17/30
![Page 26: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/26.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Multivariate and Univariate Test
Multivariate Test
18/30
![Page 27: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/27.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Multivariate and Univariate Test
Univariate Test
19/30
![Page 28: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/28.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Contrast
Contrast
A contrast is a linear combination of the group means of a givenfactor.
Cij = ci1µ1j + ci2µ2j + · · ·+ ciGµGj
with Cij : ith contrast, jth variable; cik : the coefficients of thecontrast, µkj : the means of the kth group for the jth variable.
Note: It’s a good statistical practice to perform contrast analysisdetermined or stated as a prior, rather than test all possiblecontrasts in search of significant test.
20/30
![Page 29: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/29.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Contrast
Contrast
A contrast is a linear combination of the group means of a givenfactor.
Cij = ci1µ1j + ci2µ2j + · · ·+ ciGµGj
with Cij : ith contrast, jth variable; cik : the coefficients of thecontrast, µkj : the means of the kth group for the jth variable.
Note: It’s a good statistical practice to perform contrast analysisdetermined or stated as a prior, rather than test all possiblecontrasts in search of significant test.
20/30
![Page 30: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/30.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Contrast
Example
The researcher is interested in answering the following questions:
Is the effectiveness of the placebo different from the averageeffectiveness of the drugs given to the other three groups?
Is the effectiveness of the two drugs administered to thesecond treatment group significantly different from theaverage effectiveness of the drugs administered to treatmentgroups 3 and 4?
Is the effectiveness of the drug given to the third treatmentgroup significantly different from the effectiveness of the druggiven to to fourth treatment group?
21/30
![Page 31: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/31.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Contrast
Example
The researcher is interested in answering the following questions:
Is the effectiveness of the placebo different from the averageeffectiveness of the drugs given to the other three groups?
Is the effectiveness of the two drugs administered to thesecond treatment group significantly different from theaverage effectiveness of the drugs administered to treatmentgroups 3 and 4?
Is the effectiveness of the drug given to the third treatmentgroup significantly different from the effectiveness of the druggiven to to fourth treatment group?
21/30
![Page 32: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/32.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Contrast
Example
The researcher is interested in answering the following questions:
Is the effectiveness of the placebo different from the averageeffectiveness of the drugs given to the other three groups?
Is the effectiveness of the two drugs administered to thesecond treatment group significantly different from theaverage effectiveness of the drugs administered to treatmentgroups 3 and 4?
Is the effectiveness of the drug given to the third treatmentgroup significantly different from the effectiveness of the druggiven to to fourth treatment group?
21/30
![Page 33: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/33.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Contrast
Orthogonal Contrast
Contrasts are said to be orthogonal if∑Gi=1 cik = 0 for all i.∑Gi=1
cikclknk
for all i 6= l
where i and l are any two contrasts.
Note:
The total no. of contrasts for any given factor is equal to itsdegree of freedom.
There can be infinite sets of contrast with each set consistingof maximum number of allowable contrasts
22/30
![Page 34: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/34.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Contrast
Orthogonal Contrast
Contrasts are said to be orthogonal if∑Gi=1 cik = 0 for all i.∑Gi=1
cikclknk
for all i 6= l
where i and l are any two contrasts.Note:
The total no. of contrasts for any given factor is equal to itsdegree of freedom.
There can be infinite sets of contrast with each set consistingof maximum number of allowable contrasts
22/30
![Page 35: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/35.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Contrast
23/30
![Page 36: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/36.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Contrast
Univariate significant test for the contrast
Hypothesis Testing:H0 : Cij = 0
H1 : Cij ≥ 0
var(Cij) = MSEj
G∑k=1
c2ik/nk
24/30
![Page 37: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/37.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Contrast
Univariate significant test for the contrast
Hypothesis Testing:H0 : Cij = 0
H1 : Cij ≥ 0
var(Cij) = MSEj
G∑k=1
c2ik/nk
24/30
![Page 38: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/38.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Contrast
Statistics
t =Cij√
MSEj∑G
k=1 c2ik/nk
or
T 2 = t2 =C2ij
MSEj∑G
k=1 c2ik/nk
= (
G∑k=1
c2iknk
)−1CijMSE−1j Cij
In univariate case, T 2 is equal to F-ratio
F =C2ij/(∑G
k=1 c2ik/nk)
MSEj∼ F (1, n−G)
25/30
![Page 39: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/39.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Contrast
Multivariate Significance Test for the Contrasts
Multivariate contrasts are used to simultaneously test for theeffects of all the dependent variables.
Multivariate contrasts
Ci = ci1µ1 + ci2µ2 + ·+ ciGµG
where µk is a vector of means for the kth group and Ci is the ithcontrast vector.
Hypothesis Testing: H0 : Ci = 0 H1 : Ci ≥ 0
26/30
![Page 40: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/40.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Contrast
Test Statistics is
T 2 = (
G∑k=1
c2iknk
)−1C′iΣ̂w−1
Ci
where Σ̂w is pooled within-group covariance matrix. T 2 can betransformed into F -ratio using:
F = (dfe − p+ 1
dfe × p)T 2 ∼ F (p, dfe − p+ 1)
with dfe is the error degrees of freedom.
27/30
![Page 41: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/41.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Contrast
Note:The univariate contrasts should only be interpreted if thecorresponding multivariate contrast is significant.
28/30
![Page 42: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/42.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Contrast
Example
µ1 = (2, 2), µ2 = (8, 9), µ3 = (3, 4), µ4 = (4, 5)
n1 = n2 = n3 = n4 = 5
Σ̂w =
(0.625 0.4380.438 1.5
)
29/30
![Page 43: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/43.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Contrast
Question: What’s the similarities and difference between MANOVAand DA?
One of the objectives in both methods is to determine if thegroups are significantly different with respect to a given set ofvariables.
One of the objective of MANOVA is to test which groups aredifferent with respect to a given set of variables, which is notthe objective of DA.
30/30
![Page 44: Topic 8: Multivariate Analysis of Variance (MANOVA)gauss.stat.su.se/gu/mm/F9_M.pdf · Topic 8: Multivariate Analysis of Variance (MANOVA) Multiple-Group MANOVA Contrast Contrast A](https://reader031.fdocuments.in/reader031/viewer/2022020105/5ca72e6088c99397078b86ab/html5/thumbnails/44.jpg)
Topic 8: Multivariate Analysis of Variance (MANOVA)
Multiple-Group MANOVA
Contrast
Question: What’s the similarities and difference between MANOVAand DA?
One of the objectives in both methods is to determine if thegroups are significantly different with respect to a given set ofvariables.
One of the objective of MANOVA is to test which groups aredifferent with respect to a given set of variables, which is notthe objective of DA.
30/30