Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.
-
Upload
coleen-wheeler -
Category
Documents
-
view
220 -
download
0
Transcript of Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.
![Page 1: Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.](https://reader031.fdocuments.in/reader031/viewer/2022032006/56649f075503460f94c1cac4/html5/thumbnails/1.jpg)
Multilevel Modeling Software
Wayne Osgood
Crime, Law & Justice Program
Department of Sociology
![Page 2: Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.](https://reader031.fdocuments.in/reader031/viewer/2022032006/56649f075503460f94c1cac4/html5/thumbnails/2.jpg)
What I’ll Cover
• What are multi-level models?
• Varieties of multi-level models
• Program features
• Descriptions of seven programs
• For more info:– Reviews by U of Bristol Center for Multilevel
Modeling:
http://www.mlwin.com/softrev/index.html
![Page 3: Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.](https://reader031.fdocuments.in/reader031/viewer/2022032006/56649f075503460f94c1cac4/html5/thumbnails/3.jpg)
What are multi-level models?
• Multi-level data: nesting• The statistical problem: dependence• The basic model
![Page 4: Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.](https://reader031.fdocuments.in/reader031/viewer/2022032006/56649f075503460f94c1cac4/html5/thumbnails/4.jpg)
The Basic Multilevel Model
• Hierarchical notation
• Composite/Mixed Model Notation
jjj
jjj
ijijjjij
uZ
uZ
rXY
111101
001000
10
ijijjjijj
ijjij
rXuuXZ
XZY
1011
100100
![Page 5: Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.](https://reader031.fdocuments.in/reader031/viewer/2022032006/56649f075503460f94c1cac4/html5/thumbnails/5.jpg)
What are multi-level models?
• Multi-level data: nesting• The statistical problem: dependence• The basic model• Results:
– Regression coefficients– Variances (and covariances) for residuals
• These address dependence
• Key new assumption:– Variance components have multivariate normal
distribution
![Page 6: Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.](https://reader031.fdocuments.in/reader031/viewer/2022032006/56649f075503460f94c1cac4/html5/thumbnails/6.jpg)
Programs I’ll Discuss
• Yes:– Random effects multilevel regression– Stand alone and stat package
• No:– “Fixed effects” panel models– Latent growth models– Latent class trajectory models
• A note on terminology: I’m sorry!
![Page 7: Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.](https://reader031.fdocuments.in/reader031/viewer/2022032006/56649f075503460f94c1cac4/html5/thumbnails/7.jpg)
Varieties of Multilevel Models
Nature of nesting
• 2 level
• 3 level
• More than 3!
• Multivariate (dependent variable)
• Cross-nested
![Page 8: Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.](https://reader031.fdocuments.in/reader031/viewer/2022032006/56649f075503460f94c1cac4/html5/thumbnails/8.jpg)
Varieties of Multilevel Models
• Linear/ Normal
• Non-linear/Generalized Linear• Level 1 non-normal, higher levels normal
– Dichotomous: logistic, probit– Ordinal: logistic– Multinomial: logisitic– Count: Poisson, negative binomial– Censored/limited continuous: Tobit
![Page 9: Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.](https://reader031.fdocuments.in/reader031/viewer/2022032006/56649f075503460f94c1cac4/html5/thumbnails/9.jpg)
Features of Programs: Estimation
• Iterative generalized least squares
• Restricted maximum likelihood– Max likelihood variance, least sq coefs
• Full maximum likelihood
• Partially qualified likelihood (non-linear)
• Markov chain Monte Carlo
Differences in estimates?
![Page 10: Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.](https://reader031.fdocuments.in/reader031/viewer/2022032006/56649f075503460f94c1cac4/html5/thumbnails/10.jpg)
Features: Model Complexities
• Complex variance structures– Level 1 dependent on explanatory variables– Longitudinal structures
• Latent variable effects/mediation
• Unit specific vs. population average
• Robust standard errors– GEE / sandwich– Bootstrap
![Page 11: Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.](https://reader031.fdocuments.in/reader031/viewer/2022032006/56649f075503460f94c1cac4/html5/thumbnails/11.jpg)
Features: Data Handling
• Stat package input
• Sample weights
• Multiply imputed datasets
• Automated centering
• Automated cross-level interactions
![Page 12: Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.](https://reader031.fdocuments.in/reader031/viewer/2022032006/56649f075503460f94c1cac4/html5/thumbnails/12.jpg)
Features: Additional Information
• Wald tests
• Residual analysis
• Graphing
• Unit specific estimates– “OLS”– Fitted– Bayes/Shrinkage
![Page 13: Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.](https://reader031.fdocuments.in/reader031/viewer/2022032006/56649f075503460f94c1cac4/html5/thumbnails/13.jpg)
Multilevel Modeling Programs
• MLM programs: General– HLM, MLwinN
• MLM programs: Specialized– aML, WINBUGS
• MLM in stat packages– STATA, SAS, SPSS
• Others I’ll skip– MIXed up suite, R, LIMDEP, M+, S+, SYSTAT
![Page 14: Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.](https://reader031.fdocuments.in/reader031/viewer/2022032006/56649f075503460f94c1cac4/html5/thumbnails/14.jpg)
What’s in a user friendly MLM interface?
• Equation display with point-and-click modification
• Automated centering and cross-level interactions
• Ready access to:– Residual analysis and tests of assumptions– Multiple coefficient tests (Wald)– Estimation and iteration options
![Page 15: Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.](https://reader031.fdocuments.in/reader031/viewer/2022032006/56649f075503460f94c1cac4/html5/thumbnails/15.jpg)
HLM
• Full featured, user friendly, continuing development
• Strengths: user interface, range of options and output
• Recommended: For anyone who expects to do a good deal of MLM
• Bryk, Raudenbush & Congdon– Scientific Software International, Chicago– $425, $100 each additional
![Page 16: Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.](https://reader031.fdocuments.in/reader031/viewer/2022032006/56649f075503460f94c1cac4/html5/thumbnails/16.jpg)
MLwiN
• Fully featured, very powerful, continuing development
• Strengths: range of options, up to 10 levels, bootstrap & MCMC
• Recommended for more advanced users, special purposes
• Goldstein & colleagues– Centre for Multilevel Modeling, UK– $990, $360 additional user, $3600 50 users
![Page 17: Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.](https://reader031.fdocuments.in/reader031/viewer/2022032006/56649f075503460f94c1cac4/html5/thumbnails/17.jpg)
aML• Specializes in unusual models
– Multiple equation selection models– Joint modeling of outcomes with different
response functions (e.g., normal & Poisson)
• Strengths: Technical, flexible• Weaknesses: Interface, slow• Recommended: For economists and when
it’s the only choice• From Lillard & Panis
– Now free to download
![Page 18: Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.](https://reader031.fdocuments.in/reader031/viewer/2022032006/56649f075503460f94c1cac4/html5/thumbnails/18.jpg)
WINBUGS
• A Bayesian stat package
• Mainly of interest for MCMC estimation
• Much slower
• Recommended: For MCMC beyond MLwiN.
• Medical Research Council Biostat Unit, Cambridge UK– Free to download
![Page 19: Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.](https://reader031.fdocuments.in/reader031/viewer/2022032006/56649f075503460f94c1cac4/html5/thumbnails/19.jpg)
STATA
• High level, broad, popular, user friendly, stat package
• Where to find multilevel:– “xt” commands (many)
• Strengths: data management, other features of STATA
• Weaknesses: range of MLM options• Recommended: STATA users running
random intercept models
![Page 20: Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.](https://reader031.fdocuments.in/reader031/viewer/2022032006/56649f075503460f94c1cac4/html5/thumbnails/20.jpg)
SAS
• High level, broad, popular stat package
• Primary multilevel commands:– PROC MIXED & PROC NLMIXED– Quite general
• Strengths: other features of SAS, breadth of programs
• Weaknesses: interface & options
• Recommended: For PROC-aholics
![Page 21: Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.](https://reader031.fdocuments.in/reader031/viewer/2022032006/56649f075503460f94c1cac4/html5/thumbnails/21.jpg)
SPSS• Less advanced general statistical package• Where to find MLM:
– MIXED (mixed models)– VARCOMP (general linear model, variance
components)
• Strengths: other features of SPSS• Weaknesses: limited range of options,
interface for MLM• Recommended: for SPSS users running a
few simple models