Factor Analysis is Your Friend
description
Transcript of Factor Analysis is Your Friend
![Page 1: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/1.jpg)
Factor Analysis is Your Friend
AnnMaria De Mars, PhD.The Julia Group & 7 Generation Games
![Page 2: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/2.jpg)
WHY?
Imagine this
![Page 3: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/3.jpg)
What exactly were you planning on doing with that?
Let’s say you have a massive pile of data …
![Page 4: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/4.jpg)
You Could:
“9% of adolescents reported blah blah blah”
“23% of adults said blah blah blah”
![Page 5: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/5.jpg)
The Problem:
1. Boring! No one is going to read each one.
2. Cannot conduct relational analysis of each variable --- statistical sin
3. Individual items are notoriously unreliable.
![Page 6: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/6.jpg)
SUBSCALES ?
•Do you own guinea pigs?•Do you have any stuffed animals?
![Page 7: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/7.jpg)
Conceptually, it’s pretty simple
Don’t Be Scared of Factor Analysis!
Image Source: scottyoungpsalm37.blogspot.com
![Page 8: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/8.jpg)
Factor analysis is for …
• 1. Revealing patterns of interrelationships among variables
• 2. Detecting clusters of variables
• 3. Reducing a large number of variables to a smaller number of variables, the factors of factor analysis.
![Page 9: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/9.jpg)
You can factor analyze anything
– test scores, – individual items on a test– measurements of various dimensions (i.e. height
or weight) – agricultural measures like yield of a rice field– Socioeconomic measres
![Page 10: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/10.jpg)
Is this a fair test?
• You have studied for a final exam in Biology 101. There is one question, “What is the relationship between respiration and photosynthesis?”
• Your child is in fifth grade. Her weekly spelling test consists of one word.
![Page 11: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/11.jpg)
You already understand this
True Variance vs. Error Variance
Variability & Validity
![Page 12: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/12.jpg)
Questions …Image Source: www.edudemic.com
![Page 13: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/13.jpg)
How do I …
• Decide on the number of factors• Interpret factors• With SAS Enterprise Guide
![Page 14: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/14.jpg)
How to do Factor Analysis using SAS Enterprise Guide
![Page 15: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/15.jpg)
A Brief Overview of the Process
1. Open a data set, run a factor analysis, and observe the data’s fit.
2. If necessary, run a correlation analysis to create a dataset to analyze
3. If necessary , make modifications and run your model once or twice more
![Page 16: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/16.jpg)
A complete project
![Page 17: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/17.jpg)
Our data
• From the 500 Family Study• Hundreds of questions answered• Example uses 42 items asked adolescents
regarding parent communication, rules, decision-making
![Page 18: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/18.jpg)
FILE > OPEN > DATA
![Page 19: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/19.jpg)
Hold down shift key to select more than one at a time
Select the variables
![Page 20: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/20.jpg)
TASKS > MULTIVARIATE > FACTOR ANALYSIS
![Page 21: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/21.jpg)
Look at your log first!
• When you get your results, do NOT look at your results first. Be smarter than most people and look at your log. To do that you click on the tab that says LOG
![Page 22: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/22.jpg)
What if you see this?
• WARNING: 123 OF 465 OBSERVATIONS IN DATA SET WORK.SORTTEMTABLESORTED OMITTED DUE TO MISSING VALUES.
• If we didn’t have a lot of people missing data, we could skip the next few steps, but hey, that’s life.
![Page 23: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/23.jpg)
Tasks > Describe > Summary statistics
Drag and drop to select variables to analyze
![Page 24: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/24.jpg)
• The default for SAS is to delete a record if it is missing ANY of the variables.
Why factor analyze the correlation matrix?
My first analysis was missing 120 records but no single item was missingfor more than 49 people
![Page 25: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/25.jpg)
by clicking on them and pressing the blue arrows in between the panes
Select the variables you want
![Page 26: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/26.jpg)
DATA SET > TASKS > MULTIVARIATE > CORRELATIONS.
Step Two: Create a Correlation Matrix Dataset
![Page 27: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/27.jpg)
Output matrix as SAS dataset of type=CORR:
OUTPUT DATA > SAVE OUTPUT > DATA > RUN
![Page 28: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/28.jpg)
![Page 29: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/29.jpg)
TASKS > MULTIVARIATE > FACTOR ANALYSIS
![Page 30: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/30.jpg)
Hold down shift key to select more than one at a time
Select the variables
![Page 31: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/31.jpg)
![Page 32: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/32.jpg)
So Now What does all of this Factor Analysis crap mean, anyway?
![Page 33: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/33.jpg)
What exactly is a factor?
• Recall, a factor is some underlying trait that is measured indirectly by the items you measured directly.
• AKA ‘dimension reduction technique’
![Page 34: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/34.jpg)
How many factors?
3 possibilities
![Page 35: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/35.jpg)
Eigenvalue
• The amount of variance in the individual measures explained by the factor.
Square the loadings in the factor pattern and add them up. The total is the eigenvalue. Prediction: At least one person who reads this will do exactly that and be surprised that I am right. Contrary to appearances, I do not make this s*** up.
![Page 36: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/36.jpg)
Eigenvalue
• Common criterion for deciding the number of factors is “Minimum eigenvalue greater than 1.”
• Makes intuitive sense but …
![Page 37: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/37.jpg)
![Page 38: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/38.jpg)
Method 3
• Parallel analysis criterion (macros available – Google it)
![Page 39: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/39.jpg)
Now do it again
![Page 40: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/40.jpg)
What do the factors mean?
![Page 41: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/41.jpg)
Important Point One
• The correlation of a variable with a factor is called the loading.
– loadings can be positive or negative.
![Page 42: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/42.jpg)
Important point two
• To ease interpretation we’d really like to have “simple structure”
– variables load close to 1.0 on one factor and close to zero on the others.
![Page 43: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/43.jpg)
![Page 44: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/44.jpg)
Next step: iterate
No, it is not party in the pool, sorry.
![Page 45: Factor Analysis is Your Friend](https://reader035.fdocuments.in/reader035/viewer/2022062520/56815f3a550346895dce09aa/html5/thumbnails/45.jpg)
Secret to factor analysis
• Finding a solution that is defensible BOTH statistically and theoretically
• Nice first step to structural equation modeling. In fact, it IS the first step.