Bill Bailey's Comfirmatory Factor Anal

8/3/2019 Bill Bailey's Comfirmatory Factor Anal

1/27

An Examination of the Factor Structureof the Emotional Skills AssessmentProcess (ESAP-CV) Instrument UsingConfirmatory Factor Analysis

William C. Bailey, Ph.D.Associate Professor

Christina Chi, Ph.D.Assistant Professor

School of Human Environmental Sciences

Dale Bumpers College of Agricultural, Food and LifeSciences

University of Arkansas


2/27

Emotional SkillsAssessment Process (ESAP) Nelson and Low (1999, 2004) created the

ESAP scale in order to assist students inacademic achievement, career success,personal health, and leadership.

ESAP was revised from a 213 item self-

assessment instrument evaluating 10strengths and 3 problem areas


3/27

ESAP-CV This study used a revised form of the ESAP

with 104 items.

Evaluates five emotional skills

Assertion Stress Management

Drive Strength

Time Management Commitment Ethic

One Problem Area-- Change Orientation


4/27

Data Collection

Data were collected using a questionnaireplaced on www.surveymonkey.com

Students were sent an email and asked to

respond from a variety of University coreclasses to ensure diversity

In addition to the ESAP-CV, there were

demographic items such as gender, age,ethnicity, and college classification

A total of 458 usable responses were collected
http://www.surveymonkey.com/http://www.surveymonkey.com/


5/27

Sample Split In Halves

The sample was randomly assigned to 2groupsboth groups were a little more than

250 each. Because the largest subscale was 25 items,

there was sufficient power for this analysis (1item with at least 10 respondents).

One group was analyized by exploratory factoranalysis (EFA) and the other by confirmatoryfactory analysis (CFA).


6/27

Exploratory Factor

Analysis (EFA) In order to evaluate the initial structure of

each of the subscales, EFA was

performed using SPSS 13.0. The Extraction Method was Principal

Axis Factoring in order to maximize

loadings and eliminate double loadings Loading factor of .40 was selected as

item criteria.


7/27

Results of EFA was Followed byConfirmatory Factor Analysis (CFA)

CFA gives the researcher completecontrol of the specifications of each

of the subscale constructs.

CFA also allows for a statistical testof the goodness-of-fit for the

proposed solution.

AMOS 5.0 was used for analysis


8/27

Goodness-of-Fit

Analysis Statistics #1

Overall Chi-square statisticprovidesa test of whether the sample covariance

matrix is equivalent to the model-impliedcovariance matrix within sample error.

Rule of thumbpvalues larger than .05or .10.

However, this is effected by sample sizeand should be interpreted with caution.


9/27

Goodness-of-Fit

Analysis Statistics #2

The CFI was created to compare the fit ofthe proposed model to the worst case

alternative. This is a null baseline model where every

measure is modeled as being uncorrelated with

every other measure. CFI ranges between 0 and 1.

Rule: CFI values .90 are above are adequate ofthe model.


10/27

Commitment Ethic EFA Factor

This 12 item scale measured oneconstruct according to EFA.

However, only 10 items loaded at betterthan .40

Item 5I have a solid feeling of

confidence in my ability to create a goodlife for myself.

Item 7I do not procrastinate.


11/27

Commitment Ethics ItemLoadings

Item # Factor Loading

6 .72

11 .68

2 .67

10 .67

4 .62

1 .61

8 599 .57

5 .50

12 .43

3 .40

Due to EFA

resulting in asingle factor,

CFA was not

conduced.


12/27

EFA of Assertion The Assertion portion of the ESAP has a total

of 18 items.

It has a unique design.

The word Situation is used prior to threesimilar statements creating 6 items clusters.

The EFA indicated there were only 5 itemsclusters of varying from 2 to 3 items.

Items 1, 6, 16, 17, and 18 failed to load at .40or better.


13/27

CFAModel ofAssertion

Chi square 73.132*

CFI 0.975

RMSEA 0.038

*p. = .000


14/27

Five Suggested Factor Namesfor Assertion

Items 10, 11, & 12 Response to

Requests

Items 5 & 6 Aware of Anothers Anger Items 7, 8, & 9 Communication with

Authority

Items 13, 14, & 15 Making Demands ofOthers

Items 2 & 3 Anger Directed at Another

Person


15/27

EFA Analysis Drive Strength

Drive Strength has 25 items

EFA generated Five Factors Five items failed to load .40 or

better


16/27

Chi square 246.169*

CFI 0.934RMSEA 0.048

CFA Modelof Drive

Strength

*p. = .000


17/27

Five Suggested Factor Namesfor Drive Strengths

Factor 1 Self Starter

Factor 2 Self Challenger

Factor 3 Project Focus

Factor 4 Planning for the Future

Factor 5 Personal SuccessStrategies


18/27

Time Management EFA

12 items

Resulted in 2 Factors All 12 items loaded at

better than .40


19/27

CFA of TimeManagement

Chi square 85.445*

CFI 0.967

RMSEA 0.051

*p. = .000


20/27

Suggested Names for TimeManagement Factors

Factor 1Effective TimeManagement Skills

Factor 2Punctuality


21/27

EFA of Stress Management

25 items

EFA generated 4 Factors Five items failed to load at

.40 or better


22/27

Unable to Show CFA Model

Chi square 301.39*

CFI 0.904

RMSEA 0.06


23/27

Suggested Names for 4 StressFactors

Factor 1- Stress ObstructingSense of

Well-Being

Factor 2Coping by Relaxing

Factor 3Stress andImpatience

Factor 4Unable to Cope


24/27

EFA Analysis for ProblemArea Change Orientation

12 items

2 Factors Generated 2 items failed to load at better

than .40


25/27

Chi square 114.359*

CFI 0.906

RMSEA 0.101

Unable to Name Factors

CFA forChange

Orientation


26/27

Modest Suggestions andConclusions

Several of the ESAP-CV scalesmeasure more than one concept

Reduction of items on some scalesmay be appropriate

Some of the CFA models arestatistically more powerful than others

Small number of items subscales willbe difficult to norm and title


27/27

Future Directions for Research

Does the ESAP-CV really havepredictive validity? What can it predict?

Developing norms based on gender,ethnicity, or age?

????????????

Bill Bailey's Comfirmatory Factor Anal

Documents

Transcript of Bill Bailey's Comfirmatory Factor Anal