General Education Assessment

Trevecca Nazarene University2012-13

Today’s Questions Why have a General Education curriculum?

How is General Education assessed?

What were the results of last year’s assessment?

TNU BA/BS Degree

42%

31%

19%

8%

GenEdMajorMinor/SupportElectives

Why? General Education Curriculum

◦ Develop skills for life-long learning

Why? General Education Curriculum

◦ Develop skills for life-long learning◦ Expand the learner’s worldview

Why? General Education Curriculum

◦ Develop skills for life-long learning◦ Expand the learner’s worldview◦ Locate the Major

within human knowledgeMajor/Minor

General Education

Body of Knowledge

Why? Institutional Educational Goals

General Education Outcomes

Institutional Educational Goals

1. Leadership, Service

2. Disciplined reflection

3. Factors shaping civilization

4. Appreciates global diversity

5. Write, speak, use technology

6. Think critically

7. Engenders wholeness

8. Productive influence

General Education Outcomes

1. speak, write

2. Holy Bible

3. Wesleyan-Holiness tradition

4. Systematic problem-solver

5. Global civilization

6. Modes of thinking

7. Christian faith and knowledge

8. Cultural diversity

9. Stewards of resources

How? Outcomes Assessment Cycle

Assessment Data Third-party standardized test

◦ Norm-referenced: 32 doctoral/research universities

◦ Criterion-referenced: skills, content

Multiple and varied approaches◦ Self-generated content questions◦ Self-generated survey questions◦ Samples of student work

2012-13 Assessment Results ETS-Proficiency Profile

◦ Measures 4 skills: Critical Thinking Reading Writing Mathematics

◦ In 3 contexts: Humanities Social Science Natural Science

Humanities

SocialScience

NaturalScience

Proficiency Profile Norm-referenced: Seniors; 301institutions of all types

◦ TNU Total Score: 47th percentile (n=235)

Cohort Percentile

Traditional 63

Non-traditional 20

Combined 47

Proficiency Profile Norm-referenced: Seniors; 32 doctoral/research univ.

◦ TNU Total Score: 27th percentile (n=235)

Cohort Percentile

Traditional 42

Non-traditional 17

Combined 27

2012-13 Assessment Results

Met or exceeded the criterionfor 4 of 8 assessment measures

Complete report: http://gened.wiki.trevecca.edu

Assessment Results 1: …demonstrate competency in oral and

written communication exhibiting an awareness of content, purpose, and audience while accurately using Standard English (written).

◦ Goal: 4.5 average score for all papers ◦ Actual mean: 4.44%

Assessment Results 4: …will use the scientific method, scientific

inquiry, and perform basic mathematical and statistical tasks to analyze and solve problems.

Two measures were used◦ ETS PP Natural Sciences context score◦ ETS PP Mathematics skill score

◦ Goal: 67th percentile for each area◦ Actual: Natural Sciences, 80th (met)

Mathematics, 60th (not met)

Cohort Ntl Sci

Math

Traditional 80 60

Non-Trad 56 23

Combined 80 60

Assessment Results 6: …demonstrate an understanding and practice

of various intellectual modes of thinking. Two measures were used

◦ Science Lab report score (met)◦ ETS PP Critical Thinking competency: 15% will score

“proficient” and 25% will score “marginally proficient”◦ Actual: 4% proficient, 28% marginally proficient (not

met)

◦ Affinity group: (8% proficient, 20% marginally proficient)(Norm-reference: 34th percentile)

Cohort Proficient

Marginally Proficient

Traditional 5% 29%

Non-trad. 1% 25%

Combined 4% 28%

More on ETS PPCriterion measures

Assessment Results 8: …demonstrate an understanding of

cultural diversity with a capacity to positively engage others.

Three question were asked◦ Q1…value perspectives different than mine◦ Q2…comfortable socializing with (different) ethnic

groups◦ Q3…understand cultures outside USA◦ Goal: 80% will agree/strongly agree

Q1 Ideas

Q2 Social

Q3 Cultures

Agree/St. Agree

68% 42% 41%

PP Skills Scores Norm-referenced: Seniors/all institution types

◦ Critical Thinking: 34th (95% c.i.: 20-54)

◦ Reading: 47th (95% c.i.: 30-71)

◦ Writing: 58th (95% c.i.: 58-94)

◦ Mathematics: 33rd (95% c.i.: 17-52)

PP Context Scores Norm-referenced: Seniors/all institution types

◦ Humanities: 33rd (95% c.i.: 18-59)

◦ Social Sciences: 22nd (95% c.i.: 22-66)

◦ Natural Sciences: 50th (95% c.i.: 27-75)

Proficiency Classifications Criterion –referenced classifications Skill Classification

Proficient Marginal Not Proficient

Reading 1 69% 20% 11%

Reading 2 44% 16% 40%

Critical Thinking 4% 28% 68%

Writing 1 77% 17% 7%

Writing 2 23% 44% 33%

Writing 3 9% 37% 54%

Math 1 52% 29% 19%

Math 2 26% 27% 47%

Math 3 6% 14% 81%

Proficiency Classifications Criterion –referenced classifications Skill Classification

Proficient Marginal Not Proficient

Reading 1 69% 70% 20% 17% 11% 13%

Reading 2 44% 42% 16% 19% 40% 39%

Critical Thinking 4% 8% 28% 20% 68% 71%

Writing 1 77% 66% 17% 25% 7% 9%

Writing 2 23% 22% 44% 37% 33% 41%

Writing 3 9% 9% 37% 28% 54% 63%

Math 1 52% 59% 29% 23% 19% 19%

Math 2 26% 33% 27% 25% 47% 42%

Math 3 6% 10% 14% 18% 81% 72%

Take-Aways

Combining traditional and non-traditional student scores will affect assessment results

Emphasize mathematical concepts across the curriculum

Embrace diversity—ethnic, cultural, and ideological—and help students respond and reflect in Christ-like ways

Will UR-QEP improve critical thinking skill?

Take-Away

What attitude do we project?

Excellence

Good Enough

Indifference

Past Present Future

General EducationDiscussion