Assessing Student Learning Outcomes*
description
Transcript of Assessing Student Learning Outcomes*
Assessing Student Learning
Outcomes*
* Adapted from the University of Virginia
Assessment is a process of gathering and interpreting information to discover if a program is meeting established goals and then using that information to enhance the program.
“The College demonstrates that each educational program for which academic credit is awarded (a) is approved by the faculty and the administration, and (b) establishes and evaluates program and learning outcomes.”
Why Assess?
Why Assess?
To maintain, foster, and improve the unique teaching and research environment.
Assessments should:► Be useful and feasible.► Minimize burden on faculty and students.
Programs define their own most important outcomes.
Methods should be simple and connected to what faculty are already doing.
More About How
► Begin with what you value most.
► Faculty involvement is essential.
► The unit of analysis for assessment is the program.
► Results should be used to make program improvements.
► The V.P.A. is committed to providing support.
Program Outcomes/ Objectives (3-5) What will students know and be able to do when they graduate? Should be specific & measurable.
Check if this is a Student Learning Outcome (min. of 2)
Assessment Methods/ Measures How will the outcome be measured? Who will be assessed, when, and how often?
Standards of Comparison/ Target Level How well should students be able to do on the assessment?
Interpretation of Results/ Findings What does the data show?
Use of Results/ Action Plan Who reviewed the finding? What changes were made after reviewing the results?
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
PROGRAM OR SCHOOL: Assessment Coordinator for Program or School:
Name: Email: Phone:
Program or School Mission Statement:
Program or School Goals (2-3):
ASSESSMENT MATRIX
Future Expectations
How will assessment activities be reported in the future?
►Program Review►Annual reports►Accreditation
“Good assessments give reasonably accurate, truthful information.”
Why do we insist on measuring it with a micrometer when we mark it with chalk and cut it with an axe?
--Peter Ewell
In assessment, “the perfect is the enemy of the good.” Let’s keep striving for the good.
--Tom Angelo
An approximate answer to the right question is worth a good deal more than an exact answer to an approximate question.
--J. W. TukeySlide replicated from Linda Suskie’s Achieving Middle States’ Expectations for Assessing Student Learning, a presentation to the Middle States Commission on Higher Education, May 2005. Used with permission.
Part IILearning Outcomes:Defining & Developing
What is a Student Learning Outcome?
Student learning outcomes are properly defined in terms
of the knowledge, skills, and attitudes that a student has
obtained at the end (or as a result) of his or her
engagement in a specific program.
The Leading Question
What do students need to know and be able to do after they graduate from this program?
Tips
Covert OvertKnow the arguments Summarize the argumentsReflect on the issues Share reflections on the issuesThink critically Critique assumptionsEnvision solutions Illustrate solutionsUnderstand principles Apply principlesUnderstand methods Explicate methodsAppreciate art Choose to attend art eventsAppreciate philosophy Choose to discuss philosophical issuesKnow principles of social justice Advocate principles of social justice
Be aware of covert versus overt performance criteria.
Learning Outcome Critique
Does the learning outcome:► Use action verbs?► Describe what students can do?► Include a time frame (at the end of a course, end
of the second year, etc.)?► Ask students to apply what they’ve learned by
producing something?► Address student competency rather than content
coverage?► Represent a fundamental result of the
course/program?► Represent an appropriate level of work?
Steps in Student Learning Outcomes Assessment
1. Identify student learning outcomes. 2. Develop methods to assess the outcomes.3. Collect the data.4. Analyze the findings.5. Consider appropriate action.
Assessment Matrix = A Plan
Program Outcomes/ Objectives (3-5) What will students know and be able to do when they graduate? Should be specific & measurable.
Check if this is a Student Learning Outcome (min. of 2)
Assessment Methods/ Measures How will the outcome be measured? Who will be assessed, when, and how often?
Standards of Comparison/ Target Level How well should students be able to do on the assessment?
Interpretation of Results/ Findings What does the data show?
Use of Results/ Action Plan Who reviewed the finding? What changes were made after reviewing the results?
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
PROGRAM OR SCHOOL: Assessment Coordinator for Program or School:
Name: Email: Phone:
Program or School Mission Statement:
Program or School Goals (2-3):
ASSESSMENT MATRIX
Relationship of Mission, Goals, and Outcomes
College Statement
School Mission Statement
Departmental Goals
Student Learning Outcomes
Program Outcomes/ Objectives (3-5) What will students know and be able to do when they graduate? Should be specific & measurable.
Check if this is a Student Learning Outcome (min. of 2)
Assessment Methods/ Measures How will the outcome be measured? Who will be assessed, when, and how often?
Standards of Comparison/ Target Level How well should students be able to do on the assessment?
Interpretation of Results/ Findings What does the data show?
Use of Results/ Action Plan Who reviewed the finding? What changes were made after reviewing the results?
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
PROGRAM OR SCHOOL: Assessment Coordinator for Program or School:
Name: Email: Phone:
Program or School Mission Statement:
Program or School Goals (2-3):
ASSESSMENT MATRIX
Program Outcomes/ Objectives (3-5) What will students know and be able to do when they graduate? Should be specific & measurable.
Check if this is a Student Learning Outcome (min. of 2)
Assessment Methods/ Measures How will the outcome be measured? Who will be assessed, when, and how often?
Standards of Comparison/ Target Level How well should students be able to do on the assessment?
Interpretation of Results/ Findings What does the data show?
Use of Results/ Action Plan Who reviewed the finding? What changes were made after reviewing the results?
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
PROGRAM OR SCHOOL: Assessment Coordinator for Program or School:
Name: Email: Phone:
Program or School Mission Statement:
Program or School Goals (2-3):
ASSESSMENT MATRIX
Program Outcomes/ Objectives (3-5) What will students know and be able to do when they graduate? Should be specific & measurable.
Check if this is a Student Learning Outcome (min. of 2)
Assessment Methods/ Measures How will the outcome be measured? Who will be assessed, when, and how often?
Standards of Comparison/ Target Level How well should students be able to do on the assessment?
Interpretation of Results/ Findings What does the data show?
Use of Results/ Action Plan Who reviewed the finding? What changes were made after reviewing the results?
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
PROGRAM OR SCHOOL: Assessment Coordinator for Program or School:
Name: Email: Phone:
Program or School Mission Statement:
Program or School Goals (2-3):
ASSESSMENT MATRIX
Opportunities for Measuring Student Learning Outcomes
► Course embedded assignments(Papers, exams, projects)
► Capstone courses ► Thesis/dissertation► Internships/practicums► Comprehensive exams► Employer ratings of graduates’ skills
As much as possible, use what you are already doing!
Student Learning Outcome Assessment Methods
Direct Assessments► Standardized tests► Licensure or professional
exams► Rubrics
► Essays/Papers► Exam questions► Exhibits► Performances/
Presentations► Portfolios of student work► Comprehensive exams
Indirect Assessments► Surveys
► Student► Alumni► Employer
► End-of-course memos► Focus groups► Exit interviews► Course evaluations
How much assessment?How often?
► Start with the most important program outcomes. At least two should be learning outcomes.
► Focus on what is useful for program improvement.► Not all outcomes can, or should, be assessed.► Stagger assessments over multiple years.► Allow time for analysis.
Program Outcomes/ Objectives (3-5) What will students know and be able to do when they graduate? Should be specific & measurable.
Check if this is a Student Learning Outcome (min. of 2)
Assessment Methods/ Measures How will the outcome be measured? Who will be assessed, when, and how often?
Standards of Comparison/ Target Level How well should students be able to do on the assessment?
Interpretation of Results/ Findings What does the data show?
Use of Results/ Action Plan Who reviewed the finding? What changes were made after reviewing the results?
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
PROGRAM OR SCHOOL: Assessment Coordinator for Program or School:
Name: Email: Phone:
Program or School Mission Statement:
Program or School Goals (2-3):
ASSESSMENT MATRIX
Program Outcomes/ Objectives (3-5) What will students know and be able to do when they graduate? Should be specific & measurable.
Check if this is a Student Learning Outcome (min. of 2)
Assessment Methods/ Measures How will the outcome be measured? Who will be assessed, when, and how often?
Standards of Comparison/ Target Level How well should students be able to do on the assessment?
Interpretation of Results/ Findings What does the data show?
Use of Results/ Action Plan Who reviewed the finding? What changes were made after reviewing the results?
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
PROGRAM OR SCHOOL: Assessment Coordinator for Program or School:
Name: Email: Phone:
Program or School Mission Statement:
Program or School Goals (2-3):
ASSESSMENT MATRIX
Program Outcomes/ Objectives (3-5) What will students know and be able to do when they graduate? Should be specific & measurable.
Check if this is a Student Learning Outcome (min. of 2)
Assessment Methods/ Measures How will the outcome be measured? Who will be assessed, when, and how often?
Standards of Comparison/ Target Level How well should students be able to do on the assessment?
Interpretation of Results/ Findings What does the data show?
Use of Results/ Action Plan Who reviewed the finding? What changes were made after reviewing the results?
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
PROGRAM OR SCHOOL: Assessment Coordinator for Program or School:
Name: Email: Phone:
Program or School Mission Statement:
Program or School Goals (2-3):
ASSESSMENT MATRIX