Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment...

35
Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014

Transcript of Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment...

Page 1: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

Best Practices in Writing Student Learning Outcomes

Jill Allison Kern, PhDDirector of Assessment

Christopher Newport University

July 2014

Page 2: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

Student learning outcomes (SLOs) is a generic term that refers to what students should know or be able to do upon the successful completion of:

• A course—also known as Course Learning Outcomes (CLOs),

• A program—also known as Program Learning Outcomes (PLOs), or

• Any degree at the university—also known as Institutional Learning Outcomes (ILOs).

What Are Student Learning Outcomes?

Page 3: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

Every SLO has a “hook” and “ladder.”

Page 4: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

Students who successfully complete [name the learning unit] should be able to do the following:

The “Hook”The hook is an SLO’s introductory phrase. It is always some variation on this:

Page 5: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

• Upon the successful completion of Psychology 101, students should be able to do the following:

• Those who earn a passing grade in Fine Arts 336 will be able to:

• Graduates with a major in Computer Engineering will have the following abilities:

• Those who earn an undergraduate degree at CNU should be able to do the following:

Examples of Hooks

Page 6: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

The “Ladder”

The ladder is the list of skills and knowledge that students need to demonstrate to pass the course, complete the academic program successfully, or graduate.

Page 7: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

(The term “ladder” isn’t meant to imply a hierarchy or progression of skills; it’s just a term chosen as a visual reminder of a bullet-pointed list.)

Page 8: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

For each rung in the ladder to be assessable,it needs to meet these

two criteria:

Page 9: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

Criterion 1 for Rung to Be Assessable:

It muststart with a verb that can

be observed by the

instructor.

Page 10: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

Describe

Explain

List

Present

Write

Formulate

Create

Analyze

Arrange

Critique

Synthesize

Predict

Examples of Observable Verbs

Page 11: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

Know

Learn

Understand

Comprehend

Appreciate

Study

Recognize

Become familiar with

Be knowledgeable about

Think

Value

Realize

Become aware of

See

Examples of Non-observable Verbs

Page 12: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

• Know the arguments

• Reflect on the issues

• Think critically

• Understand the principles

• Comprehend the methods

• Appreciate art

• Summarize the arguments

• Discuss one’s reflections on the issues

• Identify assumptions implicit in theories

• Apply the principles

• Explain the methods

• Describe the aesthetic properties of art works that appeal to you

Not Observable Observable

Translate Non-observable SLOs into Observable Ones

Page 13: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.
Page 14: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

For more lists of verbs to use in SLOs:

Go to cnu.edu/assessment/resources

Then, click on hyperlinks to documents under “Step 1”

Page 15: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

Criterion 2for Rung to Be Assessable:

It mustuse only one verb

in each SLO.

Page 16: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

Double-Barreled (not assessable):

Students who successfully earn a degree in communication studies will be able to write and speak effectively.

Page 17: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

Single-Barreled (assessable):

• Students who successfully earn a degree in communication studies will be able to write effectively.

• Students who successfully earn a degree in communication studies will be able to speak effectively.

Page 18: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

SLOs that connect two or more verbs with “or” are

assessable; SLOs that connect two or more verbs

with “and” are not.

Page 19: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

Students who successfully earn a degree in communication studies will be able to write or speak effectively.

Single-Barreled (assessable):

Page 20: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

 Graduates with a BA in Sociology should be able to:

• PLO-1: Identify sociological concepts and major theorists.

• PLO-2: Explain primary social theories.

• PLO-3: Design a research project using the appropriate social science methodology.

• PLO-4: Evaluate empirical research.

• PLO-5: Apply sociocultural concepts, perspectives and principles to substantive areas addressed by social sciences.

• PLO-6: Explain social and cultural phenomena using a cross-cultural perspective.

Ladder

Hook

Page 21: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

More Best Practices in Writing SLOs

Page 22: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

The verb used in an SLO should

determine the data that will be

collected to assess the SLO.

Best Practice 1

Page 23: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

Examples of SLO Verb Informing What Data to Collect

• Students who pass Great Books of the Western World should be able to list at least five attributes of texts influenced by Western traditions.

To assess, collect lists of text attributes.

• Students who successfully earn a degree in journalism will be able to write effectively.

To assess, collect writing samples.

• Students who successfully complete Math 300 will be able to use quantitative reasoning to solve problems.

To assess, collect problems that are solved using quantitative reasoning.

Page 24: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

Avoid using verbs or adjectives that imply a comparison of skills between

one point in time and another because such SLOs require a pre-

and post-measure.

Best Practice 2

Page 25: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

AVOID

Comparative VerbsComparative Adjectives

• Develop • Developed• Improve • Improved• Enhance • Enhanced• Deepen • Deepened• Strengthen • Strengthene

d

Page 26: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

Requires data collection at two points in time:

Those who earn a degree in music will improve their capacity to compose complex scores or play an instrument.

Requires data collection at two points in time:Those who earn a degree in music will demonstrate an enhanced capacity to compose complex scores or play an instrument.

Requires collection of summative (end-point) data only:

Those who earn a degree in music will be able to compose complex scores or play an instrument skillfully.

Page 27: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

No CLO should be repeated across two or more of a major’s required

courses

Best Practice 3

Students shouldn’t take multiple courses designed to produce the same

learning

Page 28: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

If a sequence of courses is designed to enable students to develop a skill at a more sophisticated level or to deepen their knowledge of a given

topic, then the CLOs should be written to reflect the differing levels

of skill/knowledge students are expected to demonstrate in each

course.

 

Page 29: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

Students who successfully complete CHEM 122L will demonstrate safe and generally accepted laboratory techniques for simple chemistry experiments.

Students who successfully complete CHEM 322L will demonstrate safe and generally accepted laboratory techniques for complex chemistry experiments.

Students who earn a passing grade in Music 325 will be able to demonstrate technical proficiency in their chosen instrument during a live public performance.

Students who earn a passing grade in Music 425 will be able to demonstrate technical mastery in their chosen instrument during a live public performance.

To complete French 200 successfully, students should be able to conjugate regular verbs in the imperfect tense correctly when speaking.

To complete French 300 successfully, students should be able to conjugate regular verbs in the imperfect tense when writing.

Examples of SLOs Specifying Depth of Learning

Page 30: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

A person in your field unfamiliar with your course or program should be

able to read an SLO and know precisely what students are

expected to learn

Best Practice 4

Page 31: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

Those earning a passing grade in Chemistry 232 will be able to identify the principles underlying the experiments performed in the course.

The following SLO would be unclear to a chemistry professor unfamiliar with what is taught in CNU’s Chemistry 232:

Those earning a passing grade in Chemistry 232 will be able to identify the principles underlying basic experiments on combustions, particles, and enzymes.

The following SLO would be clear to a chemistry professor unfamiliar with what is taught in CNU’s Chemistry 232:

Page 32: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

Best Practice 5• Keep the list of SLOs short to make assessment

manageable

• Limit the SLOs to the necessary skills and knowledge that students are to acquire

• About four to six CLOs for a three-unit course

• About five to nine PLOs for a major

• About four through seven ILOs for a degree

Page 33: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

Number your SLOs so that you may refer to them in syllabi, on graded assignments, and in assessment

reports.

Best Practice 6

Page 34: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

Upon the successful completion of the Fine Arts major with a Studio Art concentration, students will be able to:

• PLO – 1: Develop a body of work that demonstrates conceptual intent.

• PLO – 2: Create a body of work that demonstrates technical skill.

• PLO – 3: Critically evaluate art work using appropriate terminology.

• PLO – 4: Produce a portfolio that includes an artist’s statement, artist resume, and professional slides/documentation of their work.

Hook

Ladde

rEnu

mera

tion

Page 35: Best Practices in Writing Student Learning Outcomes Jill Allison Kern, PhD Director of Assessment Christopher Newport University July 2014.

• ENG 257 CLO-2: Students who successfully complete this course will be able to analyze the strengths and weaknesses of literary texts as demonstrated by a review they write on a novel from the Renaissance, Victorian, and contemporary periods.

• COMP ENG PLO-5: Graduates of CNU’s computer engineering BS program will be able to design hardware components that meet a variety of client needs.

• AICE SLO-1: Upon the successful completion of the Creative Expressions Area of Inquiry, students will be able to apply concepts from the humanities to describe artistic endeavors or participate in a fine art, such as creating a painting or choreographing a dance.

More Exemplary SLOs