CTD Spring 2015 Weekly Workshop: Learning outcomes

Learning Outcomes 1 Flight Deck by Wayan Volta on flickr CC

Do you understand how to fly an airplane?

Yes

Okay, but let’s look at this checklist. [trust and verify]

CTD Weekly Workshops:

Learning Outcomes

Peter Newbury, Ph.D.

Center for Teaching Development,

University of California, San Diego

[email protected]

@polarisdotca #ctducsd ctd.ucsd.edu

CTD Weekly Workshops:

Learning Outcomes

Unless otherwise noted, content is licensed under a Creative Commons Attribution-Non Commercial 3.0 License.

resources: ctd.ucsd.edu/programs/weekly-workshops-spring-2015/

please

sign in

Scholarly approach to teaching:

Learning Outcomes 3

Carl Wieman

Science Education Initiative

cwsei.ubc.ca

What should

students

learn? learning

outcomes

(goals, objectives)

assessment

active learning,

peer instruction

What should

students

learn?

What are

students

learning?

What instructional

approaches

help students

learn?

(Image: NASA) Learning Outcomes 4

Introductory “Astro 101”

Traditional Course Syllabus Course with

Learning Outcomes

Learning Outcomes 5

This course covers Chapters

1. Mercury

2. Venus

…

8. Neptune

9. Asteroids and Comets

10. Formation of the

Solar System

deduce from patterns in the

properties of the planets,

moons, asteroids and other

bodies that the Solar System

had single formation event.

provide notable examples of

how comets influenced

history, art and science

Learning outcomes

Learning Outcomes 6

completes the sentence, “By this end of this

lesson/unit/course, you will be able to…”

begins with an action verb (“deduce”) (more below)

tells the students what they must do to demonstrate

they “understand” the concept

Learning outcomes are valuable to…

Learning Outcomes 7

the instructor

o crystallizes what the instructor cares about

o helps the instructor select instructional strategies and activities, write the final exam

“select instructional activities…”

Learning Outcomes 8 ClassAction http://astro.unl.edu/classaction/

Does this peer

instruction question

support the

learning outcomes?

don’t

use it use it

yes no

“write the final exam…”

Learning Outcomes 9

(10 marks) List 3 patterns of the Solar System as a

whole. Then, outline in some detail the current model for

the formation of the Solar System. In particular, make sure

you explain how the observed patterns and regularities are

related to this theory of formation.

teaching to

the test? Yes!

Learning outcomes are valuable to…

Learning Outcomes 10

the students

o reveal what the instructor is looking for: no more guessing what “understand” means or what will be on the exam

o big picture of the next part of the course

o allow student to check that s/he has mastered the concept (especially when studying later)

A course should have

Course-level LOs Topic-level LOs

Learning Outcomes

several LOs giving big

picture, attitudes,

behaviors

(likely) can’t be assessed

with a single exam

question

supported by many

topic-level LOs

many LOs defining what

it means to “understand”

at this level (freshman,…)

can be (should be)

repeatedly assessed on

homework, exams

support one or more

course-level LOs

11

Topic-level

LO

Topic-level

LO

Topic-

level LO

Course-level LO #4


Course-level LO #2

Course-level LO #3 Course-level

learning outcome (LO) #1

Topic-level

LO Topic-level

LO

Topic-level

LO

Topic-level

LO

Topic-level

LO

Topic-level

LO

Topic-level

LO Topic-level

LO

Topic-

level LO

Topic-

level LO

Topic-

level LO

Topic-

level LO

Topic-

level LO

Topic-level

learning outcome

Topic-level

LO

Topic-level

LO

Topic-

level LO

Course-level LO #4


Course-level LO #2



Topic-level

LO Topic-level

LO

Topic-level

LO

Topic-level

LO

Topic-level

LO

Topic-level

LO

Topic-level

LO Topic-level

LO

Topic-

level LO

Topic-

level LO

Topic-

level LO

Topic-

level LO

Topic-

level LO Topic-

level LO

Topic-

level LO

Topic-level

LO Topic-level

learning outcome

Topic-level

LO

Topic-level

LO

Topic-

level LO

Course-level LO #4


Course-level LO #2



Topic-level

LO Topic-level

LO

Topic-level

LO

Topic-level

LO

Topic-level

LO

Topic-level

LO

Topic-level

LO Topic-level

LO

Topic-

level LO

Topic-

level LO

Topic-

level LO

Topic-

level LO

Topic-

level LO Topic-

level LO

Topic-

level LO

Topic-level

LO Topic-level

learning outcome

sync your LOs see ASTR 310 handout

Writing topic-level LOs


Writing learning outcomes is hard because you have to

recognize

declare

(admit)

what you want your students to be capable of doing.

A good start is picking the verb describing the

action the students will perform to demonstrate their

mastery of the concept.

Bloom’s Taxonomy [2,3]


transform or combine ideas to create something new think critically about and defend a position

break down concepts into parts

apply comprehension to unfamiliar situations demonstrate understanding of ideas and concepts

remember and recall factual information

6 Create

5 Evaluate

4 Analyze

3 Apply

2 Understand

1 Remember

Bloom’s Taxonomy [2,3]


higher order thinking

lower order thinking

6 Create

5 Evaluate

4 Analyze

3 Apply

2 Understand

1 Remember

Bloom’s Taxonomy Verbs


develop, create, propose, formulate, design, invent

judge, appraise, recommend, justify, defend, criticize, evaluate

compare, contrast, categorize, distinguish, identify, infer

apply, demonstrate, use, compute, solve, predict, construct, modify

describe, explain, summarize, interpret, illustrate

define, list, state, label, name, describe

6 Create

5 Evaluate

4 Analyze

3 Apply

2 Understand

1 Remember

Adapted from Carl Wieman (2007) www.cwsei.ubc.ca/resources/learn_goals.htm

1. Draft LOs from course outline


Work through the list of topics. For each topic, decide

What do I want students to be able to do, to

demonstrate they “get” this topic?

Don’t worry about drafting too many low-level LOs.

When you revise, you’ll start grouping them into

higher-level LOs.

2. “Back-engineer” LOs from exams


Use last year’s (or several years’) final exam. For each good

question, ask yourself

What is this question assessing? What is the learning

outcome I want students to demonstrate to properly

answer this question?

Is that the outcome I want? Is it too low? Too high?

When you have a list of LOs,

Does it cover everything I want for this course?

Have I over- or under-represented any concepts?

Driver’s Ed 101:

How to Drive in California


Task: Write a learning outcome

that your group’s question assesses.

(refer to Wieman handout

for Bloom’s Taxonomy verbs)


Sample Class C Written Test 5

California Department of Motor Vehicles

http://www.dmv.ca.gov/pubs/interactive/tdrive/clc6written.htm

Share your LOs with your students


(good) Publish your LOs as part of your syllabus.

(better) Publish them in your syllabus AND include relevant learning goals in your lecture slides at the beginning of each topic, even each class.

Be wary of reading them aloud: your students may not yet have the knowledge (or jargon) to appreciate the LOs. The LOs will be there when they study.

Don’t worry about “spoon-feeding” them – help the students do exactly what you feel demonstrates understanding

What is the Value of Course-Specific

Learning Outcomes?


Simon & Taylor [1] asked students to complete this

sentence:

For me, the use of learning goals in this course is…

They received 597 responses from students in computer

science and microbiology. Responses were put into

categories that emerged from the responses.


Simon & Taylor (2009)

Scholarly approach to teaching:


Carl Wieman

Science Education Initiative

cwsei.ubc.ca

What should

students

learn? learning

outcomes

(goals, objectives)

assessment

active learning,

peer instruction

What should

students

learn?

What are

students

learning?

What instructional

approaches

help students

learn?

References


1. Simon, B., & Taylor, J. (2009). What is the Value of Course-Specific Learning Goals? Journal of

College Science Teaching, 39, 2, 52-57. PDF available at

www.cwsei.ubc.ca/SEI_research/files/LifeSci/Simon_Taylor_ValueOfCourseSpecificLG.pdf

2. Bloom B. S. (1956). Taxonomy of Educational Objectives, Handbook I: The Cognitive Domain. New York:

David McKay Co Inc.

Adapted from Anderson, L. W., & Krathwohl, D. R. (2001). A Taxonomy for Learning. Teaching,

and assessing: A revision of bloom's taxonomy of educational objectives.

Revised Bloom’s Taxonomy www.celt.iastate.edu/teaching/RevisedBlooms1.html

3. Excerpt from Wieman, C. (2007). Slides from the Wieman Learning Goals Workshop.

www.cwsei.ubc.ca/resources/learn_goals.htm

4. California DMV Sample Class C Written Test 5

www.dmv.ca.gov/pubs/interactive/tdrive/clc6written.htm

http://www.celt.iastate.edu/teaching/RevisedBlooms1.html

http://www.cwsei.ubc.ca/resources/learn_goals.htm


6 Create: transform and combine ideas to create something new

develop, create, propose, formulate, design, invent

5 Evaluate: think critically about and defend a position

judge, appraise, recommend, justify, defend, criticize, evaluate

4 Analyze:: break down concepts into parts

compare, contrast, categorize, distinguish, identify, infer

3 Apply: apply comprehension to unfamiliar situations

apply, demonstrate, use, compute, solve, predict, construct, modify

2 Understand: demonstrate understanding of ideas, concepts

describe, explain, summarize, interpret, illustrate

1 Remember: remember and recall factual knowledge

define, list, state, label, name, describe

Bloom’s Taxonomy of the Cognitive Domain

(Levels of Learning)

Learning Outcomes Adapted from Carl Wieman (2007) www.cwsei.ubc.ca/resources/learn_goals.htm

32

CTD Spring 2015 Weekly Workshop: Learning outcomes

Education

Transcript of CTD Spring 2015 Weekly Workshop: Learning outcomes