Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen...

27
AAPT Feb 2009 Chilly Chicago Stephanie V. Chasteen Clicker Use in Upper-Level Courses Univ. of Colorado Breezy Boulder Clickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock Physics Dept. and Science Education Initiative University of Colorado at Boulder

Transcript of Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen...

Page 1: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

Clickers in Upper-DivisionCourses

Stephanie V. ChasteenKathy PerkinsMichael DubsonSteven Pollock

Physics Dept. and Science Education InitiativeUniversity of Colorado at Boulder

Page 2: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

CU Physics Education ResearchPER faculty & Research PIʼs:

Michael DubsonNoah FinkelsteinKathy Perkins*Steve PollockCarl Wieman*Wendy Adams*Valerie Otero (School of Ed)

Postdocs:Stephanie Chasteen*Steven Goldhaber*Archie PaulsonNoah PodolefskyLaurel Mayhew

Ph. D. students:Lauren KostChandra TurpenBen SpikeCharles Baily

Non-PER participating facultyPaul Beale (chair)*Edward KinneyOliver DeWolfe+ working groups

* = part of Science Education Initiative+Wendy AdamsAnd 12 Teaching Fellows in 5 departments

E&M and Quantum work funded under NSF Grant No. 0737118.

Page 3: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

Outline

• Step into our classroom…• Why use clickers in upper-division?• What does it look like?• Tips for success

Page 4: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

Step into our classroomSTEP INTO OUR CLASSROOM…

Page 5: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

Upper-div Clickers at CU

Non-PER2 (2007, 2009)Graduate AMO

PER, then non-PER6 (2004-2009)Statistical Mechanics

Non-PER3 (2007-2009)Solid State

Non-PER3 (2008-2009)Solid State

PER, then non-PERNon-PER

3 (2008-2009)1 (2008)

Quantum IQuantum II

PER, then non-PERNon-PER

3 (2008-2009)1 (2009)

E&M IE&M II

Non-PERNon-PER

2 (2006-2007)2 (2007, 2009)

Classical Mech. IClassical Mech. II

Instructors# times w/clickersCourse

Page 6: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

Example: Quantum Mech. I

Steven J. PollockPER researcher

3rd semester of PER-led reforms

Oliver DeWolfePrestigious string theorist

Video:Upperdivision use

Peer Instruction: 10 yearsExpert clicker user

Teaching: 15 years

Teaching: 3 yearsClicker use: first yearOpen-minded new user

Page 7: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

Video

Video: Clickers in upper division courses

Page 8: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

Example Questions

More examplesin handouts atback and on web

Page 9: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

WHY USE CLICKERS INUPPER DIVWHY USE CLICKERS

IN UPPER DIVISION?

Page 10: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

What’s special about upper-div?

• Faculty and student investment & identity• Intellectually more sophisticated students• Complex

physics

Page 11: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

Why use clickers in upper-div?

Active engagement andpeer instruction is just asuseful for juniors as forfreshmen

If you have a misconceptionabout some basic physicalidea (yes, this does happen atthe upper-division), it showsglaringly here. -student

Page 12: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

There is a time for telling

… but not too soon* *Dan Schwartz

Page 13: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

Arguments against upper-div clickers

• Chews up time Ideas are complex• Students are sophisticated learners Clickers used to aid learning• Discussion easy in small classes Students can still hide & so can misconceptions• Students may resist But perhaps only initially…• Extra effort for faculty Question banks available if you want to try

Page 14: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

Students Learn More

• Compare Junior E&M I before/after

* Students were similar in pre-course GPA

0102030405060708090

Traditional Exams ConceptualDiagnostic

Mean

Traditional Transformed

Page 15: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

Students Find Clickers Useful

0% 10% 20% 30% 40%

Pure lecturemuch more useful

Pure lecturemore useful

Same

Lecture with clickersmore useful

Lecture with clickersmuch more useful 79% of

students

12 courses, 264 student responsesUpper-div courses using clickers:

Q: How useful for your learning is the addition of clickerquestions compared to pure lecture with no clicker questions?

Page 16: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

Students Recommend ClickersQ: Would you recommend using clickerquestions in upper-level physics courses?

0% 10% 20% 30% 40% 50%

Definitely notrecommended

Neutral

Recommended

HighlyRecommended

73% of students

12 courses, 267 student responsesUpper-div courses using clickers:

Not recommended

Page 17: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

Quantum Mech Before clickers

Popular lecturer: Oliver DeWolfe“Best course I’ve ever taken”

I feel that with clicker questions, the class would "feel" morelike a lower-division course.

They are quite time consuming, and there is a lot of material tobe covered.

The class is small enough that if you don’t understandsomething you can ask the professor to clarify.

The lecture style was extremely useful NO CLICKERS!!!

Student attitudes towards introducingclickers were unfavorable

Page 18: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

Students can’t predict value

0% 10% 20% 30% 40% 50%

Definitely notrecommended

Not recommended

Neutral

Recommended

HighlyRecommend

Q: Would you recommend using clickerquestions in upper-level physics courses?

In popular pure lecture, No clickers (QM II, n=17)Add Clickers (QM I, n=30)Subtract clickers (EM II, n=16)

Page 19: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

WHAT DOES IT LOOK LIKE?WHAT DOES IT LOOK LIKE?

Page 20: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

What does it look like?

• A range of courses• Depends on faculty:

– # of questions per lecture– Timing of questions– Amount and character of peer discussion– Depth of questions

Page 21: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

Video

• Video - what do upper division clickerquestions look like?

Video: What does upper div clicker questionlook like?

Page 22: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

Students’ recommendation for implementation

# of Qs per hour: 2-5 [2-3 (62%); 4-5+ (21%)]

Timing: Interspersed with lecture (87%)

Peer-discussion: Allow and encourage (80%)

Preferred response mode: 93% prefer peer discussion as part of response93% prefer peer discussion as part of response 64% prefer some time for individual thinking prior to peer discussion 64% prefer some time for individual thinking prior to peer discussion

Upper div courses using clickersN=11 courses, 224 responses

Page 23: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

Completely useless

Mostly useless

Somewhat useful

Useful

Very useful

Challenging conceptual

Recalling a previous fact

Recalling a recent factPlugging numbers into equation

Types of clicker questions:

0% 10% 20% 30% 40% 50% 60%% of students

How useful for learning?91%35%36%18%

N=4 courses, 66 students

Preferred types of questions

Page 24: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

Tips for Success

• Tell students why youʼre using clickers• Ask questions that are challenging (but

not too hard)• Connect questions to lecture• Create a comfortable environment for

discussion• Donʼt stress grading of clickers

Video: Writing questions

Page 25: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

Video: Writing upper division clicker questions

Page 26: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

Writing clicker questions

For example:

• Conceptual• Math/Physics connection• Application of ideas• Step in calculation, proof, derivation

These are similar to lower-division questioncategories

Page 27: Clickers in Upper-Division · PDF fileClickers in Upper-Division Courses Stephanie V. Chasteen Kathy Perkins Michael Dubson Steven Pollock ... questions compared to pure lecture with

AAPT Feb 2009Chilly Chicago

Stephanie V. ChasteenClicker Use in Upper-Level Courses

Univ. of ColoradoBreezy Boulder

Thank you!

• PER course materials for Quantum and E&Mhttp://www.colorado.edu/sei/departments/physics.htm

• Clicker videos and todayʼs talk atSTEMclickers.colorado.edu

[email protected]

Handouts at the back!