Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department...
-
Upload
rosamond-lambert -
Category
Documents
-
view
214 -
download
0
Transcript of Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department...
![Page 1: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/1.jpg)
Assessment in Online CoursesGerd KortemeyerMichigan State University
APS/AAPT 2013Department Chairs Conference and Workshop
Workshop Accesshttps://s10.lite.msu.edu/Username: the email address with which you registered, all lowercasePassword: APS/AAPT
![Page 2: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/2.jpg)
Background - MyselfHave run
◦completely online large enrollment algebra-based physics courses
◦completely online physics preparation courses “remedial” math, etc.
◦blended 120-student calculus-based physics courses
Director of LON-CAPA and CourseWeaver Projects
![Page 3: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/3.jpg)
Background – Physics at MSUMSU has been running completely
online and blended large enrollment physics courses for over a decadeLike many other departments, way beyond
the “bubble”Essential and integral part of our
curriculum“Online” is more than just MOOCs
The courses that I have been teaching did not use a printed textbook
![Page 4: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/4.jpg)
Background - PlatformLON-CAPAFree open-source systemHas been used for almost 8000
courses at 160 institutionsCombines granular reading
materials and assessment resources into online coursepacks
All content shared
![Page 5: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/5.jpg)
Background - Platform
Over 440,000 resources, text and assessment combined
200,000 online assessment problems
![Page 6: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/6.jpg)
Background - PlatformEvery student gets a different
version of the same problem◦Different numbers, graphs, formulas,
options, images, movies◦Students can collaborate, but not
simply copy answer
![Page 7: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/7.jpg)
Background - Platform
Simple numerical response
![Page 8: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/8.jpg)
Background - PlatformDifferent formulas, same concept
![Page 9: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/9.jpg)
Background - Platform
Different formulas, infinitely many correct answers
![Page 10: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/10.jpg)
Background - Platform
![Page 11: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/11.jpg)
Background - Platform
![Page 12: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/12.jpg)
Background - Platform
Lifting/lowering,speeding up/slowing down,different numbers
![Page 13: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/13.jpg)
Background - Platform
Same options, but different one is correct
Need to change this, too
![Page 14: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/14.jpg)
Background - Platform
Using answer provided by learning in subsequent part
![Page 15: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/15.jpg)
Background - Platform
Two ways howthe paper couldslide off the fridge:
•Magnet slides offpaper•Paper and magnetslide off fridge
Depending onvalues, one or theother decides.
![Page 16: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/16.jpg)
AssessmentAssessment: Feedback to learners
and instructorsFormative assessment:
◦Students can keep track of their own learning Students do not fall behind
◦Instructors keep track of their students’ learning Instructors can adapt the teaching to the
learning
Summative assessment: exams◦Technology allows for frequent exams
![Page 17: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/17.jpg)
AssessmentEmbedded and integrated into
instruction◦Bloom’s Taxonomy
Embedded reading questions
End-of-chapter questions, exams
Projects, papers
![Page 18: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/18.jpg)
AssessmentTeaching
and assessment combined◦Low Bloom
level embedded into reading
◦Higher level as homework, later duedate
![Page 19: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/19.jpg)
AssessmentFeedback at
every level to◦learner◦instructor◦author
![Page 20: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/20.jpg)
Feedback
Difficult problems
Discussions
![Page 21: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/21.jpg)
Feedback
![Page 22: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/22.jpg)
Feedback
DiscussionsEncouraged, since all students have different versions.Feedback and peer-instruction.
![Page 23: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/23.jpg)
Good and not-so-good behaviorSelf-reported: what do students
do?
Gerd Kortemeyer, Gender differences in the use of an online homework system in an introductory physics course, Phys. Rev. ST Phys. Educ. Res. 5, 010107 [8 pages] (2009)
![Page 24: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/24.jpg)
Good and not-so-good behavior
1.0E+00 1.0E+01 1.0E+02 1.0E+03 1.0E+04 1.0E+05 1.0E+06 1.0E+070
10
20
30
40
50
60
70
80
90
100
Male (N=85070)Female (N=126047)
Seconds between Subsequent Submissions
Inte
gra
l S
ub
mis
sio
n [
Perc
en
t]
1 min 1 hr
Gerd Kortemeyer and Peter Riegler, Large-Scale E-Assessments, Prüfungsvor- und -nachbereitung: Erfahrungen aus den USA und aus Deutschland, Zeitschrift für E-Learning, Volume 5, Issue 1, (2010)
Tim
e it
take
s to
read
pro
ble
m
Guessing
![Page 25: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/25.jpg)
Good and not-so-good behaviorStudents do not always take
optimal advantage of◦the offered formative assessment
more in a later session
◦the online materialsBut in spite of that: it works,
mostly!
![Page 26: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/26.jpg)
Learning SuccessIn several semesters, gave same
or similar final exams for blended and completely online sections◦Controlled environments for all
sections Bubble sheet in-class External proctors the exception for
completely online students, most took in-class exams
What do you think was the outcome?
![Page 27: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/27.jpg)
Learning SuccessThe online course did slightly better
(large numbers, so even significantly)◦In other words: traditional lecture was
not helpful Caveat: these students were self-selected Important: this was not my course
Now using clickers and PER in lecture, which hopefully would shift the result
![Page 28: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/28.jpg)
Learning SuccessTraditional lectures:
◦Fun for us, since we like to hear ourselves talk◦Students might think they make a difference
But they don’t
◦And yes, even the most charismatic lecturer cannot bring about better learning Only more excitement and appreciation for the
subject Not to be underestimated!
But in the end, the learner has to do the hard work◦Thus, formative assessment!
![Page 29: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/29.jpg)
Learning SuccessOn the other hand, online
assessment does make a difference
Rewind way earlier, over a decade, before the department was lon-capsized
![Page 30: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/30.jpg)
Learning Success
• Intro Physics for Scientists and Engineers• Moved to blended format• Grades in years before and after online homework
![Page 31: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/31.jpg)
Learning Success
Mostly helped students who are on the brink of failing the course.
Fail
![Page 32: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/32.jpg)
Learning SuccessGender-specificFirst semester
(black):◦No online
homework◦Gender gap
Second semester(gray):◦With online
homework◦Less gender-gap
![Page 33: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/33.jpg)
SummaryTraditional lectures are uselessFormative assessment is good
![Page 34: Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access](https://reader035.fdocuments.in/reader035/viewer/2022062515/56649f485503460f94c6a783/html5/thumbnails/34.jpg)
Thank you!Gerd Kortemeyer
Workshop Accesshttps://s10.lite.msu.edu/Username: the email address with which you registered, all lowercasePassword: APS/AAPT