Post on 27-Dec-2015
Forecasting Exam Scores Based on How Students Participate in Introductory Geoscience Courses
PERRY SAMSONUNIVERSITY OF MICHIGAN-ANN ARBOR
(using PowerPoint!)
@PJSAMSON
Active Learning“The studies analyzed here document that active learning
leads to increases in examination performance that would
raise average grades by a half a letter, and that failure
rates under traditional lecturing increase by 55% over the
rates observed under active learning.”
Freeman et al. (2014)Active learning increases student performance in science, engineering, and mathematicsPNAS 2014 111 (23) 8410-8415
Note Confusion
Bookmark Slides
Pose/Review Questions
Take Notes
Video Capture Screen Capture
View Slides
Student View
-------------------
Active Learning Platform
@PJSAMSON
The Value of Anonymity in Inquiry
Q. When I have questions in class, I am comfortable asking them verbally.
@PJSAMSON
The Value of Anonymity in Inquiry
Q. When I have questions in class, I am comfortable asking them verbally.
Female Male0.0
0.5
1.0
1.5
2.0
2.5
3.0
3.5
4.0
4.5
Averg
ae Q
uest
ion
s/S
tud
en
t
Number of students 158
Number of questions asked
413
Average number of questions/student
2.7
@PJSAMSON
Justify Answers
Answer Questions
Image-Base Questions
Optional:
Require students to justify their selection.
Multiple Choice
Image Quiz
Learning Analytics Database
Confusion
Questions Posed
Activity Answers
Notes
Attendance
Bookmarks
Lecture Capture
Creating an Ecosystem
22-Ja
n
25-Ja
n
28-Ja
n
31-Ja
n
3-Fe
b
6-Fe
b
9-Fe
b
12-F
eb
15-F
eb
18-F
eb
21-F
eb
24-F
eb
27-F
eb
2-Mar
5-Mar
8-Mar
11-M
ar
14-M
ar
17-M
ar
20-M
ar
23-M
ar
26-M
ar
29-M
ar
1-Ap
r
4-Ap
r
7-Ap
r
10-A
pr
13-A
pr
16-A
pr0
20
40
60
80
100
120
140
160In the classroom From my school residenceFrom elsewhere Missing
Nu
mb
er
of
Stu
den
ts
Assume You Knew Everything Your Students Did as Part of ClassNOW WHAT?
Multiple Courses: Winter 2015
COURSE INSTRUCTOR SIZE
MOVESCI 230 M. Gross 103
AOSS 102 F. Marsik 187
@PJSAMSON
Relationship of Attendance vs. Grades
<70 70-80 80-90 >900
1
2
3
4
5
6
7
8
9
AOSS 102
MOVESCI 230
Exam 1 Grades
Cla
sses A
tten
ded
Relationship of Reviewing Lecture Capture vs. Grades
<70 70-80 80-90 >9040
60
80
100
120
10
15
20
25
30
MOVESCI230
AOSS102
Exam 1 Grades
MO
VES
CI
23
0
AO
SS
10
2
@PJSAMSON
Relationship of Note Taking
vs. Grades
<70 70-80 80-90 >90100
150
200
250
300
350
400
200
300
400
500
600
700
800
AOSS 102
MOVESCI 230
Exam 1 Grades
Note
s T
aken
AO
SS
10
2/A
OS
S1
05
Note
s T
aken
MO
VES
CI
23
0
Relationship of Slide Viewingvs. Grades
<70 70-80 80-90 >900
20
40
60
80
100
120
0
30
60
90
120
150
180
AOSS 102
MOVESCI 230
Exam 1 Grades
Slid
es
w/N
ote
s: A
OS
S1
02
Slid
es
w/N
oyes:
MO
VS
CI2
30
1.0 2.0 3.0 4.040
50
60
70
80
90
100
Incoming GPA
Exam
#1
Sco
re
<2.5 2.5-3.0 3.0-3.5 >3.50
2
4
6
8
10
12
Attendance
Incoming Grade Point Average
Nu
mb
er
of
Cla
sses
Att
en
ded
Attendance by itself is not a predictor of student success.
@PJSAMSON
<2.5 2.5-3.0 3.0-3.5 >3.50
5
10
15
20
25
Incoming Grade Point Average
Min
ute
s o
f Le
ctu
re C
ap
ture
V
iew
ed
pe
r C
lass
Successful Students Behave Differently
<2.5 2.5-3.0 3.0-3.5 >3.50
50
100
150
200
250
300
350
Number of Slides Viewed
Incoming Grade Point Average
Nu
mb
er
of
Slid
es
Vie
wed
<2.5 2.5-3.0 3.0-3.5 >3.50
20
40
60
80
100
120
140
Number of Notes Taken
Incoming Grade Point Average
Nu
mb
er
of
Slid
es
Vie
wed
Low GPA students take five times fewer than high GPA students.
@PJSAMSON
1. Student exam scores are related to in-class participation measured as slides viewed, notes taken and more.
These terms should be valuable both for predictive analytics and as a basis for development of personalized feedback.
2. Levels of student participation are related to students’ incoming grade point average.
This supports the possibility that low grade point students lack motivation or study skills rather than cognitive ability.
Lessons Learned