Post on 22-Dec-2015
Cottrell Meeting (July/13/01): Pg 1
Check it out at: http://webug.physics.uiuc.edu/courses/ie.html
Can Students Learn Concept-Based Problem Solving on the Web?
Mats Selen
July 13, 2001Cottrell Scholars Meeting
Cottrell Meeting (July/13/01): Pg 2
OverviewOverview The Problem:
When given a quantitative physics problem, most students immediately resort to an “equation manipulation” strategy to solve the problem.
Too many students see “concepts” and “calculations” as two totally separate and unrelated activities.» When given a quantitative question, most students will
NOT think about the CONCEPTS that are involved.» When given a qualitative question, most students will
never consider writing down an appropriate equation… math is NOT seen as a TOOL
Our Approach:Create web-based instructional materials that will promote
“concept-based” problem solving among our introductory students.» Interactive Examples (work by Gary Gladding) !
Cottrell Meeting (July/13/01): Pg 3
Why we should stress concepts:Why we should stress concepts:
On this exam, the conceptual problems were worth about 30% of the total.
Physics 101 Midterm Exam 1, Spring 2000Physics 101 Midterm Exam 1, Spring 2000
Cottrell Meeting (July/13/01): Pg 6
Interactive Examples (Socratic Interactive Examples (Socratic Dialogue)Dialogue)
when students click in “Help”…
Start by asking a numeric question(usually multi-step)
Cottrell Meeting (July/13/01): Pg 7
…”Help” results in a discussion followed by some multiple-choice questions that lead them toward the answer…
Cottrell Meeting (July/13/01): Pg 9
…these steps are designed toteach students problem solvingapproaches as well as physics…
Cottrell Meeting (July/13/01): Pg 10
Eventually they get another (simpler) numeric question whoseanswer is needed to solve the primary numeric question.
Cottrell Meeting (July/13/01): Pg 11
Clicking on “Help” again results in asimilar dialogue as the first time,although one level “deeper”.
- Problems can be 4-5 levels deep
- Eventually they get enough info to solve the problem.
Cottrell Meeting (July/13/01): Pg 12
Once they get right the answer
And somefollow-upquestions
They get arecap
Cottrell Meeting (July/13/01): Pg 13
Structure:Structure:
Base question is a quantitative problem (multi-step).
Students can request help which comes in the form of more questions. Questions for which more help is always available. Questions that must be answered correctly to get more help.
Students can opt to answer the base question at any time.
Eventually, enough help is given to solve the problem.
Once base question is answered correctly: Full credit is given. A Recap is given (Conceptual, Strategic and Quantitative
Analyses). Follow-Up Questions (optional, i.e. no credit) are asked.
Cottrell Meeting (July/13/01): Pg 14
REAL Data: Student LogsREAL Data: Student Logs We record all student submissions on IEs: (the conversation)
Cottrell Meeting (July/13/01): Pg 15
These data are very useful These data are very useful for education research:for education research:
For example, some questions we might ask ourselves are: How “engaged” are students by the IE’s ?How, exactly, are they learning?
These can be investigated by analyzing the student logs:How much time do students spend on the IEs?
How well do the students do on their first response to M/C questions?
How deep into the IE do students go?
Cottrell Meeting (July/13/01): Pg 16
How Much Time Do Students Spend on IEs?How Much Time Do Students Spend on IEs?
0
5
10
15
20
25
30
trig
vecto
r
cartra
in
catch
ball
arro
w
balloon
carpend
twostrin
gs
belt
inclin
e
bobsle
d
Av
era
ge
Tim
e S
pe
nt
(min
)
Physics 101
0
5
10
15
20
25
30
particle
beam
pendulum
capacito
r
threecharges
RCI
RCII
RCIII
copperwire
fields
wall
emf
flux
loop2
Physics 101 IE #
Av
era
ge
Tim
e S
pe
nt
(min
)
Physics 102
Cottrell Meeting (July/13/01): Pg 17
How Well Do Students Do on their How Well Do Students Do on their First Response to M/C Questions?First Response to M/C Questions?
0.00
0.10
0.20
0.30
0.40
0.50
0.60
0.70
0.80
0.90
trig
vecto
r
cartra
in
catch
ball
arro
w
balloon
carpend
twostrin
gs
belt
inclin
e
bobsle
d
IE Question #
Av
g G
rad
e o
n R
ad
io Q
ue
sti
on
s
Physics 101
0.00
0.10
0.20
0.30
0.40
0.50
0.60
0.70
0.80
0.90
particle
beam
pendulum
capacito
r
threecharges
RCI
RCII
RCIII
copperwire
fields
wall
emf
flux
loop2
IE Question #A
vg
Gra
de
on
Ra
dio
Qu
es
tio
ns
Physics 102
Cottrell Meeting (July/13/01): Pg 18
How Deep Do Students Go in IEs?How Deep Do Students Go in IEs?
0.00
0.10
0.20
0.30
0.40
0.50
0.60
0.70
0.80
0.90
trig
vecto
r
cartra
in
catch
ball
arro
w
balloon
carpend
twostrin
gs
belt
inclin
e
bobsle
d
IE Question #
Av
g D
ep
th I
nto
IE
Physics 101
0.00
0.10
0.20
0.30
0.40
0.50
0.60
0.70
0.80
0.90
particle
beam
pendulum
capacito
r
threecharges
RCI
RCII
RCIII
copperwire
fields
wall
emf
flux
loop2
IE Question #A
vg
De
pth
In
to I
E
Physics 102
Cottrell Meeting (July/13/01): Pg 19
Does IE Performance Correlate Does IE Performance Correlate with Exam Performance?with Exam Performance?
Compare Physics 101 Hour Exam grade with Indicators of IE participation
0
5
10
15
20
25
0 20 40 60 80 100
Average Hour Exam 1 Score
Aver
age
No o
f Fol
low
ups
Done
0
10
20
30
40
50
60
70
80
0 20 40 60 80 100
Average Hour Exam 1 Score
Aver
age
Scor
e on
Firs
t Res
pons
e to
IE Q
uest
ions
• Observe some correlation between (unclear how to interpret this).
• Will probably advertise this to students to encourage participation.
Cottrell Meeting (July/13/01): Pg 20
StatusStatus
Algebra-based Courses at Illinois (Physics 101 and 102).Approximately 60 IEs were used in these courses in Fall 00.Very popular!
Used heavily in Physics 100.Remedial class for at-risk students.I.E. form most of the homework for this class.Since Physics 100 has no lecture, IE’s are particularly useful
since they provide some “give & take” type dialogue.
Will implement in calculus based sequence next.
Cottrell Meeting (July/13/01): Pg 21
What Do Students Think About IEs?What Do Students Think About IEs? Always Very Positive
Independent (OIR) Focus Group Study» 100% of students preferred IEs to the usual computer problems» The half that do the optional follow-ups felt they gained confidence
Our End of Term Surveys» 87% said that the interface was “very intuitive” or “reasonably
intuitive”» How effective were IEs at helping you to develop a problem solving
strategy? “very effective” (31%), “effective” (56%), “not very” (12%) Direct Comment Facility from IE itself:
» Low response, but 100% positive (very unusual for computer feedback)
» “the drawn out explainations are much like a one on one learning environment and are very helpful not only in the problem but in the concepts behind it”
» “if these interactive examples were not there to help me i would have gone insane trying to figure out these problems....and this makes me understand the problems much better than if i were to get help from someone in the class...i believe anyways...because this way i'm figuring it out basically on my own.…”