PeerWise scaffolding for Biomolecular Science (Vet Med @ Glasgow University)
Peerwise - Paul Denny - Edinburgh 2011 (part 2)
-
Upload
eduniscieng -
Category
Education
-
view
951 -
download
0
description
Transcript of Peerwise - Paul Denny - Edinburgh 2011 (part 2)
![Page 1: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/1.jpg)
Paul Denny
PeerWisefamiliarity breeds content
Department of Computer Science
The University of Auckland
New Zealand
University of Edinburgh
Peer Feedback and Assessment for Science and Engineering
17th December, 2010
student-authored questions using PeerWise
![Page 2: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/2.jpg)
Goals
• Hands-on with PeerWise
– authoring, answering, evaluating
• Selected results
• Getting started
– with your students
![Page 3: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/3.jpg)
![Page 4: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/4.jpg)
What is PeerWise?
• Web-based MCQ repository built by students
![Page 5: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/5.jpg)
Your turn
http://peerwise.cs.auckland.ac.nz
Google: peerwise
or
![Page 6: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/6.jpg)
Registration
Click the “Registration” link
![Page 7: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/7.jpg)
Registration
Begin registration
![Page 8: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/8.jpg)
Choose a user name
Enter any user name you like
![Page 9: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/9.jpg)
Choose a password
Choose a password for
your account. Make sure
you remember what this
is!
![Page 10: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/10.jpg)
Enter the “Course ID”
The Course ID for this
workshop is:
5279
Enter this Course ID
![Page 11: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/11.jpg)
Enter your “Identifier”
Enter your “Identifier” value
![Page 12: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/12.jpg)
Confirm
You should see a green tick. Just click
“Confirm”
![Page 13: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/13.jpg)
You can now log in and begin...
You can now log in with
your username and
password.
![Page 14: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/14.jpg)
Hands-on demonstration
• Creating, answering, evaluating questions
![Page 15: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/15.jpg)
Research
• What do students think?
– Auckland
– Edinburgh
• Repository quality?
• Activity linked to performance?
![Page 16: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/16.jpg)
What do students think?
“I actually found it enjoyable, as sad
as that sounds.”
Student feedback
![Page 17: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/17.jpg)
What do students think?
• Survey responses (n = 439)
– ENGGEN 131, Semester 2, 2007
Developing new questions
helped me learn
Answering other student's
questions helped me learn
![Page 18: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/18.jpg)
What do students think?
• Survey responses (n = 387)
– ENGGEN 131, Semester 2, 2009
Developing new questions
helped me learn
Answering other student's
questions helped me learn
![Page 19: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/19.jpg)
What do students think?
• Focuses attention on learning outcomes
"What I found most interesting was how
other people structured their questions.
It kind of made me think about what kind
of topics or concepts people felt were
important to the course, hence their
choice of making a question on a
particular topic."
![Page 20: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/20.jpg)
What do students think?
• Focuses attention on learning outcomes
• Express understanding in their own words
"The biggest learning experience for me was
setting up my multi-choice question...
...in the end it was a lot of help because i was just
about able to answer any question that was on
the same topic as my question"
![Page 21: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/21.jpg)
What do students think?
• Focuses attention on learning outcomes
• Express understanding in their own words
• Question bank for drill and practice revision
"I answered over 100 questions, it was a
quick way to test my knowledge and if I
got the answer wrong the explanations
helped me learn something I wasn't too
sure with."
![Page 22: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/22.jpg)
What do students think?
• Focuses attention on learning outcomes
• Express understanding in their own words
• Question bank for drill and practice revision
• Peer comparison
"Being able to see how other people answered was
great as it allowed me to recognise at which level I
was at compared to everyone else"
![Page 23: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/23.jpg)
Edinburgh
• We sought student feedback both in ‘wash-
up’ sessions after the assessment and in the
end of course questionnaire
![Page 24: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/24.jpg)
Edinburgh
![Page 25: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/25.jpg)
![Page 26: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/26.jpg)
![Page 27: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/27.jpg)
Repository quality?
“The quality of questions range from
meaningless questions to questions
that stimulate your brain.”Student feedback
![Page 28: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/28.jpg)
Repository quality?
• Selected finding
– how often is the author’s answer incorrect?
![Page 29: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/29.jpg)
Repository quality?
• Selected finding
– how often is the author’s answer incorrect?
COMPSCI 101, Semester 1, 2008
617 questions
Analysis: 10% (62 questions)
BIOCHEM 233, Semester 1, 2010
528 questions
Analysis: 20% (109 questions)
![Page 30: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/30.jpg)
Repository quality?
• Selected finding
– how often is the author’s answer incorrect?
COMPSCI 101, Semester 1, 2008
617 questions
Analysis: 10% (62 questions)
BIOCHEM 233, Semester 1, 2010
528 questions
Analysis: 20% (109 questions)
![Page 31: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/31.jpg)
Dr. Steven Bottomley
Faculty of Health Sciences, Curtin University
At OzBio 2010, Melbourne, October 2010
![Page 32: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/32.jpg)
![Page 33: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/33.jpg)
Edinburgh
• Quality of submissions:
– Average quality was very good
– Few trivial questions / nonsense distracters
– Highest quality questions were EXCEPTIONALLY
good
![Page 34: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/34.jpg)
Activity linked to performance?
“Using PeerWise was very useful for
learning things I didn't know I didn't
know.”Student feedback
![Page 35: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/35.jpg)
Activity linked to performance?
• Do the most active students improve their
position in class?
– study at the University of California, San Diego
CSE 8A CSE 8B
Fall 2008 Winter 2009
prerequisite
![Page 36: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/36.jpg)
Activity linked to performance?
• Do the most active students improve their
position in class?
– study at the University of California, San Diego
CSE 8A CSE 8B
Fall 2008 Winter 2009
n = 73
Final exam grade provides
class rank in CSE 8A
Final exam grade provides
class rank in CSE 8B
![Page 37: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/37.jpg)
Activity linked to performance?
• Quartiles based on number of questions
answered
Q1 Q2 Q3 Q4
![Page 38: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/38.jpg)
Activity linked to performance?
• Change in rank from CSE 8A to CSE 8B
– (mean number of questions answered)
![Page 39: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/39.jpg)
Activity linked to performance?
• Replicated the following term
Winter 2009 (n=73) Spring 2009 (n=53)
The highest performing
students in the pre-requisite
course were most active
The lowest performing
students in the pre-requisite
course were most active
![Page 40: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/40.jpg)
Future work
• Multi-institutional collaboration
• Challenges
– Calendars
– Curriculums
Course 1
Institution ACourse 3
Institution CCourse 2
Institution B
PeerWise
![Page 41: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/41.jpg)
Future work
• At Edinburgh
– Does use improve course performance?
– Enhancements / changes for next year
• More consistent use across course
• More guidance from TAs / Staff?
![Page 42: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/42.jpg)
Creating a new PeerWise course
![Page 43: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/43.jpg)
Creating a new PeerWise course
123 234 345 456 567
![Page 44: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/44.jpg)
Creating a new PeerWise course
• Step 1)
• Step 2)
![Page 45: Peerwise - Paul Denny - Edinburgh 2011 (part 2)](https://reader034.fdocuments.in/reader034/viewer/2022050808/548700ceb4af9fa00d8b534f/html5/thumbnails/45.jpg)
Thank you
• Any questions?
– Now
– Later
Paul Denny
Department of Computer Science
The University of Auckland
PeerWise
peerwise.cs.auckland.ac.nz