![BYOD Guide Created using iThoughts [...] [...]. BYOD Guide.](https://static.fdocuments.in/doc/165x107/56649c935503460f9494f988/byod-guide-created-using-ithoughts-byod-guide.jpg)
Large-Scale BYOD Wireless LMS Midterm and Final Exams (289157590)
16
Large-Scale BYOD Wireless LMS Midterm & Final Exams Rob Peregoodoff, Director Learning Services @ Sauder School of Business UBC
description
Since 2010, the Sauder School of Business at the University of British Columbia has been conducting large-scale, BYOD, wireless, LMS midterm and final exams. As of January 2015, they have conducted over 20,000 individual student exams across every academic division area. This session will share the complete process, from design to delivery to concluding analytics.Outcomes: Learn about pedagogical values and principles followed when collaborating with professors on exam/question design * Learn how logistical planning mitigates technical issues and response when they do occur * Discover methods of addressing exam integrity http://www.educause.edu/annual-conference/2015/large-scale-byod-wireless-lms-midterm-and-final-exams
Transcript of Large-Scale BYOD Wireless LMS Midterm and Final Exams (289157590)
Large-Scale BYOD Wireless LMS
Midterm & Final Exams
Rob Peregoodoff, Director Learning Services @ Sauder School of Business UBC
Not Your Parent’s Multiple Choice
Disclaimer
Any views or opinions presented here are solelythose of the presenter and do not necessarilyrepresent those of Sauder or UBCadministration, faculty, instructors or staff
• Vancouver, British Columbia
• ~58,000 students
• 17 faculties
• 32nd in Times Higher Ed Global Rankings
• ~4500 BCom, MBA, Ph.D. students
• Ranked 20th in world by Financial Times amongst B-schools in research
• Ranked 49th in world by Financial Times for Exec. Ed.
Roadmap
• Exam integrity – discussion
• Question Design – activity
• Exam Data and LA – sharing and activity
• Exam Logistics – sharing and Q/A
• A story…
• The Future
Exam Integrity/Security
Straw Poll -> how many of you have ever
conducted a large (+50) major assessment
online?
At your table, please spend a few minutes sharing
why online exams are a bad idea
What we don’t do…
What we do
Question Design
• Can I ask for two volunteers, preferably with backgrounds in
modelling for business decisions, Linear Programming,
Excel, etc. to complete some questions from a midterm
exam. You will be given ~10 minutes to complete the exam
designed for 90…
• Activity = suspend all of your beliefs and current assumptions
regarding online assessments. If you could design your
‘dream’ online question for your area of expertise, what would
that question look like? Take 3 minutes. Remember, no
technical or security restrictions. This is higher ed exam
nirvana!
Data and Learning Analytics
Please open the envelope at your table labelled Online Exam Data, every second person should be given 1 package.
You are looking at:
• Page 1 -> Summary performance data for a midterm conducted last Tuesday evening for 657 students
• Pages 2 - 4 -> Item Analysis data for same midterm
1. Note page 4 red boxes
• Pages 5 – 9 -> Access Log data for 3 individual students. Can you identify from these logs which student:
Achieved the highest score in the exam = 99.7%
Achieved the lowest score in the exam = 18.3%
Achieved the median score in the exam = 70.9%.
2
1
3
Logistics (failure is not an option…)
Please open the envelope labelled Online Exam Logistics, again there are 4 copies per table
These sheets are divided into two categories:
• Front of House (students) – pages 1-4
• Back of House (instructors/invigilators/support staff) – pages 5-8
These are the actual sheets we use, you are welcome to take and use them as you wish.
I am more than happy to answer queries this evening or online for anything you would like clarification on.
A Story… last Friday night
6:10 pm ~940 students in 21 rooms enter for a 6:30 start with expectations to be out by 8:00 pm to begin their weekend
6:20 pm we instruct them to launch their devices and connect to UBC Secure (our institutional secure network) and we get building full of, “Sir…”
call the 24/7 IT Help Desk but can’t connect…send an email via 4G
6:30 pm send email to the UBC CIO and also the director of application management
6:33 pm am told there is a problem…ask the key question, expected resolution time?
6:45 pm Students encouraged to visit washrooms and review material…one class begins karaoke
7:05 pm receive a message from network group…core router outage, rollover failed, staff returning to campus to conduct manual rollover
7:10 pm students thanked for their patience and sent home with instructions to watch for further instructions…
Our Future…I think… Access to webpages A, B and C but not
X, Y and Z
Ability to collaborate, “hey, can anyone help
with the wording of Q8?”
For a deduction of 25%, click here for
a hint…
Ability to service all exam
requirements:Keyboards, stylus,
custom applications, etc.
Assessment metrics and measures we
haven’t thought of yet…
Help Us Improve and Grow
Thank you for participating
in today’s session.
We’re very interested in your feedback. Please take
a minute to fill out the session evaluation found within
the conference mobile app, or the online agenda.
https://ca.linkedin.com/in/robperegoodoff
