Post on 31-Mar-2015
www.sakaiproject.org 1
Tests and Quizzes Tool(aka SAMigo)
Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford University Learning Activity Designer
www.sakaiproject.org 2
Where did the design originate?• Formative Assessment (Homework)
– Stanford Assignment Tool for Human Biology– CourseWork CMS with Language Tools
(Andrew W. Mellon Foundation funded)
– OKI Tools Workshop to Specify Functionality(Andrew W. Mellon Foundation funded)
– OKI Formative Assessment Tool(Andrew W. Mellon Foundation funded)
• OnCourse Quiz Tool– Online testing
www.sakaiproject.org 3
Where did the design originate?
• OKI Tools Workshop– Many schools met to define needs for a CMS– One group specified the needs for an
Assessment Tool– Several hundred functional requirements
identified
www.sakaiproject.org 4
Where did the design originate?
• Assignment and Assessment Manager – Supports teaching and learning in
large lecture science courses and in language instruction
– OKI Tool developed at Stanford– Andrew W. Mellon Foundation funded
www.sakaiproject.org 5
Where did the design originate?
• OnCourse CMS for Indiana University instructional support
www.sakaiproject.org 6
What are its features:
• Assessment Authoring
• Assessment Publishing
• Assessment-taking Management
• Assessment Grading
• Question Pools Management
• Publishing Template Management
www.sakaiproject.org 7
Organize & Publish Assessments
• Library of assessments for a course– Can be ex/imported in QTI XML format
• Published assessments with responses, grades– Can be published to sections, groups in course– Can have different release, due, retract dates
www.sakaiproject.org 8
www.sakaiproject.org 9
Question Types• Multiple Choice (single and multiple correct)• Multiple Choice Survey• True/False• Matching• Essay/Short Answer• Fill in the Blank• File Upload• Audio Recording** in future Sakai 2.x release
www.sakaiproject.org 10
www.sakaiproject.org 11
Multimedia Everywhere
• WYSIWYG editor
Fonts, style, layout, images, HTML, links
• In section headers, question texts, selections for responses, feedback, comments
www.sakaiproject.org 12
www.sakaiproject.org 13
Pedagogical Flexibility
• Online test
• Self-study questions
• Homework, problem-sets
• Essay, code, or project submission
• Language drills
• Quick knowledge probes
• Others???
www.sakaiproject.org 14
Online Test• Unique tests for each student
– Randomized order of questions– Randomized draw from question pools
• Timed test-taking during access window– Auto-submit at end of timed period
• One submission only per student• Higher Security
– IP Addresses restricted– Secondary Password (proctored)
• No late submissions accepted• Scores transferred to gradebook
www.sakaiproject.org 15
www.sakaiproject.org 16
Self-Study Questions
• Immediate feedback
• Random access to Questions – Table of contents– Marked for review list
• No record of score in gradebook
• No due date; always available to student
• Unlimited submissions allowed
www.sakaiproject.org 17
www.sakaiproject.org 18
Homework/Problem Sets• Published with multiple release and due dates
for different sections• Multiple methods for handling late submissions• Students can save work during assignment
period.• Auto-grading with methods for diagnosing
learning problems • Quick-reviews of student aggregate performance
by instructors viewing histograms, statistics.• Pools for organizing questions for reuse
www.sakaiproject.org 19
Essay and Project Submission
• Use file upload question type for submitting any type of document
• Grader can download assignment; upload marked-up file to return to student
• Grades are recorded in gradebook
www.sakaiproject.org 20
Templates
• Create Assessment “Types” for different disciplines, different uses
• Select what which choices are available to the instructor.
• Hide complexity by making choices for the type (e.g., Self-study always has immediate feedback)
www.sakaiproject.org 21
www.sakaiproject.org 22
www.sakaiproject.org 23
Question Pools
• Organize questions into multiple subpools
• Export and import questions in IMS QTI format.
• Author Questions from within Pool Mgr.
• Randomly draw from pools for an assessment
www.sakaiproject.org 24
Demo
www.sakaiproject.org 26
www.sakaiproject.org 27
www.sakaiproject.org 28
www.sakaiproject.org 29
www.sakaiproject.org 30
www.sakaiproject.org 31
www.sakaiproject.org 32
www.sakaiproject.org 33
www.sakaiproject.org 34
www.sakaiproject.org 35
www.sakaiproject.org 36
www.sakaiproject.org 37
www.sakaiproject.org 38
www.sakaiproject.org 39
www.sakaiproject.org 40
www.sakaiproject.org 41
www.sakaiproject.org 42
www.sakaiproject.org 43
www.sakaiproject.org 44
www.sakaiproject.org 45
www.sakaiproject.org 46
www.sakaiproject.org 47
www.sakaiproject.org 48
www.sakaiproject.org 49
2.0 Highlights
• Full integration into Sakai framework
• Assessment scores to Gradebook
• File upload question type
• Play with it:http://nightly2.sakaiproject.org/portal
www.sakaiproject.org 50
T&Q 2.x Future
• Implementation of 2.0 framework – Release assessments to specific classes and
sections– Department template– Question Pool sharing
• Audio-recording question type
www.sakaiproject.org 51
T&Q post 2.x Future
• Establish a T&Q sub-team (designers and developers)
• New features via Assessment DG (post Baltimore conference) and feature prioritization process
• New code via committer strategy that mirrors Sakai process
• See you in Austin! (Dec. SEPP conf.)
www.sakaiproject.org 52
Questions?
www.sakaiproject.org 53
ContactsMarc Brierley, Stanford University T&Q Project Manager and Lead Designer marc.brierley@stanford.edu Charles Kerns, Stanford University Learning Activity Designer charles.kerns@stanford.edu