High Stakes Testing on Sakai with Samigo and a Locked-down OS image
Tests & Quizzes (aka SAMigo )
description
Transcript of Tests & Quizzes (aka SAMigo )
![Page 1: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/1.jpg)
Tests & Quizzes (aka SAMigo)
Christine Doherty, Stanford UniversityJune 16, 2011
![Page 2: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/2.jpg)
Agenda
• Future of T&Q: Development Dilemmas• Community Contribution• 2.8 Highlights• 2.9 Plans• Q&A
![Page 3: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/3.jpg)
Future of T&Q:Development Dilemmas
![Page 4: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/4.jpg)
Guiding Principles
Flexibility/FreedomReliability/Error-Free
![Page 5: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/5.jpg)
Development Focus
Improve UI/Interaction Add New Features
![Page 6: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/6.jpg)
Project Management
Stanford as Gatekeeper Modularize/Distribute
![Page 7: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/7.jpg)
Community Contribution
![Page 8: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/8.jpg)
New Release Process
http://confluence.sakaiproject.org/confluence/display/SAM
![Page 9: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/9.jpg)
Rationale
• User experience reviews are critical:• New features can cause clutter in UI, confusion, bad
user experience
• New features can clash with existing or planned features and lead to unexpected behavior
• Stanford only has one designer to tackle the workload, so we need help
![Page 10: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/10.jpg)
Requirements for Contributions
Clear specs are a must:
• Rationale for new feature/enhancement
• Description of expected behavior
• Documentation of all affected screens
• Screen shots desirable
![Page 11: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/11.jpg)
TimelineDate Milestone
June 1 Contributor submits design specs for new feature or enhancement via JIRA. SAMigo developers route spec to UX team for review.
Jun 15 Stanford provides initial feedback on specs
July 1 Contributor responds with revisions July 15 Stanford gives second round of feedback August 15 Contributed code QA'ed to revised spec and submitted to
Stanford September 1 SAMigo code freeze for release; Sakai QA team begins
![Page 12: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/12.jpg)
2.8 Highlights
![Page 13: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/13.jpg)
Respondus Integration before 2.8
Respondus Sakai – T&Q
Question Types ChangedMissing Metadata
![Page 14: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/14.jpg)
Respondus Integration in 2.8
Respondus Sakai – T&Q
QTI XML or Zip file from RespondusImports to Sakai Tests & Quizzes
![Page 15: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/15.jpg)
Respondus Integration
![Page 16: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/16.jpg)
Respondus Integration
![Page 17: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/17.jpg)
Respondus Integration
Respondus Sakai – T&Q
Respondus Sakai – T&Q
![Page 18: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/18.jpg)
Record Average Score
• New Feature: ability to record average score for multiple submissions
• Redesigned UI for student’s Submitted Assessments list to accommodate displaying average scores
• Contributed by Rice University
![Page 19: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/19.jpg)
Record Average Score
![Page 20: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/20.jpg)
Record Average Score
![Page 21: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/21.jpg)
Record Average Score
![Page 22: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/22.jpg)
Record Average Score
![Page 23: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/23.jpg)
Record Average Score
![Page 24: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/24.jpg)
Record Average Score
![Page 25: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/25.jpg)
Record Average Score
![Page 26: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/26.jpg)
Record Average Score
![Page 27: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/27.jpg)
Record Average Score
![Page 28: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/28.jpg)
Release Scores Only
• Based on feedback from instructors wanting to show students their scores without allowing them to see questions again (since questions are reused in subsequent tests)
• Solution is to separate out scores from rest of feedback options
![Page 29: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/29.jpg)
Release Scores Only to Students
![Page 30: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/30.jpg)
Release Scores Only
![Page 31: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/31.jpg)
Clarification of Settings
![Page 32: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/32.jpg)
Send zero scores to Gradebook for non-submission records
• Clash of scoring rules in Tests & Quizzes and Gradebook caused inability to set zero scores for non-submission records for inclusion in course grade calculation
• Solution is to allow instructors to explicitly enter a zero score for a non-submission record that gets sent to gradebook
• Patch contributed by Longsight
![Page 33: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/33.jpg)
Send zero scores to Gradebook for non-submission records
![Page 34: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/34.jpg)
Send zero scores to Gradebook for non-submission records
![Page 35: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/35.jpg)
Send zero scores to Gradebook for non-submission records
![Page 36: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/36.jpg)
Send zero scores to Gradebook
![Page 37: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/37.jpg)
Send zero scores to Gradebook for non-submission records
![Page 38: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/38.jpg)
Send zero scores to Gradebook for non-submission records
![Page 39: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/39.jpg)
Send zero scores to Gradebook for non-submission records
![Page 40: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/40.jpg)
Rich Text Entry for Short Answer/Essay
• Instructors from several institutions requested a way for students to enter rich text in essay questions for equations, foreign characters, or just general formatting
• Solution is to present students with the ability to use the FCKeditor in Short Answer/Essay questions.
• Contributed by Longsight
![Page 41: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/41.jpg)
Rich Text Entry for Short Answer/Essay
![Page 42: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/42.jpg)
Rich-text for Short Answer
![Page 43: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/43.jpg)
Rich-text for Short Answer
![Page 44: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/44.jpg)
Publish Action
• Based on feedback that Settings and Publish actions were redundant, both leading to Settings page
• Solution is to link Publish action to Publish Assessment page where settings are verified and notification added (if desired)
![Page 45: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/45.jpg)
Publish Action
![Page 46: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/46.jpg)
Publish Action
![Page 47: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/47.jpg)
Publish Action
![Page 48: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/48.jpg)
Publish Action
![Page 49: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/49.jpg)
Remove Assessment Types
• Assessment Types often prove to be confusing to instructors, since they may not know what the labels mean and what settings go with them
• One solution is to remove any trace of assessment types with a sakai property (samigo.showAssessmentTypes=False)
• Contributed by Longsight
![Page 50: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/50.jpg)
Remove Assessment Types
![Page 51: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/51.jpg)
Remove Assessment Types
![Page 52: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/52.jpg)
Remove Assessment Types
![Page 53: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/53.jpg)
2.9 Plans
![Page 54: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/54.jpg)
Stanford contributions for 2.9
• Restyling and rewriting of warning messages
• Reset selection and warning messages redraw at current question, instead of top of page
• Reworking automatic submission logic
• Validation for numeric response questions
• Count Characters button for Short Answer/Essay questions
• Render part information and images in Print view
![Page 55: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/55.jpg)
Community contributions for 2.9
• Redesign of main Assessments page (Longsight)
• Calculated question type (University of Dayton)
• Survey – Matrix of Choices question type (Rutgers)
• Extended Matching Item question type (University of Cape Town)
![Page 56: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/56.jpg)
Redesign of Main Assessments Page
![Page 57: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/57.jpg)
Redesign of Main Assessments Page
![Page 58: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/58.jpg)
Contacts
Questions and feedback: [email protected]
Lydia Li, Stanford University Project Manager [email protected]
Karen Tsao Samigo Developer [email protected]
Homepage:http://confluence.sakaiproject.org/confluence/display/SAM
![Page 59: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/59.jpg)
Online Final Exams Using Sakai at Stanford University
Jamie Tsui
9:45 AM - 10:15 AM in Beaudry B
![Page 60: Tests & Quizzes (aka SAMigo )](https://reader036.fdocuments.in/reader036/viewer/2022062222/56816731550346895ddbda4b/html5/thumbnails/60.jpg)
Questions?