TLC2016 - Turning Blackboard Learn into a Digital Examination Platform: lessons learned from 8 years...

Click here to load reader

  • date post

    11-Apr-2017
  • Category

    Education

  • view

    399
  • download

    2

Embed Size (px)

Transcript of TLC2016 - Turning Blackboard Learn into a Digital Examination Platform: lessons learned from 8 years...

PowerPoint Presentation

Turning Blackboard Learn into a Digital Examination PlatformLessons learned through 8 years of practice

1

Geert De Schutter, Educational technologistWalter Roosels, Educational technologist

Exam in progress

Digital assessment/examination: Why?Strategic reasonsImage buildingEfficiency reasonsSaving time (large groups)Financial motivesStaff student ratioEducational motivesObjectivity, quality of assessment

13/02/2012

Digital assessment/examination: University of AntwerpFocus on efficiency and educational benefitsSaving time (large groups)Authenticity of assessmentUse various types of questions & multimediaAccurate, objective and quick correctionAutomating the repetitive character of correcting

13/02/2012

Facts and figures (4): students and examinations

5

Total amount of exams per studentTotal amount of students taking an exam

5

Facts and figures (1): Evolution since reference year 2009 - 20106

6

Facts and figures (3): 2014-20157

7

Capturing the vibe

8

Question 1: What about infrastructure?9

Availability of infrastructure

13/02/201210

Anti-cheat sheetAvailability vs suitability: preventing fraud and cheating

13/02/2012

Anti-cheat sheet PCAssign PC at random (numbered cards)Identity control (student card & identity card)Banning of watches and (smart)phonesUse of Building Block examination course Consecutive sessions (without time interval)

Availability vs suitability: preventing fraud and cheating (2)

13/02/2012

Availability vs suitability: preventing fraud and cheating (3)13Block Internet access & access to file-sharesFILTER per room (router configuration):No internet accessBlackboard only

13

Question 2: What about software?14

Does our software meet the expectations?Blackboard?

15

15

Beneficial: student-friendly/authentic examinationQuestioning: use different types of questionsNot only MC questions Questions pertaining to knowledge and insight ( easy correction)Enriched ContentImages in question text and answersVideo/audio fileStudentsEssay: text editor, spelling checker, word countAccess to Test Results and FeedbackMagnifytext and imagesSPRINT (assistive software)16

16

Beneficial (2): coping with security and anti-fraud measuresTest options:Use random blocks of questionsShow answers in Random OrderRandomise questionsUse of different series (bgcolour) for questionsPresent all questions at once or one question at a time & prohibit backtrackingDefine Test availability exceptionsSet TimerUse passwordRestrict location=> IP-filter

But what about other courses? Content collection? 17

Adaptive rule ?

17

Beneficial (3): quality assurance & reusabilityQuality controlAttempts statisticsColumn statisticsItem AnalysisDownload results=> run statisticsReusing questionsElectronic archive of pools of questions & tests

18

18

Beneficial (4): scoring and processing of resultsGrade questionsGrade with usernames hiddenEssay:digital text is readable, better structure of text, word countuse of rubricsprint to HTML/WORD/PDF (program)?Use negative scores? Fill-in questions?partial credit alternatives and recalculate score unsatisfactorily19

19

Additional Software Building Blocks BB Examination courseBB negative scoresBB Rename & report (feedback CC)In-house softwareApplication WordtoBBApplication MFIB (collect unique answers)Program: Print Essay & word countAlephQ (test software)20

20

Building Block: Examination course

21

21

Why?Need of secure environmentAvoid fraud via access to BlackboardCoursesOrganisations Content CollectionCalendarSocial tools22

22

What?Course tool in regular courseGenerates New course based on specific templateLink: Start ExamLink: End ExamTransfer of students & instructors regular course >> examination course(daily synchronisation)

23

23

Examination course Start ExamHow?Student clicks on the link HIERAlternative: Instructor changes mode for one/multiple/all students in Course tools, Examencursusregular student => exam student What happens?Courses and organisations unavailableContent Collection tab unavailable: (disable auha_contentcollection portal role)Grade Centre column Examenlink gets marked 1

24

24

25Before start examAfterNo acces to Content Collection tabOnly exam course in course list

25

Examination course End examHow?Student clicks on link End ExamAlternative: Instructor changes mode for one/multiple/all studentsWhat happens?Courses and organisations availableContent Collection tab available: (enable auha_contentcollection portal role)Grade Centre column Examenlink gets marked 0

26

26

Examination course27

Start exam

Access to test

Different testsInstructions: what to do after submission

InstructionsRandom block of MC, sorting, combining, jumbled sentenceEssayInformationEnd exam

27

Question 3: What about support?28

Administrative SupportRooms:Availability, capacity, software, headphones, Communication towards students:Sample exam, Practice test, Use of Announcements Course menu link practical matters:link to Education and Examination Regulation guidelines & instructions concerning the procedurevideo about the procedurecourse information: competences, evaluation criteriaapplication of negative scores29

29

Technical SupportExam courseActivate Prepare tests & assignmentsInclude pictures & multimediaPrepare settings/adaptive releaseSupervisors:Procedure via VIDEO/PPSCertified training Checklist procedure/problemsDuring examStart & finish

13/02/2012

Lessons learned & advice

31

31

Lessons learnedGood organization & preparation is key!Success of digital exams creates new demandDemand for BB exams continues to growWhat about the capacity of computer rooms?4 weeks of examinations: Stressful - exhausting intensive for BB-team

32

32

Downsides What to do with network problems/Blackboard problems?Keep calm and call IT colleagues Loss of work:File was not saved correctly when downloading/uploadingFile could not be retrievedProcedure of ExamRather complicatedDifficult to explain to some teachers=> need for technical support!Settings for a test in different places : Test optionsAdaptive releaseNo password/IP-range for assignments33

33

Key considerationsNeed for atypical questionsChemistry, accountancy, languages,Need for external correction proceduresFill-in fields Negative scores Essay word countDifferent tests for different types of questions34

34

ConclusionGoals achieved for students and teachers:Enriched questions with multimediaImproved readability and structure of essaysAccurate, objective, quick processing and fast correction of answers=>Saving a lot of time (large groups)Quality assuranceSecure environment

35

35

Nevertheless:In order to:Integrate all security settings in one locationAvoid loss of work and network problems (DOS Attack)Combine authentic examination and powerful correction

Take your assessments and examinations to the next level with Blackboard and AlephQ

So, dont leave just yet, but stay for the next presentation!!!

36