PowerPoint Presentation

Unlocking the potential of authentic assessment and leveraging the investments in learning technology infrastructureDr Chris Moore, UWE

Assessment Problems from an Academic PerspectiveStandard Academic Year:24 weeks of teachingLectures, Practicals, tutorials, placements depending on course

Outcomes:Demonstration of knowledge, understanding, application3hrs of controlled assessment + courseworkListens to the Student Voice

Thats a lot to cover!

But not much is assessed

Fundamental Questions of AuthenticityDoes the student possess the knowledge to progress to and cope with level two and beyond?Does the student understand what they learned at level one?Do they have the skills to meet the expectations of level two and beyond?Are they seeing the point of what they do and learn?Do they retain all of the above enough to be considered employable?Are they better learners from having done what theyve done?

How can we be sure of all of the above?

The Limitations of TraditionCoursework examples:EssaysLab reportsCase studiesPostersPresentations

Exam examples:MCQsShort answers (SAQs)Essays (could be case studies or similar)

Two componentsA: Controlled conditions (Exam)B: Non-controlled conditions (Coursework)

One time point each

Common theme?

The Solution:Make it authentic:ContinuousBite sizeBuild on skillsLink theory to practiceGet them thinkingHit every topic

Make it beneficial:Identify strengths and weaknessBuild up marksKeep revisiting notesEncourage outside readingEngage better with labsBetter prepared for examsBe rewarded for engagement

Continuous Online Practical Portfolio

Sequential and Conditional

So what does it look like?

Suggested Work Pattern

Anecdotal Feedback (Module evaluations)Chris leads the module very well and the online quizzes are really useful in helping me see what areas I need to do more work in and they force me to go back over lecture materials which I may not have done so soon without these quizzesA few changes to the quizzes! They are brilliant however I find some questions require alot more work than others, e.g the fill the gaps questions, questions of equal difficulties. Also the time, at the beginning of the year there was too little, now too much, it sounds silly to complain but at the beginning of the year i found myself preparing more for the following quiz,now the time is larger im more relaxed and less vigallent.The variety of practicals held. All of the quizzes especially the pre and post which further helped my understanding of the practical. The help in which the lectures offer. Best module in giving feedback. Having the coursework broken down into weekly assessments has helped me, not only in the sense that its easy to get reasonable coursework marks in reward for consistently engaging with the content, but also it helps me get an idea of how well I have understood the content of lectures and practicals and therefore helped me focus my revision.The best aspects for me was that help and guidance was given whenever I needed it, and also the pre prac quizzes helped refresh my memory on what I learned so far.I found the ongoing practical assessments excellent, they helped me engage and make sure I was keeping on top of my lecture notes ready for each practical (Although it was slightly confusing at first).The organisation of the module is the best aspect. It is clear what needs to be learnt and where to find the information to do so as well. Online tests throughout the year are also a big help as it helps you to identify which topics you know a lot about and the topics you need to pay more attention to when revising.

Take Home PointsThey earned itThe design practically ensures they put the work in, that its their work, and that they learned from it

No marking for meAutomated nature of assessments mean varied, robust, and automatic marking

They perform and behave better in labsKnowing that the practical will be assessed and success being dependant on knowing what you did and why encourages careful thinking and an engaged approach

My attendance is through the roof!

The Next Leg11

Mobile Device Based Assessment12

A B C D EDawn of time to 2017

AdvantagesRandomised questionsRandomised order of answersInclusive of all learnersFeedback on completionInstant and automated markingInstant reporting of marking to adminI could go on (I probably will)

13

Circumvent the Limitations of TraditionMust prove its you (but remain anonymous)Must be thereResourcing/InfrastructureTo open the book, or not to open the book?14

Customise, Restrict, and Free them!Tailor to suit examLimit what they can doOpen up what they can do compared to traditional methods15

The Testing PhaseTwo hundred Level One StudentsEighty Five Multiple Choice QuestionsNinety MinutesHalf Paper, Half Tablet16

The Results17TABLET USERSSTATISTICSGRADE DISTRIBUTIONMinimum Value25Greater than 1000Maximum Value9090 - 1001Average59.5880 - 896Standard Deviation13.0870 - 791360 - 692150 - 592840 - 491330 - 39420 - 29110 - 1900 - 90

PAPER USERSSTATISTICSGRADE DISTRIBUTIONMinimum Value20Greater than 1000Maximum Value8190 - 1000Average55.8880 - 894Standard Deviation13.7470 - 791260 - 693350 - 593140 - 491630 - 391120 - 29510 - 1900 - 90

The Future18

All done, and thank you!@ceemourwww.cp-moore.comChris3.moore@uwe.ac.uk

19