Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness...

26
Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what constitutes feedback How? Some approaches tried and tested We do not have all the answers!!!

Transcript of Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness...

Page 1: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

Innovation in Assessment?

• Why?• Poor student feedback regarding feedback

timeliness and usefulness• Staff workloads• Student lack of awareness as to what

constitutes feedback

• How?• Some approaches tried and tested• We do not have all the answers!!!

Page 2: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

BUE traditional approaches• Coursework

• Reports• Essays• Maths based questions• Group or Individual

• Formal examinations• Closed book• Open book

• Presentations• Oral• Posters

• Good range seen as a positive by students and colleagues in other Schools

Page 3: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

Innovations in Assessment

Why, How and When?

Page 4: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

Why?

• Aims• To improve learning from the

assessment process• To engage students further• To improve student performance• To improve retention (hopefully)• To improve student feedback (NSS)

Page 5: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

How?

• The traditional methods of assessment are tried and tested

• External Examiners are comfortable with them

• Students are comfortable with them

• Staff are comfortable with them• BUT

Page 6: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

Could the methods we use be:• Tweaked• More balanced• Varied• How can these approaches

achieve the aims that innovative forms of assessment seek to achieve?

Page 7: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

BUE Examples

• Seen closed book examinations

• Students are given the question a week before

• Focuses research and promotes further reading

• Discourages plagiarism

Page 8: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

BUE Examples• Changing the brief of a project• Students work on a project all year with

a given brief• Submit project as a group• Given a change to the brief and an

afternoon to formulate changes to proposal

• Simulates working under pressure and ensures all group members contribute

Page 9: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

BUE Examples• Using Classroom Performance System• Students revise for examination• Use CPS in revision class • Questions multiple choice but related to

exam questions• Results count 5% to module mark• Enjoyable and helps students identify

weaknesses before the examination

Page 10: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

BUE Examples• Non issue of coursework brief until all

lectures complete• Essay titles issued randomly in week 12• Students have Christmas break to

undertake the work• Level 1 module- encourages full

attendance to the lectures and keeps students engaged over break period

Page 11: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

BUE Examples

• In class assessment with a break for group discussion

• Given a design brief, and 2 hours to sketch and explain their solution

• Then 30 minutes discussion in groups of 6 – 8 students

• Followed by 30 minutes reflection on what they would or would not change in the light of the discussion

Page 12: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

BUE Examples

• Assessed question and answer session after presentations (40%)

• The students pay a lot of attention to each others presentations

• Helps to identify any errors in the presentations

• Has been tried successfully in classes of up to 50 students

Page 13: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

BUE Examples

• Give students a great deal of choice of subject matter

• ‘write about something which interests you in the field of….’

• They research more when interested• And also learn about a lot of other

subjects while trying to choose!

Page 14: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

BUE Examples

• People from industry come in to help assess oral or poster presentations

• Students respond well, and put in extra effort

• Industrialists can be very good at pointing out the practicalities to students

• But they can be hopeless at marking!

Page 15: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

When?

• Should be introduced in either level 1 or level 2 with relatively low weighting

• Not introduced at level 3 where marks count most

• Summative or formative but more engagement if summative

• CPS good for formative

Page 16: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

Student Views

• Very varied!• When students from one course

were asked which assessment they had enjoyed most – almost every assessment was given as an answer, and very few students chose the same assessment

Page 17: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

What type of assessment is most fair?

assignment

written exam

oral exam

combination

Page 18: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

What do you learn through writing assignments?

• New material• How to structure an argument• Develop skills in interpretation• Making contacts (at work for part

time students)• How to search for material for as

legislation

Page 19: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

What do you learn through writing assignments?

• I’ve learnt more where there has been greater flexibility within the question

• I’m more likely to remember the detail if I’ve done the extra reading

• I learn more about a subject by looking from more than one angle

Page 20: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

What do you learn through studying for exams?

• Extend knowledge of a subject• Short term learning• Not much• Facts but less theory• How to produce a short report quickly• Thinking on ones feet• Reinforces knowledge already learnt• A crucial part of my learning experience• Exams are necessary to move information

into long term memory

Page 21: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

Multiple Choice Exams

• Too restrictive• There is a way of finding answers without

learning much• Very easy and don’t need much revision• Less able to assess knowledge and

understanding• If negative marking is included can be

fair• Useful for calculations

Page 22: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

Ideal exam length

• Depends on proportion of marks from exam

• Varies from 2 hours to 5 hours• Most either 2 or 3 hours• Don’t like more than one 3 hour

exam in a day

Page 23: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

Conclusion

• All innovations need to achieve some or all of the aims of assessment

• Students often prefer the traditional methods

• Diversity allows for students with all preferences to shine in some areas

• Standards still have to be maintained

Page 24: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

The big issue?

• How do these approaches facilitate the provision of timely and useful feedback?

• All of them allow a quicker turn round time

• Do we move to assessment tools merely to address this issue?

• If NSS is used to determine league table position then probably yes.

Page 25: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

The bigger picture

•What we want is successful students with enhanced experiences of JMU.

•We need to look at the whole student experience.

Page 26: Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

StudentSuccess

Pre-Entry,Induction,Transition

Student Support,

Retention &Achievement

Learning,Teaching,

Assessment

Graduation,Employability,

GlobalCitizenship

We need to address all

aspects of the student

experience