Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca...

21
Engaging language students in the feedback process: a trial with audio- feedback Dr. Elena Polisca Italian Studies The University of Manchester

Transcript of Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca...

Page 1: Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca Italian Studies The University of Manchester.

Engaging language students in the feedback process: a trial

with audio-feedback

Dr. Elena PoliscaItalian Studies

The University of Manchester

Page 2: Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca Italian Studies The University of Manchester.

Overview

• Background information (Italian Studies)• Research questions• The Hear IT! project• Project evaluation

Page 3: Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca Italian Studies The University of Manchester.

Background information (1)

• Italian Studies: ‘smaller’ discipline within School of Languages, Linguistics and Cultures

• Recruited well in 2010-2011• ITAL10200 and ITAL30200 teach students how

to write in Italian• Students write on a weekly (ITAL10200) and

fortnightly basis (ITAL30200)• Marking load is incredibly high

Page 4: Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca Italian Studies The University of Manchester.

Research questions

• Is there a way in which tutor marking time can be reduced?

• Do students really engage with the feedback received?

• Is there a way in which we can engage students with feedback further?

Page 5: Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca Italian Studies The University of Manchester.

The Hear IT! project

• 2 control groups and 1 test group for both ITAL30200 and ITAL10200

• Tutor marks compositions on paper for all students

• Control groups receive feedback on conventional School’s feedback forms

• Test groups receive audio feedback (MP3s recordings) on Blackboard

Page 6: Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca Italian Studies The University of Manchester.

The test groups

• Students received marked work without Feedback sheet• Students have to look for audio-recordings

in Bb to get comments and mark • Students have to fill in their own Feedback

sheet according to audio-comments• Students put ‘their’ feedback sheet in

marked portfolio (for ITAL10200 only)

Page 7: Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca Italian Studies The University of Manchester.

The feedback sheet

Page 8: Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca Italian Studies The University of Manchester.

The Hear IT! project

• Audio-feedback examples:

– ITAL10200 – ITAL30200– And one example from the students themselves

Page 9: Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca Italian Studies The University of Manchester.

The Hear IT! project• Did Hear IT! cut down tutor feedback time?

– Recordings between 3-5 mins long– More interactive– I enjoyed doing them – (better than writing forms!)

– Speaking faster than writing / printing / stapling– MP3s on Video Library Service + link in Bb

– Overall, audio feedback is probably faster, but this is down to the individual (e.g. what if you make a mistake? Are you happy with your recording?)

Page 10: Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca Italian Studies The University of Manchester.

Project evaluation (test groups)

Respondents

Page 11: Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca Italian Studies The University of Manchester.

How would you rate the quality of feedback received?

ITAL10200

ITAL30200

Page 12: Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca Italian Studies The University of Manchester.

Project evaluation (test groups): the feedback sheet ITAL10200

• Did you complete the feedback sheet?Yes: 100%

• Did you enjoy doing it?

• Did you find it useful?Yes: 100%

Page 13: Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca Italian Studies The University of Manchester.

Project evaluation (test groups): the feedback sheet ITAL10200

• Why didn’t you enjoy completing it?– Not actual work, just admin– Only to appease guidelines

• Why did you find it useful?– Helped me understand the different components

needed for a successful piece of work– Helped me see my mistakes more clearly– Helped reiterate feedback– Good to reflect on strengths / weaknesses– Made me more aware of marking scheme

Page 14: Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca Italian Studies The University of Manchester.

Project evaluation (test groups): the feedback sheet ITAL30200

• Did you complete the feedback sheet?

• Did you enjoy doing it?

• Did you find it useful?

Page 15: Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca Italian Studies The University of Manchester.

Project evaluation (test groups): the feedback sheet ITAL30200

• Why didn’t you complete it?– I forgot– It was time-consuming– Dull– Didn’t feel it was necessary

• Why did you find it useful?– Makes you think about mistakes more– Wrong points easier to remember – Listened to it more than once and understood it better

Page 16: Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca Italian Studies The University of Manchester.

Project evaluation (test groups)

• Did you feel engaged with the feedback process overall?

Page 17: Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca Italian Studies The University of Manchester.

Project evaluation (test group ITAL10200)

• In what way did the feedback given make you feel engaged with the feedback process?– Audio feedback more personal (x5)– I had to think about feedback much more than

usual (on audio feedback)– You are more involved with the marking process

(x2)– It showed me my mistakes, which is vital to

learning

Page 18: Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca Italian Studies The University of Manchester.

Project evaluation (test group ITAL30200)

• In what way did the feedback given make you feel engaged with the feedback process?– It makes you think about your mistakes– I was very curious about the feedback and treated

it very seriously– Audio feedback more personal and feels like a

one-to-one with the tutor (x5)– I really like getting feedback so was always

engaged– Allows you to improve

Page 19: Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca Italian Studies The University of Manchester.

Which feedback format did you prefer to receive?

Page 20: Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca Italian Studies The University of Manchester.

Conclusions (1)

• Students seem to engage with the feedback received, regardless of format (… but 100% audio)

• Is it really necessary to engage finalist students with feedback further?

• It makes sense to use audio feedback with 1st year students to:– Make them feel like they own their work– Help them understand what we look for– Help them familiarise with key feedback

vocabulary

Page 21: Engaging language students in the feedback process: a trial with audio-feedback Dr. Elena Polisca Italian Studies The University of Manchester.

Contact details

Dr. Elena PoliscaItalian StudiesSchool of Languages, Linguistics and CulturesThe University of ManchesterOxford Rd.Manchester, M13 9PL

[email protected]