1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities...

1

Dr Gill Ferrell

CC BY-NC-ND 2. Marius Kluzniak

18/3/2105 Jisc Assessment & Feedback activities 2011-2015Dr Gill Ferrell

A tour around the EMA landscape

2

CC BY-NC-SA 2.0 tiff_ku1

Pre-departure

• Jisc Assessment & Feedback programme 2011-2014

• HEI Baseline reviews• Baseline review of landscape

published 2012

A tour around the EMA landscape2

3


Travel advisory (1)

• Traditional culture stubbornly resistant to change

• Devolved responsibility & varied practice

• Limited opportunity for students to engage with process of making academic judgements

• Issues with degree structure

CC BY-NC-ND 2. Richard Lee


4

• Traditional culture stubbornly resistant to change• Traditional culture stubbornly resistant to change

Travel advisory (2)

• Investment in technical infrastructure not yet delivering efficiencies

• Preference for established technologies but innovation still difficult to scale up

• Current practice not promoting employability

CC BY-NC-ND 2. 0 Soilse


5

• Traditional culture stubbornly resistant to change• Traditional culture stubbornly resistant to change

Travel essentials

• Lifecycle Model provides our ‘map’ & ‘phrase book’

• Academic model against which processes and systems can be mapped

• Common framework for different stakeholders to discuss issues

• Means of clarifying requirements for suppliers

CC BY-NC 2.0 Marcus Ramberg


The Assessment and Feedback Lifecycle

Based on an original idea developed by Manchester Metropolitan University


7


Starting point

• Educational principles: REAP project Strathclyde;Hertfordshire Assessment for learning;NUS

• Appreciative Inquiry approaches

• Ulster Viewpoints project

CC BY-SA 2.0 Michael Coglan


A&F principles at Queen’s University Belfast


9

CC BY-NC-SA 2.0 CrazyFast

Supporting longitudinal development

• Assessment for learning rather than of learning

• More formative opportunities

• Feed forward• Ipsative approaches• Assesment scheduling• Access to information


Assessment timelines

University of Dundee course redesign using University of Hertfordshire assessment timelines tool


11

CC BY-NC-SA 2.0 xdxd_vs_xdxd

The role of feedback

• Feedback is a ‘black box’

• Programme teams don’t discuss feedback

• Useful analytical tools available


What kind of feedback do you give?

• P1 - Praise. Motivating but if used indiscriminately can appear insincere. • P2 - Recognising Progress (ipsative feedback). Can be motivating and

informs students about their learning. Lack of progress serves as an early warning.

• C - Critique. How work falls short of expectations or criteria; can be discouraging if not accompanied by information on how to improve.

• A - Advice. Help students take future action to improve. • Q - Clarification requests. Asking learners to think more deeply about

their work and generate actions themselves. • O - Unclassified statements. Neutral comments, for example that

describe the piece of work but do not make any judgement.

(adapted from IOE feedback profile)


13

CC BY 2.0 acme

Electronic Management of Assessment

• Jisc EMA project• HeLF surveys• Questionnaire (65 HEIs)• Think tank & workshops• Interviews• Discussions on EMA blog/

• Landscape review report


Localised initiatives


EMA pain points


16

CC BY-NC-SA 2.0 Cesar Harada

Systems integration

• Limited range of core technologies

• Integration loose & requiring manual intervention

• More HEIs say their A&F systems are ‘completely separate’ than ‘highly integrated’


17

CC BY-NC-SA 2.0 Cle0patra

Business Processes

• Lots of local variation• Only 12% of HEIs have

‘highly standardised’ processes

• Different interpretations of policy

• Variation hidden till EMA tried


18

CC BY –NC 2.0 Pondspider

• Necessary safeguard or ‘comfort blanket’ ?

• Avoids unconscious bias• Doesn’t support ipsative

approach• Complicated by second

marking processes• Can be lost when data

transfers between systems

Example: anonymity


19

CC BY-NC-SA 2.0 jon jordan

Urban Myths

• QAA says ‘No!’• It’s against institutional

regulations• Leads to change taking

place ‘under the radar’ of formal QA processes


What are your priorities? (1)


What are your priorities? (2)


22

Photo: livework for Jisc

Working towards solutions

• Validation of priorities• Workshop to generate

solution ideas• Validation and

refinement of solutions• Projects getting under

way


23

CC BY –NC-ND 2.0 bendeavin

Next steps

• EMA requirements map:definition of common workflows

• EMA toolkit:• Feedback hub: feasibility

study• Systems integration:

support resources


24

Highlights of the itinerary

• Educational principles: Hertfordshire, Queen’s Belfast

• Curriculum Design: Ulster• Feedback: Dundee, Institute of

Education• Employability: Exeter• EMA: Huddersfield• Reflection: Westminster• Student support: Manchester Met• Students as agents of change:

Bath Spa; WinchesterCC BY-SA 2.0 Steve Cadman


25

Souvenir shop

• A&F Baseline review: http://www.webarchive.org.uk/wayback/archive/20140614114153/http://www.jisc.ac.uk/media/documents/programmes/elearning/Assessment/JISCAFBaselineReportMay2012.pdf

• A&F Final report:http://repository.jisc.ac.uk/5450/4/Jisc_AF_Final_Synthesis_Report_Oct_2013_v2.pdf

• EMA Landscape review: http://repository.jisc.ac.uk/5599/

• Jisc Design Studio: http://jiscdesignstudio.pbworks.com

• Jisc EMA blog: http://ema.jiscinvolve.org/wp/

CC BY-NC-ND-SA 2.0 ericalaspada


26

Stay in touch

• Contact me:[email protected]

• Contact Jisc EMA lead:[email protected]

• Contribute to the blog• Get involved with the

projects• Join the mailing list:

[email protected]

CC BY-NC-SA 2.0 robin kaspar


27

Join us in Dundee

CC BY-NC-SA 2.0 William Murphy

Free one-day workshop

Electronic Management of Assessment

and Assessment Analytics

Tues 9th JuneUniversity of Abertay

Contact [email protected] for details


28

Thanks and over to you…

CC BY –NC 2.0 yuzu


1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities...

Documents

Transcript of 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities...