Electronic management of assessmentLaunch of new suite of resources

The story so far….» 2011-2014: worked with over 30

institutions across a three year programme on assessment and feedback

» 2012: baseline reviews of institutional practice

» 2013: case studies, videos and briefings

» 2014: Electronic management of assessment (EMA) project with HELF and UCISA

» July 2014: initial landscape study into EMA published Summer 2014

03/03/2016

Electronic management of assessment 2

Assessment and feedback challenges

» Highly devolved responsibility and inconsistent practices

» Lack of developmental focus» Traditional practices dominate» Timeliness, quality and

consistency of feedback

» Learner in passive role» Lack of relevance to world of

work

03/03/2016

Electronic management of assessment 3

Electronic management of assessment 4

Electronic management of assessment

» Nuanced responses but broad trends visible

» Localised initiatives but beginning to scale up

» System integration is a key problem area

» EMA exposes variability in business processes

Challenges exposed“The use of technology is now a fundamental part of the support for assessment and feedback practice across the sector, but there are few examples of fully integrated approaches to supporting the whole assessment and feedback lifecycle”

Jisc, 2014

03/03/2016

Electronic management of assessment

» Limited range of core technologies

» Integration loose and requiring manual intervention

» More HEIs say their A&F systems are ‘completely separate’ than ‘highly integrated’

Loose system integration » Lots of local variation

» Only 12% of HEIs have ‘highly standardised’ processes

» Different interpretations of policy» Variation hidden till EMA tried

Variation in business processes

03/03/2016

Electronic management of assessment 5

Assessment and feedback life-cycle

03/03/2016

Electronic management of assessment 6

03/03/2016

Electronic management of assessment 7

Electronic management of assessment 8

Moving to solutions» Workshops in Dec 2014 and Jan

2015 explored possible solutions to these prioritised challenges

» 1st workshop - resulted in 30 solution ideas

» Ideas were synthesised down into five main areas

» 2nd workshop - worked these up into three detailed project specifications

03/03/2016

Electronic management of assessment 9

Developing solutions1. Addressing the variation of

business processes and systems not meeting all needs (1,7, 12, 14)

2. Assessment literacies, assessment design, risk aversion (4, 6, 8, 9, 11, 15)

3. EMA systems integration (3)4. Lack of a

longitudinal/holistic view of student feedback; student engagement with feedback (10, 5)

5. Addressing issues with reliable submission (2)

1. Specifying the range of possible marking and moderation processes and surfacing how systems support them

2. Online toolkit sharing effective practice

3. IMS Global Consortium Assignment Task Force

4. Researching where Jisc can add value in the ‘feedback hub’ space

5. (Suppliers addressing these issues)

03/03/2016

Suite of resources

» New online guide ‘Transforming assessment and feedback with technology’ now available jisc.ac.uk/guides/transforming-assessment-and-feedback

» New accompanying online guide on EMA processes and system specification, including supplier responses to requirements (HE focus)› http://bit.ly/Jisc_EMA_guide

Now available» A self-assessment tool linking

through to the guidance › institution/departments/faculty

Coming soon

Electronic management of assessment 11

Embedded in the resources» EMA case studies and examples

› Queen’s University, Belfast› Institute of Education

(now part of UCL)› University of Hertfordshire› Manchester Metropolitan

University› Keele University› Bedford College› Walsall College › Sheffield University

» Supplier responses to EMA requirements

» Podcasts and videos› Benefits of EMA› Managing an EMA project › Assessment and feedback

lifecycle› Processes and systems› Value of Jisc resources› Employability and assessment› e-portfolios› Peer assessment› Reconceptualising feedback

03/03/2016

Electronic management of assessment 12

Find out more» Guide:

jisc.ac.uk/guides/transforming-assessment-and-feedback

» Baseline review: http://repository.jisc.ac.uk/5983/1/JISCAFBaselineReportMay2012.pdf

» Landscape report available from: bit.ly/jisc-ema

» Join the conversation on the blog: ema.jiscinvolve.org/

» and on twitter #jiscassess» Join the mailing list:

jiscmail.ac.uk/tech-enhanced-assessment

» Guides, case studies, videos and other resources on assessment and feedback: bit.ly/jisc-assess

03/03/2016

jisc.ac.uk

To find out more

Contact

Lisa GraySenior Co-design managerlisa.gray@jisc.ac.uk

03/03/2016

Electronic management of assessment 13