Electronic management of assessment webinar slides
description
Transcript of Electronic management of assessment webinar slides
![Page 1: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/1.jpg)
19/11/2014 Electronic Management of Assessment: moving on
![Page 2: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/2.jpg)
Taking part
»Use the chat box to share thoughts and ask questions
» Prefix questions with a “Q”
» Raise your hand if you want to speak
» Technical problems? Send a private message to Phil (double click on his name)
»Or call 0191 208 5000
» The webinar will be recorded and shared online.
2Electronic management of assessment: moving on
![Page 3: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/3.jpg)
Blackboard Collaborateorientation
Electronic management of assessment: moving on 3
![Page 4: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/4.jpg)
19/11/2014 Electronic Management of Assessment: moving on
![Page 5: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/5.jpg)
Overview»Introductions
»Jisc Electronic management of Assessment (EMA) project and study
»Headline findings so far
»Prioritising challenges to tackle
»Next steps: a service design approach and opportunities to get involved
Electronic management of assessment: moving on 5
![Page 6: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/6.jpg)
Introductions
Electronic management of assessment: moving on 6
Lisa Gray, Jisc: [email protected]
Dr Gill Ferrell, consultant: gill@aspire‐edu.org
Marianne Sheppard, Jisc infoNet:[email protected]
Alex Nisbett, Livework [email protected]
Phil Swinhoe, Training and administration co‐ordinator, Jisc Netskills
![Page 7: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/7.jpg)
Electronic management of assessment (EMA) project
»Recently completed – a 3 year programme exploring technology‐enhanced assessment and feedback
»4 main themes:
› Feedback and feed forward
› Enhancing student employability
› Strategies for change
› Electronic management of assessment (EMA)
Electronic management of assessment: moving on 7
Background and context
CC BY‐NC‐SA 2.0 jackhyneshttp://bit.ly/jisc‐assess and http://bit.ly/jiscdsaf
![Page 8: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/8.jpg)
Electronic management of assessment (EMA) project
»EMA ‐ benefits and drivers are clear
»Challenges surfacing relating to process, practice and technology
»Working in collaboration with the Heads of e‐Learning Forum (HeLF) and UCISA to maximise the benefits technology can offer in the management of assessment
Electronic management of assessment: moving on 8
Background and context
CC BY‐NC‐SA 2.0 ©comedynose via Flickr
![Page 9: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/9.jpg)
The EMA study
»To gather examples of practices, policies & process as well as approaches to implementation
»To identify the challenges around EMA, in terms of pedagogy/culture, process or technology and to identify existing solutions where they can be found
»To provide interim guidance to institutions on the state of play and effective practice with approaches to implementation
»To make recommendations to institutions, systems providers and Jisc on priorities to address
Electronic management of assessment: moving on 9
Aims
CC BY‐NC‐SA 2.0 ©comedynose via Flickr
![Page 10: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/10.jpg)
Information sources
»HeLF EMA surveys 2011, 2012, 2013
»Jisc assessment and feedback programme (2011 to 2014 involving over 30 institutions)
»Other Jisc learning and teaching related projects
»Literature review
»Online questions (April 2014) – 90 responses from 70 different institutions (65 HE and 5 delivering HE in FE) covering all four UK nations
»Think Tank (May 2014) 32 institutions represented
»Interviews with learning providers
Electronic management of assessment: moving on 10
![Page 11: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/11.jpg)
Headline findings
»Nuanced responses but broad trends visible
»Localised initiatives but beginning to scale up
»System integration is a key problem area
»EMA exposes variability in business processes
Electronic management of assessment: moving on 11
![Page 12: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/12.jpg)
Lots of localised initiatives
Electronic management of assessment: moving on 12
0
20
40
60
80
100
120
e-Submission e-Marking e-Feedback e-Exams
How extensively has your organisation applied EMA?
N/ASmall scale pilotsLarge scale pilotsMandated locallyMandated organisation wideDon't know
![Page 13: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/13.jpg)
Loose system integration
Electronic management of assessment: moving on 13
![Page 14: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/14.jpg)
Title of presentation 00/00/2013 14
Variation in business processes
![Page 15: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/15.jpg)
Pain points
Electronic management of assessment: moving on 15
![Page 16: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/16.jpg)
What causes the pain?
»Anonymity: both ends of spectrum motivated by student pressure
»Resistance: many stakeholders take narrow view; little joined‐up thinking
»Scaling up: may expose technology issues & ‘harden’ staff attitudes
»Feedback: storage & access issues; good practice can be hard to scale
»Practice: may be simple but process workarounds cause frustration & resentment
»Technology: limited range of core products how hard can it really be?
»Formative approaches: less well developed than summative
Electronic management of assessment: moving on 16
![Page 17: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/17.jpg)
A Lifecycle Model
Electronic management of assessment: moving on 17
![Page 18: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/18.jpg)
Top 10 Challenges
18Electronic management of assessment: moving on
![Page 19: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/19.jpg)
Top 10 Challenges
19Electronic management of assessment: moving on
![Page 20: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/20.jpg)
Where next?
»Priority area for many institutions
»Student expectations are key
»Continued co‐design with you, Jisc, HeLF & UCISA and engagement with suppliers
»Second phase of consultation through a service design approach, moving from challenges to identifying solutions – now till February 2015
»Solution development, including the production of an EMA toolkit –Summer 2015
Electronic management of assessment: moving on 20
![Page 21: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/21.jpg)
Where next?
Electronic management of assessment: moving on 21
Phase 1
Mar–July 14
•Landscape review providing initial identification of challenges and outline of the state of play with regards to EMA
Phase 2.1
Oct–Aug 15
•Second phase of consultation leading to refined and prioritised challenges (speaking as a ‘single voice’)
•Moving from challenges to solutions (Oct – Jan) •Solution development (Feb – July)
Phase 2.2
Oct–Aug 15
•Ongoing development of resources for the ‘toolkit’ based around the assessment and feedback lifecycle
![Page 22: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/22.jpg)
Moving from challenges to solutions
Electronic management of assessment: moving on 22
A service design approach
![Page 23: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/23.jpg)
Service design
Service design helps imagine a better future for customers and organisations alike.
Electronic management of assessment: moving on 23
What is it?
![Page 24: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/24.jpg)
Livework and Jisc
Electronic management of assessment: moving on 24
eg. National Monograph Strategy Re‐configuration of libraries as services to students and academics
![Page 25: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/25.jpg)
How we approach projects
Electronic management of assessment: moving on 25
Our approach is structured around four phases, each with an activity to verify the chosen direction.
Understand actors and factors that impact customers lives.
Validate assumptions with staff and customers.
Imagine new service scenarios that add value to customer relationships.
Prove what works with customers and staff.
Design services that deliver value to our clients and their customers.
Test frequently and in live settings.
Help create services that work in the real world and deliver value.
Monitor and guide the implementation.
![Page 26: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/26.jpg)
Moving from challenges to solutions
Electronic management of assessment: moving on 26
![Page 27: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/27.jpg)
Two ways of getting involved
Electronic management of assessment: moving on 27
![Page 28: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/28.jpg)
Two activities
Electronic management of assessment: moving on 28
1. Personas 2. Challenges
![Page 29: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/29.jpg)
Activity 1: User personas
29
Objectives
To create a rich understanding of the key service actors (students, academic staff and administrators).
This will help us in the first workshop where we imagine solutions to the challenges.
Electronic management of assessment: moving on
![Page 30: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/30.jpg)
Activity 1: User personas
1. Choose at least two typologies (e.g. student, lecturer)
2. Give them a name and define their role
3. Describe their main motivations. What do they want? What do they need to achieve?
4. Think and describe their needs.
5. Define the dependencies, enablers and constraints.
Electronic management of assessment: moving on 30
How?
![Page 31: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/31.jpg)
Activity 1: User personas
Visit our blog for the link
Complete a Google form for each.
Electronic management of assessment: moving on 31
How?
![Page 32: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/32.jpg)
Activity 2: The challenges
To create real, human stories which bring all of the challenges to life.
These will help us in the first workshop where we generate user‐centred solutions to the challenges.
Electronic management of assessment: moving on 32
Objectives
![Page 33: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/33.jpg)
Activity 2: The challenges
1. Visit the blog and review each challenge
2. Select those which you can think of specific examples, real stories or anecdotes for.
Electronic management of assessment: moving on 33
How?
![Page 34: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/34.jpg)
Activity 2: The challenges
3. Use the form to write your stories.
4. You will be able to see the stories others are posting, so reference or build on them.
Electronic management of assessment: moving on 34
How?
![Page 35: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/35.jpg)
Find out more:
»Lisa Gray [email protected]»Landscape report available from: bit.ly/jisc‐ema
»Join the conversation on the blog: ema.jiscinvolve.org/and on twitter #jiscassess
»Join the mailing list: www.jiscmail.ac.uk/tech‐enhanced‐assesment»Guides, case studies, videos and other resources on assessment and feedback: bit.ly/jisc‐assess
35Electronic management of assessment: moving on
![Page 36: Electronic management of assessment webinar slides](https://reader033.fdocuments.in/reader033/viewer/2022060120/5593068e1a28ab48768b4760/html5/thumbnails/36.jpg)
Any questions?