Enhancing retention through learning analytics

14
© University of South Wales Enhancing retention through learning analytics Dr Jo Smedley University of South Wales September 2013

description

Presentation given in Information Systems and Knowledge Management stream at the OR55 conference (UK Operational Research Society's annual conference) focusing on learning analytics approach to student retention and success.

Transcript of Enhancing retention through learning analytics

Page 1: Enhancing retention through learning analytics

© University of South Wales

Enhancing retention through

learning analytics

Dr Jo Smedley

University of South Wales

September 2013

Page 2: Enhancing retention through learning analytics

© University of South Wales

“University learners sometimes encounter challenges with their

learning which can lead them to quit. To enhance retention and

success of all students, information technology has enabled the

analytical review of considerable quantitative and qualitative

learning data. This has informed the identification of several key

factors with differential applications, for example, between

subjects, between student age groups, which has led to the

enhanced targeting of continuing initiatives to maximise overall

achievement.”

Abstract

Page 3: Enhancing retention through learning analytics

© University of South Wales 3

Is your organisation maximising its

information potential?

Refining data rich, information poor (DRIP) systems to

enhance client experiences

Enhancing client

experiences

Data management

Adjusting categories (JACS codes)

Adjusting reporting times

Cross-University initiative

++++++

External survey data

UCAS Admissions

Student Experience

National Student Survey

International Student barometer

Internal survey data

Module feedback

Retention

Success

Activity Monitoring

Virtual Learning Environments

Estates

Induction

++++++

Dr Jo Smedley Email: [email protected]

Collaborative opportunities Practitioner

case studies

Ideas for development

Feedback on existing

work

Page 4: Enhancing retention through learning analytics

© University of South Wales

Retention

Induction Activities

Internal Survey Data (module feedback, student

representation, student experience surveys)

Activity Monitoring (Blackboard Interactions, GlamLife

Interactions, Missed QMP Assignments, Googlemail Interactions, Logons from

student area, Tier 4 Signons, Estates info, Library info)

Data Management (Target Setting, Data Sharing)

Page 5: Enhancing retention through learning analytics

© University of South Wales

Success & Satisfaction

External Survey Reporting (NSS, PRES, International Student

Barometer, DLHE, HESA)

Data Management

(JACS coding)

Page 6: Enhancing retention through learning analytics

© University of South Wales

The Undergraduate Learner Journey

UCAS Admissions

Module feedback x n

Student representation

End of year surveys x n

National Student Survey

Page 7: Enhancing retention through learning analytics

© University of South Wales

The Postgraduate Learner Journey

Admissions

Module feedback x n

Student representation

End of year surveys x n

PRES

Page 8: Enhancing retention through learning analytics

© University of South Wales

The International Learner Journey

Admissions

Module feedback x n

Student representation

End of year surveys x n

International Student Barometer

Page 9: Enhancing retention through learning analytics

© University of South Wales

Big Data

• Internal data

• Activity monitoring

• External data

Activity monitoring

Blackboard Interactions

GlamLife interactions

Number of missed QMP Assignments

Googlemail Interactions

Logons from student area

Tier 4 sign-ons

Estates info

(entry etc)

Student Representation

Library interactions

Page 10: Enhancing retention through learning analytics

© University of South Wales 10

Internal data

Module surveys x n

Student experience surveys x n

Big Data

• Internal data

• Activity monitoring

• External data

Page 11: Enhancing retention through learning analytics

© University of South Wales 11

External data

NSS

PRES

HESA DLHE

International Student

barometer Big Data

• Internal data

• Activity monitoring

• External data

Page 12: Enhancing retention through learning analytics

© University of South Wales 12

Predictive modelling: retention

)MonitoringActivity (

data) Internal(

Retention

g

f

where:- • f and g are a multiplying factors to be determined through data analysis • internal data comprises reported formal and informal data from internal surveys, e.g. module feedback, student experience surveys • activity monitoring comprises data gathered from student interactions, e.g. VLE, Googlemail, Library, Estates

Page 13: Enhancing retention through learning analytics

© University of South Wales 13

Predictive modelling: success/satisfaction

)data External(

tisfactionSuccess/Sa

h

where:- • h is a multiplying factor to be determined through data analysis • external data comprises reported data in external league tables, e.g. NSS, PRES, International Barometer, HESA

Page 14: Enhancing retention through learning analytics

© University of South Wales

Continuing Work

• Analyse categories of existing data to determine model factors

• Collaboration

– “What works” initiative

• Impact

• Further dissemination

14 Email: [email protected]