Jisc learninganalytics dec2016

33
Paul Bailey, Senior Codesign Manager, Research and Development Jisc learning analytics service http://www.slideshare.net/paul.bailey/

Transcript of Jisc learninganalytics dec2016

Page 1: Jisc learninganalytics dec2016

Paul Bailey, Senior Codesign Manager, Research and DevelopmentJisc learning analytics service

http://www.slideshare.net/paul.bailey/

Page 2: Jisc learninganalytics dec2016

Learning Analytics Service

Learning Analytics

What is learning analytics?

Page 3: Jisc learninganalytics dec2016

Learning Analytics Service

“learning analytics is the measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimising learning and the environments in which it occurs”SoLAR – Society for Learning Analytics Research

Page 4: Jisc learninganalytics dec2016

Learning Analytics ServiceLearning Analytics Sophistication Model

Page 5: Jisc learninganalytics dec2016

Learning Analytics Service

Analytics categories by interventionImprove individual student performance - interventions aimed directly at learners Improve teaching and learning quality - interventions aimed at curriculum designImprove support systems and process - interventions aimed at support staff and the process around support staff and students. Develop strategy - interventions required to improve the performance of the institution

Page 6: Jisc learninganalytics dec2016

Learning Analytics Service

Effective Learning Analytics ChallengeRationale»Organisations wanted help to get started and have access to

standard tools and technologies to monitor and intervene Priorities identified»Code of Practice on legal and ethical issues»Develop basic learning analytics service with app for students»Provide a network to share knowledge and experienceTimescale»2015-16—test and develop the tools and metrics»2016-17—transition to service (freemium)»Sep 2017—launch, measure impact: retention and achievement

Page 7: Jisc learninganalytics dec2016

Learning Analytics Service

What do we mean by Learning Analytics?The application of big data techniques such as machine based learning and data mining to help learners and institutions meet their goals:

For our project: » Improve retention (current project)» Improve attainment (current project)» Improve employability (future project)»Personalised learning (future project)

Page 8: Jisc learninganalytics dec2016

Learning Analytics Service

Descriptive Analyticswhat happened? How do I compare?

Prescriptive Analyticswhat should I do?

Predictivewhat will happen?

Automatedit’s done

Data

Diagnostic Analyticswhy did it happen?

Ordered Data

Sector Transformation

Awareness

Experimentation

Organisation support

Organisational transformation

Analytics without a national approach

Page 9: Jisc learninganalytics dec2016

Learning Analytics Service

Sector Transformation

Awareness

Experimentation

Organisation support

Organisational transformation

Descriptive Analyticswhat happened? How do I compare?

Predictive Analyticswhat will happen?

Prescriptive Analyticswhat should I do?

Automatedit’s done

Data

Diagnostic Analyticswhy did it happen?

Ordered Data

Standardised Data

Analytics with a national approach

Page 10: Jisc learninganalytics dec2016

Learning Analytics Service

Sector Transformation

Awareness

Experimentation

Organisation support

Organisational transformation

Descriptive Analyticswhat happened? How do I compare?

Predictive Analyticswhat will happen?

Prescriptive Analyticswhat should I do?

Automatedit’s done

Data

Diagnostic Analyticswhy did it happen?

Ordered Data

Standardised Data

Adaptive learning etc.

Recommendation engines etc.

Predictive models, Intervention

management etcData exploration tools, processes etc

Dashboards, Benchmarking etc.

Data Warehouse, data stores

Data connectors

Analytics with a national approach

Page 11: Jisc learninganalytics dec2016

Descriptive Analytics

Predictive Analytics

Prescriptive Analytics

AutomatedDiagnostic Analytics

Standardised Data

Learning Records Warehouse

xAPI Plugins

Data transformation tools

Data and API Standards

Jisc Services

Other ProviderServices

Basic dashboards

Student App

Analytics Labs

Benchmarking services

College Analytics

Basic predictive modelling and intervention management

Procurement frameworks

Integration tools

Services for researchers

Pilot projects

Services for researchers

Pilot projects

Institutional Dashboards

Data visualisation tools

Data exploration tools

Advanced predictive modelling

Integrated intervention management

??? ???

Page 12: Jisc learninganalytics dec2016

Learning Analytics Service

Jisc’s Learning Analytics ProjectThree core strands:

Learning Analytics Service

Toolkit Community

Jisc Learning Analytics

Page 13: Jisc learninganalytics dec2016

Learning Analytics Service

Community: Project Blog, mailing list and network eventsBlog: http://analytics.jiscinvolve.org

Mailing: [email protected]

Page 14: Jisc learninganalytics dec2016

Learning Analytics Service

http://www.jisc.ac.uk/guides/code-of-practice-for-learning-analytics

Toolkit: Code of Practice

http://repository.jisc.ac.uk/5661/1/Learning_Analytics_A-_Literature_Review.pdf

Page 15: Jisc learninganalytics dec2016

Learning Analytics Service

Learning Analytics Service Architecture

Page 16: Jisc learninganalytics dec2016

Learning Analytics Service

DashboardsDashboards for different users of the analytics Administrators to see over all activity Course tutors to view and compare

students Student view to see engagement

activity

Based on either commercial tools from Tribal (Student Insight) or open source tools from Unicon/Marist or other providers of learning analytics products

Page 17: Jisc learninganalytics dec2016

Learning Analytics Service

Page 18: Jisc learninganalytics dec2016

Learning Analytics Service

Page 19: Jisc learninganalytics dec2016

Learning Analytics Service

Page 20: Jisc learninganalytics dec2016

Learning Analytics Service

Page 21: Jisc learninganalytics dec2016

Learning Analytics Service

Page 22: Jisc learninganalytics dec2016

Learning Analytics Service

Page 23: Jisc learninganalytics dec2016

Learning Analytics Service

Page 24: Jisc learninganalytics dec2016

Learning Analytics Service

Page 25: Jisc learninganalytics dec2016

Learning Analytics Service

First version will include: »Overall engagement»Comparisons»Self declared data»Consent management

Bespoke development by Therapy Box

Student App

Page 26: Jisc learninganalytics dec2016

Learning Analytics Service

Stats – Provides an engagement and attainment overview and drilling down to gives comparative activity graphs.

Log – Allows you to log time spent on specified activities e.g. reading for an assignment

Target – Allows you set personal targets to improve your engagement e.g. study for 10 hours this week

Page 27: Jisc learninganalytics dec2016

Learning Analytics Service

Alert and Intervention SystemTools to allow management of interactions with students once risk has been identified:

» Case management» Intervention management» Data fed back into model» etc…

Based on open source tools from Unicon/Marist (Student Success Plan)

Page 28: Jisc learninganalytics dec2016

Learning Analytics Service

Page 29: Jisc learninganalytics dec2016

Learning Analytics Service

On-boarding Process

Stage 1: OrientationStage 2: DiscoveryStage 3: Culture and Organisation SetupStage 4: Data IntegrationStage 5: Implementation Planning

https://analytics.jiscinvolve.org/wp/on-boarding/

Page 30: Jisc learninganalytics dec2016

Learning Analytics Service

Discovery readinessTopic I

DQuestion Commentary Response Scor

eLeadership 

1 The institutional senior management team is committed to using data to make decisions 

Please provide a commentary on you response to each question where appropriate

0 - Hardly or not at all1 - To some extent2 - To a great extent

 

Leadership 

2 Our vice-chancellor / principal has encouraged the institution to investigate the potential of learning analytics 

  0 - Hardly or not at all1 - To some extent2 - To a great extent

 

Leadership 

3 There is a named institutional champion / lead for learning analytics 

  0 - No2 - Yes  

Vision 

4 We have identified the key performance indicators that we wish to improve with the use of data 

  0 - Hardly or not at all1 - To some extent2 - To a great extent

 

A supported review of institutional readiness

Page 31: Jisc learninganalytics dec2016

Learning Analytics Service

Data collection

About the student Activity data

TinCan (xAPI)ETL

Page 32: Jisc learninganalytics dec2016

Learning Analytics Service

On-boarding Process

Data Explorer Visualisation Tools

Ready to implementReady to

implement

Page 33: Jisc learninganalytics dec2016

Contacts

Paul Bailey [email protected]

Further Information: http://www.analytics.jiscinvolve.org

Join: [email protected]

Learning Analytics Service