Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

39
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369) http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 1/39 Moving the Red Queen Forward: Maturing Learning Analytics Practices Thursday, October 29, 2015 at 2:40 PM in Sagamore Ballroom 3

Transcript of Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

Page 1: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 1/39

Moving the Red Queen Forward: MaturingLearning Analytics Practices

Thursday, October 29, 2015 at 2:40 PM in Sagamore Ballroom 3

Page 2: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 2/39

 

Steven Lonn

 Assistant Director for Assessment &

Evaluation, Digital Education & Innovation

University of Michigan - Ann Arbor@stevelonn

Eden Dahlstrom

Director of Research,

EDUCAUSE

@datadeeva

Glenda Morgan

Research Director, Teaching and

Learning

Gartner

@morganmundum

 Andrea Nixon

Director of Educational Research

and Lecturer in Educational Studies

Carleton College

@anixon527

Clare van den Blink

VP information TechnologyServices and CIO

Pace University

@pacecio

#EDU15 ECARresearch

Page 3: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 3/39

A slow sort of country!' said the Queen. 'Now, HERE, you

see, it takes all the running YOU can do, to keep in the

same place. If you want to get somewhere else, you must

run at least twice as fast as that! --Lewis Carroll, Through theLook ing-Glass

“ 

” 

Page 4: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 4/39

Learning Analytics Defined

“The measurement, collection, analysis and

report of data about learners and their

contexts, for purposes of understanding andoptimizing learning and the environments in

which it occurs.”  --Society for

Learning Analytics Research (SoLAR)

Not just

theoretical

insights!!

Not just

reporting!!

Not just a

dashboard!!

 Actionable intelligence!!

Page 5: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 5/39

The Philosophical End of Learning Analytics

• In order to “do analytics” you must understand the use

cases for the data/information

• There needs to be context for the data

• You must understand who the audience is (students,

faculty, admin, departments) and what problems they are

trying to solve

• If you are doing analytics right, analytics information and

output will support the conversation, not replace the

conversation

Page 6: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 6/39

Overview

• Leadership and Expertise

• Priorities and Investments

•  Analytics and Ethics

•  Advice to move your  RED QUEEN forward

• Maturity of Analytics

Page 7: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 7/39

Leadership and Expertise...

Page 8: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 8/39

 Audience Question

Who in the audience is an expert in learning analytics?

YES NO

Page 9: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 9/39

Leadership in learning analytics(in the institutions that have this role)

*fewer than 25% of

institutions have this role

Page 10: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 10/39

Responsibilities for analytics services

Page 11: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 11/39

PANEL DISCUSSION

Leadership and Expertise

•  Analytics is a highly collaborative, matrixed

process. What advice do we have for IT leaders

to find balance their leadership, support, and

strategic advisors roles?

• How do you help cultivate a scenario where

analytics at your institution to support theconversation, not replace the conversation?

Page 12: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 12/39

Priorities and Investments...

Page 13: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 13/39

 Audience Question

Which is a higher priority for your institution?

LEARNING

 ANALYTICS

INSTITUTIONAL 

 ANALYTICS

Page 14: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 14/39

 Analytics Priority

23% of respondents said learning analytics

was a major priority ; twice as many describedinstitutional analytics as one

Page 15: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 15/39

 Analytics Investment

Four in ten respondents reported little or no investment  in

learning analytics

I t t i t d t

Page 16: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 16/39

Investment in student success

technologies and leadership

commitment

Page 17: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 17/39

PANEL DISCUSSION

Priorities and Investments

• Why the disconnect between the commitment to

student success efforts and investment?

• While ECAR research shows that priority and

investment in learning analytics lags behindinstitutional analytics, what investments might

NOT be reflected in these measurements?• Can investment in institutional analytics drive

learning analytics?

• What areas have the best investment potential to

yield favorable returns for both learning analytics

and institutional analytics initiatives?

Page 18: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 18/39

 Analytics, Students, and Ethics...

Page 19: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 19/39

Student interest in analytics-powered

personalized matriculation facilitators

Page 20: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 20/39

Student perspectives about the ways

higher ed can use student data

Helpful

“big mother ” 

Creepy

“big brother ” 

Page 21: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 21/39

PANEL DISCUSSION

 Analytics and Ethics

• What are the potential unintended consequences 

of learning analytics?

• Data can be dangerous --- context, user

knowledge, quality, privacy --- What should be

our  greatest concerns about learning analytics?

Page 22: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 22/39

a few resources and services...

Page 23: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 23/39

Some EDUCAUSE resources...

Page 24: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 24/39

   E   D   U

   C   A   U   S   E

   R  e  s  o  u  r  c  e  s   f  o  r

   L  e  a  r  n   i  n  g   A  n  a

   l  y   t   i  c  s

Page 25: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 25/39

Page 26: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 26/39

Page 27: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 27/39

 A new EDUCAUSE benchmarkingservice...

B h k l ti

Page 28: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 28/39

Benchmark your analytics progress...Area Maturity Index Deployment Index

 Analytics ✓  ✓ 

Culture of innovation ✓  Not applicable

E-learning ✓  ✓ 

Information security ✓  ✓ 

IT governance ✓  Not applicable

Research computing ✓  ✓ 

Risk management ✓  Not applicable

Student success technologies ✓  ✓ 

 A 2016 collaboration between

ECAR  and CDS

Page 29: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 29/39

1) Build reports with customized peer

groups on demand

Page 30: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 30/39

2) Benchmark maturity and technology

deployment

Page 31: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 31/39

3) Receive recommendations for

improvement

Page 32: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 32/39

CDS survey

deadline

November 6

Page 33: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 33/39

 Analytics Maturity...

Page 34: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 34/39

 Analytics maturity, 2014

2nd

genmaturity

index

Page 35: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 35/39

PANEL DISCUSSION

 Analytics Maturity

What is/was the most important single thing that

you/your institution does/did to jumpstart your

learning analytics programs?

Page 36: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 36/39

Q&A...

Page 37: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 37/39

Help Us Improve and Grow

Thank you for participating

in today’s session.

We’re very interested in your feedback. Please take

a minute to fill out the session evaluation found within

the conference mobile app, or the online agenda.

Page 38: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 38/39

Transforming higher education through

the use of information technology

Page 39: Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 39/39

Why Learning Analytics Matter

We have 50 million reasons

why we need to get this work

right, right now...-

-Scott Morgan, Ed Surge

http://bit.ly/1El185T

“  ”  Randy Aragon, artist

http://www.randyarargon.com