Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

Post on 07-Aug-2018

213 views 0 download

Transcript of Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 1/39

Moving the Red Queen Forward: MaturingLearning Analytics Practices

Thursday, October 29, 2015 at 2:40 PM in Sagamore Ballroom 3

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 2/39

 

Steven Lonn

 Assistant Director for Assessment &

Evaluation, Digital Education & Innovation

University of Michigan - Ann Arbor@stevelonn

Eden Dahlstrom

Director of Research,

EDUCAUSE

@datadeeva

Glenda Morgan

Research Director, Teaching and

Learning

Gartner

@morganmundum

 Andrea Nixon

Director of Educational Research

and Lecturer in Educational Studies

Carleton College

@anixon527

Clare van den Blink

VP information TechnologyServices and CIO

Pace University

@pacecio

#EDU15 ECARresearch

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 3/39

A slow sort of country!' said the Queen. 'Now, HERE, you

see, it takes all the running YOU can do, to keep in the

same place. If you want to get somewhere else, you must

run at least twice as fast as that! --Lewis Carroll, Through theLook ing-Glass

“ 

” 

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 4/39

Learning Analytics Defined

“The measurement, collection, analysis and

report of data about learners and their

contexts, for purposes of understanding andoptimizing learning and the environments in

which it occurs.”  --Society for

Learning Analytics Research (SoLAR)

Not just

theoretical

insights!!

Not just

reporting!!

Not just a

dashboard!!

 Actionable intelligence!!

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 5/39

The Philosophical End of Learning Analytics

• In order to “do analytics” you must understand the use

cases for the data/information

• There needs to be context for the data

• You must understand who the audience is (students,

faculty, admin, departments) and what problems they are

trying to solve

• If you are doing analytics right, analytics information and

output will support the conversation, not replace the

conversation

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 6/39

Overview

• Leadership and Expertise

• Priorities and Investments

•  Analytics and Ethics

•  Advice to move your  RED QUEEN forward

• Maturity of Analytics

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 7/39

Leadership and Expertise...

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 8/39

 Audience Question

Who in the audience is an expert in learning analytics?

YES NO

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 9/39

Leadership in learning analytics(in the institutions that have this role)

*fewer than 25% of

institutions have this role

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 10/39

Responsibilities for analytics services

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 11/39

PANEL DISCUSSION

Leadership and Expertise

•  Analytics is a highly collaborative, matrixed

process. What advice do we have for IT leaders

to find balance their leadership, support, and

strategic advisors roles?

• How do you help cultivate a scenario where

analytics at your institution to support theconversation, not replace the conversation?

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 12/39

Priorities and Investments...

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 13/39

 Audience Question

Which is a higher priority for your institution?

LEARNING

 ANALYTICS

INSTITUTIONAL 

 ANALYTICS

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 14/39

 Analytics Priority

23% of respondents said learning analytics

was a major priority ; twice as many describedinstitutional analytics as one

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 15/39

 Analytics Investment

Four in ten respondents reported little or no investment  in

learning analytics

I t t i t d t

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 16/39

Investment in student success

technologies and leadership

commitment

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 17/39

PANEL DISCUSSION

Priorities and Investments

• Why the disconnect between the commitment to

student success efforts and investment?

• While ECAR research shows that priority and

investment in learning analytics lags behindinstitutional analytics, what investments might

NOT be reflected in these measurements?• Can investment in institutional analytics drive

learning analytics?

• What areas have the best investment potential to

yield favorable returns for both learning analytics

and institutional analytics initiatives?

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 18/39

 Analytics, Students, and Ethics...

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 19/39

Student interest in analytics-powered

personalized matriculation facilitators

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 20/39

Student perspectives about the ways

higher ed can use student data

Helpful

“big mother ” 

Creepy

“big brother ” 

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 21/39

PANEL DISCUSSION

 Analytics and Ethics

• What are the potential unintended consequences 

of learning analytics?

• Data can be dangerous --- context, user

knowledge, quality, privacy --- What should be

our  greatest concerns about learning analytics?

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 22/39

a few resources and services...

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 23/39

Some EDUCAUSE resources...

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 24/39

   E   D   U

   C   A   U   S   E

   R  e  s  o  u  r  c  e  s   f  o  r

   L  e  a  r  n   i  n  g   A  n  a

   l  y   t   i  c  s

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 25/39

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 26/39

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 27/39

 A new EDUCAUSE benchmarkingservice...

B h k l ti

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 28/39

Benchmark your analytics progress...Area Maturity Index Deployment Index

 Analytics ✓  ✓ 

Culture of innovation ✓  Not applicable

E-learning ✓  ✓ 

Information security ✓  ✓ 

IT governance ✓  Not applicable

Research computing ✓  ✓ 

Risk management ✓  Not applicable

Student success technologies ✓  ✓ 

 A 2016 collaboration between

ECAR  and CDS

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 29/39

1) Build reports with customized peer

groups on demand

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 30/39

2) Benchmark maturity and technology

deployment

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 31/39

3) Receive recommendations for

improvement

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 32/39

CDS survey

deadline

November 6

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 33/39

 Analytics Maturity...

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 34/39

 Analytics maturity, 2014

2nd

genmaturity

index

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 35/39

PANEL DISCUSSION

 Analytics Maturity

What is/was the most important single thing that

you/your institution does/did to jumpstart your

learning analytics programs?

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 36/39

Q&A...

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 37/39

Help Us Improve and Grow

Thank you for participating

in today’s session.

We’re very interested in your feedback. Please take

a minute to fill out the session evaluation found within

the conference mobile app, or the online agenda.

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 38/39

Transforming higher education through

the use of information technology

8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)

http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 39/39

Why Learning Analytics Matter

We have 50 million reasons

why we need to get this work

right, right now...-

-Scott Morgan, Ed Surge

http://bit.ly/1El185T

“  ”  Randy Aragon, artist

http://www.randyarargon.com