Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
Transcript of Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 1/39
Moving the Red Queen Forward: MaturingLearning Analytics Practices
Thursday, October 29, 2015 at 2:40 PM in Sagamore Ballroom 3
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 2/39
Steven Lonn
Assistant Director for Assessment &
Evaluation, Digital Education & Innovation
University of Michigan - Ann Arbor@stevelonn
Eden Dahlstrom
Director of Research,
EDUCAUSE
@datadeeva
Glenda Morgan
Research Director, Teaching and
Learning
Gartner
@morganmundum
Andrea Nixon
Director of Educational Research
and Lecturer in Educational Studies
Carleton College
@anixon527
Clare van den Blink
VP information TechnologyServices and CIO
Pace University
@pacecio
#EDU15 ECARresearch
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 3/39
A slow sort of country!' said the Queen. 'Now, HERE, you
see, it takes all the running YOU can do, to keep in the
same place. If you want to get somewhere else, you must
run at least twice as fast as that! --Lewis Carroll, Through theLook ing-Glass
“
”
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 4/39
Learning Analytics Defined
“The measurement, collection, analysis and
report of data about learners and their
contexts, for purposes of understanding andoptimizing learning and the environments in
which it occurs.” --Society for
Learning Analytics Research (SoLAR)
Not just
theoretical
insights!!
Not just
reporting!!
Not just a
dashboard!!
Actionable intelligence!!
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 5/39
The Philosophical End of Learning Analytics
• In order to “do analytics” you must understand the use
cases for the data/information
• There needs to be context for the data
• You must understand who the audience is (students,
faculty, admin, departments) and what problems they are
trying to solve
• If you are doing analytics right, analytics information and
output will support the conversation, not replace the
conversation
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 6/39
Overview
• Leadership and Expertise
• Priorities and Investments
• Analytics and Ethics
• Advice to move your RED QUEEN forward
• Maturity of Analytics
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 7/39
Leadership and Expertise...
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 8/39
Audience Question
Who in the audience is an expert in learning analytics?
YES NO
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 9/39
Leadership in learning analytics(in the institutions that have this role)
*fewer than 25% of
institutions have this role
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 10/39
Responsibilities for analytics services
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 11/39
PANEL DISCUSSION
Leadership and Expertise
• Analytics is a highly collaborative, matrixed
process. What advice do we have for IT leaders
to find balance their leadership, support, and
strategic advisors roles?
• How do you help cultivate a scenario where
analytics at your institution to support theconversation, not replace the conversation?
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 12/39
Priorities and Investments...
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 13/39
Audience Question
Which is a higher priority for your institution?
LEARNING
ANALYTICS
INSTITUTIONAL
ANALYTICS
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 14/39
Analytics Priority
23% of respondents said learning analytics
was a major priority ; twice as many describedinstitutional analytics as one
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 15/39
Analytics Investment
Four in ten respondents reported little or no investment in
learning analytics
I t t i t d t
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 16/39
Investment in student success
technologies and leadership
commitment
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 17/39
PANEL DISCUSSION
Priorities and Investments
• Why the disconnect between the commitment to
student success efforts and investment?
• While ECAR research shows that priority and
investment in learning analytics lags behindinstitutional analytics, what investments might
NOT be reflected in these measurements?• Can investment in institutional analytics drive
learning analytics?
• What areas have the best investment potential to
yield favorable returns for both learning analytics
and institutional analytics initiatives?
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 18/39
Analytics, Students, and Ethics...
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 19/39
Student interest in analytics-powered
personalized matriculation facilitators
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 20/39
Student perspectives about the ways
higher ed can use student data
Helpful
“big mother ”
Creepy
“big brother ”
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 21/39
PANEL DISCUSSION
Analytics and Ethics
• What are the potential unintended consequences
of learning analytics?
• Data can be dangerous --- context, user
knowledge, quality, privacy --- What should be
our greatest concerns about learning analytics?
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 22/39
a few resources and services...
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 23/39
Some EDUCAUSE resources...
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 24/39
E D U
C A U S E
R e s o u r c e s f o r
L e a r n i n g A n a
l y t i c s
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 25/39
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 26/39
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 27/39
A new EDUCAUSE benchmarkingservice...
B h k l ti
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 28/39
Benchmark your analytics progress...Area Maturity Index Deployment Index
Analytics ✓ ✓
Culture of innovation ✓ Not applicable
E-learning ✓ ✓
Information security ✓ ✓
IT governance ✓ Not applicable
Research computing ✓ ✓
Risk management ✓ Not applicable
Student success technologies ✓ ✓
A 2016 collaboration between
ECAR and CDS
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 29/39
1) Build reports with customized peer
groups on demand
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 30/39
2) Benchmark maturity and technology
deployment
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 31/39
3) Receive recommendations for
improvement
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 32/39
CDS survey
deadline
November 6
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 33/39
Analytics Maturity...
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 34/39
Analytics maturity, 2014
2nd
genmaturity
index
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 35/39
PANEL DISCUSSION
Analytics Maturity
What is/was the most important single thing that
you/your institution does/did to jumpstart your
learning analytics programs?
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 36/39
Q&A...
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 37/39
Help Us Improve and Grow
Thank you for participating
in today’s session.
We’re very interested in your feedback. Please take
a minute to fill out the session evaluation found within
the conference mobile app, or the online agenda.
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 38/39
Transforming higher education through
the use of information technology
8/20/2019 Moving the Red Queen Forward: Maturing Learning Analytics Practices (287949369)
http://slidepdf.com/reader/full/moving-the-red-queen-forward-maturing-learning-analytics-practices-287949369 39/39
Why Learning Analytics Matter
We have 50 million reasons
why we need to get this work
right, right now...-
-Scott Morgan, Ed Surge
http://bit.ly/1El185T
“ ” Randy Aragon, artist
http://www.randyarargon.com