UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association...
-
Upload
uksg-connecting-the-knowledge-community -
Category
Education
-
view
1.103 -
download
4
Transcript of UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association...
![Page 1: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/1.jpg)
Learning Analytics: Gaining good actionable insight
Martin Hawksey
@mhawksey
Chief Innovation, Community and Technology Officer
![Page 2: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/2.jpg)
@mhawksey 2
go.alt.ac.uk/join-ALT
![Page 3: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/3.jpg)
alt.ac.uk @mhawksey 3
![Page 4: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/4.jpg)
“
alt.ac.uk
Analytics in Education
Analytics is the process of developing actionable insights through problem definition and the
application of statistical models and analysis against existing and/or simulated future data
Adam Cooper, What is Analytics? http://publications.cetis.ac.uk/wp-content/uploads/2012/11/What-is-Analytics-Vol1-No-5.pdf
@mhawksey 4
![Page 5: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/5.jpg)
“
alt.ac.uk
Learning Analytics Definition
…the measurement, collection, analysis and
reporting of data about learners and their
contexts, for purposes of understanding and
optimising learning and the environments in
which it occurs
First International Conference on Learning Analytics and Knowledge (LAK11), 2011
@mhawksey 5
![Page 6: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/6.jpg)
alt.ac.uk
Poll question here
@mhawksey 6
![Page 7: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/7.jpg)
alt.ac.uk
Disciplines
◊ Computer science
◊ Statistics
◊ Programming
◊ Network analysis
◊ Psychology of education
◊ …
@mhawksey 7
![Page 8: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/8.jpg)
alt.ac.uk
Methods
◊ Content Analytics
◊ Context Analytics
◊ Discourse Analytics
◊ Disposition Analytics
◊ Social Network Analysis
◊ …
@mhawksey 8
Ferguson and Buckingham Shum (2012) Social Learning Analytics: Five Approaches
![Page 9: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/9.jpg)
alt.ac.uk
Tools/Products
◊ Spreadsheets - MS Excel, Tableau, Open
Refine, Google Sheets…
◊ SNA – NodeXL, Gephi, Cytoscape
◊ Programming: R, Python, MATLAB…
◊ VLEs - Blackboard Analytics for Learn,
Desire2Learn Insights …
◊ …
@mhawksey 9
![Page 10: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/10.jpg)
alt.ac.uk
@mhawksey 10
Action
Analytic
Data
Question
![Page 11: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/11.jpg)
alt.ac.uk @mhawksey
The Absence of Theory
11
![Page 12: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/12.jpg)
“
alt.ac.uk
Amazon cares not a whit *why* people who buy
german chocolate also buy cake pans as long as
they get to the checkout buying both
Mike Caulfield - Short Notes on the Absence of Theory
http://hapgood.us/2013/12/10/short-notes-on-the-absence-of-theory/
@mhawksey 12
![Page 13: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/13.jpg)
“
alt.ac.uk
Counts don’t count much if decontextualized
Wilson, T.D. (1999). Models in information behaviour research. Journal of
Documentation, 55(3), 249 – 270.
@mhawksey
Dragan Gasevic speaking at DiCE Seminar
Moray House School of Education – 9th January 2015
13
![Page 14: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/14.jpg)
alt.ac.uk @mhawksey
Data Visualization
14
![Page 15: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/15.jpg)
15
![Page 16: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/16.jpg)
@mhawksey 16
Image credit: http://practicalanalytics.co/2014/06/02/cloud-based-healthcare-platform-
apples-health-app-and-healthkit/
![Page 17: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/17.jpg)
“
alt.ac.uk
Graphs can be a powerful way to represent relationships
between data, but they are also a very abstract concept, which
means that they run the danger of meaning something only to
the creator of the graph … Everything looks like a graph, but
almost nothing should ever be drawn as one.
Ben Fry in ‘Visualizing Data’
@mhawksey 17
![Page 18: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/18.jpg)
alt.ac.uk
Exploratory visualization
Data visualizations that are used by the
designer for self-informative purposes to
discover patterns, trends, or sub-problems in a
dataset. Exploratory visualizations typically
don’t have an already-known story.
Explanatory visualization
Data visualizations that are used to transmit
information or a point of view from the designer
to the reader. Explanatory visualizations
typically have a specific “story” or information
that they are intended to transmit.
Iliinsky & Steele - Designing
Data Visualizations:
Representing Informational
Relationships
@mhawksey 18
![Page 19: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/19.jpg)
“
alt.ac.uk
Visualizations can be harmful
Corrin, L., & de Barba, P. (2014). Exploring students’ interpretation of feedback
delivered through learning analytics dashboards. In Proceedings of the ascilite
2014 conference (pp. 629-633). ascilite.
@mhawksey
Dragan Gasevic speaking at DiCE Seminar
Moray House School of Education – 9th January 2015
19
![Page 20: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/20.jpg)
alt.ac.uk @mhawksey
Ethics, privacy and data sharing
20
![Page 21: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/21.jpg)
“
alt.ac.uk
The worlds of privacy
and analytics intersect
Downes (2014)
@mhawksey
…not always happily
21
© Unknown
Source: http://crooksandliars.com/files/primary_image/14/05/inbloom-drawing.jpg
![Page 22: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/22.jpg)
alt.ac.uk
Ethics
◊ Clarity
◊ Comfort and care
◊ Choice and consent
◊ Consequence and complaint
@mhawksey 22
Legal, Risk and Ethical Aspects of Analytics in Higher Education (Kay, Korn,
& Oppenheim, 2012)
![Page 23: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/23.jpg)
alt.ac.uk @mhawksey 23
http://www.open.ac.uk/students/charter/essential-documents/ethical-use-student-
data-learning-analytics-policy
![Page 24: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/24.jpg)
alt.ac.uk @mhawksey 24
https://www.jisc.ac.uk/guides/code-of-practice-for-learning-analytics
![Page 25: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/25.jpg)
alt.ac.uk @mhawksey
Opportunities
25
![Page 26: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/26.jpg)
“
alt.ac.uk
Feedback loops between students and instructors are missing!
Hattie, J., & Timperley, H. (2007). The power of feedback. Review of education research, 77(1), 82-112.
@mhawksey 26
![Page 27: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/27.jpg)
“
alt.ac.uk
At best analytics can help start a
conversation. People have to be willing
to take the conversation on
Roberts, G. Analytics are not relationships
http://rworld2.brookesblogs.net/2014/12/12/analytics-are-not-relationships/
@mhawksey 27
![Page 28: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/28.jpg)
alt.ac.uk @mhawksey
Examples
28
![Page 29: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/29.jpg)
alt.ac.uk
Optimal Video Length
Philip Guo, Optimal Video Length for Student Engagement
@mhawksey
![Page 30: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/30.jpg)
alt.ac.uk
Misconception or mistakes in MCQs
@mhawksey 30
Koller, D The Online Revolution: Education at Scale (2012)
http://youtu.be/ixE1YAlHnVU?t=29m16s
![Page 31: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/31.jpg)
Analytics at scale: Course Signals
Developed at Purdue University, USA
31 Arnold, K. E., & Pistilli, M. (2012). Course Signals at Purdue: Using Learning Analytics
To Increase Student Success. Paper presented at LAK12, Vancouver, Canada.
http://www.slides
hare.net/R3becca
F/scaling-up-
learning-analytics
![Page 32: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/32.jpg)
Easily accessible OU data
Learning design and analytics at the OU
32
http://www.slides
hare.net/R3becca
F/scaling-up-
learning-analytics
![Page 33: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/33.jpg)
alt.ac.uk
Scaling up Learning Analytics
33
https://www.youtube.com/watch?v=Ii4EgnOvpxA
@mhawksey
![Page 34: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/34.jpg)
alt.ac.uk @mhawksey
Wrapping up
34
![Page 35: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/35.jpg)
“
alt.ac.uk
Learning activities don’t happen in a
single platform
Dragon Gasevic
@mhawksey 35
![Page 36: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/36.jpg)
“
alt.ac.uk
Not everything that can be counted counts.
Not everything that counts can be counted.
William Bruce Cameron
@mhawksey 36
![Page 37: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/37.jpg)
“
alt.ac.uk
What kind of learners are we trying
to create?
… this should drive our analytics
Simon Buckingham Shum
@mhawksey 37
![Page 38: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/38.jpg)
alt.ac.uk
Computers are stupid
@mhawksey 38
https://twitter.com/jackyalcine/status/615329515909156865
![Page 39: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/39.jpg)
alt.ac.uk
Useful links
• LACE (learning analytics community exchange) :
http://www.laceproject.eu/
• SoLAR : Society for Learning Analytics Research
http://solaresearch.org/
• Jisc: http://analytics.jiscinvolve.org/wp
• Cetis Analytics Series : http://publications.cetis.ac.uk/c/analytics
• LAK16 Conference #lak16
From http://www.slideshare.net/sheilamac/intro-to-learning-analytics-universities-
scotlanddec2014smn
@mhawksey 39
![Page 40: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/40.jpg)
alt.ac.uk
Thank you!
@mhawksey +MartinHawksey
@mhawksey 40
![Page 41: UKSG webinar: Learning analytics - gaining good actionable insight with Martin Hawksey, Association for Learning Technology](https://reader031.fdocuments.in/reader031/viewer/2022030305/5872ecbe1a28abfa548b75f7/html5/thumbnails/41.jpg)
Association for Learning Technology
Registered charity number: 1063519
www.alt.ac.uk @A_L_T