The IRAC Framework: Locating the performance zone for learning analytics
-
Upload
david-jones -
Category
Education
-
view
1.430 -
download
1
description
Transcript of The IRAC Framework: Locating the performance zone for learning analytics
![Page 1: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/1.jpg)
The IRAC FrameworkLocating the Performance Zone for Learning
AnalyticsDavid Jones @djplaner
Colin Beer @beercDamien Clark @damoclarky
http://bit.ly/iracZone
![Page 2: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/2.jpg)
How universitieswill implementanalytics
==
http://bit.ly/iracZone
![Page 3: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/3.jpg)
data warehouses “have been around for quite
some time, they have been plagued by high failure rates and limited spread or use”
(Ramamurthy, Sen and Sinha, 2008, p. 976)
the vast majority of big data and magical business
analytics projects fail. Not in a great big system-won’t-work way…They fail because the users don’t use them. (Schiller,
2012)
http://bit.ly/iracZone
![Page 4: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/4.jpg)
The IRAC FrameworkLocating the Performance Zone for Learning
Analytics
http://bit.ly/iracZone
![Page 5: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/5.jpg)
![Page 6: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/6.jpg)
Learning analytics, the analysis and representationof data about learners in order to improve learning (Clow, 2013, p.
1)
1. the development of new processes and tools aimed
at improving learning and teaching for individual students and instructors
2. The integration of these tools and processes intothe practice of teaching and learning
(Elias, 2011, p. 5)
![Page 7: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/7.jpg)
(Siemens, 2013, p. 13)
(Atif, Richards et al, 2013)
![Page 8: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/8.jpg)
Context: CQUniversity
Purpose: Identify students who may be at risk of failing
A nuanced appreciation of context is at the heartof mindful innovation with Information Technology
(Swanson & Ramiller, 2004)
![Page 9: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/9.jpg)
Context: CQUniversity
Purpose: Identify students who may be at risk of failing
A nuanced appreciation of context is at the heartof mindful innovation with Information Technology
(Swanson & Ramiller, 2004)
Help
![Page 10: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/10.jpg)
Context: CQUniversity
Purpose: Identify students who may be at risk of failing
A nuanced appreciation of context is at the heartof mindful innovation with Information Technology
Help academic staff help
![Page 11: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/11.jpg)
![Page 12: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/12.jpg)
Information
(Siemens, 2013, p. 13)
![Page 13: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/13.jpg)
http://en.wikipedia.org/wiki/Law_of_the_instrument
![Page 14: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/14.jpg)
Information - SAO
Source
Analysis
Output
# coursesPass rateGPAMoodle clicks
Single formula
Estimation ofsuccess
Student readiness survey Coming
soon!!
Insight
![Page 15: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/15.jpg)
Information - SAO
Source
Analysis
# coursesPass rateGPAMoodle activity
Single formula
Coming soon!!
Discussion forumsSocial media pages
AWE and PASS
(Atif et al, 2013)
Output
Estimation ofsuccess
Insight
![Page 16: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/16.jpg)
…the hegemonic status clickometry enjoys for analytic purposesin the realm of LMSs is counterproductive if our goal is to facilitateand evaluate the effectiveness of on-line learning
(Dietrichson, 2013, p. 349)
The amount of time students spend on the LMSis not an indication of deep or surface learning.
(Lodge & Lewis, 2012, p. 563)
![Page 17: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/17.jpg)
Any RSS/ATOM generating application
http://bit.ly/bambim
![Page 18: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/18.jpg)
Information - SAO
Source
Analysis
Output
Blog posts
External link analysis
Useful resources
Insight
Blog postsSchool sector
Link analysis
Recommend usefulposts from others
Blog posts
NLP
Detect and scaffoldreflection
Computational linguistics Detect
emotions…… …
…
![Page 19: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/19.jpg)
Predict-o-mania
http://www.slideshare.net/dgasevic/learning-analytics-are-about-learning
..predictive models are one-off and, therefore cannot be extended easily from one context to another
(Essa and Ayad, 2012, p. 2)
![Page 20: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/20.jpg)
Current modeling approaches..tend to be blackboxes from the standpoint of practitioners. Themere generation of a risk signal…does not convey enough information for the purpose of designing meaningful personalized interventions
(Essa and Ayad, 2012, p. 2)
![Page 21: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/21.jpg)
Information Representation
Affordances Change
Clickstream data
Variable models
Scutable✖
✖
✔Demographic data✔
EOS ✔
![Page 22: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/22.jpg)
Information
Representation
(Siemens, 2013, p. 13)
![Page 23: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/23.jpg)
Peoplesoft
Peoplesoft
LMS
N/A
![Page 24: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/24.jpg)
Information Representation
Affordances Change
Clickstream data
Variable models
Scutable✖
✖
✔Demographic data✔
IntegratedTabular
✔✔
EOS ✔
![Page 25: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/25.jpg)
Dashboards suck!
![Page 26: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/26.jpg)
Information
Representation
Affordances
(Siemens, 2013, p. 13)
![Page 27: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/27.jpg)
..no surprise that those things that theaffordances make easy are apt to get done, those things that the affordancesmake difficult are not apt to get done
(Norman, 1993, p. 106)
![Page 28: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/28.jpg)
M – mail-mergeE – emailP – phone callF – face-to-face
![Page 29: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/29.jpg)
![Page 30: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/30.jpg)
Hi all,
A quick email to let you know I have now completed all marking, and assessment results and the criteria sheets have been uploaded to Moodle. Again, there was a nice range of concepts explored and differing approaches to the use of the ePortfolio (Mahara).
In terms of our coursework, we are almost to the end of our theme-based activity and it is important to you are now drawing all of the threads together. Don't forget assessment task three is also right around the corner, so I would encourage you to make sure you are checking our Moodle site, contributing to the
forums and participating in either (or both) the scheduled Blackboard Collaborate sessions and the new drop-in sessions.
Please feel free to give me a call if there is anything you would like to discuss.
Regards, {$staff.firstname} {$staff.email}
20-30%
![Page 31: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/31.jpg)
![Page 32: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/32.jpg)
Information Representation
Affordances Change
Clickstream data
Variable models✖
✔Demographic data✔
“CRM” functionality ✔
Scutable✖
IntegratedTabular
✔✔
Exaptation
EOS ✔
![Page 33: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/33.jpg)
Information Representation
Affordances Change
Clickstream data
Variable models✖
✔Demographic data✔
“CRM” functionality ✔
Scutable✖
IntegratedTabular
✔✔
Exaptation
Checkpoint & Process Analytics
(Lockyer et al, 2013)
✖
EOS ✔
![Page 34: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/34.jpg)
http://www.itap.purdue.edu/studio/passnote/
![Page 35: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/35.jpg)
Less is moreBirds of a featherTake actionDon’t be a threat
http://www.itap.purdue.edu/studio/passnote/
![Page 36: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/36.jpg)
Information Representation
Affordances Change
Clickstream data
Variable models✖
✔Demographic data✔
“CRM” functionality ✔Pedagogical scaffolding✖
Scutable✖
IntegratedTabular
✔✔
Exaptation
Checkpoint & Process Analytics✖
EOS ✔
![Page 37: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/37.jpg)
https://labs.desmos.com/teacher/demo#overview
![Page 38: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/38.jpg)
Information
Representation
Affordances
Change
(Siemens, 2013, p. 13)
![Page 39: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/39.jpg)
remainder of negative feedback concernedfaculty use of the tool…over penetration…a desire for more specific information….
demonstrates that instructors and studentsare on the same page about the lack of bestpractice
(Arnold, 2010, n.p.)
![Page 40: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/40.jpg)
(Carroll, Kellog & Rosson, 1991, p. 80)
![Page 41: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/41.jpg)
Information Representation
Affordances Change
Clickstream data
Variable models✖
✔Demographic data✔
“CRM” functionality ✔Task-artifact cycle✔
Scutable✖
IntegratedTabular
✔✔
Exaptation
Checkpoint & Process Analytics✖
Pedagogical scaffolding✖
EOS ✔
![Page 42: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/42.jpg)
fundamental DSS principles like evolutionary development (Arnot & Pervan,
2005)
development processes are not implemented in a linear or
even in a parallel fashion, but in continuous action cycles that involve significant user participation(Arnot & Pervan,
2005)
![Page 43: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/43.jpg)
Information Representation
Affordances Change
Clickstream data
Variable models✖
✔Demographic data✔
“CRM” functionality ✔Task-artifact cycle✔
Evolutionary development ✔
(Buckingham-Shum, 2012, p. 8)
Scutable✖
IntegratedTabular
✔✔
Exaptation
Checkpoint & Process Analytics✖
The risk is that research and development focuses on the data which is simplest to log computationally,
perpetuating the dominant pedagogies and learning outcomes from an industrial era
Pedagogical scaffolding✖
![Page 44: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/44.jpg)
Total clicks on
Moodle site
![Page 45: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/45.jpg)
![Page 46: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/46.jpg)
![Page 47: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/47.jpg)
Information Representation
Affordances Change
Clickstream data
Variable models✖
✔Demographic data✔
“CRM” functionality ✔Task-artifact cycle✔
(Reiser, 2001, p. 63)
In place✔
Scutable✖Tabular ✔
Exaptation
Checkpoint & Process Analytics✖..provide workers with the help they need toperform certain job tasks, at the time they needthat help, and in a form that will be most helpful.Pedagogical scaffolding✖
EOS ✔
![Page 48: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/48.jpg)
![Page 49: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/49.jpg)
IRAC
Greater use
Improved learning
![Page 50: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/50.jpg)
How universitieswill implementanalytics
!=
![Page 51: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/51.jpg)
http://bit.ly/iracZone
Analysis of LA literature
Develop IRAC
Use IRACDesign research – BIM, SSI,
MAVEvaluation of institutional projects
![Page 52: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/52.jpg)
Arnold, K. E. (2010). Signals: Applying Academic Analytics. Educause Quarterly, 33(1).
Arnott, D., & Pervan, G. (2005). A critical analysis of decision support systems research. Journal of Information Technology, 20(2), 67–87. doi:10.1057/palgrave.jit.2000035
Buckingham Shum, S. (2012). Learning Analytics. Moscow.
Carroll, J. M., Kellog, W. A., & Rosson, M. B. (1991). The Task-Artifact Cycle. In John Millar Carroll (Ed.), Designing Interaction: Psychology at the Human-Computer Interface (pp. 74–102). Cambridge, UK: Cambridge University Press.
Clow, D. (2013). An overview of learning analytics. Teaching in Higher Education, 6(August), 683–695. doi:10.1080/13562517.2013.827653
Dietrichson, A. (2013). Beyond Clickometry: Analytics for Constructivist Pedagogies. International Journal on E-Learning, 12(4), 333–351.
Elias, T. (2011). Learning Analytics: Definitions, Processes and Potential. Learning.
Essa, A., & Ayad, H. (2012). Student success system: risk analytics and data visualization using ensembles of predictive models. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge - LAK ’12 (pp. 2–5). Vancouver: ACM Press.
![Page 53: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/53.jpg)
García-Solórzano, D., Cobo, G., Santamaría, E., Morán, J. A., Monzo, C., & Melenchón, J. (2012). Educational monitoring tool based on faceted browsing and data portraits. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 170–178). New York, NY, USA: ACM. doi:10.1145/2330601.2330645
Lockyer, L., Heathcote, E., & Dawson, S. (2013). Informing Pedagogical Action: Aligning Learning Analytics With Learning Design. American Behavioral Scientist, 57(10), 1439–1459. doi:10.1177/0002764213479367
Lodge, J., & Lewis, M. (2012). Pigeon pecks and mouse clicks : Putting the learning back into learning analytics. In M. Brown, M. Hartnett, & T. Stewart (Eds.), Future challenges, sustainable futures. Proceedings ascilite Wellington 2012 (pp. 560–564). Wellington, NZ.
Norman, D. A. (1993). Things that make us smart: defending human attributes in the age of the machine. Cambridge, Mass: Perseus. Reading, MA: Addison Wesley.
Ramamurthy, K., Sen, A., & Sinha, A. P. (2008). Data warehousing infusion and organizational effectiveness. Systems, Man and …, 38(4), 976–994. doi:10.1109/TSMCA.2008.923032
Reiser, R. (2001). A History of Instructional Design and Technology: Part 1: A History of Instructional Media. Educational Technology Research and Development, 49(1), 1042–1629.
![Page 54: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/54.jpg)
Schiller, M. J. (2012). Big data fail: Five principles to save your BI butt. CIO Insight.
Siemens, G. (2013). Learning Analytics: The Emergence of a Discipline. American Behavioral Scientist, 57(10), 1371–1379. doi:10.1177/0002764213498851
Swanson, E. B., & Ramiller, N. C. (2004). Innovating mindfully with information technology. MIS Quarterly, 28(4), 553–583.
Ullmann, T. D., Wild, F., & Scott, P. (2012). Comparing Automatically Detected Reflective Texts with Human Judgements. In 2nd Workshop on Awareness and Reflection in Technology-Enhanced Learning. 7th European Conference on Technology-Enhanced Learning (pp. 101–116). Saarbruecken, Germany.
![Page 55: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/55.jpg)
Slide 5, 49: "Question Everything / Nullius in verba / Take nobody's word for it" by Duncan Hull available at http://flickr.com/photos/dullhunk/202872717 under Attribution License http://creativecommons.org/licenses/by/2.0/
Slide 53: "University of Michigan Library Card Catalog" by David Fulmer available at http://flickr.com/photos/dfulmer/4350629792 under Attribution License http://creativecommons.org/licenses/by/2.0/
Slide 3: "Warehouse" by Michele Ursino available at http://flickr.com/photos/micurs/6118627854 under Attribution-ShareAlike License http://creativecommons.org/licenses/by-sa/2.0/
Slide 15: "Stream" by coniferconifer available at http://flickr.com/photos/coniferconifer/9535872266 under Attribution License http://creativecommons.org/licenses/by/2.0/
Slide 50, 51, 52: "The British Library" by Steve Cadman available at http://flickr.com/photos/stevecadman/486263551 under Attribution-ShareAlike License http://creativecommons.org/licenses/by-sa/2.0/
Slide 17: "Lawyer Crystal Ball" by CALI - Center for Computer-Assisted Legal Instruction available at http://flickr.com/photos/cali.org/6150105185 under Attribution-NonCommercial-ShareAlike License http://creativecommons.org/licenses/by-nc-sa/2.0/
![Page 56: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/56.jpg)
Slide 23: "Dashboard" by Marko Vallius available at http://flickr.com/photos/markvall/3892112410 under Attribution-NonCommercial-ShareAlike License http://creativecommons.org/licenses/by-nc-sa/2.0/
Slide 4: "framework" by kaz k available at http://flickr.com/photos/kazk/198640938 under Attribution License http://creativecommons.org/licenses/by/2.0/
Slide 47: "25.365" by romana klee available at http://flickr.com/photos/romanaklee/5391995939 under Attribution-ShareAlike License http://creativecommons.org/licenses/by-sa/2.0/
Slide 18: "The Internet" by Martin Deutsch available at http://flickr.com/photos/MartinDeutsch/3190769121 under Attribution-NonCommercial-NoDerivs License http://creativecommons.org/licenses/by-nc-nd/2.0/
Slide 8, 9: "day 140" by mjtmail (tiggy) available at http://flickr.com/photos/mjtmail(tiggy)/2518317362 under Attribution License http://creativecommons.org/licenses/by/2.0/
Slide 6: "Purpose" by Seth Sawyers available at http://flickr.com/photos/sidewalkflying/3534131757 under Attribution License http://creativecommons.org/licenses/by/2.0/
![Page 57: The IRAC Framework: Locating the performance zone for learning analytics](https://reader030.fdocuments.in/reader030/viewer/2022012823/55535b66b4c905031f8b4842/html5/thumbnails/57.jpg)
Slide 12: "Making Omelettes" by PhotoGraham available at http://flickr.com/photos/PhotoGraham/260939952 under Attribution-NonCommercial-ShareAlike License http://creativecommons.org/licenses/by-nc-sa/2.0/
Slide 2, 48: "Smoking pile of sh*t" by David Jones available at http://flickr.com/photos/DavidTJones/3626888438 under Attribution-NonCommercial-ShareAlike License http://creativecommons.org/licenses/by-nc-sa/2.0/
Slide 40: "Change Allley sign" by Matt Brown available at http://flickr.com/photos/MattFromLondon/3163571645 under Attribution License http://creativecommons.org/licenses/by/2.0/