Educational Data Mining: Potentials for 20th Century Learning...
Transcript of Educational Data Mining: Potentials for 20th Century Learning...
![Page 1: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/1.jpg)
Educational Data Mining: Potentials for 20th Century Learning Science
Ryan S.J.d. BakerTeachers College, Columbia University
![Page 2: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/2.jpg)
Exciting Times
• It’s exciting to see this workshop • Bringing educational data mining research
together with all of the other areasrepresented here
• Another step forward to making EDM one
of the key learning sciences of the 21stcentury
![Page 3: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/3.jpg)
EDM
“Educational Data Mining is an emerging discipline, concerned withdeveloping methods for exploring theunique types of data that come fromeducational settings, and using thosemethods to better understand students, andthe settings which they learn in.”
(www.educationaldatamining.org)
![Page 4: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/4.jpg)
EDM is…
• To Education • As Bio-informatics is to Biology… • A new toolbox making possible new kinds
of analyses, and analyses at larger scale
4
![Page 5: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/5.jpg)
EDM is…
• “… escalating the speed of research onmany problems in education.”
• “Not only can you look at unique learningtrajectories of individuals, but thesophistication of the models of learninggoes up enormously.”
• Arthur Graesser, Editor,
Journal of Educational Psychology5
![Page 6: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/6.jpg)
EDM is…
• “… great.” • Me
6
![Page 7: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/7.jpg)
Two communities
• Society for Learning Analytics Research– First conference: LAK2011
• International Educational Data Mining
Society– First event: EDM workshop in 2005 (at AAAI)– First conference: EDM2008– Publishing JEDM since 2009
• Plus an emerging number of great peopleworking in this area who are (not yet)closely affiliated with either community
![Page 8: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/8.jpg)
Two communities
• Joint goal of exploring the “big data” nowavailable on learners and learning
• To promote
– New scientific discoveries & to advancelearning sciences
– Better assessment of learners along multipledimensions
• Social, cognitive, emotional, meta-cognitive, etc.• Individual, group, institutional, etc.
– Better real-time support for learners
![Page 9: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/9.jpg)
Types of EDM method(Baker & Yacef, 2009)
• Prediction– Classification– Regression– Density estimation
• Clustering• Relationship mining
– Association rule mining– Correlation mining– Sequential pattern mining– Causal data mining
• Distillation of data for human judgment 9
![Page 10: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/10.jpg)
Types of EDM method(Baker & Siemens, accepted)
• Prediction– Classification– Regression– Latent Knowledge Estimation
• Structure Discovery– Clustering– Factor Analysis– Domain Structure Discovery– Network Analysis
• Relationship mining– Association rule mining– Correlation mining
10
![Page 11: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/11.jpg)
Prediction
• Develop a model which can infer a singleaspect of the data (predicted variable)from some combination of other aspectsof the data (predictor variables)
• Which students are off-task?• Which students will fail the class?• Which students will go to college
someday?
![Page 12: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/12.jpg)
Structure Discovery
• Find structure and patterns in the data thatemerge “naturally”
• No specific target or predictor variable
![Page 13: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/13.jpg)
Structure Discovery
• Different kinds of structure discoveryalgorithms find…
![Page 14: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/14.jpg)
Structure Discovery
• Different kinds of structure discoveryalgorithms find… different kinds ofstructure– Clustering: commonalities between data
points• What are students’ learning strategies in
exploratory learning environments?– Factor analysis: commonalities between
variables• Which features of the design of intelligent tutors go
together?– Domain structure discovery: structural
relationships between data points
![Page 15: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/15.jpg)
Relationship Mining
• Discover relationships between variablesin a data set with many variables– Association rule mining
• Which course-taking patterns are associated withsuccessful completion of an undergraduatesequence?
– Correlation and causal data mining• Which features of the design of intelligent tutors are
associated with better learning?– Sequential pattern mining
• How do patterns of learner hint use over timecorrespond differently to learning outcomes?
![Page 16: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/16.jpg)
Discovery with Models
• Pre-existing model (developed with EDMprediction methods… or clustering… orknowledge engineering)
• Applied to data and used as a component
in another analysis • Recent review in Hershkovitz et al. (in
press)
![Page 17: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/17.jpg)
Distillation of Data for HumanJudgment
• Making complex data understandable byhumans to leverage their judgment
• Particularly common in the learning
analytics community
![Page 18: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/18.jpg)
Types of EDM method
• Many of these overlap with traditional datamining methods
• Some new or special cases that are
particularly prominent in EDM– Latent Knowledge Estimation– Domain Structure Discovery– Discovery with Models
18
![Page 19: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/19.jpg)
Why now?
• Just plain more data available • Education can start to catch up to
research in Physics and Biology…
![Page 20: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/20.jpg)
Why now?
• Just plain more data available • Education can start to catch up to
research in Physics and Biology… fromthe year 1985
![Page 21: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/21.jpg)
PSLC DataShop(Koedinger et al, 2008, 2010)
• World’s leading public repository for educationalsoftware interaction data
• >200,000 hours of students using educationalsoftware within LearnLabs and other settings
• >30 million student actions, responses &annotations– Actions: entering an equation, manipulating a vector,
typing a phrase, requesting help– Responses: error feedback, strategic hints– Annotations: correctness, time, skill/concept
![Page 22: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/22.jpg)
The Vision
![Page 23: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/23.jpg)
Can we build educationalsoftware
• That knows as much about the learner ase-commerce software knows about itsusers?
23
![Page 24: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/24.jpg)
My internet browser cookiesknow everything about me
24
![Page 25: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/25.jpg)
• 35 years old• Living in New York
25
![Page 26: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/26.jpg)
• Fluent in English and Portuguese
26
![Page 27: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/27.jpg)
• Married with children
27
![Page 28: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/28.jpg)
• College professor
28
![Page 29: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/29.jpg)
• Reads kindle documents on an ipad
29
![Page 30: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/30.jpg)
• Travels internationally for work
30
![Page 31: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/31.jpg)
• Stays in cheap hotels
31
![Page 32: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/32.jpg)
• Likes operas by Philip Glass
32
![Page 33: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/33.jpg)
• Watches Barney videos online
33
![Page 34: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/34.jpg)
Used for
• The noble purpose of selling me morestuff
34
![Page 35: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/35.jpg)
But what do online learningenvironments know about the
learner?
35
![Page 36: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/36.jpg)
• All too often the answer is…
36
But what do online learningenvironments know about the
learner?
![Page 37: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/37.jpg)
37
![Page 38: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/38.jpg)
Some systems model student knowledge
• The systems that incorporate studentmodels typically model what a studentknows
• Can be used for– Interventions– problem selection– formative data for teachers
38
![Page 39: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/39.jpg)
Some systems model student knowledge
• The systems that incorporate studentmodels typically model what a studentknows
• Can be used for– Interventions– problem selection– formative data for teachers
• Useful!• But a one-dimensional picture of the
learner 39
![Page 40: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/40.jpg)
We can…
• Model a lot more than that
![Page 41: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/41.jpg)
My Slogan
41
![Page 42: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/42.jpg)
My Slogan
ModelEverything!
42
![Page 43: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/43.jpg)
Because…
• We can probably model everything thereis to know about the student…
43
![Page 44: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/44.jpg)
Because…
• We can probably model everything thereis to know about the student…
• More or less, anyways…
44
![Page 45: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/45.jpg)
In recent years
• There have been proofs of concept –successful models of a range ofconstructs we might care about
• Can model constructs using just log data• Some folks also use physical sensors
45
![Page 46: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/46.jpg)
Physical Sensors
• Facial Recognition Camera
46
![Page 47: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/47.jpg)
Physical Sensors
• Skin Conductance Sensor
47
![Page 48: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/48.jpg)
Physical Sensors
• Heart Rate Sensor
48
![Page 49: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/49.jpg)
Physical Sensors
• Posture “Butt” Sensor
49
![Page 50: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/50.jpg)
Physical Sensors
• EEG Pendant
50
![Page 51: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/51.jpg)
Physical Sensors
• FMRI Machine
51
![Page 52: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/52.jpg)
Physical Sensors
• FMRI Machine (Coming to a classroom near you!)
52
![Page 53: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/53.jpg)
Sensors
• Generally lead to better models than justlogs
• But not strictly needed– People have done surprisingly well at
detecting things like emotion just fromsoftware logs
53
![Page 54: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/54.jpg)
Stuff That Someone HasSuccesfully Modeled and Inferred
54
(Sensors or no Sensors)
![Page 55: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/55.jpg)
Stuff We Can Infer:Disengaged Behaviors
• Gaming the System (Baker et al., 2004,2008, 2010; Walonoski & Heffernan,2006; Beal, Qu, & Lee, 2007)
• Off-Task Behavior (Baker, 2007; Cetintaset al., 2010)
• Carelessness (San Pedro et al., 2011;Hershkovitz et al., 2011)
• WTF Behavior (Wixon et al., UMAP2012)
55
![Page 56: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/56.jpg)
Stuff We Can Infer:Meta-Cognition
• Self-Efficacy/Uncertainty/Confidence(Litman et al., 2006; McQuiggan, Mott, &Lester, 2008; Arroyo et al., 2009)
• Unscaffolded Self-Explanation (Shih et al.,2008; Baker, Gowda, & Corbett, 2011)
• Help Avoidance (Aleven et al., 2004,2006)
56
![Page 57: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/57.jpg)
Stuff We Can Infer:Affect
• Boredom (D’Mello et al., 2008; Sabourin etal., 2011; Baker et al., 2012)
• Frustration (McQuiggan et al., 2007;D’Mello et al., 2008; Sabourin et al., 2011;Baker et al., 2012)
• Confusion (D’Mello et al., 2008; Lee et al.,2011; Sabourin et al., 2011; Baker et al.,2012)
• Engaged Concentration/Flow (D’Mello etal., 2008; Sabourin et al., 2011; Baker etal., 2012) 57
![Page 58: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/58.jpg)
Stuff We Can Infer:Affect
• Curiosity (Sabourin et al., 2011)• Excitement (Arroyo et al., 2009)• Situational Interest (Arroyo et al., 2009)• Joy (Conati & Maclaren, 2009a, 2009b)• Distress (Conati & Maclaren, 2009a,
2009b)• Admiration (Conati & Maclaren, 2009a,
2009b)• Reproach (Conati & Maclaren, 2009a,
2009b)
58
![Page 59: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/59.jpg)
Stuff We Can Infer:Deep Learning
• Retention (Jastrzembski et al., 2006;Pavlik et al., 2008; Wang & Beck, 2012)
• Transfer/Shallow Learning (Baker et al.,2011, 2012)
• Preparation for Future Learning (Baker etal., 2011; Hershkovitz et al., under review)
59
![Page 60: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/60.jpg)
Stuff We Can Infer:Longer-Term Outcomes
• Standardized exam performance(Feng et al., 2009; Pardos et al., in press)
• Dropout
(Dekker et al., 2009; Arnold, 2010;Bowers, 2010; Ming & Ming, 2012)– Changes in student success in 3rd grade
predict who will drop out of high school! • College attendance
(San Pedro et al., under review)
![Page 61: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/61.jpg)
Making Rich Inference about theStudent’s Current State
• As a group, what these models show isthat we can make rich inference about thestudent’s current state
• With these models, we can get a multi-
dimensional picture of the learner
61
![Page 62: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/62.jpg)
Making Rich Inference about theStudent’s Current State
• As a group, what these models show isthat we can make rich inference about thestudent’s current state, and where they’regoing
• With these models, we can get a multi-
dimensional picture of the learner
62
![Page 63: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/63.jpg)
As we model more and more…
• We can envision software that responds toall of these aspects of the student– Meta-cognitive adaptation (cf. Arroyo et al.,
2007; Roll et al., 2010)– Disengagement adaptation (cf. Baker et al.,
2006; Walonoski & Heffernan, 2006)– Affect adaptation (cf. D’Mello et al., 2010;
Arroyo et al., 2011)– Instructor interventions when a student is at-
risk (cf. Arnold, 2010)– Optimizing memory retention (Pavlik et al.,
2008; Wang & Beck, 2012) 63
![Page 64: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/64.jpg)
Supporting…
• Supporting the development of a newgeneration of more sensitive and effectiveeducational software systems
64
![Page 65: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/65.jpg)
But also…
• Supporting a leveling-up in the learningsciences
• Enabling richer models of how learning
and engagement develop over time• Enabling multi-dimensional assessment of
the effects of learning technologies, andthe effects of small and large differencesin those technologies
• Enabling quantitative and fine-grainedconsideration of the effects and inter-
![Page 66: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/66.jpg)
These are exciting times
• It’s great to have all of you along for theadventure
• I’m excited by what we can do together • And I’m excited to learn from all of you
over the next two days
![Page 67: Educational Data Mining: Potentials for 20th Century Learning …create.nyu.edu/wordpress/wp-content/uploads/2013/04/sm... · 2013-04-16 · Potentials for 20th Century Learning Science](https://reader030.fdocuments.in/reader030/viewer/2022041015/5ec6bfbdebda4d33ca09426f/html5/thumbnails/67.jpg)
Thanks!
• Follow us on twitter @BakerEDMLab• Follow us on Facebook Baker EDM Lab• Publications at
http://www.columbia.edu/~rsb2162/publications.html
• “Big Data on Education” on Coursera, Fall2013
• Concentration in Learning Analytics in TCMasters in Human Development, Fall2013