Data Mining and Text Mining in Educational Research
Transcript of Data Mining and Text Mining in Educational Research
![Page 1: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/1.jpg)
Data Mining in EducationSocial Media + Text
Qiang Hao
http://tobeneo.com
![Page 2: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/2.jpg)
Goals
• What is Data Mining?
• What tools / knowledge do you need to do Data Mining?
• What is the basic process of Data Mining?
![Page 3: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/3.jpg)
Questions Answered by Data Mining
• Can we predict whether the coming email is a spam?
![Page 4: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/4.jpg)
Questions Answered by Data Mining
• Can we predict whether the coming email is a spam?
![Page 5: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/5.jpg)
Questions Answered by Data Mining
• Can we predict whether the coming email is a spam?
money
you
he
……
![Page 6: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/6.jpg)
Questions Answered by Data Mining
• What is the attitude of people on Twitter towards the presidential candidate Donald Trump?
![Page 7: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/7.jpg)
Questions Answered by Data Mining
• What is the attitude of people on Twitter towards the presidential candidate Donald Trump?
#Trump
#DonaldTrump
#GOPTrump
![Page 8: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/8.jpg)
Questions Answered by Data Mining
• What is the attitude of people on Twitter towards the presidential candidate Donald Trump?
![Page 9: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/9.jpg)
Questions Answered by Data Mining
• What is the attitude of people on Twitter towards the presidential candidate Donald Trump?
a, an, the, is, are, was, were, if …
![Page 10: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/10.jpg)
Questions Answered by Data Mining
• What is the attitude of people on Twitter towards the presidential candidate Donald Trump?
![Page 11: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/11.jpg)
Questions Answered by Data Mining
• What is the attitude of people on Twitter towards the presidential candidate Donald Trump?
Negative
Neutral
Positive
![Page 12: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/12.jpg)
Educational Questions to Answer by Data Mining
![Page 13: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/13.jpg)
Educational Questions to Answer by Data Mining
• What algorithm can score essays as teachers do?
![Page 14: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/14.jpg)
Educational Questions to Answer by Data Mining
• What courses should we recommend to students based on their online activities?
![Page 15: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/15.jpg)
Educational Questions to Answer by Data Mining
• Does the intervention improve students’ lexical variety in their writing?
![Page 16: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/16.jpg)
Educational Questions to Answer by Data Mining
• Are there different patterns in students’ questions; if so, are the patterns related to their academic performance?
![Page 17: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/17.jpg)
Educational Questions to Answer by Data Mining
• What sub-topics do students tend to cover when discussing this topic?
![Page 18: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/18.jpg)
Educational Questions to Answer by Data Mining
• What predictor is the most important one for whether college students seek help online in their learning?
![Page 19: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/19.jpg)
Goals
• What is Data Mining?
Replicable
Reproducible
Automatic
![Page 20: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/20.jpg)
Goals
• What is Data Mining?
• What tools / knowledge do you need to do Data Mining?
![Page 21: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/21.jpg)
Tools / Knowledge
![Page 22: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/22.jpg)
Tools / Knowledge
Carmen Reinhart Kenneth Rogoff
Thomas Herndon
![Page 23: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/23.jpg)
Goals
• What tools / knowledge do you need to do Data Mining?
Expert level of knowledge in statistics
Intermediate level of knowledge in programming
Familiarity with R/Python
![Page 24: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/24.jpg)
R for SAS and SPSS Users
Robert A. Muenchen
Goals
![Page 25: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/25.jpg)
Hands-On Programming with R
Garrett Grolemund
Goals
![Page 26: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/26.jpg)
Goals
• What is Data Mining?
• What tools / knowledge do you need to do Data Mining?
• What is the basic process of Data Mining?
![Page 27: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/27.jpg)
Data Collection
Data Cleaning
Data Processing
Data Analysis
Sharing Data and Results
Research Pipeline
![Page 28: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/28.jpg)
Data Collection
![Page 29: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/29.jpg)
• XML
Data Collection
![Page 30: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/30.jpg)
Data Collection
• JSON
![Page 31: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/31.jpg)
Mining the Social Web 2nd
Edition
Matthew A. Russell
Python
Data Collection
![Page 32: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/32.jpg)
Data Cleaning
![Page 33: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/33.jpg)
Data Processing
![Page 34: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/34.jpg)
Data Processing
![Page 35: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/35.jpg)
Data Processing
![Page 36: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/36.jpg)
Data Processing
Text Analysis with R for Students of Literature
Matthew L. Jockers
![Page 37: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/37.jpg)
Data Analysis
• Lexical Variety
• Classification• Clustering Analysis• Latent Semantic Analysis• Support Vector Machine• Sentimental Analysis
• Topic Modeling
![Page 38: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/38.jpg)
Data Analysis
Renkl, A. (1997). Learning from worked‐out examples: A study on individual differences. Cognitive science, 21(1), 1-29.
![Page 39: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/39.jpg)
Data Analysis
An Introduction to Statistical Learning
Gareth JamesDaniela WittenTrevor HastieRobert Tibshirani
![Page 40: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/40.jpg)
Sharing Data and Results
• R + KnitR + RPub
• GitHub
![Page 41: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/41.jpg)
Sharing Data and Results
• R + KnitR + RPub: http://rpubs.com/neohao/online-help-seeking
![Page 42: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/42.jpg)
Sharing Data and Results
• GitHub: https://github.com/Neo-Hao/TwitterHashtagR
![Page 43: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/43.jpg)
Sharing Data and Results
Version control with Git
Jon Loeliger
![Page 44: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/44.jpg)
![Page 45: Data Mining and Text Mining in Educational Research](https://reader031.fdocuments.in/reader031/viewer/2022021815/58f040331a28ab893c8b45b1/html5/thumbnails/45.jpg)
Thanks!