Seminario eMadrid/SHEILA sobre "Analítica del Aprendizaje". Panorama general de las actividades de...
-
Upload
emadrid-network -
Category
Education
-
view
110 -
download
0
Transcript of Seminario eMadrid/SHEILA sobre "Analítica del Aprendizaje". Panorama general de las actividades de...
An Overview of Learning Analytics Activities in
UC3MCarlos Delgado Kloos, Pedro J. Muñoz-Merino
Univ. Carlos III de Madrid, www.it.uc3m.esRed eMadrid, www.emadridnet.org
Knowledge and Data"Quite simply,
knowledge is the engine of our economy.And data is its fuel."
Neelie KroesFormer Vicepresident
European Commission,Responsible for Digital Agenda
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
2
Precious Data
"Data is a precious thingand will last longerthan the systems themselves."
Tim Berners-LeeDirector W3C
Inventor of the WWW
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
3
Privacy
www.aclu.org/ordering-pizzaC. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
4
Data is PreciousMedical Sector
Data needed for the well-being of the patientFor medical research
Educational SectorEducational Data MiningLearning AnalyticsUseful for whom?
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
5
Learning & Academic Analytics
www.educause.edu/ero/article/penetrating-fog-analytics-learning-and-education
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
6
CompromiseBalance
Accountable, justified usePrivacySecurity
Regulation and policies neededBriefgeheimnis
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
7
Legal Background in Spain Spanish Constitution (1978)
Article 18:Right to personal privacy
AEPD: Agencia Españolade Protección de Datos Since 1993
Data Protection Directive 95/46/EC
LOPD: Ley Orgánica de Protección de Datos 15/1999 Protects personal privacy
rights related to data
Agencia deProtección de Datos de la Comunidad de Madrid 2001-2012
Reglamento de Medidas de Seguridad (RD 1720/2007) Data security measures
Universities: Comisión LOPD Gives recommendations
and takes care of lawat the university
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
8
PoliciesThe legal background is in placeThe structures operativeHowever, the field is moving fastPolicies have to be put in place for handling
the different scenarios that are coming upAwareness, training, involvement of many
stakeholders, ... International collaboration
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
9
Adoption at UC3MFirst pilots
0 Courses (Khan Academy)SPOCs (Open edX)
In progressAll SPOCsedXMoodle
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
10
0 Courses
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
11
JavaMOOC
Introduction to Programming with Java –Part 1: Starting to Code with Java
Over 250.000 learners from 208 countries in 3 editions
uc3mx.es
12
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
Active Research Projects on LA SHEILA: European Commission,
2016-2018
MOOC-Maker: European Commission, 2016-2019
eMadrid: Regional Government of Madrid, 2014-2018
Smartick: Project with company. 2015-2016
Aplicaciones de analítica y sistemas de recomendación: Project with company, 2016-2017
Simlap: Spanish Ministry of Economy, 2014-2016
mapaTIC: Spanish Ministry of Education. 2015-2016
RESET: Spanish Ministry of Economy. 2015-2017
SNOLA (Spanish Network of Learning Analytics):Spanish Ministry of Economy
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
13
Research lines at UC3M1) Collection of events and interoperability2) Inference of intelligent information
3) Visualization systems in e-learning platforms
4) Evaluation of learning experiences5) Adaptive learning. Personalized learning6) Prediction and recommendation systems
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
14
1) Collection of events and interoperability
PJ Muñoz-Merino, M Wolpers, K Niemann, M Friedrich,A Pardo, C Delgado Kloos, M Muñoz-Organero:“CAM in the Semantic Web world,”6th Internat. Conf. on Semantic Systems, 2010 I-SEMANTICS ’10
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
15
2) Inference of intelligent information
Image taken from http://www.datadial.net/blog/index.php/2011/08/24/why-your-website-isnt-as-fast-as-it-should-be/ Learning
profiles
Behaviours
Meta-cognitive
skills
Emotions
Efectiveness Efficiency Interest
Gamification interest
Machine learningPedagogy Expert
Knowled. Semantics
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
16
2) Example: Skill ModellingKnow if a student has
mastered certain skills• Application of
probabilistic models such asItem Response Theory (IRT), Bayesian Networks (BN),or Knowledge Spaces (KS) and proposal of new techniques
Master thesis:Ruth González Novillo. Supervisors: PJ Muñoz-Merino, C Delgado Kloos
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
17
2) Example: Effectiveness
PJ Muñoz-Merino, JA Ruipérez-Valiente, C Alario-Hoyos,M Pérez-Sanagustín, C Delgado Kloos:"Precise effectiveness strategy for analyzing the effectiveness of students with educational resources and activities in MOOCs", Computers in Human Behavior, vol. 47, pp. 108–118 (2015)
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
18
2) Example: Emotions
D Leony, PJ Muñoz-Merino, A Pardo, C Delgado Kloos:“Provision of awareness of learners’ emotions through visualizations in a computer interaction-based environment”, Expert Systems With Applications, vol. 40, no. 3 (2013), pp. 5093-5100
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
19
2) Example: GamificationUser
Is it a thematic badge?
Do nothing
No
For each badge earned
Yes
Does the exercise belong to the badge
requisities?
Do nothing
No
Yes
Sum 1 to concentration counter
for that badge
Retrieve all the attempted exercises between the last
thematic badge acquired and the current badge
For each exercise
attempted
Sum 1 to thematic
badge counter
1𝑁 𝐶𝑜𝑛𝑐𝑒𝑛𝑡𝑟𝑎𝑡𝑖𝑜𝑛 𝐶𝑜𝑢𝑛𝑡𝑒𝑟𝑖𝐵𝑎𝑑𝑔𝑒 𝐶𝑜𝑢𝑛𝑡𝑒𝑟𝑖𝑁
𝑖=1
D Leony, PJ Muñoz-Merino, A Pardo, C Delgado Kloos:“Provision of awareness of learners’ emotions through visualizations in a computer interaction-based environment”, Expert Systems with Applications, 40:3 (2013), 5093-5100
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
20
3) Visualization Systems:ALAS-KA
JA Ruipérez-Valiente, PJ Muñoz-Merino, D Leony, C Delgado Kloos:“ALAS-KA: A learning analytics extension for better understanding the learning process in the Khan Academy platform”,Computers in Human Behavior, 47 (2015), 139-148
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
21
3) Visualization Systems: ANALYSE
Main people involved:Héctor Pijeira Díaz, Javier Santofimia, Jaime Alzola, Javier Orcoyen, José A. Gascón Pinedo, José A. Ruipérez Valiente, Pedro J. Muñoz-Merino, Carlos Delgado Kloos
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
22
3) Visualization Systems: Google Course Builder
M Marciel, F Michelinakis, R Fanou, PJ Muñoz-Merino:“Enhancements to Google Course Builder: Assessments Visualisation, YouTube Events Collector and Dummy Data Generator”, SINTICE conference (2013)
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
23
4) Evaluation ofLearning Experiences
Examples: universities,high schools, companies
For the evaluation, we use: system indicators, tests, surveys, interviews, etc.
Evaluated: students, tools, the learning process, …
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
24
5) Adaptive learning. Personalized learning
PJ Muñoz-Merino, C Delgado Kloos, M Muñoz-Organero, A Pardo:"A Software Engineering Model for the Development of Adaptation Rules and its Application in a Hinting Adaptive E-learning System", Computer Science and Information Systems, 12:1, 203-231(2015)C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
25
5) Adaptive learning. Personalized learning
PJ Muñoz-Merino, M Fernández Molina, M Muñoz-Organero,C Delgado Kloos: “An Adaptive and Innovative Question-driven Competition-based Intelligent Tutoring System for Learning”, Expert Systems with Applications, 39:8 (2012), 6932-6948
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
26
6) Prediction and Recommendation Systems
• Prediction about• Learning gains• Certificate earners• Social activity• Cheating• System behaviours
• Recommenders about
• Resources• Users
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
27
Design and implementation of telematic applications
• E-learning applications• Processing efficiency• Technologies
• Web: J2EE, PHP, Django, …• Data bases: mysql, MongoDB, Oracle, …• Client: HTML, JavaScript, CSS, …
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
28
ConclusionAdvancing in new territoriesInvolvement of stakeholders from many fields
Law and policiesTeaching methodologiesEducational researchPractice
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
29
K K’
K’>K?
C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21
30