Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

23
Canadian Pacic Flickr Combining Observational and Experiential Data to Inform the Redesign of Learning Activities Learning Analytics and Knowledge 2015 19 March 2015 Abelardo Pardo, Robert A. Ellis, Rafael A. Calvo

Transcript of Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Page 1: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Canadian

Pacific

Flickr

Combining Observational andExperiential Data to Inform theRedesign of Learning Activities

Learning Analytics and Knowledge 201519 March 2015

Abelardo Pardo,

Robert A. Ellis,

Rafael A. Calvo

Page 2: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Abelardo Pardo Combining Observational and Experiential Data to Inform the Redesign of Learning Activities 2

Chrls-H

avardB

ergeflickr.com

The Problem

The Scenario

Data Speaks

Students speak

Combining Observationaland Experiential

Page 3: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Abelardo Pardo Combining Observational and Experiential Data to Inform the Redesign of Learning Activities 3

Chrls-H

avardB

ergeflickr.com

The Problem

Page 4: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Abelardo Pardo Combining Observational and Experiential Data to Inform the Redesign of Learning Activities 4

Tochisflickr.com

Chomsky vs Norvig Debate

Are statistical models successfully applied to linguisticproblems?

Page 5: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Are statistical models successful in learning?

Abelardo Pardo Combining Observational and Experiential Data to Inform the Redesign of Learning Activities 5

JISC

InfoNetflickr

Page 6: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Abelardo Pardo Combining Observational and Experiential Data to Inform the Redesign of Learning Activities 6

CO

MS

ALU

DA

genciade

flickr.com

Correlation is enough to derive interventions

Page 7: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Abelardo Pardo Combining Observational and Experiential Data to Inform the Redesign of Learning Activities 7

Krugazorflickr.comHow to understand your approach to learning?

Fragmented or Cohesive? Deep or Surface?

Page 8: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Abelardo Pardo Combining Observational and Experiential Data to Inform the Redesign of Learning Activities 8

Jean-Etienne

Minh-D

uyPoirrierflickr.com

See both approaches in a concrete scenario

Page 9: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Abelardo Pardo Combining Observational and Experiential Data to Inform the Redesign of Learning Activities 9

Chrls-H

avardB

ergeflickr.com

The Problem

The Scenario

Page 10: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Abelardo Pardo Combining Observational and Experiential Data to Inform the Redesign of Learning Activities 10

neteffectflickr.com

1st year Engineering Course

• 300 students• Flipped Learning.• Material 100% electronic• Videos + questions• Visualization of their own performance• Preparation Exercises 10% of final score• MCQ Midterm 20% of the final score

Page 11: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Abelardo Pardo Combining Observational and Experiential Data to Inform the Redesign of Learning Activities 11

Activitiesbefore andduringlecture

Page 12: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Abelardo Pardo Combining Observational and Experiential Data to Inform the Redesign of Learning Activities 12

Videos andMCQ(formativeassessment)

Page 13: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Abelardo Pardo Combining Observational and Experiential Data to Inform the Redesign of Learning Activities 13

Exercises (Summative Assessment)

Page 14: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Abelardo Pardo Combining Observational and Experiential Data to Inform the Redesign of Learning Activities 14

Sanadreas

flickr.com

Redesign courseto improve student achievement

Page 15: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Abelardo Pardo Combining Observational and Experiential Data to Inform the Redesign of Learning Activities 15

Chrls-H

avardB

ergeflickr.com

The Problem

The Scenario

Data Speaks

Page 16: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Abelardo Pardo Combining Observational and Experiential Data to Inform the Redesign of Learning Activities 16

Vestman

flickr.com

Detect relevant factors

Linear regression model

Midterm = 10.9 + 0.012 * EA + 0.0036 * EQC -0.039 * EQI

Increase questions in activities. Intervene when low.

Page 17: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Abelardo Pardo Combining Observational and Experiential Data to Inform the Redesign of Learning Activities 17

Chrls-H

avardB

ergeflickr.com

The Problem

The Scenario

Data Speaks

Students Speak

Page 18: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Abelardo Pardo Combining Observational and Experiential Data to Inform the Redesign of Learning Activities 18

TheB

eesflickr.com

• What was the purpose of...?• What did you do with .... and why?

Page 19: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Abelardo Pardo Combining Observational and Experiential Data to Inform the Redesign of Learning Activities 19

Promote DeepEngagement withExercise Sequences

Page 20: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Abelardo Pardo Combining Observational and Experiential Data to Inform the Redesign of Learning Activities 20

Chrls-H

avardB

ergeflickr.com

The Problem

The Scenario

Data Speaks

Students speak

Combining Observationaland Experiential

Page 21: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Abelardo Pardo Combining Observational and Experiential Data to Inform the Redesign of Learning Activities 21

Abraham

Cflickr.com

Deeperengagement

Increase numberof questions

Increase numberand justify reasonfor questions innotes

Monitor deeperengagement

Page 22: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Abelardo Pardo Combining Observational and Experiential Data to Inform the Redesign of Learning Activities 22

TriciaW

angflickr.com

Partial view. Unaware ofadditional information.Non-actionable.

Connect theory withpractice. Actionableitems. Better narrative forinterventions.

Page 23: Combining Observational and Experiential Data to Inform the Redesign of Learning Activities

Canadian

Pacific

Flickr

Combining Observational andExperiential Data to Inform theRedesign of Learning Activities

Learning Analytics and Knowledge 201519 March 2015

Abelardo Pardo,

Robert A. Ellis,

Rafael A. Calvo