Connecting Pedagogical Intent with Analytics in a Flipped Classroom

68
Karl-Ludwig Poggemann Flickr Connecting Pedagogical Intent with Analytics in a Flipped Classroom The University of Texas at Arlington September 2014 Dr Abelardo Pardo (@abelardopardo ) The University of Sydney slideshare.net/abelardo_pardo

description

Description of how to use learning analytics techniques to collect evidence about student engagement while preparing a flipped classroom. A case study is presented in which students interact with various electronic resources and a measure of such engagement is produced and returned to them.

Transcript of Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Page 1: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Karl-Ludw

igPoggem

annFlickr

Connecting Pedagogical Intent withAnalytics in a Flipped Classroom

The University of Texas at ArlingtonSeptember 2014

Dr Abelardo Pardo (@abelardopardo)The University of Sydney

slideshare.net/abelardo_pardo

Page 2: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 2

Martin

Fischflickr.comContext

FlippedClassroom

LearningAnalytics

CaseStudy

Design

Page 3: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 3

Martin

Fischflickr.comContext

Page 4: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 4

FlaM

FlickrLecturer at School ofElectrical and InformationEngineering

Student atthe center

Instructionas facilitator

Technologyto improveexperience

Page 5: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 5

Quinn

Anya

flickr.com

Technology works: tangible improvement, transparent

Page 6: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 6

Wrote

flickr.com

Technology fails: hinders, prevents, complicates ...

Page 7: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Technology Fails

Negligible Cost of Failure

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 7

Page 8: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 8

Mary

Witzig

flickr.com

Personalized Learning in a Digital Environment

Page 9: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 9

Hiking

Artist

Learning Technology fails:hinders, prevents, complicates ...

Page 10: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 10

Anthony

flickr.com

Tech affordancesmust have strong,realisticpedagogicalfoundations

Page 11: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 11

Martin

Fischflickr.comContext

FlippedClassroom

Page 12: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 12

KreativeK

ewlflickr.com

Flipped Classroomdoes not exist!

(Bergmann & Sams, 2012)

Page 13: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 13

(Mazur, 2009)

Simple transfer of information does not work

Page 14: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 14

Juantan

Kw

onflickr.com

Resourceseverywhere!

Page 15: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 15

Fellmannia

flickr.com

Face-to-face timeis very valuable!

Page 16: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 16

-NA

CH

-flickr.com

Remember

Understand

Apply

Analyze

Evaluate

Create

Incl

ass

Ass

ignm

ents

Can we do better?

Page 17: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 17

-NA

CH

-flickr.com

Remember

Understand

Apply

Analyze

Evaluate

Create

Pre

-ass

ignm

ents

Incl

ass

Page 18: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 18

Chandra

Marsono

flickr.com

Does it work?

Sometimes

Page 19: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 19

SepehrE

hsaniflickr.comNot as expected Yes!

(Strayer, 2012) (Ruddick, 2012)(Bishop, 2013)

(Zappe et al., 2009)

Page 20: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

How to Design Flipped Learningabelardopardo.blogspot.com

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 20

Page 21: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 21

srharrisflickr.com

1) Pick an objective, concept, topic

Page 22: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 22

p_a_hflickr.com

2) Previous activities (Be prepared!)

Page 23: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 23

Hijukalflickr.com

3) Activities face-to-face

Page 24: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 24

blog.peerinstruction.net/2012/04/06/can-you-flip-large-classes/

Be creative!

Page 25: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 25

KrugazorInstead...

Page 26: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 26

Martin

Fischflickr.comContext

FlippedClassroom

LearningAnalytics

Page 27: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Humans are Subjective

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 27

Mind Sights: Original Visual Illusions, Ambiguities, and Other Anomalies, With a Commentary on the Play of Mind in Perception and Art, Roger N. Shepard, 1990

Page 28: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 28

VanessaOflickr.com

“Historically, humanity has made sense of the worldthrough discourse, dialogue, artifacts, myth, story,and metaphor. While those sensemaking approacheswon’t disappear, they will be augmented by data andanalytics.”

(Siemens, 2014 www.elearnspace.org/blog)

Page 29: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Learning Analytics

Measurement, collection, analysisand reporting of data about learnersand their contexts, for purposes ofunderstanding and optimizinglearning and the environments in whichit occurs.

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 29

(SoLAR, Society for LearningAnalytics Research)

Page 30: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 30

WernerK

unzFlickr.com

(Campbell, De Blois, Oblinger 2007, Academic Analytics, EDUCAUSE)

Collect

Report

Predict

Act

Refine

The fivesteps ofanalytics

Page 31: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 31

ChefC

ookeFlickr.comObserve while

working oncourse

activities

Page 32: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

A clearly identifiedenvironment within

your computer

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 32

Kevin

Davies

flickr.com

(Pardo & Delgado Kloos, 2011)

Page 33: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

InstrumentationPersonal Computer

ComputerTool 1

ComputerTool 2

ComputerTool 3

ComputerTool 4

Authenticated

Virtual Computer

ComputerTool

ComputerTool

ComputerTool

ComputerTool

ComputerTool

EventDataset

PersonalData

Encoding

Report

Infer

Act

InstructorStudent

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 33

Page 34: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 34

Horia

Varlanflickr.com

Tool usage vs academic performance

(Romero-Zaldívar et al., 2012)

Page 35: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 35

Chiot’s

Run

Flickr.com

Collect URLs Compare withcourse notes

Detect newresources

(Romero-Zaldívar et al., 2011)

Page 36: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 36

Adventures

inLibrarianship

flickr.com

Detect engagementwhile writing

(Calvo et al., 2011, Liu et al., 2013)

Page 37: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 37

Secretlondon123

flickr.com

1 Context2 Questions3 Data + algorithms4 Prediction/Intervention

Page 38: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 38

Shaylorflickr.com

1 Context: Flipped Classroom2 Questions: Are they engaged

during preparation?3 Data + algorithms: ?4 Intervention: ?

Page 39: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 39

Martin

Fischflickr.comContext

FlippedClassroom

LearningAnalytics

CaseStudy

Page 40: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 40

Benjam

inE

shamflickr.com

First YearEngineering Course

Computer Systems

Enrolment: 300students

1 Lecture (2 hours) +1 tutorial (2 hours) +1 lab (3 hours)

Flipped Lecture

Assess Participation

100% Digital Material

Midterm + Final +Project

Page 41: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 41

Page 42: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 42

Page 43: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 43

Track

Page 44: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 44

Track

Track

Page 45: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 45

Page 46: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 46

Page 47: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 47

Track

Track

Page 48: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 48

Page 49: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 49

Track

Page 50: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 50

Page 51: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 51

Track

Page 52: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 52

Page 53: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 53

Track

Page 54: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 54

Page 55: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 55

Page 56: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 56

Track

Page 57: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 57

Page 58: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 58

Page 59: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 59

Page 60: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 60

Page 61: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 61

Martin

Fischflickr.comContext

FlippedClassroom

LearningAnalytics

CaseStudy

Design

Page 62: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 62

Agile Authoring!

Page 63: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 63

Minimum markup. Sensors automatically generated.

Page 64: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 64

Solutions, tutor guide, in a single document

Page 65: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 65

billBradford

flickr.com

Plain Text Template-based design

Page 66: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

Karl-Ludw

igPoggem

annFlickr

Connecting Pedagogical Intent withAnalytics in a Flipped Classroom

The University of Texas at ArlingtonSeptember 2014

Dr Abelardo Pardo (@abelardopardo)The University of Sydney

slideshare.net/abelardo_pardo

Page 67: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

ReferencesBergmann, J., Sams, A., (2012)Flip Your Classroom: Reach Every Student in Every Class Every DayHawker Brownlow Education

Mazur, E., (2009)Farewell, Lecture?Science, 323, pp. 50-51.

Strayer, J. F. (2012).How learning in an inverted classroom influences cooperation, innovation and task orientation.Learning Environments Research, 15(2), 171–193.

Zappe, S., & Leicht, R. (2009).Flipping the classroom to explore active learning in a large undergraduate course.In Proceedings of the American Society for Engineering Education Annual Conference and Exhibition.

Bishop, J. L., and Verleger, M. A. (2013)The Flipped Classroom: A Survey of the Research.In Proceedings of the ASEE Annual Conference and Exposition (pp. 1–18).

Ruddick, K. W. (2012).Improving chemical education from high school to college using a more hands-on approach.PhD Thesis. The University of Memphis.

Campbell, J. P., DeBlois, P. B., & Oblinger, D. G. (2007).Academic Analytics.Educause Review (Vol. 42). EDUCAUSE White Paper.

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 67

Page 68: Connecting Pedagogical Intent with Analytics in a Flipped Classroom

References II

Pardo, A., Delgado Kloos, C., 2011,Stepping out of the box. Towards analytics outside the Learning Management SystemInternational Conference on Learning Analytics and Knowledge, pp, 163-167, ACM New York, USA

Romero-Zaldívar, V.A., Pardo, A., Burgos, D., Delgado Kloos, C., 2012Monitoring Student Progress Using Virtual Appliances: A Case StudyComputer & Education, 58(4):10580–1067, 2012

Romero-Zaldívar, V.A., Crespo García, R., Burgos, D., Delgado Kloos, C., Pardo, A., 2012Automatic Discovery of Complementary Learning ResourcesEuropean Conference on Technology Enhanced Learning, 2011

Calvo, R., O’Rourke, S.T., Jones, J., Yacef, K., Reimann, P., 2011Collaborative Writing Support Tools on the CloudIEEE Transactions on Learning Technologies, 4(1):88–97

Liu M., Calvo, R.; Pardo, A., 2013Visualizing the effect of actions in personal informatics systemsWorkshop on Personal Informatics, CHI’13

Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 68