Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

36
June 2013 Learning Engineer/Project Manager Open Learning Initiative Kim Larson

description

 

Transcript of Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

Page 1: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

June 2013

Learning Engineer/Project Manager

Open Learning Initiative

Kim Larson

Page 2: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

What is the Open Learning Initiative?

Scientifically-based open online learning environments based on the integration of technology and the science of learning with teaching. OLI is designed to simultaneously improve learning and facilitate learning research.

Page 3: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Page 4: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Page 5: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Page 6: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Page 7: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Page 8: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Page 9: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Page 10: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

What is a Cognitive Tutor?

A computerized learning environment whose design is based on cognitive principles and whose interaction with students is based on that of a (human) tutor—i.e., making comments when the student errs, answering questions about what to do next, and maintaining a low profile when the student is performing well.

Page 11: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Meta-cognitive skill development

Page 12: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Practice Synthesizing and Applying Skills & Knowledge

Page 13: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Page 14: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Page 15: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

What Are the Affordances of the Technology?

Page 16: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Data Collection & Feedback Loops for Continuous Improvement

Page 17: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Page 18: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Page 19: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Page 20: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Page 21: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Single Student View

Page 22: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Data Collection & Feedback Loops for Continuous Improvement

Page 23: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Community-based Research

Page 24: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Iterative improvement

Page 25: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Iterative improvement

Page 26: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Data Collection & Feedback Loops for Continuous Improvement

Page 27: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

LearnLab:Transforming Education Research

NSF Science of Learning Center•10 years, ~$50 million•Tech enhanced courses, assessment, & research•School cooperation for data collection

Ed tech + wide use = “Basic research at scale”

Page 28: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Learning Curve Analysis

DataShop: Pittsburgh Science of Learning Center

Page 29: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

OLI Review:

• Apply learning science research and scientific method to course development, implementation and evaluation.

• Develop interactive learning environments collaboratively (teams of content experts and novices, learning scientists, HCI, software engineers).

• Feedback loops for continuous improvement.

• Communities of use, evaluation and improvement.

What Difference Does it Make?

Page 30: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Proven Results

This study, conducted at Carnegie Mellon University, shows that students using the OLI statistics course at Carnegie Mellon achieved the same or better learning outcomes as students in the traditional course in half the time.

Lovett, M., Meyer, O., & Thille, C. (2008). The Open Learning Initiative: Measuring the effectiveness of the OLI statistics course in accelerating student learning. Journal of Interactive Media in Education.

Page 31: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Accelerated Learning Results

•OLI students completed course in half the time with half the number of in-person course meetings

•OLI students showed significantly greater learning gains (on the national standard “CAOS” test for statistics knowledge) and similar exam scores

•No significant difference between OLI and traditional students in the amount of time spent studying statistics outside of class

•No significant difference between OLI and traditional students in follow-up measures given 1+ semesters later

M. Lovett, O. Meyer, & C. Thille, C., “The Open Learning Initiative: Measuring the effectiveness of the OLI statistics course in accelerating student learning,” Journal of Interactive Media in Education (2008).

Page 32: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Proven Results

“The results of this study are remarkable; they show comparable learning outcomes for this basic course, with a promise of cost savings and productivity gains over time.”

Deanna MarcumManaging Director, Thaka S+R

Bowen, W.G., Chingos, M.M., Lack, K.L., & Nygren, T.I. (2012). Interactive Learning Online at Public Universities: Evidence from Randomized Trials. ITHAKA.

Page 33: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

Strategy for Educational Improvement

Data

TheoryEdTech

Page 34: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

OLI Funders

LearnLab is funded by The National Science Foundation award number SBE-0836012.

Page 35: Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI

oli.cmu.edu

 “Improvement in Post Secondary Education will require converting teaching from a ‘solo sport’ to a community based research activity.”

—Herbert Simon