Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in...

46
Fostering Higher-Order Learning in STEM Education: A Role for Science of Learning Victor Benassi Faculty Director, Center for Excellence and Innovation in Teaching and Learning Professor of Psychology University of New Hampshire Fostering Academic Success in STEM Conference April 27, 2018

Transcript of Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in...

Page 1: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Fostering Higher-Order Learning in STEM Education: A Role for Science of Learning

Victor Benassi Faculty Director, Center for Excellence and Innovation in Teaching and Learning

Professor of PsychologyUniversity of New Hampshire

Fostering Academic Success in STEM ConferenceApril 27, 2018

Page 2: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Acknowledgments

• This work is made possible by a grant from the Davis Educational Foundation. The Foundation was established by Stanton and Elisabeth Davis after Mr. Davis's retirement as chairman of Shaw’s Supermarkets, Inc.

• Thanks also to the New Hampshire (UNH) Office of the Provost and Vice President for Academic Affairs and to the Instructional Design and Development office.

• Special thanks to Catherine Overson, Lauren Kordonowy, Elizabeth Tappin, Roy Richardson, Danney Rasco, and Michael Melville.

Page 3: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Linking Kind of Knowledge, Learning

Processes, and Instructional Method

Kind of Knowledge

Learning Processes

Instructional method

Based on Koedinger, et al. (2012). The Knowledge-Learning-Instruction (KLI) framework: Bridging the science-practice chasm to enhance robust student learning. Cognitive Science, 36, 757-798.

Page 4: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Pulling it Together

Page 5: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Learning, Instruction, & Activity

LearningObjective

Instructional Principle

Learning Activity

Facts Spacing and Retrieval

Activities that promote retrieval (e.g, quizzing)

DiscriminationCategorization

Classification

Interleaving of practice

Examples

Content review

Pairing concepts with examples

PrinciplesMental modelProblem-solving

Self-ExplanationTransfer-appropriateprocessing

Self-explanation prompts for each section in a reading assignmentGuiding questions

Page 6: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Learning, Instruction, & Activity

LearningObjective

Instructional Principle

Learning Activity

Facts Spacing and Retrieval

Activities that promote retrieval (e.g., quizzing)

Page 7: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Numerous Studies on Fact Learning• Carpenter, S. K. (2014). Spacing and interleaving of study and

practice. In V. A. Benassi, C. E. Overson, & C. M. Hakala(Eds.), Applying the science of learning in education: Infusing psychological science into the curriculum. Retrieved from the Society for the Teaching of Psychology web site: http://teachpsych.org/ebooks/asle2014/index.php

• Pyc, M. A., Agarwal, P. K., & Roediger, H. L. (2014). Test-enhanced learning. In V. A. Benassi, C. E. Overson, & C. M. Hakala (Eds.), Applying the science of learning in education: Infusing psychological science into the curriculum. Retrieved from the Society for the Teaching of Psychology web site: http://teachpsych.org/ebooks/asle2014/index.php

Page 8: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

LearningObjective

Instructional Principle

Learning Activity

Facts Spacing and Retrieval

Activities that promote retrieval (e.g., quizzing)

DiscriminationCategorization

Classification

Interleaving of practice

Examples

Content review

Pairing concepts with examples

Learning, Instruction, & Activity

Page 9: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Interleaving:Revisiting the Past

Course: Statistical Reasoning

Overson, Stiegler-Balfour, Tappin, Melville, Rasco, & Benassi, 2016

Page 10: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

WHAT WE DID

Page 11: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Study Background:Sequence of Instruction and Quizzing

• Reading and instruction by teacher

Statistical test is covered

Review of Material on statistical test, including conditions to be met to use the test

Completion of online module on the statistical test

• Non-Interleaving: Quiz on the current statistical test only• Interleaving: Quiz on both the current statistical test and on

previous tests

Quiz

Repeat until all statistical tests addressed

Page 12: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

z testSingle sample tCorrelated-groups tBetween-groups tANOVAChi SquareCorrelationRegression

Eight Statistical Tests

Page 13: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Experimental Manipulation Within Course

Statistical Reasoning (Rasco)N = 38

Page 14: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

RESULTSComparing Question Conditions

Page 15: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Mean Proportion Correct on Final Exam on Choosing the Appropriate Statistical Test

one sided p < .03

Error Bars: 95% CI

Page 16: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

How might you incorporate this principle into your courses?

Page 17: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

The Power of Examples in Improving Classification of

Concepts

Rawson, K. A., Thomas, R. C., & Jacoby, L. L. (2015). The power of examples: Illustrative examples enhance conceptual learning of declarative concepts. Educational Psychology Review, 27, 483-504.

Page 18: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Study Design

In three lab experiments, under a variety of conditions,• College students studied declarative concepts,

followed by either examples of the concepts or by additional study of the concepts.

• On a later classification task, students were shown examples and were asked to identify which concept the example represented.

Page 19: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Study Design

• In three lab experiments, under a variety of conditions,1. Definition only2. Definition then Example3. Example then Definition

• On a later classification task, students were shown examples and were asked to identify which concept the example represented.

Page 20: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Refer to Rawson, et al., 2015, Figures 1A and 1B

Page 21: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

How might you incorporate this principle into your courses?

Page 22: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Learning, Instruction, & Activity

LearningObjective

Instructional Principle

Learning Activity

Facts Spacing and Retrieval

Activities that promote retrieval (e.g, quizzing)

DiscriminationCategorization

Classification

Interleaving of practice

Examples

Content review

Pairing concepts with examples

PrinciplesMental modelProblem-solving

Self-ExplanationTransfer-Appropriate Processing

Self-explanation prompts for each section in a reading assignmentGuiding Questions

Page 23: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Self-Explanation:Making sense and meaning of new

informationCourse: Biological Science

N = 148

Overson, Kordonowy, Benassi, Richardson, 2017

Page 24: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Self-explanation

• Self-monitoring of evolving understanding– Review new material– Relate information to prior knowledge– Generate questions based on new understanding

• Mechanism– Identification of gaps in learning– Helps modify flawed, existing mental models

Page 25: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

WHAT WE DID

Page 26: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Student Learning Activity• Read assigned material• Responded to prompts after each reading

section1. What information is new?2. How do the new ideas work with what you

already know?3. List two “I wonder (if, whether, why, how, which,

where, who, etc.) . . .” questions that you have as a result of reading this section

Page 27: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Research Design

• Random assignment to one of two groups– Self-explanation group– Summary group

Page 28: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

RESULTSComparing Question Conditions

Page 29: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

-20

-15

-10

-5

0

5

10

15

20

30

40

50

60

70

80

90

Summarize Self-Explain Diff

Mea

n Di

ffere

nce

Mea

n Pe

rcen

t Cor

rect

Summarize versus Self-explain Reading Activities

Error Bars: 95% CI

Page 30: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

-20

-15

-10

-5

0

5

10

15

20

30

40

50

60

70

80

90

Summarize Self-Explain Diff

Mea

n Di

ffere

nce

Mea

n Pe

rcen

t Cor

rect

Summarize versus Self-explain Reading Activities

Error Bars: 95% CI

Page 31: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Does background ability matter?

Page 32: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Mea

n Pe

rfor

man

ce

Page 33: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

How might you incorporate this principle into your courses?

Page 34: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Guiding Questions

Attending to relevant, related information

Stiegler-Balfour, J. J., & Benassi, V .A. (2015). Guiding questions promote learning of expository text for less-skilled readers. Scholarship of Teaching and Learning in Psychology, 14, 312-325.

Page 35: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Guiding Questions• Transfer-Appropriate Processing in a Psychology of

Consciousness Course• N = 39• Completed Gates McGinity Reading Test• Completed reading assignments• Guiding questions for some assignments, not for

others.• Essay exam on all material. Focused on integration

of concepts from readings.

Page 36: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Guiding Questions ExamplesEncouraged students to think about relationships

among concepts from the readings:

“What potential problems are there with the idea that consciousness causes our actions?”

“What kinds of evidence suggest a dissociation between vasomotor control and visual perception?”

Page 37: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Learning Outcomes

Page 38: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks
Page 39: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

How might you incorporate this principle into your courses?

Page 40: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Conclusions and Recommendations

• Do your courses already incorporate the kinds of principles I have discussed today?

• You can incorporate evidence-based principles, informed by science of learning, into your courses.

• You can expect to observe strong learning outcomes among your students.

Page 41: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Conclusions and Recommendations

• We have just scratched the service.

• Here are some sources:

Page 42: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

ResourceBenassi, V. A., Overson, C. E., & Hakala, C. M. (2014). Applying science of learning in education: Infusing psychological science into the curriculum. Retrieved from the Society for the Teaching of Psychology web site: http://teachpsych.org/ebooks/asle2014/index.php

Page 43: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks
Page 44: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Some User-Friendly websites• Retrieval Practice

http://www.retrievalpractice.orgPooja Argarwal

• The Learning Scientists

http://www.learningscientists.orgMegan Smith and Yana Weinstein

Page 45: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Some Accessible Videos• Deep Learning (M. Chi)https://www.youtube.com/watch?v=uC-9lViDGL0

• How People Learn (H. Roedinger)https://www.youtube.com/watch?v=4tz8gVPHhFE

• Teaching, Learning, and Technology: A Role for Science of Learning (V. Benassi)

https://www.youtube.com/watch?v=NG439BzFh7I

Page 46: Fostering Higher-Order Learning in STEM Education:A Role ... · Fostering Higher-Order Learning in STEM Education:A Role for Science of Learning Victor Benassi ... Inc. •Thanks

Thank you