Ad A Miracle Occurs Die Final Presentation

22
Performance by Design A*D[a miracle occurs]*D*I*E Presented at: 2009 US Coast Guard Human Performance Technology Conference September 2009 Susan Coleman, PhD, CPT J. Kelly Cross Intelligent Decision Systems, Inc

description

A*D [a miracle occurs]*I*E presented at the 2009 Coast Guard HPT Conference

Transcript of Ad A Miracle Occurs Die Final Presentation

Page 1: Ad A Miracle Occurs Die Final Presentation

Perf

orm

ance

by

Des

ign

A*D[a miracle occurs]*D*I*E

Presented at:2009 US Coast Guard

Human Performance Technology ConferenceSeptember 2009

Susan Coleman, PhD, CPTJ. Kelly Cross

Intelligent Decision Systems, Inc

Page 2: Ad A Miracle Occurs Die Final Presentation

September 2009 9th Annual USCG HPT Workshop

2

Perf

orm

ance

by

Des

ign

Design Miracle

Page 3: Ad A Miracle Occurs Die Final Presentation

September 2009 9th Annual USCG HPT Workshop

3

Perf

orm

ance

by

Des

ign

Critical Thinking Skills

• “Active, persistent, and careful consideration of a belief or supposed form of knowledge in light of the grounds which support it and further conclusions to which it tends.” (Dewey, 1909 as cited in Fisher, 2001)

• “…to consider in a thoughtful way the problems and subjects that come within the range of one’s experience; knowledge of the methods of logical inquiry and reasoning; and some skill in applying those methods.” (Glaser, 1941 as cited in Fisher, 2001).

• “…reasonable, reflective thinking that is focused on deciding what to believe or do.” (Noris and Ennis,1989 as cited in Fisher, 2001).

• Several sub skills– Problem solving– Decision making– Situational awareness– Cognitive agility

Page 4: Ad A Miracle Occurs Die Final Presentation

September 2009 9th Annual USCG HPT Workshop

4

Perf

orm

ance

by

Des

ign

Critical Thinking Skills

Implications• Critical thinking skills can (and should) be

developed within context (Clark, 2008)

– Red Flag Scenario

Page 5: Ad A Miracle Occurs Die Final Presentation

September 2009 9th Annual USCG HPT Workshop

5

Perf

orm

ance

by

Des

ign

Red Flag Scenario

Page 6: Ad A Miracle Occurs Die Final Presentation

September 2009 9th Annual USCG HPT Workshop

6

Perf

orm

ance

by

Des

ign

Red Flag Scenario

Page 7: Ad A Miracle Occurs Die Final Presentation

September 2009 9th Annual USCG HPT Workshop

7

Perf

orm

ance

by

Des

ign

Red Flag Scenario

Page 8: Ad A Miracle Occurs Die Final Presentation

September 2009 9th Annual USCG HPT Workshop

8

Perf

orm

ance

by

Des

ign

Cognitive Load

• How much information we can take in at a given time and make sense of it. (Sweller, 1988)

– Intrinsic– Germane– Extrinsic

• Easy to overwhelm the learner. (Sweller, 2988; Clark, 2008)

Page 9: Ad A Miracle Occurs Die Final Presentation

September 2009 9th Annual USCG HPT Workshop

9

Perf

orm

ance

by

Des

ign

Cognitive Load

Implications

• Use external memory aids.• Chunk content.• Assess performance/provide feedback. • Provide demonstrations/worked examples.• Practice to automate some skills.• Provide an intuitive screen design/easy to

use interface.

Page 10: Ad A Miracle Occurs Die Final Presentation

September 2009 9th Annual USCG HPT Workshop

10

Perf

orm

ance

by

Des

ign

Learning Styles• No single theory unites the literature on learning styles.

(Coffield et al., 2004; Menaker & Coleman, 2007)

• No data that shows learning styles are related to any learning outcomes. (Coffield et al., 2004; Hayes 2006)

• There is a lack of research demonstrating the relationship between a learning style and a particular instructional strategy in terms of learning outcomes. (Coffield et al., 2004; Menaker & Coleman, 2007)

• Issues have been clouded by commercialization efforts. (Coffield et al., 2004)

• When the goals of instruction are consistent with strategies to teach that goal, learning is optimal. (Merrill, 2002)

Page 11: Ad A Miracle Occurs Die Final Presentation

September 2009 9th Annual USCG HPT Workshop

11

Perf

orm

ance

by

Des

ign

Learning Styles

Implications• Nature of the task, learners’ prior experience,

and understanding of how content will be used are keys to good design.

• Develop learners’ metacognitive knowledge:– Strategies– Conditions under which strategies are most effective– One’s own strengths and weaknesses – Self-regulation

• Design to manage cognitive load– Provide scaffolding

Page 12: Ad A Miracle Occurs Die Final Presentation

September 2009 9th Annual USCG HPT Workshop

12

Perf

orm

ance

by

Des

ign

Experiential Learning

• Learners interact with their environment to construct their own knowledge.

• The design of the experience greatly impacts what is learned.

• Experiences that work well for novices are not necessarily beneficial for experts.

• Cognitive, physical, and affective fidelity must be balanced

(Kolb,1984; Bruner, 1961; Kalyuga, Chandler & Sweller, 2001; Kirschner et al.,2006)

Page 13: Ad A Miracle Occurs Die Final Presentation

September 2009 9th Annual USCG HPT Workshop

13

Perf

orm

ance

by

Des

ign

Experiential Learning

• Engage the learner mentally– Balance cognitive and physical fidelity

• Purposefully sequence experiential events– Deliberately increase tempo and complexity

of experiential environments and tasks.• Use a purposeful feedback strategy• Provide deliberate opportunities to

promote reflection.

Implications

Page 14: Ad A Miracle Occurs Die Final Presentation

September 2009 9th Annual USCG HPT Workshop

14

Perf

orm

ance

by

Des

ign

Interactivity

• 3 types of interaction: – Learner-content– Learner-teacher – Learner-learner (Moore, 1989).

• Interactivity is dependent on how the instruction is designed (Sims, 2003).

• Interactivity should not only be measured by the frequency of interactions but by the quality of thinking it demands from the learner (Reushle et al., 1992).

• There is evidence that learning is directly related to the level of mental effort put forth by the student. This mental effort must bear a direct relationship to the concepts and principles being taught (Merrill et al. ,1991).

Page 15: Ad A Miracle Occurs Die Final Presentation

September 2009 9th Annual USCG HPT Workshop

15

Perf

orm

ance

by

Des

ign

Interactivity

• When the instruction is passive—– Learners are not forced to examine their

cognitive structure– The resulting learning is poorly retained – The content does not relate well to previously

learned materials– The resulting learning is not easily transferred

to new situations (Merrill et al.,1991)

Page 16: Ad A Miracle Occurs Die Final Presentation

September 2009 9th Annual USCG HPT Workshop

16

Perf

orm

ance

by

Des

ign

Interactivity

• Problem-centered instruction provides visuals that illustrate a job setting in which the learner gets a virtual task assignment and learns new skills while working the assignment. (Clark & Mayer, 2003)

Item 1-11 - Inspect the Power Entry Panel (PEP).

Implications

Page 17: Ad A Miracle Occurs Die Final Presentation

September 2009 9th Annual USCG HPT Workshop

17

Perf

orm

ance

by

Des

ign

Motivation

• Motivation is the energy that accelerates behavior (Richter).

• Motivation is the combination of a person's desire and energy directed at achieving a goal. It is the cause of action. Influencing people's motivation means getting them to want to do what you know must be done (Military Leadership, 1993).

Page 18: Ad A Miracle Occurs Die Final Presentation

September 2009 9th Annual USCG HPT Workshop

18

Perf

orm

ance

by

Des

ign

Motivation

• To be effective, motivational tactics have to support instructional goals. Sometimes the motivational features can be fun or even entertaining, but unless they engage the learner in the instructional purpose and content, they will not promote learning (Keller, 2006).

• The learning task needs to be presented in a way that is engaging and meaningful to the student, and in a way that promotes positive expectations for the successful achievement of learning objectives (Small, 1997).

Page 19: Ad A Miracle Occurs Die Final Presentation

September 2009 9th Annual USCG HPT Workshop

19

Perf

orm

ance

by

Des

ign Strategy and Design:

“Consider This” Scenario used to:• Introduce the lesson and establish relevance• Encourage appropriate attitude and motivate• Provide context about why lesson/objective is important to job task(s)• Focus the student and call forth prior knowledge

MotivationSelf-Aid and Buddy Care (SABC)developed for the US Air Force Expeditionary Medical Skills Division

“Consider This”Example

Page 20: Ad A Miracle Occurs Die Final Presentation

September 2009 9th Annual USCG HPT Workshop

20

Perf

orm

ance

by

Des

ign

Conclusion

• ADDIE tells us when to do Design, but we need the science of learning to know how to do it.

• With the emerging technologies, the need for exceptionally qualified designers is increasingly important.

• We need to demand that designers understand the science of learning and have experience applying it.

• The science of learning can make learning more effective AND efficient.

Page 21: Ad A Miracle Occurs Die Final Presentation

September 2009 9th Annual USCG HPT Workshop

21

Perf

orm

ance

by

Des

ign

SourcesBruner, J.S. (1961). The act of discovery. Harvard Education Review, 31, 21-32.Clark, R. C. (2002). Applying cognitive strategies to instructional design. Performance Improvement,

41, 9. Clark, R. C. (2008). Building expertise: Cognitive methods for training. Pfeiffer: San Francisco.Clark, R. C. and Mayer, R. E. (2003). E-Learning and the Science of Instruction. San Francisco:

Jossey Bass Pfeiffer.Clark, R. E. (2004). What works in distance learning: Motivation strategies. In H. O’Neil (Ed.), What

works in distance learning: Guidelines (pp. 89-110). Greenwich, CT: Information Age Publishers. Coffield, F., Moseley, D., Hall, E., & Ecclestone, K. (2004). Learning styles and pedagogy in post-16

learning; A systematic and critical review. London: Learning and Skills Research Centre.Fisher, A. (2001). Critical thinking: An introduction. Cambridge: Cambridge University Press.Glaser, E. M. (1941). An experiment in the development of critical thinking, Teacher’s College:

Columbia University.Hayes, R. T. (2006). The science of learning: A systems theory approach. Boca Raton, FL: Brown

Walker PressKeller, J.M. Motivational design of instruction. (1983) In C.M. Reigeluth (Ed.), Instructional design

theories and models (pp. 383-433). New York: Lawrence Erlbaum Associates.Keller, J.. M. (2006). What is motivational design? Florida State University. Kirschner, P. A., Sweller, J., and Clark, R. E. (2006). Why minimal guidance during instruction does

not work: An Analysis of the failure of constructivist, discovery, problem-based, experiential and inquiry based teaching. Educational Psychologist, 41(2), 75-86.

Kolb, D. A. (1984). Experiential learning: Experience as the source of learning and development. Englewood Cliffs, NJ: Prentice-Hall.

Page 22: Ad A Miracle Occurs Die Final Presentation

September 2009 9th Annual USCG HPT Workshop

22

Perf

orm

ance

by

Des

ign

SourcesKalyuga, S., Chandler, P, & Sweller, J. (2001). Learner experience and efficiency of instructional

guidance. Educational Psychologist, 21, 5-13.Menaker, E., Coleman, S. (2007). Learning styles again: Where is the empirical evidence? In

Proceedings of the Interservice/Industry Training, Simulation and Education Conference. Orlando, FL Interservice/Industry Training, Simulation, and Education Conference.

Merrill, M. D. & Li, Z., Jones, M.K. (1991). Second generation instructional design (ID2). Educational Technology.

Merrill, M. D. (2002). Instructional strategies and learning styles: Which takes precedence: In R. A. Reiser & J. V. Dempsey (Eds.), Trends and issues in instructional technology (pp. 99-106).

Military Leadership (1993). Retreived 09/14/09 from http://www.nwlink.com/~Donclark/performance/motivation.html.

Moore, M. G. (1989). Three modes of interaction. The American Journal of Distance Education, 3(2), 1-6

Reushle, S., Dorman, M., Evans, P., Kirkwood, J., McDonald, J., and Worden, J. Critical Elements: Designing for Online Teaching. Distance Education Centre, The University of Southern Queensland.

Richter, M. S. (unknown). How learners are motivated. Retrieved from http://www.thiagi.com/motivation.pdf on 09/14/09.

Sims, R. (2003). Promises of interactivity: Aligning learner perceptions and expectations with strategies for flexible and online learning. Distance Education, 24(1), pp. 87-103.

Small, R. V. (1997). Motivation in instructional design. ERIC Digest.Sweller, P. (1988). Effects of cognitive load during problem solving: Effects on learning. Cognitive

Science, 12, 257-285