DAU Curriculum Process: Implementing Bloom’s Taxonomy and

Kirkpatrick’s Levels of Evaluation

Judith Hall Bayliss, DAU

November 2, 2007

Bloom – Learning Levels

Learn. Perform. Succeed

Structures Curriculum: Indicates Performance Outcome

6 Levels Achieved by the Learner:

1. Knowledge

2. Comprehension

3. Application

4. Analysis

5. Synthesis

6. Evaluation

Synthesis/Evaluation co-equal as “pinnacle” outcomes

Bloom’s Outcomes Described

Knowledge

Learner recalls or recognizes information, ideas and principles in the appropriate form in which they were learned.

Comprehension

Learner translates, comprehends or interprets information based on prior learning.

Evaluation

Student appraises, assesses or critiques on a basis of specific standards and criteria.

Application

Learner selects, transfers and uses data and principles to complete a problem or task with a minimum of direction.

Analysis

Learner distinguishes, classifies and relates the assumptions, hypotheses, evidence or structure of a statement or question.

Synthesis

Learner organizes, integrates and combines ideas into a product, plan or proposal that is new to him or her.

Knowledge

Learner recalls or recognizes information, ideas and principles in the appropriate form in which they were learned.

Comprehension

Learner translates, comprehends or interprets information based on prior learning.

Evaluation

Student appraises, assesses or critiques on a basis of specific standards and criteria.

Application

Learner selects, transfers and uses data and principles to complete a problem or task with a minimum of direction.

Analysis

Learner distinguishes, classifies and relates the assumptions, hypotheses, evidence or structure of a statement or question.

Synthesis

Learner organizes, integrates and combines ideas into a product, plan or proposal that is new to him or her.

Bloom – Learning Levels

Learn. Perform. Succeed

DAU Curriculum: 100 Courses – Level 1/Level 2 200 Courses – Level 3/Level 4 300 Courses – Level 4 + 400 Courses – Level 5 & 6

Terminal Learning Objectives (TLOs): – Bloom’s levels equal course level

Enabling Learning Objectives (ELOs):– Bloom’s levels may equal TLO or be a level below

Assessment strategy must fulfill Bloom’s level.

Four Tiers of Evaluation:

1.Satisfaction

2.Learning

3.Transfer

4.Results

Sometimes, ROI tacked on as a 5th level or lumped with tier 4.

ROI =/= LEVEL 4 RESULTS

Kirkpatrick – Evaluation Tiers

1

2

3

4DATA VALUE

DATA VOLUM

E

Kirkpatrick – Evaluation Tiers

Learn. Perform. Succeed

• Level 1: DAU collects through the End of Course Surveys.

– Reflected in MTM reports

• Level 2: DAU assesses students.– Elearning: on-line exams– Classroom: completion of activities, cases, etc.

• Level 3 & Level 4: DAU does not formally collect.– Must be demonstrated on the job and noted by

supervisors.

Summary

Learn. Perform. Succeed

Note to self: our learning outcomes are siblings of competencies, but not same as in terms of how to do performance assessment or what is purpose.

Bring back to competency effort alignment? When learning is drawn from competency statements, it becomes a subservient activity that is parting of meeting competency. Is not a replacement for demonstration of the competency in situ.

Back up

Learn. Perform. Succeed

EVALUATION

SYNTHESIS

ANALYSIS

APPLICATION

KNOWLEDGE

Multiple Choice

True/False

Matching

Fill in Blanks

Short Answer

BLOOM’S LEVEL

Lecture

Visuals

Video

Audio

Examples

Instructions

Analogies

QuestionsDiscussionReviewTestAssessmentReportsLearnerPresentationsWriting

ExercisesPracticeDemonstrationsProjectsSketchesSimulationsRole playMicro teach

DefineRepeatRecordList

TranslateRestateDiscussDescribeRecognizeExplainExpressIdentify

InterpretApplyEmployUseDemonstrateDramatizePracticeIllustrateOperateScheduleShopSketch

DistinguishAnalyzeDifferentiateAppraiseCalculateExperimentTestCompareContrastCriticizeDiagramInspectDebateInventoryQuestionRelate

ComposePlanProposeDesignFormulateArrangeCollectConstructCreateSet upOrganizeManagePrepare

JudgeAppraiseEvaluateRateCompareValueReviseScoreSelectChooseAssessEstimateMeasure

METHODS

CASE STUDIES SIMULATIONS

“FROM BLOOM TO ASSESSMENT”

ASSESSMENTS

Essay Reports/PaperPractical Exercise

ProblemsExercisesCase studiesCritical incidentsDiscussionQuestionsTest

ProjectsProblemsCase studiesCreative exercisesDevelop plansConstructsSimulations

Case studiesProjectsExercisesCritiquesSimulationsAppraisals

Role PlayLearning Portfolio

COMPREHENSION

If Someone Asks…

Emma