Measuring the Impact of eLearning: Turning Kirkpatrick’s Four Levels of Evaluation Upside Down

of 39 /39
Hosted by Lambda Solutions and Limestone Learning Measuring the Impact of eLearning Turning Kirkpatrick’s Four Levels of Evaluation Upside Down EMPOWER TALENT

Embed Size (px)

Transcript of Measuring the Impact of eLearning: Turning Kirkpatrick’s Four Levels of Evaluation Upside Down

Implementing the Right Training and Talent Management Technology

Hosted by Lambda Solutions and Limestone LearningMeasuring the Impact of eLearningTurning Kirkpatricks Four Levels of Evaluation Upside Down

EMPOWER TALENT1Your HostsSean HouganMarketing Coordinator

Paula YunkerManaging Partner &Instructional Designer

Paula has extensive experience in the areas of adult education, performance management and project management. Working in the industry for 30 + years, Paula has designed and developed innovative and engaging learning solutions for a variety of organizations. Applying her expertise and passion for all things learning and development, Paulas learning solutions, tools and processes have measurably enhanced employee performance on-the-job. She has also facilitated lively and informative training and conference sessions across Canada and the U.S. She is a member of the Association for Talent Development (formerly ASTD), the Canadian Society for Training and Development (CSTD) and holds Kirkpatrick Bronze Learning Evaluation certification.

Sean: Specializing in marketing communication, Sean is passionate about helping organizations find their voice and market through writing. Focused on e-Learning solutions, Sean believes that online education is the next frontier in transforming teaching practices so that high-caliber education is accessible for all. Sean dreams of being a perpetual learner and finds any opportunities she can to expand her knowledge base.2Agenda Lambda Solutions and Limestone Learning Why learning evaluation is important.Kirkpatricks four levels of evaluation explained.Aligning learning to organizational goals.Typical challenges implementing evaluation in an organization.Practical strategies for implementing learning evaluation.Favorite learning evaluation resources. Q & A

3

Our approachClients:

4We Reduce The Cost Of Learning

Powerful, flexible and open source solutionsTotara and Moodle provide you with an extensive feature set that is social and mobile enabled giving you the best value for your budget.Benefit from powerful, flexible and open source solutions that are feature rich with mobile and social applications. Totara and Moodle are 80% more cost effective and match leading competitors feature for feature.

Our agile service team implements scalable deployments to reduce your IT operating costs by more than 40%.managed cloud hosting is unparalleled for security and reliability with our 99.99% uptime commitmenTotara and Moodle managed cloud hosting that is unparalleled for security and reliability. Our agile service team implements scalable deployments to reduce your IT operating costs and worries.

Experience highly responsive customer service from our trusted professional experts. Our HelpDesk support, training, integration and custom development ensures fast and effective implementation of Totara and Moodle.Your time to use is days, not weeks with 12 years of experience and over 500 customer implementations, our highly responsive customer HelpDesk saves you time and money. Our proven experts provide support, training, integration and custom development..

12 years of experience and over 600 customer implementationsManaged cloud hosting reduces your IT operating costs by more than 40%Totara & Moodle are 80% more cost effective

5

Industry Leading Clients

All of our clients receive standard plugin installation and support included their managed hosting package6Poll #1What do you hope to gain from this webinar?

7Why Learning Evaluation Is Important?

8A Little History First

9Kirkpatricks Four Levels Of Evaluation

10Level 1 - ReactionMeasures to what degree learners react favorably to the learning event.The smile sheet.

11Poll #2Yes or no? Do you use level 1 learning evaluation?

Poll question #1:What are you most excited to learn about today?Answers:

12Level 2 - LearningMeasures to what degree learners acquire the intended knowledge, skills and attitudes based on their participation in a learning event.

13Poll #3What level 2 learning evaluation do you use in your training courses/programs?Pre-evaluation (formative)During the learning event (formative)At the end of the learning event (summative)Level 2 isnt used.

Poll question #1:What are you most excited to learn about today?Answers:

14Level 3 - BehaviourMeasures to what degree learners apply what they learned during training when they are back on the job.

15Poll #4Yes or no? Do you or your organization use level 3 learning evaluation?

Poll question #1:What are you most excited to learn about today?Answers:

16Level 4 ResultsMeasures to what degree targeted business outcomes occur as a result of the learning event(s).

17Poll #5Yes or no? Do you or your organization use level 4 learning evaluation?

Poll question #1:What are you most excited to learn about today?Answers:

18Level 5 - ROI

19Turning The 4 Levels Upside Down

20Aligning Learning To Organizational Goals

Strategies For Aligning LearningStep 1: Identify the business need.Step 2: Create the learning planStep 3: Measure the business results.

22Step 1: Identify The Business NeedAsk your key stakeholders and business partners:What desired results do you want to realize?What are the goals & business outcomes ?What needs to change to meet those goals & business outcomes?

23Step 1: Identify The Business Need (cont.)What KPIs should change? What needs to be learned to make those changes happen?What will success look like to you?

24Step 2: Create The Learning PlanDevelop a learning and evaluation plan to meet the learning requirements based on step 1 answers:What needs to be learned to achieve business outcomes?What required KPAs are needed?What learning experiences and practice are needed to become proficient?

25Step 2: Create The Learning Plan (cont.)When and how will these learning experiences and practice be best accomplished?How and when will the learning be measured? How will learning be applied to the job and how will that application be reinforced on the job?

26Step 3: Measure The Business ResultsTo identify how learning aligns to business outcomes and meets stakeholder/business partners needs:What changes in business results & key performance indicators have been realized from the training program?

27Step 3: Measure The Business Results (cont.)For every dollar invested in training how many dollars does the organization get in return? Is the ROI significant enough to justify training? What key intangible benefits (soft data) have been gained?

28Poll #6What are some examples of soft data?

29Challenges Implementing Evaluation

30Typical ChallengesLack of buy-in from the top.Ownership.Unable/unwilling to measure and track evaluation on the job.Lack of reinforcement on the job.

31Strategies For Implementing Evaluation

32Level 4 Implementation Strategies

Identify what training has the great impact.Determine how important the need is to demonstrate value.Involve stakeholders/ business partnersDetermine who is responsible?Start gathering data early.33Level 3 Implementation StrategiesDesign relevant follow-up questions.Administer 3 months post-training event individually, in groups, by survey.Ask similar questions to others to get a fuller picture.Create a Learning Action Plan.Learning contract between the learner and the supervisor/manager.

Create pre-evaluation that aligns to learning content/objectives.Design a variety of informal formative evaluation tools; at least one per lesson/objective.Design an end-of-course summative evaluation; use a checklist or rating scale to evaluate learning.

Level 2 Implementation Strategies

Go beyond a smile sheet.Focus questions on the learning experience.Make evaluation statements learner-centered. Create questions that align with higher evaluation levels.Consider using a 7, 9 or 11 point rating scale; only label each end of the scale.

Level 1 Implementation StrategiesFavorite Learning Evaluation ResourcesEvaluation websites.Books/reference material.Kirkpatrick Evaluation LinkedIn group.Training and certification.Industry and best practice research sites.Limestone Learning blog.

Questions/[email protected]

[email protected]

Paula YunkerManaging Partner

Sean HouganMarketing Coordinator

38TOLL FREE+1.877.700.1118EMAIL [email protected] US lambdasolutions.net/contact-us