Ka Overview June2010

Overview & CapabilitiesKnowledgeAdvisors

Agenda

Introductions Review previous discussions KnowledgeAdvisors’ Capabilities Overview of data capture and

analysis process/tools Discuss pilot program

2© 2010, KnowledgeAdvisors

Who we are

KnowledgeAdvisors is a human capital analytics firm. We are the world’s largest provider of learning and talent measurement solutions.


Measurement Expertise

Advisory Board− Josh Bersin− Dr. Robert Brinkerhoff− Dr. Jac Fitz-Enz− Dr. Jack Phillips− Dr. Don Kirkpatrick (retired)

KnowledgeAdvisors Experts− Measurement Strategy− Statistical Analysis− Outsourced Solutions


Metrics that Matter

Automated Data Collection

Push Reporting

Robust Filtering and Analytics


Benchmarks & Analytics

750 Million Data Points with many benchmark “slices”

Reporting that puts data into context and communicates results

Dashboards to visually interpret trends and relationships

Information distribution that reduces administrative burden


What we do

Automate the collection of learning evaluation data using validated and standardised instruments

Aggregate and present the data in a format that is meaningful for learning & HR professionals

Provide benchmarking to bring relevance to the data

Provide expertise to drive continuous improvement


Why we do it All the work by designers, facilitators, participants, coaches

and managers is for naught unless it manifests as results of importance to the business.

Credible, reliable measures are needed to determine whether the training investment is paying dividends and what refinements are needed to further improve the program’s effectiveness.

The only way to prove that resources have been well used is to continuously document and communicate relevant results.

Outcomes must be communicated to drive continual improvement in learning and development.

Effectiveness and efficiency are increased by rigorously assessing the quality of the current output, implementing ideas for improvement, measuring the impact and repeating the procedure.


Benefits of Metrics that Matter Provide ROUGHLY REASONABLE INDICATORS of

learning performance Shift focus to leading, versus lagging

indicators Trainers, program manager, managers,

coaches, and mentors are ranked and benchmarked, resulting in improved preparation & performance

Enables productive dialogue between HR and business.

Data informs all aspects of HR including Leadership, Recruiting, L&D, Performance, Engagement, and Talent.


Organisations Served


Streamline Evaluation

11

LMS Enrollment• Class information• Learner demographics

Post Event Evaluation

Follow Up Evaluation

Manager Evaluation

• Instant feedback• Satisfaction indicators• Impact, results predictors

• Impact, results indicators• Post-class support feedback

• Impact and results indicators and validation

• Support reinforcement

Data is transformed into Business Intelligence

© 2010, KnowledgeAdvisors

Smile Sheets into Smart Sheets


Value Creation vs. Value Demonstration

Ava

ilab

ility

of D

ata

Importance to Senior Management

Efficiencyconstructs

(how much we train)

Performanceconstructs

(how well we train) Impact

constructs (value we

create)

Reporting Strategy - Identify Stakeholder KPI’s

Stakeholder Responsibilities

Course Manager

Ranking of Course Scores

Instructor Manager

Ranking of Instructor Performance

Operations Manager

Enrollment, Completion, Cancellation RatesUtilization Rates (Course, Location, Instructor)

Client Job Impact , Business Results, and Value Indicators

VP of L&D Operational, Financial, Cultural and Performance Indicators


Detailed Result Catalog

View Results by

Category, Student and Question

Automate and Share Reports


Crosstab

17 © 2010, KnowledgeAdvisors

Compare question categories, courses,

instructors, locations, etc

Color codes scores relative to your selected benchmark:

red (under benchmark)yellow (at benchmark)green (exceeding benchmark)

Find Strengths & Weaknesses

Compare Results Internally and Against a

Benchmark

Drill Into Details


Compare to Internal Goals and External Benchmarks


Understand when training is applied or why it

isn’t being applied

Calculate Reasonable and

Scalable ROI Metrics


Consultatively

Discuss Training Impact


“Business Results” Imported into MTM


Import or Manually Track

Business Results

Determine Goals and

Color Coding

Display Results in Dashboard

Widgets 24


Customizable Dashboards Add / Delete Tabs

Add Delete Widgets

Email and Download

Import Results

Instructor Performance Summary

Communicates Value Provides an overview of performance

of an individual Instructor.

Highlights Areas for Improvement Performance by Instructor

Question Category. Top/bottom analysis of Courses

and Classes Trend Analysis on Ratings and Post

Event submissions Qualitative Feedback


Instructor Performance Summary


A single report containing the full story of an

instructor’s performance

Talent Development Summary Communicates Value

Provides a comprehensive view of talent and development Quarterly report format (Word 2007 or PDF)

Highlights Areas for Improvement Top/bottom analysis of Courses, Instructors, Learning

Providers and Locations Trend Analysis on Learning Methodologies and

Question Categories Impact and Value analysis by Demographics and Courses On the Job impact and Barriers to Use analysis


Next steps

Pilot Program 4-6 month trial of Metrics that

Matter Outsourced Administration Identify one or multiple programs to

evaluate Participate in all steps Outcomes include comprehensive

review of reporting and analytics using your own program results


Contact Us

Stuart HallidaySales Director07717 507 [email protected]

Ka Overview June2010

Documents

Transcript of Ka Overview June2010