Metrics that Matter ®

Cisco Channel

Partner MTM

Training

Purpose

Your organization is using

Metrics that Matter ® (MTM) to:

Collect evaluations for training

Improve learning effectiveness and impact

Communicate results

Today’s session

MTM Overview

Key Reports

Additional Resources

2 © 2012, KnowledgeAdvisors

Expectations for Training

Interactive

Ask questions

Participate in hands-on exercises

Close email and other applications

Focused

60 minutes

Off-topic questions may need to wait

3 © 2012, KnowledgeAdvisors

Agenda

MTM Overview

Getting Started with MTM

Cisco Sponsored Reports

Subscription Based Reports

Additional Resources

Wrap - Up

4 © 2012, KnowledgeAdvisors

Logging into MTM www.metricsthatmatter.com/mtm

View announcements

Register for workshops, events, and MTM training

sessions

Hands-On: Log into MTM

1. Open your web browser

2. Go to www.metricsthatmatter.com/mtm

3. Bookmark this page

4. Login

6 © 2012, KnowledgeAdvisors

Admin Menu

Admin

Favorites

Help

FAQ

Site

MTM Admin – Schedule Training

Tools Covered

Today

Tools for

Scheduling

Classes

Tools for

Collecting

Evaluations

MTM Admin – Manage Evaluations

Tools Covered

Today

Tools for

Scheduling

Classes

Tools for

Collecting

Evaluations

MTM Evaluation Process

Purpose of administration

Collect evaluations

Tag evaluations with class information

(instructor, date, learning methodology)

Populate reports

LMS integration can eliminate administration

© 2012, KnowledgeAdvisors 10

Schedule Classes

Collect Evaluations

View Reports

Add Courses

Add Locations

Add Instructors

MTM Evaluation Process

© 2012, KnowledgeAdvisors 11

Schedule Classes

Collect Evaluations

View Reports

MTM Evaluation Process

© 2012, KnowledgeAdvisors 12

Schedule Classes

Collect Evaluations

View Reports

MTM Evaluation Process

© 2012, KnowledgeAdvisors 13

Schedule Classes

Collect Evaluations

View Reports

Getting Started Resources

© 2012, KnowledgeAdvisors 14

1. Cisco Quick Start Guide

2. Cisco Welcome Kit

3. Cisco BLP Welcome Kit

Help

Report

Favorites

Reporting tab

FAQ Site

Manage

reports

Additional reports

Recommended

reports

Recent

reports

Configure

reports

Benchmark

preferences

Set reporting

scale

My

Settings

Objectives

Cisco Sponsored Reports

Identify reports

Manually run reports

Select optimal report

18 © 2012, KnowledgeAdvisors

Cisco Sponsored Reports

© 2012, KnowledgeAdvisors 19

1. Class Analysis Report

2. Quick Question

3. Data Download

Run Class Analysis Report

Query

Type

Class

Search

Date

Range

Select

Class

Select Question Categories

Set

Benchmark

Select

Question

Categories

Click Next

Additional Report Options

Select

Language

Report

Sections

Click

Next

Generate Report

Generate

Report

Select

Format

Run a Summary Report for a Class

© 2012, KnowledgeAdvisors 24

Narrative Report available in Word or PDF

Comprehensive, client-ready view into one class

Summary

Evaluation Ratings

Questions by Category

Qualitative Feedback

Demographics

Learner Responses

Next Steps

Facilitates analysis and comparison

Compare performance against a benchmark

Class Analysis Report

© 2012, KnowledgeAdvisors 25

Class Analysis Report

© 2012, KnowledgeAdvisors 26

Class Analysis Report

© 2012, KnowledgeAdvisors 27

Class Analysis Report

© 2012, KnowledgeAdvisors 28

Class Analysis Report

© 2012, KnowledgeAdvisors 29

Demographics

Additional Recommendations

Quick Question Report

30 © 2012, KnowledgeAdvisors

Summary

Question

Categories

Average

Scores

Hands-On: Run a Class Based Report

1. Click Reporting

2. Click Class Analysis or Quick Question

3. Select Date Range

4. Search for Class and click link

5. Click Next

6. Make any report selections, then click Next

7. Click Generate Report

31 © 2012, KnowledgeAdvisors

Objectives

Additional MTM Reports

Rank instructors

Review an instructor’s

performance

32 © 2012, KnowledgeAdvisors

Rank Instructors

Recognize top

instructors

Leverage top

instructors for

train-the-trainer

Drill into bottom

instructors

33 © 2012, KnowledgeAdvisors

Comparative Performance

Rank Courses

Expand design

approach of top

courses

Revise or retire

bottom courses

Incorporate into

performance

ratings

34 © 2012, KnowledgeAdvisors

Comparative Performance

Review an Instructor’s Performance

Discuss in

performance

review

Recognize

strengths

Identify skills

and courses to

improve on

Establish

development

plan and goals

35 © 2012, KnowledgeAdvisors

Instructor Performance Summary

Instructor Performance Summary

© 2012, KnowledgeAdvisors 36

Instructor Performance Summary

© 2012, KnowledgeAdvisors 37

Evaluations

collected by learning

methodology

Top and bottom

three classes

Instructor Performance Summary

© 2012, KnowledgeAdvisors 38

Ratings by question

category

Learner comments

by class

Crosstab Report

View intersection of 2 attributes to pinpoint

opportunities for improvement

Course x Question Category

Course x Instructor

Demographic x Learning Methodology

4 June 2013 © 2008, KnowledgeAdvisors 39

Analyze Qualitative Feedback

Text Analytics – Learner Comments Report

Provide aggregated view of

qualitative data

Easier access to actionable

and informative feedback

Determine learner sentiment:

Sentiment Score

(overall Satisfaction Score)

Relative to Benchmark

Word count

© 2012, KnowledgeAdvisors 40

Use Benchmarks

Compare

performance

against internal

or external

reference

Context for

quantitative

metrics

Insight into above

and below

average areas

© 2012, KnowledgeAdvisors 41

Report Card

Identify Sales Leads

Flexible Report

output/structure

Identify sales

leads

Include

qualitative data

Report by

question

© 2012, KnowledgeAdvisors 42

Multi-Level Analysis

Objectives

Q&A and Next Steps

© 2012, KnowledgeAdvisors 43

Summary

Q&A

Additional Resources

Summary

Objectives

Overview of MTM

Cisco Sponsored

Reports

Key MTM Reports

Additional

Resources

Tools

Class Analysis Report

Quick Question Report

Data Download

Comparative Performance

Report Card

Learner Sentiment

Multi-Level Analysis

© 2012, KnowledgeAdvisors 44

Additional Resources

MTM Help documentation on Reporting Best

Practices:

http://www.mtmlearning.com/lghelp/start/default.htm?_search=%20data download

FAQ site: http://knowledgeadvisors.force.com/knowledgeHome

Cisco Quick Start Guide

Cisco Welcome Kit

Cisco BLP Welcome Kit

© 2012, KnowledgeAdvisors 45

Thank you!

For on-going support and questions, please

contact your Services Team at

KnowledgeAdvisors or email Customer

Support:

solutions@knowledgeadvisors.com

© 2012, KnowledgeAdvisors 46