Metrics that Matter ®
Cisco Channel
Partner MTM
Training
Purpose
Your organization is using
Metrics that Matter ® (MTM) to:
Collect evaluations for training
Improve learning effectiveness and impact
Communicate results
Today’s session
MTM Overview
Key Reports
Additional Resources
2 © 2012, KnowledgeAdvisors
Expectations for Training
Interactive
Ask questions
Participate in hands-on exercises
Close email and other applications
Focused
60 minutes
Off-topic questions may need to wait
3 © 2012, KnowledgeAdvisors
Agenda
MTM Overview
Getting Started with MTM
Cisco Sponsored Reports
Subscription Based Reports
Additional Resources
Wrap - Up
4 © 2012, KnowledgeAdvisors
Logging into MTM www.metricsthatmatter.com/mtm
View announcements
Register for workshops, events, and MTM training
sessions
Hands-On: Log into MTM
1. Open your web browser
2. Go to www.metricsthatmatter.com/mtm
3. Bookmark this page
4. Login
6 © 2012, KnowledgeAdvisors
Admin Menu
Admin
Favorites
Help
FAQ
Site
MTM Admin – Schedule Training
Tools Covered
Today
Tools for
Scheduling
Classes
Tools for
Collecting
Evaluations
MTM Admin – Manage Evaluations
Tools Covered
Today
Tools for
Scheduling
Classes
Tools for
Collecting
Evaluations
MTM Evaluation Process
Purpose of administration
Collect evaluations
Tag evaluations with class information
(instructor, date, learning methodology)
Populate reports
LMS integration can eliminate administration
© 2012, KnowledgeAdvisors 10
Schedule Classes
Collect Evaluations
View Reports
Add Courses
Add Locations
Add Instructors
MTM Evaluation Process
© 2012, KnowledgeAdvisors 11
Schedule Classes
Collect Evaluations
View Reports
MTM Evaluation Process
© 2012, KnowledgeAdvisors 12
Schedule Classes
Collect Evaluations
View Reports
MTM Evaluation Process
© 2012, KnowledgeAdvisors 13
Schedule Classes
Collect Evaluations
View Reports
Getting Started Resources
© 2012, KnowledgeAdvisors 14
1. Cisco Quick Start Guide
2. Cisco Welcome Kit
3. Cisco BLP Welcome Kit
Help
Report
Favorites
Reporting tab
FAQ Site
Manage
reports
Additional reports
Recommended
reports
Recent
reports
Configure
reports
Benchmark
preferences
Set reporting
scale
My
Settings
Objectives
Cisco Sponsored Reports
Identify reports
Manually run reports
Select optimal report
18 © 2012, KnowledgeAdvisors
Cisco Sponsored Reports
© 2012, KnowledgeAdvisors 19
1. Class Analysis Report
2. Quick Question
3. Data Download
Run Class Analysis Report
Query
Type
Class
Search
Date
Range
Select
Class
Select Question Categories
Set
Benchmark
Select
Question
Categories
Click Next
Additional Report Options
Select
Language
Report
Sections
Click
Next
Generate Report
Generate
Report
Select
Format
Run a Summary Report for a Class
© 2012, KnowledgeAdvisors 24
Narrative Report available in Word or PDF
Comprehensive, client-ready view into one class
Summary
Evaluation Ratings
Questions by Category
Qualitative Feedback
Demographics
Learner Responses
Next Steps
Facilitates analysis and comparison
Compare performance against a benchmark
Class Analysis Report
© 2012, KnowledgeAdvisors 25
Class Analysis Report
© 2012, KnowledgeAdvisors 26
Class Analysis Report
© 2012, KnowledgeAdvisors 27
Class Analysis Report
© 2012, KnowledgeAdvisors 28
Class Analysis Report
© 2012, KnowledgeAdvisors 29
Demographics
Additional Recommendations
Quick Question Report
30 © 2012, KnowledgeAdvisors
Summary
Question
Categories
Average
Scores
Hands-On: Run a Class Based Report
1. Click Reporting
2. Click Class Analysis or Quick Question
3. Select Date Range
4. Search for Class and click link
5. Click Next
6. Make any report selections, then click Next
7. Click Generate Report
31 © 2012, KnowledgeAdvisors
Objectives
Additional MTM Reports
Rank instructors
Review an instructor’s
performance
32 © 2012, KnowledgeAdvisors
Rank Instructors
Recognize top
instructors
Leverage top
instructors for
train-the-trainer
Drill into bottom
instructors
33 © 2012, KnowledgeAdvisors
Comparative Performance
Rank Courses
Expand design
approach of top
courses
Revise or retire
bottom courses
Incorporate into
performance
ratings
34 © 2012, KnowledgeAdvisors
Comparative Performance
Review an Instructor’s Performance
Discuss in
performance
review
Recognize
strengths
Identify skills
and courses to
improve on
Establish
development
plan and goals
35 © 2012, KnowledgeAdvisors
Instructor Performance Summary
Instructor Performance Summary
© 2012, KnowledgeAdvisors 36
Instructor Performance Summary
© 2012, KnowledgeAdvisors 37
Evaluations
collected by learning
methodology
Top and bottom
three classes
Instructor Performance Summary
© 2012, KnowledgeAdvisors 38
Ratings by question
category
Learner comments
by class
Crosstab Report
View intersection of 2 attributes to pinpoint
opportunities for improvement
Course x Question Category
Course x Instructor
Demographic x Learning Methodology
4 June 2013 © 2008, KnowledgeAdvisors 39
Analyze Qualitative Feedback
Text Analytics – Learner Comments Report
Provide aggregated view of
qualitative data
Easier access to actionable
and informative feedback
Determine learner sentiment:
Sentiment Score
(overall Satisfaction Score)
Relative to Benchmark
Word count
© 2012, KnowledgeAdvisors 40
Use Benchmarks
Compare
performance
against internal
or external
reference
Context for
quantitative
metrics
Insight into above
and below
average areas
© 2012, KnowledgeAdvisors 41
Report Card
Identify Sales Leads
Flexible Report
output/structure
Identify sales
leads
Include
qualitative data
Report by
question
© 2012, KnowledgeAdvisors 42
Multi-Level Analysis
Objectives
Q&A and Next Steps
© 2012, KnowledgeAdvisors 43
Summary
Q&A
Additional Resources
Summary
Objectives
Overview of MTM
Cisco Sponsored
Reports
Key MTM Reports
Additional
Resources
Tools
Class Analysis Report
Quick Question Report
Data Download
Comparative Performance
Report Card
Learner Sentiment
Multi-Level Analysis
© 2012, KnowledgeAdvisors 44
Additional Resources
MTM Help documentation on Reporting Best
Practices:
http://www.mtmlearning.com/lghelp/start/default.htm?_search=%20data download
FAQ site: http://knowledgeadvisors.force.com/knowledgeHome
Cisco Quick Start Guide
Cisco Welcome Kit
Cisco BLP Welcome Kit
© 2012, KnowledgeAdvisors 45
Thank you!
For on-going support and questions, please
contact your Services Team at
KnowledgeAdvisors or email Customer
Support:
© 2012, KnowledgeAdvisors 46
Top Related