Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using...

46
Metrics that Matter ® Cisco Channel Partner MTM Training

Transcript of Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using...

Page 1: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Metrics that Matter ®

Cisco Channel

Partner MTM

Training

Page 2: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Purpose

Your organization is using

Metrics that Matter ® (MTM) to:

Collect evaluations for training

Improve learning effectiveness and impact

Communicate results

Today’s session

MTM Overview

Key Reports

Additional Resources

2 © 2012, KnowledgeAdvisors

Page 3: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Expectations for Training

Interactive

Ask questions

Participate in hands-on exercises

Close email and other applications

Focused

60 minutes

Off-topic questions may need to wait

3 © 2012, KnowledgeAdvisors

Page 4: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Agenda

MTM Overview

Getting Started with MTM

Cisco Sponsored Reports

Subscription Based Reports

Additional Resources

Wrap - Up

4 © 2012, KnowledgeAdvisors

Page 5: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Logging into MTM www.metricsthatmatter.com/mtm

View announcements

Register for workshops, events, and MTM training

sessions

Page 6: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Hands-On: Log into MTM

1. Open your web browser

2. Go to www.metricsthatmatter.com/mtm

3. Bookmark this page

4. Login

6 © 2012, KnowledgeAdvisors

Page 7: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Admin Menu

Admin

Favorites

Help

FAQ

Site

Page 8: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

MTM Admin – Schedule Training

Tools Covered

Today

Tools for

Scheduling

Classes

Tools for

Collecting

Evaluations

Page 9: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

MTM Admin – Manage Evaluations

Tools Covered

Today

Tools for

Scheduling

Classes

Tools for

Collecting

Evaluations

Page 10: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

MTM Evaluation Process

Purpose of administration

Collect evaluations

Tag evaluations with class information

(instructor, date, learning methodology)

Populate reports

LMS integration can eliminate administration

© 2012, KnowledgeAdvisors 10

Schedule Classes

Collect Evaluations

View Reports

Page 11: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Add Courses

Add Locations

Add Instructors

MTM Evaluation Process

© 2012, KnowledgeAdvisors 11

Schedule Classes

Collect Evaluations

View Reports

Page 12: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

MTM Evaluation Process

© 2012, KnowledgeAdvisors 12

Schedule Classes

Collect Evaluations

View Reports

Page 13: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

MTM Evaluation Process

© 2012, KnowledgeAdvisors 13

Schedule Classes

Collect Evaluations

View Reports

Page 15: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Help

Report

Favorites

Reporting tab

FAQ Site

Page 16: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Manage

reports

Additional reports

Recommended

reports

Recent

reports

Page 17: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Configure

reports

Benchmark

preferences

Set reporting

scale

My

Settings

Page 18: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Objectives

Cisco Sponsored Reports

Identify reports

Manually run reports

Select optimal report

18 © 2012, KnowledgeAdvisors

Page 19: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Cisco Sponsored Reports

© 2012, KnowledgeAdvisors 19

1. Class Analysis Report

2. Quick Question

3. Data Download

Page 20: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Run Class Analysis Report

Query

Type

Class

Search

Date

Range

Select

Class

Page 21: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Select Question Categories

Set

Benchmark

Select

Question

Categories

Click Next

Page 22: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Additional Report Options

Select

Language

Report

Sections

Click

Next

Page 23: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Generate Report

Generate

Report

Select

Format

Page 24: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Run a Summary Report for a Class

© 2012, KnowledgeAdvisors 24

Narrative Report available in Word or PDF

Comprehensive, client-ready view into one class

Summary

Evaluation Ratings

Questions by Category

Qualitative Feedback

Demographics

Learner Responses

Next Steps

Facilitates analysis and comparison

Compare performance against a benchmark

Page 25: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Class Analysis Report

© 2012, KnowledgeAdvisors 25

Page 26: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Class Analysis Report

© 2012, KnowledgeAdvisors 26

Page 27: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Class Analysis Report

© 2012, KnowledgeAdvisors 27

Page 28: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Class Analysis Report

© 2012, KnowledgeAdvisors 28

Page 29: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Class Analysis Report

© 2012, KnowledgeAdvisors 29

Demographics

Additional Recommendations

Page 30: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Quick Question Report

30 © 2012, KnowledgeAdvisors

Summary

Question

Categories

Average

Scores

Page 31: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Hands-On: Run a Class Based Report

1. Click Reporting

2. Click Class Analysis or Quick Question

3. Select Date Range

4. Search for Class and click link

5. Click Next

6. Make any report selections, then click Next

7. Click Generate Report

31 © 2012, KnowledgeAdvisors

Page 32: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Objectives

Additional MTM Reports

Rank instructors

Review an instructor’s

performance

32 © 2012, KnowledgeAdvisors

Page 33: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Rank Instructors

Recognize top

instructors

Leverage top

instructors for

train-the-trainer

Drill into bottom

instructors

33 © 2012, KnowledgeAdvisors

Comparative Performance

Page 34: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Rank Courses

Expand design

approach of top

courses

Revise or retire

bottom courses

Incorporate into

performance

ratings

34 © 2012, KnowledgeAdvisors

Comparative Performance

Page 35: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Review an Instructor’s Performance

Discuss in

performance

review

Recognize

strengths

Identify skills

and courses to

improve on

Establish

development

plan and goals

35 © 2012, KnowledgeAdvisors

Instructor Performance Summary

Page 36: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Instructor Performance Summary

© 2012, KnowledgeAdvisors 36

Page 37: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Instructor Performance Summary

© 2012, KnowledgeAdvisors 37

Evaluations

collected by learning

methodology

Top and bottom

three classes

Page 38: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Instructor Performance Summary

© 2012, KnowledgeAdvisors 38

Ratings by question

category

Learner comments

by class

Page 39: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Crosstab Report

View intersection of 2 attributes to pinpoint

opportunities for improvement

Course x Question Category

Course x Instructor

Demographic x Learning Methodology

4 June 2013 © 2008, KnowledgeAdvisors 39

Page 40: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Analyze Qualitative Feedback

Text Analytics – Learner Comments Report

Provide aggregated view of

qualitative data

Easier access to actionable

and informative feedback

Determine learner sentiment:

Sentiment Score

(overall Satisfaction Score)

Relative to Benchmark

Word count

© 2012, KnowledgeAdvisors 40

Page 41: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Use Benchmarks

Compare

performance

against internal

or external

reference

Context for

quantitative

metrics

Insight into above

and below

average areas

© 2012, KnowledgeAdvisors 41

Report Card

Page 42: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Identify Sales Leads

Flexible Report

output/structure

Identify sales

leads

Include

qualitative data

Report by

question

© 2012, KnowledgeAdvisors 42

Multi-Level Analysis

Page 43: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Objectives

Q&A and Next Steps

© 2012, KnowledgeAdvisors 43

Summary

Q&A

Additional Resources

Page 44: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Summary

Objectives

Overview of MTM

Cisco Sponsored

Reports

Key MTM Reports

Additional

Resources

Tools

Class Analysis Report

Quick Question Report

Data Download

Comparative Performance

Report Card

Learner Sentiment

Multi-Level Analysis

© 2012, KnowledgeAdvisors 44

Page 45: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Additional Resources

MTM Help documentation on Reporting Best

Practices:

http://www.mtmlearning.com/lghelp/start/default.htm?_search=%20data download

FAQ site: http://knowledgeadvisors.force.com/knowledgeHome

Cisco Quick Start Guide

Cisco Welcome Kit

Cisco BLP Welcome Kit

© 2012, KnowledgeAdvisors 45

Page 46: Cisco Channel Partner MTM Training - webcloud29.com€¦ · Purpose Your organization is using Metrics that Matter ® (MTM) to: Collect evaluations for training Improve learning effectiveness

Thank you!

For on-going support and questions, please

contact your Services Team at

KnowledgeAdvisors or email Customer

Support:

[email protected]

© 2012, KnowledgeAdvisors 46