KnowledgeAdvisors 10th Annual Analytics Symposium- Panel: The Role Of The Learning Measurement...

The Role of the Learning Measurement Analyst

Moderator:Kendall Kerekes

Panelists:

Danny Brown

Andy Chandarana

John Mattox

Shawn Overcast

March 6th, 2012

9:45 – 10:45

Panel Objectives

Apr 10, 2023 © 2011, KnowledgeAdvisors 2

Provide attendees with a comprehensive perspective about the knowledge, skills and support that learning measurement analysts need to be successful

How?

KnowledgeAdvisors has convened a panel of current employees who helped develop or had roles within corporate learning and human capital analytics groups; most were former clients.

Through a question and answer session, the panelists will share their insights and experiences.

Apr 10, 2023 3© 2011, KnowledgeAdvisors


Visualizing the Life of an Analyst

Credit where credit is due…

The next series of slides were created by Elisabeth Fosslien and used with credit attributed: http://fosslien.com/analyst/

http://fosslien.com/analyst/

The Learning Curve


The (Symposium) Motto


The “Balance”


The Job Description Generator


The Mindset


Measurement Sustainability Model

Processes

Standards, Tools

• Established and consistent processes, technologies and communications for measurement

• Broad base of skills in analytics and measurement and strong capabilities in end-to-end measurement methods

• Standardization for a consistent and single point of analytics with integration to and from feeder systems

• Roles and accountabilities for metrics are defined with consistent expectations on what should be measured.

• Strong desire to use the data for decision making

• Maturity in how data is reported and used to improve end to end talent processes

• Strong leadership for driving measurement with governance to support it.

• Standards have been created for data collection• Data integrity exists

• Culture supports and drives need for standards and common talent development processes and measurement

3

5

8

1

2

3

46

7


Evaluator Competency ModelInterpersonal Skills

Communication Skills Stakeholder Relationships Reflective Practices

Business and Technical Skills Professional Practice T&D Process Performance Consulting

Foundations

Evaluation Planning Project Management Systematic Inquiry Situational Analysis

Evaluation Implementation Instrument Design Data Analysis Data Reporting


Our Panel

Danny Brown Andy Chandarana John Mattox Shawn Overcast


Danny

18 years of private, public, and non-profit workplace learning and performance experience

After teaching high school math, started work as an Air Force contractor delivering safety & employee effectiveness training and began the quest for measurement of training programs

At ASTD headquarters, managed the ROI Network Then at Sprint Nextel, as the learning analytics lead, responsible

for the measurement & evaluation process using Metrics that Matter


AJT & Associates ROI Network Sprint University

Andy

Human Capital Measurement Consultant: 5 years as a Consultant and 2 years in HR


2 yrs benchmarking everything but HR (Fin/Acct, IT, SC, etc.)

2 yrs benchmarking HR and working on Employee Surveys

and HR Metrics/Scorecards

1-1/2 yrs establishing theHuman Capital Measurement group (Center of Excellence)

6 mo. in L&D designing and delivering new courses for

corporate audiences

http://www.pwc.com/us/en/

John Experience: 12 years evaluating corporate training

programs, setting measurement strategy, and leading measurement groups at Arthur Andersen, PricewaterhouseCoopers and KPMG

Apr 10, 2023 15

Team of 35

Evaluators

3 FTEs(2) Managers

Senior3 - 5 temps

3 – 4 FTEsAssoc DirManagerSenior

© 2011, KnowledgeAdvisors

http://www.pwc.com/us/en/

Shawn Supported consistent performance analysis and

evaluation practices, focusing on leadership development and culture change, design and development of high-visibility programs, and measuring the effectiveness and impact of these programs

Led the formation of and managed the learning & performance analytics function, including analysis in the areas of talent development, performance measurement, and alignment to goals & measures

Ever-interested in the capability development of evaluation practitioners, she has presented and published on the topic, and is a founder of the LinkedIn special interest group, Evaluator Thought Partners


Questions What is the purpose of the learning measurement analyst

for L&D? What are the most important tasks (and/or responsibilities) that the

measurement person fulfills? To achieve what end (e.g., justify existence, demonstrate value, support

data-driven decisions)?


Questions What Knowledge, Skills and Abilities are required for the

role? What other performance support is necessary or helpful to accomplishing

the tasks/responsibilities referenced above (e.g., tools, technology, process)?

What support does the analyst need from his / her boss to be successful? The organization?

What factors in the industry have impacted the role? How does it impact the role? What can L&D analysts do to prepare themselves for the role?


Scoping


CXO“Hey, I have a question.”

CLO“Hey, we need to answer the CXO’s question.”

Director of L&D“Hey, here are some ideas on how to answer the CXO’s question.”

Manager of L&D“Hey Analyst, analyze some data on this idea on how to answer the CXO’s question”

L&D Analyst

Analysis


Reporting/Presentation


L&D Analyst“Hey, here’s that project you asked for.”

Manager of L&D“Hey, awesome. I’ll add some commentary.”

Director of L&D“Hey, awesome. I’ll turn this into a slide show.”

CLO“Hey, here is a slide show answering that question you asked.”

CXO“Huh? Oh, we decided to go in a different direction. Anyways, I have a question.”

Contact information Kendall Kerekes:

[email protected] Danny Brown:

[email protected] Andy Chandarana:

[email protected] John Mattox:

[email protected] Shawn Overcast:

[email protected]


mailto:[email protected]





KnowledgeAdvisors 10th Annual Analytics Symposium- Panel: The Role Of The Learning Measurement...

Documents

Transcript of KnowledgeAdvisors 10th Annual Analytics Symposium- Panel: The Role Of The Learning Measurement...