Chapter 41 Training for Organizations Research Skills.

Chapter 4 1

Training for Organizations

Research Skills

Chapter 4 2Training for Organizations

Research Skills

Review:One minute elevator speeches:

Why do a needs assessment? Why do an evaluation?


Selected Methods

The observation method The interview method The survey method Testing


A Step-by-Step Approach

Step 1. Identify needed data Step 2. Determine who has the

answers to your questions Step 3. Design the data collection

instrument determine major points, questions, and

sequence of the questions develop a coding or tabulating method to

analyze findings


A Step-by-Step Approach (cont.) Step 4. Have “experts” review the

draft instrument Step 5. Field test the instrument,

then distribute it to or interview targets

Step 6. Analyze and interpret responses


The Questions

Categorical questionsHow many people do you supervise?

Likert-type questions On a scale of 1 to 7….. Open ended questions


The Observation Method

Types of variables descriptive inferential evaluative


The Observation Method

Recording observational data elapsed time recording frequency recording interval recording continuous recording


The Observation Form

Group work: Develop an observation form you

could use as a guide in observing a newly hired training instructor.


The Interview

Why do it?

Why not do it?


Interview Guides

Structured questions

“How many performance appraisals did you conduct last month?”

Open questions

“When conducting performance appraisals, what were your biggest challenges?”


Preparing for the Interview

1. What do you need to know? 2. Who has the answers?


Choices at the Design Stage How many people to interview? Interview one-on-one or in small

groups? In person or by telephone (video

conferencing?) Location of interview (privacy,

comfort, interruptions)


Preparation for the Interview Will interviewees need to show you

something, such as their use of technology?

Audiotape? (questions of confidentiality)

Need for repeated access? (and relationship-building)

Potential problems (e.g., getting them to talk; getting them to stop talking!)


Conducting the Interview

Put the interviewee at ease Explain why you are there & why the

interviewee was chosen Estimate how long the interview will take Explain what you will do with responsesnote--Questions should be designed to help the

client clarify issues rather than provide information for the interview.


The Interview Strategy

Listening is more than hearing

One study reported that we spend 70% of our day communicating: writing 9% reading 16% talking 30% listening 45%


Stages of Interviewing

plan (who, what, when, where) prepare (template-based questions) set the stage (“partner” with

interviewee”) collect data (keep in mind the

purpose of the interview) close the interview (summary, thanks) follow-up (copy of results?)


Preparing for the Interview

What do you need to know? Who has the answers?


Choices at the Design Stage

How many people need to be interviewed?

Interview one-on-one or in small groups? Should the interview be in person or by

telephone? (videoconferencing?!) Where should the interview be held? How long should the interview be? How should data be recorded?


Choices (cont.)

Will interviewees need to show you something, such as their use of a technology?

Audiotape? (questions of confidentiality)

Need for repeated access? (and relationship-building)

Potential problems (e.g., getting them to talk; getting them to stop talking!)


Stages of Interviewing

plan (who, what, when, where) prepare (template-based questions) set the stage (“partner” with

interviewee”) collect data (keep in mind the

purpose of the interview) close the interview (summary, thanks) follow-up (copy of results?)


The Survey Method

The method has a long history…population counts and surveys of crop production (Why? Taxes!)

Sociologists first linked data collection instruments with statistical procedures for analyzing their data


Designing a Questionnaire

Questionnaire Template Directions Body Ending Demographic Data


The Mail Questionnaire

Advantages Low cost Greater

anonymity Considered

answers Accessibility

(wider coverage)

Disadvantages Requires simple

questions No opportunity to

probe No control over

who responds Often low

response rate


Group Assignment

To assess computing needs of students, write two:

categorical questions Likert-style questions open-ended questions


Tests

Measure how well someone does a specific task or what they know about given content

Must be valid and reliable


Types of Tests

Pretests (for placement purposes) Formative (evaluate learning

progress) Diagnostic (identify learning

problems) Summative (determine that

learning occurred)


Creating and Using Tests

1. Record test items 2. Review and edit test items

Use a table of specifications to ensure coverage and match with learning objectives

3. Arrange the items in the test and prepare directions for the test

4. Administer and score the test


Experimental Methods

Used in training environments to provide evidence of the usefulness of a specific training intervention. In short, is one learning method better than another, and if so, to what degree?


Using Experimental Designs Post-test Only Design

X O1

Pre-test, Post-test DesignO1 X O2


Two-group Pre-test, Post-test DesignO1XaO2

O1XbO2

Four-group Design O1XaO2

O1 O2

XaO2

O2


Time series

O1O2O3O4 X O5O6O7O8


Review

The importance of a good data collection instrument

How to write good questions Important instrument guide design

elements The importance of planning


Exercise:

Break into groups againThen, using the sample interview

guide one person play the role of the interviewer, one the interviewee

Those watching should use the check sheet provided


Summary & Questions

What did you learn? Any questions?


See you on next week!

Chapter 41 Training for Organizations Research Skills.

Documents

Transcript of Chapter 41 Training for Organizations Research Skills.