Implementing Program Evaluation with an Ornery Audience by Dan Goerlich Virginia Cooperative...
17
Implementing Program Evaluation with an Ornery Audience by Dan Goerlich Virginia Cooperative Extension
-
Upload
jocelyn-watkins -
Category
Documents
-
view
213 -
download
0
Transcript of Implementing Program Evaluation with an Ornery Audience by Dan Goerlich Virginia Cooperative...
Implementing Program Evaluation with an Ornery Audience
byDan Goerlich
Virginia Cooperative Extension
Anticipate the Ornery
Is your audience there:
• To maintain certificates, registrations, or licenses? • Due to a mandate?• For some other involuntary reason?
If so, the chances are good that your participants may beornery.
Examples: pesticide recertification, forester licensing,registration, or certification, and logger training programs.
• SHARP Logger Program (1996)
• Three core programs (18 hrs)
• Continuing Education Requirement (12 hrs per 3 year period)
• If loggers do not achieve SHARP status, they can’t deliver wood to SFI member companies.
I should be in the woods working…this is a waste of time.
I guess they’re goin’ to teach us how to log. Hell, I’ve been loggin’ for 30 years.
I ain’t heard nuthin’ useful yet…
SHARP Evaluation History
• From 1996 through 2001 programs were conducted, but not evaluated.
• Basic evaluation introduced in 2002. – Rate this course (from 1 to 5)– What did you learn that you will use?– What do we need to change?– What other classes would you like?
• From August 28, 2002 through December 7, 2005, evaluation administered to 1,397 loggers attending 49 logger-specific educational programs.
Response Rate as a Function of Time
R2 = 0.0869
0
20
40
60
80
100
120
5/24/2002 12/10/2002 6/28/2003 1/14/2004 8/1/2004 2/17/2005 9/5/2005
Date
% R
esp
on
se
Response Rate as a Function of Score
R2 = 0.1092
0
20
40
60
80
100
120
3.0 3.2 3.4 3.6 3.8 4.0 4.2 4.4 4.6 4.8 5.0
Weighted Average Score
% R
esp
on
se
Trade the participation notice, certificate, CFE sheet, or other documentation for the evaluation to insure a high response rate. Or, draw evaluations for door prizes.
Steps to Success
1. Start simple.
2. Increase evaluation detail.
3. Implement follow-up evaluation.
4. Develop future programs based on their input.
“That class made me a lot of money.”
"...more aware of calculating repairs and costs, and also investing."
"I feel that the program was well taught and very interesting and will cut my costs on repairs."
“…make more sound business decisions.”
“When is the next log grading workshop going to be?”
“Thank you for putting this class on.”
