1 WHATtoEvaluate-Webinar1
-
Upload
nur-ashiqin-najmuddin -
Category
Documents
-
view
218 -
download
0
Transcript of 1 WHATtoEvaluate-Webinar1
-
8/6/2019 1 WHATtoEvaluate-Webinar1
1/25
Welcome to theReframing Webinar on
WHAT to Evaluate Please let us know if you cant hear the music
playing by chatting in the chat pod
Please type your email address in the Chat Pod
-
8/6/2019 1 WHATtoEvaluate-Webinar1
2/25
Designing anEvaluation Strategy
for a
Statewide ProgramWebinar Series
Nancy Ellen Kiernan
-
8/6/2019 1 WHATtoEvaluate-Webinar1
3/25
Evaluation Webinars 5 sessions: July 20- Sept 9, 2009
repeated live a few days later
followed with an Office Hour
try out ideas for your evaluation hear from other Liaisons ask for other resources give suggestions
-
8/6/2019 1 WHATtoEvaluate-Webinar1
4/25
The 7 STEPS in designing an evaluationstrategy
October 1st : State ProgramEvaluation Strategy Worksheeton Extension Reframing Websitehttp://sharepoint.ag.psu.edu/coext/ProposalPrep/default.aspx
Graphic: 7 stepshttp://extension.psu.edu/evaluation/pdf/TS83.pdf
-
8/6/2019 1 WHATtoEvaluate-Webinar1
5/25
What is program evaluation?What is program evaluation?
A systematic process to gather data aboutyour program to
1. improve or expand the program
2. provide accountability
-
8/6/2019 1 WHATtoEvaluate-Webinar1
6/25
Standards for evaluation?Standards for evaluation?useful*
accurate
feasible
propitious
http://www.eval.org/EvaluationDocuments/progeval.html
-
8/6/2019 1 WHATtoEvaluate-Webinar1
7/25
To create an Evaluation Strategy,To create an Evaluation Strategy,you, your Program Chairs andyou, your Program Chairs and
Team need to decide:Team need to decide:WHATto evaluate
HOW to evaluate
USE of results
-
8/6/2019 1 WHATtoEvaluate-Webinar1
8/25
Todays Webinar
WHAT to EvaluateWHAT to Evaluate
-
8/6/2019 1 WHATtoEvaluate-Webinar1
9/25
To Determine WHAT to EvaluateTo Determine WHAT to EvaluateStep 1. decide what evidence yourstakeholders want about yourprogram
Step 2. clarify/add program
objectives
see Evaluation Strategy Worksheet and Tipsheet #83
-
8/6/2019 1 WHATtoEvaluate-Webinar1
10/25
Decide: Who are thestakeholders for your
program?
External to Extension
Internal
-
8/6/2019 1 WHATtoEvaluate-Webinar1
11/25
Internal Stakeholders (continued)
Program Chairs*
Your Team*
Publicity Person on Team
IT Liaison
-
8/6/2019 1 WHATtoEvaluate-Webinar1
12/25
Internal Stakeholders (continued)
Instructors*
County Educators on Program Team*
community leaders, Co. Commissioners
extension committee/Board members
annual reports county level
dossier/promotion see PAEXAMPLEs #30 and #31
Specialists/ County Educators on Team
Professional presentations or articles
-
8/6/2019 1 WHATtoEvaluate-Webinar1
13/25
To Determine WHAT to Evaluate
identify
stakeholders of your program \
the kind of evidence they want
-
8/6/2019 1 WHATtoEvaluate-Webinar1
14/25
LEVELS OF EVIDENCE
IMPACTS
OUTPUTS
INPUTS
7. End Results
6. Behaviors (practice change)
5. KASI Change
4. Reactions (to implementation by T.A.)
3. People Involvement
2. Activities
1. Resources
-
8/6/2019 1 WHATtoEvaluate-Webinar1
15/25
Why doing this?
You want to evaluate
Onlywhat is useful to team
-
8/6/2019 1 WHATtoEvaluate-Webinar1
16/25
in Deciding WHAT to Evaluate
Step 1. decide what evidence your stakeholders wantabout your program
Step 2. add/clarify program objectives
Are they all there? Too vague?
Make them specific, measureable, objective, realistic
see Evaluation Strategy Worksheet and Tipsheet #83
-
8/6/2019 1 WHATtoEvaluate-Webinar1
17/25
Measureable Program Objectives
Youth participating
in community clubswill show gains insubject matterknowledge in
leadership andpersonaldevelopment.
Youth 10-12 yr. old in
community clubs willbe able todemonstrate 3 newleadership skills
related to meetingmanagement and 3communication skills.
-
8/6/2019 1 WHATtoEvaluate-Webinar1
18/25
From Objective to Evaluation
Participants will believethat the Marcellus ShaleNatural Gas Explorationand Development
will be very importantfor the local economy
raises 2 veryimportantenvironmentalconcerns
How important is theMarcellus Shale NaturalGas Exploration andDevelopment for the localeconomy?
1 Not too important
2 Somewhat important3 Moderately important
4 Very important
-
8/6/2019 1 WHATtoEvaluate-Webinar1
19/25
SUMMARYYou want the Evaluation of your
statewide program to beuseful*
accurate
feasible
propitious
-
8/6/2019 1 WHATtoEvaluate-Webinar1
20/25
Therefore, consider
WHATto evaluate
HOW to evaluate dont start here
USE of results
-
8/6/2019 1 WHATtoEvaluate-Webinar1
21/25
SUMMARYSUMMARY
In considering WHATto evaluate,1. You, Program Chair and Team should decide:
Who are your stakeholders
What level of evidence do theywant/need to know
program improvement/expansion
accountability
If objectives are complete, specific et al.
2. Complete Steps 1 and 2 in the Statewide
Program Evaluation Strategy Worksheet
-
8/6/2019 1 WHATtoEvaluate-Webinar1
22/25
Questions?
Comments?
-
8/6/2019 1 WHATtoEvaluate-Webinar1
23/25
CLICK URL
-
8/6/2019 1 WHATtoEvaluate-Webinar1
24/25
Upcoming Webinars Session 1: WHAT to evaluate?
Repeat (live) Monday Aug. 3rd, 10:30-11:30
Office Hour Wednesday, Aug 5th, 1:30-2:30
Session 2: How Can Extension Claim Credit?
Thursday, Aug. 6th, 1:30-2:30
Repeat (live) Monday Aug. 10th, 10:30-11:30
Office Hour Wednesday, Aug. 12th, 1:30-2:30
Nancy Ellen Kiernan [email protected] (814) 863 7621
-
8/6/2019 1 WHATtoEvaluate-Webinar1
25/25
"Penn State is committed to affirmative action, equalopportunity, and the diversity of its workforce."
College of Agricultural Sciences Cooperative Extension