Evaluation Communication Efforts in Extension
-
Upload
qsettle -
Category
Data & Analytics
-
view
45 -
download
0
Transcript of Evaluation Communication Efforts in Extension
![Page 1: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/1.jpg)
Extending Knowledge. Changing Lives.
Evaluating Communication Efforts
in Extension
Q. Settle, E. North, M. Brubaker, & L. Downey
![Page 2: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/2.jpg)
Extending Knowledge. Changing Lives.
Overview• The Situation• Our Stories• Options• Discussion
![Page 3: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/3.jpg)
Extending Knowledge. Changing Lives.
THE SITUATION
![Page 4: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/4.jpg)
Extending Knowledge. Changing Lives.
Need for Evaluation• Administrators
Public funding declining Need to justify all programs Need to ensure recognition of agency value
• Communicators Make the programs better Ensure meeting goals Demonstrate value
![Page 5: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/5.jpg)
Extending Knowledge. Changing Lives.
The Problem• Conducting good, thorough
evaluation is difficult• Communications professionals don’t
always have evaluation experience• Evaluation professionals don’t
always have experience evaluating communications
![Page 6: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/6.jpg)
Extending Knowledge. Changing Lives.
Our Goal• Front-to-back evaluation of
Extension communications Inputs Outputs Outcomes
![Page 7: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/7.jpg)
Extending Knowledge. Changing Lives.
Planning
![Page 8: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/8.jpg)
Extending Knowledge. Changing Lives.
Production
![Page 9: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/9.jpg)
Extending Knowledge. Changing Lives.
Finished Product
![Page 10: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/10.jpg)
Extending Knowledge. Changing Lives.
Distribution
![Page 11: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/11.jpg)
Extending Knowledge. Changing Lives.
OUR STORIES
![Page 12: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/12.jpg)
Extending Knowledge. Changing Lives.
Farmweek
![Page 13: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/13.jpg)
Extending Knowledge. Changing Lives.
Southern Gardening
![Page 14: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/14.jpg)
Extending Knowledge. Changing Lives.
The Food Factor
![Page 15: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/15.jpg)
Extending Knowledge. Changing Lives.
MediaFarmweek
TV (MPB & RFDTV)Southern Gardening
TV, Radio, & NewspaperThe Food Factor
TV
![Page 16: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/16.jpg)
Extending Knowledge. Changing Lives.
Social Media• All supplemented by social media
efforts Facebook Twitter Pinterest Instagram
![Page 17: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/17.jpg)
Extending Knowledge. Changing Lives.
History: Farmweek
![Page 18: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/18.jpg)
Extending Knowledge. Changing Lives.
History: Southern Gardening
![Page 19: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/19.jpg)
Extending Knowledge. Changing Lives.
History: The Food Factor
![Page 20: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/20.jpg)
Extending Knowledge. Changing Lives.
Production PersonnelFarmweek
Broadcast crewSouthern Gardening
Ext. Specialist and video, radio, social media, & print teams
Food Factor Ext. Agent & print news, social media, &
video team
![Page 21: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/21.jpg)
Extending Knowledge. Changing Lives.
EvaluationFarmweek
Full-scale study by 3rd partySouthern Gardening
Brief evaluationThe Food Factor
None completed (process is beginning now)
![Page 22: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/22.jpg)
Extending Knowledge. Changing Lives.
Lessons Learned So Far• Evaluation can be scary.• Meaningful evaluation is hard! Even
when it’s expensive.• You often have more of an audience
than you expect.• Evaluation can yield important
guidance for improvement—which is what it’s supposed to do!
![Page 23: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/23.jpg)
Extending Knowledge. Changing Lives.
OPTIONS TO CONSIDER
![Page 24: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/24.jpg)
Extending Knowledge. Changing Lives.
FundingIdeal• Ample funding
available to fund evaluation of every communications project
Reality• Public-sector budgets
increasingly scrutinized and crunched
![Page 25: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/25.jpg)
Extending Knowledge. Changing Lives.
The Fix• Grant projects
Outreach component of large grants• Alternative funding lines
Undergraduate Research Scholars Program
• Make the most of each project About $3K for access to nationally
representative sample
![Page 26: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/26.jpg)
Extending Knowledge. Changing Lives.
PersonnelIdeal• Communications team• Evaluators with time to
dedicate to project• Topic Specialists who
communicate clearly
Reality• Communications team• Evaluators stretched
thin• Academics speaking
research-ese
![Page 27: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/27.jpg)
Extending Knowledge. Changing Lives.
The Fix• Outside-the-box evaluators
Education, non-ag comm faculty, etc.• Undergraduate & Graduate
students Thesis, classes, etc.
• Do your own research And have specialists verify the material
• Look for overlapping interests with researchers
![Page 28: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/28.jpg)
Extending Knowledge. Changing Lives.
PrioritiesIdeal• Everyone has the same
goals for the communications and evaluation process
Reality• Everyone’s priorities
are different
![Page 29: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/29.jpg)
Extending Knowledge. Changing Lives.
The Fix• Learn to live with having different
priorities• Personnel
Untenured faculty need projects Students need experience
• Project Showing impact keeps project funded
![Page 30: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/30.jpg)
Extending Knowledge. Changing Lives.
ScopeIdeal• Every Project gets a
full-scale study Representative survey Multiple focus groups Test materials for
knowledge gain, link to Extension brand, etc.
Reality• 3rd party researchers
& faculty members are too expensive to fund enough of their time to study all communications projects
![Page 31: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/31.jpg)
Extending Knowledge. Changing Lives.
The Fix• Undergraduate and graduate
student research projects Easier for them to justify time for the
full evaluation of one specific project• Using an evaluation template
Less time and money per project
![Page 32: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/32.jpg)
Extending Knowledge. Changing Lives.
Sample & PopulationIdeal• Easy access to current
audience• Random Digit Dialing
(or alternative) to reach broader samples
Reality• LOL
![Page 33: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/33.jpg)
Extending Knowledge. Changing Lives.
The Fix• Opt-in options through
communications• Extension events• Earlier recommendations on
funding and collaboration
![Page 34: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/34.jpg)
Extending Knowledge. Changing Lives.
SpeedIdeal• Quick turnaround
Reality• Reaching audience
can take time, especially for Extension programs
• Faculty cannot always move quickly (IRB)
![Page 35: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/35.jpg)
Extending Knowledge. Changing Lives.
The Fix• Plan ahead• Start evaluation process from the
get-go
![Page 36: Evaluation Communication Efforts in Extension](https://reader035.fdocuments.in/reader035/viewer/2022070521/58ef8d651a28ab503f8b45cd/html5/thumbnails/36.jpg)
Extending Knowledge. Changing Lives.
WHAT ARE YOUR STORIES?Discussion