A Simple yet Elegant Expansion Method to Solve Radiative Transport Problems in Finite Media
Can Systems Evaluation Be Simple and Elegant?
16
Evaluating Complexity Presenter: Charles Gasper, TCC Group Can Systems Evaluation be Simple and Elegant? Evaluation 2015: Exemplary Evaluations in a Multicultural World November 13, 2015
-
Upload
tcc-group -
Category
Data & Analytics
-
view
397 -
download
0
Transcript of Can Systems Evaluation Be Simple and Elegant?
Evaluating Complexity
Presenter: Charles Gasper, TCC Group
Can Systems Evaluation be Simple and Elegant?
Evaluation 2015: Exemplary Evaluations in a Multicultural World
November 13, 2015
Evaluation isn’t new to public media
• Episodic
• Large project focused
• Discrete from organizations
However, program theory is new
• Production and count focused
• Assumed impact
• Campaign is a swear word
Challenge – Build framework for evaluation with program theory!
Must:
• Be sustainable
• Support multiple projects
• Allow integration of outcomes & impact across projects
• Include the possibility of partnerships
Make it “simple and elegant”
Media has simple activities
Collection Production Distribution
Media’s effects are also pretty simple
Nine Network of Public Media
Exposure Awareness Understanding Attitudes Activation
At least at the 100,000 foot level Production Workflow
Openings, Transitions,
Graphics
Brand Sunday Arts
Brand Nine Arts Programs
& Activities
On Air Promos (Dependent on
Local Production)
Determine other Arts Orgs We
Need to Partner/Represent Develop/
Leverage Relationships with Arts Orgs
Create Funding Proposals
Arts Production
LSL Best of the Arts (Sun)
New ½ Arts Show
Sunday Arts Block
Connect w/ Arts Institutions re:
Upcoming Events & Stories
LSL (Monday)
Non-Broadcast Activity
Providing Access to Arts Content Online
Other in the Community Elements?
Audience
Scheduling Arts Programming
Scheduling Breaks
Creating Local Arts On-Air
Promos
Other Arts Programming
Editing On-Air Promos for
National Arts Programs
Increased Awareness of Arts Culture in STL
On Air, Online, In Community
Arts Orgs Realize Their Objectives
- Attendance- Recognition- Whatever
New Audiences
Increased Community Understanding of Importance of Arts
- Economy- Culture
St. Louis IDed as a Vibrant Arts
Community in STL & Beyond
Incorporating Arts ID into
Organization Language
Incorporating Arts ID into- Jack's Letter- Donor Letter- Member Letters- Pledge Scripts- Proposals
Strengthened ID as Trusted in STL Arts
Community
Increased Funding
Increased Nine Membership
Legend
Activity
Output
Outcome
Technical Support
Technical Support
Events
Additional Arts Related Content
Increased Nine DonorsIncreased Nine Underwriters/Foundations
Interstitials
Promotion
Promoting Arts Content on Websites
Promoting Arts Content in
Press Release
Promoting Arts Content in Magazine
Promoting Arts Content on Air
Promoting Arts Content in
Social Media
At least at the 100,000 foot level Production Workflow
Openings, Transitions,
Graphics
Brand Sunday Arts
Brand Nine Arts Programs
& Activities
On Air Promos (Dependent on
Local Production)
Determine other Arts Orgs We
Need to Partner/Represent Develop/
Leverage Relationships with Arts Orgs
Create Funding Proposals
Arts Production
LSL Best of the Arts (Sun)
New ½ Arts Show
Sunday Arts Block
Connect w/ Arts Institutions re:
Upcoming Events & Stories
LSL (Monday)
Non-Broadcast Activity
Providing Access to Arts Content Online
Other in the Community Elements?
Audience
Scheduling Arts Programming
Scheduling Breaks
Creating Local Arts On-Air
Promos
Other Arts Programming
Editing On-Air Promos for
National Arts Programs
Increased Awareness of Arts Culture in STL
On Air, Online, In Community
Arts Orgs Realize Their Objectives
- Attendance- Recognition- Whatever
New Audiences
Increased Community Understanding of Importance of Arts
- Economy- Culture
St. Louis IDed as a Vibrant Arts
Community in STL & Beyond
Incorporating Arts ID into
Organization Language
Incorporating Arts ID into- Jack's Letter- Donor Letter- Member Letters- Pledge Scripts- Proposals
Strengthened ID as Trusted in STL Arts
Community
Increased Funding
Increased Nine Membership
Legend
Activity
Output
Outcome
Technical Support
Technical Support
Events
Additional Arts Related Content
Increased Nine DonorsIncreased Nine Underwriters/Foundations
Interstitials
Promotion
Promoting Arts Content on Websites
Promoting Arts Content in
Press Release
Promoting Arts Content in Magazine
Promoting Arts Content on Air
Promoting Arts Content in
Social Media
Or is it really that complex?
Let’s add community!
Let’s add community!
Allign Public Media Organizations
Assess Public Media
Organizations
ID Organizations to Participate
Community Conversations
- Issues and Solutions
Common Agenda- Goals- Objectives- Outcomes
Alignment of Activities- Hub Market Stations- Local Partners
Shared Measurement
System Awareness
Station & Partner Dissemination of
Content
Content/Program Production
Understanding Public Media & Partner Driven
Action
Increased Dialogue in the
Community
Local Partner Activity
Improved Youth Outcomes
System Design, Goal Setting & Early ActivitiesImplementation of Mutually
Reinforcing ActivitiesOutcomes
Formative Evaluation
Organizational Assessment
Document & Support DevelopmentDevelop &
Implement SystemProcess Evaluation Capture & Assess Outcomes & Impact
Impact
New Projects
New Local Partners & Funders
Local Network Strengthened
Multi-Year Funding
Local FundraisingNew Prospect
Advising
Shared Content
Legend
Outcome
Activity
Output
National MarketingMarketing Capacity
Assessment
Create Brand Messaging, Communication Strategy &
Marketing Resource Website
Visibility & Effectiveness Assessment
Local MarketingAdvise as to how to Heighten Visibility of
the Initiative
Position Development
Create & Maintain an Initiative Website & Web Guidelines for Stations
National Content
Content Goal Setting
Content Managemnt System
Local ContentEstablish Editorial
Framework
Assess Stations' Content Creation &
Dissemination Capacity
Content Scheduling
Assess Local/National Content
Connectivity
Assess National Programming Possibilities
Nine Network of Public Media
American Graduate: Let’s Make It Happen Project Design
December 11, 2013
Shared Reinforcing Content
Assess Stations' Fundraising
Capacity
Use of Content by Teachers & Parents
Increased Youth Engagement in the Classroom
Finding what’s critical!
Improved Community Perception
Improved Partner Perception
Improved Partner
Collaboration
Organizational Learning • Changes in how work is done • Changes in capacity to do the work
Our Work Increased
Awareness / Understanding
Discussion American Graduate
Champions
Increased Volunteerism &
Donations
Things Get Better for
Young People
Impact on program managers
• Clarity
• Focus
Challenges
• Fear
• Measurement fatigue
• Organizational culture
Lessons learned
• Find clarity
• Overcome your fear
• Pick the ripe apples
• Refresh and revise
