Determining & Demonstrating Value with the Logic Model
Adapted from a Presentation by
Mohamed Hosseini-Ara of City of Markham
Rebecca Jones of Dysart & Jones
The Framework
Understand the Context
Align Strategies & Objectives
Identify Services & Programs
Define Measures
Manage Measurement
Data
Translate Data Into Outcomes
& Impacts
Communicate the Results
Determining & Demonstrating Value With the Logic Model - Paul Burry
4
Understand the Context
How is value defined, measured & communicated?
Know your stakeholders—who are they?
How do they measure their progress?
Determining & Demonstrating Value With the Logic Model - Paul Burry
5
Stakeholders
Identifying and illustrating value requires relationships/conversations with stakeholders
Determining & Demonstrating Value With the Logic Model - Paul Burry
6
Clear Identity & Pride, Supportive/Engaged Community, Equity & Inclusion, Cultural Richness
Determining & Demonstrating Value With the Logic Model - Paul Burry
14
Clear Identity & Pride, Supportive/Engaged Community, Equity & Inclusion, Cultural Richness
Enhance Community Well-Being & Engagement, Create Welcoming Physical & Virtual Spaces
Determining & Demonstrating Value With the Logic Model - Paul Burry
15
Clear Identity & Pride, Supportive/Engaged Community, Equity & Inclusion, Cultural Richness
Enhance Community Well-Being & Engagement, Create Welcoming Physical & Virtual Spaces
Local History Collections & Speaker Series, Teen Queer/Straight Alliance Program, Locally Sourced Food/Farming Programs, Accessibility Initiatives
Determining & Demonstrating Value With the Logic Model - Paul Burry
16
Defining Measures
What Measures Do We Currently Use?
Operations Customer Satisfaction
Value or Impact
Determining & Demonstrating Value With the Logic Model - Paul Burry
17
Defining Measures
What Measures Do We Currently Use?
Operations Customer Satisfaction
Value or Impact
CirculationOpen HoursPeople CountProgram AttendanceInternet UseReference Queries
Determining & Demonstrating Value With the Logic Model - Paul Burry
18
Defining Measures
What Measures Do We Currently Use?
Operations Customer Satisfaction
Value or Impact
Circulation Focus GroupsOpen Hours SurveysPeople Count Program
EvaluationsProgram AttendanceInternet UseReference Queries
Determining & Demonstrating Value With the Logic Model - Paul Burry
19
Defining Measures
What Measures Do We Currently Use?
Operations Customer Satisfaction
Value or Impact
Circulation Focus Groups ?Open Hours Surveys ?People Count Program
EvaluationsProgram AttendanceInternet UseReference Queries
Determining & Demonstrating Value With the Logic Model - Paul Burry
20
Meaningful Measures…
Matter to you AND your stakeholders
Are conveyed in stakeholders’ language
Focus attention on what is most important for the organization
Are critical for managing, planning, & decision-making
Are organization-dependent
Determining & Demonstrating Value With the Logic Model - Paul Burry
21
Problems with Conventional Approaches to Measurement
Not a “culture of assessment”
Many measures convey only past performance
Often measures don’t align with stakeholder goals and concerns
Measuring impact/value can be complex
What does success look like?
Determining & Demonstrating Value With the Logic Model - Paul Burry
22
Measuring Impact/Value
You’re measuring a change in the human condition:
Behaviour Awareness
Skill Motivation
Knowledge Condition
Attitude Status
Circumstance
Determining & Demonstrating Value With the Logic Model - Paul Burry
23
The Logic Model
Goes beyond documenting what you did, and measures what difference you made in the life of your target audience. How have they changed?
Determining & Demonstrating Value With the Logic Model - Paul Burry
24
The Logic Model
InputResource
Perspective
OutputOperational Perspective
OutcomeUser
Perspective
ImpactStakeholder Perspective
Determining & Demonstrating Value With the Logic Model - Paul Burry
25
The Logic Model
InputResource
Perspective
OutputOperational Perspective
OutcomeUser
Perspective
ImpactStakeholder Perspective
• Equipment• Space• Supplies• Funding• Staff
Determining & Demonstrating Value With the Logic Model - Paul Burry
26
The Logic Model
InputResource
Perspective
OutputOperational Perspective
OutcomeUser
Perspective
ImpactStakeholder Perspective
• Training Module
• Program• Report• # of Programs• # of Attendees
Determining & Demonstrating Value With the Logic Model - Paul Burry
27
The Logic Model
InputResource
Perspective
OutputOperational Perspective
OutcomeUser
Perspective
ImpactStakeholder Perspective
• Increased Skill• Increased Knowledge• Change in Status• Change in Behaviour
or Attitude• Satisfaction level
Determining & Demonstrating Value With the Logic Model - Paul Burry
28
The Logic Model
InputResource
Perspective
OutputOperational Perspective
OutcomeUser
Perspective
ImpactStakeholder Perspective
• Long-term Effects
• Lower Dropout Rate
• Increased Literacy Level
• Increased Recovery Rate
Determining & Demonstrating Value With the Logic Model - Paul Burry
29
If we do this
InputResource
Perspective
OutputOperational Perspective
OutcomeUser
Perspective
ImpactStakeholder Perspective
The Logic Model
Determining & Demonstrating Value With the Logic Model - Paul Burry
30
If we do this This should happen
InputResource
Perspective
OutputOperational Perspective
OutcomeUser
Perspective
ImpactStakeholder Perspective
The Logic Model
Determining & Demonstrating Value With the Logic Model - Paul Burry
31
STEM Program for GirlsInput(resources)
Output(operations)
Outcome(user)
Impact(stakeholder)
Determining & Demonstrating Value With the Logic Model - Paul Burry
33
STEM Program for GirlsInput(resources)
Output(operations)
Outcome(user)
Impact(stakeholder)
• Girls ages 10-12 are interested in pursuing STEM careers (short-term)
• Girls take math, science, computer courses in high school and pursue STEM university degrees (mid-term)
• Girls pursue careers in STEM and become scientists programmers, doctors (long-term)
Determining & Demonstrating Value With the Logic Model - Paul Burry
34
STEM Program for GirlsInput(resources)
Output(operations)
Outcome(user)
• Girls ages 10-12 increase understanding of STEM careers• Increased interest in STEM course options• Positive response to questionnaire regarding
appropriate careers for girls (engineers, scientists)Impact(stakeholder)
• Girls ages 10-12 are interested in pursuing STEM careers (short-term)
• Girls take math, science, computer courses in high school and pursue STEM university degrees (mid-term)
• Girls pursue careers in STEM and become scientists programmers, doctors (long-term)
Determining & Demonstrating Value With the Logic Model - Paul Burry
35
STEM Program for GirlsInput(resources)
Output(operations)
• 6 week program offered twice per year• 25 girls ages 10-12 complete each session• Pre and Post session questionnaires (permission to follow
up in 3 years)Outcome(user)
• Girls ages 10-12 increase understanding of STEM careers• Increased interest in STEM course options• Positive response to questionnaire regarding
appropriate careers for girls (engineers, scientists)Impact(stakeholder)
• Girls ages 10-12 are interested in pursuing STEM careers (short-term)
• Girls take math, science, computer courses in high school and pursue STEM university degrees (mid-term)
• Girls pursue careers in STEM and become scientists programmers, doctors (long-term)
Determining & Demonstrating Value With the Logic Model - Paul Burry
36
STEM Program for GirlsInput(resources)
• Staffing; program design; marketing materials, facilities, equipment, speakers (6 female STEM professionals)
• $1,500 to pay for honorariums and supplies
Output(operations)
• 6 week program offered twice per year• 25 girls ages 10-12 complete each session• Pre and Post session questionnaires (permission to follow
up in 3 years)Outcome(user)
• Girls ages 10-12 increase understanding of STEM careers• Increased interest in STEM course options• Positive response to questionnaire regarding
appropriate careers for girls (engineers, scientists)Impact(stakeholder)
• Girls ages 10-12 are interested in pursuing STEM careers (short-term)
• Girls take math, science, computer courses in high school and pursue STEM university degrees (mid-term)
• Girls pursue careers in STEM and become scientists programmers, doctors (long-term)
Determining & Demonstrating Value With the Logic Model - Paul Burry
37
The Framework
Understand the Context
Align Strategies & Objectives
Identify Services & Programs
Define Measures
Manage Measurement
Data
Translate Data Into Outcomes
& Impacts
Communicate the Results
Determining & Demonstrating Value With the Logic Model - Paul Burry
38
The Framework
Understand the Context
Align Strategies & Objectives
Identify Services & Programs
Define Measures
Manage Measurement
Data
Translate Data Into Outcomes
& Impacts
Communicate the Results
Determining & Demonstrating Value With the Logic Model - Paul Burry
39
Manage Measurement Data
Plan/schedule data Collection
Who is responsible? What other work areas need to be involved?
Are you currently collecting data that is no longer relevant?
How long do you need to keep your data?
Determining & Demonstrating Value With the Logic Model - Paul Burry
40
Translate Data into Outcomes & Impacts
Define Success: what will it look like? How willyou get there?
Remember: You’re measuring social impact, not library performance/success
Be aware of possible confounding variables
Impact can be inferred, even when your data/measurement isn’t perfect
Determining & Demonstrating Value With the Logic Model - Paul Burry
41
Translate Data into Outcomes & Impacts
What does the data say? What does it not say?
No one organization is going to solve any major social issue: partner with other community organizations
Nobody said it would be easy!
Totally killing it!
Determining & Demonstrating Value With the Logic Model - Paul Burry
42
Communicate the Results
Begins at the “Understand the Context” stage
Dear stakeholder: we contribute X toward your goals
You DID build that!
Determining & Demonstrating Value With the Logic Model - Paul Burry
43
Thank You!
Paul Burry: [email protected]
More at:http://www.metricsandlibraries.org/program.html
Determining & Demonstrating Value With the Logic Model - Paul Burry
45
Top Related