Measuring for Success
description
Transcript of Measuring for Success
Measuring for SuccessNCHER Legislative Conference
Sophie WalkerSeptember 26, 2013
NCHER | September 26, 2013© 2013 Mission Measurement, LLC
2
Mission Measurement helps nonprofits, foundations, and corporations measure and improve their social impact
NCHER | September 26, 2013© 2013 Mission Measurement, LLC
3
The evolution of the social capital market has changed the donor landscape
Programs valued more than results
Relationship-driven fundraising
The market values social change
Donors act like consumers and want to purchase results
Yesterday: Independent Sector Today: Social Capital Market
NCHER | September 26, 2013© 2013 Mission Measurement, LLC
4
Nonprofits need data that shows how they create value in one of three ways
Can produce certain outcomes that others can’t
MOST EFFECTIVE
MOST EFFICIENT
MOST INNOVATIVE
Can produce the same outcomes as others but at
a lower cost
Have the potential to produce breakthrough results but untested
NCHER | September 26, 2013© 2013 Mission Measurement, LLC
5
There are a continuum of approaches to measure social impact
Science5 Year Impact Study
HopeWe know we have impact,
no need to measure
Outcome MeasurementMeasure your near-term outcomes
NCHER | September 26, 2013© 2013 Mission Measurement, LLC
6
Define Success
What are we really trying to accomplish?
Measure Results
How do we measure what we do?
Drive StrategyHow do we use data to inform decisions?
• Identify Priority Outcomes
• Define Performance Metrics
• Design Measurement Process
• Implement Data Collection
• Report and Analyze Results
• Inform Strategic DecisionsAlign
Strategies
Mission Measurement approaches measurement in three inter-related stages
NCHER | September 26, 2013© 2013 Mission Measurement, LLC
7
Identifying high-value outcomes is the first step to effective measurement
Leve
l of I
mpa
ct
Time
Activities
Outcomes
ImpactWe measure long-term change only if it is possible, practical and informative to do so
Outcomes are the focus of our measurement. They tell our impact story, let us know if we’re on track, and help us make timely improvements
We track activities (as required) to show accountability and track execution
NCHER | September 26, 2013© 2013 Mission Measurement, LLC
8
Measuring outcomes is much higher value than measuring activities
ActivitiesThings we do
OutcomesResults or changes we produce
Conduct training
Provide mentoring
Gain press coverage
Measuring activities asks, “how many?”
Increase skills
Improve leadership
Improve perception
Measuring outcomes asks, “how well?”
NCHER | September 26, 2013© 2013 Mission Measurement, LLC
9
Change in Chicago unemployment rate
% of participants placed in jobs
Job retention after 1 year
Job retention after 90 days*
Develop strong metrics that are credible, feasible, and valuable
Total number of organizations
contacted
# of activated or highly-engaged
partners
Weak Strong
Credible
Feasible
Valuable
*Research shows that 90-day job retention leads to longer-term retention.
NCHER | September 26, 2013© 2013 Mission Measurement, LLC
10
A + B + C = D
ImpactWhat are we ultimately trying to accomplish?
Priority OutcomesWhat changes in behavior, condition, or status are required?
Performance Measures
How do we measure progress toward our
outcomes?
Key StrategiesWhich programs will
drive results?
To begin, build a Success Equation
NCHER | September 26, 2013© 2013 Mission Measurement, LLC
11
USA Funds evolved to having a laser focus on results
USA Funds faced new pressures as a nonprofit organization:• Changing and evolving role of funders• Shift towards an investment orientation in philanthropy• Increased demand for results• Opportunities for sustainable value creation or shared value creation
USA Funds wanted to use measurement to:• Determine if investments made were worthwhile• Illustrate good stewardship of resources• Build credibility with stakeholders• Maximize actions to reach strategic goals• Demonstrate contribution to social good
NCHER | September 26, 2013© 2013 Mission Measurement, LLC
12
Outcomes Outcomes Outcomes
Outcome Statement Outcome Statement Outcome Statement
Outcome Statement Outcome Statement Outcome Statement
Outcome Statement Outcome Statement Outcome Statement
Postsecondary Readiness and Enrollment
Postsecondary Persistence and Success
Utilization of Best Practices at Participating Institutions
USA Funds and Mission Measurement created an Impact Framework based on high-value outcomes
Corporate Impact: Increase economic and social opportunity for disadvantaged students through enhancing attainment of post-secondary education goals
Products, Services, & Grants
Sho
rter
term
Lo
nger
ter
m
NCHER | September 26, 2013© 2013 Mission Measurement, LLC
13
USA Funds and Mission Measurement developed a deliberate, thoughtful approach to implementation
Overcoming Internal Challenges• Using new terminology• Managing multiple data sources• Non-existent data collection tools• Lack of automation
Moving from Concept to Practice• Identify useful data sources and metrics• Create data collection tools• Use a consistent set of evaluation terms• Develop a process and regular schedule for data collection and reporting• Involve product/program managers throughout the process to create buy-in• De-mystify evaluation (i.e. internal training sessions for staff)• Allow a role for both external and internal evaluation• Regular progress monitoring
NCHER | September 26, 2013© 2013 Mission Measurement, LLC
14
USA Funds learned some key lessons in how to make measurement “stick”
• Management commitment• Employees have ownership in a process they helped develop• Yield better and more useful information• Bringing in outside firm to accelerate process
NCHER | September 26, 2013© 2013 Mission Measurement, LLC
15
Measurement is not a one-time event, but a dynamic learning process
Develop & refine USA
Funds’ investment
strategy
Makeinvestment
Monitor progress
Assess and communicate
results
Integrate learning
NCHER | September 26, 2013© 2013 Mission Measurement, LLC
16
Thank you!
Sophie WalkerEngagement [email protected]
www.missionmeasurement.com@MissionMeasure