M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene...
Transcript of M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene...
![Page 1: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/1.jpg)
www.chfinternational.org
M&E Tool for NGO Capacity Building
NGO Capacity Building Workshop
September 2010
Presented
by
Carlene Baugh
![Page 2: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/2.jpg)
www.chfinternational.org
• Gain awareness of:
– Framework for achieving program effects
– A tool for tracking capacity building
• Identify:
– How the tool can be applied in your NGO
capacity building program (s)
At the end of the session participants will
![Page 3: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/3.jpg)
www.chfinternational.org
Let’s look at some
FRAMEWORKS!
![Page 4: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/4.jpg)
www.chfinternational.org
Causal Chain
Inputs Activities Outputs Outcomes Impacts
![Page 5: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/5.jpg)
www.chfinternational.org
Capacity Development
Individual
•Development Professionals
•Civil Society Leaders
•Youth
•Change Agents
Organization
• Community Based Organizations
• Non-Governmental Organizations
• Government departments
• Social enterprises
• Businesses
System
• Communities
• National Health systems
• National level civil society
• Governmental Coordination Systems
Eco-System
• Societies
• The full gamut of individuals, organizations, networks and systems
• Cross-functional
• Cross sectoral
• Cross-hierarchical
![Page 6: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/6.jpg)
www.chfinternational.orgSpringfield Centre |
Making markets work
SUPPORTING
FUNCTIONS
RULES
LawsStandards
Information
Informing &
communicating
Setting &
enforcing rules
Business
membership
organisations
Government
Private sector
Not-for-profit sector
Informal
networks
MARKET PLAYERS
Demand SupplyCORE
Enabling Environment
![Page 7: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/7.jpg)
www.chfinternational.org
Traditional Program characteristics:
Judge success or failure
Measure against fixed goals
External for objectivity
Linear cause/effect models
Accountability to external
Accountability for control, blame
Engender fear of failure
Developmental\Systemic
approach
Provide feedback for improvement
New measures as goals evolve
Internal, integrated, interpretive
Seek to capture system dynamics
Accountability to values, commitments
Understand & respond strategically
Feed hunger for learning
Adapted from: Patton, Michael Q., 2006, “Evaluation for the Way We Work”,
The Nonprofit Quarterly, Spring.
![Page 8: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/8.jpg)
www.chfinternational.org
Key messages
![Page 9: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/9.jpg)
www.chfinternational.org
• See yourself as a
part of a
interconnected
web of
relationships and
systems
Look at the bigger picture
Key Messages or themes
![Page 10: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/10.jpg)
www.chfinternational.org
Recognizing that change is…
• Continuous
• Complex
• Non-linear
• Multi-directional
• Not controllable
Key Messages or themes
![Page 11: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/11.jpg)
www.chfinternational.org
Keeping your eyes wide open
• Being attentive
along the journey
is as important as
the destination
Key Messages or themes
![Page 12: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/12.jpg)
www.chfinternational.org
Contribution not attribution
• your influence on a
better world
• you can influence
but not control
change in your
partners
Key Messages or themes
![Page 13: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/13.jpg)
www.chfinternational.org
What is Outcome Mapping
• An M&E tool developed by IDRC
• Shift from assessing the products of a
program TO:
Behavior change: relationships, or
actions of the people, groups, and
organizations with whom a program works
directly and those within its sphere of
influence.
![Page 14: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/14.jpg)
www.chfinternational.org
What is Outcome Mapping
• Assesses the contributions of
development programs make to the
achievement of outcomes
• Learning-based and use-driven guided by
principles of participation and iterative
learning throughout the program life-cycle
• Program, project or organizational levels
![Page 15: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/15.jpg)
www.chfinternational.org
What is Outcome Mapping
• Focuses on monitoring and evaluating its
results in terms of the influence of the
program on the roles these partners play
in development
![Page 16: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/16.jpg)
www.chfinternational.org
Outcome Mapping
Defines the program’s outcomes as changes in
behaviors of direct partners
Focuses on how programs facilitate
change rather that how they caused change
Recognizes the complexity of
development processes together with the
contexts in which they occur
Boundary Partners
Individuals, groups or organizations with whom
the program interacts directly to effect change
![Page 17: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/17.jpg)
www.chfinternational.org
3 Stages
![Page 18: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/18.jpg)
www.chfinternational.org
Focus on direct partners• Key concept is
« boundary partners »
• The individuals, groups,
and organizations you
work with directly and
anticipate opportunities
for influence
![Page 19: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/19.jpg)
www.chfinternational.org
Examples
• Local communities (NGOs, indigenous
groups, churches, community leaders)
• Government officials and policymakers
(department, regional administration)
• Private sector (tourism, fisheries, non-
timber forest products, logging and wood
processing companies)
![Page 20: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/20.jpg)
www.chfinternational.org
Example
• Outcome Challenge: The program
intends to see local communities that
recognize the importance of, and are
engaged in, the planning of resource
management activities in partnership with
other resource users in their region
![Page 21: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/21.jpg)
www.chfinternational.org
progress markers =
ladder of change
Love to see
Like to see
Expect to see
![Page 22: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/22.jpg)
www.chfinternational.org
Progress markers
✓ A graduated set of statements describing a
progression of changed behaviors in the
boundary partner
✓ Describe changes in actions, activities and
relationships leading to the ideal outcome
✓ Shows story of change by articulating the
complexity of the change process
✓ Can be monitored & observed
✓ Permit on-going assessment of partner’s
progress (including unintended results)
![Page 23: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/23.jpg)
www.chfinternational.org
Performance M&E
• Monitoring 3 elements
– Changes in behaviors, actions, relationships,
groups (outcome journal)
– Strategies to encourage change in its
partners (strategy journal)
– Functioning of a program as an
organizational unit (performance journal)
Each of these monitoring tools builds on elements from the Intentional
Design stage, so the group should feel relatively comfortable with them.
![Page 24: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/24.jpg)
www.chfinternational.org
Performance Journal mtg
– What are we doing well and what should we
continue doing?
– What are we doing “okay” and what can we
improve?
– What do we need to add to better address the
organizational practices?
– What activities do we need to modify
– Who is responsible? What are the time lines?
– Has any issue come up that we need to
evaluate in greater depth? What? When?
Why? How?
![Page 25: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/25.jpg)
www.chfinternational.org
Outcome journal
To understand the change process in boundary
partners. Collects information about:
• Story of change and reasons for change
• Unexpected changes
• The actors and factors that contributed to that
change
• How we know the change occurred
• Learnings (what? how? why?)
![Page 26: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/26.jpg)
www.chfinternational.org
References
• Building learning and reflection into
development programs (Sarah Earle, Fred
Carden & Terry Smutylo, 2001)
• Outcome Mapping Learning Community
http://www.outcomemapping.ca/
![Page 27: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool](https://reader035.fdocuments.in/reader035/viewer/2022071302/60a97e6453188c4dc60ba98c/html5/thumbnails/27.jpg)
www.chfinternational.org
Feedback & Questions