Choosing the Correct Evaluation Approach for your Project€¦ · Table 1. Characteristics of...
3
Participatory Approach Process of inquiry, learning, critical analysis, community building and social change using a collaborative approach that values the contribution of everyone involved. Outcome Mapping Plan, monitor and evaluate activities that bring about behavioural change in society Is the Outcome Predictable? Traditional Evaluation Developmental Evaluation WHY? Step 1 Vision HOW? Step 2 Mission WHO? Step 3 Partners WHAT? Step 4 Outcomes Intentional Design YES NO Outcome & Performance Monitoring Developmental Evaluation is an ongoing process, which supports learning and development for complex and constantly changing issues. It involves continuous adaptation based on timely feedback. The DE evaluator builds relationships, provides leadership and strategic thinking. Traditional approaches to evaluation have a “sequence of steps that are required to assess the situation, gather and analyze data, formulate a solution and then implement the solution” [1]. It works well when the situation is simple, clearly defined, with definite boundaries [1]. Characteristics of Complexity ?[1] [2] • High uncertainty – Difficult to predict outcomes • Cause/ Effect are difficult to track – The main causes are not clearly defined • Social Complexity H Involves collaboration among multiple stakeholders • Context dependent H Varies from person to person and community to community • Dynamic H Constantly evolving and rapidly changing • Emergent H No obvious measures of success and constantly changing environment • Non linear H Small actions can have large and multiple reactions • Innovative H RealHtime learning and development Choosing the Correct Evaluation Approach for your Project
Transcript of Choosing the Correct Evaluation Approach for your Project€¦ · Table 1. Characteristics of...
![Page 1: Choosing the Correct Evaluation Approach for your Project€¦ · Table 1. Characteristics of Traditional Evaluation Compared to Developmental [3] Developmental Evaluation Entry Points](https://reader033.fdocuments.in/reader033/viewer/2022050607/5faebe20c358fb4749577210/html5/thumbnails/1.jpg)
Participatory Approach
Process!of!inquiry,!learning,!critical!analysis,!community!building!and!
social!change!using!a!collaborative!approach!that!values!the!
contribution!of!everyone!involved.!
!
Outcome Mapping
Plan,!monitor!and!evaluate!activities!that!bring!
about!behavioural!change!in!society!!
Is the Outcome Predictable?
Traditional Evaluation Developmental Evaluation
WHY? !!!Step%1%Vision!HOW? !!Step%2%Mission!WHO? !!Step%3%Partners!
WHAT? !!Step%4%Outcomes!
Inte
ntio
nal D
esig
n
YES NO
Out
com
e &
Perf
orm
ance
M
onit
orin
g
Developmental!Evaluation!is!an!ongoing!
process,!which!supports!learning!and!
development!for!complex!and!constantly!
changing!issues.!!It!involves!continuous!
adaptation!based!on!timely!feedback.!!
The!DE!evaluator!builds!relationships,!
provides!leadership!and!strategic!
thinking.%
Traditional!approaches!to!evaluation!
have!a!“sequence!of!steps!that!are!
required!to!assess!the!situation,!
gather!and!analyze!data,!formulate!a!
solution!and!then!implement!the!
solution”![1].!It!works!well!when!the!
situation!is!simple,!clearly!defined,!
with!definite!boundaries![1].!!
Characteristics of Complexity ?[1]%[2]!!!
• High%uncertainty!–!Difficult!to!predict!outcomes!• Cause/%Effect%are%difficult%to%track!–!The!main!causes!are!not!clearly!defined!• Social%Complexity!H!Involves!collaboration!among!multiple!stakeholders!!• Context%dependent!H!Varies!from!person!to!person!and!community!to!community!• Dynamic!H!Constantly!evolving!and!rapidly!changing!• Emergent!H!No!obvious!measures!of!success!and!constantly!changing!environment!!• Non%linear%H!Small!actions!can!have!large!and!multiple!reactions!!• Innovative!H!RealHtime!learning!and!development!!!
!
Choosing the Correct Evaluation Approach for your Project
![Page 2: Choosing the Correct Evaluation Approach for your Project€¦ · Table 1. Characteristics of Traditional Evaluation Compared to Developmental [3] Developmental Evaluation Entry Points](https://reader033.fdocuments.in/reader033/viewer/2022050607/5faebe20c358fb4749577210/html5/thumbnails/2.jpg)
Table 1. Characteristics of Traditional Evaluation Compared to Developmental [3]
Developmental Evaluation Entry Points [4]!
For More Information:
Developmental!Evaluation!Literature!Review!!
Developmental!Evaluation!One!Pager!National!Collaborating!Centre!for!Determinants!of!Health!!
Orientation – Includes!steps!such!as:!direction,%principles,%system%features%and%%boundaries%and%strategies%and%progress%markers.!!Orientation!covers!the!same!elements!as!Intentional%Design!in!the!Outcome%Mapping!framework
Relationship Building – Role!of!the!developmental!evaluator!is!to!build!a!relationship!with!the!stakeholders!to!influence!change!and!to!form!a!strong!foundation!
for!the!work
Development of a Learning Framework – Highlight!key!challenges,!opportunities,!areas!for!learning!and!identify!feedback!mechanisms
Sense – Making – Data%is%collected,%analyzed,%synthezed%and%reported%in%a%quick%manner.%Evaluator!works!with!the!stakeholder!to!identify!patterns!in!the!data!and!facilitate!ongoing!learning!%
Traditional Evaluation Developmental Evaluation
Success!and!failure!can!be!measured!
There!is!no!success!or!failure!but!evaluation!
generates!feedback!and!learning!which!can!
support!the!direction!of!the!change!
Results!can!be!compared!to!anticipated!
outcomes!
New!monitoring!is!developed!as!goals!
change.!Outcomes!are!not!predictable.!
Evaluation!design!is!based!on!a!cause!and!
effect!model.!With!a!series!of!steps!to!
follow.!Ie!if!X!is!changed!Y!will!happen!
Design!the!evaluation!to!capture:!learning!
from!feedback!loops,!developing!
interconnections!and!relationships!
Findings!can!be!generalized!across!time!and!
applicable!to!different!areas!
Learnings!are!specific!to!the!project!and!can!
influence!ongoing!innovation!
Example:!Following!a!recipe.!Recipes!are!
tested!to!produce!the!same!results!over!
time.!Follow!a!set!of!instructions!to!get!a!
predetermined!outcome.!
Example:!Environmental!Initiatives.!
Competing!stakeholders!are!involved!with!
different!interests!and!the!stakes!are!high.!
!
![Page 3: Choosing the Correct Evaluation Approach for your Project€¦ · Table 1. Characteristics of Traditional Evaluation Compared to Developmental [3] Developmental Evaluation Entry Points](https://reader033.fdocuments.in/reader033/viewer/2022050607/5faebe20c358fb4749577210/html5/thumbnails/3.jpg)
References 1. Gamble,!J.!A.!A.!(2008).!A!developmental!evaluation!primer.!Montreal:!JW!McConnell!Foundation.! Retrieved!from!http://www.mcconnellfoundation.ca/assets/Media%20Library/Publications/A%20De
velopmental%20Evaluation%20Primer%20H%20EN.pdf!
!
2.!!Patton,!M.!Q.!(2011).!Developmental!Evaluation:!Applying!Complexity!Concepts!to!
Enhance!Innovation!and!Use!(1st!ed.).!The!Guilford! Press!
!
3.!!Evaluation!and!the!Effectivenss!of!Social!Innovation! –!A!call!for!the!Long!View!
(2011)!Retrieved!from!(http://theacaciagroup.ca/ideas/?p=39)!
!
4.!!Dozois,!E.,!BlanchetHCohen,!N.,!Langlois,!M.,!Foundation,!J.!M.!F.,!Rights,!U.!O.!V.!(.!I.!I.!F.!
C.,!&!Development.!(2010).!DE!201:!A!Practitioner's!Guide!to!Developmental!Evaluation.!
International!Institute!for!Child!Rights!and!Development,!University!of!Victoria!
!
!
!
!
!
