Download - Choosing the Correct Evaluation Approach for your Project€¦ · Table 1. Characteristics of Traditional Evaluation Compared to Developmental [3] Developmental Evaluation Entry Points

Transcript
Page 1: Choosing the Correct Evaluation Approach for your Project€¦ · Table 1. Characteristics of Traditional Evaluation Compared to Developmental [3] Developmental Evaluation Entry Points

Participatory Approach

Process!of!inquiry,!learning,!critical!analysis,!community!building!and!

social!change!using!a!collaborative!approach!that!values!the!

contribution!of!everyone!involved.!

!

Outcome Mapping

Plan,!monitor!and!evaluate!activities!that!bring!

about!behavioural!change!in!society!!

Is the Outcome Predictable?

Traditional Evaluation Developmental Evaluation

WHY? !!!Step%1%Vision!HOW? !!Step%2%Mission!WHO? !!Step%3%Partners!

WHAT? !!Step%4%Outcomes!

Inte

ntio

nal D

esig

n

YES NO

Out

com

e &

Perf

orm

ance

M

onit

orin

g

Developmental!Evaluation!is!an!ongoing!

process,!which!supports!learning!and!

development!for!complex!and!constantly!

changing!issues.!!It!involves!continuous!

adaptation!based!on!timely!feedback.!!

The!DE!evaluator!builds!relationships,!

provides!leadership!and!strategic!

thinking.%

Traditional!approaches!to!evaluation!

have!a!“sequence!of!steps!that!are!

required!to!assess!the!situation,!

gather!and!analyze!data,!formulate!a!

solution!and!then!implement!the!

solution”![1].!It!works!well!when!the!

situation!is!simple,!clearly!defined,!

with!definite!boundaries![1].!!

Characteristics of Complexity ?[1]%[2]!!!

• High%uncertainty!–!Difficult!to!predict!outcomes!• Cause/%Effect%are%difficult%to%track!–!The!main!causes!are!not!clearly!defined!• Social%Complexity!H!Involves!collaboration!among!multiple!stakeholders!!• Context%dependent!H!Varies!from!person!to!person!and!community!to!community!• Dynamic!H!Constantly!evolving!and!rapidly!changing!• Emergent!H!No!obvious!measures!of!success!and!constantly!changing!environment!!• Non%linear%H!Small!actions!can!have!large!and!multiple!reactions!!• Innovative!H!RealHtime!learning!and!development!!!

!

Choosing the Correct Evaluation Approach for your Project

Page 2: Choosing the Correct Evaluation Approach for your Project€¦ · Table 1. Characteristics of Traditional Evaluation Compared to Developmental [3] Developmental Evaluation Entry Points

Table 1. Characteristics of Traditional Evaluation Compared to Developmental [3]

Developmental Evaluation Entry Points [4]!

For More Information:

Developmental!Evaluation!Literature!Review!!

Developmental!Evaluation!One!Pager!National!Collaborating!Centre!for!Determinants!of!Health!!

Orientation – Includes!steps!such!as:!direction,%principles,%system%features%and%%boundaries%and%strategies%and%progress%markers.!!Orientation!covers!the!same!elements!as!Intentional%Design!in!the!Outcome%Mapping!framework

Relationship Building – Role!of!the!developmental!evaluator!is!to!build!a!relationship!with!the!stakeholders!to!influence!change!and!to!form!a!strong!foundation!

for!the!work

Development of a Learning Framework – Highlight!key!challenges,!opportunities,!areas!for!learning!and!identify!feedback!mechanisms

Sense – Making – Data%is%collected,%analyzed,%synthezed%and%reported%in%a%quick%manner.%Evaluator!works!with!the!stakeholder!to!identify!patterns!in!the!data!and!facilitate!ongoing!learning!%

Traditional Evaluation Developmental Evaluation

Success!and!failure!can!be!measured!

There!is!no!success!or!failure!but!evaluation!

generates!feedback!and!learning!which!can!

support!the!direction!of!the!change!

Results!can!be!compared!to!anticipated!

outcomes!

New!monitoring!is!developed!as!goals!

change.!Outcomes!are!not!predictable.!

Evaluation!design!is!based!on!a!cause!and!

effect!model.!With!a!series!of!steps!to!

follow.!Ie!if!X!is!changed!Y!will!happen!

Design!the!evaluation!to!capture:!learning!

from!feedback!loops,!developing!

interconnections!and!relationships!

Findings!can!be!generalized!across!time!and!

applicable!to!different!areas!

Learnings!are!specific!to!the!project!and!can!

influence!ongoing!innovation!

Example:!Following!a!recipe.!Recipes!are!

tested!to!produce!the!same!results!over!

time.!Follow!a!set!of!instructions!to!get!a!

predetermined!outcome.!

Example:!Environmental!Initiatives.!

Competing!stakeholders!are!involved!with!

different!interests!and!the!stakes!are!high.!

!

Page 3: Choosing the Correct Evaluation Approach for your Project€¦ · Table 1. Characteristics of Traditional Evaluation Compared to Developmental [3] Developmental Evaluation Entry Points

References 1. Gamble,!J.!A.!A.!(2008).!A!developmental!evaluation!primer.!Montreal:!JW!McConnell!Foundation.! Retrieved!from!http://www.mcconnellfoundation.ca/assets/Media%20Library/Publications/A%20De

velopmental%20Evaluation%20Primer%20H%20EN.pdf!

!

2.!!Patton,!M.!Q.!(2011).!Developmental!Evaluation:!Applying!Complexity!Concepts!to!

Enhance!Innovation!and!Use!(1st!ed.).!The!Guilford! Press!

!

3.!!Evaluation!and!the!Effectivenss!of!Social!Innovation! –!A!call!for!the!Long!View!

(2011)!Retrieved!from!(http://theacaciagroup.ca/ideas/?p=39)!

!

4.!!Dozois,!E.,!BlanchetHCohen,!N.,!Langlois,!M.,!Foundation,!J.!M.!F.,!Rights,!U.!O.!V.!(.!I.!I.!F.!

C.,!&!Development.!(2010).!DE!201:!A!Practitioner's!Guide!to!Developmental!Evaluation.!

International!Institute!for!Child!Rights!and!Development,!University!of!Victoria!

!

!

!

!

!