Institutionalizing Impact Evaluation in Human DevelopmentThe Spanish Impact Evaluation

Fund (SIEF) Sebastian Martinez

Human Development Network

World Bank

Impact Evaluation Portfolio in Human Development 67% of IEs at the WB are in HD Total of 125 IEs in HD

98 IEs are considered ‘ongoing’ – have an evaluation designed or data collected

By Sector: Education (42%) Health (28%) Social Protection (25%) Cross-cutting (5%)

Regional Distribution of HD IEs

42

22

18

12

2 2

0

5

10

15

20

25

30

35

40

45

AFR LAC SAR EAP ECA MENA

# o

f im

pa

ct e

valu

atio

ns

Spanish Impact Evaluation Fund (SIEF) Gov. of Spain and World Bank:

Shard interest in Results Agenda TF Managed by HD Network:

Build global knowledge about what works Build capacity to conduct and consume IE Disseminate knowledge and improve

effectiveness of social policy 11M Euros between 2007-2010

Largest TF for IE at WB But many others supporting and promoting IE

SIEF Priorities: Gov. of Spain sets priority areas & countries

Evaluation of interventions that improve HD Outcomes 11 broad areas 66 countries

Policy relevance is key criteria Test innovative approaches/new questions Large programs

Favor prospective evaluations with robust methodolgies Experimental & Quasi-experimental

Control Groups

SIEF: Building Global Knowledge About What Works Three windows of IE funding:

Quick wins: $1.5 million IEs giving results in 1-2 years

Cluster Fund: $6.0 million Funding programs of evaluation

Innovation Fund: $1.5 million Funding stand-alone, highly innovative evaluations

SIEF: Cluster Fund ($6m)

First call for Proposals: Large demand for IE funding $42 million in requests 34 Proposed clusters (16 of > 3 proposals) 163 Individual proposals

Short listed 7 clusters with $10M of requested funding

SIEF Funded Clusters

Youth to Work Transition/Active Labor Markets

Conditional Cash Transfers (second generation)

Basic Education Accountability Health Contracting / Performance HIV/AIDS Malaria Control

Cluster Approach

Improve coordination and quality of evaluation activities: Generate “body of knowledge”

Meta-analyses Communities of Practice:

Common measurement tools Cross-fertilization between evaluation teams

Quality: External peer review to access funds Cluster leaders provide TA

SIEF: Capacity Development in IE 5 field-based regional evaluation workshops

per year in partnership with region 150-200 participants: government, development

partners, NGOs, academic 10-20 IE experts & moderators Organized around project teams

Technical/policy tracks Lectures followed by hands on application to projects Teams develop their own IE concept note Presentations and feedback from colleagues

Dissemination Activities

Publication costs Spanish translation costs SIEF website and public use databases Global/regional conferences

www.worldbank.org/sief