WELCOME to the webinar

“Evaluation to accelerate progress

towards equitable development” 6th September 2011

This Live Webinar will start at 9:30 AM, New York time.

All microphones & webcams are disabled and we will only enable microphones during

the Q&A portion.

Therefore, you will not hear any sound/noise till the beginning of the webinar.

Series of 17 live webinars on

“Equity-focused Evaluations” Interact live with 28 world-level evaluators

This new series of webinars will address the challenges and

opportunities in evaluating the effects of policies, programmes

and projects to enhance equitable development results, with a

special focus on the effects to the most excluded, marginalized

and deprived groups.

Colin KIRK

Penny HAWKINS

Evaluation to accelerate progress towards

equitable development

6 September 2011

Belen SANZ

Flaminia MINELLI

Human rights and Gender equality in evaluations

21 September 2011

Marco SEGONE

Michael BAMBERGER

How to design, implement and use equity-

oriented evaluations

4 October 2011

Robert CHAMBERS

Saville KUSHNER

Whose voices matter

Case study evaluation as an intervention for

promoting equity

11 October 2011

Patricia ROGERS

Richard HUMMELBRUNNER

Program theories and LogFrames to evaluate

pro-poor and equity programs

27 October 2011

Bob WILLIAMS

Martin REYNOLDS

Systems approach (CSH) to address ethical

issues

14 November 2011

Michael Quinn PATTON

Developmental Evaluation

6 December 2011

Webinars on Equity-focused Evaluation

Webinars on Equity-focused Evaluation

Donna MERTENS

Bagele CHILISA

Methodological guidance in evaluation for Social

Justice

Indigenous approaches to evaluation

January 2012

Jennifer GREENE

Values-Engaged Evaluation

February 2012

Rodney HOPSON

Katrina BLEDSOE

Cultural Responsiveness in Applied Research

and Evaluation Settings

March 2012

Bradley COUSINS

Evaluations in marginalized communities

influencing national policies. The case of

Aboriginal communities in Canada

March 2012

Francisco GUZMAN

Evaluation of the ILO’s strategy to eliminate

discrimination in employment and occupation

April 2012

Juha UITTO

Oscar GARCIA

Evaluating equity-focused public policies. The

case of Brazil and Mexico

April 2012

Rosina SALERNO

Evaluation of neglected illnesses in Latin

America

May 2012

Katherine HAY

Sanjeev SRIDHARAN

A healthy discomfort? Development, equity and

evaluation

Ten Questions that Evaluations of Health Equity

Initiatives should answer

May 2012

Webinars on Equity-focused Evaluation

Rajesh TANDON

Sulley GARIBA

Evaluation of pro-poor urban interventions

June 2012

Julian BARR

Ken CHOMITZ

Evaluation of climate change interventions for

excluded populations

June 2012

The recording will be available at

www.mymande.org

1

2

http://www.mymande.org/

The recording will be available at

www.mymande.org

http://www.mymande.org/

The recording will be available at

www.mymande.org

http://www.mymande.org/

Interact live with Questions and Answers

1

3

2

Evaluation to accelerate progress

towards equitable development

Keynote Speaker

Colin KIRK, Director, UNICEF Evaluation Office;

former Director, Operations Evaluation at African

Development Bank; former Head, DFID Rwanda at

DFID; former Head, Evaluation Department at DFID

Penny HAWKINS, Evaluation Office, The Rockefeller

Foundation; author of a chapter in the recently

published book “Evaluating Policy and Practice: A New

Zealand Reader”; former President of the Australasian

Evaluation Society (AES)

Key questions

• What does equity means?

• How equitable interventions can be

evaluated?

• How evaluation can contribute to equity?

Agenda

9h30 – 9h35 Welcome and introduction

Marco Segone, Systemic Management, UNICEF

Evaluation Office

9h35 – 9h55 Colin Kirk, Director, UNICEF Evaluation Office

9h55 – 10h05 Penny Hawkins, Evaluation Office,

The Rockefeller Foundation

10h05 – 10h25 Questions and Answers

Moderator: Abigail Taylor, Knowledge Management

Specialist, UNICEF Evaluation Office

10h25 – 10h30 Wrap-up: Marco Segone

Evaluation and equitable development

Colin Kirk, Evaluation Director, UNICEF

Webinar on equity focused evaluation

6 September 2011

“`Then you should say what you mean,' the March

Hare went on.

`I do,' Alice hastily replied;

`at least - at least I mean what I say - that's the

same thing, you know.'”

Alice’s adventures

in Wonderland

Lewis Carroll, 1865

Outline

Equity: are we saying what we mean?

And can we measure what we say?

• Equity in principle and practice

• Evidence on equity

• What do we mean by equity?

• How does UNICEF address equity?

• How can evaluation contribute?

• An example from Egypt

• Conclusions

“Right in principle…”

“Above all, we need to come together as a global

community and fully commit ourselves to reaching the

hardest to reach. For there can be no true progress in

human development unless its benefits are shared –

and to some degree driven – by the most vulnerable

among us”.

Tony Lake, UNICEF Executive Director

Tokyo, 3 June 2011

“…right in practice”

“…the equity approach is not only right in principle. It is

right in practice.

This means, in practice, doing a better job of mapping

the areas of greatest need – looking beyond averages

and disaggregating the data so as better to target the

hardest to reach.

It means developing better monitoring and evaluation

of results, to see what is working and where further

resources should be focused.”

Global inequality

“… the richest population quintile gets 83 percent of global

income, with just a single percentage point for those in the

poorest quintile.

…Inequity is dysfunctional, and there is a grave need to

place equity at the center of the development agenda.”

Global Inequality: Beyond the Bottom Billion –

A Rapid Review of Income Distribution in 141 Countries

Isabel Ortiz and Matthew Cummins, 2011

“the evidence shows that

even small decreases in

inequality, already a reality in

some rich market

democracies, make a very

important difference to the

quality of life”

The Spirit Level:

Why More Equal Societies Almost Always

Do Better

Richard Wilkinson and Kate Pickett, 2009

Saying what we mean

Equity can carry different meanings depending upon

what is to be considered in terms of equity:

• Income, access, opportunities, abilities, needs, costs,

sector, geography, demographics, etc

• Inputs/activities or outcomes/impacts

• Units of measurement (per capita, per dollar paid, per

service provided etc)

• Points of comparison (average, median, disaggregated)

Equity principles

• Horizontal equity (“fairness”):

the distribution of outcomes between individuals and groups considered equal in ability or need

• Vertical equity (“social justice”):

the distribution of outcomes between individuals and groups of different incomes or social class (compensating for overall inequities)

• Vertical equity (“social inclusion”):

the distribution of outcomes between individuals and groups in terms of different needs, abilities and access.

These principles often overlap and conflict: they are not just technical categories but underlie political choices – here, we need not only to “say what we mean”, but also “mean what we say.”

What does UNICEF mean by

equity?

• For UNICEF, equity means that all children have an

opportunity to survive, develop and reach their full

potential, without discrimination, bias, or favouritism.

• The Convention on the Rights of the Child

guarantees the fundamental rights of every child,

regardless of gender, race, religious beliefs, income,

physical attributes, geographical location, or other

status.

• “All rights for all children everywhere.”

How does UNICEF address

equity? • A commitment to universal child rights, informing a

broad range of human development interventions, including humanitarian interventions

• A “bottom up” approach, based on disaggregated country-specific situation analyses (SitAns)

• Community-based interventions, with local partners, scaling up to national level

• Monitoring and evaluation for learning, accountability and advocacy

Evaluation and equitable

development

How can evaluation contribute to equitable

development?

• By providing clarity on what we mean when we talk

about equity: “saying what we mean”

• By providing clarity on how we measure equity:

“measuring what we say”

• By providing evaluation evidence for use in

advocating for equitable development

Integrating communities into

the health system in Egypt

The Takamol project (2006), financed by USAID, aimed to enable delivery of quality integrated reproductive health (RH) services:

by strengthening the health system

and building the capacity of the communities served by the health system.

The Takamol project

• Targeted 1279 clinics and 21 hospitals covering a

population of 2.6 million

• Health system strengthening through strengthening

service providers and institutions

• Community capacity building, including engaging

with community leaders and corporate players, and

“democracy seminars”

• Restructured health facility Boards of Directors for

community representation (including women)

The M&E framework

Success!

All objectives achieved

Success factors: Government “ownership”

Health services and facilities improved through an integrated, holistic and collaborative approach

Corporate engagement

Community leaders involved

Board reform effective

Set up an environment for analytical thinking and improvement

Evaluation for equitable

development

How can evaluation contribute to equitable development?

By providing clarity on what we mean when we talk about equity: “saying what we mean”

By providing clarity on how we measure equity: “measuring what we say”

By providing evaluation evidence for use in advocating for equitable development

Takamol made good use of evaluative thinking and results:

By establishing a clear, practical and measurable project design

By investing in appropriate monitoring and evaluation

By using M&E results internally to build ownership and advocate for sustained reform and improvement

By publishing lessons learned for wider discussion and uptake

Conclusion

• Equity is right in principle and right in practice…

•but technically challenging and politically contested in theory and in practice

• Evaluation can contribute

•technically by clarifying concepts and methods

•politically, by supplying evidence for advocacy, debate and decision-making

A final word from Alice:

“She generally gave herself very good advice (though she very seldom followed it).”

If evaluation is to make the contribution it should, we need to be able to provide “very good advice” and be able to follow through. We need to get it right in principle, and in practice.

THANK YOU!

Evaluation and equitable development

Penny Hawkins, Evaluation Office, The Rockefeller Foundation

Webinar on equity focused evaluation

6 September 2011

Questions and Answers

1

3

2

The recording will be available at

www.mymande.org

1

2

http://www.mymande.org/

Next webinars

• Human Rights and Gender Equality in

evaluation, Wednesday, 21st September

• How to design and manage equity-focused

evaluations, Tuesday, 4th October

Evaluation of Webinars

Survey

Your opinion/feedback is important to us, therefore

we ask that you complete this short evaluation on

today’s webinar.

http://www.zoomerang.com/Survey/WEB22CY88DJYDX/

http://www.zoomerang.com/Survey/WEB22CY88DJYDX/