JOINT EVALUATION UNIT – April 2009 1. Why are Result & Impact Indicators Needed? To better...

JOINT EVALUATION UNIT – April 2009

1

Why are Result & Impact Indicators Needed?To better understand the positive/negative

results of EC aid.

The main questions are:1) What change is needed?2) For whom?3) How to measure this change?

2

Why are Result & Impact Indicators Needed?

1. Assist EC country teams to develop a set of indicators for the programming level (e.g. to guide development and monitoring of a Country Strategy Paper)

2. To fill, as much as possible, the 'missing middle' between implementation indicators and global impact indicators

3

Global ImpactsIntermediate Impact

Specific Impact

Results/ Outcomes

The Missing Middle

4

ProgrammingImplementation

Outputs

5

Fresh Water – A Limited Supply!

6

Example – Cause & Effect ChainOUTPUT LEVEL: Rehabilitation and building of drinking water systems

Increased affordability of safe water for the population

POVERTY REDUCTION

Increased access to safe water

Reduced rate of water related diseases

Improved Health and social development

Missing Middle

Time

The Global Intervention Logic

Environment

Institutional Reform

Infrastructure (construction/ maintenance)

Improved Health

Reduced vulnerability of Ecosystem to

climatic events

Poverty Reduction

Sustainable National Water

Supply

Increased Access to Basic Sanitation

Strong Link

Link

Improved Conservation & Preservation of

Water

Social Development

Greater Equity in Allocation of

Water & Sanitation

Improved Quality of Water & Sanitation

GLOBAL IMPACTSINTERMEDIATE IMPACTS

SPECIFIC IMPACTS

RESULTS/OUTCOMES

OUTPUTCLUSTERS

Improved Water & Sanitation Health

& Hygiene Behaviour

Education

Increased Affordability of

Water & Sanitation Increased Access to Water

Economic Growth

Economic

Improved Use of Water &

Sanitation

Increased Employment

Effects

Improved Conditions for Economic Growth

Reduced Rate of Water Related

Diseases

The Multidimensional Impacts of Water and Sanitation

“Water is probably the only natural resource to touch all aspects of human civilization —from agricultural and industrial development to the cultural and religious values embedded in society.”

- Koichiro Matsuura, Director-General, UNESCO

8

How to deal with the different dimensions of water and sanitation

9

The intervention logic can be split into 3 different areas:

Public Health

Economy

Sustainable Eco-System

10

Public Health Intervention Logic


Education


Improved Health



Water & Sanitation


Diseases

Social Development

Improved Water & Sanitation Health

& Hygiene Behaviour

Increased Access to Water


Water & Sanitation


OUTPUTCLUSTERS

GLOBAL IMPACTSINTERMEDIATE IMPACTSSPECIFIC IMPACTSRESULTS/OUTCOMES

Did you know?More than 2.2 million people die each year

from diseases associated with poor water and sanitary

conditions

Did you know?More than 2.2 million people die each year

from diseases associated with poor water and sanitary

conditions

Did you know? 17% of the world’s

people lack access to safe water and 40% lack

access to adequate sanitation services

Did you know? 17% of the world’s

people lack access to safe water and 40% lack

access to adequate sanitation services

IndicatorsIndicators

• Water and sanitation hygiene awareness

• Domestic access to safe water

• Access to basic sanitation


• Water and sanitation hygiene awareness

• Domestic access to safe water

• Access to basic sanitation


• Pollution of water and soil• Treatment of waste water

• Equity in domestic water and sanitation allocation

• Household expenditure on water and sanitation


• Pollution of water and soil• Treatment of waste water

• Equity in domestic water and sanitation allocation

• Household expenditure on water and sanitation

IndicatorIndicator

• Rate of water borne diseases

IndicatorIndicator

• Rate of water borne diseases

11

Economy Intervention Logic


Sanitation

Economic Growth



Water & Sanitation


OUTPUTCLUSTERS


SPECIFIC IMPACTSRESULTS/OUTCOMES

Greater equity in Allocation of

Water


Improved Conditions for Economic Growth


Economy

Did you know?

Use of fresh water: 70 % irrigation 22 % industry 8 % domestic use


• Employment resulting from water and sanitation construction and maintenance

• Irrigation requirements

• Equity in allocation of water between sectors

• Cost of water for business


• Employment resulting from water and sanitation construction and maintenance

• Irrigation requirements

• Equity in allocation of water between sectors

• Cost of water for business

IndicatorIndicator

• Business access to water

IndicatorIndicator

• Business access to water

IndicatorIndicator

• Business productivity

IndicatorIndicator

• Business productivity

12

Sustainable Eco-System Intervention Logic

Environment


Reduced vulnerability of

Ecosystem to climatic events


Supply

Improved Use of Water & Sanitation


Water


RESULTS/OUTCOMES

OUTPUTCLUSTERS

Did you know?

By 2025 water withdrawals are

predicted to increase by 50% in developing

countries and 18% in developed countries

Education


• Availability of water• Preservation of water

• Water leakages • Recycling of water


• Availability of water• Preservation of water

• Water leakages • Recycling of water

IndicatorIndicator

• Sustainable extraction of water

IndicatorIndicator

• Sustainable extraction of water

Environment



Improved Health

Reduced vulnerability of Ecosystem to

climatic events


Supply


Strong Link

Link


Diseases


Water

Social Development


Water & Sanitation


Improved Water & Sanitation Health & Hygiene Behaviour

Education


Water & Sanitation


Improved Conditions for Economic Growth Economic

Growth

Economic


Sanitation


Poverty Reduction

GLOBAL IMPACTSOUTPUT

CLUSTERSSPECIFIC IMPACTS

RESULTS/OUTCOMES

INTERMEDIATE IMPACTS

Effects

MDG 7- Target 10

MDG 1 - Target 1&2

MDG 4 - Target 5

Millennium Development Goals

Global ImpactsIntermediate Impact

Specific Impact

Results/ Outcomes

The Missing Middle

14

ProgrammingImplementation

Outputs

Attention

1. This is a simplified tool, not a template. Intervention logic must be developed for each country based on its context and existing government strategies

2. Indictors are not fixed but provide ideas on how to set, monitor and evaluate CSP objectives

3. Crosscutting issues should be mainstreamed into relevant indicators (e.g. disaggregation of data by gender)

4. Outcomes/Impact are not fully attributable to the EC Outputs are 100% attributable to the EC but attribution falls as you move up the chain of results

List of Indicators:

SPECIFIC/INTERMEDIATE IMPACT INDICATOR

17. Business productivity - x% change in food production/yield and processing costs-x% change in industrial production costs

INTERMEDIATE IMPACT INDICATORS

18. Sustainable extraction of water- Annual extraction of from surface and ground water, in relation to its minimum annual recharge (i.e. water balance sheet)19. Rate of water borne diseases-Inflection rates for diseases such as diarrhoea, intestinal worms, parasitic infections etc.

SPECIFIC IMPACTS INDICATORS

13. water and sanitation hygiene awareness- Improved collection and storage of drinking water- Proportion of people hand washing- Use of hygienic sanitation facilities 14. Domestic access to safe water (inc. time savings)- Number of households connected to water network for x months of year- Number of households within 1km of safe water for x months of year-Number of households who receive more than 20 litres of water per day15. Business access to water- x% of agricultural water needs meet for x months of the year- x% of industrial water needs meet for x months of the year16. Access to basic sanitation-Number of people with access to basic sanitation

RESULTS/OUTCOMES INDICATORS

1. Availability of water- Change in water levels for lakes, rivers and water table2. Preservation of water - Area of protected wetlands, lakes and rivers3. Irrigation requirements- Amount of water needed to produce xm² of x food4. Water leakages- % of water lost through water systems due to leakages5. Recycling of water - Amount of sanitation water that is recycled - Amount of water used in industry that is recycled 6. Employment resulting from water and sanitation construction and maintenance-Number of people directly and indirectly employed in water and sanitation construction and maintenance projects7. Pollution of water and soil- Levels of chemicals, minerals, metals, pesticides etc in soil and water (surface and ground water).8. Treatment of waste water- Proportion of domestic, agricultural and industrial waste water that is treated before being discharged9. Equity in domestic water and sanitation allocation- Rate of connection to water/sanitation network for slums/shanty towns compared to national average- Level of rural poor connection to water/sanitation network compared to national average 10. Equity in allocation of water between sectors- Implementation of transparent public or public/private mechanisms to allocate water 11. Household expenditure on water and sanitation- x% of household expenditure on water and sanitation by each income group in society 12. Cost of water for businesses - Water as a x% cost of agricultural value- Water as a x% cost of industrial value

JOINT EVALUATION UNIT – April 2009 1. Why are Result & Impact Indicators Needed? To better...

Documents

Transcript of JOINT EVALUATION UNIT – April 2009 1. Why are Result & Impact Indicators Needed? To better...