Session 6

Identifying Indicators

1

Session Objective

• Apply an existing PHE tool to select standardized M&E indicator(s) for a proposed PHE project

• Formulate local, project-specific indicators.

2

Key Characteristics of Indicators

– PRECISE e.g., defined the same way by all people

– SENSITIVE e.g., Changes proportionately in response to actual changes in the condition being measured

– CONSISTENT e.g., Not changing over time so that it always measures the same thing

– MEASURABLE e.g., able to be recorded and analyzed in quantitative and qualitative terms

3

Key Considerations for

Indicator Selection

1. The intervention itself (e.g., set of activities/procedures)

2. “Target” or the anticipated result in quantifiable terms

3. Result Chain Factor

4

Result Chain FactorThe “if-then” linkage between boxes

SUCCESS = Sound Theory + Good Implementation

Accurate Results Chain

Well ExecutedProject

DesiredResults

used todesign

leads to

Inaccurate Results Chain

Well ExecutedProject

DesiredResults

used todesign

does notlead to

Accurate Results Chain

Poorly ExecutedProject

DesiredResults

used todesign

does notlead to

Inaccurate Results Chain

Poorly ExecutedProject

DesiredResults

used todesign

does notlead to

Adapted from Foundations for Success (2005). “WWF Standards of Conservation Project and Programme Management”

SUCCESS

THEORY FAILURE

PROGRAM FAILURE

TOTAL FAILURE!

5

Results Chain: CRM intervention to achieve a food security

outcomeMarine

ProtectedArea (MPA)

Established andManaged byCommunity

CoastalHabitatsProtected

Regenerationof coral reef

and associated

reef fish

Improved flow of

ecologicalgoods and

services to thecommunity

ImprovedFood

Security

Establishment and management of MPA by the community Coastal habitats protected

Coral and fish regenerated, improved flow of ecological goods and services to the community

Action /InterventionResult Chain Factor Additional Factors 6

PHE Operational Linkages – Assumptions

Results Chain #1 : Implementation Efficiencies to Achieve Health and Conservation Outcomes

Improvedefficiency

CoordinatedConservation &

Health/PopInterventions

Improvedhealth

Improvedconservation

Cost/effort share

IF coordinated, THEN conservation and health/population interventions will share the cost/effort leading to improved efficiency

Adapted from Foundations for Success (2005) Conventional Wisdom on Causal Linkages among Population, Health, and Environment Interventions and Targets 7

Pathway Through Which Projects Achieve Results

INPUT PROCESS OUTPUT OUTCOME IMPACT*Human, financial, and material resources including partner-ships and an enabling Environment

Example:

Supportive population or environment policies

Actions, procedures or activities being taken by the project to achieve objectives

Example:

CBD services established at the grassroots level

Products, effects or services that a project provides to the community (result of activities)

Example:

Expanded access to FP information and methods

Changes to the population, environment or health system (created by the outputs)

Example:

Use of modern FP methods increased among eligible couples

Ultimate result or long-term outcome

Example:

Reduction in fertility among women of reproductive age (15-49 yrs)

8

Type of Measurement

Program-based Measure

Population- based and Habitat- based

Measures

Adapted from Foundations for Success (2005). “WWF Standards of Conservation Project and Programme Management.”

Process Results

9

Data Collection MethodsLevel of Measurement

Methods Data Sources Time frame

InputsProgram-based Measures

1. Trend analysis 1. Service statistics records

2. Project records

Progress within six months of project start and routinely collected every one to three months throughout project cycle

ProcessProgram-basedmeasures

1. Trend analysis2. Rapid

appraisal (qualitative)

1. Focus group2. Key informant

interviews3. Facility surveys

First six months to one year of program implementation

OutputsProgram-basedMeasures

1. Trend analysis2. Transect

survey

1. Service statistics2. Project records3. Direct

observation

One to two years

Outcomes(short-term or long-term)Population-based or habitat-based measures

1. Population-based surveys

2. Transect survey

3. Mapping

1. Questionnaires2. Survey forms3. Global positioning

systems (GPS)4. Legal records5. Log books

Two to three years for short-term and three to five years or longer for long-term

10

Using “Standard” PHE Indicators

Objective Intervention

Results ChainFactor

Potential Indicator(By level of measurement)

Process(program-

based)

Output(progra

m-based)

Outcomes(population-

or habit-based)

Improved RH outcomes among people living in coastal areas by 2004

CBD of contraceptives

Increase FP access and practice

? ? ?

Community capacitated to implement CRM by 2006

MPA established and managed with community involvement

Habitatsprotected

? ? ?

11

IPOPCORM IndicatorsObjective Interventi

onResult Chain Factor

Potential Indicator(By level of measurement)

Process(program-

based)

Output (program-

based)

Outcome(population-

or habit-based)

Improved RH outcomes among people living in coastal areas by 2004

Community Based Distribution (CBD) ofcontraceptives

Increase FP access and practice

# of CBD agents trained

% of trained CBD agents currently active

# of acceptors new to modern contraception(pg 55)

Community capacitated to implement coastal resource management (CRM) by 2006

Marine protected area (MPA) established and managed with community involvement

Habitatsprotected

Number of community members trained in enforcement procedures (pg 81)

Hours of enforcement patrols logged (pg 83)

Number and area (km2) of MPAs under improved management (pg 95)

12

Integrated Indicators(Measures a linkage aspect of a PHE approach or

intervention)Process / Outputs (Program-Based)

1. Number of linked messages/materials created

2. Number and frequency of PHE educational sessions provided in the target community

3. Number of new PHE partnerships created that make linkages among organizations or institutions from different sectors

Outcomes / Impacts (Population-Based)

6. Percent of households knowledgeable about or aware of a specific PHE issue

7. Percent of communities in target/project area receiving all three PHE elements

8. Number of enabling local policies supporting PHE

13

Value Added Indicators(Measures value added in one sector as a result of work targeted in another

sector)Process / Outputs (Program-

Based)

1. Percent of leadership positions held by women on community-based natural resource management committees

2. Net dollar value of FP products socially marketed by CBD agents

3. Amount of money saved each month (firewood expenditure) among households that install and use improved cooking stoves (ICS)

Outcomes / Impacts (Population-Based)

1. Percentage of households that earn income from the sale of cooking oil processed from moringa seeds

2. Incidence of acute respiratory infections (ARI) among children under age five

3. Percent of young (15-24 yr) ecologist who report use of condom during last sexual intercourse 14

TASK - Selecting Indicators1. Using the MEASURE guide and worksheet, select

indicators for each of the sector objectives in your proposed PHE project framework. Select at least one standard indicator for each Intervention/Result Chain Factor (RCF). If you can not locate a suitable indicator, then formulate one.

2. If time permits, work on a second Intervention for one or more of your Sectoral Objectives. Alternatively you could work on an Integrated Indicator or one Value-Added Indicator.

Time: 45 minutes 15

Objective Intervention

Result ChainFactor

Potential Indicator(By level of measurement)

Process(program-

based)

Output(program-

based)

Outcome(population- or habit-based)

INDICATOR SELECTION WORKSHEETSector: __________________

16

Objective

Community capacitated to manage forest resources in sustainable fashion

Intervention

Result ChainFactor

Potential Indicator(By level of measurement)

Process(program-based)

Output(program-based)

Outcome(population- or habit-based)

Installation of Improved Cooking Stove (ICS)

Reduce consumption of firewood

# of households that install and use ICS on a regular basis

Amount of firewood saved each month from use of ICS

Forest coverage (hectares)

Reduce indoor air pollution

Reduce vulnerability to violence

# or HH with children <5 yrs that install and use ICS regularly

Average number of hours spent collecting fire wood (women and girls)

% of children <5 yrs that were treated for ARI in the past six months% women/girls reporting acts of violence while gathering firewood in the past six months

Incidence of ARI among children in the project area by source of household energy

Incidence of violence among women and girls who gather firewood

Example: Value Added InterventionSector: Environment

17