[FINAL TERMS OF REFERENCE WFP COUNTRY...

28
EVALUATION QUALITY ASSURANCE SYSTEM Office Of Evaluation Measuring Results, Sharing Lessons [FINAL] TERMS OF REFERENCE WFP - COUNTRY PORTFOLIO EVALUATION AFGHANISTAN 2009 - 2011 T ABLE OF CONTENTS 1. Background................................................................................................................................. 2 1.1. Introduction ......................................................................................................................... 2 1.2. Country Context .................................................................................................................. 2 2. Reasons for the Evaluation ...................................................................................................... 6 2.1. Rationale ............................................................................................................................... 6 2.2. Objectives ............................................................................................................................. 7 2.3. Stakeholders and Users ...................................................................................................... 7 3. Subject of the Evaluation ......................................................................................................... 7 3.1. WFP’s Portfolio in Afghanistan ......................................................................................... 7 3.2. Scope of the Evaluation ...................................................................................................... 9 4. Key Questions ............................................................................................................................ 9 5. Evaluation Approach .............................................................................................................. 10 5.1. Evaluability Assessment ................................................................................................... 10 5.2. Methodology ...................................................................................................................... 11 5.3. Quality Assurance ............................................................................................................. 12 6. Organization of the Evaluation ............................................................................................ 12 6.1. Phases and Deliverables ................................................................................................... 12 6.2. Evaluation Team ................................................................................................................ 13 6.3. Roles and Responsibilities................................................................................................ 15 6.4. Communication ................................................................................................................. 15 6.5. Budget ................................................................................................................................. 16 Annexes............................................................................................................................................... 17 Annex 1: Map ............................................................................................................................ 17 Annex 2: WFP Strategic Plan 2008 – 2013 ............................................................................. 18 Annex 3: Timing, phases and deliverables ........................................................................... 20 Annex 4: Afghanistan WFP 2009 – 2010 Portfolio................................................................ 21 Annex 5: Key stakeholdres by project ................................................................................... 22 Annex 6: Core standard indicators ........................................................................................ 23 Annex 7: Factsheet.................................................................................................................... 24 Annex 8: Library ....................................................................................................................... 25

Transcript of [FINAL TERMS OF REFERENCE WFP COUNTRY...

EVALUATION QUALITY ASSURANCE SYSTEM

Office Of Evaluation

Measuring Results, Sharing Lessons

[FINAL] TERMS OF REFERENCE

WFP - COUNTRY PORTFOLIO EVALUATION – AFGHANISTAN 2009 - 2011

TABLE OF CONTENTS

1. Background................................................................................................................................. 2

1.1. Introduction ......................................................................................................................... 2

1.2. Country Context .................................................................................................................. 2

2. Reasons for the Evaluation ...................................................................................................... 6

2.1. Rationale ............................................................................................................................... 6

2.2. Objectives ............................................................................................................................. 7

2.3. Stakeholders and Users ...................................................................................................... 7

3. Subject of the Evaluation ......................................................................................................... 7

3.1. WFP’s Portfolio in Afghanistan ......................................................................................... 7

3.2. Scope of the Evaluation ...................................................................................................... 9

4. Key Questions ............................................................................................................................ 9

5. Evaluation Approach .............................................................................................................. 10

5.1. Evaluability Assessment ................................................................................................... 10

5.2. Methodology ...................................................................................................................... 11

5.3. Quality Assurance ............................................................................................................. 12

6. Organization of the Evaluation ............................................................................................ 12

6.1. Phases and Deliverables ................................................................................................... 12

6.2. Evaluation Team ................................................................................................................ 13

6.3. Roles and Responsibilities ................................................................................................ 15

6.4. Communication ................................................................................................................. 15

6.5. Budget ................................................................................................................................. 16

Annexes ............................................................................................................................................... 17

Annex 1: Map ............................................................................................................................ 17

Annex 2: WFP Strategic Plan 2008 – 2013 ............................................................................. 18

Annex 3: Timing, phases and deliverables ........................................................................... 20

Annex 4: Afghanistan WFP 2009 – 2010 Portfolio ................................................................ 21

Annex 5: Key stakeholdres by project ................................................................................... 22

Annex 6: Core standard indicators ........................................................................................ 23

Annex 7: Factsheet .................................................................................................................... 24

Annex 8: Library ....................................................................................................................... 25

2

1. Background

1. The purpose of these terms of reference (TOR) is to provide key information to

stakeholders about the proposed evaluation, to guide the evaluation team and specify

expectations during the various phases of the evaluation. The TOR are structured as

follows: Section 1 provides a summary on the context; Section 2 presents the rationale,

objectives, stakeholders and main users of the evaluation; Section 3 presents the WFP

portfolio and defines the scope of the evaluation; Section 4 identifies the key issues; Section 5

spells out the evaluation approach; and Section 6 indicates how the evaluation will be

organized. The annexes provide additional information as indicated in the relevant sections.

1.1. Introduction

2. Country Portfolio Evaluations (CPE) encompass the entirety of WFP activities during a

specific period. They evaluate the performance and results of the portfolio as a whole and

provide evaluative insights to make evidence-based decisions about positioning WFP in a

country and about strategic partnerships, programme design, and implementation. In

addition, CPEs help Country Offices in the preparation of Country Strategies and provide

lessons and specific recommendations that can be used in the design of new operations.

1.2. Country Context

3. Afghanistan has been a conflict or fragile state for more than three decades with

significant deleterious impacts on the socio-economic conditions for most of the population.

During the 1990s, the Taliban regime restricted much of the prior productive activity and the

technological advancements achieved in prior decades. Since the fall of the Taliban in 2001,

the political situation has been fragile and insecurity has been a major factor mitigating

development and stability of the country.

4. Estimated at 25.5 million1, Afghanistan’s population is largely rural, with a significant

amount of mobility and displacement throughout the country. The three main cities of

Kabul, Kandahar and Herat have populations of 2.5 million, 450,000, and 350,000

respectively; rapid urbanisation will see these areas grow substantially in the next few

years. Seasonal labour migration, especially with neighbouring Pakistan and Iran, is

common as are the corresponding remittances.

5. Although there have been significant foreign investments in infrastructure throughout

the country, continued poor access to public goods, productive and social services, and

markets has resulted in high levels of poverty and limited livelihood opportunities.

Agricultural production, including the illegal production of poppies, is the major source of

economic growth and livelihoods throughout the whole country. The provinces in the north,

south, southwest and southeast have suffered from both long-term drought and insecurity,

which has negatively affected food security and weakened labour markets. Recent 2011

droughts in the agricultural areas of the north have also caused increasing vulnerability

leading into the winter2.

1 Afghanistan Country Report October 2011. The Economic Intelligence Unit Limited. 2 Ibid.

3

6. In summary, there are several immediate key challenges for recovery, transition and

socio-economic development in Afghanistan3:

Insecurity, corruption, and continued insurgent conflict destabilizing institutions and

recovery at all levels;

high levels of poverty, low levels of formal school attendance, and extremely limited

livelihood options for young people;

political instability and factionalism throughout the country, based on historical and

cultural factors as well as the recent foreign military, political and economic

interventions;

the lack of physical infrastructure, including electrification and water supply, is

insufficient to support industry and social services;

relatively weak institutions to support this physical infrastructure and service

delivery. This relates to technical capacity of support services and governance

capacity to manage state infrastructure;

a weak regulatory environment for enforcement of contracts and regulation of public

and private transactions, exacerbated by pervasive rent-seeking;

land and finance markets are very thin to non-existent in many rural areas and thus a

barrier to increased agricultural production;

limited linkages to regional and global markets, in addition to a limited domestic

markets because of high poverty levels;

continued reliance on illegal poppy production and the resultant instability (through

both enforcement of, and avoidance of, formal and official regulations) this causes.

7. Afghanistan is a country with a rich cultural heritage and which has also made

significant recent progress against its development objectives. It must be recognized that

while the challenges remain, significant progress4 has been made since 2001 including the

following:

the return of over 5 million refugees from neighbouring countries since 2001 and a

significant number of these returning to urban areas;

exponential increase in school enrollment since the pre-2001 period, including

enrollment of both girls and boys. There has also been an increase in school

infrastructure throughout the country;

increased access to health services throughout the country and increased rural road

infrastructure

over 2.5 million people benefiting from social protection systems offered by the

government or non-state agencies

establishment of a banking sector (a central bank and commercial banks) and

financial services, including a stable currency and predictable interest rates;

3 Afghanistan National Development Strategy (2008 – 2013). 4 Ibid.

4

increased access to telecommunication services throughout the country with

corresponding infrastructure

increased commercial and foreign investment in all sectors of the economy

8. There is a continuing concern that heavy levels of donor investment, with concomitant

presence of numerous non-state actors and private entities, can lead to geographic and social

fragmentation5. Inequality between urban and rural areas, between the remote areas and the

accessible provinces, and between the educated elite and the majority poor exacerbates

poverty and mitigates efforts at peace-building.

9. Food insecurity and malnutrition remain a continuing chronic problem throughout

Afghanistan. The most recent National Risk and Vulnerability Assessment shows that food

security has deteriorated in 25 of 34 provinces and 31% of the total population are food

insecure. Nationally, chronic malnutrition stands at 60.5%, acute malnutrition at 8.7%, and

underweight at 39%6. Under-5 mortality and maternal mortality are 199/1000 and

1400/100,000 respectively. Macro and micronutrient deficiencies are serious public health

concerns especially in children and women. All food security and nutrition related

indicators show significant problems in Afghanistan for most of the population. While for

most indicators the trends are improving, aggregate improvements are largely the result of

increased investment and infrastructure in urban areas to meet the needs of urbanizing

populations. With 80% of the population living in rural areas, these trends vary significantly

from province to province and indeed within each province7.

10. Agriculture is a major feature of the Afghan economy and the majority of households are

engaged primarily in agricultural production. Because of conflict, natural disasters and

population increases, in the last two decades Afghanistan has lost 60% of its livestock herd

and 70% of its forest cover. Agriculture accounts for approximately 40% of GDP and over

70% of the labour market in Afghanistan. The principal legal crops are wheat, maize, rice

and barley. Fruits, nuts, vegetables, wool, cotton and hides/skins are the major exports.

Much of the agriculture in Afghanistan is irrigated from seasonal rivers in the north and the

south, and crops are regularly affected by drought caused by reduced snow loads in the

region. The seasonal calendar (Figure 1) provides an illustration of key features in the

agricultural calendar. Given the importance of small-scale agriculture and livestock, the

food security of many households is dependent on exchange via local agricultural markets

and, to an increasing extent, seasonal labour markets.

Figure 1: Afghanistan seasonal agriculture calendar

Source: http://www.fews.net/pages/timelineview.aspx?loc=1&gb=af&l=en

5 Afghanistan UN Development Assistance Framework (2010 – 2013).

6 MOPH/CDC/UNICEF, 2003/04, National Nutrition Survey, Afghanistan (WHO 2006 Growth Standards)

7 See the recent Provincial Briefs (June 2011), an analysis of 39 socio-economic indicators, for more information. For

example, poverty incidence varies from 9% in Helmand province to 76% in Paktika province versus the national average

of 36%.

5

11. The education sector continues to be a major focus for many multilateral and bilateral

agencies, including WFP. Educational attainment has been steadily increasing since 2001 but

still remains low by regional and international standards. The 2005-2009 net primary school

enrollment ratio was 74% and 46% for boys and girls, respectively. The attendance ratio for

the same group was 66% and 40% for boys and girls, respectively. These data8, contrasted to

the pre-2001 period with minimal schooling available (no official schooling for girls), are

evidence of the investments and incentives provided to the education sector over the last

decade.

12. The national policy framework in Afghanistan is supportive of most international

development trends and objectives. Within the food security and agricultural sector, the

National Agricultural Development Framework emphasizes improved physical

infrastructure and market development. This policy framework was developed in 2009/2010

in order to better prioritize investment within the sector and to rectify nearly '...seven years

of failed agricultural development.'9 With a Natural Resources Management (NRM)

programme, an Agricultural Production and Productivity Programme (APP) and an

Economic Regeneration Programme (ER), the three pillars of the national strategy form a

holistic approach to sustainable development of the agriculture sector. Despite an emphasis

on wheat imports, food aid and a strategic grain reserve to counter food price increases and

drought-related food shortages in 2011, the Ministry of Agriculture, Irrigation and Livestock

(MAIL) is emphasizing fooder production, increased access to agricultural inputs, watershed

protection and irrigation, and integrated pest management.10

13. Within the education sector, the National Education Strategic Plan (2010- 2014) consists

of five programmes that aim to improve access to and quality of education in Afghanistan.

Three areas are of highest priority: first, providing access to education for boys and girls to

improve enrollment and retention, which includes the building / repair of schools; second, to

train teachers and improve the quality of the curriculum; and third, to improve the

institutional environment to effectively manage the education sector and related resources.

14. In the areas of food utilization, the Health and Nutrition Strategy (HNSS) aims to

improve the health and nutritional status of the population with greater emphasis on

women, children and underserved areas. The HNSS-aligned Public Nutrition Policy and

Strategy (2009 – 2013) focuses on providing direct nutrition interventions through the health

sector with support from other sectors.

15. WFP has been active in Afghanistan since 1964, with the most significant investments

coming since 2001. Building on its comparative advantage, WFP provided emergency food

assistance in the years immediately following 2001, in addition to providing coordination

and logistics for many agencies through its special operations. In addition to food insecurity

caused by conflict, WFP has responded to a significant number national disasters (see Table

1) over the past decade. In 2006, the WFP initiated a relief and recovery operation (PRRO

104270) that covered a range of transition and development oriented activities, focused on

the areas of education and food security. Since 2009, the WFP has continued much of this

8 www.childinfo.org

9 March 2010 presentation on NADF by Ministry of Agriculture, Irrigation and Livestock.

http://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&ved=0CB8QFjAA&url=https%3A%2F%2Fw

ww.cimicweb.org%2FDocuments%2FPRT%2520CONFERENCE%25202010%2FNADF_Principles.pdf&ei=Ei7KTp6q

HozqOfqR_eQP&usg=AFQjCNGtRcKZcqstve425ypmxEHkfxzcSQ&sig2=zfCdtVg9M1etXZMf-fk9TQ

10 2011 Agriculture Prospects Report. Ministry of Agriculture, Irrigation and Livestock.

6

transition and recovery work with its 1.2 billion USD Enhancing resilience and food security in

Afghanistan operation, planned for a period of 36 months and an annual coverage of 7.6

million people. WFP has been a major recipient of funding from the consolidated appeals

process (CAP), in which approximately 60 separate agencies prescribe priorities and

interventions for emergency humanitarian funding each year (Table 2).

Table 1: Natural disasters in Afghanistan (2002 - 2010)

Table 2: Afghanistan consolidated Appeal 2007 – 2011

2. Reasons for the Evaluation

2.1. Rationale

16. The rationale for this country portfolio evaluation (CPE) is to review the comparative

advantage and positioning of the WFP Afghanistan operations vis-a-vis the situation on the

ground, the priorities and strategies of government and other non-state actors, good

practices in humanitarian response and working in fragile/conflict states. In addition the

CPE will evaluation the results of the WFP portfolio against stated objectives and with a

focus on the long-term impacts and sustainability.

17. The Afghanistan CPE takes place at the mid-point of its major relief and recovery

operation and the finding and recommendations will be used in the design of the next WFP

operation. Afghanistan presents a challenging portfolio for WFP, with significant security

risks and access difficulties. In addition, the portfolio is large with many different activities

being implemented in different parts of the country. Given the multi-stakeholder context of

Afghanistan, where many partners and many donors are involved throughout the country,

Year Natural disasters People affected

2002 Epidemic 200,000

2002 Earthquake 91,228

2005 Storm 22,656

2006 Drought 1,900,000

2006 Mass movement wet 300,000

2007 Flood 20,000

2008 Drought 280,000

2008 Extreme temperature 170,684

2009 Flood 60,016

2010 Flood 40,000

2011 Flood 3,000

2011 Drought 1,750,000

Source: EM-DAT: The OFDA/CRED international disaster database

Total Required under CAP $USD WFP required $USD WFP % of total total # agencies

2011 678,632,984 412,195,165 61% 57

2010 870,561,261 347,542,420 40% 60

2009 603,981,153 328,208,444 54% 60

2008 81,321,254 76,756,835 94% 4

2007 - - - -

Source: http://fts.unocha.org/pageloader.aspx?page=emerg-emergencyCountryDetails&cc=afg

7

the comparative advantage of WFP and its implementation framework will be major

features of the evaluation.

2.2. Objectives

18. Evaluations serve the dual objectives of accountability and learning. As such, the

evaluation will:

assess and report on the performance and results of the country portfolio in line with the

WFP mandate and in response to humanitarian and development challenges in

Afghanistan (accountability); and

determine the reasons for observed success/failure and draw lessons from experience to

produce evidence-based findings to allow the CO to make informed strategic decisions

about positioning itself in Afghanistan, form strategic partnerships, and improve

operations design and implementation whenever possible (learning).

2.3. Stakeholders and Users

19. The primary user of this evaluation will be the WFP Country Office in its design of new

operations, country strategies and partnerships and in potential adjustments to current

operations.

20. The WFP works with a large number of cooperating partners in Afghanistan. WFP also

funds several international NGOs and government agencies, which in turn have their own

cooperating partners and project implementation. The WFP's government counterparts at

national level include the Ministry of Agriculture, Irrigation and Livestock (MAIL), the

Ministry of Rural Rehabilitation and Development (MRRD), the Ministry of Education

(MoE), the Ministry of Public Health (MoPH), the Ministry of Labour, Social Affairs, Martyrs

and Disabled (MoLSAMD) and the Ministry of Refugees and Returnees (MoRR), and

Ministry of Women’s Affairs (MoEA) and the Afghanistan National Disaster Management

Authority (ANDMA). These central levels ministries are again represented at provincial

level with steering committees that manage implementation of WFP/government

interventions. At community level there are many community development councils

(CDCs) and shuras with different affiliations that are engaged in both governance and

implementation of recovery/reconstruction projects as well as humanitarian interventions in

emergency situations. Give the scale and scope of WFP's operations, this is a necessary

degree of cooperation and coordination; the degree to which this is successful, contributing

to portfolio results, and can be improved is a subject of this evaluation.

21. It is important that a thorough stakeholder analysis (see annex 5 for preliminary detail) is done at

the inception stage of the evaluation. Understanding the key strategic and operational partners, the

priority issues, and the various interests at stake will be fundamental to answering some of the

evaluation questions.

3. Subject of the Evaluation

3.1. WFP’s Portfolio in Afghanistan

22. Since 2006, there have been two protracted relief and recovery operations (PRRO) with

one on-going, one emergency operation (EMOP) that is on-going, three special operations

8

(SOs), with one on-going, and one purchase-for-progress (P4P) operation that is on-going

Figure 2 illustrates the timeline of these operations, their budgets, expenditures and

beneficiaries.

23. This evaluation will focus on the 2009 – 2011 time period (see red outline in Figure 2), in

which there have been three operations (see also Annex 4). The evaluation will cover the

PRRO 200063, coming at the mid-point of its implementation, the SO 200092, which

provides logistics support to WFP and other agencies, and the P4P pilot project which

started in early 2010 and is yet in its early stages. A 11 month emergency operation (EMOP

200366) began in December 2011, largely as a response to the recent drought, but will not be

covered by the evaluation.

24. Given the scale, scope and coverage of the PRRO 200063, its interventions form the bulk

of the Afghanistan portfolio and it will be the major focus of the evaluation. This relief and

recovery operation builds upon the results and lessons of its predecessor operation, PRRO

104270, and covers relief, recovery and capacity building components. These components

include emergency food assistance (general food distribution), urban social safety nets,

maternal and child health and nutrition, support to TB patients, food for assets, food for

education, food for training, building of community grain storage facilities and a national

strategic grain reserve, flour fortification and support to national-level data collection

systems. Table 3 illustrates the breakdown of beneficiaries by activity. Table 4 summarizes

the planned versus actual expenditures from 2009 – 2011.

Figure 2: Timing and funding of the Afghanistan portfolio

Table 3: Distribution of portfolio activities PRRO 200063

9

Table 4: Planned versus actual expenditures 2009- 2011

25. The operational activities covered by the evaluation are guided by WFP’s current

strategic plan (see Annex 2). The majority of WFP activities are focused on saving lives

(Strategic Objective 1) and rebuilding livelihoods (Strategic Objective3). Much of the

capacity building and systems strengthening interventions fall within Strategic Objective 5.

3.2. Scope of the Evaluation

26. The evaluation will pick up where the last evaluation finished in 2009.11 The findings

and recommendations from that evaluation, and their subsequent use/utility in the design of

the following PRRO, which began in 2010, will be a part of this evaluation. The evaluation

will cover all geographic areas of WFP operation.

27. In light of the strategic nature of the evaluation, it is not intended to evaluation each

operation individually but to focus broadly on the portfolio as a whole.12 Following the

established approach for WFP CPEs, the evaluation focuses on three main areas; strategic

alignment of the portfolio, strategic decision-making and overall results and performance.

These three areas of focus are detailed in the key evaluation questions.

4. Key Questions

28. The CPE will be addressing the following three key questions, which will be further

detailed in a matrix of evaluation questions to be developed by the evaluation team during

11 The prior evaluation was an operations evaluation of PRRO 104270 and focused on the results of this operation. It was

narrower in scope than this CPE and did not cover the results of three pilot activities under PRRO 104270; namely wet

school feeding, cash-vouchers and MCHN. It was limited to an evaluation of the design of these three activities given

that they had only recently begun. This CPE will cover those three pilot activities, which have been carried over into the

2010 – 2011 period under the new PRRO 200063. 12 The evaluation will follow a WFP internal audit exercise in Afghanistan (to be done in late 2011), which will focus on

some internal WFP control systems as well as some areas of operational importance such as M&E, reporting, planning,

budgeting, etc. The CPE is not intended to duplicate or overlap with some of these internal audit exercises. In addition,

the CO has conducted several key exercises in 2011 e.g. Strategic Reviews, preparation of a Food Security Strategy, set

up of a Strategy and Policy Unit, etc. Several other assessments/studies are planned during the first quarter of the year

and will feed into the CPE evaluation.

Education Nutrition GFD Cash* FFW/FFA/FFT HIV/TB

PRRO 200063 X X X X X X

Planned % of

beneficiaries43 4 43 7 3

Actual % of

beneficiaries45 3 39 9 4

Source: WFP Dacota

* Beneficiary share not available for PRRO 200063 as activity was implemented in Feb. 2011

2007 2008 2009 2010 2011

Gross Requirements 185.5 331.6 339.5 357.0 385.3

Direct Expenses* 133.7 204.8 206.6 168.8 n.a

Gap 51.8 126.7 132.9 187.9 n.a

D. Exp. Vs. Requirements (%) 72% 62% 61% 47% n.a

Source: WFP ODXR Unit (2010 figures from ODXR PoW 18 August 2011); APR 2010 and 2008 (*).

Gross Requirements: Needs (USD, millions); Direct Expenses (USD, millions): Excludes PSA costs. *2009 & 2010 expenses are according to IPSAS and not comparable to 2008 & previous years' values based on UNSAS.

Requirements vs. Direct Expenses - Afghanistan (USD, millions)

10

the inception phase. Collectively, the questions aim at highlighting the key lessons from the

WFP country presence and performance, which will inform future strategic and operational

decisions.

29. Question 1: What has been the strategic alignment of the WFP portfolio, including the

extent to which:

its main objectives and related activities are relevant to the humanitarian and

developmental needs of the Afghanistan population;

its strategies and objectives have been aligned with those of government and NGO’s

in Afghanistan;

its operational activities have been aligned with international good practices for non-

state providers (NSPs) working in fragile/conflict states, e.g. peace-building and or

humanitarian objectives;

its strategies and operational activities have been aligned with those of relevant

humanitarian and development partners in order to achieve complementarity of

interventions at policy and operational levels?

30. Question 2: What have been the factors driving strategic decision-making, including the

extent to which WFP:

has analysed the national food security, nutrition, livelihoods and gender context and

appropriately targeted its interventions using this analysis;

has sufficient technical expertise (either internal or through partnership) to

strategically manage the different interventions under the portfolio;

has development and implemented appropriate monitoring and evaluation systems

to support strategic decision making;

has been driven by external funding and or political factors to alter its portfolio from

the original design;

has strategically adjusted its operational implementation in response to changing

needs of the populations, funding, partner, security and other circumstances?

31. Question 3: What have been the performance and results of the WFP portfolio, including:

the efficiency, effectiveness and probable impact of the relief13, recovery14 and

capacity building15 components of the portfolio;

5. Evaluation Approach

5.1. Evaluability Assessment

Evaluability is the extent to which an activity or a programme can be evaluated in a reliable and

credible fashion. It necessitates that a policy, intervention or operation provides: (a) a clear description

of the situation before or at its start that can be used as reference point to determine or measure

13 Relief components include emergency food assistance, the urban social safety net, and MCHN.

14 Recovery components include food for assets, food for education and food for training, and WFP’s support for the

national tuberculosis programme.

15 Capacity building components include the development of community grain storage facilities and a national strategic

grain reserve, flour fortification and support to data collection systems.

11

change; (b) a clear statement of intended outcomes, i.e. the desired changes that should be observable

once implementation is under way or completed; (c) a set of clearly defined and appropriate indicators

with which to measure changes; and (d) a defined timeframe by which outcomes should be occurring.

32. The relief and recovery operations implemented during the evaluation period are

designed with specific outputs and outcomes. These are detailed in the planning and

reporting documents for each operation and catalogued in WFP data systems available at

both the country and headquarter levels. To this extent, these operations are evaluable

against stated outcomes. The special operation is generally supportive of the PRROs and is

evaluable at the output (efficiency) level. The P4P operation is designed with its own set of

outputs and outcomes and is thus evaluable against its planned targets.

33. The evaluation will build upon a wide range of secondary data available in Afghanistan.

Within each government ministry of relevance there exists data sets of relevance, often done

in partnership with WFP and other bilateral or multi-lateral agencies. The Central Statistics

Organization16 regularly conducts surveys of relevance and the National Risk and

Vulnerability Assessment and associated secondary analysis will be especially important.

The Afghanistan Research and Evaluation Unit17, an independent research/evaluation

organization based in Kabul, has a number of on-going research projects as well as a

catalogue of many research publications of relevance to this evaluation. In addition a

number of one-off studies or surveys have been done by non-state agencies in areas of

relevance to this evaluation. A key preparatory task for the evaluation is to review and analyse

existing secondary data and determine the data and information gaps that exist in order to fully

answer the evaluation questions.

34. The security and access issues, especially for expatriate consultants, will mitigate the

extent to which the evaluation team can observe relevant operational areas. It is expected

that the evaluation team will a) rely on secondary data to a greater extent because of this

context, b) gather primary qualitative data from a wide range of stakeholders in areas that

are accessible, and c) utilize Afghani technical and evaluation experts (or sub-contracted

institutions) as key members of the team.

35. Finally, the framing of the WFP operations as a ‘portfolio’ does not necessarily reflect

how the WFP manages its work. Within WFP operations are the singular focus and

managed relatively independently. In addition and from WFP’s operational perspective,

activities from one operation are often perceived distinct from similar activities in another

operation. However, from past evaluation experience the concept of a ‘portfolio’ closely

matches the perspectives of community, partners and donors and for evaluation purposes it

is useful in evaluation questions of strategic alignment, strategic decisions, and achievement

of outcomes.

5.2. Methodology

36. The evaluation will employ relevant internationally agreed evaluation criteria including

those of coverage, relevance, coherence (internal and external), efficiency, effectiveness,

impact, sustainability and connectedness.

16 http://www.cso.gov.af/

17 http://www.areu.org.af/Default.aspx

12

37. During the inception phase, the evaluation team will design the evaluation methodology

to be presented in the inception report. The methodology will:

examine the logic of the portfolio and on the common objectives arising across

operations;

utilize a thorough stakeholder analysis done during the preparation and inception

phases;

be geared towards addressing the evaluation questions/sub-questions using

triangulation and analysis of both quantitative and qualitative data. The evaluation

matrix, presented as part of the inception report, will be a key organizing tool for the

evaluation;

take into account the limitations to evaluability pointed out in 5.1 as well as budget and

timing constraints.

38. The methodology should demonstrate impartiality and lack of biases by relying on a

cross-section of information sources (e.g. stakeholder groups, including beneficiaries, etc.)

and using a mixed methodological (e.g. quantitative, qualitative, participatory) to ensure

triangulation of information through a variety of means. The sampling technique to

impartially select field sites to be visited must be specified in the inception report.

5.3. Quality Assurance

39. WFP’s evaluation quality assurance system (EQAS) is based on the UNEG norms and

standards and good practice of the international evaluation community (ALNAP and DAC).

It sets out processes with in-built steps for quality assurance and templates for evaluation

products. It also includes quality assurance of evaluation reports (inception, full and

summary reports) based on standardised checklists. EQAS will be systematically applied

during the course of this evaluation and relevant documents provided to the evaluation

team. The evaluation manager will conduct the first level quality assurance, while the OE

Director will conduct the second level review. This quality assurance process does not

interfere with the views and independence of the evaluation team, but ensures the report

provides the necessary evidence in a clear and convincing way and draws its conclusions on

that basis.

40. The evaluation team will be required to ensure the quality of data (validity, consistency

and accuracy) throughout the analytical and reporting phases. To further enhance the

quality and credibility of this evaluation, external reviewer(s) will provide further quality

assurance to the process and will comment on the draft inception and evaluation reports.

6. Organization of the Evaluation

6.1. Phases and Deliverables

41. The evaluation will be implemented over a 10 month period in 2012. As is typical for

WFP’s Country Portfolio Evaluations, the evaluation will proceed through five phases (see

Annex 3 for more detail including the dates for deliverables). The inception phase may

involve a briefing of the evaluation team in Rome, but this could be moved to Afghanistan

depending on the evaluation team location. This is followed by an inception mission (team

leader and evaluation manager) to Afghanistan. An inception report, finalized in this phase,

13

provides the detail for conducting the evaluation fieldwork and addressing the terms of

reference, in addition to an analysis of available secondary data. The fieldwork phase is

anticipated to require 3-4 weeks and will involve primary and additional secondary data

collection. Given the seasonal conditions in Afghanistan, the fieldwork will start no earlier

than March 2012. The analysis and reporting phase concludes with a final evaluation report

that will be presented to WFP’s Executive Board in November 2012. Figure 3 summarizes

the provisional evaluation schedule.

Figure 3: Provisional evaluation timeframe

6.2. Evaluation Team

42. The evaluation will be conducted by a team of independent consultants with relevant

experience and expertise for the WFP Afghanistan portfolio. This evaluation requires a

range of subject and evaluation expertise as indicated below and summarized in Table 5.

Evaluation questions 1 and 2 are concerned with issues related to humanitarian

response management, working in fragile/conflict states, food assistance targeting

and intervention design, and monitoring and evaluation. It is expected that two

technical experts will be required to cover these areas (and indeed may have

expertise and experience overlapping with other areas). Thus, one specialist focused

upon humanitarian response management, and the second focused on monitoring and

evaluation (including targeting) will be required for the evaluation team. The

evaluation team leader will likely be a specialist in one of the above areas in addition to

having overall responsibility for implementing the evaluation.

Evaluation question 3 is focused upon the results of the WFP portfolio and will rely

primarily on secondary data analysis and primary qualitative data collection. Given

the overall focus of WFP activities, one evaluation specialist in education within the

Afghanistan context and another with livelihoods expertise and experience in

Afghanistan will be required for the evaluation team. Given the prevalence of

Phase Activities Jan Feb Mar Apr May June July Aug Sept Oct Nov

Inception

briefing in Rome/Kabul x

inception mission x

final inception report x

Fieldwork

Kabul x

area offices x x

intervention sites x x

partners x x

x

Reporting

analysis of data x x x

draft evaluation report x x

final evaluation report x

Executive Board summary x

management response x

EB presentation x

Aide-memoire

14

malnutrition in Afghanistan and the interest of the WFP Country Office in working

with partners on nutrition policies, strategies and operations, nutrition expertise and

experience is also required to compliment that of livelihoods and education18. It is

anticipated that these three areas of expertise will also contribute to evaluation

question 1 and provide a nuanced analysis of the humanitarian and development

context, including the challenges and opportunities in the education, nutrition and

livelihoods domains.

It is expected that Afghani national consultants will be an important part of the

evaluation team, potentially covering 2-3 of the technical specialties. Evaluation

specialists from Afghanistan can be recruited independently or with the assistance of

the evaluation manager. For the conduct of the primary data collection, and

dependent on security and access issues, it may be necessary to hire either an

independent research firm in Afghanistan or a select group of evaluation assistants

with the requisite expertise and language skills to carry out certain focus group

discussions and key informant interviews.

Table 5: Evaluation team expertise required

43. The following specific qualifications are required:

Team leader

o Post-graduate degree in a relevant area with preferred specialty knowledge

and experience in either humanitarian/relief operations or food security or

nutrition.

o At least 10 years experience managing research and evaluations, either as an

independent consultant or within an organization.

o At least 10 years (consecutive with above) leading teams of people in a multi-

stakeholder, multi-cultural environment and a track record of producing

results therein.

18 The Country Office intends to scale down the education-related interventions and scale up those of nutrition; thus the

nutrition expertise of the evaluation team will be the priority.

Expertise Expertise and experience required Key evaluation questions covered

Team leader

One technical area (below) plus significant prior experience with evaluation within

the UN system all

Humanitarian

response

management

Good practices in humanitarian response; international experience in complex

emergencies; international humanitarian/development organization management;

emergency preparedness and response planning; peace-building and capacity

building 1 & 2

Monitoring and

evaluation

Intervention targeting systems/issues; general poverty, livelihood and food

security indicators; vulnerability assessment mapping (VAM), Afghanistan's

National Risk and Vulnerability Assessment (NRVA) and other relevant data sets in 1&2 (contribution to 3)

Education and

school feeding

School feeding; the education sector in Afghanistan; education system

development and capacity building 3 (contribution to 1)

Livelihoods

Livelihood systems & coping strategies in Afghanistan; post-conflict and transition

livelihoods; food for assets and food for work programmes; disaster risk reduction 3 (contribution to 1)

Nutrition

MCHN operations; anthropometry; household nutrition; gender and nutrition;

international nutrition standards; food fortification 3 (contribution to 1)

15

o Demonstrable skills (through prior work and professional education or

accreditation) in evaluation methodology

o A track record of publication and excellent English language writing and

presentation skills

o Ability to work in difficult and insecure conditions

Subject specialists

o Significant (at least 5 years) demonstrable expertise (through work experience

and education) in at least one of the areas of food security, nutrition,

humanitarian response, conflict/fragile state governance, and monitoring and

evaluation.

o at least 5 years experience in research and or evaluation, either as an

independent consultant or as part of this function in an organization

o A track record of written work on similar assignments

o Ability to work in difficult and insecure conditions

6.3. Roles and Responsibilities

44. This evaluation is managed by WFP’s Office of Evaluation with Mr. Ross Smith as the

evaluation manager. The evaluation manager (EM) is responsible for drafting the TOR;

selecting and contracting the evaluation team; preparing and managing the budget; setting

up the review group; organizing the team briefing in HQ; assisting in the preparation of the

field missions; conducting the first level quality assurance of the evaluation products and

consolidating comments from stakeholders on the various evaluation products. The EM will

also be the main interlocutor between the evaluation team, represented by the team leader,

and WFP counterparts to ensure a smooth implementation process.

45. WFP stakeholders at CO, RB and HQ levels are expected to provide information

necessary to the evaluation; be available to the evaluation team to discuss the programme,

its performance and results; facilitate the evaluation team’s contacts with stakeholders in

Afghanistan; set up meetings and field visits, organise for interpretation if required and

provide logistic support during the fieldwork. A detailed consultation schedule will be

presented by the evaluation team in the Inception Report.

6.4. Communication

46. In order for this evaluation process to be an effective learning process, the evaluation

team will emphasize transparent and open communication with evaluation stakeholders.

The evaluation terms of reference and relevant research tools will be summarized to better

inform stakeholders about the process of the evaluation and the expectations of them. The

Office of Evaluation will assist in translation of summary documents as needed, including

the terms of reference, aide-memoire, etc. in order to facilitate dissemination to stakeholders.

47. The Office of Evaluation will make use of data sharing software to assist in

communication and file transfer with the evaluation team and the WFP country office. In

addition, regular tele-conference and one-on-one telephone communication between the

evaluation team, the evaluation manager, and the WFP country office focal point will assist

in discussing any issues.

16

48. The evaluation inception report and final reports shall be written in English. It is

expected that the evaluation team, with the team leader providing quality control, produce

written work that is of very high standard, evidence-based, and free of errors. Translation

of the summary ToR and summary evaluation report will be done as necessary.

49. The final evaluation will be presented to WFP’s Executive Board, along with the

official management response to key recommendations. Thereafter it will be posted on

WFP’s internet, both internally and externally, and incorporated into the Office of

Evaluation’s annual report. In addition the EM and the WFP Country Office will produce

appropriate dissemination products, such as summarized presentations, lessons learned

briefs, and other products that can be extracted from the collected data, e.g. case studies.

6.5. Budget

50. The evaluation will be financed from OE’s Programme Support and Administrative

budget. Based on the team composition presented in section 6.2., the associated

remuneration (daily fees), the cost of international and domestic travel, etc. the total cost of

the evaluation is expected to be US$ xxx.

51. The WFP Afghanistan office has agreed to support the costs of in-country travel and

security arrangements during the fieldwork in Afghanistan [to be discussed / confirmed]. The

exception to this would be the costs borne by a local research/evaluation firm that organizes

its own logistics for data collection [to be discussed / confirmed].

17

Annexes

Annex 1: Map

18

Annex 2: WFP Strategic Plan 2008 – 2013

STRATEGIC OBJECTIVE ONE: SAVE LIVES AND PROTECT LIVELIHOODS IN

EMERGENCIES

Goals

1. To save lives in emergencies and reduce acute malnutrition caused by shocks to below

emergency levels

2. To protect livelihoods and enhance self-reliance in emergencies and early recovery

3. To reach refugees, internally displaced persons (IDPs), and other vulnerable groups and

communities whose food and nutrition security has been adversely affected by shocks

Main Tools

• General and targeted food assistance and emergency nutrition interventions

• Emergency needs assessments

• Emergency logistics, special operations, and information and communications technology

(ICT) capacity

• United Nations cluster leadership for logistics and emergency ICT

STRATEGIC OBJECTIVE TWO: PREVENT ACUTE HUNGER AND INVEST IN

DISASTER PREPAREDNESS AND MITIGATION MEASURES

Goals

1. To support and strengthen capacities of governments to prepare for, assess and respond to

acute hunger arising from disasters

2. To support and strengthen resiliency of communities to shocks through safety nets or

asset creation, including adaptation to climate change

Main Tools

• Vulnerability analysis and mapping

• Early warning products and tools

• Disaster preparedness and mitigation programmes

• Programmes to help communities reinforce their essential food and nutrition security

systems and infrastructures, as well as their adaptability to climate change – including

voucher, cash and food-based safety nets

STRATEGIC OBJECTIVE THREE: RESTORE AND REBUILD LIVES AND

LIVELIHOODS IN POST-CONFLICT, POST-DISASTER OR TRANSITION

SITUATIONS

Goals

1. To support the return of refugees and IDPs through food and nutrition assistance

2. To support the re-establishment of livelihoods and food and nutrition security of

communities and families affected by shocks

19

3. To assist in establishing or rebuilding food supply or delivery capacities of countries and

communities affected by shocks and help to avoid the resumption of conflict

Main Tools

• Targeted programmes that facilitate the re-establishment of livelihoods

• Special operations to rebuild essential hunger-related infrastructure

• Food distribution programmes that facilitate re-establishment of food and nutrition

security

• Voucher and cash-based programmes that facilitate food access

• Capacity strengthening for the re-establishment of community service infrastructure

STRATEGIC OBJECTIVE FOUR: REDUCE CHRONIC HUNGER AND

UNDERNUTRITION

Goals

1. To help countries bring undernutrition below critical levels and break the

intergenerational cycle of chronic hunger

2. To increase levels of education and basic nutrition and health through food and nutrition

assistance and food and nutrition security tools

3. To meet the food and nutrition needs of those affected by HIV/AIDS, tuberculosis and

other pandemics

Main Tools

• Mother-and-child health and nutrition (MCHN) programmes

• School feeding programmes

• Programmes addressing and mitigating HIV/AIDS, tuberculosis and other pandemics

• Policy and programmatic advice

STRATEGIC OBJECTIVE FIVE: STRENGTHEN THE CAPACITIES OF COUNTRIES TO

REDUCE HUNGER, INCLUDING THROUGH HAND-OVER STRATEGIES AND

LOCAL PURCHASE

Goals

1. To use purchasing power to support the sustainable development of food and nutrition

security systems, and transform food and nutrition assistance into a productive investment

in local communities

2. To develop clear hand-over strategies to enhance nationally owned hunger solutions

3. To strengthen the capacities of countries to design, manage and implement tools, policies

and programmes to predict and reduce hunger

Main Tools

• WFP’s procurement activities

• Hand-over of WFP hunger tools

• Policy and programmatic advice

• Advocacy

20

Annex 3: Timing, phases and deliverables

Policy Evaluation – Phases, Deliverables and Timeline Key Dates

Phase 1 - Preparation

Desk review, first draft of TOR and quality assurance

Circulation of TOR and review

Preparatory mission to Country (Evaluation manager and team

leader)

Identification and recruitment of eval team Jan 30. 2012

Final TOR Dec. 30, 2011

Phase 2 - Inception

Briefing core team at WFP HQ Early Feb. 2012

Inception mission Late Feb. 2012

Review documents and draft inception report including methodology.

Submit draft inception report to OE Mid-March 2012

OE quality assurance and feedback

Revise inception report

Submit revised inception report to OE End-March 2012

OE shares inception report with stakeholders for information

Phase 3 – Evaluation Mission

Briefing April 1, 2012

Field work April 2012

Debriefing

Aide memoire/In-country Debriefing May6/7, 2012

Phase 4 - Reporting

Draft evaluation report

Submit Draft evaluation report to OE May 30, 2012

OE quality feedback

Revise evaluation report

Submit revised evaluation report to OE June 30, 2012

OE share evaluation report with stakeholders (working level)

OE consolidate comments

Revise evaluation report

Submit revised evaluation report to OE July 15, 2012

OE circulates the Executive Summary to WFP’s Executive Staff

OE consolidate comments

Revise Executive Summary of evaluation report

Submit final evaluation report to OE July 30, 2012

Phase 5 Executive Board and follow-up

Editing / translation of summary report

Preparation of Management response

Preparation of evaluation brief and dissemination of reports

Presentation of evaluation summary report to the EB November 2012

Presentation of management response to the EB

21

Annex 4: Afghanistan WFP 2009 – 2010 Portfolio

P A P A P A P A

PRRO 200063

Enhancing

Resilience and

Food Security

in Afghanistan

Apr 10 -

Mar 13240,783 145,267 5,455,745 4,279,682 474,738,685 67,912,111 1,100,364,923 454,969,125 41% 15%

Support people affected by conflict and

disaster, IDPs and vulnerable groups

such as malnourished children and

pregnant and lactating women whose

food security has been adversely

affected by shocks; support re-

establishment of livelihoods affected by

shocks through support for basic

education and skills training, especially

for girls and women; improve the

success of TB treatment.

1-5 School feeding,

GFD, HIV/AIDS

and TB,

therapeutic and

supplementary

feeding, MCH,

FFW/FFT

SO 200092

Provision of

Common

Humanitarian

Air Service to

UN Agencies,

NGOs and

Counterparts

in Afghanistan

Jan 10 - Dec

11_ _ _ _ _ _ 39,726,786 27,844,278 70% _

Provision of a safe,

and cost-effective air transport service

for over 700 United Nations

Agencies, NGOs, diplomatic missions

and other humanitarian and

development actors, contributing to

development and reconstruction

activities in Afghanistan

_ _

SO 107080

Provision of

emergency

telecommunic

ation service

to

humanitarian

community in

Afghanistan

Oct 07 -

Feb 08_ _ _ _ _ _ 323,212 323,212 100% _

Improve operational command/control

and coordination among humanitarian

agencies; Enhance staff security

through the establishment of a

common telecommunications

network and the provision of training

to support MOSS compliance by UN

agencies and NGOs.

_ _

SO 105140

United

Nations

Humanitarian

Air Service

Apr 06 -

Dec 09_ _ _ _ _ _ 67,404,174 56,767,123 84% _

Provide a safe, responsive, efficient and

cost-effective air transport service for

the humanitarian and development

community for the rehabilitation and

reconstruction

of Afghanistan; Provide the capability

for medical and emergency security

evacuation when required.

_ _

PRRO 104270

Post-Conflict

Relief and

Rehabilitation

in the Islamic

Republic of

Afghanistan

Jan 06 -

Mar 10276,556 214,071 5,546,819 6,066,173 457,586,534 381,945,149 877,317,083 688,552,577 78% 55%

Enhance food security and improve the

human and productive capital of

vulnerable Afghans in highly food-

insecure and remote areas, with

special emphasis on vulnerable women

and children.

1-5 SF, GFD, HIV/AIDS

and TB,

therapeutic and

supplementary

feeding, MCH,

FFW/FFT, C&V

% funded

Afghanistan 2009 - 2011 Portfolio description

Activities

Source: SPR, PD, Resource Situation (13 November 2011), Dacota

% funded: Actual $/ Planned $ = Confirmed Contributions / Approved contrib.

Food

Cost/

Total Cost

Objectives SO'sMT (thousands) Beneficiaries (thousands)Food cost Total WFP Cost

(USD, millions) (USD, millions)Operation

Operation

Title

Time

Frame

Annual Average Totals by project

22

Annex 5: Key stakeholders by project

Operation

NumberOperation Title Timing Beneficiaries Multi and Bilateral Funding donors

Cooperating International

Agencies

Operational Governmental

PartnersCooperating International NGOs

PRRO 200063

Enhancing Resil ience

and Food Security in

Afghanistan

Apr 10 - Mar 13

IDPs and returnees; FFW and

FFA beneficiaries, households

headed by disabled people or

widows; malnourished

children under 5 and

pregnant and lactating

women; Food for training and

food for education especially

among girls; support to

people under tubercolosis

programme

Australia, Belgium, Canada, Croatia, Finland,

Germany, India, Ireland, Italy, Japan,

Luxembourg, Netherlands, New Zeland, Poland,

Romania, Russian Federation, Saudi Arabia,

Slovenia, Spain, Switzerland, U.K., U.S.A.

FAO, WHO, UNHCR,

UNICEF

Ministry of Agriculture,

Irrigation and Livestock, the

Ministry of Rural

Rehabilitation and

Development, the Ministry of

Education, the Ministry of

Public Health, the Ministry of

Labour, Social Affairs, Martyrs

and Disabled and the Ministry

of Refugees and Returnees.

Action Contre la Faim, Aga Khan

Foundation, Aga Khan Health

Services, Aide Medicale

Internationale, Associazione Pro

Bambini di Kabul, BRAC, Care

International, Danish Afghan

Commitee, German Leprosy and TB

Relief Association, Health Net TPO,

German Medical Services,

International Medical Corps, Mercy

Malasya, Medair, Norwegian Afghan

Commitee, Save the Children

International, Tearfund

SO 200092

Provision of Common

Humanitarian Air

Service to UN Agencies,

NGOs and Counterparts

in Afghanistan

Jan 10 - Dec 11 _

European Commission, Japan, USA

_ _

SO 107080

Provision of emergency

telecommunication

service to humanitarian

community in

Afghanistan

Oct 07 - Feb 08 _

UN CERF UNOPS, UNHCR,

UNICEF, UNDP, FAO,

WHO, UNAMA, World

Bank, and the Asian

Development

Bank

_

Agency for Technical

Cooperation and Development

(ACTED),

Action Aid, Aide Medicale

Internationale (AMI), CARE

International, Catholic Relief

Services (CRS), Danish

Committee for

Aid to Afghan Refugees

SO 105140

United Nations

Humanitarian Air

Service

Apr 06 - Dec 09 _

Canada, Germany, Japan, Norway, Spain,

UN CERF, USA _ _

PRRO 104270

Post-Conflict Relief and

Rehabilitation in the

Islamic Republic of

Afghanistan

Jan 06 - Mar 10

Foof for Work, Cash for Work

and Food for Training

beneficiaries; beneficiaries of

Food For Education for

Increased Enrolment and

Nutrition; monthly rations for

teacher training;TB patients;

beneficiaries for

supplementary feeding;

Australia, Belgium, Canada, Croatia, Denmark,

European Commission, Faroe Islands, Finland,

France, Germany, Greece, Iceland, India,

Ireland, Italy, Japan, Lithuania, Luxembourg,

Netherlands, New Zealand, Norway, Poland,

Qatar, Romania, Russian Federation, Saudi

Arabia, Spain, Sweden, Switzerland, UN Cerf, UN

Common Funds and Agencies, U.K., USA

FAO, UNAMA, UNDP, the

United Nations

Environment

Programme (UNEP),

UNHCR, UNICEF, UNOPS,

WFP and WHO

Ministry of the Economy,

Ministry of Education,

Ministry of Women’s Affairs,

Ministry of Transport,

Ministry of Health, Ministry of

Agriculture, Animal

Husbandry and Food, Ministry

of Rural Rehabilitation and

Development

Aga Khan Health Services, BRAC,

Care International, German Medical

Srevices, International Medical

Corps, Leprosy Control Organization,

Medair, Mercy Malasia, Save the

Children International, Norwegian

Afghan Commitee, Solidarite

Afghanistan Belgium

Source: Project documents, Resource Updates, http://home.wfp.org/NGO/index

23

Indicator Source

(2001)

(2010)

(1990-95)

(2010-15)

(1990)

(2010)

(2000)

(2010)Rank

(2000) UNDP HDR 2002

(2007)Rank

(2001) UNDP HDR 2001

(2010) UNDP HDR 2010

(2002)

(2008)

(2002)

(2008)

(2003)

(2008)

(2002)

(2008)

Income/food deficit status (LIFDC: Yes

or No)2011 FAO Country Profile

Mod & Sev Severe

33 y 12y

Prevalence of anaemia in < 5 (000) 2006WHO "Prevalence of

anemia ‘93-‘05"

(1990)

(2009)

Maternal Mortality rate (per 100,000

live births)(2000-2007) UNICEF SOWC 09

(2000) UNDP HDR 2002

(2010) UNDP HDR 2010

(2001)

(2009)

Public expenditures on health (% of

government expenditures)(2000-07) UNDP HDR 2009

Male Female

49x 18x

Annex 6: Core standard indicators

(2000-2008) 42% UNDP HDR 2010

70%

y/x: Data refer to years or periods other than those specified in the column heading, differ from the standard definition or refer to only part

of a country. Such data are included in the calculation of regional and global averages

Mod & Sev

9y

59y

Mod & Sev (2003-09)

Educ

atio

n

Literacy Rate Youth

(15-24 y) (%)

UNICEF SOWC 11

UNICEF SOWC 11

1600

UNICEF SOWC 11

a: population figures are based on the 2006 projection from the 2004 revision from the United Nations Population Division.

UNDP HDR 2010(2008) 52

(2003-09)

Population not using improved water

source (%)

(2004-08) UNICEF SOWC 09

Life expectancy at birth42.6

44.6

Weight-for-age (Underweight),

prevalence for < 5 (%)

People l iving with HIV - Adults +

Children (estimate)

_

5732

Weight-for-height (Wasting),

prevalence for < 5 (%)(2003-09)

Height-for-age(Stunting), prevalence

for < 5 (%)

UNAIDS Global AIDS

Epidemic Report 2010_

83

Pove

rty

Population living below National

poverty l ine (%)

Food

Sec

urity Yes

Prevalence of undernourishment (% of

total population)(2000)

< 5 mortality rate (per 1000 live births)250

UNICEF SOWC 11199

FAO The State of Food

Insecurity in the World

2002

Heal

thN

utrit

ion

Econ

omic

Gini Index_

_

GDP per capita (PPP US$)

Annual GDP growth rate14.3

158

World Bank. WDI.3.4

Agriculture as % of GDP45%

World Bank. WDI.29%

World Bank. WDI.362

GNI per capita (US$)490

World Bank. WDI.860

Core Standard Indicators for Country Context - Afghanistan

DataGe

nera

l

Population (total, mill ions)26.7

World Bank. WDI.34.3

Average annual growth (%)7.3

UNDP HDR 20103.2

Urban Population (% of total)18.1

UNDP HDR 201022.6

Human Development Index 0.349 UNDP HDR 2010

155

Gender- related Development index_

0.310UNDP HDR 2009

154

_

24

Annex 7: Factsheet

Timeline and funding level of Afghanistan portfolio operations

Operation Title Time Frame

EMOP

200366

Relief food assist. for

drought-affected

popul. in northern

Afghanistan

Oct 11 - Sep 12Req: $93

mill ion

PRRO

200063

Enhancing Resilience

and Food Security in

Afghanistan

Apr 10 - Mar 13

SO 200092

Provision of Common

Humanit. Air Service

to UN Ag., NGOs and

Counterparts in Afgh.

Jan 10 - Dec 11

SO 107080

Provision of

emergency telecom.

service to

humanitarian

community in Afghan.

Oct 07 - Feb 08

SO 105140

United Nations

Humanitarian Air

Service

Apr 06 - Dec 09

PRRO

104270

Post-Conflict Relief

and Rehabilitation in

the Islamic Republic of

Afghanistan

Jan 06 - Mar 10

P4P Purchase for Progress Mar 10 - Mar 15

M F M F M F M F M F M F

2,467,675 2,262,834 3,450,009 3,314,867 4,521,773 4,173,494 4,734,855 4,291,055 3,397,888 3,158,159 n.a n.a

Source: las t SPR avai lable, Resource Si tuation (3 October 2011), APR 2006 - 2010

Requirements (Req.) and Contributions (Contrib.) are US$ mi l l ions

2006

114,515

94.8

4%

4,730,509

2007

217,008

133.7

5%

6,764,876

Beneficiaries (actual)

Total of Beneficiaries (actual, thousands)

Food Distributed (MT)

Direct Expenses (US$ millions)

5%

9,025,910

Req: $67,404,174 Contrib: $57,624,699

2008

248,807

204.8

6%

8,695,267

% Direct Expenses: Afghanistan vs. World

2010

6,556,047

145,267

168.8

4%

Req: $1,100,364,923

Contrib: $454,967,745

Req: US$ 31,114,170

2011

n.a

n.a

n.a

n.a

2009

275,955

206.6

Req: $323,212

Contrib: $323,212

Req: $877,317,083 Contrib: $688,552,577

Req: $39,726,786

Contrib: $27,844,278

LEGEND

Funding

Level

> 75 %

Between 50

and 75%

Less than

50 %

2013

2015

2012

Education Nutrition GFD Cash* FFW/FFA/FFT HIV

PRRO 200063 X X X X X X

Planned % of

beneficiaries43 4 43 7 3

Actual % of

beneficiaries45 3 39 9 4

PRRO 104270 X X X X X X

Planned % of

beneficiaries59 5 18 1 15 2

Actual % of

beneficiaries59 1 20 1 18 1

Source: WFP Dacota

*Beneficiary share not available for PRRO 200063 as activity was implemented in Feb.2011

Activities by operation and beneficiary share

58%

5%

23%

1% 11% 2%

Education 58%

Nutrition 5%

GFD 23%

Cash 1%

FFW/FFA/FFT11%

% of planned beneficiaries by

Top 5 donors: USA, Japan, India, United Kingdom, Australia

Partners: Government of Afghanistan, 7 International Agencies and 80 NGOs

25

Annex 8: Library

Library for Afghanistan Country Portfolio Evaluation Author Date Pages

1 - Documents relative to the evaluation exercise

WFP Evaluation Policy WFP OE 16

Code of Conduct for Evaluation in the UN System UNEG 8

Impacts evaluations and Development - NONIE Guidance Frans Leeuw, Jos Vaessen

A - Evaluation Quality Assurance System

Inception Report

Template + Quality Checklist WFP OE

Evaluation Report

Template + Quality Checklist WFP OE

Technical Notes

TN - Stakeholders Analysis UNICEF

TN - evaluation matrix The Road to Results, G. Mora, Ray C.

TN - Logic Model Real World Evaluation, M. Bamberger, J. Rygh

TN - Evaluation team members work plan and proposed stakeholders meeting WFP OE

B - Terms of Reference

2 - Government Documents

Afghanistan Nationa Development Strategy 2008-2013 Islamic Republic of Afghanistan 2008 259

Afghanistan Millennium Development Goals Report 2010 Islamic Republic of Afghanistan Oct-10 60

Agriculture Prospects Report 2011 Ministry of Agriculture, Irrigation and Livestock May-11 17

Summary of the National Risk and Vulnerability Assessment 2007/08 GoA & EU 2007 24

Agriculture Prospects Report 2009 Ministry of Agriculture, Irrigation and Livestock May-09 21

Poverty Status in Afghanistan Ministry of Economy Jul-10 90

Joint Evaluation of the Paris Declaration Phase 2: Islamic Republic of Afghanistan Ministry of Finance 2010 66

Response to Global Monitoring Report, The hidden crisis: Armed Conflict and Education Ministry of Education 2011 10

The National Strategic Education Plan Ministry of Education Aug-10 19

Fact Sheet GoA 2011 1

Health and Nutrtion Sector Strategy Ministry of Health Feb-08 92

Strategic Plan for the Ministry of Public Health (2011-2015) Ministry of Health May-11 63

3 - WFP Afghanistan

A - Operations

See sheet "Operations" (SPRs, PD, Budget, Budget Revisions, LTSH Matrices, etc) WFP

B - Evaluations

Evaluation Report of Afghanistan – PRRO 10427.0 Post Conflict Relief and Rehabilitation in the Islamic Republic of

AfghanistanWFP Oct-09 198

Summary Report of Evaluation Report of Afghanistan – PRRO 10427.0 WFP Oct-09 16

Management Response to the recommendations of the summary evaluation report AFGH PRRO 104270 WFP Jan-10 9

Strategic Evaluation of WFP's Contingency Planning 2002-2008 WFP Oct-09 100

Evaluation of Afghanistan PRRO 10233WFP Apr-04 61+annexes

Review of the UNJLC Core unitWFP May-04 13

Review of the United Nations Joint Logistics Centre (UNJLC) Operations in AfghanistanWFP Sep-03 7

26

C - Assessment Reports

A Regional View of Wheat Markets and Food Security in Central Asia - with a focus on Afghanistan and Tjikistan WFP/FEWSNET Jul-11 35

Afghanistan - National Risk and Vulnerability Assessment 2007/8EU Oct-09 155

Northern Wheat Trader Survey and Afghan Food SecurityWFP/FEWSNET Aug-07 50

National Risk and Vulnerability Assessment 2005Ministry of Rural Rehabilitation and

Development Kabul Jun-07 187

Afghanistan - Market Price Bulletin WFP Aug-11 5

D - Strategic Review Reports

Review of WFP School Feeding in Afghanistan WFP Aug-11 65

Review of the Wet Feeding Pilot Project Afghanistan (2009 – 2010) WFP Jan-10 38

A Strategic Review of World Food Programme (WFP) Operations in Afghanistan WFP May-11 52

4 - WFP Docs

A - Policies

WFP Strategic Plan 2008 to 2013 WFP May-08 23

WFP Strategic Plan 2006 to 2009 WFP Jun-05 43

Programme Category Review WFP Jun-10 17

Strategic Results framework (related to WFP Strategic Plan 2008-2013) WFP Jan-09 15

Implementation Action Plan for Capacity Development and Hand-Over 2010-2013 WFP 2010 17

Consolidated framework of WFP policies WFP Oct-09 35

Gender Policy - Policy Brief WFP 2

WFP Gender Policy WFP Feb-09 15

Food Aid and Livelihoods in Emergencies Strategies for WFP (2003) WFP May-03 14

Food for Nutrition : mainstreaming nutrition in WFP, 2004 WFP Apr-04 17

Nutrition in emergencies : WFP experiences and challenges, 2004 WFP Apr-04 17

Micronutrient fortification : WFP experiences & ways forward, 2004 WFP Apr-04 16

School Feeding Policy WFP Oct-09 27

Vouchers and cash transfers as food assistance instruments : opportunities and challenges WFP 01-Oct 20

Disaster and risk reduction (DRR) Policy WFP Jan-09 21

HIV/AIDS Policy (for EB approval) WFP Jun-10 1

School Feeding Policie: Investment Case Manual WFP 23

B - Evaluations

Summary Report of the Evaluation of WFP's Capacity Development WFP Office of Evaluation Apr-08 14

Management Response to Evaluation of WFP's Capacity Development Policy and Operationes WFP Office of Evaluation May-27 9

Management Response Effectiveness of WFP Livelihood WFP Office of Evaluation May-09 10

Summary Report of the Strategic Evaluation of the Effectiveness of WFP Livelihood Recovery WFP Office of Evaluation Apr-09 14

Thematic Evaluation of the Protracted Relief and Recovery Operation (PRRO) Category WFP Office of Evaluation Feb-04 131

Thematic Review of Targeting in WFP Relief Operations WFP Office of Evaluation Nov-05 176

WFP-UNHCR Joint Evaluation of the Pilot Food Distribution Projects WFP Office of Evaluation Jan-06 76/160

Support to Information Systems for Food Security FAO, WFP Office of Evaluation Oct-09 190

C - General Docs

Memorandun of Understanding between UNHCR and WFP WFP Juk-02 16

Water Harvesting for improved drought preparedness using Food for Assets WFP Oct-08 41

27

D - Nutrition

WFP Food and Nutrition handbook WFP N/A 130

WFP Nutrtition Product Sheet WFP Oct-11 2

The right food at the right time WFP Jun-11 15

Mother and child nutrition (MCHN) WFP 9

WFP NUTRITION IMPROVEMENT APPROACH WFP Jul-10 23

Food for Nutrition : mainstreaming nutrition in WFP, 2004 WFP Apr-04 17

E - HIV

The evolution of Food Assistance for HIV care and treatment 2000 to 2009; A decade of institutional innovations WFP 2009 20

Getting Started: HIV, AIDS and gender in WFP programmes WFP Jun-06 40

Food Assistance Programming in the Context of HIV WFP Sep-07 278

F - School Feeding

Sustainable School Feeding: Lifting school children out of the hunger trap WFP Nov-09 17

Rethinking School Feeding WFP/WB 2009 188

WFP and WB Partnership: A New Approach to School Feeding WFP Dec-09 6

New Approach to School Feeding WFP N/A 5

Transition Strategy for Sustainable School Feeding WFP N/A 24

School Feeding Cost Tools WFP 11

School feeding and nutrition 2010 WFP 5

G - Refugees

Refugees WFP 5

Joint assessment guidelines WFP/UNHCR Jun-04 216

MOU (Memorandum of understanding)WFP/UNHCR Jul-02 14

H - Food Security

FSMS Indicators Compendium WFP May-10 71

FSMS technical guidance WFP May-10 86

I - Capacity Development

Policy on Capacity Development WFP Oct-09 16

Operational Guide to Strengthen Capacity of Nations to Reduce Hunger (2010) WFP Mar-10 132

J - Beneficiary Definition

Guidance Note on Beneficiary Definition Counting WFP 11

5 - Afghanistan documents from external sources

1 - UNDP

Assessment of Development Results, Evaluation of UNDP contribution Afghanistan UNDP May-09 150

Evaluation of UNDP assistance to conflict affected countries - Case study Afghanistan UNDP 2006 57

UNDP Afghanistan 2010 Annual Report UNDP 2010 24

Police Perception Survey, 2009 the Afghan Perspective UNDP 2009 65

Assessment of Development Results Repost, Afghanistan UNDP May-09 150

Baseline Study of Pilot Democratic Policing UNDP Mar-10 46

Afghanistan Westrern Regions Update UNDP Jul-10 6

United Nations Development Assistance Framework 2010-2013 in support to the Afghanistan National Development

StrategyUNDP 2010 30

Afghanistan Human Development Report UNDP 2007 173

2 - UN AFGHANISTAN

Common Country Assessment 2004 UNAMA 2004 89

Protection of Civilians in Armed Conflict - Afghanistan Annual Report UNAMA Mar-11 70

Children and Armed Conflict - Visit of the Special Representative for Children & Armed Conflict to Afghanistan UNAMA Feb-10 15

Harmful Traditional Practices and Implementation of the Law on Elimination of Violence against Women in

AfghanistanUNAMA Dec-10 62

The situation in Afghanistan and its implications for international peace and security UNAMA Mar-08 18

28

3 - FAO

Strengthening National Seed Production Capacity in Afghanistan FAO 2007 61

Price Monitoring and Analysis Country Brief Jan-Apr 2011 FAO Jan-11 2

Global Forest Resources Assessment - Afghanistan FAO 2010 32

4 - UNHCR

Afghanistan Situation Operationa Update UNHCR Sep-09 10

Study on cross border population movements between Afghanistan and Pakistan UNHCR Jun-09 76

Shelter Update UNHCR Feb-09 2

National Profile of Internal Displaced Persons (IDPs) in Afghanistan UNHCR Aug-08 50

Estimated Population - 2012 - 2013 and Expected Refugee Returnees - 2009 - 2013 to Selected Areas/districts -

AfghanistanUNHCR 1

UNHCR Afghanistan Global Appeal 2010-2011 UNHCR 2010 4

UNHCR Afghanistan Global Report 2010 UNHCR 2010 4

5 - UNAIDS/WHO

Country Progress Report UNAIDS Mar-10 77

Epidemiologial FactsheetUNAIDS/WHO 2009 3

Afghanistan Health Profile WHO 2009 2

Global Report 2010 UNAIDS 2010 364

Country Cooperation Strategy for WHO and Afghanistan WHO 2006 107

Country Cooperation Strategy at Glance WHO Mar-11 2

Sexual and Reproductive Health in Protracted Crises and Recovery UNFPA/WHO Sep-09 21

Immunization Profile - Afghanistan WHO Jul-11 4

6- UNDAF

United Nations Development Assistance Framework In Support to the Afghanistan National Development

Strategy 2010-2013UNDAF 32

United Nations Development Assistance Framework (UNDAF) for the Islamic Republic of Afghanistan 2006-2008 UNDAF 2006 62

7 - FEWSNET

Afghanistan Food Security Outlook April to September 2011 FEWSNET 2011 6

Afghanistan Price bulletin August 2011 FEWSNET 2011 3

Labor Markets, Liuelihood Strategies and Food Security in Afghanistan FEWSNET May-07 49

The Contribution of Regional Markets to Afghan Wheat Supplies FEWSNET May-07 6

Livelihood zone map FEWSNET Feb-11 1

8 - Others

Afghanistan Research Newsletter Afghanistan Research and Evaluation Unit Jan-2011 32

UNOPS AGOC Monitoring and Evaluation Services UNOPS 6

Land Issues and Poverty Reduction - Requirements for Lasting Peace in Sudan and Afghanistan IFPRI 2007 4

Afghanistan Politics, Elections and Government Performance Congressional Research Service Jan-10 32

Afghanistan Provincial Briefs World Bank Jun-11 80

The hidden crisis: Armed Conflict and Education UNESCO 2011 420

Islamic Republic of Afghanistan: Poverty Reduction Strategy Paper - Progress Report IMF

6 - Reports

Afghanistan Country Profile Economist Intelligence Unit 2008 25

Afghanistan Country Report Economist Intelligence Unit 2011 20

Afghanistan Report NATO 2009 42

Aid and Conflict in Afghanistan International Crisis Group Aug-11 34