APR Workshop 2010-M&E-TG2 - annual outcome survey

I- What is the annual outcome survey and why to do it?

The annual outcome survey is a simple household survey that will be undertaken annually by project staff and will cover a small sample of 200 households selected randomly.

The survey will be conducted exclusively in villages targeted by the project or receiving project interventions, and will include both project beneficiaries and non beneficiaries (the latter used as control group).

Overall, the exercise is expected to take no more than 3 months and can be implemented by project staff and extension officers, with or without external support.

The main objectives of the survey are to: (i) measure changes happening at the household level in terms of livelihoods and food security during the project life; (ii) assess targeting efficiency; (iii) provide evidence of project success or failure; and (iv) provide timely performance information necessary to undertake corrective actions.

II- How and when to conduct the survey?

Annual outcome surveys should be conduced every year starting from the 2nd year of implementation.

The survey should be implemented in conjunction with qualitative assessments that will complement the household-level information, providing information on “why” and “how” some outcomes were or were not achieved. This means that in each village, in addition to the household interviews, the team should conduct a certain number of focus group (FG) discussions and key informant (KI) interviews (see TG 3 and TG 4 for more details on qualitative assessments).

The figure below provides an overview of the survey design. The figure shows that the field data collection teams will go to 20 villages, and in each village they will conduct 10 household interviews as well as focus groups and/or key informant interviews. The number of qualitative interviews to conduct will be decided by the project (number in the figure below given as examples).

TECHNICAL GUIDELINES No2Conducting an annual outcome survey

TECHNICAL GUIDELINES No2Conducting an annual outcome survey

200 Household interviews10-15 Focus groups

10-15 Key informant interviews

200 Household interviews10-15 Focus groups

10-15 Key informant interviews

Village 1Village 1 Village 20Village 20

10 HH interviews

10 HH interviews

1 Focus group1 Focus group

2 Key informant interviews

2 Key informant interviews

10 HH interviews

10 HH interviews 2 Focus

groups2 Focus groups

1 Key informant interview

1 Key informant interview

TECHNICAL GUIDELINES No2 - Conducting an annual outcome surveyTECHNICAL GUIDELINES No2 - Conducting an annual outcome survey

II- How to prepare and conduct an annual outcome survey?

Overview:

Activity/step Estimated Duration

Comments Responsibility

1 Development of the questionnaire and interview guides for qualitative assessments (see TG 3 and 4)

1-3 days Can take longer if questions are added or modified from the standard template.

M&E officer, with inputs from component coordinators and project coordinator.

2 Selection of the sample

1-3 days Depending on availability of reliable lists.

M&E officer. Lists to be provided by project staff (villages) and local authorities (households).

3 Selection of enumerators and supervisors

5 days If possible, enumerators should be field officers and supervisor project staff.

M&E officer and project coordinator.

4 Training of enumerators and field testing of questionnaire and qualitative assessment guides

1-2 days The training should include a session on sampling.

M&E officer and external consultant if any.

5 Logistical planning, preparation for data collection

1-2 days M&E officer and Project coordinator.

6 Data collection 1-3 weeks Depends on availability of cars/motorbikes.

Project coordinator for supervision, extension workers for data collection.

7 Data entry 1-2 weeks If Excel file is used, data entry can only be conducted by one person at a time.

M&E officer for supervision, assistant for data entry.

8 Data analysis 1 week M&E officer with support from external consultant (if any).

9 Report writing 1 week M&E officer, with inputs from component coordinators and project coordinator.

10 Communication and sharing

ad hoc events

Project coordinator, M&E and KM officer.


A standard questionnaire is given in Annex V. Some parts of the questionnaire (highlighted in yellow) must be adapted by the project staff according to the context of the project.

The questionnaire can either be used is as it is or be modified according to the specific information needs of the project. Some guidance on how to modify the questionnaire is given in Annex II.

The administration of the questionnaire should not take more than 30 minutes per household.

The sampling frame (ie. population from where the sample is selected) is the list of villages targeted by the project. This list should be available at project level.

The sample will be composed of 200 households (20 villages, 10 households per village).

The selection of the sample is done in two stages: (1) Selection of 20 villages; and (2) Selection of 10 households in each village.

The same sampling frame will be used every year, but the sample selection will be re-done every year. This means that different villages and different households will be surveyed each year

There are two options:

Option A: If all villages covered by the project have identical socio-economic conditions, random selection can be done.

Option B: If there are different groups of villages with different characteristics (for example some villages are located in the lowlands, others in the highlands; or some villages are poorer than others), then the stratified sampling methodology needs to be used.

Option A: Random selection of 20 villages

Write down the list of all the villages targeted by the project, in alphabetical order, and give them a number from 1 to total number of villages.

Example : The project ABC targets 212 villages, listed below in alphabetical order.

Number Village1 Banora

Step 1 - Developing the questionnaireStep 1 - Developing the questionnaire

Step 2 - Selecting the sampleStep 2 - Selecting the sample

Step 2 - Stage 1: Selection of 20 villagesStep 2 - Stage 1: Selection of 20 villages


2 Boubere3 Boukaria4 Diarendli5 Kolla6 Loppe Soun…………

209 Vienza210 Vouk211 Watagan212 Winso

Calculate the Sampling Interval (SI) according to the formula below:

SI = total number of villages/20.

Round up if the decimal is 0.5 or greater. Round down if the decimal is less than 0.5.

Example :

SI = 212/20 = 10.6

Select a Random Number (R) between 1 and SI. To find a random number, you can use the Excel function Rand (type “=rand()” in an Excel worksheet) which gives a random number comprised between 0 and 1, and multiply this number by SI to get a number between 1 and SI.

Round up if the decimal is 0.5 or greater. Round down if the decimal is less than 0.5.

Example :

Typing “rand()” on an Excel spreadsheet we get the number 0.54. We multiply this number by SI.

R = 0.54 * SI = 0.54 * 11 = 5.94.

Select the Rth village from the list. This is the first village selected for your sample. Add the sampling interval (SI) and select the next village. This is the second village selected for your sample. Add again the sampling interval and go to the next village, which will be your third village. Continue like this until you reach 20 villages. If you get to the end of the list, just continue from the beginning.

Example:

SI = 11

R = 6

The 6th village (Dsik) is selected

The 17th village (Loufta) is selected

The 28th village is selected

R = 6

6 + SI = 6 + 11 =17

17 + SI = 17 + 11 = 28

Etc.


Number Villages Selected?1 Banora No2 Boubere No3 Boukaria Yes (20th)4 Diarendli No5 Doussoura No6 Dsik Yes (1st)7 Farabat No8 Fardia No9 Fomma No10 Gaghaty No11 Gogta No12 Kalenko No13 Kolla No14 Loppe Soun No15 Lansanaya No16 Lenny Tiewi No17 Loufta Yes (2nd)… … …… … …… … …… … …204 Tambanao Yes (19th)205 Toukri No206 Tomokan No207 Ullih No208 Vienza No209 Vouk No210 Watagan No211 Winao No212 Winsik No

The exercise is over and your list of 20 villages randomly selected is ready!

Option B: Selection of 20 villages through stratified random sampling

Identify groups or clusters of villages, looking at their main characteristics.

Example :

Stratified village categories Nb of villagesLowland villages 90Highlands villages 122

Total 212

Sampling interval

1st village selected

Last village selected

If you reach the end of the list before getting 20 villages, continue from the beginning


Calculate the percentage in each group.

Example :

% Lowlands villages = ( 90 / 212 ) x 100 = 42 %% Highlands villages = ( 122 / 212 ) x100 = 58 %

This tells us that, out of a sample of 20 villages: - 42% should be villages in the lowlands (8 villages) - 58% should be villages in highlands (22 villages)

From there on, apply the same methodology as explained in Option A above. Calculate the Sampling Interval (SI) according to the formula below:

SI = total number of villages/8 [Lowlands villages] SI = 26SI = total number of villages/22 [Highlands villages SI = 7

For the next steps, you will random select the villages using two separate lists of villages (corresponding to your two categories of villages).

Etc.

Once you have the list of 20 villages where you will go to collect data, you will need to select randomly 10 households in each village.

Two options exist for selecting households in the villages, described below.

Option 1 is similar to the method for selection of the villages. It is preferred over option 2. However, it requires having a reliable list of all households living in the selected villages. If this information is not available, option 2 can be applied. Option 2 is cheaper and faster than option 1.

Choosing the appropriate method for household selection will depend on the information available and the logistic, time and resources constraints.

More detailed information on sampling procedures is given in Annex III.

Option 1

In each village, each household is given a unique number (no two households can have the same number).

Example: In the village there are 35 households, such that households are numbered 1 to 35.

A sampling interval (SI) is calculated, by dividing the total number of households by 10. Round up if the decimal is 0.5 or greater. Round down if the decimal is less than 0.5.

Example: 35/10=3.5, SI=4.

Step 2 - Stage 2: Selection of 10 households in each selected villageStep 2 - Stage 2: Selection of 10 households in each selected village


As in the selection of the villages, a random number between 1 and SI is selected (for example, you can write numbers from 1 to 4 on small pieces of paper, fold them and ask someone to pick one paper).

Example: The number 2 was picked. The household number 2 of the list is selected as the first household. Then we add 4 (the sampling interval) and select the next household (household number 6). Add again 4 and so on until you reach 10 households.

Option 2

Once the data collection team arrives in the village, the approximate center of the village is identified. A pencil or bottle is spun to select a random walking direction (also called a transect line).

The data collection team then counts the number of households encountered along the transect line between the centre and the perimeter of the cluster (end of the village). This number is divided by 10 (total number of household needed in our case) to determine the interval at which households will be selected in the transect line.

When the transect line contains less than the number of households required, all households in the line are included in the sample and the data collection team returns to the center of the cluster to pick a second random walking direction and the process is repeated.

This may require returning to the center and repeating the process as for transects with fewer than the number of required households.

Source: WFP sampling guidelines for vulnerability analysis, ODAV (VAM) – WFP, Rome, December 2004


Training and field testing of the questionnaire

The survey team will consist of enumerators and their supervisors. It is recommended that each team should consist of three enumerators and one supervisor (see below).

Training and field testing must be organized with all enumerators and supervisors before going to the field.

The training should include sessions on: (i) questionnaire comprehension and interviewing skills; (ii) sampling procedure for selection of the households in the villages; (iii) how to conduct key informant interviews.

The duration of the training can vary from one to two days, and the training can be conducted in the project office.

The training should include field testing of the data collection tools (questionnaire and interview guidelines), the purpose being to verify that all questions are clear and easy to understand by the respondent. If necessary, the questionnaire should be revised after training and field testing. The revision must involve the trainees who did the field testing.

Selecting the enumerators and supervisors

The data collection should be undertaken by 3 teams, each team being composed of 1 enumerator and 1 supervisor.

The 3 teams will go to the first 2 villages together, and a debriefing will take place the next day to discuss and agree on possible corrective actions to take for the rest of the data collection exercise.

Then each team will go to 6 villages, and stay one day in each village.

The entire data collection should therefore take approximately 10-15 days if all teams can work at the same time, and if transportation from one village to the other is not too long. More days will be needed if there is only one car/motorbike available and if villages are very far from each other.

Day 1 – 2 -3:

Day 4:

Day 5 - 15

Data collection teams

Data collection teams

1 supervisor (project staff)

1 enumerator (field officer)





6 villages6 villages




Debriefing and preparation for field work

Step 3 – Conducting the surveyStep 3 – Conducting the survey


Logistical planning and preparation for data collection

The following material is needed for the data collection exercise:

Cars or motorbikes to go to the villages (ideally 3 so that all teams can work contemporaneously)

Hardcopies of the questionnaires (plan for approx. 10 additional copies per team in case of need)

6 copies of the present guidelines (one for each team member) Pens and plastic folders to carry the questionnaires

Data collection

Household surveys

The respondent should be the head of household or any person designated by him/her.

If there is no respondent in the household (e.g. head of household is absent and the other people do not want or cannot respond), the team should proceed to the next selected household.

See do & don’ts for interviewers in Annex IV.

Role of the supervisor

Throughout the fieldwork, the supervisor will be responsible for observing interviews and provide assistance to enumerators when needed.

Supervisors should also make sure that questionnaires are reviewed for completeness, legibility and consistency, during the field work (so that eventual corrections can be made while in the village).

Entering the data

An Excel file is provided to facilitate data entry and data analysis.

In the database, each row corresponds to a household (ie. a questionnaire), and each column correspond to a variable (ie. a question).

Analysing the data

The data will include beneficiaries and non-beneficiaries households since the selection of the households in the villages will be done randomly on all the households living in the village.

The results can be compared from year to year even though the same households will not be surveyed each year.

The expected outcomes of the project should guide the analysis of the data. Remember to look back at your performance questions and Logframe before starting the analysis and report writing. It will remind you what your analysis should focus on.

Step 4 – Analysing resultsStep 4 – Analysing results


Writing the report

The emphasis should be on the meaning and implications of the data analysis for the project, not on the methodological aspects (these can be put in annex).

The survey report should not be more than 10 pages.

Communicating and sharing the results

Once a first draft of the report has been prepared, the M&E officer must organize a ½ day workshop with the project team and main stakeholders to present the results of the survey and discuss the main issues.

Enumerators (project field staff) and supervisors must participate in the workshop.

After the workshop, comments can be integrated in the report and the final report must be sent to IFAD and other stakeholders.


ANNEXES

I - Modifying the questionnaire

The basis for developing your questionnaire should be the Logframe, which is supposed to tell you what the expected outcomes of each component are. If the Logframe is not clearly defined, the project staff should meet to identify the outcomes they are interested in tracking with the household survey. The design of the questionnaire is extremely important since the same questionnaire will be used along the project life (in order to be able to compare the results). Therefore make sure to insert all the information that you need to track outcomes.

-> How to translate the expected outcomes into indicators?-> From indicator to question in the questionnaire

Example:

One expected outcome is “Improved quality of the crops and sustainable operating conditions for small farmers”.

In order to know whether this outcome was achieved, the performance questions might be as follows:1 - “To what extent small farmers have improved the quality of their crops?”2 - “Do small farmers have a more secured and stable access to market?”

What kind of information do you need in order to answer these two questions? Information will be related to the quality of the crops and on how farmers are organized to sell their products. You may need information both at farmer (household) level and at community level (ie. talking to the marketing groups or community market institutions). Let’s focus on household level indicators (ie. that we can inform through household survey).

Possible indicators at household level are:1.1 - Number of farmers growing high value crops1.2 – Perception of the farmers on the quality of their crops1.3 - Perception of the farmers on the way project activities have improved their operating conditions 2.1 – Number of farmers who are part of a marketing group2.2 - Perception of the farmers on the ability of the group to improve their operating conditions2.3 - Perception of the farmers on the way project activities have increased the quality of the crops

Now that we have the indicators, we need to translate them into questions to insert in the questionnaire. One or more questions can be needed to inform one single indicator.1.1 – “Do you grow high value crops?” Y/N1.2 – “This year, did you improve the quality of your crops compared to last year?” Y/N1.3 - “Do you see any relation between your participation in project activities and the quality of your crops?” Y/N2.1 - “Please explain your answer”2.2 – “Are you part of a marketing group?” Y/N


2.3 – “Do you think that the fact that you are in this group has improved your operating conditions?” Y/N

When modifying the questionnaire, remember that:

Questions should be as clear as possible. Notes for enumerators must be inserted in italic in the questionnaire when the question may not be interpreted correctly, or to define a key term.

Each question should correspond to a precise information need. It must add value to the analysis without making it too complex.

Delete questions that are not related to your project activities (e.g. if your project has no micro-enterprise component, delete the section on micro-enterprises)

If you add a question, make sure to attribute a unique variable number (e.g. K1). If you delete a question, modify the variable numbers to make sure they are coherent

(e.g. if you delete E2, E3 becomes E2, E4 become E3 etc.) When you modify question numbers, check in the analysis file that the variable

numbers correspond to the questionnaire. The administration of one questionnaire should take no more than 30 minutes. 15-20

min is ideal. You can arrange the questionnaires by component (one section by component) instead

of by thematic as in the example.

II - Sampling

Probability sampling will be used for the survey, since it minimizes the risk of biased selection. This means that all target villages will have the same probability of being selected. In other words, villages located far away from the project office in a remote area will have as much probability to be selected as villages closer to the main urban centre and more easily accessible. This will increase the cost and duration of the survey (enumerators are likely to travel more) but will considerably increase the credibility of the results.

Probability sampling is opposed to convenience sampling, in which the prime consideration is accessibility: only those easily reached by interviewers are included in the sample. Convenience sampling does not permit generalization of the data.

To select the sample, the first thing you need is a sampling frame. The sampling frame is the list of villages that will be considered for inclusion in the sample. Since the survey will cover only villages who are participating in project activities, in our case the sampling frame will be composed exclusively of all the villages targeted by the project. A list of these villages should be available at project level.

For the selection of households in the village, sampling option 1 is recommended since it is more statistically rigorous, but it is feasible only if an accurate list of all households in the selected villages is available (or if a map can be drawn with the village leader indicating all the households). If a list can be obtained from a recent census or from local authorities, and if the villages are not too large in size, the survey team should use this option to select the households.

The second option for selecting households is the most rapid, but also the least preferred method. This method is commonly used in anthropometric surveys.

III - Interviewing skills: some do’s and don’ts for interviewers

DO test the interview schedule beforehand for clarity, and to make sure questions cannot be misunderstood.

DO state clearly what the purpose of the interview is.


DO assure the interviewee that what is said will be treated in confidence. DO ask if the interviewee minds if you take notes or tape record the interview.

DO record the exact words of the interviewee as far as possible. DO keep talking as you write. DO keep the interview to the point. DO cover the full schedule of questions. DO watch for answers that are vague and probe for more information. DO be flexible and note down everything interesting that is said, even if it isn’t on the

schedule. DON’T offend the interviewee in any way. DON’T say things that are judgmental. DON’T interrupt in mid-sentence. DON’T put words into the interviewee’s mouth. DON’T show what you are thinking through changed tone of voice.


IV – Questionnaire

The following standard questionnaire may be amended to capture the essence of your project interventions.

In so doing, irrelevant issues or questions should be deleted; and any additional questions can be added.

Changing the questionnaire will however have implications on the Excel database that IFAD has developed to facilitate data entry and analysis.

In case you will need support to amend this database to reflect the changes introduced in the standard questionnnaire, please contact the IFAD Asia and Pacific Division ([email protected]).

ANNUAL OUTCOME SURVEY

[Insert name of the project and country]

I Date (D/D/M/M/Y/Y/Y/Y) : /___/___/___/___/___/___/___/___/

II Name of the enumerator: ___________________________________________________

Note for enumerator : Before starting the interview, introduce yourself, explain what are the objectives of the survey and ask the person if he/she consents to respond to the questions. If not, go to the next household.

Circle codes corresponding to the answers in the right column.

A – HOUSEHOLD IDENTIFICATION

A.1 Village ____________________________ A.2 District or Province _______________________

A.3 Name of the head of household : ______________________________________________________

A.4 What is the gender (sex) of the household head? A. Male B. Female

A.5In terms of income group, in which of the following categories would you consider that your households belongs?:

A. Well off

B. Average

C. Poor

D. Very poor

B – PARTICIPATION IN PROJECT ACTIVITIES

B.1 Since when is your household involved in project activities (year)? /___/___/___/___/

B.2Over the last 12 months, were you (or any household member) involved

in any activity of the [insert name of the project]

A. Yes

B. No (->go to B4)

[Insert logo of implementing agency]QUESTIONNAIRE ID: /___/___/___/

B.3In which of the following project activities were you (or any member of your household) involved during the

past 12 months? [For each main set of activity below (e.g. “Forestry training”, circle the corresponding code]

B.3.1 - [Insert name of activity a] A. Yes B. No

B.3.2 - [Insert name of activity b] A. Yes B. No

B.3.3 - [Insert name of activity c] A. Yes B. No

B.3.4 - [Insert name of activity d] A. Yes B. No

B.3.5 - [Insert name of activity e] A. Yes B. No

B.3.6 - [Insert name of activity f] A. Yes B. No

B.3.6 - [ continue list of activities…] A. Yes B. No

B.4In general, regarding how your participation in project activities has

impacted on your living conditions, are you:

A. Very satisfied

B. Moderately satisfied

C. Not satisfied at all

B.5How often do you have contact with project staff (extension workers;

facilitators, etc.)?

A. Frequently

B. Occasionally

C. Rarely

C - LIVELIHOODS

C.1 Do you have a source of cash income?A. Yes

B. No (no cash income, only subsistence agriculture)

C.1.1 – Compared to last year (i.e. 12 months ago), would you say

that, this year, your income is:

A. Higher

B. Equal

C. Lower

C.2What is the main source of income of your household?

[Use codes below and write corresponding code on the right]

/_ __/

[One answer only]

[Adapt the response options below to the context of your project]

A. Agriculture and sales of crops

B. Fishing and sales of fish

C. Livestock and sales of animals

D. Natural resources

E. Petty trading

F. Unskilled labour

G. Salaries, wages (employees)

H. Handicraft

I. Remittances

J. Begging, assistance

K. Other (specify:

C.3 Do you have other sources of income? A. Yes B. No (-> go to D.1 )

C.3.1 - What are these other income sources for your household? /_ _ _/ ; /_ __/ ; /__ _/

[Use same codes as above ] [Max 3 answers]

D – FOOD SECURITY

D.1

Over the last 12 months, was there any period(s) during which you were

not able to provide 3 meals per day for your household (food shortage

period)?

A. Yes

B. No (-> go to D.2 )

D.1.1 - For how many weeks in total, over the last 12 months? /___/___/

D.1.2 – Was there an improvement as compared to previous year?

A. Some improvement

B. Same

C. Situation is worse

E – LAND TENURE

E.1 Do you own productive land (including fish ponds)? A. Yes B. No (-> go to E.2 )

E.1.1- What is the size of your land (in acres)? /_ __/__ _/ acres

E.2 Do you have property rights on a land? A. Yes B. No (-> go to F.1 )

E.2.1 - How secure do you consider your property rights?

A. Very secure

B. Moderately secure

C. Insecure

D. Very insecure

F - AGRICULTURAL PRODUCTION AND IRRIGATION

F.1 Do you cultivate land, and if so, for what purpose?

A. Yes, own consumption only

B. Yes, sales only

C. Yes, consumption and sale

D. No (-> go to F.5 )

F.1.1 - Do you grow high value crops? [provide definition of high

value crop] A. Yes B. No

F.1.2 - Compared to last year (i.e. 12 months ago), did the

productivity of your crops increase this year?

A. Yes B. No (-> go to F.2)

F.1.2.1 - How would you quantify this increase?

A. Small

B. Medium

C. Large

F.1.2.2 – Is this increase related to any project activity? A. Yes B. No

F.2 During the past 12 months, did you adopt any new agricultural A. Yes B. No (-> go to

production technology promoted by the project? F.3)

F.2.1 - Which one? [response options to be adapted by project]/____/ ; /____/

[Two answers maximum]


A. Technology a

B. Technology b

C. Technology c

D. Technology d

E. Technology e

F.3Compared to last year (ie. 12 months ago), this year, did your crop

production area increase:

A. Yes B. No (-> go to F.4)

F.3.1 - How would you quantify this increase?

A. Small

B. Medium

C. Large

F.3.2 – Is this increase related to any project activity? A. Yes B. No

F.4 Do you use irrigation system(s)? A. Yes B. No (->go to F.5)

F.4.1 - Did you manage to increase your irrigated area this year

compared to last year (i.e. 12 months ago)?

A. Yes B. No (->go to F.5)


A. Small

B. Medium

C. Large


F.5 Do you have access to a fish pond? A. Yes B. No (->go to F.6)

F.5.1 - Compared to last year (i.e. 12 months ago) did the

productivity of this fish pond increase this year? A. Yes B. No (-> go to F.6)


A. Small

B. Medium

C. Large


F.6 Do you own livestock? A. Yes B. No (->go to G.1)

F.6.1- Compared to last year (i.e. 12 months ago), is your herd A. Yes B. No (->go to

size larger this year? G.1)


A. Small

B. Medium

C. Large


G – ACCESS TO MARKETS

G.1 Do you get an income from sales of agricultural production? A. Yes B. No (->go to G.2)

G.1.1 - Compared to last year (i.e. 12 months ago), has your

income from sales of agricultural production increased?

A. Increased

B. Did not change

C. Decreased

G.1.2 - Do you have a contract for selling your production? A. Yes B. No (->go to G.2)

G.1.2.1 - Has this contract improved your financial

situation? A. Yes B. No

G.2Compared to last year (i.e. 12 months ago), has your physical access

to market improved this year?

A. Yes B. No

*******************************************************************************The following sections (H, I and J) are optional: they should be included in the

questionnaire only if the project is involved in activities related to the particular topic.

For example, if the project has a natural resources management component, include

the section on NRM (section J). Remove the sections that are not relevant to the project

H – ACCESS TO RURAL FINANCIAL SERVICES

H.1Did you (or any household member) borrow money over the last 12

months? A. Yes B. No (-> go to H .2 )

H.1.1 – What was the source of credit?

A. Informal (friends, NGOs, Cooperatives/credit group)

B. Formal (bank/micro-finance institution)

H.1.2 - How much did you borrow (total last 12 months)?

[Write the amount in the local currency]

/___/___/___/___/___/___/___/

[Currency]: _______________

H.1.3 – Have you repaid the amount borrowed?

A. Yes

B. Not yet, but soon

C. No, cannot repay

H.1.4 - What did you - or will you - use the money for?

[One answer: only the main use should be reported]

A. Consumption (food, clothes, ceremonies, etc.)

B. Income generating activities (tools; equipment, etc.)

C. Other investments (housing improvement, land acquisition; etc.)

D. Education

E. Health

H.2Overall, do you consider that, compared to last year (ie. 12 months ago),

your household has now a better access to financial services? A. Yes B. No

H.2.1 - Would you say this is related to any project activity? A. Yes B. No(-> go to I.1 )

I - ENTERPRISE DEVELOPMENT AND EMPLOYMENT

I.1Do you or any household member have a non-farm enterprise?

[Provide definition of non-farm enterprise e.g. handicraft activities] A. Yes B. No (-> go to I.2 )

I.1.1 – In addition to yourself, how many employees do you have?

A. No employee

B. One to two employees

C. Three to five employees

D. More than five employees

I.1.2 - Did the project help your household establish or expand

your enterprise/business?

A. Yes, establish

B. Yes , expand

C. No (-> go to I.2 )

I.2Did project help you find a job or improve your employment

conditions? A. Yes B. No

J – ACCESS TO NATURAL RESOURCES

[Section to adapt. Select only the parts that are relevant for your project activities.].

J.1 Do you have access to community fish ponds? A. Yes B. No (-> go to J.2 )

J.1.1 – Is this access regulated? A. Yes B. No

J.1.2 – Has your access to the fish ponds improved since last year? A. Yes B. No

J.1.3 – Do you consider that the productivity of the fish ponds has

improved as compared to last year? A. Yes B. No (-> go to J.2 )

J.1.3.1 - If yes, was it thanks to project activities? A. Yes B. No

J.2 Do you have access to marine fisheries? A. Yes B. No (-> go to J.3 )

J.2.1 – Is the access regulated? A. Yes B. No

J.2.2 – Has your access to marine fisheries improved since last

year?A. Yes B. No

J.2.3 – Do you consider that the productivity of the marine

fisheries has improved as compared to last year? A. Yes B. No (-> go to J.3 )

J.2.2.1 – If yes, was it thanks to project activities? A. Yes B. No

J.3 Do you have access to forest? A. Yes B. No (-> go to J.4 )


J.3.2 – Do you consider that your access to the forest has improved

as compared to last year?A. Yes B. No (-> go to J.4 )

J.3.3 – Do you consider that the productivity of the forest has

improved as compared to last year?A. Yes B. No (-> go to J.4 )


J.4 Do you have access to community pasture land? A. Yes B. No (-> end)


J.4.2 – Do you consider that your access to pasture land has

improved as compared to last year?

A. Yes B. No

J.4.3 – Do you consider that the productivity of the forest has

improved as compared to last year?A. Yes B. No (-> go to J.4 )


*************************************************************************************THIS IS THE END OF THE INTERVIEW, THANK YOU

QUESTIONNAIRE B

FOR NON BENEFICIARIES

This questionnaire is the same as questionnaire A except that it does not contain the questions related to project activities. The numbering should not be changed, so that same questions have the same number in both questionnaires.

C - LIVELIHOODS

C.1 Do you have a source of cash income?A. Yes

B. No (no cash income, only subsistence agriculture)

C.1.1 – Compared to last year (i.e. 12 months ago), would you say

that, this year, your income is:

A. Higher

B. Equal

C. Lower

C.2What is the main source of income of your household?

[Use codes below and write corresponding code on the right]

/_ __/

[One answer only]


A. Agriculture and sales of crops

B. Fishing and sales of fish

C. Livestock and sales of animals

D. Natural resources

E. Petty trading

F. Unskilled labour

G. Salaries, wages (employees)

H. Handicraft

I. Remittances

J. Begging, assistance

K. Other (specify:

C.3 Do you have other sources of income? A. Yes B. No (-> go to D.1 )

C.3.1 - What are these other income sources for your household?

[Use same codes as above ]

/_ _ _/ ; /_ __/ ; /__ _/

[Max 3 answers]

D – FOOD SECURITY

D.1

Over the last 12 months, was there any period(s) during which you were

not able to provide 3 meals per day for your household (food shortage

period)?

A. Yes

B. No (-> go to D.2 )

D.1.1 - For how many weeks in total, over the last 12 months? /___/___/

D.1.2 – Was there an improvement as compared to previous year?

A. Some improvement

B. Same

C. Situation is worse

E – LAND TENURE

E.1 Do you own productive land (including fish ponds)? A. Yes B. No (-> go to E.2 )

E.1.1- What is the size of your land (in acres)? /_ __/__ _/ acres

E.2 Do you have property rights on a land? A. Yes B. No (-> go to F.1 )

E.2.1 - How secure do you consider your property rights?

A. Very secure

B. Moderately secure

C. Insecure

D. Very insecure

F - AGRICULTURAL PRODUCTION AND IRRIGATION

F.1 Do you cultivate land, and if so, for what purpose?

A. Yes, own consumption only

B. Yes, sales only

C. Yes, consumption and sale

D. No (-> go to F.5 )

F.1.1 - Do you grow high value crops? [provide definition of high

value crop] A. Yes B. No

F.1.2 - Compared to last year (i.e. 12 months ago), did the

productivity of your crops increase this year? A. Yes B. No (-> go to F.2 )


A. Small

B. Medium

C. Large

F.2

During the past 12 months, did you adopt any new agricultural

production technology (e.g. promoted by government extension

services or by a donor-funded project)? A. Yes B. No (-> go to F.3 )

F.2.2 – How did you learn about this new technology?

A. Through government extension services

B. Through an NGO

C. Through donor-funded project

D. Through a neighbour/friend

E. On my own initiative

F.3Compared to last year (ie. 12 months ago), this year, did your crop

production area increase: A. Yes B. No (-> go to F.4 )

F.3.1 - How would you quantify this increase?

A. Small

B. Medium

C. Large

F.4 Do you use irrigation system(s)? A. Yes B. No (->go to F.5 )

F.4.1 - Did you manage to increase your irrigated area this year

compared to last year (i.e. 12 months ago)? A. Yes B. No (->go to F.5 )


A. Small

B. Medium

C. Large

F.5 Do you have access to a fish pond? A. Yes B. No (->go to F.6 )

F.5.1 - Compared to last year (i.e. 12 months ago) did the

productivity of this fish pond increase this year? A. Yes B. No (-> go to F.6 )


A. Small

B. Medium

C. Large

F.6 Do you own livestock? A. Yes B. No (->go to G.1 )

F.6.1- Compared to last year (i.e. 12 months ago), is your herd size

larger this year?A. Yes B. No (->go to G.1 )


A Small

B. Medium

C. Large

G – ACCESS TO MARKETS

G.1 Do you get an income from sales of agricultural production? A. Yes B. No (->go to G.2 )

G.1.1 - Compared to last year (i.e. 12 months ago), has your

income from sales of agricultural production increased?

A. Increased

B. Did not change

C. Decreased

G.1.2 - Do you have a contract for selling your production? A. Yes B. No (->go to G.2 )

G.1.2.1 - Has this contract improved your financial

situation? A. Yes B. No

G.2Compared to last year (i.e. 12 months ago) has your physical access to

market improved this?

A. Yes B. No

*******************************************************************************The following sections (H, I and J) are optional: they should be included in the

questionnaire only if the project is involved in activities related to the particular topic.

For example, if the project has a natural resources management component, include

the section on NRM (section J). Remove the sections that are not relevant to the project

H – ACCESS TO RURAL FINANCIAL SERVICES

H.1Did you (or any household member) borrow money over the last 12

months? A. Yes B. No (-> go to H .2 )

H.1.1 – What was the source of credit?

A. Informal (friends, NGOs, Cooperatives/credit group)

B. Formal (bank/micro-finance institution)

H.1.2 - How much did you borrow (total last 12 months)?

[Write the amount in the local currency]

/___/___/___/___/___/___/___/

[Currency]: _______________

H.1.3 – Have you repaid the amount borrowed?

A. Yes

B. Not yet, but soon

C. No, cannot repay

H.1.4 - What did you - or will you - use the money for?

[One answer: only the main use should be reported]

A. Consumption (food, clothes, ceremonies, etc.)

B. Income generating activities (tools; equipment, etc.)

C. Other investments (housing improvement, land acquisition; etc.)

D. Education

E. Health

H.2Overall, do you consider that, compared to last year (i.e. 12 months ago),

your household has now a better access to financial services? A. Yes B. No

I - ENTERPRISE DEVELOPMENT AND EMPLOYMENT

I.1Do you or any household member have a non-farm enterprise?

[Provide definition of non-farm enterprise e.g. handicraft activities] A. Yes B. No (-> go to J.1)

I.1.1 – In addition to yourself, how many employees do you have?

A. No employee

B. One to two employees

C. Three to five employees

D. More than five employees

I.1.2 - Did anyone help you establish or expand your enterprise or

business?

A. Yes (Establish)

B. Yes (Expand)

C. No

I.1.2.1 - If yes, who helped you?

A. Government extension services

B. An NGO

C. A donor-funded project

J – ACCESS TO NATURAL RESOURCES

[Section to adapt. Select only the parts that are relevant for your project activities.].

J.1 Do you have access to community fish ponds? A. Yes B. No (-> go to J.2 )


J.1.2 – Has your access to fish ponds improved compare to last

year?

J.1.3 – Do you consider that the productivity of the fish ponds

has improved as compared to last year (i.e. 12 months ago)? A. Yes B. No (-> go to J.2 )

J.2 Do you have access to marine fisheries? A. Yes B. No (-> go to J.3 )

J.2.1 – Is the access regulated? A. Yes B. No


year?

J.2.3 – Do you consider that the productivity of the fish ponds

has improved as compared to last year (i.e. 12 months ago)? A. Yes B. No (-> go to J.3 )

J.3 Do you have access to forest? A. Yes B. No (-> go to J.5 )



year?

J.3.3 – Do you consider that your access to the forest has

improved as compared to last year (i.e. 12 months ago)? A. Yes B. No (-> go to J.4 )

J.4 Do you have access to community pasture land? A. Yes B. No (-> end)


J.4.2 – Has your access to fish ponds improved compare to last year?

J.4.3– Do you consider that your access to pasture land has improved

as compared to last year (i.e. 12 months ago)? A. Yes B. No

*************************************************************************************THIS IS THE END OF THE INTERVIEW, THANK YOU

APR Workshop 2010-M&E-TG2 - annual outcome survey

Education

Transcript of APR Workshop 2010-M&E-TG2 - annual outcome survey