BRACE Impact EvaluationPhase II – Upper Nile & Western Bahr el

Ghazal

BRACE: “Building Resilience through Asset Creation and Enhancement”FFA: ‘Food For Assets’ in 4 states – Northern

Bahr el Ghazal & Warrap State (Phase I), Upper Nile & Western Bahr el Ghazal (Phase II)

Funded by:

Through:

Implemented by: Local Partners

BRACE Impact EvaluationFunded by:

Implemented in South Sudan by:

Supported from Geneva by:

BRACE Impact Evaluation Phase II – Upper Nile – April 2013Counties: Akoka, Fashoda, Longochuk,

Luakpiny/Nasir, Melut, Malakal, Ulang counties

Total household level interviews: 3,040Treatment locations: 1,520Control locations: 1,520

Teams: Nuer (10), Dinka (10), Shilluk (10)

BRACE Impact Evaluation Phase II – Upper Nile TeamElisabeth Vikman – Project ManagerFarah Abdessamad – Assessment ManagerAriane Petretti – GIS/Database InternDragomir Draganov – Base Manager3 Assessment Teams each including

Assessment Team Leader (1)Community Focal Point (1)Assessment Assistants (8)Driver (1)

BRACE Impact Evaluation Phase II – Upper Nile – Assessment Team Leader Role

Lead the Assessment Team in conducting household surveys in a timely and efficient manner

Communicate and clarify the field manual, including methodology and procedures, to Assessment Team members in the field

Manage accommodation arrangements as agreed with Assessment Manager Develop familiarity with the field manual including methodology and procedures Develop familiarity with questionnaire and data collection tool (smart phone) Protect and care for smart phone and any other survey equipment Conducting household interviews as a member of the Assessment Team while

closely following the field manual Conducting focus group discussions with community members closely following

the field manual Record GPS coordinates, location information and respondent answers carefully

and accurately on smart phone and/or paper form Liaising with community leaders and informing communities about the objective

and scope of the survey while ensuring that the correct information is shared to avoid misunderstandings  

Ensuring coordination, cooperation and clear communication with the Assessment Manager at all times

Raise questions and report issues to the Assessment Manager as they arise

BRACE Impact Evaluation Phase II – Upper Nile – Community Focal Point Role

Liaising with community leaders and informing communities about the objective and scope of the survey while ensuring that the correct information is shared to avoid misunderstandings  

Develop familiarity with the field manual including methodology and procedures Develop familiarity with questionnaire and data collection tool (smart phone) Protect and care for smart phone and any other survey equipment Conducting household interviews as a member of the Assessment Team while

closely following the field manual Conducting focus group discussions with community members closely following

the field manual Record GPS coordinates, location information and respondent answers carefully

and accurately on smart phone and/or paper form Communicate and clarify the field manual, including methodology and

procedures, to Assessment Team members in the field Ensuring coordination, cooperation and clear communication with the

Assessment Team Leader at all times Raise questions and report issues to the Assessment Team Leader as they arise

BRACE Impact Evaluation Phase II – Upper Nile – Assessment Assistant Role

Develop familiarity with the field manual including methodology and procedures Develop familiarity with questionnaire and data collection tools (smart phones) Protect and care for smart phones and any other survey equipment Conducting household interviews as a member of the Assessment Team while

closely following the field manual Record GPS coordinates, location information and respondent answers carefully

and accurately on smart phones and/or paper form Ensuring coordination, cooperation and clear communication with the

Assessment Team Leader and/or Community Focal Point in the field at all times Raise questions and report issues to the Assessment Team Leader and/or

Community Focal Point as they arise Informing communities about the objective and scope of the survey while

ensuring that the correct information is shared to avoid misunderstandings  

ScheduleWhen What WhoToday – 8:30 am – 5:30pm Training ALLFriday 5 April – 8:30am – 5:30pm

Training ALL

Saturday 6 April – 8:30am – 5:30pm

Pilot ALL

Sunday 7 April DAY OFFMonday 8 April – 8:30am Data collection ALL

On Mission – A day in the field TREATMENT Location – a site which has been chosen for WFP FFA

implementation CONTROL Location – a site where no FFA has taken place in the past 12

months***Make sure you know WHICH location you are interviewing at!***

Each team will follow the same procedure;

• Arrive at TREATMENT LOCATION• Find community leaders• Explain who we are:

We’re working for ACTED We’re doing an evaluation of food security in Upper Nile We will return to the area a 2nd and a 3rd time to gather more information Anything people tell us will be confidential – we will report what we find but not

who told us We have no control over food distributions – if respondents tell us there is lack of

food that does not mean food distributions will take place and if they tell us there is plenty of food that does not mean that food distributions will not take place

On Mission – A day in the field Ask for a community that can act as CONTROL LOCATION – this

should be:1. Nearby2. Similar3. NOT have participated in WFP FFA activities in the past 12

months

CFP or ATL MOVES with 4 Assessment Assistants to CONTROL location 1 x Focus Group Discussion and 4 x 5 = 20 Household Interviews

CFP or ATL STAYS with 4 Assessment Assistants at TREATMENT location and does: 1 x Focus Group Discussion and 4 x 5 = 20 Household Interviews

On Mission – Selecting households to interview TREATMENT Location – a site which has been chosen for WFP FFA implementation CONTROL Location – a site where no FFA has taken place in the past 12 months

Step 1: At the site where focus group discussion is being held, EACH assessment assistant to drops her/his pen on the ground.

Step 2: Ask the key informants how long it would take to reach the LAST household by footing IN THE DIRECTION THAT THE PEN IS POINTING.

If NO households are located in that direction, drop the pen again and repeat until you find a direction in which households are located

Step 3 – scenario A: If key informants say that the LAST household is located LESS than 1 hour away, say for example 20 minutes, walk in the direction of the pen to the LAST household and COUNT ALL households on the way.

Step 3 – scenario B: If key informants say that the LAST beneficiary household is located MORE than 1 hour away, walk for 1 hour only, in the direction of the pen and COUNT ALL households on the way.

Step 4 – scenario A: Interview the LAST household that you reach

Step 4 – scenario B: After walking for 1 hour and counting all households you pass, stop and interview the NEAREST beneficiary household

On Mission – Selecting households to interviewsStep 5: Divide the total number of houses you counted in Step 3 by 5 (minimum number of interviews) EXAMPLE 1: You pass 30 houses – 30 / 5 = 6 EXAMPLE 2: You pass 5 houses – 5/5 = 1

Step 6: Once your first interview is completed, return towards your starting point, interviewing every NTH household (for example, if 30 houses passed, interview every 6TH household – if 5 houses passed, interview every household)

***If THIS IS THE 2ND LOCATION OF THE DAY and you don’t think you can complete 5 interviews on that day:Ask the key informants to ESTIMATE the number of households you would pass in 1 hour IN THE DIRECTION OF THE PEN (or less, if the LAST household is less far than 1 hour away) – then divide that number by 5, and interview every NTH household you pass in the direction of the pen. When you return the day after to complete the interviews, follow STEPS 1 - 6 above, IN THE SAME DIRECTION you followed the previous day

***If no respondent is present at the selected household, go to the nearest household in the direction you are following until you find a respondent

***IF YOU ARE INTERVIEWING AT A TREATMENT LOCATION: If a household DOES not include a member aged AT LEAST 18 years of age who is able/willing to work – go to the next household in the direction you are following until one is found that includes a member aged at least 18

***IF YOU ARE INTERVIEWING AT A CONTROL LOCATION: If a household HAS received FOOD in return for WORK in the past 12 months – go to the next household in the direction you are following until one is found that includes an 18-year old able to work – DO NOT interview households participating in FFA at control locations

***Remember: the respondent does NOT need to be household head but has to be someone who knows about household expenditure and food consumption and MUST be aged at least 15

On Mission - introductions Who we are and what we do

We’re working for ACTED

We’re doing an evaluation of food security in Upper Nile

We will return to the area a 2nd and a 3rd time to gather more information

Anything people tell us will be confidential – we will report what we find

but not who told us

We have no control over food distributions – if respondents tell us there is

lack of food that does not mean food distributions will take place and if

they tell us there is plenty of food that does not mean that food

distributions will not take place

On Mission – definitions HH (HH) members = a group of people who routinely eat out of the same pot and live on

the same compound (or physical location). It is possible that they may live in different

structures. Sharing the pot is the unifying factor for HHs.

HH Head (HHH) = a member of the HH who manages the family resources and

decisions (He/She is the final decision maker on most decisions related to income

allocation and major family activities).

Respondent = the person representing the household that you are interviewing, this can

be the household head but can also be another HH member who knows about food and

expenditure

Food AID = food received without giving anything in return

Food for Work/Food for Assets = food received in return for work on community assets

On Mission – logistics DurationTOIL – Time off in lieuMission allowanceAccommodation – safeTime-keepingSafetyAssets

Finally...Do you know your individual IDs?Is the time and date set on your phone?Do you know how to limit battery

consumption?Any questions?