Post on 14-Jul-2020
Agenda
Welcome Remarks
Introduction
Overview of Measurement Options
Panel Discussion
Questions and Answers
Closing Remarks
Twitter info:
@USAID @REAL_Award
@USAIDFFP @FeedtheFuture
@TANGOInt @MercyCorps
#resilience
#resiliencemeasurement
#measuringresilience
Resilience and Resilience Capacities Measurement Options
November 8, 2018 at 9:00 – 10:30 am ET
Presenters and Panelists
Tiffany M. Griffin
Adviser, Monitoring, Evaluation, and Strategic Analysis
USAID Center for Resilience
RESILIENCE AND RESILIENCE CAPACITIES MEASUREMENT OPTIONS NOV 8, 2018
Katherine Arnold
Associate Director, Monitoring, Evaluation, and Learning
Dept. of Hunger and Livelihoods, Save the Children
Olga Petryniak
Senior Director, Global Resilience
Mercy Corps
Arif Rashid
Monitoring and Evaluation Team Lead
USAID Office of Food for Peace
Tim Frankenberger
President and Co-founder
TANGO International
Janina Mera
Monitoring and Evaluation Advisor
USAID Bureau for Food Security
Customized Standardization
• NOT an oxymoron!
• Context is important
• SOME uniformity has advantages
Practicality
• Documents designed with the users in mind
• Resource-intensity and 6 years of testing drove the options
Complement to Other Resources
• Guidance Notes
• Short Course Series/Webinars
• Evidence Briefs
• Assessment Tools
• Case Studies
Important Caveats / Considerations
• Food security-centric
• HH/Community-centric
• Resist the urge to adopt the “easiest” way forward
• Categories are not “fixed”
RESILIENCE AND RESILIENCE CAPACITIES MEASUREMENT OPTIONS
USAID-funded food security
activities require consistent and
context-specific ways to measure
resilience and resilience capacity
in order to ensure effective
resilience programming and
continuous improvement based
on evidence.
Resilience /Resilience Capacities
Measurement Options
Photo
cre
dit: Z
achar
ias
Abubeker/
Save
the C
hild
ren
Resilience/Resilience Capacities Measurement Options
USAID RESILIENCE AND RESILIENCE CAPACITIES MEASUREMENT OPTIONS NOVEMBER 2018
Resilience and Resilience
Capacities Measurement
Options
Household
QuestionnaireCommunity
Questionnaire
Methodological
Guidance
Enumerator
Guidance
• Provides an introduction to and comparison of several measurement approaches for analyzing resilience (i.e., Light, Intermediate, and Full), each of which reflects a different level of effort and budget in terms of the survey instrument and analysis used (i.e., number of questions asked and analyzed).
• Intermediate and Light approaches use subsets of the questions, responses, and analysis of the Full approach.
Save
the C
hild
ren
USAID RESILIENCE AND RESILIENCE CAPACITIES MEASUREMENT OPTIONS NOVEMBER 2018
Resilience/Resilience Capacities Measurement Options
Photo
cre
dit: T
AN
GO
Inte
rnat
ional
Full approach – resilience focus countries; full “menu” of
questions, responses, and analyses
Intermediate approach – programs in countries promoting
resilience but not resilience focus countries; subset from Full menu
Light approach – programs in countries that are not resilience
focus countries; minimal subset from Full menu
USAID RESILIENCE AND RESILIENCE CAPACITIES MEASUREMENT OPTIONS NOVEMBER 2018
Resilience/Resilience Capacities Measurement Options
Comparison of full, intermediate, and light approaches
USAID RESILIENCE AND RESILIENCE CAPACITIES MEASUREMENT OPTIONS NOVEMBER 2018
Protocol considerations for the Light, Intermediate and Full resilience approaches
NOVEMBER 2018USAID RESILIENCE AND RESILIENCE CAPACITIES MEASUREMENT OPTIONS
Household and Community Questionnaires
• Together, the household and
community questionnaires make up
the resilience instrument.
• Must be used in conjunction with
the FFP core questionnaire.
• In the FFP questionnaire, certain
modules or questions must remain
and others must be deleted when
used with the resilience
instrument.
• Replacement questions included in
an annex if not used with FFP
questionnaire.
USAID RESILIENCE AND RESILIENCE CAPACITIES MEASUREMENT OPTIONS NOVEMBER 2018
Photo
cre
dit: K
aryn
Fox, T
AN
GO
Inte
rnat
ional
Enumerator Guidance
• Provides specific instructions for enumerators to help them interpretquestions and responses in the household and community questionnaires.
• Not all questions are included:
− Yes/no questions that do not require further explanation.
USAID RESILIENCE AND RESILIENCE CAPACITIES MEASUREMENT OPTIONS NOVEMBER 2018
Methodological Guidance
• Provides specific instructions for calculating individual components of resilience capacity as well as the three resilience indices absorptive, adaptive, and transformative capacity and an overall resilience index.
• Represents the Full approach (i.e., complete “menu” of questions, responses, and analyses).
USAID RESILIENCE AND RESILIENCE CAPACITIES MEASUREMENT OPTIONS NOVEMBER 2018
Resilience Indices and Components of Resilience Capacity: Full Approach
USAID RESILIENCE AND RESILIENCE CAPACITIES MEASUREMENT OPTIONS NOVEMBER 2018
Methodological Guidance
USAID RESILIENCE AND RESILIENCE CAPACITIES MEASUREMENT OPTIONS NOVEMBER 2018
1. Access to cash savings. This indicator is a binary (dummy) variableequal to 1 if the respondent reported that a household memberregularly saves cash.
• Survey question: R601
2. Access to remittances. This indicator is a binary (dummy) variableequal to 1 if the respondent reported that the household receivesremittances.
• Survey questions: R1101, R1103, R1105, R1107
3. Asset ownership index. Asset ownership is measured using thenumber of consumer durables, productive assets, and livestock owned.
• Survey questions: BL H7.02, H7.03, R201, R201A
USAID RESILIENCE AND RESILIENCE CAPACITIES MEASUREMENT OPTIONS NOVEMBER 2018
Methodological Guidance
Thank You
TANGO International
Tim Frankenberger tim@tangointernational.com
www.fsnnetwork.org/REAL
resiliencemeasurement@gmail.com
Panel Discussion
Resilience M&E in Implementation
Examples from the Sabal program in Nepal
1) Inform program design and TOC
2) Inform M&E system and tools
- Baseline survey
- Routine monitoring
3) Review and revise TOC
4) Frame how we talk about resilience
Resilience M&E tools used to:
Ethiopia
PRIME
PRIME Ethiopia
Baseline and Counterfactual challenges…
PRIME Ethiopia
PRIME Post-Shock Measurement Framework
Nepal
PAHAL
PAHAL Nepal
PAHAL Models
PAHAL Nepal
PAHAL Models
PAHAL Nepal
PAHAL Measures of Resilience Strategies
Key Considerations
Questions
& Answers
Photo
cre
dit: T
AN
GO
Inte
rnat
ional
Photo
cre
dit: T
AN
GO
Inte
rnat
ional
Thank You
www.fsnnetwork.org/REAL
www.tangointernational.com
www.mercycorps.org/research/resilience
www.savethechildren.org