Opportunities for impact evaluation in the NAP process

16
Economics of Adaptation in Agriculture Opportunities for Impact Evaluation in NAP Process Ali Akram FAO, Impact Evaluation Expert Yale University

Transcript of Opportunities for impact evaluation in the NAP process

Page 1: Opportunities for impact evaluation in the NAP process

Economics of Adaptation in Agriculture

Opportunities for Impact Evaluation in NAP Process

Ali Akram FAO, Impact Evaluation Expert

Yale University

Page 2: Opportunities for impact evaluation in the NAP process

Structure• Context• Estimating climate change impacts on agriculture (Ricardian

technique)• Estimating impacts of adaptations (experimental and quasi-

experimental techniques)• Institutional arrangements• Mapping to NAP elements

Page 3: Opportunities for impact evaluation in the NAP process

Context• Country governments engaging in NAP process

• Complex task – many elements

• Multiple resources and tools are needed

• Impact Evaluation (IE) one such tool

• Provides two complementary inputs for NAP process:• What is impact of climate change?• What is impact of adaptations?

Page 4: Opportunities for impact evaluation in the NAP process

IE for Climate Change Impacts• Called the Ricardian technique

• First used for agriculture in the United States

• Method can be feasibly deployed in multiple contexts

• Applied to agriculture in Africa and Latin America

Page 5: Opportunities for impact evaluation in the NAP process

IE for Climate Change Impacts• Farmers experience large range of climates

• Relating farmer profit to climate quantifies climate change impacts

$$$ $$

$$$$

Farmer Profit Climate

Page 6: Opportunities for impact evaluation in the NAP process

IE for Climate Change Impacts• Existing variation in climate tells us what farmers will do as climate

changes

• Help us quantify damage from climate change

• Add-on: Provides insights on possible adaptations

• Rationalize adaptation spending• Knowing damages justifies spending on adaptation

Page 7: Opportunities for impact evaluation in the NAP process

IE for Adaptations• Policymakers must rationally choose adaptations

• Turn to experimental and quasi-experimental techniques (choice depends on circumstance)

• Rationale: understand if given adaptation choice has intended impact

Page 8: Opportunities for impact evaluation in the NAP process

IE for Adaptations• Always think of ideal scientific experiment

• Control group; treatment group

• For adaptations – subjects must be randomly assigned

• Lottery assignment ensures validity of evaluation

?

?

Page 9: Opportunities for impact evaluation in the NAP process

IE for Adaptations

CONTROL

TREATMENT ADAPTATION

Page 10: Opportunities for impact evaluation in the NAP process

IE for Adaptations• When randomization not feasible, turn to quasi-experimental

methods• Not feasible due to constraints – political, institutional, design

(timing)

• Array of techniques• Difference-in-Difference• Regression Discontinuity Design• Matching• Instrumental Variables

Page 11: Opportunities for impact evaluation in the NAP process

Institutional Arrangements• Three roles

• Implementation• Data Collection• Design and Analysis

Implementation Data Collection

Analysis

Design

Page 12: Opportunities for impact evaluation in the NAP process

Institutional Arrangements• Capacity

• Trained economists• In-house capability might exist• Partnership (e.g. researchers)

• Timing• Design: Researcher input before implementation• Obtaining results: could take some years

Page 13: Opportunities for impact evaluation in the NAP process

IE and the NAP Process• IE (both techniques) help with key NAP elements

NAP Element Impact Assessment Tool(s) Connection Element B Preparatory Elements: Assessing climate vulnerabilities and identifying adaptation options at the sector, subnational, national and other appropriate levels.

Ricardian The Ricardian technique can be used to understand climate change impacts, quantifying the vulnerability of agriculture to climate change. The same can also be used to assess climate adaptations that are already being undertaken to help identify options for adaptation.

Element B Preparatory Elements: Reviewing and appraising adaptation options.

Experimental and Quasi-experimental

Experimental and quasi-experimental techniques can be used to assess adaptation options in a rigorous evidence-based manner.

Element C Implementation Strategies: Prioritizing climate change adaptation in national planning.

Ricardian Experimental and Quasi-

experimental

As before, the Ricardian technique can help identify possible adaptations based on what is already taking place in agriculture. Then, evidence generated from experimental and quasi-experimental methods can help to select the adaptations that are effective.

Element D Reporting Monitoring and Review: Reviewing the NAP process to assess progress, effectiveness and gaps; Iteratively updating the national adaptation plans.

Experimental and Quasi-experimental

Evidence generated from experimental and quasi-experimental techniques helps with these – as a continuous process of testing and deploying new adaptation programs, and rejecting those options that do not work.

Page 14: Opportunities for impact evaluation in the NAP process

Conclusion• Impact Evaluation – broad set of tools• Two areas where immediately applicable:

• Understanding climate change impacts on agriculture sector

• Understanding impact of adaptations in agriculture• Technical resource persons are needed• IE tools allow multiple parts of NAP process to be

addressed

Page 15: Opportunities for impact evaluation in the NAP process

Conclusion

• Next steps include:

• Identifying opportunities for using IE methods

• Providing training to countries on specific methods

Page 16: Opportunities for impact evaluation in the NAP process