Social phenomena influence impact evaluation of environmental managent interventions:British...
-
Upload
juliapgjones -
Category
Environment
-
view
541 -
download
0
Transcript of Social phenomena influence impact evaluation of environmental managent interventions:British...
![Page 1: Social phenomena influence impact evaluation of environmental managent interventions:British Ecological presentation Julia Jones, Ranaivo Rasolofoson, Edwin Pynegar](https://reader030.fdocuments.in/reader030/viewer/2022032421/55a70ddf1a28ab01628b45aa/html5/thumbnails/1.jpg)
http://www.madagasikara-
voakajy.org/index.php
Assessing the impact of
environmental management interventions on ecological
outcomes
Julia P. G. Jones1, Ranaivo Rasolofoson1,2, Edwin Pynegar1
1School of Environment, Natural Resources and Geography, Bangor University
2 Department of Food and Resources Economics, University of Copenhagen
![Page 2: Social phenomena influence impact evaluation of environmental managent interventions:British Ecological presentation Julia Jones, Ranaivo Rasolofoson, Edwin Pynegar](https://reader030.fdocuments.in/reader030/viewer/2022032421/55a70ddf1a28ab01628b45aa/html5/thumbnails/2.jpg)
“Those who cannot learn from history are doomed to repeat it”
Georges Santayana 1863-1952
![Page 3: Social phenomena influence impact evaluation of environmental managent interventions:British Ecological presentation Julia Jones, Ranaivo Rasolofoson, Edwin Pynegar](https://reader030.fdocuments.in/reader030/viewer/2022032421/55a70ddf1a28ab01628b45aa/html5/thumbnails/3.jpg)
Key message: social phenomena influence impact evaluation of environmental management interventions
![Page 4: Social phenomena influence impact evaluation of environmental managent interventions:British Ecological presentation Julia Jones, Ranaivo Rasolofoson, Edwin Pynegar](https://reader030.fdocuments.in/reader030/viewer/2022032421/55a70ddf1a28ab01628b45aa/html5/thumbnails/4.jpg)
Randomised Control Trial: units are allocated to the intervention group or control group randomly
Intervention Control
Random allocation
![Page 5: Social phenomena influence impact evaluation of environmental managent interventions:British Ecological presentation Julia Jones, Ranaivo Rasolofoson, Edwin Pynegar](https://reader030.fdocuments.in/reader030/viewer/2022032421/55a70ddf1a28ab01628b45aa/html5/thumbnails/5.jpg)
Randomised Control Trials: mainstay of much applied ecology
RCTSs are increasingly advocated for more complex environmental interventions
![Page 6: Social phenomena influence impact evaluation of environmental managent interventions:British Ecological presentation Julia Jones, Ranaivo Rasolofoson, Edwin Pynegar](https://reader030.fdocuments.in/reader030/viewer/2022032421/55a70ddf1a28ab01628b45aa/html5/thumbnails/6.jpg)
It is well recognised that impacts of an intervention may ‘spill over’ (from control to intervention units)
![Page 7: Social phenomena influence impact evaluation of environmental managent interventions:British Ecological presentation Julia Jones, Ranaivo Rasolofoson, Edwin Pynegar](https://reader030.fdocuments.in/reader030/viewer/2022032421/55a70ddf1a28ab01628b45aa/html5/thumbnails/7.jpg)
Such ‘biophysical spill-over’ may mask the impact of the intervention
![Page 8: Social phenomena influence impact evaluation of environmental managent interventions:British Ecological presentation Julia Jones, Ranaivo Rasolofoson, Edwin Pynegar](https://reader030.fdocuments.in/reader030/viewer/2022032421/55a70ddf1a28ab01628b45aa/html5/thumbnails/8.jpg)
Imitation of the intervention in control areas (social spill over) can mask the true impact of the intervention in an RCT
Important social phenomenon #1: interventions may be imitated in the control units (social ‘spill over’)
Pynegar, Gibbons, Asquith & Jones (submitted) What role should Randomised Control Trials play in providing the evidence base underpinning environmental management?
![Page 9: Social phenomena influence impact evaluation of environmental managent interventions:British Ecological presentation Julia Jones, Ranaivo Rasolofoson, Edwin Pynegar](https://reader030.fdocuments.in/reader030/viewer/2022032421/55a70ddf1a28ab01628b45aa/html5/thumbnails/9.jpg)
Intervention should have a direct impact on outcome of interest
Intervention aims to change behaviour
Change in behaviour should impact the outcome of interest
Interventions which aim to change behaviour are fundamentally different from those aiming to have a direct impact on outcome of interest….
![Page 10: Social phenomena influence impact evaluation of environmental managent interventions:British Ecological presentation Julia Jones, Ranaivo Rasolofoson, Edwin Pynegar](https://reader030.fdocuments.in/reader030/viewer/2022032421/55a70ddf1a28ab01628b45aa/html5/thumbnails/10.jpg)
![Page 11: Social phenomena influence impact evaluation of environmental managent interventions:British Ecological presentation Julia Jones, Ranaivo Rasolofoson, Edwin Pynegar](https://reader030.fdocuments.in/reader030/viewer/2022032421/55a70ddf1a28ab01628b45aa/html5/thumbnails/11.jpg)
John Henry effect (those in control group increase their effort)-will reduce apparent effect of the intervention
John Henry effect
![Page 12: Social phenomena influence impact evaluation of environmental managent interventions:British Ecological presentation Julia Jones, Ranaivo Rasolofoson, Edwin Pynegar](https://reader030.fdocuments.in/reader030/viewer/2022032421/55a70ddf1a28ab01628b45aa/html5/thumbnails/12.jpg)
Important social phenomenon #2: people behave differently when they are being experimented upon
Pynegar, Gibbons, Asquith & Jones (submitted) What role should Randomised Control Trials play in providing the evidence base underpinning environmental management?
![Page 13: Social phenomena influence impact evaluation of environmental managent interventions:British Ecological presentation Julia Jones, Ranaivo Rasolofoson, Edwin Pynegar](https://reader030.fdocuments.in/reader030/viewer/2022032421/55a70ddf1a28ab01628b45aa/html5/thumbnails/13.jpg)
Intervention Control
Pre-matching comparison
Post-matching comparison
Matching
Quasi-experimental approach: units in intervention group are “matched” with control units which are as similar as possible
![Page 14: Social phenomena influence impact evaluation of environmental managent interventions:British Ecological presentation Julia Jones, Ranaivo Rasolofoson, Edwin Pynegar](https://reader030.fdocuments.in/reader030/viewer/2022032421/55a70ddf1a28ab01628b45aa/html5/thumbnails/14.jpg)
Relative effectiveness of different approaches to Community Forest Management at delivering conservation outcomes in Madagascar?
CFM which do not allow commercial forestry
CFM which do allow commercial forestry
![Page 15: Social phenomena influence impact evaluation of environmental managent interventions:British Ecological presentation Julia Jones, Ranaivo Rasolofoson, Edwin Pynegar](https://reader030.fdocuments.in/reader030/viewer/2022032421/55a70ddf1a28ab01628b45aa/html5/thumbnails/15.jpg)
Matched based on:
Proximity to recent deforestation
Proximity to a road
Proximity to an urban centre
Quality of agricultural land
Altitude
![Page 16: Social phenomena influence impact evaluation of environmental managent interventions:British Ecological presentation Julia Jones, Ranaivo Rasolofoson, Edwin Pynegar](https://reader030.fdocuments.in/reader030/viewer/2022032421/55a70ddf1a28ab01628b45aa/html5/thumbnails/16.jpg)
Result: CFM which allows commercial logging appears to have increased deforestation, CFM which does not allow commercial logging appears to have reduced deforestation
Source: Rasolofoson, Ferraro, Jenkins & Jones (submitted) The effectiveness of Community Forest Management at slowing deforestation in Madagascar
![Page 17: Social phenomena influence impact evaluation of environmental managent interventions:British Ecological presentation Julia Jones, Ranaivo Rasolofoson, Edwin Pynegar](https://reader030.fdocuments.in/reader030/viewer/2022032421/55a70ddf1a28ab01628b45aa/html5/thumbnails/17.jpg)
BUT: We know CFM (and the types of CFM) were not allocated randomly, there will likely be reasons (social/political/historical) not captured in our matching variables
![Page 18: Social phenomena influence impact evaluation of environmental managent interventions:British Ecological presentation Julia Jones, Ranaivo Rasolofoson, Edwin Pynegar](https://reader030.fdocuments.in/reader030/viewer/2022032421/55a70ddf1a28ab01628b45aa/html5/thumbnails/18.jpg)
Important social phenomenon #3: True matching is challenging without social/institutional understanding
of process of allocation to the intervention
![Page 19: Social phenomena influence impact evaluation of environmental managent interventions:British Ecological presentation Julia Jones, Ranaivo Rasolofoson, Edwin Pynegar](https://reader030.fdocuments.in/reader030/viewer/2022032421/55a70ddf1a28ab01628b45aa/html5/thumbnails/19.jpg)
http://www.madagasikara-
voakajy.org/index.php
Conclusions
• Talk of a ‘gold standard’ for impact evaluation is unhelpful.
• Social phenomena influence evaluation of the impacts of ecological management interventions and perhaps deserve more attention.
![Page 20: Social phenomena influence impact evaluation of environmental managent interventions:British Ecological presentation Julia Jones, Ranaivo Rasolofoson, Edwin Pynegar](https://reader030.fdocuments.in/reader030/viewer/2022032421/55a70ddf1a28ab01628b45aa/html5/thumbnails/20.jpg)
http://www.madagasikara-
voakajy.org/index.php
Thanks (@juliapgjones)
Nigel Asquith Paul Ferraro James Gibbons Clinton Jenkins
Edwin Pynegar Ranaivo Rasolofoson