Evaluating interventions to end VAW: Challenges and opportunities
-
Upload
melvin-nichols -
Category
Documents
-
view
49 -
download
1
description
Transcript of Evaluating interventions to end VAW: Challenges and opportunities
![Page 1: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/1.jpg)
Evaluating interventions to end VAW: Challenges and opportunities
Mary Ellsberg, PhD
IGWG Technical UpdatePromising Practices in Monitoring and EvaluationNovember 8, 2007www.path.org
![Page 2: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/2.jpg)
• What are the challenges for evaluating efforts to end VAW?
• Innovative approaches
• Lessons learned and recommendations
![Page 3: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/3.jpg)
The Evaluation Gap on VAW
• World Bank review of best practices on found a lack of evidence on effectiveness of interventions in all sectors – (Bott, Morrison, Ellsberg, 2004)
• Review of 237 interventions in health sector, 11 met criteria for evidence based research methods (Wathen & Macmillan, 2003)
• In 2004, US Prevention Services Task Force released updated recommendations for routine screening concluded evidence is lacking on effectiveness of screening women in primary care.
![Page 4: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/4.jpg)
Main purpose of Impact Evaluation
• Did change occur in the desired direction?
• Can the change be attributed to the intervention?
![Page 5: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/5.jpg)
“Impact evaluation aims to measure the difference between what happened with the program and what would have happened without it.”
(Center for Global Development, 2006)
![Page 6: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/6.jpg)
• Weakness in design
• Analysis and interpretation of data
• Use of evidence for policy
Methodological challenges in current evaluation research
![Page 7: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/7.jpg)
• Most studies measure outcomes or process (i.e. increase in screening or detection, increased reporting) and very few measure impact
• Lack of control groups, small sample sizes
• Evaluation conducted at end of intervention - no baseline data or ongoing monitoring
Design issues
![Page 8: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/8.jpg)
Challenges (cont.)
• Short follow up periods
• Tend to measure change in individuals, not at community or society level
• Hard to tease out contribution of different strategies
![Page 9: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/9.jpg)
• Lack of instruments for comparable data collection
• Analysis and interpretation – lack of rigorous statistical methods (regression, control for confounders)
• Lack of consensus on indicators (what is success?)
![Page 10: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/10.jpg)
Why is evaluation research so scarce?
• Program implementers have little incentive to carry out impact evaluations:
• Often donor driven – goals may be at odds with perceived program priorities (may even affect funding)
• Impact evaluations tend to be more costly, complex design, require more technical knowledge than outcome evaluations
• Usually involve outside evaluators, does not create capacity
• Programs typically do not receive adequate resources to conduct impact evaluations
![Page 11: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/11.jpg)
Violence occurs at many levels…
![Page 12: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/12.jpg)
…and therefore must be addressed at many levels
IndividualRelationship
CommunitySociety
![Page 13: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/13.jpg)
Social change is complex
“If we understand VAW as a manifestation of women’s low status and lack of power in relationships, then it is the context of women’s lives that we aim to influence, rather than responding to specific forms of violence… changing the core dynamics within relationship as well as in the broader community.”
(Michau, 2007)
![Page 14: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/14.jpg)
Different interventions need different methods
• Policy and legal reforms
• Improvement of services and support for survivors of violence (police, health services, judicial system)
• Mass media campaigns and interpersonal communications
![Page 15: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/15.jpg)
Different contexts and types of violence require different methods
• Armed conflict
• FGM
• Femicide
• Honor violence
• Child marriage
• VAW and HIV
• VAW and economic empowerment
![Page 16: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/16.jpg)
Consideration of respondent and interviewer safety must be a priority
![Page 17: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/17.jpg)
Innovative approaches to evaluation research on VAW
• Randomized control studies (Image, Stepping Stones)
• Development of instruments to measure gender norms and power relations (GEM scale and Sexual Power in Relationships)
• Use of mixed methods (qualitative and quantitative)
![Page 18: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/18.jpg)
Image Program in South Africa
Microfinancing and training on violence, together with community mobilization activities reduced domestic violence by 50% in intervention group over 2 years
![Page 19: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/19.jpg)
Participatory evaluation methods may also be appropriate
![Page 20: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/20.jpg)
96The Family Counseling Centers were opened
97Domestic violence law passed in Honduras
99Women’s Institute drafts a national violence prevention plan
Problems with space for consultations
Problems with the authorities
No funding during 1999
2000Training for doctors in Comayagua (with PAHO)
The road followed (time lines)
![Page 21: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/21.jpg)
The Family
Sometimes your family supports you. You feel relieved when you can rely on family for help.
The church is important. They give advice, they visit us; if a man kicks his wife out they will give her shelter and food until she resolves her situation.
Neighbors
Sometimes they help. Other times they fan the flames.
This is someone you can really trust.
The Woman’s
House
It’s important but difficult for some to get to.
The Judge
The Police
“The judge told me, ‘I’m sorry but I never get involved in family fights.’ That man could have me killed.”.
The police told me, “If you keep nagging I am going to throw you in jail too.”
RositaRosita
The health center
They listen to you here and give good
advice
Good Friends The
Christian Community
![Page 22: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/22.jpg)
Lessons learned
• Urgent need to improve the quantity and quality of impact evaluation
• Develop a strategic research agenda – what are priority topics ?
• Develop rigorous methods and comparable instruments for measuring outcomes and impact
• Strengthen internal monitoring and evaluation systems and build into project design
![Page 23: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/23.jpg)
Strengthen local research capacity
![Page 24: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/24.jpg)
It is not feasible or necessary to carry out impact evaluations in all programs
IE are best targeted to programs that are new or expanding and for which effectiveness has not been established.
(Evaluation Gap Working Group, 2006)
![Page 25: Evaluating interventions to end VAW: Challenges and opportunities](https://reader037.fdocuments.in/reader037/viewer/2022110403/56812c2e550346895d90b012/html5/thumbnails/25.jpg)
Knowledge from impact evaluations is a global public good
• Knowledge has wider benefits and may be generalized to other programs
• Costs should be born by the broader community, not just the implementing partner
• Requires significant investment over a prolonged period