HOW EVIDENCE GENERATED BY AN ANALYSIS OF … · APBDes 2018 as a supplier for subsidized...

HOW EVIDENCE GENERATED BY AN ANALYSIS OF MONITORING DATA FROM OUTCOME HARVESTING CAN BE USED IN INFLUENCING

INTRODUCTION

• Karen Biesbrouck: Project leader on Outcome Harvesting at the Impact Measurement and Knowledge team, and a Global MEAL specialist e.g. for the Right to Food program at the Thematic Unit Food, Land, and Water.

• Sanne Djojosoeparto: Cultural anthropologist working at the Thematic Unit Food, Land and Water; key in analysing the outcome statements.

• Case material Indonesia thanks to Widyanto Widyanto (Project leader, Oxfam Indonesia) and Ishma Soepriadi (MEL officer, Oxfam Indonesia).

OBJECTIVE OF THIS SESSION

• Share evidence from our analysis of early and intermediate outcomes in the Right to Food program, • Highlighting how results of this analysis triggered reflections on the influencing strategies;

case of Indonesia. • As Oxfam continues this analysis, it builds its global narrative, and communicates it for

accountability and learning purposes.

• The discussion on this experience will kickstart a dialogue among workshop participants • on the opportunities and challenges they face when using evidence from harvested

outcomes in influencing.

INTRODUCTION PARTICIPANTS

1. Your name, function, organisation2. Experience in outcome harvesting so

far3. Experience in analysing outcome

statements

OXFAM NOVIB & SOMO IN THE STRATEGIC PARTNERSHIP• ‘Dialogue and Dissent’ Strategic partnership Dutch ministry of Foreign Affairs • ‘Towards a worldwide influencing network’ in 17 countries, 31 projects

• Themes: Right to Food, Conflict and Fragility, Finance for Development

**00) Improved policies (government)

**10) Improved policies (private sector)

**20) Strengthened CSOs

3**30) Increased political will

**40) Increased citizens voice**50) Stronger & wider

alliances

**70) Shifted norms and attitudes

Changes in peoples’ lives

Intervention strategies

GENERIC THEORY OF CHANGE

KEY CHALLENGES FOR MEL IN INFLUENCING

• Multiple approaches: influencing can be part of many approaches including lobbying, advocacy or campaigning

• Causal relationships: linking advocacy and outcomes is complex• Long horizons: influencing work is long term. Change can be slow and incremental• What does success look like: defining success is tricky and varies depending on who is

asked. The goal posts can often shift depending on the circumstances• Changing circumstances: because of a fluid environment, work is rarely repeated or

replicated • Conflicting political process: influencing often means engaging in a process that may have

political consequences

OUTCOME HARVESTING IN SELECTED OUTCOME AREAS

**00) Improved policies (government)

**10) Improved policies (private sector)

**20) Strengthened CSOs

3**30) Increased political will

**40) Increased citizens voice**50) Stronger & wider

alliances

**70) Shifted norms and attitudes



GENERIC THEORY OF CHANGE, METHODOLOGIES

OUTCOME HARVESTING

• Oxfam Novib & other Dutch organisations benefitting from Strategic Partnership: innovate by using outcome harvesting for monitoring results in influencing

• ONL does it at an unprecedented scale and pace.

OXFAM NOVIB’S ANALYSIS OF OUTCOMES IN THE STRATEGIC PARTNERSHIP

ANALYSIS OF ALL OUTCOME HARVESTING DATA IN THE SP

• This presentation: Right to Food pilot analysis, Indonesia case. • Now, Oxfam scales up to include its two other SP themes, while

also deepening the analysis.• Aims to answer our question How did change happen? To:

• Inform the project cycle • Build the narrative of the strategic partnership, validating our theories of

change and elaborating on them. • Inform the second phase of the strategic partnership.

• We share lessons of the analysis in meetings and reports; these feed into learning events and into planning workshops.

SCOPE OF THE WIDER ANALYSISScaling up: Deductive analysis looking at

• (Pilot) Outcome areas as defined in Theory of Change SP• Three key learning areas:

o Shrinking (or elastic) civic spaceo Linking local and global influencingo The importance of truth and legitimacy in influencing

• Mainstreaming areas in the SP: Gender and Youth; Private sector engagement; Conflict sensitivity

THE TEAM CONDUCTING THE ANALYSIS

• 3 main Researchers for analysis overseeing theme • 3 Global MEAL specialists specific analysis• 2 Impact Measurement overseeing global analysis

and Knowledge specialists

• Teamwork ensures a consistent approachand comparability• Coding and analysis using software for qualitative data analysis (MaxQDA)• Working towards project, thematic and global lessons learned

EVIDENCE FROM ANALYSIS OF EARLY AND INTERMEDIATE OUTCOMES IN INDONESIA R2F PROGRAM

INDONESIA POLICY CHANGES AIMED ATImplementation of• Land Law (Agrarian Reform)• Laws on Protection and

Empowerment of Farmers (LPEF), and of Laws on Protection and Empowerment of Fisherfolk and Salt Farmers (LPEFAS)

Policy on Grievance mechanism district level (adoption local level)

KRKPLocal Government

East Flores:Local Government allocated budget for BUMDES (Village

Owned Enterprise) in APBDes (budget for Village) as supplier for fertilizer subsidies

East Flores:Planning & Development Agency declared his support to establishment of Village-Owned Enterprise (BUMDES)

Round 1

Round 2

Local Parliament

East Flores:Declared support for drafting a

region regulation on distribution and monitoring of

subsidized fertilizer

Maros, North Lombok and East Flores:

House of Representatives committed to supporting the strengthening of subsidized

fertilizer policy at district level

North Lombok:Local government established Village Assembly Board (Majelis Krama Desa/MKD) as a platform for farmer's

complain

North Lombok:Planning and Development Agency (Bappeda) has

allocated fund in 2017 for the need of organic fertilizer

National Government

Director of Fertilizers and Pesticides Ministry of Agriculture approved committed to redesign

the composition of Fertilizer and Pesticide

Supervisory Commission (KPPP) involving civil society

Maros, North Luwu, North Lombok, East Flores:The Commission of Pesticide and Fertilizer Monitoring

(KP3) committed to do the institution strengthening of KP3 at the district level

Local CommunityKPA

National Government

Signed MoU for agrarian reform implementation

Commitment to encourage

collected data from CSO & local

community

Local Government

Commitment to support local community in

agrarian reform village

implementation

Commitment to promote agrarian reform as conflict resolution strategy

Round 1

Round 2

National Parliament

Agreed to discuss CSO draft on

genuine agrarian reform aspects of

land bill drafts

Agreed to have further discussions

about list of problem inventory issues (DIIM) on

land bill that submitted by CSO

that related to agrarian reform

Involved in data collection on

agrarian reform in prioritised locations

Practiced special skills obtained

from the training in the agricultural

derivative products

Local CommunityKIARA

National Government

The Minister of Marine Affairs and Fisheries

declared the commitment to support fisherwomen to have get fisherman card

(Kartu Nelayan)

Local Government

Sikka:Village Government

issued Decree No. 33 of 2017 on the inauguration

and stipulation of the female fishermen group

"Wakatau”

Round 1

Round 2

Lombok:Fisher women expressed their commitment to encouraging

the Province and The Ministry of Maritime Affairs and

Fisheries to implement Law No. 7/2016

Sikka:Fisher women formed an organization called IPNAS

(Ikatan Perempuan NelayanSikka) to consolidate

fisherwomen group in coastal areas and villages in district

Kupang:Fisher women in Kupang City

have been informed about Fishing Card and take

responsibility to get personal Fishing Card

West Nusa Tenggara Province:

The Head of Marine Affairs and Fisheries Services promised to share with the central

government the coastal society’s

recommendations regarding Law No. 7/

2016

Local CSO

The Head of Working Group on Land Bill agreed to have a

further discussion on Land Bill for coastal area

East Lombok:3 local CSOs in East Lombok committed to encourage the

implementation of Law No.7/2016

Kupang:The chairman of Fishermen

Association of Indonesia (Himpunan Nelayan SeluruhIndonesia/HNSI) started to

participate in collecting evidence obtained from

PIKUL

Seafish for Justice issued petition adressed to the AICHR

(Asean Intergovernmental Comission on Human Rights) and ASEAN Country Policy

Maker to ratify ILO Convention 188 for fishery workers.

SPNational Government

Presidential Staff Office (KSP) integrate gender perspective on the Book of “Presidential Staff Office Guideline: “National Agrarian Reform in Government Work plan 2017” for the

implementation of agrarian reform

Local Government

Village Government planned the involvement of

women in the management of agricultural land

Round 1

Round 2

National Parliament

Experts from House of Representative of Gerindra Fraction asked SP input for

DIM land Bill focus on gender aspect and

women interest

The ministry of Environment & Forestry integrated gender aspect in Tenure Panel agenda regarding to SP's recommendation on

women's roles and rights in natural resource management and land

The ministry of agriculture, committed to open a cooperative opportunity food rights assessment guide initiated by SP and

integrated in Gender Mainstreaming policy by the ministry to ensure PUG in policy and program to include the situation of women

farmers

Ministry of Marine Affairs & Fisheries proposed collaboration with SP to initiate cross-ministerial meetings in reducing gender

mainstreaming strategies in programs and policy of Ministry of Marine and Fisheries

Strengthened CSOs

Increased political will 22x

Increased citizens voiceStronger & wider alliances 20 x

Shifted norms and attitudes


HOW CHANGE HAPPENED IN INDONESIA

Media7 x

10 x 7 x2 x

Succesful lawsuit

Improved policies (government) 1x


1 x

(Local) Community Local GovernmentNational Government

KRKP: Composition of Fertilizer and Pesticide Supervisory Commission; ToC confirmed, role of media

Intervention Strategies

Strengthened CSO’s (Social audit KRKP-KATALIS)

Stronger and wideralliances (KRKP has

facilitated dissemination and FGD with stakeholders)

Increased political will(commitment of the Director of Fertilizer and

Pesticides Ministry of Agriculture )


Increased citizen’svoice (audience forum in

Luwu Utara)

Improved policies (government) (Redesigned the composition of the Fertilizer and Pesticide Supervisory Commission (KPPP) in the involvement of civil society elements in the new

composition of KPPP in October 2017)

Increased political will (the local government approved a new

composition involving civil society (NGOs and the Press) within the KPPP structure)

Increased citizen’s voice(Hearings (audience) to the directorate of Fertilizer and

Pesticides to encourage changes in the composition of KPPP:

involve civil society.)

Media (local press; mainstream issue; media as

partners in publication activities; pressure to government indirectly)

Local GovernmentRegional Parliament Regional Government

KRKP: Subsidized Fertilizer; ToC confirmed, role of media

Increased political will(On October 2017, local governmentof Boru Kedang Village (East Flores)

has allocated budget for Village-Owned Enterprise (BUMDES) in APBDes 2018 as a supplier for

subsidized fertilizer )

Increased political will(In April 2017, Head of East Flores

District Development Planning Agency declared support to the establishment of Village-Owned

Enterprises)

Strengthened CSO’s (social audit of KRKP and Oxfam highlighted the need to enhance the service system. It started with the idea to facilitate Village-Owned Enterprises (VOE/BUMDES) s as the retailer at the village level and Village Cooperative Unit (VCU) as the distributor at the district level)

StrengthenedCSOs (YLKMP

facilitates social audit in the provision of data on

issues )

Increasedpolitical will (April 2017, Head of Fraction B

in East Flores’ DPRD declared support for

drafting region regulation distribution and

monitoring of subsidized fertilizer)

Increased political will(District parliament (DPRD)

representatives in Maros, North Lombok and East Flores are committed

to support the strengthening of subsidized fertilizer policy at district

level (March-April 2017))

Increased political will (Local government (Samangki and Jenetaesa Village)

commitment in involving BUMDES as perpetrators of Line IV (retailers) of fertilizer subsidies for support of PMD Sector and Maros District in

September and October 2017 )

Increased politicalwill (In May 2017, The

Commission of Pesticide and Fertilizer Monitoring (KP3)

committed to do the institution strengthening of KP3 at the

district level.)

Increased political will (In October 2017, the Bappeda Economic Division has

allocated a budget of 2017 for the procurement of organic fertilizer needs for farmers in Lombok

UtaraRegion)

Increased citizen’s voice) (FGD withgovernment and communities.)

Media (as mainstream issuedwith public; civil society

recognized because of media)

Stronger and wider alliances

(KATALIS-KRKP facilitate dissemination of social audit to local government, SKPD,

DPRD, PEMDES, NGO)

Strengthened CSOs(role Ayu Tani –KRKP in providing information/planning and feasibility study; support Ayu Tani creating awareness village government)


(KRKP and partners organizing FGD at village

and district level)

Strongerand wider

alliances (FGD involving DPRD,

SKPD, KP3, Village government officer,

local CSO and journalists)

National Government

Increased political will(President Executive Office (Kantor

Staf Presiden/KSP) signed MoU with KPA on people’s participation in

implementing Agrarian Reform for the period of 2016 – 2019 (8

November 2016 in Makassar City, South Sulawesi)

Local Community Local Government

KPA: Agrarian Reform confirms ToC: Political will from CSO advocacy, also in alliances

Strengthened CSO’s(KPA advocacy; /KPA supports data

collection to prioritse locations for implementation of Agrarian reform)

Stronger and wideralliances (establishment of

Working Group on Agrarian Reform or Pokja RA, the agrarian reform task

force (including KPA), in Palu, Central Sulawesi, 25 –26 August 2016, in

Central Sulawesi. )

Increased political will (Local government has advocated for conflict resolution through priority

location of agrarian reform (LPRA) .The local government has used LPRA data proposed by CSOs and local

communities to be the pilot project for the implementation of agrarian reform in Central Sulawesi, South Sulawesi and Southeast Sulawesi from April to November 2017)

Strengthened CSO’s/communities(Increasing Local community / KPA members / Farmers’

organization’s capacity building in collecting data of priority location Agrarian Reform in the process of

advocacy)

Stronger and wideralliances On August 25 – 26, 2016 in

Palu, Central Sulawesi, local CSOs and local communities actively involved in data collection on agrarian reform in prioritisedlocations to prepare the implementation of

agrarian reform

Increased political will (Local government has commitment to support local community in implementation of DAMARA in Piondo village)

Increased political will(Since 2017, The government

through the Ministry of Agrarian and Spatial Planning (ATR/BPN), Ministry of LHK and KSP is

committed to implement the Priority Location of Agrarian Reform (LPRA)

in national and regions)


(Ministry of ATR and Ministryof Villages have formed a working group on agrarian

reform. KPA has been actively involved in meetings and discussions of agrarian

reform.)

Stronger and wider alliances (RefromAgraria Task Force in Central Sulawesi and alliance

between community, KPA and Farmer’s organization in data collection.)

Strengthened CSO’s (KPA developed database and format of data

collection; KPA assisted local/farmer/community organisations in

developing data of prioritised locations for agrarian reform implementation)

Strengthened CSO’s (KPA facilitated strategic plans that involve local government. 2.KPA involved in process of

assessing agrarian situation 3.KPA facilitated in participatory mapping training 4.KPA

facilitates capacity building of local communities 5.KPA facilitated training of

derivative agricultural products)

(Local) Community

KPA: Strengthened communities /agricultural production Poverty alleviation (pending advocacy results)

Intervention Strategies (KPA Support the assessment process in monitoring the potential of natural resources/human resources that have not been explored yet. 2.Provide an understanding of strategic plan with participatory method to establish and actualize the vision and mission of local community independently 3.Provide additional capacity/skills to local community through specialized skill training in terms of derivative product management4.Provide information and training marketing management5.Implement marketing of agricultural

derivative products))

Stronger and wider alliances (In marketing, the role of

Terminal Benih, Inagri and other partnership helped accessing information of product

marketing)

Strengthened communities/changes in peoples lives(Since August 2017, local communities have been using post-training

special skills in the process of agricultural production as an embodiment of Damara in 2 villages at Central Sulawesi)

Strengthened communities (Local CSo and local community in 8 villages (Central Sulawesi, Southeast Sulawesi, South Sulawesi and East Nusa Tenggara) have a deeper understanding of the DAMARA concept

and are committed to its development.)

(Local) CommunityDistrict Parliament

Kiara: Land Bill Recommendation Confirms: Political will from stronger CSO’s & Increased citizens’ voice


Increased political will (In March 2017, the Commission 4 of the East Lombok Parliament agreed to propose the Land Bill Recommendation from the coastal communities at the local level to the Central Government)

Increased citizen’s voice (Land tenure, fishing ground security and the

threatened of land conversion have been mapped by coastal community and fisherfolks

then discussed with district parliament members. In FGD, the mapping results of

above issues have been submitted by the community (CSO) to the chairman of Commission 4 of East Lombok District

Parliament, Mr. H. Hasan Rahman, SH on end of March 2017,in the parliament

building.)

National Parliament

Increased political will (In Feb 2017, The Head of Working Group on Land Bill agreed to have a

further discussion on Land Bill for coastal area. )

Strengthened CSO’s (KIARA lobby and hearing with related parties, preparing and composing the Land Bill position paper document, FGD with CSO (which one?) in

composing the inventory list formulation of Land Bill problem by using the coastal area perspective., Implementing the Land

Bill discussion along with the head of Land Bill group work commission 2 DPR RI. Doing intense communication with the parliament towards Land Bill. Doing monitoring towards the

discussion situation of Land Bill at the parliament.)

National Government (local) communitySP: Petition Fisher Folk and Civil Society permits artificial islets confirms ToC; lawsuits alternative strategy


Increased political will (On May 31st 2016 and March 16th 2017, the Jakarta State Administrative Court approved the petition of Fisher folk and Civil Society to cancel the permits issued for the construction of four artificial islets on Jakarta’s northern coast. )

Strengthened CSO’s (action research, documentation and analysis of the situation, strengthening communities).

Stronger and wider alliances (advocacy with other CSO’s, media and public support)

Succesful lawsuitIncreased voice

(fisherwomen in lawsuit and togovernment)

National Government (local) communityKIARA: Fisheries/Law. No. 7/women Confirms ToC: increased citizens voice, shifted norms&attitudes


Increased political will (In Jakarta, September 2017, Ministry of Maritime affairs and Fisheries stated the commitment to help women fisherfolks to get Fisheries Card (Kartu Nelayan))

Strengthened CSO’s (KIARA with Pikul, WTM and LPSDN in term of: 1.Performing data collection and the existence of problems faced by fisherwomen 2.Preparing the

study of recognition of fisherwomen)

Increased voice (Fisherwomen in Kupang City have been informed of Fisherman Insurance and declared

desire to take care of the making fisherman card by changing the occupation in their ID Card()


Increased voice (To be recognized, the women fisheries conducting a meeting with Ministry of affairs and

fisheries and invited the Ministry to visit the women's fishing territory)


Strengthened CSO’s (Pikul conducted research From research, Pikul found that many

fisherwomenuntil now do not have a fishing card. Obstacles because in their ID card occupationonlylisted as a housewife, not as a fisherman; KIARA

was present in dissemination of results)

Implementation of Law No. 7

HOW EVIDENCE GENERATED BY THIS ANALYSIS TRIGGERED REFLECTIONS ON THE INFLUENCING STRATEGIES,THE CASE OF INDONESIA

INDONESIA REACTIONS ON OUTCOMES ANALYSISOutcome harvesting helped us to overcome some of the challenges for MEL in influencing work, particularly “Causal Relationship”; “Changing Circumstances”, and “What does Success look like”.

The analysis enhanced Oxfam Indonesia team’s “Reflection and understanding of our achievements and challenges in influencing work”. • “Doing rounds of outcome harvesting, allows us to see ‘baby outcomes’ mature”• Shows the different stages in Influencing Work: whereas our target is “Improved

Policy”; at this moment, most of the results are in “Increased Political Will”• Increased our awareness of the importance of outcome area “Stronger and Wider

Alliance”, (which we did not plan).

HOW EVIDENCE GENERATED BY AN ANALYSIS OF … · APBDes 2018 as a supplier for subsidized...

Documents

Transcript of HOW EVIDENCE GENERATED BY AN ANALYSIS OF … · APBDes 2018 as a supplier for subsidized...