M&E framework

Szczecin edition

June 22, 2016

M&E framework

• Based on

– Literature review

– Interviews and observations during the project

• Focus on transboundary and cross-border

collaboration in MSP

• The framework

– To be used when countries or stakeholders evaluate

the processes

– Presents an approach and suggestions on how to not

an evaluation method

Updated version available

• Updated based on analysis of interviews and

observations

Updated version available

Different practices across borders

Know planning systems of neighbours

Existing cross-border collaboration and networks

Common approaches to MSP

Common standards for data and mapping

International policies

Talk to each other, ask questions (communication)

Stated national priorities help collaboration

Address TB issues in national processes

MSP has different status in different countries

Similar understanding of topics

Countries in different timing

Updated version available

• Updated based on analysis of interviews and

observations

• Still work under construction

• For comments at workspace

– Folder: Monitoring Evaluation/FOR COMMENTS

– Please send comments by end of August

– Upload into folder WITH A DIFFERENT FILE NAME

Purpose of the final product

• Explain rationale for evaluating

– The point of evaluation and monitoring is to know that

are we meeting the objectives we aim to achieve

• And to check what other harm we may cause (side-effects)

– Preparing for evaluation from the beginning helps to

plan your process

• Goal → Objective → Indicator → Management measure

(Douvere and Ehler 2011)

• SMART (specific, measurable, achievable, realistic and

timely)

• Provide guidance on evaluating transboundary

collaboration in MSP

• Theory-based evaluation

Theory-based evaluation

• Theory-based evaluation approach is a mainstreamapproach in policy evaluation– Broad discussion, e.g. intervention theory, program theory,

intervention logic, logical framework

– e.g. inherent in preparation of European Maritime and Fisheries Fund

• What ”theory” are we talking about here?– An understanding of how a spatial plan, policy or

intervention will produce change (theory of change)

– ”Through which activities, actions and outputs my plan willreach the set objectives?”

– Contextual issues

• What are the risks stemming from the broader context?

• Side-effects

Theory-based evaluation

• An approach, not a specific method

– Several examples of methods that can be used

• Open standards for conservation planning

– BaltSpace – a good example

• Start from defining objectives

Intervention

Inputs Activities Outputs

Impact

Initial

outcomesIntermediate

outcomesImpacts

Assumptions:

How do the outputs result in outcomes? What has to

happen? What contextual factors influence?

Risks:

Risks that the link is weak or non-existing

Side-effects:

What are the intervention’s effects in a broader context?

Hansen, Morten Balle, and Evert Vedung 2010.

Theory-Based Stakeholder Evaluation. American

Journal of Evaluation 31(3):295-313.

Process in BalticSCOPE

• Adjust the principle into evaluation of

transboundary collaboration in MSP

• Continue analysing the material

• Work together with the planners – group works

• Today a group work on outcomes and how do

we know, if we are achieving them