Analysis of the Impact and Effectiveness of Projects

Structural Funds Programme for Malta

2004-2006

Presentation of main findings and recommendationsEvaluation Network Meeting

22nd September 2009

Structural Funds Programme for Malta - 2004-2006Event co-financed by the European Union

European Regional Development Fund (ERDF)Co-financing rate: 75% EU Funds; 25% Government of Malta Funds 1

Objectives of the exercise

The specific objectives of the contractor were as follows:

• To assess and verify the achievements registered by projects as identified by the Managing Authority;

• To conduct an analysis of the effectiveness and impact of the sample of projects;

• To propose recommendations for the future in terms of monitoring and collection of data.

2

General Information

• 13 projects that formed part of the Structural Funds Programme 2004-2006 were analysed;

• Analysis reflects the situation as at the 31st October 2008.

3

Projects AnalysedMeasure 1.1

Improving the Environment Situation, ERDF

Project ref. number

Project Title

ERDF 2 Wied il-Mielaħ Restoration and Management of Storm Water

ERDF 10 Acquisition of Air Monitoring Equipment to Comply with Acquis Requirements

ERDF 21 Aerial Emissions for Maghtab, Qortin and Wied Fulija Landfills

ERDF 22 Establishing Civic Amenity and Bring-In Sites

ERDF 23 Marine Scientific Surveys around Filfla for its Conservation

ERDF 28 Drinking Water Quality Project

4

Projects AnalysedMeasure 4.1

Basic Infrastructure & Development of the Tourism Sector

Project ref. number

Project Title

ERDF 32 Extension of the Crafts School & Setting up of a Crafts Incubation Centre

ERDF 34 Gozo Museum of Archaeology Display Project

ERDF 35 The Upgrading of the TINA Network in Gozo

ERDF 36 Niche tourism for the Island of Gozo

5

Projects AnalysedMeasure 4.2

Human Resources - ESF

Project ref. number

Project Title

ESF 27 ETC Schemes and Courses

ESF 28 Crafts Courses for Sustainable Careers in Gozo

ESF 29 University of Malta Gozo Centre Courses

6

Research Methodology

7

The analysis of the Structural Funds interventions included:

• Desk research• Literature review• Fieldwork• Interviews with key actors, beneficiaries and

users

Analytical Tools

• Obtaining data – Stakeholder consultation, individual interviews, focus groups, secondary and administrative data, observational techniques.

• Analysing data – logic models, focus groups, institutional analysis, input/output analysis.

• Making judgements – SWOT analysis, sustainability / risk assessment plus impact assessment.

Approach Taken• A Measure-specific and a project-specific

approach were applied; • Data and information concerning the

Effectiveness and Impact at both Measure and Project level was collected and analyzed;

• Some observations on Priority 4 which provides a specific programme allocation to address the special development need facing Gozo as a whole were also included;

• Particular attention was also paid to the aspect of data collection.

10

Measure SpecificMeasure Implementation

• Measure 1.1 had a slow start in terms of disbursement of funds;

• However, improvement was registered by the end of 2007;

• Measure 4.1 and Measure 4.2 - second best performing and the best performing Measures respectively;

11

Data Collection

• Use of Common Minimum Indicators;• Use of Mandatory Indicators;• Establishing meaningful Baseline Indicators;• Sourcing of data;• Measuring of public awareness;• Use of evaluation sheets;• Presentation of data in a meaningful manner to

the general public.

12

Recommendations • Data needs analysis• Ready availability of statistics from already

established sources (e.g. National Statistics Office, Malta Resources Authority etc.)

• Public perception surveys• Evaluation sheets of ESF-funded training programmes• Common set of identical indicators• Simple user surveys• Purpose / intent of trainees applying to join the

programme

13

Additional Outputs

• Course evaluation sheet

• Template for evaluating public awareness campaigns

14

Thank You

for your kind attention

15