ESF Evaluation partnership Rome, 26 November 2014

“Monitoring and evaluation of Italian Youth Guarantee Implementation Plan”

A joint project of Italian Ministry of Labour and Social Policies and ISFOL

Outline of this presentation

Key elements of Italian YGIP

Monitoring and evaluation activity and its output

First evidences on the progress of YG scheme in

Italy

Key elements of Italian YGIP - 1

• Performance related pay system: a standard cost framework devised to reward most effective interventions

• Contestability: Services costs in charge of residence region but opportunity for clients to apply everywhere

• Standard profiling score to assess the risk of social exclusion and to modulate reimbursement to Employment Services

Key elements of Italian YGIP - 2

• Subsidiarity: possible interventions supporting Regions not complying with effectiveness and management targets

• Monitoring and evaluation

The YG scheme: paths, measures, offers

Registration

Basic services

Vocational training

Community Service

Job coaching

Promotion

Support

Employment

Apprenticeship

Traineeship

Self-employment

Addressing to Employment

Services

Continued education and

training

Outreaching drop-outs

from education

and training system

Overall budget

Monitoring and evaluation

i. Monitoring and evaluation of implementation process of YG Regional Action plans

ii. Monitoring of services delivered, activation measures and of beneficiaries

iii. Impact and efficiency evaluation of measures

iv. Assessment of YG impact in a comparative macroeconomic perspective

i. Implementation process analysis

Youth Guarantee policies: YEI funds role in Regional plans and complementarities between YEI and other resources

Regional plans implementation: analysis of service delivering procedures and mechanisms at regional level; role of Social Partners and other stakeholders in the YG measures provisions; monitoring implementation and operational programming; in-depth focus on Community Services measure

ii. Monitoring of services, measures and beneficiaries

Quasi real-time analysis of: registrations, take-ups, services and measures delivered.

Outcomes: detailed data on participants, measures offered and

regional models and performances

list of indicators depicting implementation status and progress towards target(s) achievement

Clients perception and satisfaction (ad-hoc CAWI survey)

YGIP list of indicators

Implementation

Coverage

Immediate and long-term outcome

Performance and process

Service quality perception

JAF (EMCO) indicators

Impact and effectivenessevaluation

Assess the effectiveness of measures implemented in terms of activation of YG beneficiaries through: Employment (including apprenticeship), Vocational training, Continued education

Outcomes and targets set according to measures’ characteristics and rationale

Administrative data (2015) and survey data (including a longitudinal section of the sample – 2015-2016)

YG impact in a comparative macroeconomic perspective

Assess the possible differentiated impact of YG program in European countries and explore possible success factors

Macro-economic and simulation modelling to assess the impact of YG on LM indicators and productive systems.

Progress in budget allocation

A snapshot of YG implementation (as of November 19th)

Registered users 303,071 17.6 % of indicative target* Contacted by PES and

profiled **94,627 31.6 % of registered users **

In YG Service 5,493 5.8 % of profiled users

Received an ALMP offer 3,574 3.8 % of profiled users

Source: Ministry of Labour - BDPAPL

* Target as of 2013 (LFS estimates of NEETs available to work)** Data missing for Liguria region

Monthly flow of registrations and take ups by Employment Services

Registered users by age

Take ups by profiling score index