ANNOUNCES NOTICE OF RECRUITEMENT · 2019. 10. 25. · sos children’s villages bosnia &...
Transcript of ANNOUNCES NOTICE OF RECRUITEMENT · 2019. 10. 25. · sos children’s villages bosnia &...
SOS CHILDREN’S VILLAGES BOSNIA & HERZEGOVINA
YOUTH EMPOWERMENT PROGRAMME IN SARAJEVO
ANNOUNCES NOTICE OF RECRUITEMENT
CONSULTANT / EXTERNAL ASSOCIATES (F/M) / 1 POSITION
DURATION: November – December 2019
PROJECT: YOUTH EMPOWERMENT AND EMPLOYMENT PROGRAM (YEEP) 2016-2019
SOS Children’s Villages Bosnia and Herzegovina (SOS BiH) seeks the services of a skilled evaluation consultant to
undertake an external evaluation of a 3-year project, funded by the German Federal Ministry for Economic Cooperation
and Development (BMZ) and Hermann-Gmeiner-Fonds Deutschland e.V. The overall aim of the project was to deliver a
continuous and sustained youth empowerment programme to help reduce the impact of youth unemployment on communities
and individuals in the region through youth employability. We support young people on their way to employment and
independence through a special focus on youth empowerment and to help them prepare for the labour market and increase
their employment prospects.
The Project - Promotion of professional and social integration of marginalized young people in Sarajevo through the
establishment of the "Youth Empowerment and Employment Program (YEEP)" started on 01 September, 2016 and will end on
31 December, 2019. This evaluation is intended to feed into project closure activities. Details regarding contents of proposals
and submission procedures are explained herein, Terms of Reference (ToR).
The evaluation will answer the following questions:
1) What are the changes the program has brought in the lives of the target group who participated in it, their families and their
communities?
2) How relevant, effective, efficient, sustainable and participatory are the programme interventions?
3) What lessons can be drawn from the project in order to be used for further continuation of the programme?
The evaluation should analyze the progress that the project has achieved in relation to the specific programme indicators, as
set out in the Impact Matrix of the project. All project material for the external evaluators are provided with access to data as
agreed in the contract signed.
The consultant qualifications should have:
Proven competency in monitoring and evaluation, including impact assessment or project evaluation.
A social science backgrounds.
Demonstrated a good knowledge of development work and partners in multiple sectors in Bosnia and Herzegovina, and
experience in international development is also highly desired.
A good knowledge of the country (Bosnia and Herzegovina) with focus on topics such as social protection and policies,
education, social inclusion, gender relations etc.
Proven experience and expertise in evaluating cross-cutting issues.
Proven experience in participatory processes and data collection methods.
Good facilitation and interpersonal skills.
Strong skills in coordinating teamwork.
Strong analytical and conceptual skills.
Excellent written and oral communication skills.
Ability to transfer complex concepts and ideas into practical and simple language.
Ideally experience in organising research processes with/for SOS Children’s Villages.
Ideally have experience and credibility in providing evaluating services to BMZ financed projects.
Proficiency in English language written and oral.
Excellent computer skills, including word processing, spreadsheet programs and data base management.
Re-announcement date: 25 October, 2019.
Submission of the technical and financial proposal.
The deadline for submitting the proposal is 04 November, 2019 at 16:00 hrs. (BiH time), with “YES Sarajevo
Evaluation” in the subject line.
Interested External Evaluator Service Provider’s should deliver, and/or email:
Curriculum Vitae (CV) of the expert/(s) that will be engaged in fulfilling the external evaluation service.
Letter of Interest (no more than one page).
Proposal (both technical and financial).
Any document that they have to proof their expertise on external evaluation, and/or an example piece of work from a
similar assignment.
Incomplete applications will not be considered.
Contacted will be only those candidates who are shortlisted.
Note: We do not commit to returning received applications.
Nepotpune prijave neće se razmatrati.
Kontaktirani će biti samo oni kandidati koji su ušli u uži izbor.
Napomena: Ne obavezujemo se vraćati pristigle prijave.
***
To: SOS Children's Villages Bosnia and Herzegovina
Semira Fraste, b.b. 71000 Sarajevo
Bosnia and Herzegovina
Or
E-mail: [email protected] and [email protected]
Subject line: YES Sarajevo Evaluation
A loving home for every child 1 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
Terms of Reference (TOR)
For
External Evaluation of the
Promotion of professional and social integration of marginalized young people in Sarajevo through the establishment of the Youth Empowerment and Employment Program (YEEP)
(BMZ Project 3756)
SOS Kinderdorf International, Representative Office, Bosnia and Herzegovina SOS Children’s Villages Bosnia and Herzegovina
Re-announcement
Sarajevo, Bosnia and Herzegovina 25 October 2019
A loving home for every child 2 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
TABLE OF CONTENTS
Introduction|3
1 | Background and Rationale|3
2 | Purpose, Objectives and Use|4
3 | Scope of the Work|6
4 | Methodology|11
5 | Process of Evaluation|11
6 | Outputs and Deliverables|13
7 | Expert profile of the Evaluation Team|13
8 | Tentative Timetable|14
9 | Management of the Evaluation|15
10| Quantity Structure|17
11| Evaluation Report Structure|19
12| Selection Criteria|21
13| Mode of Payment|21
14| Submission of the Technical and Financial Proposal|22
ACRONYMS BMZ German Federal Ministry for Economic Cooperation and Development CVPD Children’s Villages Programme Director ES Employment Specialist F&CDD Fundraising and Communication Development Director FD Finance Director HGFD SOS Children’s Villages worldwide / Hermann-Gmeiner-Fund Germany e.V. IM Impact Matrix IO SOS International IOR SOS international Office Region NALCA National Alternative Care Adviser ND National Director NFSPA National Family Strengthening Programme Advisor NGO None Governmental Organisation NPDD National Programme Development Director NPFA National Public Funding Adviser OECD/DAC Organisation for Economic Cooperation and Development / Development Assistant Committee PM Project Manager SOS BIH SOS Children’s Villages Bosnia and Herzegovina TOR Terms of Reference VC Volunteer Coordinator VET Vocational Education Training YEEP/YES Youth Empowerment Employment Program/Youth Empowerment Service
INTRODUCTION These Terms of Reference (ToR) serve as a request for proposals from individual consultants or companies who are interested in conducting an impact evaluation of the project: Promotion of professional and social integration of marginalized young people in Sarajevo through the
A loving home for every child 3 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
establishment of the "Youth Empowerment and Employment Program (YEEP)", BMZ project, funded by the German Federal Ministry for Economic Cooperation and Development (BMZ) and Hermann-Gmeiner-Fonds Deutschland e.V. Details regarding contents of proposals and submission procedures are explained herein. SOS Children’s Villages Bosnia and Herzegovina (SOS BiH) was registered in 1994 as the national representative of SOS Children’s Villages International and is a non-political, non-governmental organization. The programmes include youth development, education, alternative long-term care and family strengthening. The SOS BIH program activities are organised and implemented by 177 highly skilled employees and are being carried out in the locations of Sarajevo, Mostar, Gorazde and Gracanica. SOS Children's Villages International and SOS BiH have been working together successfully since 1994 and the programme work is divided into the following areas: Family-friendly alternative long-term care - two children's villages, two youth facilities, two "semi-independent living" programmes; Foster families - support for 40 foster families; Prevention-six family strengthening programmes; Education: two kindergartens, two centres for early childhood development, four youth empowerment projects; De-institutionalisation: development of the law on foster families and related quality standards, training of foster families, capacity building of skilled workers; and Advocacy-Care Leavers Voices, Youth Advocacy Network and Strengthening the Rights of Children in Alternative Care. SOS BiH actively, participates in policy-making and advocates for the rights of children and young people who are at social risk - as stated in the UN guidelines for alternative long-term care. And work closely with decision-makers, government institutions, civil society organizations and social service providers, and attached great importance to the involvement of young people in decision-making processes.
1|Background and Rationale
The Project1 - Promotion of professional and social integration of marginalized young people in Sarajevo through the establishment of the "Youth Empowerment and Employment Program (YEEP)” implemented in City of Sarajevo with emphasis in the two municipalities Novi Grad and Ilidza East with 139,704 residents. In the project area there are two groups of marginalize young people who are faced with particular challenges: both young people from troubled families and young people from care systems (social service, foster parents) are faced with socio-economic exclusion. In Novi Grad, the youth unemployment rate is 47.6% and in East Ilidza at 54%. Approximately 50% of the target group has a secondary school certificate but due to the pressure of just trying to provide for a living, are unable to complete further qualifications. Most of the young people work in the informal sector or do seasonal work by offering themselves as day workers. They only have a small irregular income and are exposed to risky and insecure working conditions. 20% of households with young people have problems covering monthly living costs. In these households’ teenagers are often responsible for the family income. This means that almost every one in five households lives at risk of poverty. The marginalized groups described are struggling because of their family situation (marginalized family or no parental care) with social exclusion. Psychosocial consequences of socio-economic exclusion are stress, depression, and fear for the future, alcohol and drug abuse and low self-esteem and negative self-image. Apathy, passivity and hopelessness are widespread among marginalized youth. This reinforces the already existing burden of the still noticeable effects of the war and the strong inter-ethnic tensions. Furthermore, the local community and employers lack the responsibility, responsiveness and coordination mechanisms to tackle the important issues of marginalized youth integration and unemployment.
1 The Project, refer to Promotion of professional and social integration of marginalized young people in Sarajevo through the establishment of the "Youth Empowerment and Employment Program (YEEP)”, hereinafter YES Center.
A loving home for every child 4 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
All programmes of SOS Children’s Villages Bosnia and Herzegovina (SOS BiH) contributed to social inclusion of discriminated and marginalized young people. Therefore, this project is not a one-time action but bedded into a long-term and integrated Youth Empowerment Programme. The overall objective is to improve the livelihood and empowerment of 300 marginalized young people (15-29 year of age) in the City of Sarajevo, benefited from a quality information access in the Youth Empowerment and Employment Program (YEEP) Centre (hereinafter YES Center). More specifically to support youth in their ability to find employment/income by means of qualifications and trainings in the area of life-employability skills, job search skills/application, vocational training, employment and self-help/business start-ups. Further increased of its household income, contributed to their financial self-sustainability, and social inclusion. As a result, the role of the target group as responsible project stakeholder was strengthened. The established collaborative stakeholders network provided a platform for exchange of experience and knowledge, mutual support, confirmation and maintained the collaborative YEEP Stakeholders Network, were NGO Nautilus as strategic partner in this project were improved. Furthermore, the involved voluntary youth in the Information Center are important actors in the peer learning approach of the project that assures a long-term involvement and motivation of the target group. SOS BiH secured cooperation with public institutions, different chambers of commerce and the business sector. The evaluation should determine the extent of the implemented outcomes and sustainability of the project as well as the performance of SOS BiH in the process of the project implementation that will lead to recommendations for improvement of the approach and services for supporting marginalized youth reaching social and financial sustainability. In addition, the evaluation results can serve as bases for further joint initiatives and cooperation between SOS Children’s Villages worldwide / Hermann-Gmeiner-Fund Germany e.V. (HGFD) and SOS Children’s Villages Bosnia and Herzegovina as implementing partners. This evaluation at the end of the project should assess strengths and weaknesses of the project, its impact on the target group and potential improvements and/or new developments for further continuation of the project.
It should also support the pilot approach of this project and draw lessons learnt from the implementation that can be taken further to develop and implement similar projects in other municipalities in Bosnia and Herzegovina.
2|Purpose, Objectives and Use
The overall objective of this evaluation will be to assess the impact of the project. The specific objectives of the evaluation are:
To assess the effectiveness of the implemented Project: Promotion of professional and social integration of marginalized young people in Sarajevo through the establishment of the "Youth Empowerment and Employment Program (YEEP)" in the City of Sarajevo targeting two municipalities Novi Grad (Federation of BiH) and East Ilidza (Republika Srpska). Especially the progress the project has made against the target indicators as found in the Impact Matrix (IM).
To evaluate the efficiency of the project in relation to beneficiaries, costs and timeframe of the project.
Assess the extent to which the project addressed the real needs of the target group (relevance).
To assess the sustainability of the project (institutional, social, financial, etc.).
To assess how the project contributed to the desired long-term change for the beneficiaries (impact).
To conclude finding and recommendations for further development of future interventions. More details about the specific objectives can be found under point No.3 Scope of work.
A loving home for every child 5 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
The desired results of the evaluation are:
To document the impact of the project with special emphasis on the impact the project has had on marginalized youth (including women).
To provide commentary on the overall project design, the intervention logic and an analysis of the strategy and methodology used in the project: Promotion of professional and social integration of marginalized young people in Sarajevo through the establishment of the "Youth Empowerment and Employment Program (YEEP)” in the City of Sarajevo (two municipalities Novi Grad-Federation of BiH and East Ilidza - Republika Srpska).
To critically examine the impact matrix and target indicators found in the original proposal and provide post-project figures along with a narrative explaining the reasons for under/over performance achievement.
To draw conclusions, make recommendations and state lessons learnt for future strategy and improvements in implementation of the project.
To provide commentary on the current political, social and cultural factors impacting the implementation of the project.
To document the communities’ attitude towards the project.
Key persons:
Marginalized youth participating in the project
Youth who are not participating but might be somehow affected by the project (e.g. from neighborhood)
Marginalized youth who left the project
Project team
SOS Children’s Villages BiH programme units’ staff/teams; especially those of Youth Empowerment and Family Strengthening Programme
Project partners, community members and associates, local partners and main stakeholders
Strategic and Programme Management on National Level
Key users of evaluations results:
Project level: Project team – Project Manager (PM), Employment Specialist (ES), Volunteer Coordinator (VC).
Management level: National Director (ND), National Programme Development Director (NPDD), Finance Director (FD), Fundraising and Communication Development Director (FR&CDD); National Public Funding Adviser (NPFA), National Alternative Care Adviser (NALCA), National Family Strengthening Programme Advisor (NFSPA), and Children’s Villages Programme Director, Sarajevo (CVPD).
Community level: Mayor in two municipalities Novi Grad (Federation of BiH) and East Ilidza (Republika Srpska), Administrative Units authorities, Regional Labor Offices of BiH authorities, Public VET centres / Academe in BiH, Corporates and Civil Society Organisations.
Regional level: SOS international Office Region (IOR).
Global level: SOS international (IO), project donor and SOS Kinderdörfer weltweit. The evaluation findings should contribute to:
Strengthen the work with marginalized young people in reaching to improve the livelihood and empowerment to their financial self-sustainability, and social inclusion, socio-economical sustainability.
Strengthen the partnerships with community service providers, associates and duty bearers;
A loving home for every child 6 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
Improve organizational future programme work.
Understand more deeply how and why the project is effecting change.
Inform decision making authorities in local and national level for further strategic directions toward work with marginalized young people.
3| Scope of the Work
The geographical scope at which the evaluation will be conducted is on the territory of the City of Sarajevo with a special focus on the Municipality of Novi Grad (Federation of BiH) and East Ilidza (Republika Srpska), where the YES Centre is located, through which the activities of the project are being implemented.
The scope of the evaluation will include all the aspects (activities, services) of the project implementation
as presented in the Project Proposal and Impact Matrix. The statistically significant sample of project
participants (random sample of project participants – marginalized youth from SOS care and two-targeted
local communities which are currently assisted by the project, as well as youth that have already left the
project, partners and project staff should take part in the evaluation in order to collect and analyse the
maximum available qualitative and quantitative data.
The plan is to invite all relevant partners and duty bearers to take part in the evaluation, without exclusion
of anyone. The evaluation segment of desk research will be done at the evaluator’s premises, but the
research (survey, focus groups, and interviews) will take place in YES Center, Sarajevo.
The expected period for conducting the evaluation is two months after the conclusion of an agreement for the implementation of the evaluation.
The evaluation questions should be revolved around the following evaluation criteria (OECD DAC): Relevance, Impact, Effectiveness, Efficiency, Sustainability and Project Management and Coordination. On the basis of the above evaluation criteria, instruments/questionnaires for the field mission should be prepared for stakeholders. Refer to Table 1.
A loving home for every child 7 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
Table 1: Defining the DAC Evaluation Criteria
Evaluation issue
Key guiding questions
Sources of information
Relevance Does the project address the situation of the specific target group?
To what extent is the project focused on the intended target group - i.e. youth and parents from vulnerable families and local specialists from relevant institutions/organisations?
What have been the specific criteria for the selection of the beneficiaries?
To what extent the youth and parents from vulnerable families and local specialists from relevant institutions/organisations have met the selection criteria?
To what extent, the project interventions respond to the needs and priorities of the project participants, including the needs of the communities that the project addresses?
To what extent project design addresses locally and nationally defined needs and priorities?
To what extent, the project adjustments that have been made so far, were relevant?
Documents: BMZ Project Proposal Annual SOS BiH and BMZ
project reports BMZ Project Participants
Database BMZ project Monitoring Tool Individual Folder and
individual development plan of project participants
People: Project participants, former
project participants Project staff
Effectiveness and Efficiency Has the project reached the intended results in an effective and efficient way?
To what extent are the objectives of the project being attained?
What is the percentage of the project fulfilment against the set indicators?
To what extent the project strategies, methodologies, tools and processes contributed to the achievement of the planned results?
Is the relation between input of resources and results achieved appropriate and justifiable?
What are the social benefits for youth/families/communities compared with resources spent for activities?
How do the costs of this project compare with the similar initiatives in the country?
Could the outcomes and results have been achieved at lower cost through applying a different approach?
Documents: Quarterly progress reports Annual BMZ project reports Individual Folder of project
participants Statistics Feedback letters of the project
participants Pre and post training evaluation
forms Partnership agreements
A loving home for every child 8 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
Building sustainable community-based responses
To what extent the project objectives and activities are in compliance of the needs of the target group?
Does the support system being built in the target communities effectively respond to the situation of youth and parents of vulnerable families?
To what extent has SOS Children’s Villages BiH contributed to the development of capacity of the public/private partners and main duty bearers to respond to the situation of the target group?
To what extent the community demonstrates interest to the project outcomes?
To what extent local authorities are involved and provide support to the project?
Building self-reliance of marginalized young people at risk
How many beneficiaries have participated in the project? Are all of them in need of the project services?
To what extend the beneficiaries are aware of the project and the services it provides? Do all targeted beneficiaries receive services by the project?
To what extent have beneficiaries been satisfied with the project interventions?
To what extend the amount, type and quality of the services correspond to the needs of the target group?
To what extent the quality of support had improved the lives of the beneficiaries? Are they satisfied with the services they received and its quality?
How many beneficiaries left the project since the beginning and became self-reliant? To what extend the results which they reached are sustainable and effective after they left the project?
What are the reasons for beneficiaries to fail in achieving self-reliance by the end of the evaluated period?
People: Marginalized young people and
state specialists who are participating or have participated in the project;
Partners (key implementation partner, public bodies and private partners)
Project staff Documents: BMZ Project Participants
Database Individual Development plans
(IPDs) SOS BiH Programme
Database Partner organisation - youth
led organisation – NGO Nautilus database
A loving home for every child 9 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
What approaches and strategies defined in case files/ beneficiaries’ plans have been the most effective and contributing in achieving self-reliance?
Is replication or removal of certain approaches required to increase efficiency?
Impact The systematic analysis of the changes in the lives of beneficiaries, communities and other stakeholders brought by the project.
What has been the impact in line with the planned results of the project, in terms of changes brought about in the situation of beneficiaries and communities?
What has been the impact beyond the planned results of the project, in terms of changes brought about in the situation of beneficiaries and communities? (positive and/or negative)
Documents: Matrix of Indicators as per BMZ-
Proposal Project progress reports Individual Folder of project
participants Feedback letters of the project
participants Pre and post training evaluation
forms People: Marginalized young people from
SOS Care, 2 local communities and local specialists from relevant institutions/organisations who are participating or have participated in the project
Partners (public bodies, government, key implementation partner)
Other stakeholders Project staff
A loving home for every child 10 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
Sustainability Measuring whether the benefits of an activity are likely to continue after donor funding has been withdrawn. Projects need to be environmentally as well as financially sustainable.
To what extend can activities, results and effects be expected to continue after project (BMZ/HGFD financing) has ended?
Has the capacity of the implementation partner been developed? If so, in what areas and how?
People: Marginalized young people and
youth from vulnerable families in 2 targeted areas and local specialists from relevant institutions/organisations who are participating or have participated in the project.
Partners (public bodies, government, key implementation partner)
Volunteers participated in the project
Project staff
Project management and coordination Does the project management and coordination ensure the quality implementation of the project.
To what extent does the project have appropriate management and coordination structures and organization of the process? Are these structures aimed at quality of the project implementation?
Who else from the local associates implementing partner was involved in the process of management and coordination and how it affects the quality implementation?
Documents: Project progress reports Partnership agreements
People: Project management team Partners (public bodies,
government, key implementation partner)
Project staff
A loving home for every child 11 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
4|Methodology
To be applied in the evaluation. The External Evaluation should be based on participatory approach involving and engaging a wide and diverse range of stakeholders. Stakeholders` participation is necessary for accountability, promoting ownership and sustainability, facilitating buy in, and further use of the evaluation recommendations. The participatory approach is very useful in engaging stakeholders and gaining their insights, experiences with the programs and the benefits obtained because of the programs. The evaluation implies inclusion of various 'rights holders' or young people leaving care, young people at social risk, parents at social risk, children from families at social risk that benefit from the project, as well as the 'duty bearers' or those responsible and accountable for providing services. This is necessary to assess whether benefits and contributions are fairly distributed by the interventions being evaluated. In general, evaluation methodology is concentrated on the objective, description and explanation of changes that have happened in beneficiaries’ lives due to their participation in the project. The evaluation approach should be also results’ oriented to provide evidence of both quantitative and qualitative achievements and the outputs and outcomes obtained by the project (or not). Both primary and secondary data should be used in the evaluation, and collected from a wide and diverse range of primary and secondary sources. Secondary information should be collected from documents provided to the evaluator. Primary information should be collected from the stakeholders of the project through semi-
structured interviews face-to face, and focus group discussions with beneficiaries and project staff members. The external evaluation work should be implemented according to Organizational Code of Conduct and Child Protection Policy.
5|Process of Evaluation
Description of the evaluation phases, the activities undertaken (chronologically) and relevant actors: Plan and design data collection methodology and process and agree on site visits to the project areas to meet project participants: 300 marginalized young people from SOS Care and two-targeted local communities and local specialists from relevant institutions/organisations and collect information in accordance with the requirements stipulated in the evaluation design.
The methodology of evaluation will include the following:
Document review including analysis on key reference documents listed in Terms of Reference
Case study of randomly selected beneficiaries’ files (present and those who exited the project
Interviews - structured and/or semi-structured; in person and/or by telephone with key informants listed in Terms of Reference
Focus groups with selected key informants – youth and parents of vulnerable families in the targeted areas and local specialists from relevant institutions/organisations, community members
Other methods relevant to evaluation objectives and scope
A loving home for every child 12 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
Data collection process includes:
Reviewing the project documentation and other sources of information at project level.
Identification of the major stakeholders who are associated with the project to be interviewed, such as the direct participants of the project (300 marginalized young people from SOS Care and local communities in the two-targeted areas and local specialists from relevant institutions/organisations), implementation partners, key local government representatives, and other service providers.
Selection of representative sample of communities or groups to be interviewed on the basis of agreed criteria.
Agreeing on the type of information to be collected.
Preparation of data collection tools including consultation with project staff on project/national/regional level.
Data collection with questionnaires and interviews with co-workers, beneficiaries, representatives of
partners, local authorities and community, focus groups and analysis of data. All data collected needs
to be disaggregated by sex.
Other to be defined by external evaluator.
Data analysis and elaboration of evaluation report: External evaluator will analyse collected data and will prepare an evaluation report that describes the main evaluator’s findings, recommendations and lessons learned. The final report should follow the structure and content as outlined in the terms of references. This stage includes:
Analysis of the data and elaboration of conclusions and recommendations
Preparation of a draft report
Present the findings to the respective staff on local/national and regional/ level to ensure triangulation
Finalise the report after inputs from various stakeholders
The main participants of the evaluation are:
Direct project beneficiaries: marginalized young people from SOS Care and 2 two municipalities
Novi Grad (Federation of BiH) and East Ilidza (Republika Srpska); local specialists from relevant institutions/organisations.
Project staff: Project Manager (PM), Employment Specialist (ES), Volunteer Coordinator (VC).
Programme staff on the National level: National Director (ND), National Programme Development Director (NPDD), Finance Director (FD), Fundraising and Communication Development Director (FR&CDD); National Public Funding Adviser (NPFA), National Alternative Care Adviser (NALCA), National Family Strengthening Programme Adviser (NFSPA), and Children’s Villages Programme Director, Sarajevo (CVPD).
Direct stakeholders: local government, private partners, business community, volunteers, etc.
6|Outputs and Deliverables External evaluator should prepare the following key deliverables:
Evaluation Design Contains the evaluation framework, detailed evaluation methodology, work plan and budget.
Developed Evaluation Tools
A loving home for every child 13 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
Draft Evaluation Report Draft report will be prepared in line with the proposed structure below and should be submitted to National Programme Management in National Office (NO), electronically via e-mail, in English not exceed 30 pages.
Final Evaluation Report
The findings of the external evaluation shall be presented in a written report following the proposed outline. Attachments – Templates of applied evaluation tools, questionnaires, main areas for focus groups and etc. The final evaluation report should be jargon free, clear and simply written. The main body of the report should not exceed 30 pages and should include an Executive summary, brief project background and recommendations. Technical information/annexes should be included in appendices only. Analysis of project achievements should always be backed up with relevant data, with reference to the data source. Recommendations should be specific and include relevant details for how they might be implemented. Final evaluation report should be submitted to National Director in English.
7|Expert profile of the Evaluation Team The Consultant must have:
Proven competency in monitoring and evaluation, including impact assessment or project evaluation.
A social science backgrounds.
Demonstrated a good knowledge of development work and partners in multiple sectors in Bosnia and Herzegovina, and experience in international development is also highly desired.
A good knowledge of the country (Bosnia and Herzegovina) with focus on topics such as social protection and policies, education, social inclusion, gender relations etc.
Proven experience and expertise in evaluating cross-cutting issues.
Proven experience in participatory processes and data collection methods.
Good facilitation and interpersonal skills.
Strong skills in coordinating teamwork.
Strong analytical and conceptual skills.
Excellent written and oral communication skills.
Ability to transfer complex concepts and ideas into practical and simple language.
Ideally experience in organising research processes with/for SOS Children’s Villages.
Ideally have experience and credibility in providing evaluating services to BMZ financed projects.
Proficiency in English language written and oral.
Excellent computer skills, including word processing, spreadsheet programs and data base management.
The Evaluation team should consist of the number of persons, which can be affordable in accordance with the approved evaluation budget. Roles and responsibilities in the team are distributed in accordance to the competence, level of expertise and requirements of the evaluation team. In order to be more time effective, the work with the documents, meetings with the project team, beneficiaries, partners and stakeholders can be done simultaneously and divided among evaluation team members. It is expected that the evaluation team will present concrete recommendations which are addressed to the specific stakeholders. Team leader of the evaluation team is responsible for:
A loving home for every child 14 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
Quality and timely fulfilment of the ToR with expected results of the evaluation
Overall evaluation design of the process
Elaborated evaluation plan indicating each step of the process
Effective distribution of the responsibilities among evaluation team members
Quality and timely implementation of the evaluation plan
Effective and quality data collection
Data compilation and analysing aimed at reaching goal of the evaluation
Preparation and submission of high quality and consistent evaluation report in due course External evaluator should not be biased and have any reason for conflict of interests. Evaluation team must respect participating communities’ culture, social norms, values and behaviour; and maintain appropriate relationships with participants to this evaluation.
8|Tentative Timetable
No.
No. of Weeks
Actions
Success Indicator
1. 1st week Hold 1st meeting with the client and defining of the contracted volume of work
The volume of work agreed and the contract is signed by both parties
Prepare the action plan for the evaluation process indicating the exact dates of visiting the location
Plan is prepared and approved by National Office (NO)
Analyse all available basic project documents (BMZ-proposal, reports, BMZ-guidelines, concepts, etc.)
Evaluation team received the documents in time
2.
2nd week
Develop set of tools (interviews, questionnaires, focus group scenarios etc.)
The set of tools is defined and approved by NO
2nd meeting with the client and discussion of the methodology and tools to be used during evaluation
Methodology and tools are defined and approved by NO
Prepare and submit to NO schedule of site visits mentioning all required documents to be prepared in the location
Schedule is approved by NO and received by the location. All required documents are prepared by the location
Develop and finalise the visit plan with the defined local stakeholders, project workers, stakeholders in the location, beneficiaries in the location
Visit plan is agreed, final visit plan (if needed) is received by the evaluators
3. 3rd week Make visit to the project location Evaluators are in the location
Hold meetings with all relevant parties as per the visit plan
Questionnaires are filled, focus groups and interviews are documented
Provide and analyse project documents in the location
Evaluators possess all required documents in the location
A loving home for every child 15 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
Analyse all data and prepare the draft report indicating the findings, recommendations, lessons learnt
Draft report is prepared and shared with NO
4. 4rt week 3rd meeting with the client and discussion of the preliminary results of the evaluation
Feedback from NO is received by the evaluators
Make the final draft report Final draft report is received
Provide feedback for the final draft report from NO and insert in the final draft
Feedback is received by evaluators and inserted in the final draft
Prepare and send final draft to NO Final draft received and approved by NO in the final draft and final draft received by NO
9|Management of the Evaluation Management involvement in the process is defined by the scope of responsibilities in the organisation. During the evaluation the responsibilities will be distributed as follow:
No.
Title/Position Responsibilities Comments
National Office of SOS Children’s Villages Bosnia and Herzegovina
1. National Director (ND)
• Approval of the volume of work for the evaluators • Signing of the contract with the evaluators • Approval of the final draft of the evaluation report • Approval of the payment, based on the contract terms
2.
National Programme Development Director (NPDD)
• Define the overall scope of work for the evaluation • Discuss the action plans and evaluation process with the
evaluators • Discuss methodology and set of tools with the evaluators • Receive and approve the evaluators action plans, visit
plans etc. • Finalise with the evaluators and with the project manager
the visit list and ensure the organization of the meetings as per the approved visit plan.
• Provide feedback to the 1st and the final draft evaluation report
• Monitor the whole process of evaluation • Approval of the TOR for evaluation • Approval of the final list of documents to be forwarded to
the evaluators • Providing feedback and approval of the methodology and
tools for evaluation • Approve schedule of the meetings
A loving home for every child 16 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
No.
Title/Position Responsibilities Comments
3. Project Manager (PM)
• Organises meetings with all relevant people as per the visit plan (SOS + external)
• Provides all relevant project documents and information (reports, statistics, etc.)
• In cooperation with NPDD organise meetings with the evaluators and NO workers
• Prepare draft of TOR • Discuss the action plans and evaluation process with the
evaluators • Discuss methodology and set of tools with the evaluators
4. Project staff
• Provides all relevant project documents and information (reports, statistics, etc.)
• Organise meetings with community members, programme participants for evaluation purpose
• Contribute during feedback giving process as per component led by each of them
A loving home for every child 17 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
10|Quantity Structure
Table 2, below showing the different activities and amount of 24 working days per evaluator:
NO. EVALUATION ACTIVITIES
DAYS OF THE MONTH
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
1. Hold 1st meeting with the client and defining of the contracted volume of work.
2. Prepare the action plan for the evaluation process indicating the exact dates of visiting the location.
3.
Finalise the list of the basic documents to be provided to the evaluation team. If translation is needed define the documents for translation.
4. Analise all available basic project documents (reports, guidelines, concepts etc.).
5. Develop set of tools (interviews, questionnaires, focus group scenarios etc.).
6. 2nd meeting with the client and discussion of the methodology and tools to be used during evaluation.
7. Prepare and submit to National Office (NO) schedule of travel to project location and required documents to be prepared.
8.
Develop and finalise the visit plan with the defined local stakeholders, project workers, stakeholders and beneficiaries in the location.
A loving home for every child 18 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
NO. EVALUATION ACTIVITIES
DAYS OF THE MONTH
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
9. Make visit to the project location.
10. Hold meetings with all relevant parties as per the visit plan.
11. Provide and analyse project documents in the location.
12. Analyse all data and prepare the draft report indicating the findings, recommendations, lessons learnt.
13. 3rd meeting with the client and discussion of the preliminary results of the evaluation.
14. Make the final draft report.
15. Provide feedback for the final draft report from NO and insert in the final draft.
16. Prepare and send final draft to NO.
The evaluation is expected to be undertaken in between November – December 2019. The final report is due on 31st of December 2019.
A loving home for every child 19 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
11|Evaluation Report Structure
The evaluation report has to be structured in the following way:
TABLE OF CONTENTS
Table of contents
Figures and tables
Acronyms SUMMARY
Background and project context
Findings and conclusions
Recommendations and lessons learned 1. INTRODUCTION
1.1. SCOPE OF EVALUATION • Brief project description
1.2. BACKGROUND AND RATIONALE
• Reason and justification for evaluation • Aim and purpose of evaluation • Key guiding questions
1.3. EVALUATION MISSION
• Time span and process of evaluation • Profile, composition and independence (none-bias) of evaluation team • Participation of partners and target group in evaluation • External factors influencing the evaluation process and respective consequences
2. METHODOLOGY
2.1. EVALUATION APPROACH AND METHODOLOGY • Methodology and instruments • Measures ensuring the protection of the stakeholders involved
2.2. CRITICAL ASSESSMENT
• Measures ensuring the protection of the stakeholders involved 3. CONDITIONS FOR EVALUATION
• Local context, problem statement, initial potentials of project and important changes throughout project period
• Presence and actions of other stakeholders • Risk factors for achieving project objectives
A loving home for every child 20 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
4. PERFORMANCE OF GERMAN AND IMPLEMENTING PARTNER
• Staff qualification • Changes at German and implementing partner organization
5. EFFECTIVENESS
5.1. RELEVANCE • Needs of the target group are addressed and the objectives of the donor (BMZ),
German and implementing partners are attained • Adequate developmental approach and conceptualization
5.2. EFFECTIVENESS
• Quality of project planning • Quality of system of indicators and objectives • Quality of project implementation • Motivation, ownership and legitimacy of implementing partner • Quality of project management • Achievability of project objectives • Other effects on output and impact level (incl. negative, if any)
5.3. EFFICIENCY
• Cost effectiveness of the project
5.4. DEVELOPMENTAL IMPACTS • Achievement of overall objective • Model-character, structural changes and broad effect • Other effects of overall, developmental impact (incl. negative, if any)
5.5. SUSTAINABILITY
• Viability and durability of positive impacts (once BMZ-funding has ceased); incl. developments in surrounding areas.
• Risks and potentials of sustainable impacts for the target group as well as on organisational level
6. CROSS-CUTTING ISSUES
• Cross-cutting topics of development cooperation • Contribution to organisational goals
7. CONCLUSIONS AND RECOMMENDATIONS
7.1. CONCLUSIONS
7.2. RECOMMENDATIONS
7.3. LESSONS LEARNED
A loving home for every child 21 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
ANNEXES • Terms of Reference • Composition and independence (none-bias) of evaluation team • Evaluation matrix • Evaluation plan and time diagram • List of stakeholders consulted • Bibliography/reference • Questionnaires/other data collection instruments • System of objectives and indicators
12|Selection Criteria
The following selection criteria will be taken into consideration by the tender committee in selecting the best proposal:
Method: The proposed method for evaluating the impact of the project is suitable.
Timetable/work plan: The timetable/work plan are realistic and meet the needs of the project.
Cost: The cost of the proposal given the availability of data, analysis, method, and other aspects of
the proposal are reasonable and feasible.
Experience: The level of training and experience of the consultants in undertaking impact evaluations and recommendations from organizations for which the consultant(s) have worked previously.
Proposals should include details on methodology, work plan, costs, expertise, experiences and Curriculum Vitae (CV) of the consultant(s).
13|Mode of Payment
The agreed consultancy fee will be paid in three phases (installments): 1st Phase: The consultant shall receive 25% of the total agreed amount upon signing the contract. 2nd Phase: The consultant shall receive 25% of the total agreed amount after the submission of the draft report, and after having received feedback from relevant stakeholders. This phase includes presentation of the draft report.
3rd Phase: The consultant shall receive the remaining 50% of the total payment after incorporating all of the feedbacks received from various stakeholders and the submission of the Final Report.
A loving home for every child 22 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina
14|Submission of the Technical and Financial Proposal
Re-announcement date: 25 October, 2019.
The deadline for submitting the proposal is 04 November, 2019 at 16:00 hrs. (BiH time), with “YES Sarajevo Evaluation” in the subject line. Interested External Evaluator Service Provider’s should deliver, and/or email:
Curriculum Vitae (CV) of the expert/(s) that will be engaged in fulfilling the external evaluation service.
Letter of Interest (no more than one page).
Proposal (both technical and financial).
Any document that they have to proof their expertise on external evaluation, and/or an example piece of work from a similar assignment.
***
To: SOS Children's Villages Bosnia and Herzegovina
Semira Fraste, b.b. 71000 Sarajevo Bosnia and Herzegovina
Or E-mail: [email protected] and [email protected]
Subject line: YES Sarajevo Evaluation