under EU-funded Balochistan Rural Development and ...€¦ · Special thanks to all the trainers...

TRAINING ON BRDCEP MONITORING & EVALUATION FRAMEWORK AND SOCIO-ECONOMIC BASELINE SURVEYS APPROACHES AND METHODOLOGIES

under EU-funded Balochistan Rural Development and Community Empowerment Programme (BRDCEP) being implemented in collaboration with the Local Government

and Rural Development (LG&RD) Department, Government of Balochistan

Quetta, 27th November - 1st December, 2017

RURAL SUPPORT PROGRAMMES NETWORK

Training on M&E framework and SESs Approaches & Methodologies

P a g e | ii

Acknowledgements

Special thanks to all the trainers and resource persons- Mr. Khurram Shahzad, Mr. Muhammad Tahir Waqar, Mr. Ahmed Ullah, Mr. Asmat Kakar, Mr. Muhammad Ibrahim Alvi, Mr. Ghulam Rasool, Mr. Sharafat Sherazi and Mr. Rafiullah Kakar for delivering comprehensive and participatory sessions in accordance to the training workshop agenda and schedule. We would also like to appreciate the Government of Balochistan representatives, especially Mr. Asfandyar Kakar, Secretary P&D and Mr. Agha Syed Liaqat Ali, MPA and Member of Parliamentary Committees at P&D for their active participation in the training. Last but not least, we are grateful to the participants from BRSP, NRSP and representatives from GoB-P&D department for their interactive discussions during the training sessions.

www.facebook.com/BRDCEP www.rspn.org, www.brdcep.org.pk

Prepared by: Mawish Iqbal, Documentation and Reporting Officer, BRDCEP, RSPN Khurram Shahzad, Specialist Monitoring & Evaluation, RSPN © 2017 Rural Support Programmes Network (RSPN). All Rights Reserved.

“This publication has been produced with the assistance of the European Union. The contents of this

publication are the sole responsibility of Rural Support Programmes Network (RSPN), Balochistan Rural

Support Programme (BRSP), and National Rural Support Programme (NRSP) and can in no way be taken

to reflect the views of the European Union.”

More information about the European Union in Pakistan is available on:

Web: http://eeas.europa.eu/delegations/pakistan/ Twitter: http://www.twitter.com/EUPakistan Facebook: https://www.facebook.com/pages/European-Union-in-Pakistan/269745043207452

http://www.facebook.com/BRDCEP

http://www.rspn.org/

http://www.brdcep.org.pk/

http://eeas.europa.eu/delegations/pakistan/

http://www.twitter.com/EUPakistan

https://www.facebook.com/pages/European-Union-in-Pakistan/269745043207452

https://www.bing.com/images/search?view=detailV2&ccid=sZTWuSmL&id=EF967C46AD6F99E13367C7E946143D698F09D16D&thid=OIP.sZTWuSmLx2Phlna2MOv1KgEsEs&mediaurl=http://icon-icons.com/icons2/535/PNG/512/Facebook-Icon_icon-icons.com_52904.png&exph=512&expw=512&q=facebook+symbol&simid=608023356445625703&selectedIndex=5


P a g e | iii Rural Support Programmes Network (RSPN)

Acronyms and Abbreviations

ANSA Affiliated Network for Social Accountability’s

BCDP Balochistan Community Development Programme

BRDA Balochistan Rural Development Academy (BRDA)

BRDCEP Balochistan Rural Development and Community Empowerment Programme

BRSP Balochistan Rural Support Programme

C&V Communication and Visibility

CAPI Computer-Assisted Personal Interviewing

CAT Community Awareness Toolkit

CDD Community Driven Development

CEO Chief Executive Officer

CO Community Organisation

CRPs Community Resource Persons

DAC Development Assistance Committee

DRM Detailed Result Matrix

EU European Union

EU-TA European Union-Technical Assistance

GIS Geographical Information System

GoB Government of Balochistan

GYDI Global Youth Development Index

ICT Information and Communications Technology

IDRC International Development Resource Centre

IFAD International Fund for Agriculture Development

IMI Institutional Maturity Index

IOA Institutional and Organisational Assessment Model

IT Information Technology

KM Knowledge Management

KPIs Key Performance Indicators

LG&RD Local Government and Rural Development

LSO Local Support Organisation

M&E Monitoring & Evaluation

MER Monitoring, Evaluation and Research

MIS Management Information System

MPA Member Provincial Assembly

NRSP National Rural Support Programme

OECD Organisation for Economic Co-operation and Development's

P&D Planning and Development

PAR Participatory Action Research

PEACE Programme for Economic Advancement and Community Empowerment

PFM Public Finance Management

PIM Programme Implementation Manual


P a g e | iv Rural Support Programmes Network (RSPN)

PIU Programme Implementation Unit

PMER Planning, Monitoring, Evaluation and Research

PMM Programme Monitoring Matrix

PMP Programme Monitoring Plan

PMU Programme Management Unit

PSC Poverty Scorecard

QA Quality Assurance

QACP Quality Assurance and Control Plan

QC Quality Control

ROM Result Oriented Monitoring

RSPN Rural Support Programmes Network

RSPs Rural Support Programmes

SDGs Sustainable Development Goals

SES Socio-Economic Surveys

SUCCESS Sindh Union Council and Community Strengthening Support

UC Union Council

VO Village Organisation

YDI Youth Development Index


P a g e | v Rural Support Programmes Network (RSPN)

Table of Contents

ACKNOWLEDGEMENTS ............................................................................................................................ II

ACRONYMS AND ABBREVIATIONS .......................................................................................................... III

1. INTRODUCTION TO BRDCEP ................................................................................................................. 1

2. PREFACE TO THE TRAINING WORKSHOP .............................................................................................. 2

3. PROCEEDINGS OF DAY ONE .................................................................................................................. 3

3.1. WELCOME REMARKS .................................................................................................................................3

3.2. SESSION ON OVERALL INTERVENTION LOGIC OF BRDCEP ..................................................................................4

3.3. AN OVERVIEW OF BRDCEP LOGFRAME .........................................................................................................4

3.4. STRATEGIC IMPORTANCE OF M&E FRAMEWORK .............................................................................................5

3.5. PROCESS OF DEVELOPMENT OF M&E FRAMEWORK .........................................................................................6

3.6. SESSION ON TYPES, PURPOSE, SCOPE AND MONITORING FUNCTIONS ..................................................................6

3.7. KEY ELEMENTS OF MONITORING FUNCTION IN BRDCEP ..................................................................................7

4. PROCEEDINGS OF DAY TWO ................................................................................................................. 8

4.1. SESSION ON BRDCEP’S PROGRAMME MONITORING MATRIX............................................................................8

4.2. M&E TEAM STRUCTURE - ROLE AND RESPONSIBILITIES ....................................................................................8

4.3. MONITORING OF PROGRAMME BY THE EU .....................................................................................................9

4.4. MAINSTREAMING GENDER & SOCIAL ACCOUNTABILITY MECHANISMS IN M&E FRAMEWORK ................................10

4.5. RSPN ASSISTANCE IN DEVELOPING A JOINT & INTEGRATED MIS/GIS FOR BRDCEP ...........................................11

4.6. TYPES, PURPOSE, SCOPE AND CRITERIA FOR EVALUATION ...............................................................................11

4.7. EC’S TOOLS AND METHODS TO MANAGE AN EVALUATION PROCESS .................................................................12

5. PROCEEDINGS OF DAY THREE ............................................................................................................. 13

5.1. IMPORTANCE OF POVERTY TARGETING IN CDD PROGRAMMES.........................................................................13

5.2. OVERVIEW OF THE POVERTY SCORECARD CENSUS PROGRESS ...........................................................................13

5.3. PRE AND POST PROGRAMME POVERTY SCORECARD SURVEYS ..........................................................................14

5.4. SESSION ON GLOBAL YOUTH DEVELOPMENT INDEX 2016 ...............................................................................14

5.5. APPROACHES & METHODOLOGIES OF SOCIO-ECONOMIC BASELINE SURVEYS ......................................................15

6. PROCEEDINGS OF DAY FOUR .............................................................................................................. 16

6.1. SESSION ON ANNUAL INSTITUTIONAL MATURITY INDEX SURVEYS ......................................................................16

6.2. AN INTRODUCTION TO THE BRDCEP RESEARCH COMPONENT .........................................................................16

6.3. RESEARCH FRAMEWORK FOR BRDCEP & ACTION PLAN .................................................................................17

6.4. STRATEGY FOR OPERATIONALISATION OF M&E FRAMEWORK ..........................................................................17

6.5. IMPORTANCE OF MANAGEMENT INFORMATION SYSTEM IN M&E .....................................................................18

6.6. MECHANISMS TO REVIEW THE PROGRESS AGAINST M&E FRAMEWORK .............................................................19

6.7. DISCUSSIONS ON M&E REPORTING ............................................................................................................19

6.8. SESSION ON EU REPORTING GUIDELINES .....................................................................................................19

7. PROCEEDINGS OF DAY FIVE ................................................................................................................ 20

7.1. DISCUSSIONS ON MAJOR CHALLENGES IN MONITORING & EVALUATION IN BALOCHISTAN CONTEXT ........................20

7.2. ROLE OF EU-TA ON GENDER ANALYSIS AND CDD POLICY FORMULATION ..........................................................21

7.3. QUALITY ASSURANCE AND QUALITY CONTROL MECHANISMS ...........................................................................21

7.4. MANAGEMENT OF RISK REGISTER FOR BRDCEP ...........................................................................................22


P a g e | vi Rural Support Programmes Network (RSPN)

7.5. OVERVIEW OF THE TRAINING SESSIONS AND WAY-FORWARD ..........................................................................22

8. CLOSING REMARKS BY GOB REPRESENTATIVES .................................................................................. 23

8.1. MR. ASFANDYAR KAKAR, SECRETARY P&D, GOB ..........................................................................................23

8.2. MR. AGHA SYED LIAQAT ALI, MPA & MEMBER OF PARLIAMENTARY COMMITTEE-P&D, GOB .............................23

9. CERTIFICATE DISTRIBUTION AND CONCLUSION .................................................................................. 24

10. PARTICIPANTS FEEDBACK AND EVALUATION OF TRAINING ............................................................. 24

10.1. TRAINING OBJECTIVES, CONTENTS, DESIGN AND FACILITATORS ......................................................................24

10.2. TRAINING CONCEPTS/MODULES ..............................................................................................................26

10.3. PARTICIPATION IN SUBSEQUENT TRAININGS ................................................................................................26

11. KEY DECISIONS AND FOLLOW-UP ACTION POINTS ........................................................................... 27

ANNEX-I: TRAINING AGENDA AND SCHEDULE ........................................................................................ 28

ANNEX-II: LIST OF TRAINING PARTICIPANTS .......................................................................................... 30


P a g e | 1 Rural Support Programmes Network (RSPN)

1. Introduction to BRDCEP

Balochistan Rural Development and Community Empowerment Programme (BRDCEP) is

supported by the European Union (EU) and being implemented in close collaboration with the

Local Government and Rural Development (LG&RDD) Department of the Government of

Balochistan (GoB). The five-year BRDCEP is being implemented by three implementing partners,

namely Rural Support Programmes Network (RSPN), National Rural Support Programme (NRSP)

and Balochistan Rural Support Programme (BRSP) in 249 rural Union Councils(UCs) of eight

districts of Balochistan. The programme focuses on empowering citizens and communities and

providing them with the means to implement community-driven socio-economic development

interventions. It will also amplify their voice and capability to influence public policy decision-

making through active engagement with local authorities for quality, inclusive and equitable

service delivery, and civic-oversight.

The EU has also engaged the services of Human Dynamics, an Austrian institution, to enable the

Government of Balochistan (GoB) to foster an enabling environment for strengthening the

capacities of local government/authorities to manage and involve communities in the statutory

local public sector planning, financing, and implementation processes. The Programme also has a

Public Finance Management (PFM) component, which will work closely with Human Dynamics to

assist the GoB to cost and fund the community-led development policy framework.

The overall objective of the BRDCEP is to support the Government of Balochistan in its efforts to

reduce the negative impact of economic deprivation, poverty and social inequality, environmental

degradation and climate change, and instead to develop opportunities by building and

empowering resilient communities to participate actively in identifying and implementing socio-

economic development activities on a sustainable basis in partnership with local authorities.

Under BRDCEP, 1.9 million Pakistani citizens of 300,000 poor rural households in 249 union

councils will be mobilised and organised into a network of people’s own institutions: 19,129

Community Organisations (COs); 3,103 Village Organisations (VOs); 249 Local Support

Organisations (LSOs) and 31 LSO Networks at tehsil level and eight at district level.

RPSN component under BRDCEP is operational from June 30, 2017 and will be concluded on June

30, 2022. The RSPN’s role involves facilitating implementation of the programme through partner

RSPs by ensuring quality control, standardization of procedures, developing a common M&E

framework, baseline approaches, documentation, responding appropriately to lessons learnt and

providing value-added strategic backing where required. RSPN will also aim at wider



dissemination of the lessons learnt through evidence-based advocacy with stakeholders and the

media to scale up successful development approaches.

2. Preface to the Training Workshop

Monitoring and Evaluation (M&E) of programme activities offers the programme managers,

government and civil society representatives with improved means for learning from previous

experience, enhances service delivery, assists in forecasting and apportionment of resources, and

corroborates domino effect. Besides, it stimulates the philosophy of accountability amid the

stakeholders at individual and organization levels and consequently increases the effectiveness of

projects and programmes. As part of BRDCEP-RSPN component, RSPN prepared a Monitoring &

Evaluation (M&E) Framework for the BRDCEP partner RSPs which include the Balochistan Rural

Support Programme (BRSP) and National Rural Support Programme (NRSP). In addition to

outlining and providing detailed matrices on the Monitoring and Evaluation functions of the

BRDCEP, closely tied to the global programme Logframe, the M&E Framework includes associated

tools such as the Quality Assurance and Control Plan (QACP), Institutional Maturity Index (IMI),

Socio-Economic Baseline Midline and End-line survey approaches and methodologies and a

manual on the Poverty Scorecard (PSC) survey for enumerators and supervisors.

These tools were prepared after reviewing the EU action document, existing manuals of the RSPs,

BRSP and NRSP proposal documents and consultation with RSP resource groups. An extensive

review of literature and desk studies was also undertaken in the formation of these documents.

For the socio-economic baseline approaches and methodologies, the input from the University of

Mannheim, Germany was also considered. Considering this all, RSPN arranged a five days training

on “Monitoring & Evaluation Framework and Socio-economic Approaches and Methodologies”

exclusively for the BRDCEP. The training was held from November 27, 2017 to December 1, 2017

at Quetta Serena Hotel. BRDCEP M&E team of BRSP and NRSP along-with relevant government

officials from Planning and Development (P&D) department and Local Government and Rural

Development (LG&RD) department of GoB attended the training event. Although these two were

different trainings, but as the content was overlapping and the participants were supposed to be



same that’s why it was fused together. Furthermore, for the said reasons, the quality control and

quality assurance related content were also conferred upon. However, the remaining content of

quality control and quality assurance will be covered during the training on BRDCEP’s Programme

Implementation Manual (PIM) in January 2018.

The overall objective of the training was to orient BRSP and NRSP monitoring officers and other

participants on BRDCEP M&E framework and socio-economic baseline survey approaches and

methodologies. In addition to this, to review the M&E framework draft and incorporate feedback

in it. It was also aimed at augmenting awareness and ripen the interest in implementation of result

based M&E of projects and shed light on what it needs. Participatory and interactive approach

was adopted throughout the training. It included open Discussion; experience sharing; question

& answer; summary and feedback and power point presentations; etc.

3. Proceedings of Day One

November 27, 2017

On November 27, 2017 Mr. Khurram Shahzad, Specialist M&E, RSPN opened the training event

and warmly hailed all the participants. He stated that the objective of the training is to nurture a

common understanding of M&E framework and Socio-economic Approaches and Methodologies

amongst all the BRDCEP stakeholders. “We are here for sharing and incorporation of further

feedback; there is flexibility. We will be reviewing these as a team”, expressed Mr. Khurram.

Then one of the participants

recited a few verses from the Holy

Quran. Later on, a round of

introduction was conducted. All

the participants were asked to

divvy up their work experience

too.

3.1. Welcome Remarks

Dr. Shahnawaz Khan, Senior

Programme Manager and Team

Leader-BRDCEP, BRSP said, “I am

thankful to Mr. Khurram Shahzad

and Mr. Muhammad Tahir Waqar not only for organising this training; but for their role in

conceptualisation of BRDCEP at the programme designing phase.” He further added that BRDCEP

has been built upon EU-funded Balochistan Community Development Programme (BCDP) and

Sindh Union Council and Community Strengthening Support (SUCCESS). Regarding the training, he

underscored that M&E is an integral component of any programme. M&E framework serves as a

guiding component, from which we can derive outputs and indicators”, spoke Dr. Shahnawaz

Khan. The purpose of this training is to develop a common understanding of M&E framework. He

advised to incorporate the lessons learned from previous experiences.



Mr. Khurram Shahzad added that one of the purposes of this training is networking and the strong

networking leads to innovative thinking.

3.2. Session on overall Intervention Logic of BRDCEP

By Mr. Khurram Shahzad, Specialist M&E, RSPN

Mr. Shahzad comprehensively explicated the overall Intervention Logic of the BRDCEP in

accordance to the programme’s action document. He shared that the BRDCEP is being considered

as one of the best designed programme covers strengthening local governance for the sustainable

rural development. He further stated that in case of BCDP, the top-tier excelled in terms of

engaging GoB and now EU hopes to sustain the same work and theoretical account at the district

and lower levels in case of BRDCEP.

Mr. Shahzad then gave details of how RSPN works. He then moved on to how the EU support to

the Community Driven Development (CDD) approach where EU support for engaging RSPs

commenced from PEACE, then BCDP and SUCCESS and now it is more strengthened with the

BRDCEP.

He told that BRDCEP has three RSPs as implementing partners for grant component and engaged

Human Dynamics for technical assistance to the GoB. In each contract, components of other

implementing partners are added in order to ensure shared understanding and standardisation

and achieve common programme development objectives. He then talked about the anticipated

results from BRDCEP set out for RSPN, RSPs and EU-TA. He also shared that one of the core

components of the programme is mainstreaming of crosscutting themes such as gender; social

accountability; evidence based policy development; etc. He also shared the importance of

formulating the community-driven local development policy framework for the Balochistan.

Mr. Siraj Ghouri, Sr. Manager M&E, ICT and C&V - BRSP, commented that if we get successful in

developing the said local development policy framework; it will be a mammoth success and this

will result in sustainable

development in the

province.

3.3. An overview of

BRDCEP Logframe By Mr. Muhammad Tahir

Waqar, Senior Programme

Manager MER, NRSP

Mr. Waqar delivered an

extensive session on an

overview of BRDCEP

Logframe. To encourage

participation, he first asked

the participants to define the logframe. Several definitions of logframe were put forth by the

participants. Mr. Waqar then defined the logframe and explained about the horizontal and



vertical logic of the logframe tool. He said that the logframe recapitulates the project/programme

and its context in a logical way, consequently the association between the activities (inputs) and

the expected results (outputs) can be observed. It has both a vertical and a horizontal logic, where

the vertical logic illustrates what the project proposes to do; the connections between what will

be done and what will be accomplished (the ‘means to the ends’) and it postulates the key risks

and assumptions. The horizontal logic delimits how progress and performance will be monitored,

and what will be the information sources for doing this.

Then Mr. Waqar discussed the EU logframe template and explained its contents in detail. He told

that the output/result indicators can be fed on a regular basis and it is important to note,

remember and ensure that the indicators will be disintegrated by gender. He informed that result

level indicators will be in percentage; however, the output level indicators will be in numbers. All

the participants agreed to all this.

Mr. Waqar further informed that under BRDCEP national and provincial LSO conventions and

other similar events will be held. One of the key elements of BRDCEP is that on the basis of review

and analysis of gender policies, the necessary change in gender policies will be brought.

He also advised to disseminate information and have participatory discussions on crosscutting

themes in the meetings and trainings conducted by Community Resource Persons (CRPs). This can

result in raised awareness and improvement in the attitudinal factors. “When in the field, we need

to do process monitoring and also gauge how activities are moving in line with timeline”, intoned

Mr. Waqar.

3.4. Strategic Importance of M&E Framework

By Mr. Ahmed Ullah, Programme Manager BRDCEP, RSPN

At the outset of the session Mr. Ahmed Ullah explicated the linkage about the significance of

BRDCEP and M&E. He said that BRDCEP

addresses both demand and supply side

factors of the rural development through

strengthening local governance.

Referring to the strategic importance of

BRDCEP M&E Framework, Mr. Ahmed Ullah

articulated that M&E Framework is

indispensable as it will assist in developing

unified monitoring and evaluation strategies

and serves as a guidance to construct a

common M&E component of the BRDCEP for

the implementing partners. The framework

showcases a meticulous description of the

scope of the monitoring and evaluation

functions. It also contains modules on the

approaches and methodologies for socio-economic baseline surveys; institutional maturity index;



quality assurance and control plan along with poverty scorecard implementation manual and

guidelines.

At the end of this session, Mr. Siraj Ghouri added that we need to stress on value of time. Timing

is very critical particularly in M&E perspective.

3.5. Process of Development of M&E Framework


Mr. Shahzad then gave details as regards the process that was adopted in formulation of M&E

framework. He re-counted that the approach has been consultative that hinges on ‘shared

expectations’ and ‘joint ownership’. It was headed out with a desk review followed by several

consultative meetings with focal points and relevant BRDCEP team. M&E framework was then

presented in successive M&E Resource Groups Meeting and germane sections of the M&E

Framework were also shared with Technical Advisor of University of Mannheim, Germany.

He stipulated that the Specialist M&E at RSPN and M&E Managers of respective BRDCEP

implementing partner RSPs, BRSP and NRSP shall be the keepers. The M&E framework is a living

document. However, ensuing to the initial approval; revisions can be incorporated into it as per

the requirements of field implementation; when deemed necessary. It will be preferred to accept

request for revisions in writing; the approval of incorporating any modification will be established

jointly with all the stakeholders including EU.

3.6. Session on Types, Purpose, Scope and Monitoring Functions

By Mr. Asmat Kakar, M&E Officer BRDCEP, RSPN

Mr. Kakar firstly asked the

participants to share how do they

define and understand the term

monitoring. “Monitoring is a

systematic activity where it is

observed, tracked and analyze how

the programme is progressing and

of what quality it is”, said Mr.

Kakar. He accentuated that

monitoring under BRDCEP will

induce validation of progress, risk

mitigation, scope management,

programme course correction,

quality assurance, timeliness and

better coordination.

Then he talked about the scope of monitoring under BRDCEP. He stated that it will cover the

following aspects:

Human resource and technical inputs, activities, processes, and immediate outputs.



The prime focus will be relevance, targeting or beneficiary selection and efficiency afore

effectiveness.

Regarding the monitoring functions, Mr. Kakar said that it will include: maintaining logframe and

tracking performance and risks; verifying and reporting on the state of implementation progress

and human and technical inputs. It will also observe the beneficiary selection criteria. Follow-up

on key agreed actions from the periodic monitoring reports.

Responding to a participant’s query that what constitutes an environment risk, Mr. Shahzad said

that it takes in policy, regulations, law and order situation, etc. Furthermore, Mr. Waqar

reinforced to keep reviewing the assumptions (both internal and external) stated in the

programme’s logframe to have better understanding of the context and risks.

3.7. Key Elements of Monitoring Function in BRDCEP


Mr. Shahzad then delivered an inclusive session with respect to the key elements of monitoring

function in BRDCEP. He stated that the key monitoring and reporting elements are:

Key Performance Indicators (KPIs);

Programme Monitoring Plan (PMP);

Detailed Result Matrix (DRM);

Programme Monitoring Matrix (PMM);

Monitoring in insecure areas;

Reporting; and

M&E Team Structure, Role & Responsibilities.

He explained the KPIs by providing various practical examples. He mentioned that these KPIs will

provide a holistic picture of

the overall BRDCEP on a

standardised format. In

addition, a web-based

integrated MIS is being

developed by both

implementing RSPs to track

and report on the KPIs on

regular basis. In the MIS, the

KPIs will be mapped on

different geographic layers,

for e.g. province, districts,

tehsils, and union councils to show the overall geographic coverage of the programme

interventions. As concerns PMP, it informs who will implement, how the implementation will be

done, what will be the timeframe and who will monitor. The template of PMM for BRDCEP was

showcased and explained in detail. Mr. Asmat Kakar added that BRDCEP impact and outcome

level indicators are aligned with all the SDGs.



Mr. Shahzad then said that the DRM centers on what to monitor. It functions as a monitoring

guidance matrix for the relevant stakeholders and implementing partners counting the RSP

programme teams for BRDCEP, and the EU. On the other hand, PMM will offer a more thorough

depiction of how, when and where to carry out monitoring. It will also delineate who should be

responsible for conducting and monitoring the activities; and also covers details on the

target/criteria of each activity and sub-activity, the location it has to take place and the

timeline/frequency with which it is to be carried out. Both the DRM and PMM will be reviewed

bi-annually.

4. Proceedings of Day Two

November 28, 2017

On the second day of the training, Mr. Shahzad recapped the day-one and concisely summarized

all the sessions delivered.

4.1. Session on BRDCEP’s Programme Monitoring Matrix

By Mr. Asmat Kakar, M&E Officer BRDEP, RSPN

Mr. Kakar delivered session in a participatory way on BRDCEP’s Programme Monitoring Matrix

(PMM). He said that this matrix explains on how, when and where to undertake monitoring and

who would be responsible for conducting the monitoring activity. The PMM is fabricated upon

the DRM. He highlighted that it provides details on the target/criteria of each indicator, the

timeline/frequency with which the indicators are to be monitored. The PMM will be reviewed bi-

annually reinforced by Mr. Kakar. He then explained the format and contents of the PPM in detail.

Then the participants were asked to review and provide feedback or clarify any query they may

have.

4.2. M&E Team Structure - Role and Responsibilities

By Mr. Muhammad Tahir Waqar, Senior Programme Manage MER, NRSP

Mr. Waqar said that the key for M&E team is to maintain some independence from the

programme implementation

team. For this, the M&E staff at

district level should directly

report to the Manager M&E at

PMU/PIU of BRSP at Quetta

and NRSP at Turbat- who will

directly report to the Manager

M&ER at BRSP Head office at

Quetta and NRSP at Islamabad.

He then explained the

proposed structure for M&E

and also what should be the



responsibilities of M&E staff at field, district and head office levels.

Mr. Shahzad said that it is critical to have regular coordination and communication between M&E

and programme management teams essential to achieve the programme development

objectives, efficiently and effectively.

4.3. Monitoring of Programme by the EU

By Mr. Ibrahim Alvi, Manager PMER, BRSP

Mr. Alvi, reinforced the importance of monitoring function for the BRDCEP. He also shared the

experiences and lessons learned from the BCDP and other projects from monitoring perspectives.

He informed that the senior official at EU

delegation for Pakistan designated for

BRDCEP will be doing regular monitoring

of the programme. This mechanism will

involve regular meetings with BRDCEP

implementing partners; participation in

the BRDCEP activities; field visit to see

progress and meet with community

institutions, GoB representatives,

development stakeholders, and the

beneficiaries as well. Thus, they will also

be reviewing and following-up on the

periodic progress reports of BRDCEP

implementing partners i.e. RSPN, EU-TA,

BRSP and NRSP.

Mr. Alvi also explained the Result Oriented Monitoring (ROM) Mission. It provides a brief

depiction on the implementation of an intervention at the given time. It works not only as a

support tool for project management by informing stakeholders about the performance of a

EU-funded projects are assessed by external experts according to four DAC criteria:

Relevance is the extent to which the objectives of a development intervention are consistent

with beneficiaries’ requirements, country needs, global priorities and partners’ and donors’ policies.

Efficiency is the measure of how economically resources/inputs (funds, expertise, time, etc.) are

converted into outputs.

Effectiveness is the extent to which the development intervention’s objectives were achieved, or are expected to be achieved, taking into account their relative importance.

Sustainability is the continuation of benefits from a development intervention after major development assistance has been completed.

Horizontal issues such as gender, environment and EU visibility are also part of the analysis.

Source: https://ec.europa.eu/europeaid/results-oriented-monitoring_en

https://ec.europa.eu/europeaid/results-oriented-monitoring_en



specific intervention, moreover it adds the lessons learnt for further programming, design and

implementation of interventions. It is conducted through on site assessments of interventions. A

consistent, greatly structured methodology guarantees the quality and the comparability of the

data gathered. Interventions are notched against OECD evaluation criteria (relevance, efficiency,

effectiveness, impact, and sustainability) substantiated by summarizing explanatory texts. In the

training, also the benefits of ROM mission for implementing partners were also expounded.

4.4. Mainstreaming Gender & Social Accountability Mechanisms in M&E

Framework


It was quite an interactive session. Initially, the participants shared their understanding regarding

the notion of social accountability. Mr. Ahmed Ullah then defined the term social accountability

by using DFID and World Bank definitions.

He said that the use of social accountability

is relatively new in Pakistan. Its main aim is

to improve the public service delivery in the

country in a participatory way.

He then conferred about the Affiliated

Network for Social Accountability’s (ANSA)

framework for social accountability as it is

more applicable to BRDCEP. He further

added that it is imperative to understand

that the social accountability initiatives

which are not sensitive to their ever-

changing contexts will always undergo

questioning of relevance. He also explained

the several social accountability tools that are being utilized worldwide. Importantly, Mr. Ahmed

Ullah said that the BRDCEP intervention logic and its overall blueprint for implementation

addresses the usage of almost all the social accountability tools and techniques discussed. And so,

he explained this in particular by referring to BRDCEP relevant activities and usability of various

social accountability tools and processes.

Moving to the mainstreaming Gender, Mr. Ahmed Ullah expressed that Gender mainstreaming

approach is to stimulate empowerment of women by enabling women to analytically evaluate

their own situations, gain skills, build confidence, move into decision-making roles and organise

with others to influence change. It necessitates the transformation of gender power relations by

the women who are affected by inequalities and discrimination. Regarding BRDCEP, he stated that

under this programme- gender focused M&E Framework, PIM, CAT, etc. are being developed and

finalised along with gender sensitive approaches in measuring results and reporting mechanism.

In addition, EU-TA will carry out comprehensive gender analysis for gender mainstreaming

strategy and will work with RSPs to mainstream recommendations at organisational and

programme levels. This was well accepted by the training participants.



4.5. RSPN Assistance in Developing a Joint & Integrated MIS/GIS for BRDCEP


Mr. Shahzad shared with the participants that RSPN will facilitate in developing a common

integrated MIS as per the BRDCEP’s requirement. Mr. Siraj ratified that we can standardise the

contents of both MIS being developed by the BRSP and NRSP, separately. Mr. Shahzad suggested

to have agreement and cooperation, it will be good to form a MIS working group of all three grant

programme implementation partners i.e. RSPN, NRSP and BRSP. He further emphasized that it is

important to document the MIS/IT related working as it helps throughout and after the

programme life cycle as well. All the relevant staff at the training was in agreement with this all.

It was underlined that the integrated MIS/databases fortifies effective data storage, information

sharing and data management. It also strengthens the reporting through the auto-generation of

standardised reports required for submission to the EU and sharing with other stakeholders. This

will also be useful in improving timeliness and completeness of reporting.

4.6. Types, Purpose, Scope and Criteria for Evaluation


At the start of this important session, Mr. Shahzad clearly emphasised stated that the aim of

evaluation under BRDCEP will be twofold.

1. Learning for improvement of in the ongoing BRDCEP programme and/or design of future

projects and programmes, and

2. Accountability of those results that are committed to the GoB, EU and other key

development stakeholders

Nonetheless, as regards the

scope of the evaluation under

BRDCEP it is hoofed on the

Impact and outcome level

indicators of the overall

BRDCEP Logframe.

Mr. Shahzad explained about

the criteria of evaluation that

includes measuring the change

in poverty status of household

on the poverty scorecard. This

will be done through the PSC

census before the programme

and a sample based PSC survey

at the end of the programme to

measure the change overtime. Also, estimate the change in the income, sources of income, asset

ownership, incidence, depth and severity of poverty, with associated social characteristics of the

poor people (households), perception on citizen's involvement in local governance process.



Moreover, estimate the change in targeted poor households’ access to and use of public services,

with satisfaction levels such as access to water and sanitation, education, health, civil acts

registration, etc.

Mr. Shahzad added that we shall assess the functionality, capacity and maturity of the community

institutions (COs/VOs/LSOs) formed under the programme, for this Sample based Community

Institutions Maturity Index surveys will be undertaken. He further stated that a number of

thematic quantitative and qualitative studies will also be conducted under RSPN component that

will also gauge the impact of BRDCEP activities. In addition to these evaluations/assessments, EU

has planned to undertake an external mid-term review and a final evaluation.

4.7. EC’s Tools and Methods to Manage an Evaluation Process


Mr. Shahzad explained about the training sessions organised by EU Delegation on "Tools and

methods to manage an evaluation process", from 31st January to 2nd February 2017, within the EU

Delegation. He also informed the meeting participants that this training was initially designed and

targeted to EU’s project managers, however considering the importance of the RSPs in current

context, the EU invited RSPN to participate to this training- to be then disseminated to the other

RSPs with an objective to better understanding of the EU's approach and methodology to

evaluations of projects and programmes, and that the implementing RSPs to know what to expect

when EU shall undertake the mid-term and final evaluation of RSP implemented programmes.

Therefore, Mr. Shahzad from RSPN attended this three-day long training sessions led by

evaluation experts engaged by the EU headquarter in Brussels.

The overall training objective was to improve the quality of EU funded operations in line with aid effectiveness principles and the purpose was to support EU task managers in a useful/practical way in order to improve the management of project and programme evaluations. Mr. Shahzad briefly discussed the following concepts, methodologies, approaches and tools for evaluation with the training participants: Introduction to the overall course and its basic evaluation concepts Nature and uses of evaluations Key elements for an evaluation process Evaluation methods Evaluation tools Current thinking and recent developments in relation to evaluations Development of terms of reference for an evaluation Managing the quality of an evaluation process

Mr. Shahzad further added that the training agenda along-with training material and sessions’

PowerPoint presentations already shared via dropbox with the M&E managers and focal persons

of BRSP and NRSP for reference, sharing with district M&E officers, use and further needful

actions.



5. Proceedings of Day Three

November 29, 2017

Mr. Asmat Kakar reiterated the day one and two. In a nutshell, he abridged all the sessions and

discussions.

5.1. Importance of Poverty Targeting in CDD Programmes

By Mr. Muhammad Tahir Waqar,

Senior Programme Manager MER,

NRSP

Mr. Waqar said that the two main

focus areas under BRDCEP include

policy based on CDD approach and

increase income of poor people. He

said that the key to achieve this is

that social mobilisation should be

inclusive and representative of poor

households.

Moving to the topic, he emphasised

first to understand why and how

poverty targeting. He stated that in

case of Balochistan, there prevails

vast disparities amongst the districts. The targeting focus will be more on areas where the

intensity of the poor is more.

Mr. Waqar also described the approaches of poverty targeting is employed by the World Bank

and IFAD. Then he proceeded towards the various instruments being used for poverty targeting

globally. Moreover, he talked about the cutoff points and their impact on implementing poverty

targeting interventions. He said that the choice of cut-off matters a lot for impact. Most

importantly, he shared about the official poverty definitions uses Pakistan. He said at RSPs for PSC

census, we use the official PSC developed by the World Bank for Pakistan. However, we have

added a family-roster to capture more accurate data. Mr. Khurram Shahzad then explained the

PSC and poverty at household level nexus.

5.2. Overview of the Poverty Scorecard Census Progress

By Mr. Muhammad Ibrahim Alvi, Manager PMER, BRSP and

Mr. Ghulam Rasool, Programme Manager BRDCEP, NRSP



Mr. Alvi shared that approximately 50 percent target of PSC census has been completed in the

seven districts of BRSP. He also reported the district wise summary statistics against various PSC

indicators. Until now, the average household size tends to be 5.67. District Loralai hosts the

maximum household size and it was close to 7. Until now there have been 2,964 cases of refusal.

Further, Mr. Alvi informed that validation for socio-economic baseline survey will be made out by

25th December and the data collection will start in February 2018.

Then, Mr. Ghulam Rasool briefly presented an overview of District Kech and NRSP’s work there.

Referring to PSC progress under BRDCEP, he informed that out of the total target 66,795

households, until now the 18,045 households have been covered. He then shared various

statistics as per the collected data. He also reported that before initiating PSC, NRSP held a

meeting with the chairman of local government and updated them about the survey activities.

5.3. Pre and Post Programme Poverty Scorecard Surveys

By Mr. Muhammad Tahir Waqar, Senior Programme Manager MER, NRSP

Mr. Waqar stated that PSC is one of the tools being used for poverty targeting. It is a simple and

user-friendly tool that local pro-poor development programmes can use for targeting, for

monitoring their beneficiary selection, and for tracking changes in participants’ poverty rates over

time. RSPs are also using it as part of the social mobilisation process and implementation for

poverty targeted interventions. Interestingly, RSPN has developed a user-manual for BRSP and

NRSP exclusively for BRDCEP.

He then explained that under BRDCEP, CAPI approach based PSC is being conducted by BRSP and

NRSP. He also said that manual data entry was more time consuming, complicated and prone to

errors.

5.4. Session on Global Youth Development Index 2016

By Mr. Rafiullah Kakar, Consultant at World Bank

The Youth Development Index measures progress on youth development in 183 countries,

counting 49 Commonwealth member states, told Mr. Rafiullah Kakar. It covers five domains,

measuring young people’s levels of education, health and well-being, employment and

opportunity, as well as civic participation and political participation. Germany topped the list with



a score of 0.894, followed by Denmark and Australia. The three countries presenting the greatest

decline in their YDI scores between 2010 and 2015 are Pakistan, Angola and Haiti. Young people

in all three countries have been severely affected by civil unrest, armed conflict and natural

disasters.

Mr. Rafiullah Kakar shared that Pakistan stands

at 154 among 183 countries in the YDI. In

Pakistan 42% of children are enrolled in

secondary schools. However, the South Asia

and global score for the same indicator are 68%

and 81% singly. Likewise, in terms of financial

inclusion and political participation Pakistan

ranks too low in comparison to the South Asia

and global scores for the same indicators. The

YDI suggests the following areas critical to

youth development should be prioritised by

governments and policy-makers in the region:

Secondary enrolment; Youth employment; Proficiency in internet usage; Financial inclusion; and Mental disorders.

Mr. Khurram Shahzad concluded the session by thanking Mr. Rafiullah Kakar for taking time and sharing his contribution on youth development, globally. He further emphasised that the critical areas identified for focus for country and specifically in context of Balochistan will be considered during the rollout of the BRDCEP implementation activities.

5.5. Approaches & Methodologies of Socio-economic Baseline Surveys


Mr. Shahzad once again highlighted the purpose and scope of evaluation under BRDCEP. The

baseline, midline and end-line Socio-Economic Surveys (SES) are fragment of the overall

accountability and learning purpose of the M&E component of the BRDCEP.

He further explained the purpose and objectives of the SES are: a) estimate the change in the

income, sources of income, asset ownership, incidence, depth and severity of poverty and

associated social characteristics of the poor (households) in the targeted programme districts;

and b) estimate the change in targeted poor households’ access to and use of basic social and

public services, with satisfaction levels such as access to water and sanitation, education, health,

civil acts registration, etc.

He then explained the approach of SES. Basically, it will be outsourced by RSPs. He also shared the

timelines and methodology. For the power and sample calculations, he informed that it was done

by University of Mannheim. He also shed light on the themes and associated questions of the SES.



6. Proceedings of Day Four

November 30, 2017

Mr. Khurram Shahzad went over the deliberations and sessions of the last three days.

6.1. Session on Annual Institutional Maturity Index Surveys


Mr. Shahzad delivered a comprehensive and interactive session on Institutional Maturity Index

(IMI). He said that the IMI

captures how mature are the

developed community

institutions. An institution or

social structure has a number

of facets. It includes capacity

of its members, policy and

legislation, planning and

implementation of

development activities,

profitable linkages with

markets and local authorities,

etc. He said that IMI is a useful

tool to assess the maturity level of community institutions (COs, VOs and LSOs). Through it, the

issues that are identified are basically the areas of improvement for community institutions.

IMI is aimed at exploring capacity gaps and put forward remedial measures for capacity building

of community institutions and also facilitate these institutions to undertake self-assessment and

improve organizational effectiveness and efficiency. Mr. Shahzad shared that IMI is formulated

based on Institutional and Organisational Assessment Model (IOA Model) by Universalia and the

International Development Resource Centre (IDRC).

He then thoroughly explained the indicators and criteria of evaluation through IMI. He said that

all the indicators included in IMI are verifiable. Under IMI, the location of community institutions

with respect to distance and access will also be assessed. IMI is an added value for programme

development and policy support. It also helps in verifying that all segments of the community are

represented in the community institutions.

6.2. An Introduction to the BRDCEP Research Component


One of the key component of BRDCEP is participatory action research, shared Mr. Ahmed

Ullah.The primary purpose of research is to promote evidence-based advocacy and learning with

relevant stakeholders, policy makers and donors and to inform the design of the Balochistan

community-led development framework. Also, the research generated evidence can be used to

scale-up successful CDD approaches.



With the purpose of continuing and disseminating common learning, basic principles of

Participatory Action Research (PAR) model will be used to stimulate empowerment, participation

and action of all stakeholders involved. This approach of action research will be used to specifically

focus on understanding: (1) poverty dynamics in Balochistan, (2) the nexus between community-

led development and local governance, (3) the dynamics of inclusive development, with focus on

gender issues and women’s empowerment. The findings of this will feed into policy formulation

and inform decision making

6.3. Research Framework for BRDCEP & Action Plan


Mr. Ahmed Ullah explained the BRDCEP framework. He said that under it following activities will

be carried out:

Participatory Action Research;

Thematic Sectoral Studies/assessments;

Qualitative Studies to further explore findings from Socioeconomic Surveys and PSC; and

Implementation of Lessons Learned.

He then explained each of these

activities one by one. Then he moved

on to discuss the process of

disseminating findings and results

from the BRDCEP research

component. He said that at

dissemination stage high level

coordination will be ensured with all

stakeholders including GoB, EU, EU-

TA, etc.

6.4. Strategy for

Operationalisation of M&E

Framework


Mr. Shahzad stated that, initially all key personnel from each RSP for M&E activities are being

capacitated by RSPN in this five-day long training on the M&E function and framework in order to

create a common understanding among all implementation partners. Follow up reviews and

subsequent session will also be included in the M&ERG in order to continue to gain feedback from



all implementing partners

and ensure continuous

improvement and efficiency

of the M&E function of the

BRDCEP.

The M&E section of the RSPs

will also produce facilitating

mechanisms such as

development of research

methodologies, preparation

of monitoring formats and

plans; and technical

backstopping to the BRDCEP

partner RSPs in maintaining BRDCEP databases. RSPN will seek to establish institutional linkages

with research organisations and universities in Pakistan and the University of Mannheim to bring

in best practices and knowledge resources.

The M&E section of RSPs at the head office level will provide continuous backstopping and need-

based capacity building support to the M&E staff at the Programme Implementation Unit (PIU)

and district level.

6.5. Importance of Management Information System in M&E

By Mr. Sharafat Sherazi, Data Analyst, NRSP

Mr. Sherazi said that the computerised database application software is being developed and

maintained by the BRDCEP partner BRSP and NRSP.

Android applications are being developed for

monitoring and tracking of the interventions

progress. This will assist the field staff in updating

the progress regularly, he also said that all of the

RSPs shall be capable to tra ck data about coverage,

inclusion, and targeting of poor households,

particularly women. “Furthermore, this will also let

us to monitor how many households in which

poverty band is participating in multiple

interventions and evaluate the overall progress”,

told Mr. Sherazi.

He said that tagging system has been introduced in

the MIS. Entry is done once and then afterwards

just tagging will be carried out. He also shared that

a correction module has been added in NRSP’s integrated MIS for BRDCEP.



6.6. Mechanisms to Review the Progress against M&E Framework


In this session, Mr. Shahzad informed the participants that there will be six monthly review of

progress against the M&E framework. He mentioned that the CEOs, M&E Heads and Programme

Managers of BRSP, NRSP and RSPN will attend this meeting in order to improve the progress and

impact of M&E arrangements. Relevant officials will receive the meeting minutes for further

needful actions.

In addition, monthly internal reviews will be conducted by RSPs on the M&E framework and share

the key findings and action points with department heads, M&E sector heads and the CEO to

gather feedback. A similar external review will be conducted bi-annually by the RSPN Board’s

BRDCEP oversight committee. An assessment of the programme design and output indicators

(logframe), based on evidence will also be undertaken.

6.7. Discussions on M&E Reporting

(PMRs, Field Monitoring Reports, and Monitoring Action Plans)

By Mr. Asmat Kakar, M&E Officer BRDCEP, RSPN

Mr. Kakar said that PMR will be send on every 5th of the month. He explained the PMR reporting

template line by line. Likewise, he did for Field Monitoring Reports and Monitoring Action Plan. It

was also explained that how the reports of monitoring visits can be written effectively and

precisely.

The participants reviewed the formats and clarified the confusions they had. They all agreed that

such reports are really useful for effectiveness of M&E procedures and framework as well as for

overall programme.

6.8. Session on EU Reporting Guidelines

By Mr. Muhammad Ibrahim Alvi, Manager PMER, BRSP

Mr. Alvi shared that according to EU reporting requirements, all the implementing partners have

to ensure EU reporting requirements and guidelines in all periodic progress reports (narrative,

financial) of the BRDCEP. He said that reporting will be done as per the deliverables identified and

mentioned in the respective ‘Grant Agreement’.



In addition, a periodic progress report due within 60 days from the end of each reporting period

(including the last reporting period) will have to be submitted to EU country office. Other than

this, a final report has to be submitted, within 60 days after the end of the project. Mr. Ibrahim

Alvi also explained the basic requirements of these reports in this session.

7. Proceedings of Day Five

December 01, 2017

Mr. Khurram welcomed and thanked all the participants for their active participation in previous

four days of the training. He briefly provide major highlights of training sessions held and also

shared the final day’s agenda.

7.1. Discussions on Major Challenges in Monitoring & Evaluation in Balochistan

Context

By Mr. Ibrahim Alvi, Manager PMER, BRSP

The session was pretty much interactive. Mr. Alvi shared that key challenges are access to the far

flung areas along-with major security

risks. Also, the availability of internet

connectivity is a big challenge in some

programme targeted areas. The M&E

officers of va rious districts, then

discussed the issues that they are

facing with regards to PSC and also

those issues that they anticipate with

respect to future activities under

BRDCEP. Migration is high in Loralai

due to water scarcity issues. Also,

access to distant households is an



issue and to minimize this the enumerators stay at least for a week in the UC. Washuk is highly

deserted area and the key issue is also of access. In several cases, there is 10 KMs distance

between two households. Some of the households are located at Iran border and that is also a

huge security risk. As far as Khuzdar is concerned, in two tehsils there are security issues.

In case of Jhal Magsi, the internal migration to Sindh areas is high. The reasons attributable to this

are tribal conflicts, drought, etc. In Zhob, there were some issues in some areas where the BRSP

commissioned the PSC; however, now it is rectified as data was recollected in these problematic

areas as a corrective measure. The issues in Kech district includes:

Internal and external migration;

Drought;

Militancy;

Internet connectivity; and

7.2. Role of EU-TA on Gender Analysis and CDD Policy Formulation


Mr. Shahzad explained the role of EU-TA on Gender Analysis and CDD Policy Formulation. Its

objective is to undertake a comprehensive gender analysis of Balochistan for the BRDCEP and

produce a gender mainstreaming strategy for a gender sensitive implementation approach as well

as recommendations for targeted programming for the entire programme in general, and

particularly for the community empowerment through social mobilisation component. He then

told about the methodology, outputs and deliverables of this exercise. Further to this, Mr.

Shahzad explained the following results mandated to the EU-TA to be achived in programme

timelines:

A dedicated local community development policy framework formulated and implemented;

Improved capacities of the GoB local authorities;

A PFM reform strategy and action plan are developed and implemented; and

Capacities of Balochistan Rural Development Academy (BRDA) developed on CDD and local

governance.

7.3. Quality Assurance and Quality Control Mechanisms


Mr. Shahzad explained that the Quality Assurance (QA) and Quality Control (QC) are two

independent and correlated terms. QA denotes the process used to generate the deliverables,

and can be undertaken by a manager, client, and also a third-party reviewer. Some examples of

QA are process checklists, project audits, etc. On the other hand, QC signifies to quality associated

activities linked with the establishment of project/programme outputs and deliverables. It is used

to substantiate that deliverables are of satisfactory quality, complete and accurate. The instances

of QC activities are inspection, testing process, etc.

He informed that on the basis of BRDCEP-PIM, RSPN will develop a quality assurance and control

plan (QACP) and tools to be implemented by BRSP and NRSP. It will ascertain the requirements



and standards for the programme implementation and deliverables. It is aimed at not just to

ensure that programme activities are completed, but done so in a timely and efficient manner.

As part of the QACP, the tools will include certain checklists and needful guidelines will be

developed by RSPN and then capacitate the RSPs and GoB representatives for effective on-ground

implementation, accordingly.

7.4. Management of Risk Register for BRDCEP

By Mr. Khurram Shahzad, RSPN

Mr. Shahzad delivered an interactive session on the management of risk register for the BRDCEP.

He stressed that the risk register is indispensable tool for effective risk management and

mitigation purposes. As risks are well recognised at the programme designing phase, they should

be recorded in the register and accordingly the needful agreed action should be taken. The risk

register is a living document; therefore, it is imperative to record the date on which the risks are

identified and mitigated.

He further explained comprehensively the risk management plan formulated under BRDCEP. He

shared that it is formed upon the assumptions and necessary conditions essential for the

continuity. The risk register

will be managed by the RSPs-

BRSP and NRSP Programme

Managers of BRDCEP. The

status against risk

management plan and risk

register will be updated and

reviewed bi-annually.

7.5. Overview of the

Training Sessions and

Way-Forward By Mr. Khurram Shahzad,

Specialist M&E, RSPN

Mr. Shahzad expressed his gratitude over the successful completion of the training. He thanked

all the participants for their active participation. He said that the basic aim of the training was “to

transfer the knowledge of tools” and learn “how to solve problem through which tool”. He further

shared the BRDCEP sequencing is based on efforts; achievements; outputs; lessons learnt and

research. Referring to the BRDCEP M&E framework, he mentioned that all the basic concepts and

techniques are comprehensively defined along-with usage of MIS/GIS are also incorporated in it.

Then talking about the monitoring under BRDCEP, Mr. Shahzad said that monitoring will be done

at multiple levels that includes process, output, outcome and impact levels. He once again

highlighted that the aim of evaluation under BRDCEP will be learning for improvement and

accountability of those results that are committed to the donor, GoB and other key stakeholders.



Moreover, Mr. Shahzad said that EU believes in contribution instead of going for attribution.

Research is one of the core component of this programme. It will result in the evidence based

policy formulation. He also said that having integrated MIS and GIS systems will help in

standardisation in programme implementation. Also, he said that by using android powered

tablet-computers for data collection minimises the risk of inconsistent, wrong, incomplete, etc.

entries.

He also restated the poverty targeting strategies currently operational and their relevance to the

BRDCEP. Likewise, he talked about the significance of use of policy cut-offs in such strategies. He

then emphasised on the significance of mainstreaming gender and social accountability

particularly in BRDCEP. He then recapped the role of EU-TA particularly with reference to the

gender analysis and CDD policy formulation. In the same way, he recapitulated the proceedings

of all the training days.

8. Closing Remarks by GoB Representatives

8.1. Mr. Asfandyar Kakar, Secretary

P&D, GoB

Mr. Asfandyar Kakar said that the M&E is the

base of any programme. “It is the nervous

system of any programme; it should have clear-

cut linkages with outputs and results”,

underscored Mr. Asfandyar Kakar. He also

believed that the more is contributed in M&E,

the more improvement will be seen in results.

He also stated that it is imperative to have an integrated MIS and executive dashboard. He said

that MIS must have connection with the M&E too. The MIS and dashboard should have open

access for all including the government officials. He wished all the best to the BRDCEP Team and

training participants.

8.2. Mr. Agha Syed Liaqat Ali,

MPA & Member of

Parliamentary Committee-P&D,

GoB

Mr. Agha Syed Liaqat Ali articulated his

appreciativeness of the training. He

also shared his past experience and

lessons learned from the

implementation of various rural

development initiatives.

He further said that Balochistan is far

away in ter ms of development as since



long it is undergoing multiple challenges including migration and security issues. “We need to

enhance the pace of process of development here and for this we all have to work together. We

need to catch up with the fast developing world”, said Mr. Agha Syed Liaqat Ali. He was hopeful

that BRDCEP will contribute to it to a large extent in terms of development in Balochistan

province.

He congratulated upon successful completion of training. He also said that M&E is the core

component for any project and for its sustainability and effectiveness, there is a need to have

strong M&E procedures in effect.

9. Certificate Distribution and Conclusion

At the end, the participants were awarded certificates. These were given by Mr. Asfandyar Kakar

and Mr. Agha Syed Liaqat Ali.

The training provided an opportunity for the participants to become familiar with the approaches

of BRDCEP M&E framework and socio-economic baseline surveys. It also enabled the participants

to learn from and share experiences and also increased the knowledge as well as understanding

of BRDCEP overall.

10. Participants Feedback and Evaluation of Training

At the conclusion of specific modules in the training workshop, feedback forms were distributed

to participants to gather their reviews on the objectives, content, design, facilitation and concepts

covered in the training that were communicated to the participants.

10.1. Training Objectives, Contents, Design and Facilitators

Responses were gathered from all training participants of the BRSP and NRSP staff (16 in total),

where the average responses ranged between a score of 3.63-4.88 (on a scale of 1 to 5; 1 lowest,

5 highest), showing that the response was largely positive. The summary of the feedback collected

is recorded in Table 1.

Table 1: Summary of Feedback on Training Objectives, Content, Design and Facilitators



Description Mean Min Max

a. Training Objectives

1. Prior to the training workshop, I was well informed about the objectives. 3.63 2.00 5.00

2. At the beginning of the training workshop, the objectives were clearly described.

4.38 3.00 5.00

3. The training objectives were achieved during the training workshop. 4.38 3.00 5.00

b. Training Contents

1. The content of the training workshop was relevant to my work. 4.38 3.00 5.00

2. The training was an important opportunity for the exchange of experience, information and networking with colleagues from other different organisations.

4.63 4.00 5.00

3. What I take from this training workshop will have a positive impact on my work in the future.

4.88 4.00 5.00

c. Training Design

1. The training workshop structure was logical. 3.69 2.00 5.00

2. The activities in this training workshop gave me sufficient practice and feedback.

3.81 2.00 5.00

3. The pace of the training workshop was appropriate. 4.06 2.00 5.00

4. The duration of the training workshop was appropriate. 4.25 2.00 5.00

5. The physical setting of the training workshop (i.e. temperature, lighting, etc. of the room) was comfortable.

4.88 4.00 5.00

6. The logistical support (training hall, food, and travel arrangements/transport) was appropriate.

4.69 4.00 5.00

7. The materials/resources distributed were useful and relevant. 4.31 3.00 5.00

d. Training Facilitation

Ahmed Ullah, Programme Manager BRDCEP – RSPN 3.58 1.00 5.00

1. The facilitators were well-versed in the contents of the training. 3.63 2.00 5.00

2. The facilitators were effective in delivering the training. 3.63 2.00 5.00

3. The facilitators encouraged everyone to participate. 3.50 1.00 5.00

Muhammad Tahir Waqar, Senior Programme Manager MER - NRSP 4.40 3.00 5.00




Muhammad Ibrahim Alvi, Manager PMER – BRSP 3.85 1.00 5.00




Khurram Shahzad, Specialist M&E – RSPN 4.60 3.00 5.00




Asmat Kakar, M&E Officer BRDCEP – RSPN 3.75 1.00 5.00






10.2. Training Concepts/Modules

As summarised in Table 2: 45% of the participants indicated that they could implement the modules independently; While a collective 36% indicated that they either understand the concepts imparted in the

training or could implement the modules with some assistance. No single participant indicated that s/he was confused about any concept or module listed in

bellow table. Table 2: Summary of Feedback on Training Concepts/Modules

Concepts/Modules

Confusing Can

understand

Can implement with some assistance

Can implement

independently

Not Applicable

Intervention Logic & Gender Analysis 0 6 6 4 0

Programme Logframe 0 2 5 8 1

M&E Framework 0 3 1 11 1

Monitoring Functions and Plans 0 1 2 12 1

Evaluation Functions and Plans 0 0 9 7 0

Gender & Social Accountability Mechanisms 0 4 8 3 1

Poverty Targeting Strategies 0 2 5 7 2

Socio-economic Surveys Approaches 0 0 10 6 0

Total 0 18 46 58 6

10.3. Participation in Subsequent Trainings

The participants were asked whether they would like to participate in future trainings, everyone provided a positive response, all 16 participants stated that they would participate in subsequent trainings. Additionally, all participants responded that they would recommend similar training workshops to their colleagues. Additional Feedback

a. Appreciation:

Great learning experience and developed better understanding about M&E related activities.

I found the training very effective and informative. It added a lot regarding to my knowledge

about monitoring and evaluation. Thanks for your assistance.

It was a good training and had a positive impact on all the participants, and hope such

trainings will be continued in future as well.

The training was very informative and fruitful in our working environment- very friendly

conducted and facilitated by professionals.

The training was very fruitful in order to know about M&E Framework, mechanism, strategies

of European Union, and also guidelines provided by EU for monitoring the programme

activities.

Such trainings are very much recommended in future.



Overall the training was productive and very informative for all the participants. Components

were related to specific program and sector. Logistics were well planned.

b. Areas for consideration and other recommendations:

As we are working in Balochistan and often attend meetings at HQ (head quarter at Quetta),

we think if the said trainings should be organised in Sindh, Punjab, Islamabad, etc.

Need to incorporate group work exercises.

Relevant experience should be shared.

In future such trainings are very much recommended.

Such trainings would be conducted in future for more clarity and measuring impact of

program, effectively.

The training should have been more participatory. Further, too many sessions really made it

challenging to understand the whole concept.

11. Key Decisions and Follow-up Action Points

The following are the key decisions and follow-up action points resulted in the light of discussions

held during training sessions on M&E:

RSPN will update and revise the map of Balochistan being used in existing knowledge products

and visibility items where boundary of one identified district is not accurate.

RSPN will review the ER3 and ER4 being used in the programme’s logframe and associated

monitoring matrices and align with the approved logframe.

RSPN will make attempt to also align the BRDCEP result indicators with MPI along with the

SDGs.

It was proposed that a section on youth development may be included in the PIM in light of

discussions made in GYDI session by Mr. Rafiullah Kakar.

It was also suggested by the training participants to provide more orientation on the Social

Accountability tools in future.

BRSP will share a brief write-up on outcome tracking mechanisms used in BCDP along-with

reporting templates with RSPN and NRSP.

RSPN will take lead to discuss further on the thematic sectoral studies with all the

stakeholders planned under BRDCEP’s research component.

It was an agreement between BRSP and NRSP to have a common integrated executive

dashboard so that all data can be available in one click at one place in a real-time.

All participants were requested to share if there is any further feedback they have on M&E

framework with RSPN at the earliest. So that RSPN will share the revised M&E framework

document after incorporating the partners’ feedback for further use.

BRSP and NRSP BRDCEP M&E Managers need to share their respective M&E frameworks

containing related target details/figures that fully align with their programme documents with

BRSP and NRSP HO/HQ MER Programme Managers and RSPN at the earliest.

===============================================



Annex-I: Training Agenda and Schedule

Timeline Activity Lead

Day 1: Monday, November 27, 2017

09:30 AM Recitation from the Holy Quran One of the participants

09:35 AM Round of Introduction All Participants

09:50 AM Welcome Remarks Mr. Nadir Gul, CEO-BRSP

10:00 AM Session on Intervention Logic of the overall BRDCEP Khurram Shahzad, RSPN

10:30 AM An overview of BRDCEP Logframe Muhammad Waqar, NRSP

11:15 AM Tea/Coffee Break RSPN Administration

11:45 PM Strategic Importance of M&E Framework Ahmed Ullah, RSPN

12:00 PM Process of Development of M&E Framework Khurram Shahzad, RSPN

12:15 PM Session on Types, Purpose, Scope and Monitoring Functions

Asmat Kakar, RSPN

01:00 PM Lunch & Prayer Break RSPN Administration

02:00 PM Key Elements of Monitoring Function in BRDCEP [Key Performance Indicators & Programme Monitoring Plan]

Khurram Shahzad, RSPN

03:00 PM Overview & Discussion on Detailed Results Matrix Asmat Kakar, RSPN

04:30 PM Wrap-up of Day-One

Day 2: Tuesday, November 28, 2017

09:30 AM Recap of Day-one Khurram Shahzad, RSPN

10:00 AM Session on BRDCEP’s Programme Monitoring Matrix Asmat Kakar, RSPN

11:30 AM Tea Break RSPN Administration

12:00 AM M&E Team Structure - Role and Responsibilities Muhammad Waqar, NRSP

12:30 PM Monitoring of Programme by the EU Ibrahim Alvi, BRSP

12:45 PM Mainstreaming Gender and Social Accountability Mechanisms in the M&E Framework

Ahmed Ullah, RSPN

01:00 PM Session on RSPN Assistance in Developing a Joint and Integrated MIS/GIS for BRDCEP


01:30 PM Lunch and Prayer Break RSPN Administration

02:30 AM Session on describing the Types, Purpose, Scope and Criteria for Evaluation under BRDCEP


02:45 PM Evaluation of Overall BRDCEP by the EU Muhammad Waqar, NRSP

03:00 PM Session on EU’s Evaluation Strategy and Approach Khurram Shahzad, RSPN

04:00 PM Wrap-up of Day-Two Asmat Kakar, RSPN

Day 3: Wednesday, November 29, 2017

09:30 AM Recap on Sessions of Day-One and Day-Two Asmat Kakar, RSPN

10:00 AM Importance of Poverty Targeting in CDD Programmes Muhammad Waqar, NRSP

10:30 AM Overview of the Poverty Scorecard Census Progress by BRSP and NRSP

Ibrahim Alvi, BRSP and Ghulam Rasool, NRSP


11:15 AM Pre and Post Programme Poverty Scorecard Surveys Muhammad Waqar, RSPN



Timeline Activity Lead

12:00 PM Global Youth Development Index Rafiullah Kakar, Consultant


02:30 PM Approaches & Methodologies of Socio-economic Baseline Surveys (Baseline, Midline & End-line)


4:30 PM Wrap up of Day-Two Asmat Kakar, RSPN

Day 4: Thursday, November, 30, 2017

09:30 AM Recap of Sessions of Previous Three-Days Asmat Kakar, RSPN

10:00 AM Session on Approaches & Methodologies for Institutional Maturity Index Surveys


10:30 AM An Introduction to the BRDCEP Research Component Ahmed Ullah, RSPN

11:00 AM Research Framework for BRDCEP & Action Plan Ahmed Ullah, RSPN

11:30 PM Tea Break RSPN Administration

12:00 PM Strategy for Operationalisation of M&E framework through Building Capacities of RSP M&E Team


12:30 PM Importance of Management Information System in M&E

Sharafat Sherazi, NRSP

01:00 PM Mechanisms to Review the Progress against M&E framework

Asmat Kakar, RSPN


02:30 PM Discussions on Reporting-PMR, Field Monitoring Reports, Monitoring Action Plan

Asmat Kakar, RSPN

03:30 PM Session on EU Reporting Guidelines Asmat Kakar, RSPN

04:00 PM Wrap up of Day-Three Khurram Shahzad, RSPN

Day 5 December 1, 2017

09:30 AM Recap of overall Training Sessions and Discussions Khurram Shahzad, RSPN

10:00 AM Discussions on Challenges in Monitoring and Evaluation

Ibrahim Alvi, BRSP

10:30 AM Role of EU-TA on Gender Analysis and CDD Policy Formulation



11:15 AM Quality Assurance and Quality Control Khurram Shahzad, RSPN

12:15 PM Risk Register Khurram Shahzad, RSPN

12:30 PM Overview of the Training Sessions and Way-Forward Khurram Shahzad, RSPN

12:45 PM Closing Remarks Secretary P&D, GoB

01:00 PM Feedback on the Training MPA and Member of Parliamentary Committee P&D GoB

01:15 PM Certificate Distribution GoB Representatives

01:00 PM Lunch and Prayer, and End of Training Workshop RSPN Administration



Annex-II: List of Training Participants

Sr. Participant’s Name Designation Org. Location Cell Phone Email

1 Jahanzeb Baloch Assistant Director BPPRA Quetta 0333-3382409

2 Abdul Rasheed District M&E Officer BRSP Zhob 0310-8000405 [email protected]

3 Amin Khilji SPO M&E (South) BRSP HO Quetta 0332-7881596 [email protected]

4 Dr. Shahnawaz Sr. Manager/TL BRDCEP BRSP Quetta 0300-9381938

5 Ghulam Jillani District M&E Officer BRSP Khuzdar 0333-7901083 [email protected]

6 Hussain Shah District M&E Officer BRSP Jhal Magsi 0347-3989899

7 Junaid Sultan District M&E Officer BRSP Pishin 0332-4352279 [email protected]

8 Kareem Jan District M&E Officer BRSP Loralai 0345-8315926 [email protected]

9 Luluwa Baloch C&V/Research Officer BRSP Quetta 0300-2888802 [email protected]

10 M. Ibrahim Alvi Manager PMER BRSP HO, Quetta 0300-0500242 [email protected]

11 Muhammad Aadil Coordinator M&E (N) BRSP HO Quetta 0333-7829289 [email protected]

12 Rahim Sasoli District M&E Officer BRSP Washuk 0333-7773399

13 Rajab Ali Coord. M&E (LH/WASH) BRSP HO, Quetta 0308-3767902 [email protected]

14 Siraj ul Haq Ghouri Sr. Manager BRSP HO, Quetta 0321-5880045 [email protected]

15 Wazir Khilji SPO M&E BRSP HO Quetta 0345-8312043 [email protected]

16 Ghulam Rasool PM BRDCEP NRSP Kech 0320-5004491 [email protected]

17 M. Tahir Waqar SPM-MER NRSP Islamabad 0300-5553988 [email protected]

18 Saeed Ahmed PO MER BRDCEP NRSP Kech 0323-8905937 [email protected]

19 Sharafat Sherazi Data Analyst BRDCEP NRSP Islamabad 0300-8522623 [email protected]

20 Mohsin Badim Trainee P&D, GoB Quetta

21 Waqar-ul-Mulk Assistant Engineer P&D, GoB Quetta 0333-7844481

22 Ahmed Ullah PM BRDCEP RSPN Islamabad 0300-8386016 [email protected]

23 Ali Akbar Qureshi Programme RSPN Islamabad 0300-5553178 [email protected]

24 Asmat Kakar M&E Officer BRDCEP RSPN Islamabad 0334-2315117 [email protected]

25 Habib Asgher PO Communications RSPN Islamabad 0333-5380166 [email protected]

26 Khurram Shahzad Specialist M&E RSPN Islamabad 0300-5201720 [email protected]

27 Mawish Iqbal D&R Officer BRDCEP RSPN Islamabad 0300-5564475 [email protected]

28 Rafiullah Kakar Consultant World Bank Quetta 0334-3818888

mailto:[email protected]





















under EU-funded Balochistan Rural Development and ...€¦ · Special thanks to all the trainers...

Documents

Transcript of under EU-funded Balochistan Rural Development and ...€¦ · Special thanks to all the trainers...