REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24...

27
- SIVAC Initiative- 20-24 April 2015 www.sivacinitiiative.org REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs) Technical Capacities Regional Training on NITAGs Capacity Building Nairobi 20-24 April, 2015

Transcript of REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24...

Page 1: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

- SIVAC Initiative- 20-24 April 2015 www.sivacinitiiative.org

REPORT:

Strengthening National Immunization Technical Advisory Groups (NITAGs)

Technical Capacities

Regional Training on NITAGs Capacity Building

Nairobi 20-24 April, 2015

Page 2: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 2

Table of content Context and rationale ......................................................................................................................... 3

Objectives of the training ................................................................................................................... 4

Format and content of the training .................................................................................................... 4

Participants’ profile ............................................................................................................................ 5

Meeting operations ............................................................................................................................. 6

Training expectations ......................................................................................................................... 6

Objective 1: To enhance participants understanding of the concepts in vaccinology

(including the principles for issuing evidence-based recommendations) and their skills to

critically assess quality of data in published papers ...................................................................... 7

Objective 2: To develop participants teaching capacity and skills to run workshops for

NITAGs using the training manual developed by the SIVAC Initiative ......................................... 10

Evaluation of the training ................................................................................................................. 11

Evaluation of objective 1 of the training ...................................................................................................... 11

Evaluation of individual sessions ............................................................................................................. 11

Knowledge of topics ................................................................................................................................ 12

Understanding the principles and methods of using evidence to develop evidence based

recommendations ................................................................................................................................... 14

Topics that require further training........................................................................................................... 14

Overall evaluation of objective 1: ............................................................................................................ 15

Evaluation of objective 2 of the training ................................................................................................... 16

Participants overall feedback on the workshop ........................................................................................... 17

Objectives achievement .......................................................................................................................... 17

Time allocated for each session .............................................................................................................. 19

Overall satisfaction .................................................................................................................................. 19

Next Steps .............................................................................................................................................. 20

Conclusion and next steps .............................................................................................................. 21

Appendix 1: Training programme .................................................................................................... 23

Appendix 2: List of participants ...................................................................................................... 27

Page 3: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 3

Context and rationale

The SIVAC Initiative implemented by AMP was established in 2008 with the main objective of supporting

national authorities in low and middle-income countries set-up and strengthen their NITAGs. In 2012, WHO

designated the Health Policy and Institutional Development Unit (HPID) of the “Agence de Médecine

Préventive” (AMP) as a WHO Collaborating Centre on evidence-informed immunization policy-making

considering its experience with National Immunization Technical Advisory Groups (NITAGs).

The SIVAC Initiative has supported the creation and/or strengthening of 14 NITAGs and organized over 20

training workshops in collaboration with partners in Africa, South-East Asia, Europe, Eastern-Mediterranean

and West Pacific WHO regions, with the aim of building NITAGs capacity to function in accordance with

WHO guidelines.

Building from this experience, the SIVAC Initiative has developed a training catalogue that describes the

project strategy and key interventions to reinforce NITAGs’ capabilities to provide decision-makers with

sound technical and evidence-based recommendations. As presented in the catalogue of trainings, SIVAC

capacity building strategy comprises regional and national training programmes with the following goals:

i. For regional trainings:

+ To develop local expertise to sustain NITAG capacity building (e.g. training local experts as

technical resources and facilitators of future regional and national NITAGs trainings) );

+ To promote a learning-by-experience approach through sharing of best practices and lessons

learned among countries with a similar context

ii. For national trainings:

+ To address specific country needs as related to NITAG scope of work or topics of

consideration.

The target groups identified in the training catalogue are:

+ National experts as potential future facilitators for NITAGs trainings

+ NITAG chairs and secretariats

+ NITAG members including core members, liaison members, and ex-officio members

To implement this strategy, the SIVAC Initiative developed a training manual that comprises three core

units and one with optional modules (“a la carte”). Each Unit has a set of materials: a facilitator guide,

facilitation methods, slide deck, and an aide-memoire with resources for the participant. The three core

units are: 1) Establishment and mode of operations of an efficient NITAG; 2) Analysis of Health Systems,

Immunisation, and policy-decision process and 3) Development of evidence –based recommendations. The

“a la carte” training includes the following modules: 1) Socio-anthropological approach to vaccination; 2)

Principles and use of economic assessments of vaccines and immunisation programmes in decision-

making; 3) the GRADE approach for systematic reviews

As the number of NITAGs is increasing, it is expected that they will require support to build and strengthen

their technical capacity. It is also anticipated that already existing NITAGs will also need to reinforce their

Page 4: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 4

capacities. It is important to ensure that support will be available when needed. AMP is proposing that a

pool of experts be trained to assist NITAGs in obtaining the necessary skills for an optimal functioning.

As capacity building is a continuous process, the availability of local technical assistance to NITAGs will

help maintain NITAGs technical skills.

It is against this background that the SIVAC Initiative organized training for NITAGs capacity building in

Nairobi (Kenya) on April 20 to 24, 2015 as a pilot of the implementation of the strategy described in the

training catalogue.

The course was jointly facilitated by the SIVAC Initiative, the Vaccines for Africa Initiative (VACFA) of the

Institute of Infectious Disease and Molecular Medicine at the University of Cape Town, South Africa and an

educational trainer from the Kenya Medical Research Institute (KEMRI, Kisumu site). The AMP training Unit

also assisted in the design and implementation of the course.

Objectives of the training

+ Objective 1: To enhance participants’ understanding of the principles for issuing evidence-based

recommendations in immunisation and their skills to critically assess quality of data in published

papers

+ Objective 2: To develop participants teaching capacity and skills to facilitate workshops for NITAGs

organized by the SIVAC Initiative

Format and content of the training

The training was a 5-day residential workshop organized in two parts according to the above objectives of

the training.

Part one of the training, which ran for two days, focussed on objective 1. Lectures, group discussions, and

practice sessions were used to deliver the following topics:

+ Introduction to vaccinology

+ Evidence-Based Medicine (EBM) and EBM’s role in vaccinology

+ Practical guide to search for scientific evidence from PubMed database

+ Developing evidence-based recommendations in immunization

In the second part of the training (day 3 to day 5) the trainers focussed on teaching skills and familiarizing

participants with the SIVAC training manual as stated in objective 2. This section was provided in the form

of lectures, group work and practice sessions. The sessions covered included:

+ Introduction to the NITAG training manual with a focus on training 1 and 3

+ Specificities of adult learning

+ Participatory approach for optimal learning

+ Familiarization with the NITAGs training manual

+ Practice: Delivering a training session

Page 5: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 5

The training programme is provided in appendix 1.

Participants’ profile

The training targeted public health experts who:

+ Are familiar with NITAGs operations or with immunization decision-making and programme

management

+ Have a working relationship with their respective countries’ Ministry of Health or

+ Hold relevant positions in partner institutions providing technical support to national authorities

Participants were from the WHO country office in Côte d’Ivoire (representing the inter-country support team

for West Africa, IST), from India, Kenya, Mozambique, and Nigeria. Two consultants from the SIVAC

Initiative attended the workshop. EPI focal persons at WHO Regional offices in AFRO and SEARO as well

at WHO IST for East and Southern Africa and West Africa were also invited although did not attend (they

sent their apologies for not attending).

Participants are listed in appendix 2.

Page 6: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 6

Meeting operations

At the start of the training, facilitators and participants agreed that country specific issues discussed be

treated as confidential.

Training expectations

The training expectations of participants at the start of the training are provided below:

No. of participants Expectation

********* Learn how to critically appraise evidence and make sense of results for decision making

********* Deepen understanding of research for evidence in vaccination

******* Understand the steps for transparent grounds of a recommendation on immunization

****** Be familiar with the core topics proposal by the SIVAC-Initiative for strengthening NITAG capacities

***** Practice searching techniques for finding evidence on vaccination

** Practice teaching of the core topics and receive constructive feedback from peers and the training team

* Share experiences/barriers to introduction of evidence based recommendations e.g. availability of good quality evidence

* Share challenges experienced in other countries with NITAG and how these challenges are being handled

Page 7: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 7

Objective 1: To enhance participants understanding of the concepts in vaccinology (including the principles for issuing evidence-based recommendations) and their skills to critically assess quality of data in published papers

There were two topics covered under this objective:

i. Vaccinology and Evidence-Based Medicine

The presentation on ‘introduction to vaccinology’ aimed at making participants understand the common

terms used in vaccinology (epidemiology, vaccination & immunization, research)

The presentations on ‘Evidence Based Medicine (EBM)” and on “ the role of EBM in vaccinology’ and

EBM utilization in vaccinology covered the following: what is EBM; History of EBM; Examples of EBM

utilization in vaccinology, the steps and process of conducting research for evidence-based

recommendation on immunization.

Participant discussions: Participants discussed the challenges of developing local evidence

based recommendations when local evidence was unavailable. Discussion on this issue highlighted

an important role that NITAG members can play to further the development of local evidence. For

example, by identifying areas with little or no evidence and advising the relevant government

department on ways to get the local evidence. Discussions on this issue also acknowledged

situations where no local evidence exists; regional evidence could be considered with caution. In

most LMICs, contextual challenges that may confound the evidence are very similar.

ii. Developing evidence-based recommendation in immunization

The lecture on ‘NITAGs process to issue evidence based recommendations’ provided an overview of

the process followed by NITAGs in issuing evidence based recommendations including tools and methods

for searching and critically appraising the evidence

Participant discussions: The important take-home message from the discussions was that

operations and recommendations developed by NITAG should follow its operational manual. It is

important that policy makers recognize NITAG as an advisory body that provides high quality advice

to the national authorities and decision-makers, thus the importance for NITAGs to follow a

structured and transparent method for issuing their recommendations. The process for constituting

NITAGs should be well integrated in the decision making process so that NITAG formation and

operations are not easily disrupted.

The session on ‘the KENITAG experience’ aimed at illustrating how the Kenya NITAG was formed and the

methodology used in developing a recommendation on the influenza vaccine.

Page 8: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 8

Participant discussions: NITAG establishment – it was clarified that the approval of a NITAG

rests with the relevant Ministry within each national government.

Participants requested information on what support is available from the SIVAC Initiative. The

SIVAC Initiative provides technical and financial support for the establishment and initial operations

of a NITAG, however national governments are then expected to gradually take up the financial

responsibilities of the NITAG. The Kenya NITAG was presented and discussed as an example

where the SIVAC Initiative provided financial and technical support for establishment of a NITAGn

the start-up period.

Discussions arose about the best way to establish a NITAG. It was agreed that establishment of the

committee in a sustainable manner was best done on basis of a formal legislative or administrative

order (e.g. a Ministerial decree) . Nigeria is currently pursuing an administrative/executive route for

establishment of its NITAG given that legislative action would take too long. The Kenya NITAG was

formed following incorporation of the need for a NITAG in the 2013 national immunization policy.

The Minister of Health appointed members of the Kenyan NITAG.

It was shared that housing the secretariat within the national immunization programme is beneficial

in that it provides a sustainable source of secretariat support, and that the decisions taken by

NITAG are likely to be disseminated and/or accepted by the national immunization programme.

However, for members of the national immunization programme to fulfil satisfactorily their roles in

the NITAG secretariat they would need a certain amount of time dedicated to their added duties.

Additional experiences from the country-level followed: Mozambique shared that the composition of

the NITAG secretariat is derived from people working at the national programme for vaccines.

Including policy makers into the NITAG working processes would helped speed up formation of

policy that is signed off by the Minister of Health. India’s NITAG has been in existence since 2000

but new developments in 2013 have allowed it to have a more active role in immunization than

before. The speaker pointed out the importance of having a political mandate at national level for

country ownership and commitment of the NITAG.

NITAG membership and member replacement: Participants discussed different methods of

identifying core members of the NITAG. Aside from nomination of members by the head of the

national immunization programme to the Minister, they discussed the possibility of recruitment of

nationals through advertising Although some expressed concern that this method may result in an

overwhelming number of applications. The approach on how to identify members should be a

country specific decision rather than a standard approach to each country given the unique social,

legal, governance, and political environments encountered in each country.

Some participants expressed concerns about potential political influences during appointment of

members. It was noted that depending on each country’s context, political appointments might be a

trade-off that the NITAG has to make in order to get political support in its operations. Participants

from Nigeria stated that appointment of members given the federal system of government with many

competent people across several regions eligible for appointment would be difficult. The experience

of appointment of members in other countries was shared. In Kenya, the Head of the Unit of

Vaccines and Immunization Services (UVIS) made a list that was shared with the Cabinet Secretary

Page 9: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 9

for Health for input and final approval. The list of members presented to the Ministry of Health in

Benin was not approved and a new list had to be generated. Ghana plans to advertise NITAG

positions, thereafter a panel will review and decide on the final list of members.

In Nigeria, membership of NITAG may have to be higher beyond the recommended 10-15 given the

size of the country.

Replacement of members was discussed:. In the Mozambique NITAG, where a member comes

from a particular organization, if the member needs to be replaced, the organization from which the

member comes from is asked to nominate a replacement. However, it is made clear to the nominee

and the institution that he/she will not represent his/her institution interest but is a member of NITAG

in his/her own right.

NITAG operations: Participants discussed other challenges around the formation of NITAGs,

compared the roles and functions of Inter-agency Coordinating Committee (ICC) and NITAG,

membership and decision-making, and resources to support the start of the NITAG functions.

Participants were encouraged to share their histories of the challenges of getting the NITAGs up

and running in their countries. To address the challenges of core members not having sufficient time

to perform comprehensive literature searches, the Mozambique NITAG in its last meeting agreed to

make use of postgraduate students in public health to support literature searches and compile

background documents in support of NITAG meeting deliberations

Conflict of interest: Different types of conflict of interest were discussed. Concerns were raised that

NITAG core members as experts in the field are likely to have conducted pharma-sponsored

research in the immunization field and therefore potential areas of conflict or influence may arise. In

managing these different types of conflict, it was explained that the NITAG procedural manual

should have clear guidance on how to manage different types of conflict, as they require different

actions.

The topic on ‘conducting a literature search’ provided an overview of the process for conducting and

recording a literature search. Practical demonstration of framing a PICO approach question, developing a

search query as well as searching for evidence in PubMed database was provided to the participants.

The topic on ‘evidence critical appraisal’ introduced the tools for critically appraising evidence with

particular focus on the CASP tools. During the group work session that followed, participants were divided

into two groups and developed a recommendation framework for a particular vaccine issue, prioritised the

data needed for the recommendation framework, practiced conducting and recording a search, retrieved an

article and used the CASP tools to assess the quality of the article retrieved. The findings of each group

were presented back in plenary.

Page 10: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 10

Objective 2: To develop participants teaching capacity and skills to run workshops for NITAGs using the training manual developed by the SIVAC Initiative

Part 2 of the training was devoted to objective 2 and was covered from day 3 to 5. It included:

i. The presentation of the NITAG training manual

During the session on ‘introduction to the NITAG training manual’ participants were provided with an

overview of the manual’s content and structure. Thereafter they were divided into two groups and were

taken through 2 teaching units of the manual:

+ Training 1 on “Establishment and mode of operations of an efficient NITAG”

+ Training 3 on “Development on an evidence-based recommendation on immunisation”

Participant suggestions to improve the training manuals: Participants’ suggestions to improve the

content of the manual are listed below:

+ Organisation of the manual

o Combine the modules in to one document - the presentation of the manual in numerous

different folders was confusing

o For each training provide a draft time-table

+ Emphasis on the operationalisation of the NITAG:

o More information on the functioning of working groups should be provided

o Mention the need to make use of the country annual work plan and the country multiyear

plan in developing the NITAG work plan

o Include a template for a WG report

ii. The presentation of the NITAG Resource Centre (NRC)

The presentation covered the NRC structure, how it could be used by NITAGs in their functioning and

interactions with other groups.

Participant discussions: Participants suggested that a tool/guidance be provided on how to navigate

through the website. This could take the form of a video, an interactive interface, or some answers /

questions in the existing FAQ (Frequently Asked Questions) section.

iii. Presentation of teaching methods

At the introduction of the training a number of participants did not consider training methods as important or

relevant to them. By the end of the training session they were more eager to utilize what they had learned.

Page 11: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 11

Different teaching methods were presented to participants using interactive approaches. These were: “how

to make a presentation instructive”; “anti-presentation role play” and “the carousel exercise”

iv. Practices sessions on the training manual

Each participant was assigned a section of the NITAG training manual. They were allocated a time to

prepare their presentation. Some followed the materials proposed by SIVAC but a number of them modified

their slides to fit the presentation, incorporating some of teaching technics (carrousel, brainstorming, etc.)

Each participant had 30mns for their presentation. Feedback sessions allowed for constructive comments.

Participants embraced the activity.

Evaluation of the training

Participants’ feedback was obtained at two stages: First by getting participants’ feedback on the individual

topics of each of the training’s objectives and secondly by collecting overall feedback on the training

In addition the report of the educational designer attached to this report elaborates specifically on the

instructional part of the training in terms of:

+ Participants satisfaction and knowledge increase

+ Suggestions for improving the training and the material used

Evaluation of objective 1 of the training

Evaluation of individual sessions

Question: After your participation in part one of the workshop, tell us how you rate the following sessions.

Answer: The results are provided in the figures below:

Page 12: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 12

0

2

4

6

8

10

Poor Good Very good Excellent

No

. o

f r

esp

on

de

nts

Score assigned

Intro to vaccinology

n=11

0

2

4

6

8

10

Poor Good Very good ExcellentN

o. o

f r

esp

on

de

nts

Score assigned

History of EBM & EBM

in vaccinology

n=11

Knowledge of topics

Question: After your participation in part one of the workshop, tell us how you rate yourself on knowledge

of the following topics.

Answers: The responses are provided below:

Page 13: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 13

0

2

7

2

0

2

4

6

8

10

Same as before

Slightly improved

Improved Dramatically improved

No

. o

f r

esp

on

de

nts

Score assigned

Principles of EBM

n=11

01

7

3

0

2

4

6

8

10

Same as before

Slightly improved

Improved Dramatically improvedN

o. o

f r

esp

on

de

nts

Score assigned

Steps in dvpt of EBM

recommendations

n=11

0

2

45

0

2

4

6

8

10

Same as before

Slightly improved

Improved Dramatically improved

No

. o

f r

esp

on

de

nts

Score assigned

Search for evidence

n=11

0

45

2

0

2

4

6

8

10

Same as before

Slightly improved

Improved Dramatically improvedN

o. o

f r

esp

on

de

nts

Score assigned

Appraising published

literature

n=11

Page 14: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 14

Understanding the principles and methods of using evidence to develop evidence based

recommendations

Question: Tell us how well you think you have understood the principles and methods of “from evidence to

evidence based recommendation”. Please give further answers/details on this question if relevant.

Answers

Topics that require further training

Question: Is there any aspect of the process of recommendation making on which you would need further

training? If so, which one?

Answers: These were the responses listed:

+ Appraising quality of published literature

+ Structuring the recommendation note & technical reports

+ Grading of recommendations (weak to strong)

+ Drafting an EB recommendation

+ Conducting a literature search

Page 15: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 15

Participants commented that additional information is required on:

+ How to make recommendations when insufficient good quality evidence is available

+ How to take different aspects into perspective/consideration to make the EBR

+ The process of synthesizing evidence

+ How to manage conflicting literature

+ Managing practical difficulties on the ground

It was stated that regular practice would be able to bring more clarity.

Overall evaluation of objective 1:

Question: After your participation in this part of the workshop, tell us how you rate the topics chosen for the

workshop and the structure of the workshop.

Answers

Question: Would you have any suggestions on how the training could be improved in regards to

objective 1 of the programme?

Answers: Participants provided suggestions to improve the workshop:

+ The group work on selecting elements and specific data within a recommendation framework,

developing a research question, conducting a search and appraising the quality of a paper was

better done as one group work session rather than split over two days.

Page 16: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 16

+ There is need to train NITAGs on legal issues and use of students in EBM & EBR

+ A better structure for the manuals (e.g. divide for new & existing NITGAs) is required.

+ Manuals should have been circulated before workshop for pre-reading.

Question: After your participation in objective 1 of the workshop, do you have any general comment?

Answers: General comments on the workshop are provided below:

+ Good group work & hands on literature search

+ Very admirable facilitators

+ Other countries used as case studies

+ Timing of the training was good

+ Useful workshop to help NITAGs

Evaluation of objective 2 of the training

Establishment and mode of operations of an efficient NITAG

Question: How well have you understood the principles presented in training 1 “establishment and mode of

operations of an efficient NITAG”?

Answers: The responses are provided below:

Page 17: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 17

Question: Is there any aspect about NITAG establishment and mode of operations on which you would

have needed further information or training? If so, which one?

Answers: Their responses are provided below:

+ Confidentiality agreements

+ Agenda setting

+ Terms of reference for working groups

+ Template for technical reports by working groups

+ Decree/legal backing to establish NITAGs

+ Functions and support provided by the NITAG secretariat

Question: Tell us how you rate the methodology used to present the training manual.

Answers: The responses are provided below:

Participants overall feedback on the workshop

Seven questionnaires were collected (out of 9 participants, one of whom has already left at the time of

evaluation).

Objectives achievement

Question: Participants were asked to rank their achievement of each objective of the workshop on a 0-5

scale (0: not achieved - 5: totally achieved)

Page 18: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 18

+ Objective 1: To enhance participants understanding of principles for issuing evidence-based

recommendations and their skills to critically assess quality of data in published papers

+ Objective 2: To develop participants teaching capacity and skills to run workshops for NITAGs using

training manual developed by the SIVAC Initiative

Answers: Participants responded that both objectives were equally well achieved (though a slightly higher

level of achievement for Objective 1).

Achievement of Objectives

Number of respondents assigning each score (n=5)

Score 0 0,5 1 1,5 2 2,5 3 3,5 4 4,5 5

Nb for objective 1 4 3

Nb for objective 2 1 4 2

Page 19: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 19

Time allocated for each session

Question: For each of the 22 sessions, participants were asked to indicate on scale between '–' and '+' ,

where '–' meant needs less time, '+' meant needs more time, and' =' meant time is appropriate.

The evaluation shows that the majority of participants felt that the overall duration of the training should be

increased.

All participants indicated that more time should have been allocated to the session on KENITAG

experience Sessions where the time allocated was not enough according to the evaluation results include:

Introduction to Vaccinology; Evidence-Based Medicine; NRC presentation; carrousel method, learning

styles, anti-presentation and brainstorming

Overall satisfaction

Question: Participants were asked to rate their satisfaction with the logistics of this workshop (venue,

communication prior to the meeting, rooms) on a 0-5 scale.

Page 20: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 20

Answers: Only 5 participants answered this question, and rated the logistics between 3 and 5 (see details

in the figure below).

Logistics

Number of respondents assigning each score (n=5)

Score 0 0,5 1 1,5 2 2,5 3 3,5 4 4,5 5

Nb 1 2 2

Question: Participants were asked to rate their overall satisfaction for this workshop on a 0-5 scale:

Answers: All participants rated their overall satisfaction between 4 and 5 (see details in the graph below)

Overall satisfaction

Number of respondents assigning each score (n=7)

Score 0 0,5 1 1,5 2 2,5 3 3,5 4 4,5 5

Nb 3 2 2

Question: Participants were asked to state any other element that would help improve the next workshop.

Answers: Five participants answered. Their answers are:

+ You are doing well already

+ Satisfactory

+ A brief session on the last day where country representatives can give a 5-10 minutes briefing on

how they plan to disseminate the training in their settings

+ Pre-Course Reading Material

+ Time set aside during the day to read the training material

+ More discussion and case studies from different country experiences

Next Steps

Question: Participants were asked to tell how confident they are to organize NITAGs capacity building

workshops

Answers: 6 participants answered. Their answers are:

+ Very confident (n=2)

Page 21: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 21

+ Fairly confident

+ Somewhat confident - need time to internalize and prepare / pilot the sessions with time

measurement

+ I'll be able to support more our NITAG

+ This training was very helpful to get an idea of what resources are available for the training. As a

follow on, it would be helpful to build into it an action plan to disseminate

Question: Participants were asked to indicate which kind of follow-up support they would need from the

SIVAC Initiative

Answers: Five participants answered. Their answers are:

+ Other country experience / visit

+ To support disseminate this training further and do national Training of Trainers

+ Additional trainers to support

+ Share innovation by email

+ Regular email exchange

+ Opportunity for capacity building

+ Technical support for young NITAG country

Conclusion and next steps

The pilot implementation of the training of national facilitators for NITAGs capacity building workshops was

well received by participants who have indicated that this training was timely and responded to a need at

country level.

This workshop enabled to identify components of the SIVAC materials that need to be improved to be a

useful resource for NITAGs in their operations. From the discussion and participants’ feedback, it was

observed that after a NITAG training or orientation, there would still be a need for continuous support until

members are well familiarized with the tools and methods of working for an optimal functioning of their

committees. The experts trained at this workshop might be valuable resources for countries NITAG; their

support to NITAGs could be assistance in the development of operational documents, clarification of certain

concepts, inputs in the development of evidence-based recommendation, organization of “refresher”

sessions.

To help participants get the skills to provide this support to their NITAG, SIVAC will follow-up with them to:

+ Involve them as co-facilitators of national orientation / training workshops for NITAGs

+ Provide support to organize working sessions with secretariat or a limited number of members (2-4),

i.e. to deepen specific points: Guidance to a Working Group on the process for preparing a

recommendation; clarification on some aspects of NITAG functioning (manual of procedures…)

+ Co-facilitation with SIVAC of regional workshops

For the rollout of the training the following activities are planned:

+ Revision of the training content

Page 22: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 22

+ Finalization of remaining sections/training units of the training manual

Section on NITAG evaluation in training 1

Training 2 on Analysis of Health Systems, Immunization Context and Policy-Decision

Process

Three “A la carte” trainings

Economic assessments of vaccines and immunization programs in decision-making

Socio-anthropological approach to immunization

The GRADE approach

+ Translation in French

+ Rolling out training workshops

Page 23: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 23

Appendix 1: Training programme

Time Topic Person(s) responsible

Sunday 19 April

Check-in

Facilitators to meet between 5:00 and 7:00 pm

Monday 20 April

Introduction

8:00 8:30 Registration Admin

8:30 8:40 Welcome address Antoinette Ba-Nguz, SIVAC Coordinator Prof Were KENITAG chair

8:40 8:50 Participants Introduction Antoine Durupt Programme officer SIVAC

8:50 9:00 Presentation of the training programme

Antoinette Ba-Nguz

Objective 1: To enhance participants understanding of the concepts in vaccinology (including the principles for issuing evidence-based recommendations) and their skills to critically assess quality of data in published papers Topic 1.1: Vaccinology, Evidence-Based Medicine

9:00 9:30 Introduction to vaccinology Benjamin Kagina Post-Doctoral Fellow, University of Cape Town

9:30 10:00 Questions & Answers

10 :00 10 :30 Coffee Break

10: 30 11 :15 Evidence-Based Medicine ( EMB) and EBM’s role in vaccinology (part 1)

Benjamin Kagina

Topic 1.2: Developing Evidence-based recommendation in Immunization

11.15 11.45 NITAGs process to issue EB recommendation

Antoinette Ba-Nguz

11:45 12:45 Evidence-Based Medicine ( EMB) and EBM’s role in vaccinology (part 2)

Leila Hussein Abdullahi Research Fellow VACFA,(UCT)

12.45 13.00 Questions & Answers

13:00 14:00 Lunch

14:00 14:30 The KENITAG experience Marybeth Maritim, University of Nairobi Co-Chair KENITAG

14:30 15:45 Group work Antoinette BA-Nguz (lead)

15:45 16:15 Literature search strategies

Jeanette Dawa; Consultant KENITAG

Page 24: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 24

Time Topic Person(s) responsible

16:15 16: 45 Coffee Break

16:45 18:00 Group work Benjamin Kagina (lead) Facilitators

18:00 18 :15 Closure Benjamin Kagina

Tuesday 21 April 2015

Topic 1.2: Developing Evidence-based recommendation in Immunization (Cont’d)

09:00 09:30 Evidence Critical Appraisal Antoinette Ba –Nguz

09:30 10:30 Group work ( cont’d) Benjamin Kagina (lead)

10 :30 11 :00 Coffee Break

11:00 13:00 Group work Benjamin Kagina (lead)

13:00 14:00 Lunch

14:00 14:30 Participants feedback on the previous sessions

Antoine Durupt

Objective 2: Develop participants teaching capacity and skills to run workshops for NITAGs using training manual developed by the SIVAC Initiative

Topic 2.1: Introduction to the NITAGs training manual

14:30 14:40 Presentation of the NITAGs training manual

Antoinette Ba-Nguz

14:40 16:00 Group reading: Trainings 1 and 3

Jeanette Dawa, Antoine Durupt, Antoinette BA-NGUZ

16:00 16 :15 Questions & Answers

16:15 16:30 Closure &Tea

Wednesday 22– Friday 24 April Objective 2: Develop participants teaching capacity and skills to run workshops for NITAGs using training manual developed by the SIVAC Initiative (cont’d)

Time Topic Person(s) responsible

Wednesday 22 Topic 2.2 The NITAG Resource Centre (NRC)

08:30

09:15 Presentation of the NRC Antoine Durupt

09:15 10:00 Presentation of training & Pre-test & Business cards exercise

Emmanuel Owino Training coordinator for the Vaccine Pharmacovigilance training KEMRI – Kisumu Lucile Diemert Instructional Designer AMP

Page 25: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 25

Time Topic Person(s) responsible

Topic 2.3: Specificities of adult learning

10:00 10:30 Training and teaching Emmanuel Owino Lucile Diemert

10:30 11:00 Coffee break

11:00 11:30 Fundamental principles Emmanuel Owino Lucile Diemert

11;30 12:30 Different learning styles Emmanuel Owino Lucile Diemert

12:30 13:30 Lunch

Topic 2.4: A participatory approach for optimal learning

13:30 14:00 Anti-presentation – Role play Emmanuel Owino Lucile Diemert

14:00 15:00 Educational and interactive presentations

Emmanuel Owino Lucile Diemert

15:00 15:30 Group work Lead: Emmanuel Owino & Lucile Diemert

15:30 16:00 Coffee break

Topic 2.5: The SIVAC Training programme for NITAGs

16:00 17:00 Individual work for familiarization with NITAG training manual

Participants

17:00 17:30 Feedback on day

Thursday 23

Topic 2.5 (cont’d) : The SIVAC Training Programme for NITAGs

08:30 10:30 Presentation of the training modules

Participants

10:30 11:00 Coffee break

Topic 2.6 Practice Lead: Emmanuel Owino & Lucile Diemert

11:00 12:30 Lectures preparation Participants

12:30 13:30 Lunch

13:30 14:00 Lecture: Participant 1

14:00 14:30 Lecture: Participant 2

Page 26: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 26

Time Topic Person(s) responsible

14:30 15:00 Feedback from the audience

15:00 15:30 Lecture: Participant 3

15:30 16:00 Coffee break

16:00 16:30 Lecture: Participant 4

16:30 17:00 Feedback from the audience

17:00 17:30 Feedback on day

Friday 24

Topic 2.5:Practice (Cont’d)

8:30 9:00 Lecture : participant 5

9:00 9:30 Lecture : participant 6

09:30 10:00 Feedback from the audience

10:00 10:30 Lecture: participant 7

10:30 11:00 Coffee break

11:00 11:30 Lecture: participant 8

11:30 12:00 Feedback from the audience

12:00 12:30 Feedback on the day

12:30 14:00 Lunch

14:00 14:30 Next steps Antoinette Ba-Nguz

14:30 15:00 Training evaluation Facilitators

15:00 15:30 Closure Participants receive their certificates

15:30 16:00 SIVAC- Individual Country teams side meetings on follow-on activities

SIVAC team

Page 27: REPORT: Strengthening National Immunization Technical ... · PDF file- SIVAC Initiative- 20-24 April 2015 REPORT: Strengthening National Immunization Technical Advisory Groups (NITAGs)

-SIVAC Initiative- 20-24 April 2015 sivacinitiative.org 27

Appendix 2: List of participants

Name Country Institution / Position Email address

Participants

Dr SACARLAL Jahit Mozambique CoPI / Chair [email protected]

Dr OKPOSEN Bassey Nigeria CMO/Head RI & ESS NPHCDA

[email protected]

Dr MAHMUD Mustafa Z. NPHCDA [email protected]

Dr ETSANO Andrew NPHCDA [email protected]

Dr BAGANA Murtala M. CHAI [email protected]

Dr INAMDAR Leena India Senior Advisor -Evidence to Policy Immunization Technical Support Unit Ministry of Health and Family Welfare

[email protected]

Ms OKERO Amolo Kenya SIVAC Consultant [email protected]

Dr DAWA Jeannette SIVAC Consultant [email protected]

Dr N'ZUE Kofi Côte d'Ivoire EVP Focal point - OMS Bureau in Ivory Coast [email protected]

Facilitators

Ms Leila Hussein Abdullahi South Africa Vaccines for Africa Initiative (VACFA) University of Cape Town (UCT),

[email protected]

Dr Benjamin Mugo Njeru Kagina [email protected]

Mr Antoine Durupt France Programme Officer - SIVAC/AMP [email protected]

Ms Lucile Diemert Instructional designer - Training unit / AMP [email protected]

Dr Antoinette BA-NGUZ Kenya SIVAC Senior Coordinator for Africa / AMP [email protected]

Mr Emmanuel Owino Educational trainer [email protected]

Dr Marybeth Maritim Vice-Chair KENITAG/ Senior Lecturer Department of Internal Medicine - UON

[email protected]