An instrument to evaluate whether health promotion interventions apply health

promotion principles in their work

Sara Torres, Université de MontréalNicole Beaudet, DSPM

Eric Litvak, DSPMFrançois Chiocchio, Université d’Ottawa

Julie Des Lauriers, DSPMAnne Guichard, Université Laval

Lucie Richard IRSPUM, Université de Montréal

CPHA Conference, TorontoWednesday May 28, 2014

2013-12-13 2

Objectives of presentation

• Present the evaluation research tool used to assess whether health promotion interventions apply health promotion principles in their work

• Present findings from the application of the tool in the context of a professional development program in health promotion

3

Background

• Health Promotion Laboratory (HPL)

• Implemented by the Montreal Public Health Department since 2010

• The HPL supports multi‐disciplinary local public health teams• in conceptualizing, • developing, and • implementing health promotion interventions

• HPL evaluation has been funded by CIHR-PHSI

4

ALPS Project

• The HPL provides a medium for team members to learn, reflect, and develop a health promotion intervention

• One of the evaluation components is to examine the health promotion interventions generated by the HPL

5

Two Cases Examined

Team A Team CTeam composition

Nine professionalsHealth & safety division

Eight professionals Children & families services’ division

Sector Public institution & monitors a private sector business

Public sector

Problematic Environmental risks in factories

Lack of access to childcare New immigrant families, children 0-5 years oldIsolation & poverty

Targeted Issue

Workers’ Health & safety Factors of protection for children

Intervention Counselling program Potential business owners (opening a new enterprise or re-locating to the territory)

Four small projects (daycare access, breastfeeding, social support & neighbourhood safety)

6

Intervention Evaluation Methods

• Data collection strategies • Document review, in‐depth interviews, and

focus groups with health professionals involved in the program

• Adaptation of Guichard and Ridde’s 2009 tool: “Une grille d’analyse des actions pour lutter

contre les inégalités sociales de santé” (grid to analyze actions to fight against social inequities in health)

7

Adaptation/application of tool

• Revising the language

• Discussing/research team/testing

• Validating the adaptation of the tool with one of the authors

• Developing a five element scale

• Applying the tool to two health promotion interventions

8

Stages Description of Rubrics

a) Analysis of the problematic and planning the intervention

Sources of information Social & behavioral determinants of health, sub-groupsInvolvement of partners, experts & target groups Influence of the literatureObjectives (social determinants of health, levels of action, reduction of social inequities in health, analysis of the problematic)

b) Implementation

Incentives & work methodsDefinition of tasks, responsibilities, coordinators/directorsLeadership sharingAdaptation and accessibility/target groups

c) Evaluation

Evaluation plan (planning & beyond the pilot stage)Participation of different actors in all stagesPossible negative effects/different sub-groups & long-term

d) Sustainability

Activities/planning stages & going beyond the pilot stageHuman and financial resources dedicated to the interventionOrganizational risks (staff, logistics)

e) Empowerment

Participants’ self-esteem, reinforce technical capacityCritical consciousness/partners/target groups

Evaluation Grid

9

Stages Rubrics Ranking Principles

a) Analysis of the problematic and planning the intervention

Social determinantsTarget groups Involvement of actorsInfluence of literatureObjectives

Low=

Medium =

Good &Excellent =

Non-Applicable = N/A

Equity

Holism

Participation

Intersectorality

Multiple settings & strategies

Empowerment

Intersectorality

Sustainability

(Source: Rootman et al., 2001)

b) Implementation

IncentivesTasks & responsibilitiesLeadership

c) Evaluation

PlanningBeyond pilot stageNegative effects

d) Sustainability

Beyond pilot stageHR and financial

e) Empowerment

Self-esteemCritical consciousness

Coding and Data Analysis

10

Results Team C 1 of 2Stages Rubrics Ranking Principle

a) Analysis of the problematic and planning the intervention

Social & behavioral determinants of health, sub-groupsInvolvement of partners, experts, target groups Levels of actionObjectives/ analysis of the problematic)Reduction of social inequities in health

Equity

Holism

Participation

b) Implementation

Incentives and work methods/ partnersDefinition of tasks, responsibilities, coordinators/directorsLeadership sharingAdaptation and accessibility to target groups

Participation

Intersectorality

Multiple settings & strategies

11

Results Team C 2 of 2Stage Rubrics Ranking Principle

c) Evaluation

Evaluation plan (planning, beyond the pilot stage)Participation of different actors in all stagesNegative effects/different sub-groups, long-term

N/A Participation

Equity

Intersectorality

d) Sustainability

Activities/planning stages/beyond the pilot stageHuman and financial resourcesOrganizational risks (staff, logistics)

Equity

Multiple settings &strategies

e) Empowerment

Participants’ self-esteem, technical capacityCritical consciousness/partners/target groups

Equity

Participation

12

Discussion

The tool facilitates… • The advancement of knowledge and

methods in health promotion

• The development of health promotion interventions that are multidimensional

To be more effective… • The tool should be used by evaluators

and practitioners prior to starting the health promotion intervention

13

Conclusion

This evaluation research tool gives health professionals and

organizations a medium to examine how professional

development programs and the resulting interventions can

incorporate a health promotion approach

Pour plus d’information:http://www.medsp.umontreal.ca/ALPS/

For more information: Sara Torres: sara.torres.ospina@umontreal.ca

(Postdoctoral Fellow)

Lucie Richard : lucie.richard@umontreal.ca(ALPS Principal Investigator)

Nicole Beaudet : nbeaudet@santepub-mtl.qc.ca(HPL Project Manager)