Case study

Title: To measure quality of life and social participation

Specific theme: To measure quality of life and social participation among HI and partners’ beneficiaries

Presented by: Stéphanie Legoff, Manager - Impact, Monitoring & Evaluation Unit, Technical Resources Division

Impact Assessment Seminar, 2-6 December Phnom Penh

Quality of life: definition and challenges

Quality of life has become one of the major challenges in the fields of international development and solidarity

However: There is a diversity of approaches and models The terms quality of life / well-being / social participation are often confused There is no scientific consensus about a definition of quality of life ...

... but there is general agreement that: → Quality of life is a subjective concept → Quality of life is a multi-dimensional concept

A suggestion for a broad definition:“An individual’s perception of his place in existence, within the context of the culture and value system in which he lives, and in relation to his aims, expectations, standards and fears”

Impact Assessment Seminar, 2-6 December Phnom Penh

Context

At Handicap International: References to quality of life and social participation appear with

ever-increasing frequency in the aims of HI projects and are regarded as positive indicators;

Studies (e.g.: impact study in Togo) and development of tools by our projects (e.g.: Project Tiga, Cambodia)

Impact Assessment Seminar, 2-6 December Phnom Penh

An increasing need for a reference framework and methodology

Project description

Impact Assessment Seminar, 2-6 December Phnom Penh

The Impact, Monitoring & Evaluation Unit, in collaboration with the Knowledge Management Unit (Research), has launched a project with the aim of constructing a tool:

Which allows the quality of life of adult beneficiaries to be measured Which is adapted to most projects Which is adapted to the context of an intervention Which is scientifically validated

Main stages of the study

Completing the questionnaire:

Final version

Drafting the study protocol and

methodology kit

Impact Assessment Seminar, 2-6 December Phnom Penh

Literature review and analysis of the main models and approaches to quality of life (developed externally) Collection and analysis of the studies and tools developed by our projects (15 tools and studies, 2 ongoing research projects) Interviews with HI players, and partner questionnaires on the perception of quality of life and the expectations of this tool

Pre-test of version 0 in Senegal among people with intellectual disabilities

Field test of version 1 in Senegal (60 beneficiaries interviewed) Presentation to the Steering Committee

Initial questionnaire: version 0

Amended questionnaire:

version 1

Overview of questionnaire

The questionnaire has a supplementary module for socio-demographic information

Impact Assessment Seminar, 2-6 December Phnom Penh

5 consensus-based aspects of quality of life Number of questions Reply methods

Physical and mental health (SPM) 3 5

Social and personal relations (RSP) 4 5Subjective well-being (psychol. state) (BES) 5 7

Basic needs (environment) (BB) 5 5

Material well-being (BEM) 2 4

2 supplementary aspects

Perception of security (PS) 3 4

Social and family participation (PSF) 6 5

TOTAL SCORE, PROJECT EFFECTS 28 -

Overview of questionnaire

Points for discussion about the content of the questionnaire:

Self-worth: several scales were suggested and tested (Rosenberg Scale) but this aspect of the questionnaire was removed because of issues with terminology and question structure

Social and family participation: a question on citizenship has been tested and will be revised

Impact Assessment Seminar, 2-6 December Phnom Penh

The study is overseen by the research laboratory Study location: urban environment, Dakar (Senegal)

Study sample: 60 adult individuals (41.7% with physical disabilities, 35% with sensory disabilities, 23.3% HIV)

2 field stages: 1st stage - 2 trained researchers (30 interviews), 2nd stage - 2 HI researchers and partners accompanied by the 1st two-person team (30 interviews)

Roll-out of version 1 field test

Impact Assessment Seminar, 2-6 December Phnom Penh

Quality of life score (5 aspects) = 51.8/100Total tool score (7 aspects) = 55.3/100

Results of version 1 field test

Impact Assessment Seminar, 2-6 December Phnom Penh

Score BEM / 100 Score BES / 100 Score BB / 100 Score PS / 100 Score SPM / 100 Score RSP / 100 Score PSF / 1000

10

20

30

40

50

60

70

80

A tool for adults The tool was tested in an urban environment Training of researchers: solid training and

external recruitment (not by HI and partners) Translation of the questionnaire: 1) into the local language

(2) sign language interpretation Accessibility of the questionnaire and its handover (pre-test) Classification of the individuals interviewed for the module

Socio-demographic information Change interpretation: analysis of external factors, inclusion of

a control group?

Challenges encountered

Impact Assessment Seminar, 2-6 December Phnom Penh

The next steps

Complete the methodology kit(using the questionnaire, organising the survey, training researchers and analysing the results)

Trial in English- and Spanish-speaking countries and other regions (baseline project)

2014: Practical guide: “How to evaluate the effects of HI and partner projects on the quality of life and social participation of their beneficiaries“

Impact Assessment Seminar, 2-6 December Phnom Penh

1. For which kind of your projects (context of interventions, target populations...) can this tool be used?

2. What are the success factors and key points of this tool?

Discussion

Impact Assessment Seminar, 2-6 December Phnom Penh