MEASURING HEALTH RELATED QUALITY OF LIFE IN DIABETES: THE VALIDATION OF THE DIABETES HEALTH PROFILE...

1
There is a need to validate existing patient reported outcome measures (PROMS) to provide evidence on their validity. Subsequently, short measures can be developed from validated PROMS to lessen respondent burden. The aim of this study was to: •Validate the three domain conceptual framework of the Diabetes Health Profile (DHP-18) •Apply Rasch analysis to investigate the performance of the DHP-18 and develop a short 12 item version (DHP-12). Introduction MEASURING HEALTH RELATED QUALITY OF LIFE IN DIABETES: THE VALIDATION OF THE DIABETES HEALTH PROFILE (DHP-18) AND THE DEVELOPMENT OF A BRIEF MEASURE OF DIABETES RELATED HRQL (DHP-12) Brendan Mulhern 1 & Keith Meadows 2 1 Health Economics and Decision Science, University of Sheffield; 2 DHP Research and Consultancy Ltd The DHP-18 (Meadows et al., 2000): •Assesses psychosocial functioning in Type 2 diabetes across three domains: Psychological Distress; Barriers to Activity; Disinhibited Eating (scored on a 0-100 scale) •Is the diabetes-specific outcome measure selected for the UK Department of Health Patient Reported Outcome Measures Pilot for Long Term Conditions in Primary Care. The Diabetes Health Profile (www.diabeteshealthprofile.com) DHP-18 validation: •Exploratory factor analysis was used to investigate the factor structure of the DHP-18 Rasch analysis: •Rasch analysis was used to investigate the performance of the DHP- 18 and select items for the DHP-12. Rasch assesses the performance of individual items in relation to the underlying trait measured by the dimension level model. •Rasch assesses: •The ordering of item response categories (disordered items are rescored ) •Differential item functioning (DIF) across different background characteristics •The fit of each item to the overall model •The position of each item on the underlying severity (latent) scale (negative values cover the severe end of the scale, zero is the average, positive values cover the mild end of the scale Rasch was applied to each of the DHP-18 dimensions across two data subsets DHP-18/DHP-12 comparison: •The correlations between the measures were assessed •Internal consistency for each domain was assessed using Cronbach’s alpha •A separate comparison sample was used for this analysis Sample: Methods Factor and Rasch analysis (DHP-12 items highlighted in green) •Four items from each domain have been selected. •Responses to 10 items are disordered so have been rescored score range is 0-26). •One item (depression due to diabetes) displays DIF by gender. This item has been retained as depression in diabetes has been found to be higher in females (Lustman et al, 1988). DHP-18/DHP-12 comparison: Results •The three domain structure of the Diabetes Health Profile was confirmed. •Rasch analysis indicates that the DHP-18 has satisfactory performance overall. This means that the measure provides a valid basis for the development of a new short diabetes specific PROM. •A variety of Rasch analysis criteria have been used to develop a12 item version of the Diabetes Health Profile (DHP-12) that includes four items in each domain. Discussion Factor and Rasch analysis Comparison sample S1: Development S2: Validation n 771 810 2953 Aged above 65 57.6% 57.9% 52.42% Gender Male 59.4% 62.2% 53.90% DHP-18 scores Psychological Distress 19.07 18.21 19.26 Barriers to 22.33 21.11 23.30 Factor loading Rasch analysis Item Ordere d? No DIF? Fit? Location DHP- 12? Scorin g PD BA DE 1 2 1 2 1 2 1 2 Psychological distress domain 6. Lose temper if people nag 0.54 n/a n/a n/a 15. Lose temper or shout due to diabetes 0.86 n/a n/a n/a 14. Depression due to diabetes 0.62 - 0.96 - 0.73 0-2 16. Lose temper over small things 0.8 - 0.52 - 0.19 0-2 17. Moody about diabetes 0.69 0.5 0.14 0-2 18. More arguments at due to diabetes 0.68 0.97 0.79 0-2 Barriers to activity domain 2. Difficult staying out late 0.62 n/a n/a n/a 3. Days tied to meal times 0.72 n/a n/a n/a 12. Worry about busy shops 0.44 n/a n/a n/a 1. Food control life 0.47 - 0.96 - 1.03 0-2 4. Avoid going out if sugars low 0.63 0.24 0.16 0-2 10. Worry about colds/flu 0.44 - 0.07 0.02 0-2 13. Edgy when out and nowhere to eat 0.56 0.26 0.26 0-2 Disinhibited eating domain 11. Wish not so many nice things to eat 0. 50 n/a n/a n/a 5. Eat to cheer yourself up 0. 77 0.87 0.35 0-2 7. Hard to say no to food you like 0. 75 - 0.04 0.08 0-2 8. Easy to stop eating 0. 63 0.33 0.57 0-3 9. Eat extra when bored/fed up 0. 67 - 1.61 - 1.00 0-3 Mean (sd) Rang e Correlat ion % floor % ceilin g Alph a PD factor 0.95 DHP-18 19.26 (18.69) 0- 100 17.6 0.2 0.83 DHP-12 27.19 (23.93) 0- 100 20.3 1.2 0.76 BA factor 0.86 DHP-18 23.30 (17.94) 0- 100 8.8 0.1 0.68 DHP-12 24.68 (18.68) 0- 100 16.1 0.1 0.48 DE factor 0.96 DHP-18 33.45 (23.85) 0- 100 10.3 1.0 0.76 DHP-12 38.11 (26.90) 0- 100 14.5 2.3 0.71

Transcript of MEASURING HEALTH RELATED QUALITY OF LIFE IN DIABETES: THE VALIDATION OF THE DIABETES HEALTH PROFILE...

Page 1: MEASURING HEALTH RELATED QUALITY OF LIFE IN DIABETES: THE VALIDATION OF THE DIABETES HEALTH PROFILE (DHP-18) AND THE DEVELOPMENT OF A BRIEF MEASURE OF DIABETES RELATED HRQL (DHP-12)

There is a need to validate existing patient reported outcome measures (PROMS) to provide evidence on their validity. Subsequently, short measures can be developed from validated PROMS to lessen respondent burden. The aim of this study was to:

•Validate the three domain conceptual framework of the Diabetes Health Profile (DHP-18)•Apply Rasch analysis to investigate the performance of the DHP-18 and develop a short 12 item version (DHP-12).

Introduction

MEASURING HEALTH RELATED QUALITY OF LIFE IN DIABETES:THE VALIDATION OF THE DIABETES HEALTH PROFILE (DHP-18) AND THE DEVELOPMENT

OF A BRIEF MEASURE OF DIABETES RELATED HRQL (DHP-12)Brendan Mulhern1 & Keith Meadows2

1 Health Economics and Decision Science, University of Sheffield; 2 DHP Research and Consultancy Ltd

The DHP-18 (Meadows et al., 2000):•Assesses psychosocial functioning in Type 2 diabetes across three domains: Psychological Distress; Barriers to Activity; Disinhibited Eating (scored on a 0-100 scale)

•Is the diabetes-specific outcome measure selected for the UK Department of Health Patient Reported Outcome Measures Pilot for Long Term Conditions in Primary Care.

The Diabetes Health Profile (www.diabeteshealthprofile.com)

Contact: Brendan Mulhern, Health Economics and Decision Science, University of Sheffield, Regent Court, Sheffield, S1 4DA; e-mail: [email protected]; website: www.shef.ac.uk/hedsReference: Meadows KA, Abrams C, Sandbaek A. (2000) Adaptation of the Diabetes Health Profile (DHP-1) for use with patients with Type 2 Diabetes mellitus: psychometric evaluation and cross-cultural comparison. Diabetic

Medicine; 17: 572-580.Lustman PJ, Griffiths IS, Clouse RE et al. (1988). Depression in adults with diabetes: Results of a 5 year follow up study. Diabetes Care; 11(8): 605-612.

DHP-18 validation:•Exploratory factor analysis was used to investigate the factor structure of the DHP-18

Rasch analysis:•Rasch analysis was used to investigate the performance of the DHP-18 and select items for the DHP-12. Rasch assesses the performance of individual items in relation to the underlying trait measured by the dimension level model. •Rasch assesses:

•The ordering of item response categories (disordered items are rescored )•Differential item functioning (DIF) across different background characteristics•The fit of each item to the overall model•The position of each item on the underlying severity (latent) scale (negative values cover the severe end of the scale, zero is the average, positive values cover the mild end of the scale

Rasch was applied to each of the DHP-18 dimensions across two data subsets

DHP-18/DHP-12 comparison:•The correlations between the measures were assessed•Internal consistency for each domain was assessed using Cronbach’s alpha•A separate comparison sample was used for this analysis

Sample:

Methods

Factor and Rasch analysis (DHP-12 items highlighted in green)

DHP-12•Four items from each domain have been selected. •Responses to 10 items are disordered so have been rescored (raw score range is 0-26). •One item (depression due to diabetes) displays DIF by gender. This item has been retained as depression in diabetes has been found to be higher in females (Lustman et al, 1988).

DHP-18/DHP-12 comparison:

Results

•The three domain structure of the Diabetes Health Profile was confirmed.

•Rasch analysis indicates that the DHP-18 has satisfactory performance overall. This means that the measure provides a valid basis for the development of a new short diabetes specific PROM.

•A variety of Rasch analysis criteria have been used to develop a12 item version of the Diabetes Health Profile (DHP-12) that includes four items in each domain.

•Initial psychometric analysis demonstrates evidence for the comparability of the DHP-12 and DHP-18, but the internal consistency of the Barriers to Activity domain is low. Further analysis will be carried out to investigate the relationship in more detail using different datasets.

Discussion

Factor and Rasch analysis Comparison sample

S1: Development S2: Validation

n 771 810 2953

Aged above 65 57.6% 57.9% 52.42%

Gender Male 59.4% 62.2% 53.90%

DHP-18 scoresPsychological Distress 19.07 18.21 19.26

Barriers to Activity 22.33 21.11 23.30

Disinhibited Eating 35.86 36.25 33.45

  Factor loading Rasch analysis 

       

Item Ordered? No DIF? Fit? Location DHP-12? Scoring  PD BA DE 1 2 1 2 1 2 1 2 Psychological distress domain

6. Lose temper if people nag  0.54 √ √ n/a n/a n/a15. Lose temper or shout due to diabetes 0.86 √ √ n/a n/a n/a

14. Depression due to diabetes 0.62 √ √ -0.96 -0.73 √ 0-216. Lose temper over small things 0.8 √ √ √ √ √ -0.52 -0.19 √ 0-2

17. Moody about diabetes 0.69 √ √ √ √ √ 0.5 0.14 √ 0-218. More arguments at due to diabetes 0.68 √ √ √ √ √ 0.97 0.79 √ 0-2

Barriers to activity domain 2. Difficult staying out late 0.62 √ √ √ n/a n/a n/a3. Days tied to meal times 0.72 √ √ √ √ n/a n/a n/a

12. Worry about busy shops 0.44 √ √ n/a n/a n/a1. Food control life 0.47 √ √ √ √ √ -0.96 -1.03 √ 0-2

4. Avoid going out if sugars low 0.63 √ √ √ √ 0.24 0.16 √ 0-210. Worry about colds/flu 0.44 √ √ √ √ -0.07 0.02 √ 0-2

13. Edgy when out and nowhere to eat 0.56 √ √ √ √ 0.26 0.26 √ 0-2Disinhibited eating domain

11. Wish not so many nice things to eat 0.50 √ √ √

n/a n/a n/a

5. Eat to cheer yourself up  0.77 √ √ √

√ √ 0.87 0.35 √ 0-2

7. Hard to say no to food you like 0.75 √ √ √

√ √ -0.04 0.08 √ 0-2

8. Easy to stop eating 0.63 √ √ √ √

√ √ 0.33 0.57 √ 0-3

9. Eat extra when bored/fed up 0.67 √ √ √ √

√ √ -1.61 -1.00 √ 0-3

Mean (sd) Range Correlation % floor % ceiling AlphaPD factor 0.95

DHP-18 19.26 (18.69) 0-100 17.6 0.2 0.83DHP-12 27.19 (23.93) 0-100 20.3 1.2 0.76

BA factor 0.86DHP-18 23.30 (17.94) 0-100 8.8 0.1 0.68DHP-12 24.68 (18.68) 0-100 16.1 0.1 0.48

DE factor 0.96DHP-18 33.45 (23.85) 0-100 10.3 1.0 0.76DHP-12 38.11 (26.90) 0-100 14.5 2.3 0.71