NCHS Opioid Question Evaluation Study
Transcript of NCHS Opioid Question Evaluation Study
![Page 1: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/1.jpg)
NCHS OPIOID QUESTION EVALUATION STUDY
Kristen Miller, Ph.D.
Collaborating Center for Question Design and Evaluation Research, National Center for Health Statistics
![Page 2: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/2.jpg)
OPIOID COMPARATIVE COGNITIVE INTERVIEWING STUDY
• Topics: Opioid Use, Misuse, Impairment, Addiction
• 140 Interviews (Additional 40 Spanish Interviews still to be conducted)
• Regions: DC Metro; Lexington, KY; Mobile, AL; Seattle, WA; Boston, MA; Wichita, KS; El Paso, TX; Chicago, IL
• Languages: Spanish, English
![Page 3: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/3.jpg)
OPIOID COMPARATIVE COGNITIVE INTERVIEWING STUDY
1. What constructs are captured by individual questions?
2. Are they consistently captured across demographic groups in diverse socio-cultural contexts? Or other relevant respondent groups?
3. Assess the feasibility of asking opioid questions for face-to-face population-based household surveys
• What topics are possible?
• What are the data quality concerns?
![Page 4: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/4.jpg)
SAMPLE CHARACTERISTICS
72
68
WOMEN MEN
GENDER9
74
36
6 7
1
RACE/ETHNICITY
19
36
56
29
1 8 - 29 YRS
30 - 49 YRS
50 - 64 YRS
65+ YRS
AGE
18
42
38
25
15
EDUCATION
![Page 5: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/5.jpg)
OPIOID-USE SAMPLE CHARACTERISTICS
32%
22%
26%
9%11%
Cause
ChronicCondition
Injury
Surgery
Other
None
9%
46%36%
9%
Usage
Never
Temporary
Current,Extensive
Previously,Extensive
79%
2%
19%
Source
Legal
Illegal
Both
![Page 6: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/6.jpg)
PRIMARY FINDINGS
1. Use
2. Misuse
3. Disorder
![Page 7: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/7.jpg)
OPIOID-USE SCREENER QUEST IONS
1. These next questions are about the use of prescription pain relievers called opioids. When answering these questions, please do not include over-the-counter pain relievers such as aspirin, Tylenol, Advil, or Aleve. During the past 12 months, have you taken any opioid pain relievers prescribed by a doctor or dentist? Examples include hydrocodone, Vicodin, Norco, Lortab, oxycodone, OxyContin, Percocet and Percodan. (13 errors)
2. Please look at the names and pictures of the pain relievers shown below. In the past 12 months, which, if any, of these pain relievers have you used? (8 errors)
![Page 8: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/8.jpg)
NHIS ERROR PATTERNS
1. Respondents believed their medication, which is not listed as an example, is an opioid—and it’s not. (False positive)
2. Respondents did not realize their medication is an opioid. (False negative)
3. The examples limited respondents’ definition of what to include. (False negative)
4. Respondents forgot that they had taken an opioid months earlier. (False negative)
![Page 9: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/9.jpg)
NSDUH
1. Respondents do not know the name of their opioid. (False negative)
2. Respondents mistook Tylenol 3 for regular Tylenol. (False positive)
![Page 10: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/10.jpg)
CONCLUSIONS
Neither question dramatically outperforms the other
NHIS = more false negative pattern
![Page 11: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/11.jpg)
0
5
10
15
20
25
30
35
NHIS NSDUH
NHIS NSDUH
RANDSOPIOID USE PREVALENCE RATE
NHIS n=1302; NSDUH n=1344*** p < 0.001; Unweighted; Cohen’s h = 0.177
NSDUH = 37.9%NHIS = TBD
![Page 12: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/12.jpg)
OPIOID M ISUSE QUEST ION
The next question asks about using prescription pain relievers in any way a doctor did not direct you to use them. When you answer these questions, please think only about your use of the drug in any way a doctor did not direct you to use it, including:
1) Using it without a prescription of your own,
2) Using it in greater amounts, more often, or longer than you were told to take it,
3) Using it in any other way a doctor did not direct you to use it.
Have you ever, even once, used any prescription pain reliever in any way a doctor did not direct you to use it?
![Page 13: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/13.jpg)
FINDINGS
Responses: 46 = ‘yes’ 72 = ‘no’
Of the 72 ‘no’ responses, 13 cases of false-negative reports.
(Likely did not catch all)
Concern of underestimation
![Page 14: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/14.jpg)
When you answer these questions, please think only about your use of the drug in any way a doctor did not direct you to use it, including: • Using it without a prescription of your own• Using it in greater amounts, more often, or longer than you were told to take it• Using it in any other way a doctor did not direct you to use it• Have you ever, even once, used any prescription pain reliever in any way
a doctor did not direct you to use it?
One Question: Am I abusing?
Yes
“I’m an addict.”
No
“I don’t take opioids.”
“I’m a responsible user.”
Two Parts: “Am I taking without a MD’s prescription?” If not, “Am I taking more than prescribed?”
Yes
“My pain was unbearable.”
“It was for recreation.”
No
“I’ve never done these things.”
![Page 15: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/15.jpg)
When you answer these questions, please think only about your use of the drug in any way a doctor did not direct you to use it, including: • Using it without a prescription of your own• Using it in greater amounts, more often, or longer than you were told to take it• Using it in any other way a doctor did not direct you to use it• Have you ever, even once, used any prescription pain reliever in any way
a doctor did not direct you to use it?
One Question: Am I abusing?
Yes
“I’m an addict.”
No
“I don’t take opioids.”
“I’m a responsible user.”
Two Parts: “Am I taking without a MD’s prescription?” If not, “Am I taking more than prescribed?”
Yes
“My pain was unbearable.”
“It was for recreation.”
No
“I’ve never done these things.”
Justifications:“Same manner.” “It all evens out.”“It says as needed.” “My daughter is a nurse practitioner.”“It’s essentially the same purpose”
![Page 16: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/16.jpg)
CURRENTLY PROPOSING
1. Did you ever take the medication more frequently or in higher doses than was prescribed?
2. Have you ever taken someone else’s opioid medication, that is, pain relievers not prescribed to you by your doctor?
![Page 17: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/17.jpg)
DISORDER QUESTIONS
• During the past 12 months, was there a month or more when you spent a lot of your time getting or using prescription pain relievers?
• During the past 12 months, was there a month or more when you spent a lot of your time getting over the effects of the prescription pain relievers you used?
• During the past 12 months, did you try to set limits on how often or how much prescription pain relievers you would use?
[If yes] Were you able to keep to the limits you set, or did you often use prescription pain relievers more than you intended to?
• During the past 12 months, did you need to use more prescription pain relievers than you used to in order to get the effect you wanted
![Page 18: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/18.jpg)
DISORDER FINDINGS
• Questions seen as asking about addiction (i.e., whether they are or not)
• Inability to establish causality
![Page 19: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/19.jpg)
CURRENTLY PROPOSING
• Reconsider the criteria for identifying ‘disorder’ in terms of what can be captured in household, population-based surveys
• Very difficult to ask about opioid disorder
• Interpretation: “Am I addicted?”
• Problems with causality
• Clinical questions do not work in survey setting
![Page 20: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/20.jpg)
SUMMARY OF FINDINGS
1) The ways in which respondents understood themselves in relationship to their use impacts how they interpret, process and ultimately respond to the opioid survey questions—particularly misuse and disorder questions
2) And, these understandings are informed by the social context in terms of:
a. What they have heard about opioids and the epidemic
b. Whether they know people impacted by the epidemic
3) These relationships impact the quality of data and can skew our understanding of the opioid epidemic– particularly for current, extensive opioid users
![Page 21: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/21.jpg)
USE SELF-UNDERSTSANDING CHARACTERISTICS
NEVERNever-Not-Me • Not a “pill person”; Doesn’t fill prescriptions; See addiction in others
Uninformed • No understanding of “opioid”; Unaware of opioid crisis
TEMPORARY
Knowledgeable • Understands self as being informed; Mindset that opioids are temporary; Does not refill; destroys medicine
Avoider • Not a “pill person”; Have taken, but decided didn’t like it; See addiction in others
Uninformed • No understanding of “opioid”; Lack knowledge of their own medicine
CONTINUING
Addicted • Understands themselves as being addicted; “I’m hooked,” “Oh yeah, I’m addicted”
Responsible • Understands themselves as having chronic, debilitating pain that requires opioids; Understands self as a responsible user; Receives opioids from a medical doctor, follows prescription (or rather, sees themselves as doing so)
PREVIOUSLY EXTENSIVE
Recovered Addict • Understands self as always being an addict
Not-Me • Views self as being over their addiction
TYPES OF SELF-UNDERSTANDING
![Page 22: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/22.jpg)
SELF-UNDERSTSANDING
CHARACTERISTICS QUESTION RESPONSE
USEAGE MISUSE, IMPAIR, DISORDER
Not-Me • Not a “pill person” • Doesn’t fill
prescriptions• See addiction in
others
• Accurate • NA
Uninformed • No understanding of
“opioid”• Unaware of opioid
crisis
• False “yes” to NSDUH after seeing Tylenol 3
• NA
NEVER USED
![Page 23: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/23.jpg)
SELF-UNDERSTANDING
CHARACTERISTICS QUESTION RESPONSE
USEAGE MISUSE, IMPAIR, DISORDER
Addict • Personally understands
opioid addiction• Understands self as
always being an addict
• Accurate • Accurate
Recovered Addict• Personally understands
opioid addiction• Views self as being over
their addiction
• Thinks of methadone as a treatment, not an opioid.
• Accurate
PREVIOUSLY, EXTENSIVELY USED
![Page 24: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/24.jpg)
SELF CHARACTERISTICS QUESTION RESPONSE
USEAGE MISUSE, IMPAIR, DISORDER
Knowledgeable • Understands self as being informed • Mindset that opioids are temporary • Does not finish or refill prescription• Destroys medicine
• Accurate • False Positives (Some Rs overly literal; paranoid aboutaddiction)
Avoider• Not a “pill person” • Have taken, but decided didn’t like it• See addiction in others
• False “no” to NHIS; did not know medicine was an opioid
• False Negatives (Some Rs “I don’t abuse”; justifications for misuse)
Uninformed• No understanding of “opioid”• Lack knowledge of their own medicine
• False “yes” to NSDUH after seeing Tylenol 3
TEMPORARY USER
![Page 25: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/25.jpg)
SELF CHARACTERISTICS QUESTION RESPONSE
USEAGE MISUSE, IMPAIR, DISORDER
Addicted • Understands themselves as being
addicted• “I’m hooked,” “Oh yeah, I’m addicted”
Accurate Accurate
Responsible• Understands themselves as having
chronic, debilitating pain that requires opioids
• Understands self as a responsible user • Receives opioids from a medical
doctor, follows prescription (or rather, sees themselves as doing so)
• Recognizes addiction in others
Accurate Misuse: Not always accurate= Strategies for understanding their misuse as “not misuse”
Impairment: Ability to distinguish “pain” from “opioid side effects” is difficult
Disorder: Not Accurate: = Interprets question as “Are you addicted?”
CURRENT, EXTENSIVE
![Page 26: NCHS Opioid Question Evaluation Study](https://reader034.fdocuments.in/reader034/viewer/2022052106/62880d121a06f531f43ab8cf/html5/thumbnails/26.jpg)
NEXT STEPS
1. Conduct Spanish interviews
2. Continue analysis, complete report, write papers
3. Cognitive interviewing work with revised questions
4. More work with RANDS; looking at validity, adding misuse
5. Develop standardized, validated set of opioid-related survey questions