Instrumental variables for comparative effectiveness research: a review of applications M. Alan...
-
Upload
ada-houston -
Category
Documents
-
view
219 -
download
1
Transcript of Instrumental variables for comparative effectiveness research: a review of applications M. Alan...
![Page 1: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/1.jpg)
Instrumental variables for comparative effectiveness research: a review of
applications
M. Alan Brookhart, Ph.D.
Division of Pharmacoepidemiology,
Brigham & Women’s Hospital, Harvard Medical School
![Page 2: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/2.jpg)
Overview of Lecture
• Brief introduction to instrumental variable analysis
• Examples of instrumental variables, some characteristics
• Role of IV in observational studies of medical interventions
![Page 3: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/3.jpg)
The Challenge of Observational Studies of Intended Effects
• Confounding by indication is strong
• Patients who need treatment are more likely to receive treatment
• Indications unmeasured or poorly measured– > Unmeasured confounding bias
![Page 4: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/4.jpg)
Instrumental Variables
• Can permit estimation of causal effects even when important confounders are unmeasured
• Instrument should be correlated with treatment• Instrument should be related to outcome only
through association with treatment (often termed the exclusion restriction)– Empirically unverifiable, but can be explored in
observed data.
![Page 5: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/5.jpg)
Confounding and Instrumental Variables
Received Received TreatmeTreatmentnt
OutcomeOutcome
ConfoundersConfoundersTreatment Arm AssignmentTreatment Arm Assignment
Example: Randomized Controlled Trial with Non-Compliance
RandomizationRandomization
BlindingBlinding
CC
XX YY
ZZ
InstrumentInstrument
![Page 6: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/6.jpg)
Intention-to-treat and (Wald) IV Estimator
α
ITT Estimator = E[Y|Z=1] - E[Y|Z=0]
E[Y|Z=1] - E[Y|Z=0]
IV Estimator = -------------------------
E[X|Z=1] - E[X|Z=0]
Effect of the Instrument on the Outcome
= ------------------------------------------------------------
Effect of the Instrument on the Exposure
![Page 7: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/7.jpg)
Interpretation of an IV
• When treatment effects are heterogeneous, IV estimator may be biased for average treatment effect (ATE)
• IV estimates a weighted average of causal treatment effects
• Subgroups of patients whose treatment status is more likely to be influenced by the IV are weighted up
• Empirical data, subject-matter knowledge may be used to anticipate direction of bias in IV relative to ATE
![Page 8: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/8.jpg)
IVs For Comparative Effectiveness
![Page 9: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/9.jpg)
Preference-based Instrumental Variables
• Substantial variation in medical practice across regions, hospitals, physicians
• Differences in medical practice may represent a natural experiment
• Suggests IVs defined at level of provider
![Page 10: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/10.jpg)
Observational Study of Non-steroidal Anti-Inflammatory Drugs
and GI bleeding risk in an elderly population(Brookhart et al, Epidemiology 2006)
• Compare short-term risk of GI outcomes between – Non-selective NSAIDs– COX-2 selective NSAIDs
• Coxibs are slightly less likely to cause GI problems
• Coxibs are likely to be selectively prescribed to patients at increased GI risk
• Classic problem of confounding by indication
![Page 11: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/11.jpg)
Characteristics of Cohort
Variable Coxib NS NSAID
Female Gender 86% 81%
Age > 75 75% 65%
Charlson Score>1 76% 71%
History of Hospitalization 31% 26%
History of Warfarin Use 13% 7%
History of Peptic Ulcer Disease 4% 2%
History of GI Bleeding 2% 1%
Concomitant GI drug use 5% 4%
History GI drug use 27% 20%
History of Rheumatoid Arthritis 5% 3%
History of Osteoarthritis 49% 33%
![Page 12: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/12.jpg)
COXIB
COX-2 Preferring Physician
NS NSAID Preferring Physician
NS NSAID
“Marginal Patient”
COXIB
COXIBNS NSAID
NS NSAID
Low Moderate High
Patient’s GI Risk
![Page 13: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/13.jpg)
Estimating Preference
– Volume of NSAID prescribing varies considerably among physicians
– Our approach: use the type of the last NSAID prescription written by each physician as a measure of current preference
– If for last patient, physician wrote a coxib prescription, for the current patient he is classified as a “coxib preferring physician” other he is classified as an “non-selective NSAID preferring physician.”
![Page 14: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/14.jpg)
Index Patient’s IV isPrevious Patient’s Treatment
Treatment
Previous PatientTreated with NSAIDs
Index Patient
Treatment = ?
Time
![Page 15: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/15.jpg)
Instrument should be related to treatment
LastNSAID
Prescription(IV)
Current Prescription (Actual Treatment)
CoxibX=1
Non-Selective NSAIDX=0
CoxibZ=1
(73%) (27%)
Non-Selective NSAIDZ=0
(50%) (50%)
![Page 16: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/16.jpg)
Instrument should be unrelated to observed patient risk factors
Variable Coxib Pref
Z=1
NS NSAID Pref
Z=0Female Gender 84% 84%
Age > 75 73% 72%
Charlson Score > 1 75% 73%
History of Hospitalization 29% 27%
History of Warfarin Use 12% 10%
History of Peptic Ulcer Disease 3% 3%
History of GI Bleeding 1% 1%
Concomitant GI drug use 5% 5%
History GI drug use (e.g., PPIs) 25% 24%
History of Rheumatoid Arthritis 4% 4%
History of Osteoarthritis 45% 41%
![Page 17: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/17.jpg)
IV estimate of the effect of coxib exposure on GI outcome
IV Estimate
E[Y|Z=1]-E[Y|Z=0] -0.21%
------------------------- = -------- = -0.92%
E[X|Z=1]-E[X|Z=0] 22.8%
Crude
E[Y|X=1]-E[Y|X=0] = +0.03%
After multivariable adjustment
= -0.04%
![Page 18: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/18.jpg)
Other examples of preference-based instrument
• Clinic, hospital as IV – Johnston SC, J Clin Epi– Schneeweiss, Seeger, Walker NEJM 2008: Aprotinin during
CABG
• Geographic region as instrument– Wen, J & Kramer J Clin Epi 1997 – Brooks et al, HSR, Breast cancer treatment– Stuckel T, et. al JAMA – Cardiac catheterization
• Generally available, but vulnerable to case-mix bias, concomitant treatments associated with the IV
![Page 19: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/19.jpg)
Distance to Specialty Provider as IV
McClellan, M., B. McNeil and J. Newhouse, JAMA, 1994. "Does More Intensive Treatment of Acute Myocardial Infarction Reduce
Mortality?”
• Medicare claims data identify admissions for AMI, 1987-91
• Treatment: Cardiac catheterization (marker for aggressive care)
• Outcome: Survival to 1 day, 30 days, 90 days, etc.
• Instrument: Indicator of whether the hospital nearest to a patient’s residence does catheterizations.
![Page 20: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/20.jpg)
Are assumptions valid ?
1. Is IV associated with treatment?
26.2% get cath if nearest hospital does caths19.5% get cath if nearest hospital does not do caths
2. Is IV associated with outcome other than through it effect on treatment?
They demonstrated IV is largely unassociated with observed patient characteristics.
![Page 21: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/21.jpg)
McClellan, et al. results
α
1. Conventional methods
- Crude estimate -30% (17% 1-year mortality if catheterized vs. 47%) - OLS estimate is -24%, adjusting for observable risk factors
2. IV estimator suggest catheterization associated with 10 percentage point reduction in mortality
E[Y|Z=1]-E[Y|Z=0] -0.7%
------------------------- = -------- = -10.4%
E[X|Z=1]-E[X|Z=0] 6.7%
![Page 22: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/22.jpg)
Other Examples of Distance IVs
• Brooks et al -- Effect of dialysis center profit status on survival
• McConnell KJ et al -- Treatment of head injuries at level I vs level II trauma centers
• Must be used studying a treatment that is dispensed at particular locations– Not applicable to many prescription medications
• Treatment must depend on distance
![Page 23: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/23.jpg)
Beta blocker after HF hospitalization and 1-year mortality
IV status:
Before
IV status:
After
Calendar Time as an IV
% B
B u
se a
fter
HF
hos
pita
l.Johnston et al. Stat Med 2008
Bias: Secular trends in other things related to the outcome
Best used when there is a dramatic shift in practice in a short time period: e.g, changes in guidelines, or safety warnings.
![Page 24: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/24.jpg)
IVs can also be created
• ‘Randomized encouragement’ designs (Ten Have et al)
• Designed delays (McClure M., Dormuth C; work in British Columbia)
![Page 25: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/25.jpg)
One-off Instruments
• Day of the week of hospital admission as an instrument for waiting time for surgery (Ho et al.)
• Surgeons operate only on weekdays and therefore patients admitted on the weekend may have to wait longer for surgical treatment.
• Bias: patients admitted on the weekend were different from those admitted on the weekday.
• Bias: IV could be independently related to the outcome if other aspects of hospital care that could affect the outcome were different over the weekend.
![Page 26: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/26.jpg)
Characteristics of Good Application of IVs
• IV should be have theoretical motivation
• IV should be strongly associated with treatment
• IV should be largely unrelated to patient characteristics
• Some consideration should be given to generalizing the estimate
• Used in the setting of a large sample
![Page 27: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/27.jpg)
Role of Instrumental Variable
• IV assumptions are different from those underlying conventional approaches
• Makes IV excellent for secondary analysis– Wang et al, NEJM 2005
• Problem arises if methods given different results• IV method deserve primary status if IV is
strong&valid, sample size is large, and unmeasured confounding expected to be great
![Page 28: Instrumental variables for comparative effectiveness research: a review of applications M. Alan Brookhart, Ph.D. Division of Pharmacoepidemiology, Brigham.](https://reader030.fdocuments.in/reader030/viewer/2022032604/56649e625503460f94b5e28f/html5/thumbnails/28.jpg)
Coming soon to the AHRQ website…
Practical guide to IV Methods for Comparative
Effectiveness Research, by Brookhart, Rassen, and Schneeweiss