Care Metrics and Quality Improvement/media/Non-Clinical/Files-PDFs-Excel-MS-Word … · Care...

13
1 Care Metrics and Quality Improvement Jason H. Wasfy, MD MPhil FACC Medical Director, Massachusetts General Physicians Organization Assistant Professor, Harvard Medical School November 7, 2018 Measuring and managing Conceptually, hard to improve what you can’t measure As such, many of us have been working on developing metrics for improved care Payment models are evolving Success has been mixed Reviewing past experience can help us develop good measures 2

Transcript of Care Metrics and Quality Improvement/media/Non-Clinical/Files-PDFs-Excel-MS-Word … · Care...

Page 1: Care Metrics and Quality Improvement/media/Non-Clinical/Files-PDFs-Excel-MS-Word … · Care Metrics and Quality Improvement Jason H. Wasfy, MD MPhil FACC Medical Director, Massachusetts

1

Care Metrics and Quality Improvement

Jason H. Wasfy, MD MPhil FACC

Medical Director, Massachusetts General Physicians Organization

Assistant Professor, Harvard Medical School

November 7, 2018

Measuring and managing

• Conceptually, hard to improve what you can’t measure

• As such, many of us have been working on developing metrics for improved care

• Payment models are evolving

• Success has been mixed

• Reviewing past experience can help us develop good measures

2

Page 2: Care Metrics and Quality Improvement/media/Non-Clinical/Files-PDFs-Excel-MS-Word … · Care Metrics and Quality Improvement Jason H. Wasfy, MD MPhil FACC Medical Director, Massachusetts

2

HRRP and HF mortality

• Statistical approaches to causal inference depend on methods (linearization, reference group etc)

• Initially, I was skeptical about results linking HRRP and mortality because of ecological inference fallacy

• There is an argument both ways (look at all patients affected by the policy vs. lack of plausible causal mechanism)

• Different results among analyses performed with different methods

• Qualitative methods could strengthen understanding3

Papadogeorgegou 2018 Wasfy 2017

Glass half empty or half full?

• No question some measurement has caused adverse consequences (PCI reporting)

• Sometimes improvement in process measures not translated into outcomes (DTB)

4

From Joynt et al. JAMA 2012

Menees et al NEJM 2013

Page 3: Care Metrics and Quality Improvement/media/Non-Clinical/Files-PDFs-Excel-MS-Word … · Care Metrics and Quality Improvement Jason H. Wasfy, MD MPhil FACC Medical Director, Massachusetts

3

Half full

• But I still think carefully designed measures have great potential

• Also, not measuring/reporting has produced suboptimal health outcomes

5

Some successes -ART

• Fertility Clinic Success Rate and Certification Act

• Mandated national public reporting of outcomes for ART

• Good outcomes (single infant born alive after 37 weeks and weight above 2.5 kg) increased from 18.5% to 26.7% from 2000 to 2010

6

cdc.gov

JAMA 2013

Page 4: Care Metrics and Quality Improvement/media/Non-Clinical/Files-PDFs-Excel-MS-Word … · Care Metrics and Quality Improvement Jason H. Wasfy, MD MPhil FACC Medical Director, Massachusetts

4

ACOs and patient experience

• CAHPS scores contribute to ACO financial performance

• Average performance of ACOs went from 82nd to 96th

percentile nationally, robust to group differences in trends

7

McWilliams et al NEJM2014

Our experience at MGH

• Metrics allow us internal attention and funds to support quality improvement

• Discuss our efforts to show how an organization might respond to quality metrics

8

Page 5: Care Metrics and Quality Improvement/media/Non-Clinical/Files-PDFs-Excel-MS-Word … · Care Metrics and Quality Improvement Jason H. Wasfy, MD MPhil FACC Medical Director, Massachusetts

5

AMI and PCI readmission tactics

• We use mixed-methods more common to health services research

• Quantitative techniques such as adjusting for preexisting trends and including readmissions to other facilities

• Systematic physician chart reviews to inform clinical and operational strategies (avoids anecdotes/personal experiences)

9

Low risk chest discomfort and heart failure

1010

Wasfy et al Circ Intv 2014

Page 6: Care Metrics and Quality Improvement/media/Non-Clinical/Files-PDFs-Excel-MS-Word … · Care Metrics and Quality Improvement Jason H. Wasfy, MD MPhil FACC Medical Director, Massachusetts

6

Lots of chest discomfort – but low TLR

11

• 9288 PCI patients, 893 (9.8%) readmitted at MGH and BWH within 30 days

• 6.2% complications of PCI, 38.1% suspicion for angina

11

Wasfy et al Circ Intv 2014

only 2.6% TLR!

12

Variables known before PCI can predict readmission risk prospectively (C-statistic = 0.69)

Wasfy et al Circ Qual Outcomes 2013

Page 7: Care Metrics and Quality Improvement/media/Non-Clinical/Files-PDFs-Excel-MS-Word … · Care Metrics and Quality Improvement Jason H. Wasfy, MD MPhil FACC Medical Director, Massachusetts

7

NLP searches refine risk prediction

• Anxiety, frequent ED visits

• Social variables are prominent (homelessness, non English speaking)

13

Wasfy et al Circ Cardiovasc Qual Outcomes 2015

Nearly half preventable

1414

Wasfy et al Journal of the American Heart Association 2014

Page 8: Care Metrics and Quality Improvement/media/Non-Clinical/Files-PDFs-Excel-MS-Word … · Care Metrics and Quality Improvement Jason H. Wasfy, MD MPhil FACC Medical Director, Massachusetts

8

We then validated this preventability

15

Tanguturi et al. Circ Cardiovasc Qual Outcomes 2017

Including non-index readmissions, slope for MGH patients is 2.5x rest of state

16

13%

14%

15%

16%

17%

18%

19%

20%

2006 2007 2008 2009 2010 2011 2012 2013 2014

Rea

dmission Rate W

ithin 30 Days post‐Discharge

MGH PCI ReadmitRate

NON MGH ReadmitRate

Linear (MGH PCI ReadmitRate)

Linear (NON MGH ReadmitRate)

Page 9: Care Metrics and Quality Improvement/media/Non-Clinical/Files-PDFs-Excel-MS-Word … · Care Metrics and Quality Improvement Jason H. Wasfy, MD MPhil FACC Medical Director, Massachusetts

9

Tactics

• Risk prediction and patient education

• Two pillars

(1) Mandatory outpatient follow up

(2) NP based electronic notifications when patients are in the ED

17

Outpatient follow up

• Standard protocols around 2 week follow up for all MGH patients

18

Page 10: Care Metrics and Quality Improvement/media/Non-Clinical/Files-PDFs-Excel-MS-Word … · Care Metrics and Quality Improvement Jason H. Wasfy, MD MPhil FACC Medical Director, Massachusetts

10

Protocol-based triggers for cardiology consultation in the emergency department

19

Presentation Default Recommendations

Early recognition at time of registration

20

Page 11: Care Metrics and Quality Improvement/media/Non-Clinical/Files-PDFs-Excel-MS-Word … · Care Metrics and Quality Improvement Jason H. Wasfy, MD MPhil FACC Medical Director, Massachusetts

11

PCI and AMI do not fully overlap

• Only 184,110 of those readmitted PCI patients (32.7%) had AMI during the index PCI hospitalization

21

Wasfy JH, Dominici F, Yeh RW. Circulation 2016

Review of AMI readmissions

22

Of 197 AMI readmissions, 111 received no revascularization.

28.4% too high risk11.7% type 2 MI6.6% patient declined interventions

So we included AMI patients in the protocols.

Martin et al. JAHA 2018

Page 12: Care Metrics and Quality Improvement/media/Non-Clinical/Files-PDFs-Excel-MS-Word … · Care Metrics and Quality Improvement Jason H. Wasfy, MD MPhil FACC Medical Director, Massachusetts

12

These interventions are correlated with a 40% drop in index-readmission rate

23

Associated with CMS penalty reduction

24

Our mission is quality care - external incentives only organize efforts and provide funds for important work.

We can use these funds to improve care, expand access and rapid consultative care in the ED.

Page 13: Care Metrics and Quality Improvement/media/Non-Clinical/Files-PDFs-Excel-MS-Word … · Care Metrics and Quality Improvement Jason H. Wasfy, MD MPhil FACC Medical Director, Massachusetts

13

Meaningful measures?

2525

Metrics are most meaningful if:

(1) Risk adjusted without unmeasured confounders(2) Clinical data rather than administrative data (harder to do)(3) There is minimal opportunity to manipulate data by clinicians

(either conscious or unconscious) (4) Some attention to social determinants of health (even if not

included in risk-adjustment)

Wasfy et al Circulation 2015

Thanks!

26

[email protected]

@jasonwasfy