Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD...
-
Upload
thomas-moore -
Category
Documents
-
view
216 -
download
0
description
Transcript of Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD...
![Page 1: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/1.jpg)
Development and Testing of the AHRQ QI Toolkit for Hospitals
Donna O. Farley, PhDPeter Hussey, PhDRAND Corporation
![Page 2: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/2.jpg)
Set of tools that hospitals can use to help improve performance in quality and patient safety
The AHRQ Quality Indicators (QIs) – Inpatient Quality Indicators (IQIs)– Patient Safety Indicators (PSIs)
Targeted to wide range of hospitals– Independent or system-affiliated– Varying quality improvement experience
What Is the Toolkit?
2
![Page 3: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/3.jpg)
Toolkit Development
Developed through a Task Order in the AHRQ ACTION program
RAND partnered with UHC to develop and test the toolkit
AHRQ will continue toolkit support
3
![Page 4: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/4.jpg)
Applicable for hospitals with differing knowledge, skills, and needs
Serves as a “resource inventory” from which hospitals can select tools
Different audiences for each tool (e.g., quality officer, finance officer, programmer)
How Hospitals Can Use the Toolkit
4
![Page 5: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/5.jpg)
What Are the Quality Indicators?
Inpatient Quality Indicators – 28 indicators of quality in four sets– Volume, counts (6)– Mortality for conditions, rates (7)– Mortality for procedures, rates (8)– Utilization, rates (7)
Patient Safety Indicators – – 17 indicators and a composite indicator– Screen for adverse events for inpatients– Expressed as rates
5
![Page 6: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/6.jpg)
The Development Process
Develop Alpha Toolkit• Identify tools to include• Develop draft tools
Field Test Alpha Toolkit
Revise and Finalize Toolkit for
Dissemination
Perform Evaluation• Improvement experiences• Usability of toolkit• Effects on QI values
6
![Page 7: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/7.jpg)
Established principles to guide toolkit development
Reviewed literature to guide design Developed outline of toolkit based on
steps of a quality improvement process
Identified and developed specific tools for each step
Tool Development Steps
7
![Page 8: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/8.jpg)
Technical Advisory Panel
8
Six-member panel Brought various skills and perspectives
– Hospital experience– Quality improvement– Relevant research skills
Provided guidance throughout toolkit development– Toolkit design principles– Content of the tools
![Page 9: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/9.jpg)
Parsimony in tool choice and design Target the most important factors
for implementation Provide tools that offer most value
for a range of hospitals Readily accessible contents Enable hospitals to assess
effectiveness of their actions
Principles Guiding Toolkit Development
9
![Page 10: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/10.jpg)
Structure of the Toolkit
Introduction and RoadmapA. Readiness to ChangeB. Applying QIs to the Hospital DataC. Identifying Priorities for Quality ImprovementD. Implementation MethodsE. Monitoring Progress and Sustainability
of ImprovementsF. Return-on-Investment AnalysisG. Existing Quality Improvement Resources
10
![Page 11: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/11.jpg)
The Roadmap
A navigational guide through the toolkit For each tool, it summarizes:
– Action step being taken– Brief description of the tool– Key audience(s) to use the tool– Position with lead role responsibility
11
![Page 12: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/12.jpg)
Quality improvement collaborative Conducted by UHC 11 hospitals participated Structured implementation process
for improvements on the QIs Evaluation performed by RAND
Field Test Design
12
![Page 13: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/13.jpg)
WHAT WE LEARNED
![Page 14: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/14.jpg)
Evaluation Design
Six hospitals participated in evaluation Designed to learn:
– Hospital implementation strategies– Experiences in Improvement effort– Usefulness and usability of the tools
Data collection– Pre/post interviews– Regular update calls during study period– Three post-interviews in site visits
14
![Page 15: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/15.jpg)
Overall, Positive Feedback
The tools were judged by the hospitals to be usable and useful
Hospitals varied widely in how many, and which, tools they chose to apply
Toolkit was useful for achieving staff consensus on the extent of quality gaps and on evidence-based practices
15
![Page 16: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/16.jpg)
PSI 4: Death among surgical inpatients w/ serious complications
PSI 7: Central venous catheter-related bloodstream infection
PSI 12: Postoperative pulmonary embolism or deep vein thrombosis
PSI 13: Postoperative sepsis PSI 15: Accidental puncture/laceration PSI 19: Obstetric trauma-vaginal delivery
w/o instrument
All the Hospitals Chose to Address PSIs
16
![Page 17: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/17.jpg)
Three Key Learnings
Hospitals need to trust their data Priority-setting is challenging Keep the tools short and simple
17
![Page 18: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/18.jpg)
Need to Trust Your Data
The IQI or PSI rates have to be credible: “If we’re running reports over coding
information, we have to be mindful of coding issues before engaging medical staff. Need to be sure that we’re not wasting their time.”
18
![Page 19: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/19.jpg)
Priority-Setting is Challenging
Many hospitals commented on prioritization:“It’s a great benefit to look at data and
explore it to see if it’s an issue… I don’t know if [hospitals] have the time to do that, unless it’s driven by corporate leadership or pay structure.
[There are] so many other things that we’re mandated to report and improve, it’s hard to look for something else.”
19
![Page 20: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/20.jpg)
Keep Tools Simple
Users should be able to easily find the tools they need:
“People have so much going on that it’s hard…”
“I think we have to come up with simpler versions…”
20
![Page 21: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/21.jpg)
Revised Toolkit To Address These Issues
Added a documentation and coding tool to improve PSI validity
Made prioritization matrix tools flexible so a hospital can tailor it with factors it considers in priority-setting
Simplified tools and instructions to increase usability
21
![Page 22: Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.](https://reader035.fdocuments.in/reader035/viewer/2022081605/5a4d1ba87f8b9ab0599c9d1e/html5/thumbnails/22.jpg)
QUESTIONS?