A National Web Conference on Reducing Provider Burden ......presentation, type your ... design...
Transcript of A National Web Conference on Reducing Provider Burden ......presentation, type your ... design...
![Page 1: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/1.jpg)
AHRQ National Web Conference onReducing Provider Burden Through Better
Health IT Design
Presented by:Pascale Carayon, PhD
Zia Agha, MD Lukasz Mazur, PhD
Moderated by:Bryan Kim, PhD
Agency for Healthcare Research and Quality
January 25, 2018
![Page 2: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/2.jpg)
Agenda
• Welcome and Introductions • Presentations • Q&A Session With Presenters • Instructions for Obtaining CME Credits
Note: After today’s Webinar, a copy of the slides willbe emailed to all participants.
2
![Page 3: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/3.jpg)
Presenter and Moderator Disclosures
The following presenters and moderator have no financial interests to disclose:
Pascale Carayon, PhD Presenter
Zia Agha, MD Presenter
Lukasz Mazur, PhD Presenter
Bryan K im, PhD Moderator
This continuing education activity is managed and accredited by the Professional Education Services Group (PESG), in cooperation with AHRQ, TISTA, and RTI.
PESG, AHRQ, TISTA, and RTI staff have no financial interests to disclose.
Commercial support was not received for this activity. 3
![Page 4: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/4.jpg)
How to Submit a Question
• At any time during thepresentation, type yourquestion into the “Q&A”section of your WebEx Q&Apanel.
• Please address your questionsto “All Panelists” in the drop-down menu.
• Select “Send” to submit your question to the moderator.
• Questions will be read aloud bythe moderator.
4
![Page 5: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/5.jpg)
Learning Objectives
At the conclusion of this activity, participants should be able to:
1. Identify the cognitive and team work involved in venousthromboembolism (VTE) prophylaxis and the sociotechnical systemdesign requirements that support collaborative VTE prophylaxisteamwork.
2. Describe methods for capturing and analyzing EHR use for providing acomprehensive assessment of usability, clinical workflow, physician-patient communication, cognitive load, and user satisfaction in twodistinct outpatient settings.
3. Explain an evaluation to assess provider mental workload andperformance on abnormal test result follow-up in both a standard and an enhanced EHR environment that includes results trackingfunctionality.
5
![Page 6: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/6.jpg)
Sociotechnical Design of Health IT for Teams Application to VTE Prophylaxis
Pascale Carayon, PhDWisconsin Institute for Healthcare Systems Engineering
University of Wisconsin-Madison
![Page 7: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/7.jpg)
• Ann Schoofs Hundt• Peter Hoonakker• Megan Salwei• Roger Brown
UW-Madison
• Peter Kleinschmidt• Brian Patterson• Shashank Ravi [Yale]
UW He alth
Geisinger • Vaibhav Agrawal• Jason Stamm• Ken W ood [Univ ersity of Mar yland]
• Becky Price
7
Acknowledgments
Funding by AHRQ: 5R01HS022086“Health IT-supported process for preventing and managing VTE”
https://cqpi.wisc.edu/vte-and-health-it/
Yushi Yang [Drexel] •
Doug Wiegmann• Yudi Wang•• Emily Wirkus
![Page 8: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/8.jpg)
Venous Thromboembolism (VTE)
• VTE:
– Patient safety problem (Goldhaber & Bounameaux, 2012;Maynard et al., 2013, 2014)
• Solutions for preventing VTE:
– Guidelines for VTE prophylaxis
– Risk assessment algorithms
– EHR (CDS) to support VTE prophylaxis
• But…
ØUsability, usefulness and workflow integration of health ITØNot just admission:
• Missed doses of enoxaparin à DVT formation [Louis et al., 2014]
ØCollaborative work of physician, pharmacist, nurse, etc…8
![Page 9: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/9.jpg)
Admission Interruption Re-initiation Initiation Transfer
VTE Prophylaxis
VTE Prophylaxis in the HospitalSEIPS Model of Work System and Patient Safety
[SEIPS = Systems Engineering Initiative for Patient Safety] (Carayon et al., 2006, 2014)
9
![Page 10: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/10.jpg)
Study Design
• Multiple case study design (Eisenhardt, 1989)
11 cases
GMC
CCM
Cardiology
Hospitalist
GWV
CCM
CCS
Hospitalist
GSACH
Hospitalist
IM
UWHC
CCM
CCS
Hospitalist
4 hospitals
CCM=Critical Ca re MedicineCCS=Critical Ca re Surgery IM=Internal Medicine 10
![Page 11: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/11.jpg)
11
Data Collection Methods • Survey: – To assess clinician attitudes toward and perceptions of VTE
prophylaxis and potential solutions – N=1,009 (attendings, residents, PA/NP, pharmacists, nurses);
85% response rate • Observation: – Focused on morning rounds: VTE-related activities – N=40; 69 hours
• Interviews and focus groups: – Based on SEIPS model: W hat is the work system? System barriers and facilitators? – N=40; 61 hours
Multiple feedback loops
![Page 12: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/12.jpg)
Results à Sociotechnical Design Considerations
1. Survey 2. Role network analysis 3. Cross-case analysis
Participatory Human-Centered Design
12
![Page 13: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/13.jpg)
Participatory Human-Centered Design
• Objective:– To define design considerations for health IT that
supports cognitive and team work in VTEprophylaxis [interruption/re-initiation]
• Divergence/convergence (Brown, 2009-Design Thinking]
• Local and national experts• Participation of clinical team
membersØSociotechnical system
13
![Page 14: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/14.jpg)
Sociotechnical Design Considerations for VTE Prophylaxis
focus on interruption & re-initiation Ø 13 categories with 22 specific design considerations:
1. Patient journey 2. Clinical appropriateness 3. Physician teamwork 4. Role clarity 5. Built-in redundancy/error recovery 6. Structure-rounds-shift change 7. Organizational culture 8. Workload 9. Technology access 10. Environment 11. Education of nurses and physicians 12. Education of patients 13. Unit-level monitoring
14
![Page 15: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/15.jpg)
2. Role network analysis3. Cross-case analysis
Results à Sociotechnical Design Considerations
1. Survey
15
![Page 16: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/16.jpg)
Who is best able to provide daily assessment of patient need for VTE prophylaxis?
16
![Page 17: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/17.jpg)
Error recovery Role clarity (resilience)
Sociotechnical Design Considerations
• Need to reduce role ambiguity… but also need for a “second pair of eyes”
• Team configurations and responsibilities
• Automation to monitor and/or suggestinterruption or re-initiation
17
![Page 18: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/18.jpg)
3. Cross-case analysis
Results à Sociotechnical Design Considerations
1. Survey 2. Role network analysis (Hundt et al., 2017)
18
![Page 19: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/19.jpg)
Role Network Analysis [Interruption]
GWV-Hospitalist
(Hundt et al., 2017)
GWV-CCM
Activities in blue = performed during multidisciplinary bedside rounds
19
![Page 20: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/20.jpg)
Sociotechnical Design Considerations
• Need to support teamwork… in particular communication between attendingphysician and proceduralists [technology for teamcommunication]
• Transparent, open organizational culture… anyone can suggest interrupting or re-initiating VTEprophylaxis
• Structure for team discussion and team awareness… checklists and reminders in EHR
20
![Page 21: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/21.jpg)
1. Survey 2. Role network analysis
Results à Sociotechnical Design Considerations
3. Cross-case analysis
21
![Page 22: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/22.jpg)
Cross-Case Analysis Cross-case analysis table
[focus on interruption & re-initiation] 11 case reports: 11-25 pages each 1. Contextual information 2. Data on VTE process and
outcomes [survey, observation]
3. Perceptions of and attitudes toward VTE prophylaxis [survey]
4. VTE prophylaxis across the hospital journey [role network analysis]
5. Roles in VTE prophylaxis [survey]
6. VTE-related team interaction during morning rounds [observation]
7. Perceived barriers to VTE prophylaxis [survey]
8. Possible solutions for VTE prophylaxis [survey]
Perspectives: ü Contextual d ata ü Survey data ü Observation data ü Role networks ü Comparing CCM ü Comparing CCS ü Comparing hospitalist
(Miles, Huberman & Saldana, 2014)
22
![Page 23: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/23.jpg)
Sociotechnical Design Considerations for VTE Prophylaxis
focus on interruption & re-initiation Ø 13 categories with 22 specific design considerations:
1. Patient journey 2. Clinical appropriateness 3. Physician teamwork 4. Role clarity 5. Built-in redundancy/error recovery 6. Structure-rounds-shift change 7. Organizational culture 8. Workload 9. Technology access 10. Environment 11. Education of nurses and physicians 12. Education of patients 13. Unit-level monitoring
23
![Page 24: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/24.jpg)
e
Sociotechnical Design Considerations for VTE Prophylaxis
focus on interruption & re-initiation Ø 13 categories with 22 specific design considerations:
1. Patient journey 2. Clinical appropriateness 3. Physician teamwork 4. Role clarity 5. Built-in redundancy/error r covery 6. Structure-rounds-shift change 7. Organizational culture 8. Workload 9. Technology access 10. Environment 11. Education of nurses and physicians 12. Education of patients 13. Unit-level monitoring
24
![Page 25: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/25.jpg)
Sociotechnical Design Considerations for VTE Prophylaxis
focus on interruption & re-initiation Ø 13 categories with 22 specific design considerations:
1. Patient journey 2. Clinical appropriateness 3. Physician teamwork 4. Role clarity 5. Built-in redundancy/error recovery 6. Structure-rounds-shift change 7. Organizational culture 8. Workload 9. Technology access 10. Environment 11. Education of nurses and physicians 12. Education of patients 13. Unit-level monitoring
25
![Page 26: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/26.jpg)
Sociotechnical Design Considerations for VTE Prophylaxis
focus on interruption & re-initiation Ø 13 categories with 22 specific design considerations:
1. Patient journey 2. Clinical appropriateness 3. Physician teamwork 4. Role clarity 5. Built-in redundancy/error recovery 6. Structure-rounds-shift change 7. Organizational culture 8. Workload 9. Technology access 10. Environment 11. Education of nurses and physicians 12. Education of patients 13. Unit-level monitoring
26
![Page 27: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/27.jpg)
Sociotechnical Design Considerations for VTE Prophylaxis
focus on interruption & re-initiation Ø 13 categories with 22 specific design considerations:
1. Patient journey 2. Clinical appropriateness 3. Physician teamwork 4. Role clarity 5. Built-in redundancy/error recovery 6. Structure-rounds-shift change 7. Organizational culture 8. Workload 9. Technology access 10. Environment 11. Education of nurses and physicians 12. Education of patients 13. Unit-level monitoring
27
![Page 28: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/28.jpg)
Sociotechnical Design Considerations for VTE Prophylaxis
focus on interruption & re-initiation Ø 13 categories with 22 specific design considerations:
1. Patient journey 2. Clinical appropriateness 3. Physician teamwork 4. Role clarity 5. Built-in redundancy/error recovery 6. Structure-rounds-shift change 7. Organizational culture 8. Workload 9. Technology access 10. Environment 11. Education of nurses and physicians 12. Education of patients 13. Unit-level monitoring
28
![Page 29: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/29.jpg)
Sociotechnical Design Considerations for VTE Prophylaxis
focus on interruption & re-initiation Ø 13 categories with 22 specific design considerations:
1. Patient journey 2. Clinical appropriateness 3. Physician teamwork 4. Role clarity 5. Built-in redundancy/error recovery 6. Structure-rounds-shift change 7. Organizational culture 8. Workload 9. Technology access 10. Environment 11. Education of nurses and physicians 12. Education of patients 13. Unit-level monitoring
29
![Page 30: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/30.jpg)
Sociotechnical Design Considerations for VTE Prophylaxis
focus on interruption & re-initiation Ø 13 categories with 22 specific design considerations:
1. Patient journey 2. Clinical appropriateness 3. Physician teamwork 4. Role clarity 5. Built-in redundancy/error r ecovery 6. Structure-rounds-shift change 7. Organizational culture 8. Workload 9. Technology access 10. Environment 11. Education of nur ses and physicians 12. Education of pa tients 13. Unit-level monitoring
Context matters!
30
![Page 31: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/31.jpg)
Sociotechnical Design Considerations for Care Process
Ø 13 categories with 22 specific design considerations: 1. Patient journey 2. Clinical appropriateness 3. Physician teamwork 4. Role clarity 5. Built-in redundancy/error r ecovery 6. Structure-rounds-shift change 7. Organizational culture 8. Workload 9. Technology access 10. Environment 11. Education of nur ses and physicians 12. Education of pa tients 13. Unit-level monitoring
ü Sociotechnical system (SEIPS model)
ü Participatory human-centered design
ü Multidisciplinary ü Multiple contexts
31
![Page 32: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/32.jpg)
Contact Information
Pascale Carayon, PhDWisconsin Institute for Healthcare Systems Engineering
University of Wisconsin-Madison
32
![Page 33: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/33.jpg)
Quantifying EHR Usability To Improve Clinical WorKflow -
QUICK
Funding support AHRQ R01 2012-2016
Zia Agha, MD Prof . Departmen t o f Medicin e UCSD
CMO and EVP Wes t Health [email protected]
![Page 34: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/34.jpg)
Aim 1: Measure and compare EMR use patterns.
• EMR usability must be expressed inoperational terms to guide objectivecomparisons.
• We propose to measure and compareclinicians’ use of EMRs during outpatientvisits, based on video recordings, EMR screencapture, and EMR mouse-click and key-clickdata.
34
![Page 35: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/35.jpg)
Aim 2: Measure and compare clinical workflow and clinician-patient communication.
• During the limited timeframe of an outpatientvisit, clinicians multitask between EMR work andinteraction with patients.
• The complexity of the clinical workflow is notdirectly observable from EMR alone, yet must betaken into account to make meaningfulcomparisons across visits.
• We propose to measure clinician workflow andclinician-patient verbal communication, based onvideo recording of visits and coded to a discreteset of behaviors.
35
![Page 36: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/36.jpg)
Aim 3: Measure satisfaction and cognitive load.
During clinical encounters, clinicians managemultiple needs that impose an administrativeand cognitive burden. Therefore, we willmeasure cognitive burden via the NASA TaskLoad Index (NASA-TLX), a validated and widelyused tool that enables subjective assessments ofthe workloads associated with those interactingwith human-machine systems.
36
![Page 37: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/37.jpg)
Aim 4: Explore associations between aims 1, 2, and 3.
• To understand real-world EMR usability, wewill explore associations between EMR usage,workflow, communication, user satisfaction,and cognitive load.
• Additionally, separate analyses will also beconducted to study the effect of sites (UCSDand VA), clinician types (Primary andSpecialty), and EHRs (CPRS and EPIC) onusability and workflow.
37
![Page 38: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/38.jpg)
Site comparison in terms of care delivery model, staff support, and EHR features.
38
![Page 39: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/39.jpg)
• Specialties included gastroenterology, pulmonology,cardiology, rheumatology, nephrology.
Recruitment by site and specialty groupings
39*
![Page 40: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/40.jpg)
Visit process data
Body tracking
Eyetracking
Primary Instruments Secondary Instruments
Mouse + keyboard activity
EHR screen recording
Vocalization + verbal activity
Nonverbal + clinical workflow
Usability SoftwareRoom Video Sensor data
restricted to window of the visit
40
![Page 41: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/41.jpg)
Figure 1: Visit activity
41
![Page 42: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/42.jpg)
Summary of data coding quality in terms of intercoder agreement across dual-coded visits.
42
![Page 43: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/43.jpg)
Comparison of EHR function activity between the two sites based on mouse clicks and timing based on physicians’ gaze-to-EHR.
43
![Page 44: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/44.jpg)
unid actually group of 9 CPRS tabs
not all behaviors are considered here, will add up to less than 100% of visit duration
EHR Activity + NonVerbal Gaze / Visit
44
![Page 45: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/45.jpg)
Comparison of CPOE frequency, time-at-task per order and EHR UI burden as measured by numbers of clicks/order
45
![Page 46: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/46.jpg)
Figure 4
46
![Page 47: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/47.jpg)
47
![Page 48: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/48.jpg)
Distribution of navigation across EHR functions. Tab-level transitions based on mouse clicks tagged to the top-level screen or ‘‘Tab” coding.
48
![Page 49: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/49.jpg)
EHR Navigation patterns for one randomly selected visit foreach study physician, based on mouse click activity human-coded to top-level Tab or EHR screen.
Each colored square represents atransition between major EHR functions or ‘‘Tabs” (e.g., Notes ? Orders).
The number of Tab transitions is shown to the right of each navigation sequence.
49
![Page 50: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/50.jpg)
Cognitive load ratings and rank orders - NASA TLX
50
![Page 51: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/51.jpg)
Gender in NASA TLX
52
![Page 52: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/52.jpg)
Correlation of CPOE activity and effort rating on TLX
53
![Page 53: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/53.jpg)
Figure 5
54
![Page 54: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/54.jpg)
Summary
We demonstrated a novel approach to collecting and analyzing multiplesources of data during clinical activities and integrated these streams intomeaningful measures, enabling comparison across two clinical settingswith different EHRs and a spectrum of primary and specialty (outpatient) care.
This effort revealed a high degree of variation in observed activity andclinical practice despite accounting for similar types of visits and patientcomplexity.
We identified similar patterns of EHR use and navigation at the 2 sitesdespite differences in functions, user interface, and consequent codedrepresentation.
Both sites displayed remarkably high burden (frequency and time at task)to attended to EHRs along with high subjective workload as measured byNASA Task Load survey.
55
![Page 55: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/55.jpg)
Summary
Commonly noted high-level clinical tasks, such as medicationreconciliation or preventive care were highly distributedacross the visits and very difficult to measure, suggesting theneed for further levels of integration.
Preliminary workload analyses suggested a complexrelationship between levels of measurable physicians’ activityduring visits and perceptions of effort and task performance.
As no single visit activity factor was highly correlated with subjective task load, a fuller understanding of the workflowand cognitive flow will require integration of qualitative data,e.g., physician interviews.
56
![Page 56: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/56.jpg)
QUICK Team
Zia Agha, MD - West Health / UCSD
Shazia Ashfaq, MD - VMRF / VASDHS
Lin Liu, PhD - VMRF / UCSD
Charlene Weir, PhD - University of Utah
Kai Zheng, PhD - University of Michigan
Mark T. Gabuzda, MD - VASDHS / UCSD
Braj B. Pandey, MD - VASDHS / UCSD
Robert El-Kareh, MD - UCSD
Jing Zhang, MS - UCSD
Kellie Avery, BS - VMRF
Alan Calvitti, PhD - VASDHS
Steven Rick, BS - VMRF / UCSD
Neil Farber, MD - UCSD
Harry S. Hochheiser, PhD - University of Pittsburgh
Nadir Weibel, PhD - UCSD
Kristin Bell, MD - VASDHS / UCSD
Richard Street, PhD - Texas A&M
Yunan Chen , PhD - UCI
Sara Mortensen, BS - VMRF
Elizabeth Kang - VMRF / UCSD
57
![Page 57: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/57.jpg)
Contact Information
Zia Agha, MD
Prof . Departmen t o f Medicin e UCSD CMO and EVP Wes t Health
58
![Page 58: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/58.jpg)
Reducing Provider Burden through BetterHealth IT Design – Part 3
Providers’ Interaction with EHRs
Lukasz Mazur, PhD
Division of Healthcare Engineering, University ofNorth Carolina, Chapel Hill, NC
![Page 59: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/59.jpg)
Acknowledgment
• Federal Project Officer: Steve Bernstein, AHRQ, CEPI, Division of Health IT
• Grant Number: R21HS024062 • Co-PI: Carlton Moore MD, Lawrence Marks, MD • Investigator: Prithima Mosaly, PhD • UNC Epic consultant: Amy Coghill, MSN, RN, OCN
• This study was supported by the grant from the Agency forHealthcare Research and Quality. The content is solely theresponsibility of the authors and does not necessarily represent theofficial views of the Agency for Healthcare Research and Quality.
Acknowledgment: Dr. Donald Spencer, Professor; Vice President andChief Medical Informatics Officer, UNC Health Care.
60
![Page 60: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/60.jpg)
Health IT and Patient SBuilding Safer Systems fo
afetyr Better Care
• Health IT can improve patient safety and quality of care and should be widely embraced (Bates 2003; Ash 2009).
• For example, Hill (2013) found that providers seeing (on average per hour) 2.4 patients require about 4,000 mouse-clicks in EHRs during a 10-hour shift.
• Reports focused on EHR-related medical malpractice identified over 80% of the reported events involve patient harm (Garber 2015).
61
![Page 61: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/61.jpg)
Workflow and communications 24% (high/variable workload)
Usability 33%
Actions 6%
Policies & procedures 6%
Harm
The Joint Commission Report on EHR-related errors (n=120)
A complimentary publication of The Joint Commission Issue 54, March 31, 2015 62
![Page 62: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/62.jpg)
Specific Aims
To quantify the effect of: • EMR environment (baseline/enhanced)• Volume (low/high) of abnormal test resultson providers’ experienced task demands, workload, and performance.
Our focus was on follow-up of abnormal test results, and the baseline and enhanced EMR environment used for the study was Epic®.
63
![Page 63: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/63.jpg)
Background and Significance
• Clinicians fail to acknowledge over one-third of the
EHR alerts for critically abnormal imaging studies
(Singh 2007).
• Even when providers acknowledge abnormal results,
7-10% of patients still do not receive timely follow-up (Singh 2009; Hysong 2010, 2011).
• The likelihood for lack of timely follow-up doubleswith dual-alert communication in which providers
receive abnormal results for other providers’ patients
(Zapka 2010).
64
![Page 64: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/64.jpg)
Human Factors Laboratory • VisionTrack ISCAN• Tobii X-60• SMI glasses• BrainVision • ABM EEG • NeXus
• Epic Playground• Mosaiq• PLUNC• Elekta Emulator
• Computers• Printers• Phones
65
![Page 65: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/65.jpg)
Study Participants
Total of 38 residentsfrom the school ofmedicine at one largeacademic institutionparticipated in thisstudy, all withsufficient experiencewith EHR (Epic) asrelated to oursimulated scenarios
Specialty # of Participants
Post Graduate Year (PGY) PGY: count
Gender F: female;M: Male
1:4 2:2 3:5 4:3
Internal Medicine 14 F:9 M:5
1:1 2:1 3:1 4:1
Family Medicine 4F:2 M:2
1:3 2:2 3:4 4:0
Pediatrics 9F:7 M:2
1:1 2:2 3:0 4:1 5:1
Surgery (general, neuro, ortho, head
& neck)5
F:3 M:2
1:1 2:1 3:1 4:2 5:1
Other (cardiology, psychiatry, critical care, ob/gyn)
6F:3 M:3
1:10 2:08 3:11 4:06 5:03
Total 38 F:24 M:14
66
![Page 66: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/66.jpg)
Study Design
Randomize
Providers(n=38)
Recognition of Abnormal
Results
Recognition of Abnormal
Results
Track & Follow-up on Planned
Diagnostic Evaluation
Session 1:Current Epic Environment
Session 2:Current (n=20) vs. Enhanced (n=18)
Epic Environment
Low vs. High volume of abnormal test results
67
![Page 67: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/67.jpg)
68
![Page 68: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/68.jpg)
69
![Page 69: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/69.jpg)
Planning Sheets
75 master patients; 12 reserved provider logins; 175 hours to plan, build, test (about 5 weeks)
70
![Page 70: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/70.jpg)
Current Epic Design
71
![Page 71: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/71.jpg)
Enhanced Epic Design
Singh H, Spitzmueller C, Petersen NJ, et al. Primary care practitioners' views on test result management in EHR-enabled health systems: a national survey. J Am Med Inform Assoc 2013;20:727-735. 72
![Page 72: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/72.jpg)
Data Collection
Experienced task demands:– navigation clicks (e.g., moving from one window
to another window on the screen, etc.),– decision clicks (e.g., accepting/cancelling a test or
medication, etc.),– search clicks (e.g., initiating the search option for
medications/orders/etc.),– total clicks (sum of navigation, decision, and
search clicks).
73
![Page 73: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/73.jpg)
Data Collection
Quantification of perceived workload • NASA-Task Load
Index (NASA-TLX), a widely applied and valid tool, was used to measure perceived workload.
74
![Page 74: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/74.jpg)
Data Collection
Quantification of physiological workload – eye tracking– electroencephalography [EEG]
75
![Page 75: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/75.jpg)
Data Collection
Quantification of physiological workload– eye tracking• Tobii X2-60, 60Hz remote eye tracker and Eyeworks
data recording software.
• baseline measures, task-evoked pupillary response(TEPR) and blink rate (Mosaly 2017).
– electroencephalography [EEG]• X-10 wireless EEG headset system from Advanced Brain
Monitoring (ABM)
• bi-polar sensor sites: Fz, F3, F4, Cz, C3, C4, POz, P3, P4.
76
![Page 76: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/76.jpg)
Data Collection
• Quantification of performance– unacknowledged abnormal test results (identified
by failure to order a referral, medication oradditional testing)
– unacknowledged patients with ‘no-show’ statusfor their scheduled appointments (identified byfailure to follow up with ‘no-show’ patients)
– total amount of time that participants took tocomplete each session.
77
![Page 77: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/77.jpg)
Data Analysis
• Multivariable analysis of variance– Pooled data (all results combined)
– Abnormal vs. ‘no-show’
• Participants as a random factor.
• All our data analyses were conducted using JMP 13software with significance level set at 0.05(normality: all p>0.05; equal variance: all p>0.05;suitable for parametric analysis).
78
![Page 78: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/78.jpg)
Results – Task Demands - Pooled data
• High-volume of abnormal test results generatedsignificantly more total clicks when compared to thelow-volume of abnormal test results condition(p<.01).
Current-EMR(Low-volume)
Current-EMR(High-volume)
Task Demands (average per scenario)
Enhanced -EMR(Low-volume)
Enhanced-EMR(High-volume)
390(91) 496(110) Total Clicks (count) † 396(83) 479(118)
223(73) 276(76) Navigation Clicks (count) 239(75) 286(78)
120(22) 155(29) Decision Clicks (count) 106(25) 124(47)
46(17) 63(14) Search Clicks (count) 51(18) 69(24)
79
![Page 79: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/79.jpg)
Results – Task Demands - Abnormal vs. No-show
Current-EMR(Abnormal)
Current-EMR(No-Show)
Task Demands(average per result)
Enhanced -EMR(Abnormal)
Enhanced-EMR(No-Show)
33(11) 28 (12) Total Clicks (count) † 31(12) 21(9)
17(7) 15(7) Navigation Clicks (count) † 16(6) 11(5)
5(2) 4(2) Decision Clicks (count) 5(3) 3(2)
11(4) 9(5) Search Clicks (count) † 9(2) 6(4)
• Enhanced-EMR, specifically for patients with
‘no-show’ status, indicated lower task demands
as quantified by total, navigation, and search
clicks (p<.01).
80
![Page 80: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/80.jpg)
Results – Subjective Workload- Pooled data
• Analysis of NASA-TLX scores indicated no significant differences (p>.05).
• NASA-TLX > 55 are associated with degradation in performance (Hart, 2006; Mazur, 2013, 2016).
Current-EMR(Low-volume)
Current-EMR(High-volume) NASA-TLX Enhanced -EMR
(Low-volume)Enhanced-EMR(High-volume)
48(15) 58(13) NASA-TLX (0=low to 100=high) 49(18) 49(13)
81
![Page 81: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/81.jpg)
• On average, human eye blinks 20-25/minute.• Blink rate was significantly lower in the current-EMR
(p=.01), suggesting higher mental workload (Mosaly2017).
Current-EMR(Low-volume)
Current-EMR(High-volume) Physiological Workload Enhanced -EMR
(Low-volume)Enhanced-EMR(High-volume)
15(9) 17(7) Blink Rate (blinks/minute) 24(10) 22(6)
Results – Physiological Workload- Pooled data
82
![Page 82: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/82.jpg)
Results – Physiological Workload- Abnormal vs. No-show
• Blink rate was significantly lower in the current-EMR, specifically for ‘no-show’ (p<.01) patients, suggesting higher mental workload.
• Power of Fz (6-7Hz) – Pz (8-10 Hz) was significantly less in enhanced-EMR, specifically for ‘no-show’ patients (p=.02), suggesting ‘less optimal’ information processing efficiency (Klimesh, 1999).
Current-EMR(Abnormal)
Current-EMR(No-show) Physiological Workload Enhanced-EMR
(Abnormal)Enhanced-EMR
(No-show)
18(9) 18(9) Blink Rate (blinks/minute) † 19(9) 24(11)
0.8(0.4) 0.7(0.4) Power of Fz (6-7 Hz) - Pz (8-10 Hz) (!"#)† 0.9(0.6) 0.9(0.7)
83
![Page 83: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/83.jpg)
Results – Performance
• Significant improvement in performance in the enhanced-EMR (p<.01).• Significant longer time to complete scenarios in the high-volume of abnormal
test results condition (p<.01).• Significant less time to process patients with abnormal test results in the
enhanced-EMR (p<.01), specifically with no-show status (p<.01).
Current-EMR(Low-volume)
Current-EMR(High-volume)
Enhanced -EMR(Low-volume)
Enhanced-EMR(High-volume)Performance
Clinical Performance†-missed abnormal results
-missed to follow-up on ‘no-shows’2
156
170 2
1 4
26:12(7:48) 37:18(10:24) Time-to-complete (min) † 28:54(6:12) 34:12(12:06)
Abnormal results only:Time to Scenario Completion (min:sec) †2:20(0:58) 2:42(1:00) 2:25(0:49) 2:30(1:12)
‘No-show’ results only:Time to Scenario Completion (min:sec) †1:48(0:36) 2:06(1:13) 1:36(0:48) 1:25(0:46)
84
![Page 84: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/84.jpg)
Reducing Provider’s Burden- Abnormal & No-Show
(n = results)Performance
(total # of errors)Task
Demand(total clicks)
Average Time to Complete a Result
(min:sec)
Enhanced EMR(n=189) 0 23 1:51
Current EMR(n=210) 0 32 2:27
+9 clicks+36 sec
Given 50 results per interaction: 450 clicks and 30 min!
85
![Page 85: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/85.jpg)
Conclusions
• Need to ‘optimally’ design features of the EMR to focus providers attention on:– i) abnormal test results– ii) patients’ status, both with enough detail to facilitate (or
not facilitate) appropriate follow-up communications.
• Develop and publicize policies and guidelines regarding work practices and demands to ensure appropriate levels of workload and performance.
• Innovative education/training requirements (e.g., simulation based training vs. traditional training) and performance feedback systems could be organized and implemented (Mazur 2017).
http://www.ihi.org/resources/Pages/Publications/Closing-the-Loop-A-Guide-to-Safer-Ambulatory-Referrals.aspx 86
![Page 86: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/86.jpg)
87
![Page 87: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/87.jpg)
Limitations
• One experiment with relatively small number of participants from one teaching hospital, performed on set of scenarios.
• Time between simulated sessions varied from 1 to 3 weeks, which could have unexpectedly bias the study due to some carryover effects between sessions.
• Day and time of the day to conduct assessments varied, which could have also affected the results.
• Simulated environment, where the subjects knew that their work was going to be assessed, may have affected participants’ performance.
• Reporting workload via NASA-TLX is subjective and can be challenging for some participants.
• Quantification methods of physiological workload, while validated and broadly used, may not fully considered potential confounding factors streaming from cognitive information processing or general cognitive states.
88
![Page 88: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/88.jpg)
Contact Information
Lukasz Mazur, PhDDivision of Healthcare Engineering
University of North Carolina, Chapel [email protected]
89
![Page 89: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/89.jpg)
Questions
![Page 90: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/90.jpg)
How to Submit a Question
• At any time during the presentation, type your question into the “Q&A” section of your WebEx Q&A panel.
• Please address your questions to “All Panelists” in the drop-down menu.
• Select “Send” to submit your question to the moderator.
• Questions will be read aloud by the moderator.
91
![Page 91: A National Web Conference on Reducing Provider Burden ......presentation, type your ... design requirements that support collaborative VTE prophylaxis teamwork. ... During clinical](https://reader036.fdocuments.in/reader036/viewer/2022071115/5ffb942231384162371a4f40/html5/thumbnails/91.jpg)
92
Obtaining CME/CE Credits
If you would like to receive continuing education credit for this activity, please visit:
https://ahrq.cds.pesgce.com