Decreasing the Variability in Turnaround Time for · PDF file · 2013-01-07treat...
-
Upload
truonglien -
Category
Documents
-
view
219 -
download
3
Transcript of Decreasing the Variability in Turnaround Time for · PDF file · 2013-01-07treat...
Problem:•BetweenJanuaryandAugustof2011thereweremultiplecomplaintsfromtheEmergencyDepartment(ED)regardingtheturnaroundtime(TAT)forradiologyreports.•ReviewofthepreliminarydatashowedthatthemeanTATwasexcellent;however,therewasconsiderableday-to-dayvariabilityintheTAT,especiallyafternormalbusinesshours.•ThepurposeofthisprojectwastodecreasethevariabilityinTATforradiographystudiesfromtheED,andevaluateifareductioninvariationwouldimprovepatientthroughputintheED.
Specific Aim:•ThegoalofthisprojectwastoincreasethepercentageofEDradiographswithaTATof35minutesorlessfrom82%togreaterthan90%byJanuary13,2012.
Methods:•Aninterdepartmentalimprovementteamwasassembledwithmembersfromtheradiologydepartment,thedivisionofemergencymedicine,andtheJamesM.AndersonCenterforHealthSystemsExcellence.•Theteamfirstdeterminedthegoalanddefinedthemetric*Overallgoal:tohaveafinalreportforradiographsavailablewithin1hourofwhenthestudywasordered»Meantimefromordertoimagewasmeasuredtobe25minutesonaverage»Thislefttheradiologistwith35minutestointerpretanddictatethestudy
*Definingthemetrics»Primarymetric–thepercentageofEDradiographswithaTATof35minutesorlesswasdefinedastheprimarymetricinordertofocusondecreasingvariabilityratherthanoverallTAT.»TAT–thetimewhenthestudyiscompletedbythetechnologistintheradiologyinformationsystemtothetimewhenthereportisfinalizedbythestaffradiologist
•ReasonstofocusonEDradiographs*TheydisproportionallyaffecttheoverallTATforEDpatients–85%ofallradiologystudiesperformedonpatientsfromtheEDareradiographs*HasthelargestimpactonEDpatientthroughputasarapidTATwouldallowtheEDstafftoquicklytreatanddischargetheloweracuitypatientsthatmakeupalargepercentageoftheEDcensus.*TATforEDradiographsprovidesareasonablereal-timemeasureofhowwellthedepartmentiskeepingupwithoveralldemand
•Theteamthencreatedaprocessmaptodescribetheradiologist’sreadingworkflowaswellasamodifiedfailuremodeandeffectsanalysis(Fig.1)inordertodeterminepotentialareasforimprovement.
Interventions:•Finally,theteamdesignedseveralinterventions*Increaseawarenessofproblem
»Emailtostafffromchairdescribingproblem»Presentationatfacultymeetingdescribingproblem
*Directfeedbacktofaculty»DailyTATreport»DailyTATreportwithcomparativedata(Fig2)Increasestaffing»Doublecovercallshifts
*Efficiencytraining»Emailtipstoimproveefficiency»One-on-onetrainingteachingtipstoimproveefficiency
•ThedailyTATreportwithcomparativedatawasthemainintervention.
FAIL
URE
MO
DES
IN
TERV
ENTI
ON
S CU
RREN
T
PRO
CESS
1. Default status to ASAP for all patients in the ED
2. ALL PACS worklists display order status
1. Reading room assistants
2. Trainee coverage
3. Evaluate staffing
1.Workflow analysis
2.Coach less efficient radiologists
3.QC tech
4.Reading room assistants
1. Notification of incomplete status
1. On wrong service in PACS
2. Not identified as ED
3. Wrong patient
4. Wrong study
5. Not performed
6. Not completed in RIS
1. Ordered incorrectly
2. Patient not in ED at time the order is placed
3. Order not placed using Stat or ASAP status
4. PACS worklist does not display order status
1. Interruption in reading room
2. MD away (Fluoro, US)
3. Multiple studies on worklist / not enough radiologists
4. PACS down
1. Efficiency of radiologist
2. QC issue
3. Interruption
4. Knowledge/ look-up
5. Incomplete study
6. Consult another radiologist
1. Not completed in RIS
2. Dictation system down
3. Wrong order
1. ED patients default to ASAP status
2. Redundant worklists
3. Unread study worklist in PACS
Study on PACS
Identify ED Study
Open Study
Interpret study
Dictate Study
1. Reading room assistants
2. Notification that dictation is waiting
1. Wait for call back
2. Hit wrong button
3. Not in dictation queue (trainee)
Sign Report
Figure 1:
Modified failure mode effects analysis diagram showing the process (black boxes) required to interpret and dictate a radiograph from the emergency department. The failure modes listed in the red boxes show the potential reasons an individual step could fail. The interventions listed in the green boxes show all of the interventions that have been implemented or could be implemented to ensure that a failure does not occur. The interventions listed in red text are the interventions that were considered in this improvement project.
0
5
10
15
20
25
30
35
40
12/7
/201
1 21
:52
12/7
/201
1 21
:52
12/7
/201
1 21
:49
12/7
/201
1 21
:33
12/7
/201
1 21
:05
12/7
/201
1 20
:54
12/7
/201
1 20
:51
12/7
/201
1 20
:38
12/7
/201
1 20
:34
12/7
/201
1 20
:23
12/7
/201
1 20
:21
12/7
/201
1 20
:12
12/7
/201
1 20
:09
12/7
/201
1 20
:08
12/7
/201
1 20
:05
12/7
/201
1 20
:03
12/7
/201
1 20
:03
12/7
/201
1 20
:03
12/7
/201
1 20
:01
12/7
/201
1 20
:01
12/7
/201
1 20
:01
12/7
/201
1 20
:01
12/7
/201
1 19
:50
12/7
/201
1 19
:45
12/7
/201
1 19
:27
12/7
/201
1 19
:20
12/7
/201
1 19
:04
12/7
/201
1 18
:58
12/7
/201
1 18
:57
12/7
/201
1 18
:56
12/7
/201
1 18
:55
12/7
/201
1 18
:54
12/7
/201
1 18
:54
12/7
/201
1 18
:54
12/7
/201
1 18
:50
12/7
/201
1 18
:45
12/7
/201
1 18
:37
12/7
/201
1 18
:37
12/7
/201
1 18
:37
12/7
/201
1 18
:32
12/7
/201
1 18
:29
12/7
/201
1 18
:25
12/7
/201
1 18
:25
12/7
/201
1 18
:25
12/7
/201
1 17
:58
12/7
/201
1 17
:50
12/7
/201
1 17
:36
12/7
/201
1 17
:29
12/7
/201
1 17
:15
TAT
Time of Day
TAT for ED Radiographs
Radiograph Median Goal (35)
Radiologist X 12/7 n=49; mean 6.8; Median 6; 100% < 35 min
Daily TAT report for 12/7/2011. a) This email report is sent to the radiologist the day after he or she is on call. It tells the radiologist how he or she performed and how he or she compares to their peers. In addition, a chart showing the TAT for each radiograph is attached (b). On the chart, the x-axis shows the time the study was completed in the radiology information system and the y-axis shows the TAT. The blue point represents the TAT for one ED radiograph. The red line represents the median TAT for the call shift and the green line is the target of 35 minutes. Each radiologist is provided with the number of studies he or she read (n), their mean TAT, median TAT, and percent of studies read in 35 minutes or less.
9/19 Begin Daily TAT reports
10/3 Begin overnight
TAT reports
Dual Coverage
10/25 Begin Comparison
data
11/10 Share data with faculty
11/23 Begin Overnight
Comparison
12/21 Discussion with Rad Z
30.0
40.0
50.0
60.0
70.0
80.0
90.0
100.0
07/0
1/11
(n=1
09)
07/0
8/11
(n=0
87)
07/1
5/11
(n=0
79)
07/2
2/11
(n=0
76)
07/2
9/11
(n=0
94)
08/0
5/11
(n=0
78)
08/1
2/11
(n=0
87)
08/1
9/11
(n=1
18)
08/2
6/11
(n=1
07)
09/0
2/11
(n=0
82)
09/0
9/11
(n=1
14)
09/1
6/11
(n=1
14)
09/2
3/11
(n=1
31)
09/3
0/11
(n=1
20)
10/0
7/11
(n=1
34)
10/1
4/11
(n=0
95)
10/2
1/11
(n=0
85)
10/2
8/11
(n=1
03)
11/0
4/11
(n=1
09)
11/1
1/11
(n=0
86)
11/1
8/11
(n=0
94)
11/2
5/11
(n=0
95)
12/0
2/11
(n=0
84)
12/0
9/11
(n=0
97)
12/1
6/11
(n=0
85)
12/2
3/11
(n=0
78)
12/3
0/11
(n=0
73)
01/0
6/12
(n=0
99)
01/1
3/12
(n=0
96)
Perc
ent
Date
Daily Percentages Average % of radiographs with a TAT <35 minutes Control Limits
Figure 3:
Annotated p-chart showing the daily percentage (blue points) of ED radiographs read within 35 minutes. The mean percentage of radiographs read with a TAT within 35 minutes is represented by the solid red line. The annotations (yellow boxes) describe the dates of different interventions. Note that the mean shifted downward in mid-to-late December. This occurred primarily because a radiologist on the overnight call shift was batch reading exams. After discussing the downsides of this process with the radiologist on 12/21/2011, the radiologist’s practice changed and the mean percentage of radiographs with a TAT within 35 minutes improved again.
Decreasing the Variability in Turnaround Time for Radiography Studies from the Emergency DepartmentAlexander J Towbin, MD1, Srikant B Iyer, MD, MPH2,3, James Brown, MS3, Kartik Varadarajan, PhD3, Laurie A Perry, RN1, David B Larson, MD, MBA1
Cincinnati Children’s Hospital Medical Center, 1Department of Radiology,
2Division of Emergency Medicine,
3James M. Anderson Center for Health Systems Excellence
Results:•Baseline*80daysbetweenJuly1,2011,andSeptember19,2011*8,602EDradiographsperformed*MeanTATwas23.9minutes*MedianTATwas15minutes.*7,073or82.2%ofallEDradiographswerereadwithaTATof35minutesorless*StandarddeviationforTATwas22.8minutes
•Afterimplementation*89daysbetweenOctober17,2011,andJanuary13,2012*8,913EDradiographsperformed*MeanTATimprovedto14.6minutes(p<0.01)*MedianTATimprovedto10minutes(p<0.01)*8,283or92.9%(p<0.01)ofallEDradiographswerereadwithaTATof35minutesorless(Fig3)*StandarddeviationforTATwas12.7minutes(Fig4)
•Additionalbenefits*DailyTATreportshelpedtoidentifyreadingpracticesthatnegativelyaffectedTAT(Fig5)
•Balancemeasures*Percentageofstudiesreadbytrainees
»Baseline:62%»Afterintervention:59.9%
*TATfornon-EDRadiographs»Baseline:65minutes»Afterintervention:46minutes(p<0.01)
*TATforallimagingstudies»Baseline:102minutes»Afterintervention:78minutes(p<0.01)
•EffectonEDDoctodispositiontime*Baseline:88.7minutes*Afterintervention:79.8minutes
Conclusion:•AsthedepartmentalTATfallsunder25minutes,furtherimprovementispossible.*InordertocontinuetoimprovetheTAT,technologicinterventionsarenotenough.*Inthepast,wehaveimprovedtheTATthroughworkflowdesign,readingroomenhancements,andstandardizing/structuredreporting.*Inordertocontinuetoimprove,weworkedtodecreaseprovidervariability.
•WeweresuccessfulindecreasingtheaverageTATforEDradiographsaswellasthevariability,asmanifestedby:*DecreaseinmeanTATfrom23.8to14.6minutes*IncreaseinthepercentageofEDradiographswithaTATofwithin35minutesfrom82.2%to92.9%*DecreaseinthestandarddeviationforTATfrom22.8to12.7minutes.
•TheimprovementsinradiologyTAThadadirecteffectontheoverallEDpatientexperience*DecreaseinEDDoctodispositiontimefrom88.7to79.8minutes
•Overallimprovementsaccomplishedthroughincreasedtransparency,feedback,andindividualcoachinginasettingwhereworkflowandelectronicsystemshadalreadybeenredesignedtooptimizeTAT.
0
10
20
30
40
50
60
70
80
90
100
10/1
0/20
11 5
:05
10/1
0/20
11 3
:34
10/1
0/20
11 3
:34
10/1
0/20
11 2
:38
10/1
0/20
11 2
:34
10/1
0/20
11 1
:40
10/1
0/20
11 1
:30
10/1
0/20
11 1
:25
10/1
0/20
11 1
:25
10/1
0/20
11 1
:19
10/1
0/20
11 0
:32
10/1
0/20
11 0
:24
10/1
0/20
11 0
:21
10/1
0/20
11 0
:16
10/1
0/20
11 0
:14
10/1
0/20
11 0
:06
10/9
/201
1 23
:59
10/9
/201
1 23
:50
10/9
/201
1 23
:44
10/9
/201
1 23
:29
10/9
/201
1 23
:10
10/9
/201
1 23
:10
10/9
/201
1 23
:10
10/9
/201
1 23
:10
10/9
/201
1 22
:56
10/9
/201
1 22
:44
10/9
/201
1 22
:28
10/9
/201
1 22
:16
10/9
/201
1 22
:06
10/9
/201
1 22
:04
10/9
/201
1 22
:04
10/9
/201
1 22
:02
10/9
/201
1 21
:58
10/9
/201
1 21
:54
10/9
/201
1 21
:53
10/9
/201
1 21
:33
TAT
Time of Day
TAT for ED Radiographs
Radiograph Median Goal (35)
Radiologist Y 10/9 – 10/10 n=36; mean 48; Median 50; 30.5% < 35 min
Figure 5:
Daily TAT report for the overnight call shift between October 9 and October 10, 2011. This report shows a batch reading pattern. In this example, the radiologist waited long periods of time between signing reports. As the radiologist signed a group of reports, the TAT became shorter for reports in the queue. Once the radiologist caught up, he or she then waited for another batch of reports. This is shown by the sudden jump in TAT.
0.0
10.0
20.0
30.0
40.0
50.0
60.0
70.0
80.0
90.0
100.0
7/1/
11
7/8/
11
7/15
/11
7/22
/11
7/29
/11
8/5/
11
8/12
/11
8/19
/11
8/26
/11
9/2/
11
9/9/
11
9/16
/11
9/23
/11
9/30
/11
10/7
/11
10/1
4/11
10/2
1/11
10/2
8/11
11/4
/11
11/1
1/11
11/1
8/11
11/2
5/11
12/2
/11
12/9
/11
12/1
6/11
12/2
3/11
12/3
0/11
1/6/
12
1/13
/12
Stan
dard
Dev
iatio
n
Date
Standard deviation of the average daily TAT Mean Control Limits
0.0
10.0
20.0
30.0
40.0
50.0
60.0
70.0
80.0
7/1/
11
7/8/
11
7/15
/11
7/22
/11
7/29
/11
8/5/
11
8/12
/11
8/19
/11
8/26
/11
9/2/
11
9/9/
11
9/16
/11
9/23
/11
9/30
/11
10/7
/11
10/1
4/11
10/2
1/11
10/2
8/11
11/4
/11
11/1
1/11
11/1
8/11
11/2
5/11
12/2
/11
12/9
/11
12/1
6/11
12/2
3/11
12/3
0/11
1/6/
12
1/13
/12
Mea
n Tu
rnar
ound
Tim
e (m
inut
es)
Date
Average daily TAT for ED radiographs Mean Control Limits
X-Bar (a) and S-Bar (b) charts showing the daily mean (X-bar) and daily mean standard deviation (S-bar) for the TAT for radiographs from the emergency department. On each chart, the points represent either the daily mean (x-bar) or mean standard deviation (s). The solid red line represents the average mean TAT or the average mean standard deviation for the TAT.
Figure 4A: Figure 4B:
Figure 2A: Figure 2B:
Methods of analysis:•Statisticalprocesscontrol*ObtainedTATvaluesforeveryEDradiographperformedovereach24-hourcalendarday*ThepercentofEDradiographswithaTATof35minutesorlesswascalculatedforeachdayandchartedonap-chart.*X-barandS-barchartswereusedtomeasurethechangeinthevariabilityoftheTATforEDradiographs.*InordertomeasureifthechangesinradiologyhadaneffectonpatientflowintheED,thetimefromwhentheEDstafffirstmetwiththepatienttothetimeafinaltreatmentdecisionwasmade(“doctodisposition”time)wasmeasuredandchartedonx-barands-charts.*Statisticalsignificanceforallprocesscontrolchartswasdeterminedusingtheacceptedrulesforidentifyingspecialcausevariation.
•Statisticalanalysis*Two-tailedt-testforindependentvariablestocomparemeans*Wilcoxonranksumtocomparemedians*Twosamplet-testtocomparepercentages.