IIIG LTMS V2 Review. LTMS V2 Review Data Summary: – Includes 285 Chartable reference oil results...
41
IIIG LTMS V2 Review
-
Upload
tamia-brisley -
Category
Documents
-
view
213 -
download
0
Transcript of IIIG LTMS V2 Review. LTMS V2 Review Data Summary: – Includes 285 Chartable reference oil results...
IIIG LTMS V2 Review
LTMS V2 Review
• Data Summary:– Includes 285 Chartable reference oil results from
all test laboratories – Most recent chartable reference oil result
included in data set is March 22, 2010– Includes all ACLW data that is currently exhibiting
a mild trend– WPD and PVIS defined as “Primary Parameters”– ACLW defined as “Secondary Parameters”
LTMS V2 Review
• Proposed Limits for IIIG LTMS v2 example:– Limits for ei & zi:
Shewhart Chart of Prediction Error ei = Yi – Zi-1
Limit Type Limit*
Level 3 2.066
Level 2 1.734
Level 1 1.351
EWMA of Standardized Test Result Zi = λ(Yi) + (1 – λ)Zi-1
Limit Type λ LimitLevel 2
Upper Limit0.2
TBD by SP Input
Level 2Lower Limit
0.2
TBD by SP Input
Level 10.2 0
• IIIG calibration attempt summary:– Of the 289 total, 73.3% acceptable, 17.3% failed
acceptance, and 9.4% were invalid
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Acceptable (AC) Failed Accept (OC) Lab Invalid (LC)
Pe
rce
nta
ge
Fate of IIIG Calibration AttemptsAccording to TMC Semi-Annual Reports
• IIIG Alarm Summary (all labs & chartable results):– Below summarizes the unacceptable, reduced, and
extended reference interval count for LTMS v1 & v2.
0
5
10
15
20
25
30
35
40
45
50
55
60
PVIS ACLW WPD Overall
Nu
mb
er
of
Pa
ram
ete
r A
larm
s
IIIG Test Parameter
LTMS Alarms in the Sequence IIIG Parameters - Based on Chartable Tests Only
Unacceptable Current
Unacceptable New
Reduced Interval Current
Reduced Interval New
Extension 40% New
Extension 20% New
• IIIG Alarm Summary (all labs & chartable results):– Below summarizes the unacceptable, reduced, and extended
reference interval percentage for LTMS v1 & v2.
0%
1%
2%
3%
4%
5%
6%
7%
8%
9%
10%
11%
12%
13%
14%
15%
16%
17%
18%
19%
20%
21%
22%
23%
24%
PVIS ACLW WPD Overall
Nu
mb
er
of
Pa
ram
ete
r A
larm
s
IIIG Test Parameter
LTMS Alarm Percentage in the Sequence IIIG Parameters - Based on Chartable Tests Only
Unacceptable Current
Unacceptable New
Reduced Interval Current
Reduced Interval New
Extension 40% New
Extension 20% New
• IIIG Alarm Summary (by lab):– Below summarizes the unacceptable, reduced, and
extended reference interval count for LTMS v1 & v2 by test lab (285 Chartable test results).
0
5
10
15
20
25
30
35
40
45
50
55
60
A B D E F G All Labs
Nu
mb
er
of
Te
st A
larm
s
Test Lab
LTMS Alarms in the Sequence IIIG Test Based on Chartable Tests Only
Unacceptable Current Unacceptable New Reduced Interval Current
Reduced Interval New Extension 40% New Extension 20% New
• IIIG RMSE for the PVIS parameter:– RMSE calculation is a function of the average deviation
from the target and within lab variation.
0.0
0.5
1.0
1.5
2.0
2.5
A B D E F G All Labs
Av
era
ge
PV
IS R
MS
E
Test Lab
Candidate Oil Test Result Target Variability in the Sequence IIIGBased on All Chartable Tests
Current System New System
• IIIG Relative Pass limit of a Candidate test for the PVIS parameter:
125
130
135
140
145
150
155
160
A B D E F G
Av
era
ge
PV
IS
Test Lab
Average Relative Candidate Test Result in the Sequence IIIGBased on All Chartable Tests
Current System New System
• IIIG RMSE for the WPD parameter:– RMSE calculation is a function of the average deviation
from the target and within lab variation.
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
1.1
1.2
1.3
1.4
1.5
1.6
A B D E F G All Labs
WP
D R
MS
E
Test Lab
Candidate Oil Test Result Target Variability in the Sequence IIIGBased on All Chartable Tests
Current System New System
• IIIG Relative Pass limit of a Candidate test for the WPD parameter (with a [GF-4] 3.5 limit):
2.50
2.75
3.00
3.25
3.50
3.75
A B D E F G
WP
D
Test Lab
Average Relative Candidate Test Result in the Sequence IIIGBased on All Chartable Tests
Current System New System
• IIIG RMSE for the ACLW parameter:– RMSE calculation is a function of the average deviation
from target and within lab variation.
0.0
0.2
0.4
0.6
0.8
1.0
1.2
1.4
1.6
1.8
2.0
A B D E F G All Labs
Ave
rag
e C
am &
Lif
ter
Wea
r R
MS
E
Test Lab
Candidate Oil Test Result Target Variability in the Sequence IIIGBased on All Chartable Tests
Current System New System
• IIIG Relative Pass limit of a Candidate test for the ACLW parameter:
52
53
54
55
56
57
58
59
60
61
A B D E F G
Av
era
ge
Ca
m &
Lif
ter
We
ar
Test Lab
Average Relative Candidate Test Result in the Sequence IIIGBased on All Chartable Tests
Current System New System
• Undue Influence example for TPVIS (ei) data– Plot of ei data with no Undue Influence adjustment
-3
-2
-1
0
1
2
3
4
5
6
7
8
0 5 10 15 20 25 30 35 40 45 50 55 60 65
e i R
esul
t
Observation Number
TPVIS (ei) Chart Example (Chartable Lab Data, exclusively)
Level 2 LL Level 2 UL Level 3 LL Level3 UL TPVIS ei (Lab:A)
TPVIS ei (Lab:B) TPVIS ei (Lab:D) TPVIS ei (Lab:E) TPVIS ei (Lab:F) TPVIS ei (Lab:G)
• Undue Influence example for TPVIS (ei) data– Circled results with “capped” adjustment (at +2.066 limit)
• Result adjusted if |Yi – Zi-1| > 2.066 and |Yi – Yi+1| > 2.066
-3
-2
-1
0
1
2
3
0 5 10 15 20 25 30 35 40 45 50 55 60 65
e i R
esul
t
Observation Number
TPVIS (ei) Chart Example (Chartable Lab Data, exclusively)
Level 2 LL Level 2 UL Level 3 LL Level3 UL TPVIS ei (Lab:A)
TPVIS ei (Lab:B) TPVIS ei (Lab:D) TPVIS ei (Lab:E) TPVIS ei (Lab:F) TPVIS ei (Lab:G)
• Undue Influence “Capped” Result Summary– (285 Total Chartable results)
0
2
4
6
8
10
12
14
16
18
20
22
24
26
A B D E F G All Labs
Und
ue In
fluen
ce F
requ
ency
(O
bser
vatio
ns C
appe
d)
Test Lab
Undue Influence - Frequency Chart
PVIS UI Count ACLW UI Count WPD UI Count
AppendixLTMS V2 Charts By Test Lab
Lab A
0
50
100
150
200
250
1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52 55 58
PV
IS
Time
Effective Pass Limit Given Severity Adjustment for Lab A
Old System
New System
0
0.5
1
1.5
2
2.5
3
3.5
4
4.5
1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52 55 58
WP
D
Time
Effective Pass Limit Given Severity Adjustment for Lab A
Old System
New System
0
10
20
30
40
50
60
70
80
90
100
1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52 55 58
AC
LW
Time
Effective Pass Limit Given Severity Adjustment for Lab A
Old System
New System
Lab B
0
50
100
150
200
250
1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55
PV
IS
Time
Effective Pass Limit Given Severity Adjustment for Lab B
Old System
New System
0
0.5
1
1.5
2
2.5
3
3.5
4
4.5
1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55
WP
D
Time
Effective Pass Limit Given Severity Adjustment for Lab B
Old System
New System
0
10
20
30
40
50
60
70
80
90
100
1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55
AC
LW
Time
Effective Pass Limit Given Severity Adjustment for Lab B
Old System
New System
Lab D
0
0.5
1
1.5
2
2.5
3
3.5
4
4.5
1 4 7 10 13 16 19 22 25 28 31 34
WP
D
Time
Effective Pass Limit Given Severity Adjustment for Lab D
Old System
New System
0
50
100
150
200
250
1 4 7 10 13 16 19 22 25 28 31 34
PV
IS
Time
Effective Pass Limit Given Severity Adjustment for Lab D
Old System
New System
0
10
20
30
40
50
60
70
80
90
100
1 4 7 10 13 16 19 22 25 28 31 34
AC
LW
Time
Effective Pass Limit Given Severity Adjustment for Lab D
Old System
New System
Lab E
0
50
100
150
200
250
1 4 7 10 13 16
PV
IS
Time
Effective Pass Limit Given Severity Adjustment for Lab E
Old System
New System
0
0.5
1
1.5
2
2.5
3
3.5
4
4.5
1 4 7 10 13 16
WP
D
Time
Effective Pass Limit Given Severity Adjustment for Lab E
Old System
New System
0
10
20
30
40
50
60
70
80
90
100
1 4 7 10 13 16
AC
LW
Time
Effective Pass Limit Given Severity Adjustment for Lab E
Old System
New System
Lab F
0
50
100
150
200
250
1 4 7 10 13 16 19 22 25 28 31 34
PV
IS
Time
Effective Pass Limit Given Severity Adjustment for Lab F
Old System
New System
0
0.5
1
1.5
2
2.5
3
3.5
4
4.5
1 4 7 10 13 16 19 22 25 28 31 34
WP
D
Time
Effective Pass Limit Given Severity Adjustment for Lab F
Old System
New System
0
0.5
1
1.5
2
2.5
3
3.5
4
4.5
1 4 7 10 13 16 19 22 25 28 31 34
WP
D
Time
Effective Pass Limit Given Severity Adjustment for Lab F
Old System
New System
Lab G
0
50
100
150
200
250
1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52 55 58 61 64 67 70 73 76 79 82
PV
IS
Time
Effective Pass Limit Given Severity Adjustment for Lab G
Old System
New System
0
0.5
1
1.5
2
2.5
3
3.5
4
1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52 55 58 61 64 67 70 73 76 79 82
RC
S
Time
Effective Pass Limit Given Severity Adjustment for Lab G
Old System
New System
0
10
20
30
40
50
60
70
80
90
100
1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52 55 58 61 64 67 70 73 76 79 82
AC
LW
Time
Effective Pass Limit Given Severity Adjustment for Lab G
Old System
New System
