DOT&E Scorecard: Wins & Losses, Post-game Report [email protected].
23
-
Upload
cameron-king -
Category
Documents
-
view
221 -
download
0
Transcript of DOT&E Scorecard: Wins & Losses, Post-game Report [email protected].
Scorecard
• Wins?
• Losses?
• Post-Game?
• Whose Scorecard? – We give scores – We get scored
Visitor: Date: Start Time: Weather: Home: Scorer: End Time: Time of Game:
# Line Up Pos 1 2 3 4 5 6 7 8 9 10 AB R H RBI
S RunsU HitsM ErrorsS Left on Base
# Opposing Pitchers W/L/S IP H R ER BB SO HB BK TBF
# Catchers PB UmpiresHP: 3B:1B:2B:
Who
What
I don’t know
Why
3
4
7
5
The scores we giveThe scores we giveThe scores we give
3-Dec-84 TOMAHAWK (TASM & TLAM-N) yes yes yes Mr. Weinberger27-Dec-84 M1A1 Abrams Tank yes yes yes Mr. Weinberger4-Mar-85 Standard Missile Block II yes yes yes BG Hall
24-Aug-85 Sergeant York (DIVAD) yes no no Mr. Krings30-Sep-85 OH-58D Army Helicopter Improvement Program yes yes (-) yes (-) Mr. Krings7-Oct-85 AV-8B Harrier yes yes yes Mr. Krings4-Dec-85 TOMAHAWK (TLAM-C) yes yes yes Mr. Krings12-Mar-86 E-6A TACAMO Operational Assessment yes potential potential Mr. Krings19-Mar-86 AEGIS/CG-47 Class Cruiser yes yes yes Mr. Krings16-Apr-86 AGM-65D Infrared Maverick FOT&E yes yes yes Mr. Krings17-Sep-86 Arleigh Burke (DDG51) OA yes yes yes Mr. Krings30-Oct-86 Tactical Army Combat Service Support Computer System yes yes yes Mr. Krings24-Nov-86 Low Altitude Navigation & Targeting Infrared System no yes yes Mr. Krings12-Jun-87 Landing Craft Air Cushion yes yes yes Mr. Krings25-Jun-87 ELF Commo System yes yes yes Mr. Krings24-Aug-87 S-3A Weapon System Improvement Program (S-3B) no potential no Mr. Krings6-Oct-87 TRIDENT II (D-5) Strategic Weapons System OA yes low risk low risk Mr. Krings1-Dec-87 Bradley (follow-up OA) yes potential potential Mr. Krings1-Apr-88 CV Inner-Zone ASW Helo SH-60F yes potential potential Mr. Krings
11-May-88 MH-53E Helicopter yes marginal no Mr. Krings13-Jun-88 S-3A Weapon System Improvement Program (S-3B) yes yes yes(-) Mr. Krings30-Aug-88 Bigeye Interim Report no potential potential Mr. Krings9-Sep-88 OH-58D AHIP Scout/Recon yes yes not tested Mr. Krings
15-Nov-88 Secure Telephone Unit (STU III) yes marginal marginal Mr. Krings5-Dec-88 Mobile Subscriber Equipment FOT&E yes yes yes Mr. Krings8-Dec-88 MK48 Advanced Capability Torpedo yes no yes Mr. Krings
14-Dec-88 M9 ACE yes yes marginal Mr. Krings19-Dec-88 Low Altitude Navigation & Targeting Infrared System yes yes yes Mr. Krings1-Jan-89 MK-48 ADCAP Torpedo yes yes1-Feb-89 Phoenix (AIM-54C) yes yes
25-Apr-89 AN/SQS-53C Sonar System yes yes(-) yes Mr. Krings24-May-89 M939A2 5-Ton Truck yes yes yes Mr. Krings1-Jul-89 ASPJ OA LRIP Memo for USD(A) yes potential + potential - Mr. Adolph1-Sep-89 JTIDS yes yes no Mr. Adolph26-Mar-90 Pedestal Mounted Stinger yes yes yes(-) Mr. Duncan1-Oct-90 Rolling Airframe Missile yes yes (-) no Mr. Duncan1-Oct-90 LFT&E of Rolling Airframe Missile (RAM) yes yes1-Oct-90 FAADS/LOS-F-H yes yes (-) no1-Oct-90 LFT&E of FAADS/LOS-F-H
31-Oct-90 ATACMS yes yes(-) yes Mr. Duncan1-Dec-90 LFT&E of ATACMS BLK I yes(-)
13-Dec-90 Single Channel Ground & Airborne Radio Channel yes yes yes Mr. Duncan24-Jan-91 Advanced Cruise Missile yes yes yes(-) Mr. Duncan29-Jan-91 TOMAHAWK TLAM/D yes yes yes Mr. Duncan5-Feb-91 HH-65 Engine Study yes potential potential Mr. Duncan
26-Apr-91 AN/ALQ-184 & AN/ALM-233 yes yes yes Mr. Duncan1-Jan-92 LFT&E of SM-2 BLK IIIA yes yes
21-Jan-92 NAVSTAR GPS User Equipment yes yes yes Mr. Duncan6-Mar-92 B-1B Electronic Countermeasures Review yes no no Mr. Duncan1-Apr-92 LFT&E of Torpedo MK-50 yes yes1-Apr-92 LFT&E of HARM Improved Warhead yes yes7-Apr-92 AIM-120A Advanced Medium Air-to-Air Missile yes yes(-) yes(-) Mr. Duncan1-May-92 LFT&E of AIM-120A Advanced Medium Air-to-Air Missile yes yes(-)1- Jun-92 LFT&E of TOMAHAWK TLAM/C yes(-) yes(-)1- Jun-92 TOMAHAWK TLAM/C yes yes (-) yes (-)2-Oct-92 Composite Health Care System yes potential potential Mr. Duncan4-Dec-92 Airborne Self Protection Jammer OT-IID Memo for SecDef yes no no Mr. Duncan
15-Dec-92 ALR-56M Radar Warning Receiver yes yes yes Mr. Duncan16-Dec-92 C-17 EOA yes potential potential Mr. Frame2-Mar-93 Verlical Launch Antisubmarine Rocket FOT&E yes no yes Mr. Frame
29-Mar-93 Milstar Navy EHF Satellite Program AN/USC-38(V) yes yes yes Mr. Frame1-Apr-93 LFT&E of M830A1 120mm HEAT-MP-T Cartridge yes yes1-Apr-93 LFT&E of M109A6 Paladin Howitzer yes yes9-Apr-93 M109A6 Paladin Howitzer yes yes yes Mr. Frame
30-Apr-93 Palletized Loading System yes marginal no Mr. Frame1-May-93 LFT&E of Hellfire II yes yes(-)1-May-93 LFT&E of M113A3 Spall Liner yes yes1-Jul-93 DRAGON II LFT&E yes yes
19-Jul-93 Single Channel Ground & Airborne Radio Channel yes yes yes Mr. Frame1-Feb-94 LFT&E of M919 25mm APFSDS-T yes yes1-Feb-94 LFT&E of M829A2 APFSDS-T yes yes3-Feb-94 Rolling Airframe Missile yes yes (-) no Mr. Frame1-May-94 LFT&E of M1A2 Abrams Tank yes yes(-)
13-May-94 E-2C UDP yes yes yes Mr. Frame9-Aug-94 M1A2 Abrams Tank yes yes no Mr. Frame1-Nov-94 LFT&E of Sensor Fuzed Weapon (SFW) yes yes12-Jan-95 T-45 Jet Flight Tng System yes yes yes Mr. Coyle24-Feb-95 JTIDS Class 2/2H yes yes yes Mr. Coyle23-Mar-95 B-1B Operational Readiness Test yes yes yes Mr. Coyle8-Aug-95 Family of Medium Tacticval Vehicles yes yes yes Mr. Coyle27-Sep-95 LFT&E of M903 Saboted Light Armor Penetrator yes(-) yes Mr. Coyle12-Oct-95 AH-64D Longbow Apache/Longbow Hellfire yes yes yes Apache (-) Apache Hellfire Mr. Coyle25-Oct-95 FAADC3I & Ground Based Sensor yes marginal yes Mr. Coyle1-Nov-95 C-17 Globemaster III Airlift Aircraft yes yes yes yes(-) yes Mr. Coyle31-Jan-96 AFATDS yes yes yes Mr. Coyle11-Mar-96 MK 48 MODS ADCAP yes yes yes Mr. Coyle10-May-96 Sensor Fuzed Weapon yes yes yes Mr. Coyle30-May-96 LFT&E of M430A1 40-mm Cartridge yes(-) yes Mr. Coyle1-Sep-96 ASPJ Limited Scope for Bosnia yes (-) yes (-) marginal Mr. Coyle
19-Sep-96 JSTARS yes yes (-) no Mr. Coyle20-Sep-96 Standard Missile-2 Block IIIB yes yes yes Mr. Coyle1-Apr-97 ATACMS IA Oper Assessment yes no no Mr. Coyle
13-May-97 Javelin yes yes yes yes yes Mr. Coyle30-May-97 JTIDS - 2M yes yes no Mr. Coyle8-Aug-97 Enhanced Position Location Reporting System yes yes (-) yes (-) Mr. Coyle25-Sep-97 AWACS E-3 Radar System Improvement Program yes yes yes (-) Mr. Coyle30-Jan-98 Ship Self Defense System yes yes (-) yes Mr. Coyle1-Apr-98 ATACMS IA yes yes (-) yes yes yes(-) Mr. Coyle1-Apr-98 ALR-67 (V)3 LRIP Certification yes potential potential Mr. Coyle
23-Apr-98 LFT&E of Armor Piercing Cartridges (M995 and M993) yes yes Mr. Coyle7-Oct-98 JSTARS CGS Assessment yes no no Mr. Coyle
27-Oct-98 Joint Standoff Weapon - Baseline (JSOW) yes yes yes yes yes Mr. Coyle20-Nov-98 Combat Service Support Control System (CSSCS) yes (-) no yes (-) Mr. Coyle8-Dec-98 Close Combat Tactical Trainer yes yes no Mr. Coyle13-Jan-99 B-1B Block D Conventional Munition Upgrade yes yes yes Mr. Coyle22-Jan-99 SMART-T yes open issue no Mr. Coyle1-Feb-99 LFT&E of B-1B Conventional Mission Upgrade Program yes(-) yes(-) Mr. Coyle5-Mar-99 Cheyenne Mountain Upgrade yes yes yes Mr. Coyle30-Jun-99 JSTARS CGS Assessment yes no no Mr. Coyle16-Jul-99 LFT&E of XM-93 Wide Area Munition yes yes(-) Mr. Coyle9-Aug-99 ALR-67(V3) Advanced Special Receiver yes yes yes Mr. Coyle18-Oct-99 F-15 Fighter Data Link yes yes yes Mr. Coyle12-Nov-99 Voice Communication Switching System yes yes yes Mr. Coyle16-Dec-99 Minuteman III Guidance Replacement System yes yes (-) yes Mr. Coyle7-Jan-00 LFT&E of SH-60B/HH-60H yes yes Mr. Coyle
18-Jan-00 Rolling Airframe Missile yes yes yes yes yes Mr. Coyle3-Apr-00 F/A-18 E/F Super Hornet yes yes yes yes yes Mr. Coyle
23-May-00 SLAM-ER yes yes yes yes yes Mr. Coyle16-Aug-00 JSTARS Common Ground Station yes yes (-) no Mr. Coyle1-Oct-00 LFT&E of XM1001 - 40mm Canister Cartridge yes yes(-) Mr. Coyle
17-Nov-00 V-22 OSPREY yes yes no yes yes Mr. Coyle30-Nov-00 F-15E Tactical EW System, AN/ALQ-135 Band 1.5 yes yes no Mr. Coyle1-Dec-00 LFT&E of MH-47E/MH-60K Special Operations Aircraft yes yes Mr. Coyle
22-Dec-00 USS OSPREY Class Coastal Minehunter (MHC 51) yes yes yes yes yes Mr. Coyle18-Jan-01 LFT&E of B-2 Bomber Conventional Warfare Mission no yes (-) Mr. Coyle2-Mar-01 Joint Direct Attack Munition (JDAM) - 2000 lbs yes yes no Mr. Frame6-Apr-01 M2A3 Bradley Fighting Vehicle System yes yes yes yes yes Mr. Frame
26-Sep-01 Minuteman III Ppropulsion Replacement System yes yes yes Mr. Frame14-Sep-01 F-22 Test Adequacy Report to Congress (Section 8124) Mr. Christie3-Oct-01 Predator Medium Altitude Endurance UAV yes no no Mr. Christie
14-Nov-01 Joint Primary Aircraft Training System: T-6A Aircraft yes yes no Mr. Christie1-Feb-02 Cooperative Engagement Capability (CEC) yes yes yes Mr. Christie
25-Mar-02 Sensor Fuzed Weapon (SFW P3I) yes yes Mr. Christie28-Mar-02 Advanced Medium Range Air-to-Air (AMRAAM) yes yes Mr. Christie9-Apr-02 MLRS M270A1 Launcher yes yes yes Mr. Christie2-Aug-02 MH-60S Fleet Combat Support Helicopter yes yes no yes yes Mr. Christie31-Oct-02 PAC-3 Block 2002 System Mr. Christie23-Dec-02 Shadow 200 Tactical UAV marginal yes(-) no Mr. Christie3-Feb-03 M329E3 Armor Piercing Fin-Stabilized Discarding Sabot-Tracer yes yes Mr. Christie9-Apr-03 B-1B Block E Conventional Mission Upgrade Program yes no yes yes yes Mr. Christie15-Jul-03 Seawolf Nuclear Attack Submarine yes yes yes yes yes Mr. Christie24-Sep-03 Multifunctional Information Distribution System (MIDS) yes yes no Mr. Christie2-Dec-03 Integrated Defensive Electronic Countermeasures Suite (IDECMS) yes yes yes Mr. Christie
Classified System
Exit Criteria Met = yes; Stealth = yes; Avionics = no; Weapons Delivery = no
DOT&E scores major acquisition programs. Reports to Congress on IOT&E: 110. Score is whether the test was adequate and whether the test confirmed that the system actually tested is effective and suitable for combat.
Date System Adequate?
• Yes
• No
Effective?
• Yes
• No
Suitable?
• Yes
• No
LFT&E
3-D
ec-
84
TO
MA
HA
WK (
TA
SM
& T
LAM
-N)
yes
yes
yes
Mr.
Wein
berg
er
27-D
ec-
84
M1
A1
Ab
ram
s Tan
kyes
yes
yes
Mr.
Wein
berg
er
4-M
ar-
85
Sta
nd
ard
Mis
sile
Blo
ck II
yes
yes
yes
BG
Hall
24-A
ug
-85
Serg
ean
t York
(D
IVA
D)
yes
no
no
Mr.
Kri
ngs
30-S
ep
-85
OH
-58
D A
rmy H
elic
op
ter
Imp
rovem
en
t Pro
gra
myes
yes
(-)
yes
(-)
Mr.
Kri
ngs
7-O
ct-8
5A
V-8
B H
arr
ier
yes
yes
yes
Mr.
Kri
ngs
4-D
ec-
85
TO
MA
HA
WK (
TLA
M-C
)yes
yes
yes
Mr.
Kri
ngs
12-M
ar-
86
E-6
A T
AC
AM
O O
pera
tional A
ssess
men
tyes
pote
nti
al
pote
nti
al
Mr.
Kri
ngs
19-M
ar-
86
AE
GIS
/CG
-47 C
lass
Cru
iser
yes
yes
yes
Mr.
Kri
ngs
16-A
pr-
86
AG
M-6
5D
In
frare
d M
averi
ck F
OT&
Eyes
yes
yes
Mr.
Kri
ngs
17-S
ep
-86
Arl
eig
h B
urk
e (
DD
G51
) O
Ayes
yes
yes
Mr.
Kri
ngs
30-O
ct-8
6Tact
ical A
rmy C
om
bat
Serv
ice S
up
port
Com
pu
ter
Syst
em
yes
yes
yes
Mr.
Kri
ngs
24-N
ov-8
6Lo
w A
ltit
ud
e N
avig
ati
on
& T
arg
eti
ng
In
frare
d S
yst
em
no
yes
yes
Mr.
Kri
ngs
12-J
un
-87
Lan
din
g C
raft
Air
Cu
shio
nyes
yes
yes
Mr.
Kri
ngs
25-J
un
-87
ELF
Com
mo S
yst
em
yes
yes
yes
Mr.
Kri
ngs
24-A
ug
-87
S-3
A W
eap
on
Syst
em
Im
pro
vem
ent
Pro
gra
m (
S-3
B)
no
pote
nti
al
no
Mr.
Kri
ngs
6-O
ct-8
7TR
IDEN
T II (D
-5)
Str
ate
gic
Weap
on
s S
yst
em
OA
yes
low
ris
klo
w r
isk
Mr.
Kri
ngs
1-D
ec-
87
Bra
dle
y (
follo
w-u
p O
A)
yes
pote
nti
al
pote
nti
al
Mr.
Kri
ngs
1-A
pr-
88
CV
In
ner-
Zon
e A
SW
Helo
SH
-60F
yes
pote
nti
al
pote
nti
al
Mr.
Kri
ngs
11-M
ay-8
8M
H-5
3E
Helic
opte
ryes
marg
inal
no
Mr.
Kri
ngs
13-J
un
-88
S-3
A W
eap
on
Syst
em
Im
pro
vem
ent
Pro
gra
m (
S-3
B)
yes
yes
yes(
-)M
r. K
rin
gs
30-A
ug
-88
Big
eye In
teri
m R
ep
ort
no
pote
nti
al
pote
nti
al
Mr.
Kri
ngs
9-S
ep
-88
OH
-58
D A
HIP
Sco
ut/
Reco
nyes
yes
not
test
ed
Mr.
Kri
ngs
15-N
ov-8
8S
ecu
re T
ele
ph
on
e U
nit
(S
TU
III)
yes
marg
inal
marg
inal
Mr.
Kri
ngs
5-D
ec-
88
Mobile
Sub
scri
ber
Equ
ipm
ent
FOT&
Eyes
yes
yes
Mr.
Kri
ngs
8-D
ec-
88
MK
48 A
dvan
ced
Cap
abili
ty T
orp
edo
yes
no
yes
Mr.
Kri
ngs
14-D
ec-
88
M9
AC
Eyes
yes
marg
inal
Mr.
Kri
ngs
19-D
ec-
88
Low
Alt
itu
de N
avig
ati
on
& T
arg
eti
ng
In
frare
d S
yst
em
yes
yes
yes
Mr.
Kri
ngs
1-Jan
-89
MK
-48 A
DC
AP T
orp
edo
yes
yes
1-F
eb-8
9Phoen
ix (
AIM
-54
C)
yes
yes
25-A
pr-
89
AN
/SQ
S-5
3C
Son
ar
Syst
em
yes
yes(
-)yes
Mr.
Kri
ngs
24-M
ay-8
9M
93
9A
2 5
-Ton T
ruck
yes
yes
yes
Mr.
Kri
ngs
1-Ju
l-8
9A
SPJ O
A L
RIP
Mem
o f
or
US
D(A
)yes
pote
nti
al +
p
ote
nti
al -
Mr.
Ad
olp
h1
-Sep
-89
JTID
Syes
yes
no
Mr.
Ad
olp
h2
6-M
ar-
90
Ped
est
al M
ou
nte
d S
tin
ger
yes
yes
yes(
-)M
r. D
un
can
1-O
ct-9
0R
olli
ng
Air
fram
e M
issi
leyes
yes
(-)
no
Mr.
Dun
can
1-O
ct-9
0LF
T&
E o
f R
olli
ng A
irfr
am
e M
issi
le (
RA
M)
yes
yes
1-O
ct-9
0FA
AD
S/L
OS
-F-H
yes
yes
(-)
no
1-O
ct-9
0LF
T&
E o
f FA
AD
S/L
OS-F
-H3
1-O
ct-9
0A
TA
CM
Syes
yes(
-)yes
Mr.
Dun
can
1-D
ec-
90
LFT&
E o
f A
TA
CM
S B
LK I
yes(
-)1
3-D
ec-
90
Sin
gle
Ch
an
nel G
rou
nd
& A
irb
orn
e R
ad
io C
han
nel
yes
yes
yes
Mr.
Dun
can
24-J
an-9
1A
dvance
d C
ruis
e M
issi
leyes
yes
yes(
-)M
r. D
un
can
29-J
an-9
1TO
MA
HA
WK T
LAM
/Dyes
yes
yes
Mr.
Dun
can
5-F
eb-9
1H
H-6
5 E
ng
ine S
tud
yyes
pote
nti
al
pote
nti
al
Mr.
Dun
can
26-A
pr-
91
AN
/ALQ
-18
4 &
AN
/ALM
-23
3yes
yes
yes
Mr.
Dun
can
1-Jan
-92
LFT&
E o
f SM
-2 B
LK IIIA
yes
yes
21-J
an-9
2N
AV
STA
R G
PS
Use
r E
qu
ipm
ent
yes
yes
yes
Mr.
Dun
can
6-M
ar-
92
B-1
B E
lect
ron
ic C
ou
nte
rmeasu
res
Revie
wyes
no
no
Mr.
Dun
can
1-A
pr-
92
LFT&
E o
f Torp
ed
o M
K-5
0yes
yes
1-A
pr-
92
LFT&
E o
f H
AR
M Im
pro
ved W
arh
ead
yes
yes
7-A
pr-
92
AIM
-120
A A
dvance
d M
ed
ium
Air
-to-A
ir M
issi
leyes
yes(
-)yes(
-)M
r. D
un
can
1-M
ay-9
2LF
T&
E o
f A
IM-1
20
A A
dvan
ced M
ed
ium
Air
-to-A
ir M
issi
leyes
yes(
-)1
-Ju
n-9
2LF
T&
E o
f TO
MA
HA
WK
TLA
M/C
yes(
-)yes(
-)1
-Ju
n-9
2TO
MA
HA
WK T
LAM
/Cyes
yes
(-)
yes
(-)
2-O
ct-9
2C
om
posi
te H
ealt
h C
are
Syst
em
yes
pote
nti
al
pote
nti
al
Mr.
Dun
can
4-D
ec-
92
Air
born
e S
elf
Pro
tect
ion
Jam
mer
OT-I
ID M
em
o f
or
SecD
ef
yes
no
no
Mr.
Dun
can
15-D
ec-
92
ALR
-56
M R
ad
ar
Warn
ing
Rece
iver
yes
yes
yes
Mr.
Dun
can
16-D
ec-
92
C-1
7 E
OA
yes
pote
nti
al
pote
nti
al
Mr.
Fra
me
2-M
ar-
93
Verl
ical La
un
ch A
nti
sub
mari
ne R
ock
et
FOT&
E
yes
no
yes
Mr.
Fra
me
29-M
ar-
93
Mils
tar
Navy E
HF
Sate
llite
Pro
gra
m A
N/U
SC
-38(V
)
yes
yes
yes
Mr.
Fra
me
1-A
pr-
93
LFT&
E o
f M
83
0A
1 1
20
mm
HE
AT-M
P-T
Cart
ridg
e
yes
yes
1-A
pr-
93
LFT&
E o
f M
10
9A
6 P
ala
din
How
itze
r
yes
yes
9-A
pr-
93
M1
09A
6 P
ala
din
How
itze
ryes
yes
yes
Mr.
Fra
me
30-A
pr-
93
Palle
tize
d L
oad
ing
Syst
em
yes
marg
inal
no
Mr.
Fra
me
1-M
ay-9
3LF
T&
E o
f H
ellfi
re II
yes
yes(
-)1
-May-9
3LF
T&
E o
f M
11
3A
3 S
pall
Lin
er
yes
yes
1-Ju
l-9
3D
RA
GO
N II LF
T&
Eyes
yes
19-J
ul-
93
Sin
gle
Ch
an
nel G
rou
nd
& A
irb
orn
e R
ad
io C
han
nel
yes
yes
yes
Mr.
Fra
me
1-F
eb-9
4LF
T&
E o
f M
91
9 2
5m
m A
PFS
DS
-Tyes
yes
1-F
eb-9
4LF
T&
E o
f M
82
9A
2 A
PFS
DS
-Tyes
yes
3-F
eb-9
4R
olli
ng
Air
fram
e M
issi
leyes
yes
(-)
no
Mr.
Fra
me
1-M
ay-9
4LF
T&
E o
f M
1A
2 A
bra
ms
Tan
kyes
yes(
-)1
3-M
ay-9
4E
-2C
UD
Pyes
yes
yes
Mr.
Fra
me
9-A
ug-9
4M
1A
2 A
bra
ms
Tan
kyes
yes
no
Mr.
Fra
me
1-N
ov-9
4LF
T&
E o
f Sen
sor
Fuze
d W
eap
on
(S
FW)
yes
yes
12-J
an-9
5T-4
5 Jet
Flig
ht
Tn
g S
yst
em
yes
yes
yes
Mr.
Coyle
24-F
eb
-95
JTID
S C
lass
2/2
Hyes
yes
yes
Mr.
Coyle
23-M
ar-
95
B-1
B O
pera
tion
al R
eadin
ess
Test
yes
yes
yes
Mr.
Coyle
8-A
ug-9
5Fa
mily
of
Med
ium
Tact
icval V
eh
icle
syes
yes
yes
Mr.
Coyle
27-S
ep
-95
LFT&
E o
f M
90
3 S
ab
ote
d L
igh
t A
rmor
Pen
etr
ato
ryes(
-)yes
Mr.
Coyle
12-O
ct-9
5A
H-6
4D
Lon
gbow
Ap
ach
e/L
ong
bow
Hellfi
reyes
yes
yes
Ap
ach
e (
-)A
pach
eH
ellfi
reM
r. C
oyle
25-O
ct-9
5FA
AD
C3I &
Gro
un
d B
ase
d S
en
sor
yes
marg
inal
yes
Mr.
Coyle
1-N
ov-9
5C
-17
Glo
bem
ast
er
III A
irlif
t A
ircr
aft
yes
yes
yes
yes(
-)yes
Mr.
Coyle
31-J
an-9
6A
FATD
Syes
yes
yes
Mr.
Coyle
11-M
ar-
96
MK
48
MO
DS
AD
CA
Pyes
yes
yes
Mr.
Coyle
10-M
ay-9
6S
en
sor
Fuze
d W
eapon
yes
yes
yes
Mr.
Coyle
30-M
ay-9
6LF
T&
E o
f M
43
0A
1 4
0-m
m C
art
rid
ge
yes(
-)yes
Mr.
Coyle
1-S
ep
-96
AS
PJ Li
mit
ed S
cop
e f
or
Bosn
iayes
(-)
yes
(-)
marg
inal
Mr.
Coyle
19-S
ep
-96
JSTA
RS
yes
yes
(-)
no
Mr.
Coyle
20-S
ep
-96
Sta
nd
ard
Mis
sile
-2 B
lock
IIIB
yes
yes
yes
Mr.
Coyle
1-A
pr-
97
ATA
CM
S IA
Op
er
Ass
ess
men
tyes
no
no
Mr.
Coyle
13-M
ay-9
7Ja
velin
yes
yes
yes
yes
yes
Mr.
Coyle
30-M
ay-9
7JT
IDS
- 2
Myes
yes
no
Mr.
Coyle
8-A
ug-9
7E
nh
ance
d P
osi
tion
Loca
tion R
eport
ing
Syst
em
yes
yes
(-)
yes
(-)
Mr.
Coyle
25-S
ep
-97
AW
AC
S E
-3 R
ad
ar
Syst
em
Im
pro
vem
en
t Pro
gra
m
yes
yes
yes
(-)
Mr.
Coyle
30-J
an-9
8S
hip
Self
Defe
nse
Syst
em
yes
yes
(-)
yes
Mr.
Coyle
1-A
pr-
98
ATA
CM
S IA
yes
yes
(-)
yes
yes
yes(
-)M
r. C
oyle
1-A
pr-
98
ALR
-67
(V
)3 L
RIP
Cert
ifica
tion
yes
pote
nti
al
pote
nti
al
Mr.
Coyle
23-A
pr-
98
LFT&
E o
f A
rmor
Pie
rcin
g C
art
rid
ges
(M9
95
an
d M
993
)yes
yes
Mr.
Coyle
7-O
ct-9
8JS
TA
RS
CG
S A
ssess
men
tyes
no
no
Mr.
Coyle
27-O
ct-9
8Jo
int
Sta
nd
off
Weap
on
- B
ase
line (
JSO
W)
yes
yes
yes
yes
yes
Mr.
Coyle
20-N
ov-9
8C
om
bat
Serv
ice S
up
port
Con
trol Syst
em
(C
SS
CS
)yes
(-)
no
yes
(-)
Mr.
Coyle
8-D
ec-
98
Clo
se C
om
bat
Tact
ical Tra
iner
yes
yes
no
Mr.
Coyle
13-J
an-9
9B
-1B
Blo
ck D
Con
venti
on
al M
un
itio
n U
pg
rad
eyes
yes
yes
Mr.
Coyle
22-J
an-9
9S
MA
RT-T
yes
open iss
ue
no
Mr.
Coyle
1-F
eb-9
9LF
T&
E o
f B
-1B
Conven
tional M
issi
on
Up
gra
de P
rog
ram
yes(
-)yes(
-)M
r. C
oyle
5-M
ar-
99
Ch
eyen
ne M
oun
tain
Up
gra
de
yes
yes
yes
Mr.
Coyle
30-J
un
-99
JSTA
RS
CG
S A
ssess
men
tyes
no
no
Mr.
Coyle
16-J
ul-
99
LFT&
E o
f X
M-9
3 W
ide A
rea M
unit
ion
yes
yes(
-)M
r. C
oyle
9-A
ug-9
9A
LR-6
7(V
3)
Ad
vance
d S
peci
al R
ece
iver
yes
yes
yes
Mr.
Coyle
18-O
ct-9
9F-
15
Fig
hte
r D
ata
Lin
kyes
yes
yes
Mr.
Coyle
12-N
ov-9
9V
oic
e C
om
mu
nic
ati
on S
wit
chin
g S
yst
em
yes
yes
yes
Mr.
Coyle
16-D
ec-
99
Min
ute
man
III
Gu
idance
Rep
lace
men
t S
yst
em
yes
yes
(-)
yes
Mr.
Coyle
7-Jan
-00
LFT&
E o
f SH
-60B
/HH
-60
H
yes
yes
Mr.
Coyle
18-J
an-0
0R
olli
ng
Air
fram
e M
issi
leyes
yes
yes
yes
yes
Mr.
Coyle
3-A
pr-
00
F/A
-18
E/F
Su
per
Horn
et
yes
yes
yes
yes
yes
Mr.
Coyle
23-M
ay-0
0S
LAM
-ER
yes
yes
yes
yes
yes
Mr.
Coyle
16-A
ug
-00
JSTA
RS
Com
mon G
rou
nd
Sta
tion
yes
yes
(-)
no
Mr.
Coyle
1-O
ct-0
0LF
T&
E o
f X
M10
01
- 4
0m
m C
an
iste
r C
art
rid
ge
yes
yes(
-)M
r. C
oyle
17-N
ov-0
0V
-22
OS
PR
EY
yes
yes
no
yes
yes
Mr.
Coyle
30-N
ov-0
0F-
15
E T
act
ical E
W S
yst
em
, A
N/A
LQ-1
35 B
and
1.5
yes
yes
no
Mr.
Coyle
1-D
ec-
00
LFT&
E o
f M
H-4
7E/M
H-6
0K
Speci
al O
pera
tion
s A
ircr
aft
yes
yes
Mr.
Coyle
22-D
ec-
00
US
S O
SPR
EY C
lass
Coast
al M
ineh
un
ter
(MH
C 5
1)
yes
yes
yes
yes
yes
Mr.
Coyle
18-J
an-0
1LF
T&
E o
f B
-2 B
om
ber
Con
ven
tion
al W
arf
are
Mis
sion
n
oyes
(-)
Mr.
Coyle
2-M
ar-
01
Join
t D
irect
Att
ack
Mun
itio
n (
JDA
M)
- 20
00
lb
syes
yes
no
Mr.
Fra
me
6-A
pr-
01
M2
A3
Bra
dle
y F
igh
tin
g V
ehic
le S
yst
em
yes
yes
yes
yes
yes
Mr.
Fra
me
26-S
ep
-01
Min
ute
man
III
Pp
ropu
lsio
n R
ep
lace
ment
Syst
em
yes
yes
yes
Mr.
Fra
me
14-S
ep
-01
F-2
2 T
est
Ad
eq
uacy
Rep
ort
to C
on
gre
ss (
Sect
ion 8
124
)M
r. C
hri
stie
3-O
ct-0
1Pre
dato
r M
ed
ium
Alt
itud
e E
nd
ura
nce
UA
Vyes
no
no
Mr.
Ch
rist
ie1
4-N
ov-0
1Jo
int
Pri
mary
Air
craft
Tra
inin
g S
yst
em
: T-6
A A
ircr
aft
yes
yes
no
Mr.
Ch
rist
ie1
-Feb-0
2C
oop
era
tive E
ng
agem
en
t C
ap
abili
ty (
CE
C)
yes
yes
yes
Mr.
Ch
rist
ie2
5-M
ar-
02
Sen
sor
Fuze
d W
eapon
(S
FW P
3I)
yes
yes
Mr.
Ch
rist
ie2
8-M
ar-
02
Ad
vance
d M
ed
ium
Ran
ge A
ir-t
o-A
ir (
AM
RA
AM
)yes
yes
Mr.
Ch
rist
ie9
-Ap
r-0
2M
LRS
M2
70A
1 L
aun
cher
yes
yes
yes
Mr.
Ch
rist
ie2
-Au
g-0
2M
H-6
0S
Fle
et
Com
bat
Su
pport
Helic
op
ter
yes
yes
no
yes
yes
Mr.
Ch
rist
ie3
1-O
ct-0
2PA
C-3
Blo
ck 2
00
2 S
yst
em
Mr.
Ch
rist
ie2
3-D
ec-
02
Shad
ow
20
0 T
act
ical U
AV
marg
inal
yes(
-)n
oM
r. C
hri
stie
3-F
eb-0
3M
32
9E
3 A
rmor
Pie
rcin
g F
in-S
tab
ilize
d D
isca
rdin
g S
abot-
Tra
cer
yes
yes
Mr.
Ch
rist
ie9
-Ap
r-0
3B
-1B
Blo
ck E
Con
ven
tion
al M
issi
on
Upg
rad
e P
rog
ram
yes
no
yes
yes
yes
Mr.
Ch
rist
ie1
5-J
ul-
03
Seaw
olf
Nu
clear
Att
ack
Su
bm
ari
ne
yes
yes
yes
yes
yes
Mr.
Ch
rist
ie2
4-S
ep
-03
Mu
ltif
un
ctio
nal In
form
ati
on
Dis
trib
uti
on
Syst
em
(M
IDS
)yes
yes
no
Mr.
Ch
rist
ie
2-D
ec-
03
Inte
gra
ted D
efe
nsi
ve E
lect
ron
ic C
ou
nte
rmeasu
res
Suit
e (
IDE
CM
S)
yes
yes
yes
Mr.
Ch
rist
ie
Cla
ssifi
ed
Syst
em
Exit
Cri
teri
a M
et
= y
es;
Ste
alt
h =
yes;
Avio
nic
s =
no;
Weap
ons
Deliv
ery
= n
o
Cumulative Number
0
20
40
60
80
100
120
0 20 40 60 80 100 120
Reports
Effective
Suitable
Reports Final Reports:90% Effective80% Suitable
But a downward trend.
Cumulative Number
0
20
40
60
80
100
120
0 20 40 60 80 100 120
Reports
Effective
Suitable
Reports
Cumulative Number
0
20
40
60
80
100
120
0 20 40 60 80 100 120
Reports
Effective
Suitable
Reports
Cumulative Number
0
20
40
60
80
100
120
0 20 40 60 80 100 120
Reports
Effective
Suitable
Reports
DOT&E scores are “final scores”
• It is not unusual for a system to do poorly in its IOT&E.
• Different Services have, in the past, handled this differently.
• Often the effect is to rerun the OT until the test results are “good enough.”
1985-1990 1996-2000
Source: ATEC/AEC
Handicappers Guide: Ten ways to tell a program is in trouble
without doing a single test
1. Live fire testing is an issue from outset
2. Unrealistic requirements
3. Tests start getting cut long before testing has begun
4. Program doesn’t want to do M&S early
5. Program wants to replace testing with M&S
- - From the achieves
6. Program does tests that, if they fail, will make headlines and does it without adequate prep.
7. Start cutting training manuals, logistic & sustainability
8. Program is cutting LRIP article and increasing overall production
9. No money budgeted for second test if first test fails
10. Program talks to testers only when it is required, and restricts access as a matter of attitude
DOT&E also gets scored
• In the press
• In Congress
WashingtonPost…
1987
2001
1997
Interesting Plays
• Early involvement
• Modeling & simulation
• Acquisition Plays
• Central T&E Investment Program
• Defense Test Resource Management Center
• Win & Loose is the wrong paradigm – Who is the opponent?
• Win – Win is the goal– “business has to make a profit and the soldier
has to get what he needs” (~1987)– “products that satisfy user needs with
measurable improvements to mission capability and operational support, in a timely manner, and at a fair and reasonable price” (DoD Directive 50001, May 2003)
