Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center...
Transcript of Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center...
![Page 1: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/1.jpg)
Integrity Service Excellence
THE AIR FORCE TEST CENTER VALUE TO THE ACQUISITION
PROCESS
Air Force Test Center
Dr. Elisabetta Jerome
Technical Advisor for Armament and Weapons T&E
30 October, 2014 Approved for Public Release CASE NUMBER: 96TW-2014-0135
![Page 2: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/2.jpg)
Author Contact Information
Elisabetta L. Jerome, PhD Technical Advisor for Armament and Weapons Test and Evaluation AFTC/CZ 101 West D Ave, Bldg 1, Suite 115 [email protected] 850.883.2922 (DSN 875.2922) 850.217.8105 (mobile)
2
![Page 3: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/3.jpg)
Outline
3
• AFTC: who we are • How DT&E fits and adds value
to the acquisition process through systems engineering.
• Ongoing efforts • Success stories • Why we need to do better • Conclusions
![Page 4: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/4.jpg)
Our Heritage
Edwards AFB
Eglin AFB
Arnold AFB
![Page 5: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/5.jpg)
Span of Operations
Nellis AFB
HQ AFMC
Wright-Patterson AFB HQ AFTC
Edwards AFB
![Page 6: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/6.jpg)
Span of Operations
96 TW
Eglin AFB
AEDC
Arnold AFB
412 TW
Edwards AFB
![Page 7: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/7.jpg)
Span of Operations
Arnold Engineering Development Complex (AEDC)
Moffett Field White Oak, MD
AEDC
Arnold AFB
![Page 8: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/8.jpg)
8
![Page 9: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/9.jpg)
96th Test Wing (96 TW)
Span of Operations
Crystal City, VA Beale AFB
Greenville, TX
Melbourne, FL
Kirtland AFB
Peterson AFB
Gunter Annex
96 TW
Eglin AFB
Seattle, WA
Holloman AFB
Wright-Patterson AFB
Hanscom AFB
White Sands Missile Range
Lackland AFB
Denver CO
Nellis AFB
Waco, TX
Warner-
Robins AFB
Langley AFB
![Page 10: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/10.jpg)
• Test & evaluate state-of-the-art weapons and
provide superior installation support. – Air-to-Air/Air-to-Ground – Aircraft-Store Compatibility – Weapon Effects – Legacy Weapon Systems – Strategic Test Capabilities – Special Ops – Command and Control/Cyber – Range Management – Installation Support
96th Test Wing
![Page 11: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/11.jpg)
Span of Operations
96th Test Wing (96 TW) 412th Test Wing (412 TW)
Charleston AFB
Langley AFB
Marietta, GA
NAS Patuxent River
Tinker AFB
Tucson, AZ
AF Plant 04 Warner-Robins AFB
Hurlburt Field
Seattle, WA
Wright-Patterson AFB
412 TW
Edwards AFB
Hill AFB
![Page 12: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/12.jpg)
412th Test Wing
• Leverage our location, weather, partnerships, and personnel to conduct independent, objective assessments on behalf of the USAF – Flight Operations – Engineering – Test Management – Maintenance – Installation Support
![Page 13: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/13.jpg)
AFTC Benefits
• Aligns AFMC Test Enterprise Resources and responsibilities/authority, beginning to end, to single Center CC
• Provides opportunity to standardize Enterprise processes & become more efficient & effective
• Single, simplified interface to customers • Confident we have many other opportunities
we have not yet realized
![Page 14: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/14.jpg)
Tester of Choice
• State of the art test facilities • Technical and test experts to support
each test • Trained engineers to help with
statistically relevant testing • Superior support with data reduction,
reporting and scheduling
![Page 15: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/15.jpg)
Our Mission and Our Vision
15
Conduct Developmental Test and Evaluation of air, space, & cyber systems to provide
timely, objective, and accurate information to decision makers
Tester of Choice…Today and Tomorrow
![Page 16: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/16.jpg)
Outline
16
• AFTC: who we are • How DT&E fits and adds value
to the acquisition process through systems engineering.
• Ongoing efforts • Success stories • Why we need to do better • Conclusions
![Page 17: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/17.jpg)
What Systems Engineering means to me
• There is a comprehensive plan on how and when to do things.
• Multiple people and organizations are involved in every process and decision. From the very beginning.
• There is a specific order things are done in
• Working together you can be more efficient and have a far better outcome
17
![Page 18: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/18.jpg)
18
“…we need to balance the desire for thorough testing against the resources in time and money required to conduct the testing. This can only be accomplished through a cooperative effort that fully involves DT&E professionals in the program planning process.”
Frank Kendall Under Secretary of Defense for Acquisition,
Technology, and Logistics ITEA Journal 2013
![Page 19: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/19.jpg)
BLUF
• DT&E: from big “T”, little “e” to big “T” and big “E”
• Testers not just involved through systems engineering practices but a valued member of every acquisition team
19
![Page 20: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/20.jpg)
Testing and the Acquisition Process
• Early involvement • Testers as integral part of the
team/program office • Testers provide added value – not just
testing. True DT&E – Test design – Data analyses – Failure analyses
20
![Page 21: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/21.jpg)
Early Involvement
• Why is early tester involvement important? – Testable/measurable Requirements – Realistic Requirements – Facilities/Instrumentation Available? – Capabilities/Manpower – Data Rights – Long-Term Strategy
21
AFTC’s Desire is Early & Continuous Involvement
![Page 22: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/22.jpg)
Ongoing Efforts
• Working with AFMC/A3F and AFLCMC/AQT on implementation of AFI and AFMCI direction for early involvement of testers
– Formalize AFTC as OPR for AFI 99-103, para 4.3 Pre-MS A Tester Involvement in the Acquisition Process
• Develop coordinated plan to maximize use of AFTC test reps, CTAs, testers in SPOs
– AFTC Test Reps working with every customer to understand program requirements and identify impacts of AFTC capabilities, to ensure program requirements are realistic and testable and to develop program test strategies
• Elevate modeling / statistical engineering to resourced AFTC enterprise capability
– Use statistical tools to meet desired acquisition outcomes – Use analysis tools to extract results from all available data
• Apply value added analysis to all test programs and document results, lessons learned, and impact on acquisition
– Key value added by DT is the maturation of the system – A partial measurement of this is the DRs and Watch Items that are identified and
corrected and WHEN. Early correction of DRs saves huge $ – AFTC can enhance value to acquisition by evaluating DR/WIs for systemic root causes – Improve test processes – Communicate risks across acquisition programs
22
![Page 23: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/23.jpg)
Examples – Success Stories
• In-house statistics/design of experiment experts
• HTVSF soil characterization issues – AFTC part of the team – suggested three tests as path forward – fundamental critical results to the Program Office
• Sled tests design and predictions • SDB II, AMRAAM, LRSO – embedded tester
with the program. Liaison, facilitator • MOP – AFTC ready for tests of this very large
warhead 23
![Page 24: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/24.jpg)
Past issues and why we need to do better
• PL MK-82 requirements and realities – Must be lethal to X feet – No collateral damage past Y feet – Arena tests results and analysis
• JASSM requirements and realities – Millions of extra dollars spent because of a single
target in the “ORD”
24
![Page 25: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/25.jpg)
Conclusions / Way Forward
• The AFTC wants to have early and continuous involvement in the acquisition process
• We promise to recapture true DT&E. Emphasis on the E.
• We need the acquisition community’s help in keeping us in the loop
• To offer the best value we must be prepared. To be prepared we must know what is coming.
• Our business is testing, let us help you from the beginning to the end to insure what you want is testable and measurable and what you get is exactly what you want.
![Page 26: Air Force Test Center AIR FORCE TEST CENTER VALUE TO THE ACQUISITION PROCESS Air Force Test Center ... of air, space, & cyber systems to provide timely, objective, and accurate information](https://reader030.fdocuments.in/reader030/viewer/2022040213/5ea8ae293cee3555310b8eea/html5/thumbnails/26.jpg)
26