LDTO Designations - Defense Acquisition University · LDTO Designations AF Life Cycle Management...

AFLCMC… Providing the Warfighter’s Edge

LDTO Designations

AF Life Cycle Management Center

Rapidly delivering war-winning capability

Jeff ColpittsAFLCMC/AZTCom 937-656-7818 DSN [email protected]


Agenda

• What’s an LDTO?

• New AFI 99-103

• Form 42 instructions

• Resources: LCMC Standard Process, AZT repository, CTAF contacts

2


Process Flowchart*

1.1DetermineIf LDTO isnecessary


Updated LDTO Flow Chart


What is an LDTO?

• Required by 10 U.S.C. 139b for MDAPs– Provides technical expertise on DT&E issues to the CDT

– Conducts DT&E activities as directed by CDT

– Assists CDT to reach technically informed, objective judgements about both gov’t and contractor T&E planning and results

• AFI 99-103 extras

– Functions as Lead Integrator for program’s DT&E

– Applies to ACAT, non-ACAT and FMS

– Separate from the program office (paragraph 1.3.6)

5


Updated LDTO Flow Chart


No-LDTO Option

– “No-LDTO Option” has been replaced “alternate” LDTO – Will be separate from program office

• AFMC and HAF/TE aware of turmoil• CTA working with AFMC/A3 and HAF/TE on way ahead


List of approved LDTOs

• LDTO will be selected from the list– Part of the Form 42

• Sorted by Test Capabilities, list includes: – AFTC (96 TW, 412 TW, AEDC)

– AFLCMC/AZT (CTA) – including SOs at Hill, Robins, & Tinker

– 582 MMXS (Missile Mx Squadron, Hill AFB)

– 645 AESG (Big Safari)


Process Flowchart*


The Form Changes


Form 42 Instructions

11


The Form Changes


Notes

• For programs planning to identify the CTA or one of its sites (Hill, Tinker, Robins) as their LDTO, the LDTO will be listed as CTA and the organization executing the test will be the appropriate site. Example:

AFLCMC/AZT (EZPT-CTAH) for CTA SO Hill

• Programs planning to identify AFTC or one of its sites (AEDC, 96TW, etc) as their LDTO, the LDTO will be AFTC and the organization executing the test will be the appropriate site, to include test squadron, if known. Example: AFTC (412 TW / 418 FLTS)


New PDF Format

15

While you’re typing…

When you hit tab/move to another block…


Example – Program Background

16

They’ve got all the important programmatic information here like the MDA, Acquisition Strategy, future decision points, requirement for the effort, need date, etc.


System Under Test

Example Text:“The C-130H (2-4 aircraft) will be modified to install AN/APX-119 Mode 5 transponder, ADS-B Out, and Mode S EHS. The AN/APX-119 Mode 5 transponder and control head will be installed and modified to meet ADS-B Out compliance. Aircraft instrumentation to record ADS-B and Mode S EHS data will be required.”“Other components that will be added for this effort include, GPS receiver, air data computer and signal processor. The contractor is responsible for all modifications. AIMS certification testing is required as part of this test effort. Cybersecurity T&E to conduct Cooperative Vulnerability Identification (CVI) is required.”


Test Objective and Test Details


Example – Test Objectives & Details

19

OTA/OTO says ‘or’ - That’s okay. Better than ‘unknown’ or leaving it blank.


Technical & Safety Risk Assessment of THE TEST


Block 16: Justification of your LDTO choice

Example


Coordination/Signature Block


Coordination Comments

23


POC Workflows

Stakeholders on every form: – “AFLCMC/AZT CTA LDTO Workflow”

(AFLCMC CTA) – “AFMC/A3F LDTO Workflow ”

Other Potential Stakeholders:

• “AF Test Center LDTO Workflow” (AFTC XP)

• Wright-Patterson AFB PEOs: – “AFLCMC/WI Workflow Mailbox (ISR & SOF)”– “AFPEO MOBILITY WORKFLOW” (AFLCMC/WL)– “AFLCMC/WK Workflow (Tankers)” (AFLCMC/WK)– “AFPEO Agile Combat Support Workflow”

(AFLCMC/WN)– “AFPEO/FB Workflow” (AFLCMC/WW, Fighter &

Bomber)

• Gunter AFB PEOs– “AFLCMC/HI Workflow” (Primary for AFLCMC/HI,

Business and Enterprise Systems)– “AFPEO BES Workflow” (Backup for AFLCMC/HI)

• Hanscom AFB PEOs:– “AFPEO Battle Management Workflow” (AFLCMC/HB)– “AFPEO C3I & Networks Workflow” (AFLCMC/HN)

• Eglin AFB PEO:– “AFPEO Weapons Workflow” (AFLCMC/EB)

24


Comments Section

AFMC/A3 recently directed that A&AS contractors cannot sign the form. So, possible work-around:

Have a TM from another program/project within the Directorate signs T&E OSF signs Leave it blank


Additional Advice

• Don’t assume everyone reading the form is as familiar with the system under test as you are. Explain the program at a fundamental level so others can understand the objective and associated risks.

• Anticipate the tough questions. Your form will move through the process much quicker if it doesn’t require a lot of data-gathering (phone calls, email traffic, etc).


No-LDTO Option Justification

This information will be included in current LDTO designation form:


AFI 99-103, Paragraph 2.18

LDTO Responsibilities:1. Provide technical expertise on DT&E matters to CDT / Test Manager.

2. Conduct DT&E activities as coordinated with the CDT.

3. Oversee contractor DT&E as directed by the CDT/TM.

4. Collaborate with the CDT/TM to establish, coordinate, and oversee a confederation of government DT&E organizations that plan and conduct DT&E according to the TEMP.

5. Plan, manage, and conduct DT&E, LFT&E, and integrated testing according to TEMP.

6. Participate in ITTs as they are being formed as assist TIPTs

7. Conduct or oversee cyber tests in support of the cyber test strategy as directed by the CDT/TM.

8. Provide gov’t DT&E results and final reports to the PM, PEO, and other stakeholders in support of Decision Reviews and Certification for OT Readiness. Provide results to program’s common T&E database.


Supplement to AFI 99-103, Paragraph 3.17

• 3.17.4.1. (Added) Prioritize the use of DoD Test Ranges and Facilities and document any decision not to use them.

• 3.17.6.1. (Added) Ensure that each test is conducted IAW an approved test plan, approved test safety documentation, and the principles of integrated test. This requirement applies whether the LDTO conducts the test or oversees test execution by a contractor or PTO.

• 3.17.6.2. (Added) Coordinate T&E plans with the appropriate test agencies, PTOs, and all other stakeholders. (T-2)

• 3.17.8.1. (Added) Utilize valid test measurement and data acquisition methods in the reporting of test results.

• 3.17.10. (Added) Coordinate with PTOs to ensure corporate expertise and required capabilities are used to support PMs.

• 3.17.11. (Added) Conduct Technical Review Boards (TRB) and Safety Review Boards (SRB).• 3.17.12. (Added) Participate on Configuration Control Boards (CCB), product improvement working

groups, and test management councils as requested by the PM.• 3.17.13. (Added) Ensure T-2 modifications on aerospace vehicles are approved IAW AFMCI 21-126,

Temporary 2 (T-2) Modification of Aerospace Vehicles and AFI 62-601, USAF Airworthiness, or by the PM (or designated representative) for all other systems.

• 3.17.14. (Added) Provide oversight of combined DT&E and OT&E flight testing until the safety of the modification has been verified

29


Waivers?!?!

• Waivers are required if any provisions of AFI guidance or policy can not be met in the pursuit of an LDTO or Alternate-LDTO designation.

• All proposed waiver submissions should contain the general/background information specified in AFI 33-360, Para 1.9.


New Candidate LDTO

• If the best LDTO candidate isn’t on the list, provide supporting information to questions on next slide with Form 42 so you can get them ADDED to the approved candidate list. Then your office (and others) can benefit in the future.

• 11 questions concerning the organizations documented processes for test planning, execution, tech & safety reviews, test reporting, manpower and resources available, etc.

– Asks about capacity to accomplish responsibilities in 99-103 para 3.17

– Currently, questions are in Enclosure 4 of Interim Policy

– Expect they will be in Attachment 3 of the supplement when released


LDTO Selection Data1. Does the proposed LDTO possess a documented process for the test planning function, to include a technical review, safety review, risk assessment and test hazard analysis of the program prior to test execution? 2. Does the proposed LDTO possess a documented process for accomplishing test execution? 3. Does the proposed LDTO possess a documented process for providing timely test results and deficiency reporting? 4. Does the proposed LDTO have documented evidence of possessing (or having access to) the appropriate manpower and resources necessary to accomplish test planning, test execution and the test reporting functions? 5. Does the proposed LDTO possess a qualified workforce with the requisite mission experience, T&E APDP or DoDI 8570 (for DBS systems) credentials and management expertise required to accomplish the proposed tests? 6. Does the proposed LDTO possess, or have access to, the required test resources to thoroughly evaluate the system under test? 7. Does the proposed LDTO have the capability and capacity to accomplish the responsibilities described in AFI 99-103, paragraph 3.17? Has the LDTO agreed to accept the test effort? 8. Is the proposed LDTO an inspectable unit, subject to compliance inspections by AFMC/IG or other Air Force or DoD inspection processes? 9. Is the proposed LDTO an independent and unbiased organization, removed from any conflict-of-interest with the program office requesting the test support? Does the LDTO report to a management chain outside the PEO for the SUT? If not, describe the degree of independence that exists. 10. For PTO and contractor testing, does the proposed LDTO have the ability to adequately manage and oversee their test planning, execution and reporting? 11. List the organizations from the LDTO Candidate List (Enclosure 1), which were considered, but not selected, and justification for each decision. 32


Resources

• AFLCMC LDTO Standard Process has lots of extra info:– https://cs4.eis.afmc.af.mil/sites/1534/APD/APD/Forms/UserView.aspx

• AFMC supplement to AFI 99-103 – Implement the new version of the LDTO Designation Form 42, w/

instructions– Latest form at AFMC/A3 LDTO site:

https://cs1.eis.af.mil/sites/afmca3ldto/SitePages/Home.aspx

• If you have questions about the form or process, contact your CTAF

33

Reminder: Forward approved form to AFMC/A3F, the LDTO and CTA

https://cs4.eis.afmc.af.mil/sites/1534/APD/APD/Forms/UserView.aspx

https://cs1.eis.af.mil/sites/afmca3ldto/SitePages/Home.aspx

AFLCMC… Providing the Warfighter’s EdgeAFLCMC/AZT CTA Chief (T&E Center Senior Functional) Dr. Beverley Gable (785-9269)Branch Chief, Program Support Mike Loosbrock (DSN785-7529) Agile Combat Support Directorate - AFLCMC/WNEW/Avionics, Human Systems Integration, Simulators, Combat Electronics, Targeting Pods, Automatic Test Sys, Support Eq. – WPEW - Robins

Orlando Grino (WP) (DSN 785-7516)Sam Huggins (Robins) (DSN 472-2680)

ISR & SOF Directorate - AFLCMC/WIRecon/Special Ops, Global Hawk, Predator/Reaper, 645 AESG “Big Safari” – WPC-130, UH-1, HH-60, U-2 - Robins

Joe Twarek (WP) (DSN 785-8988)Sam Huggins (Robins) (DSN 472-2680)

Fighter/Bomber Directorate - AFLCMC/WWB-1, B-2, B-52, F-15/16/22/35, A-10 – WPF-15 – RobinsF-16, A-10 – HillB-1, B-52 - Tinker

Jeff Colpitts (WP) (DSN 986-7818)Sam Huggins (Robins) (DSN 472-2680)

Robert Lamb (Hill) (DSN 586-1883)Daniel Llewelyn (Tinker) (DSN 336-4110)

Mobility Directorate - AFLCMC/WLC-5/17/27/130, LAIRCM, Aircraft Survivability, Tactical Airlift, JPATS, PAR, Trainers - WPC-130, C-5 - Robins Commercial Derivative Aircraft, E-9, T-1, USAFA Aircraft - Tinker

Russ Burks (WP) (DSN 785-7515)Sam Huggins (Robins) (DSN 472-2680)

Daniel Llewelyn (Tinker) (DSN 336-4110)

Tanker Directorate – AFLCMC/WK KC-10,46,135 – WPMAPA - HillC/KC-135, KC-10 - Tinker

Russ Burks (WP) (DSN 785-7515)Robert Lamb (Hill) (DSN 586-1883)

Daniel Llewelyn (Tinker) (DSN 336-4110)

Business Enterprise Systems - AFLCMC/HI Orlando Grino (Gunter/WP) (DSN 785-7516)Mike Harrington (Hanscom) (DSN 845-1661)

AFLCMC CTA Support toAcquisition Directorates/Programs

AFLCMC… Providing the Warfighter’s EdgeElectronic Systems Complex: Hanscom AFB Pete Vilcans (DSN 845-1662)

Battle Management – AFLCMC/HB (AWACS, mission planning, air space management) - HanscomE-8 Joint Stars, DCGS - RobinsE-3, ATCALS – TinkerSpace & C3I - Hill

Mike Harrington (Hanscom) (DSN 845-1661) Sam Huggins (Robins) (DSN 472-2680)

Daniel Llewelyn (Tinker) (DSN 336-4110)Robert Lamb (Hill) (DSN 586-1883)

C3I / Networks – AFLCMC/HN (Hanscom) Vacant (DSN 845-XXXX)

Strategic Systems – AFLCMC/SS (Kirtand AFB) POC: AFNWC CTA

Air Armament Complex: Eglin AFBArmaments – AFLCMC/EB (Weapons, munitions)Munitions Sustainment - Hill

Vacant(Mike Loosbrock acting POC)

Robert Lamb (Hill) (DSN 586-1883)

AFSAC Directorate – AFLCMC/WF (LOA/LOR Support) - WP FMS Program Support: WW, WI, WL, WK, WN - WP Terrence Manuszak (DSN 785-XXXX)

AF Sustainment Center (AFSC)- Hill Robert Lamb (Hill) (DSN 586-1883)

Branch Chief, Workforce ManagementLouis Alliod (DSN 674-5829)

T&E Workforce Development / Personnel ActionsT&E Statistical Methods & Design of Experiments

Vacant (DSN TBD)Preeta Gupta (DSN 785-7554)

Branch Chief, Test Technical/Safety Reviews Phillip Tharp (DSN 674-5492)

AFLCMC CTA Support toAcquisition Directorates/Programs (Cont)

AFLCMC… Providing the Warfighter’s EdgeDirectorate / PEO T&E OSF

AFSAC (WF) N/R

Agile Combat Support (WN) PendingBattle Management (HB) Stephen Falcone (DOE acting, GS-15)

Business & Enterprise Systems (HI) Toy Robinson (DOE acting, GS-15)C3I & Networks (HN) TBDFighter/Bomber (WW) Reagan Toler (GS-14)ISR & SOF (WI) LTC Jason GeitgeyTanker (WK) TBDMobility (WL) Paul T. Cross (GS-14)Propulsion (LP) N/RArmaments (EB) Bruce Young (DOE acting, GS-15)

Directorate T&E Organization Senior Functionals* (OSFs)

AFLCMC CTA Chief is Center Senior Functional for T&E *Ref: AFMCI 36-2645


37

Questions?


Back up slides

38


39


40

LDTO Designations - Defense Acquisition University · LDTO Designations AF Life Cycle Management...

Documents

Transcript of LDTO Designations - Defense Acquisition University · LDTO Designations AF Life Cycle Management...