Taylor.randall

NASA PM Challenge 2009

February 24–25, 2009

This document has been reviewed for export control and it does NOT contain controlled technical data. Copyright 2009 California Institute of Technology . Government sponsorship acknowledged.

Preparing for anNPR 7120.5D Life-Cycle ReviewRandall L. TaylorGRAIL Project Acquisition Manager/Review CaptainJet Propulsion LaboratoryCalifornia Institute of Technology

Taylor This document has been reviewed for export control and it does NOT contain controlled technical data. 1

Agenda• The GRAIL mission• Preparing for a NASA Procedural Requirements (NPR)

7120.5D Preliminary Design Review (PDR)– Organization– Pre-PDR reviews– Gate products– Presentation materials– IT and logistics– Standing Review Board (SRB) coordination

• Summary


The GRAIL Mission• The Gravity Recovery And Interior Laboratory (GRAIL)

mission was selected by NASA as a Discovery Program project

• The NASA Science Mission Directorate (SMD) utilized the competed missions (Announcement of Opportunity) process– GRAIL was one of three proposals selected to perform Phase A

concept studies– GRAIL was the single proposal selected to perform Phase B

preliminary design

• GRAIL is PI-led (Dr. Maria T. Zuber, MIT) and JPL-managed• Key development dates:

– Jan. 2008: Start of Phase B– Apr. 2008: Project Mission System Review (PMSR)– Nov. 2008: Project PDR– Jan. 2009: Confirmation Review/Key Decision Point (KDP)-C


The GRAIL Mission (cont.)• Science objectives:

– Determine structure and interior of Moon, from crust to core

– Understand thermal evolution of Moon– Extend knowledge to other terrestrial

planets• Mission outline:

– Twin S/C launched on aDelta 7920H-10

– 9-month mission; launch in Sep 2011– Low altitude, 50-km polar orbit– 90-day primary mapping mission– Spacecraft operate at ~200 km

separation– Extensive science data analysis– E/PO MoonKam cameras engage

public – Heritage: GRACE-like mission concept– Heritage: S/C from LM: XSS-11– Design concept requires no new

technology

• Science measurements and payload:– Ka-band ranging system (with

GRACE heritage) measures relative velocity of CM of 2 spacecraft

– DSN used for absolute position determination

• Mission management:– MIT: PI, SRS contract for E/PO– GSFC: DPI, gravity science modeling

and data analysis– JPL: PM, SE, MA, MO & GDS,

Payload, LM spacecraft system contract, data processing


The GRAIL Mission (cont.)

Watkins


PDR Preparation: Organization• The project established a review preparation team with key roles:

– Review Captain • Team Leader• Lead for gate products and presentation materials instructions, guidelines,

interpretations, content review• Supported by project schedule analyst

– Documentation Lead• Lead for gate products and presentation materials formatting, editing, production• Supported by other technical writers and reproduction contractor

– Information Systems Lead• Lead for file formats, data repositories, access privileges• Supported by project librarian, CM engineer, and export technical representative

– Logistics Lead• Lead for review site selection, arrangements, equipment, attendee support services• Supported at the actual review by high-potential volunteers (who wanted to observe

a project review)

• The team employed a detailed preparation schedule to make sure all actions were identified, assigned, and completed on time


PDR Preparation: Schedule


PDR Preparation: Schedule (cont.)


Pre-PDR Reviews• NPR 7120.5D requires, at time of Project PDR, a project Integrated Baseline

– Technical, schedule, cost – Includes “a series of in-depth assessments of selected critical work elements of the

WBS…”• GRAIL employed a disciplined process to establish requirements • As proposed, GRAIL conducted a battery of Inheritance Reviews (IRs)

(May–June 2008)– 13 element IRs covered all spacecraft subsystems and all instrument assemblies– Top-level assessment at Flight System IR (July 2008)– Added additional IR for alternative avionics approach (Aug. 2008)

• As proposed, GRAIL conducted a battery of pre-PDR reviews(Aug.–Oct. 2008)

– 20 element PDRs/Technical Interchange Meetings (TIMs) covered all spacecraft subsystems and all instrument assemblies; also covered requirements, V&V, and mission design and navigation

– Top-level assessment of the instrument at Payload PDR (Nov. 2008)• All reviews had board reports, Recommendations for Action (RFAs), and project

responses


Pre-PDR Reviews: Schedule


Gate Products• NPR 7120.5D and NPR 7123.1 specify gate products as entrance criteria for the

review/deliverables to support the KDP• In addition to the NASA gate products, JPL Flight Project Practices require additional gate

products• Gate product content and format are not always clear

– GRAIL Review Captain was a member of NPR 7120.5D writing team– He and JPL Project Support Office provided instructions and made interpretations as required– In many cases NASA or JPL templates exist (e.g., NASA 7120.5D template for Project Plan, JPL

template for Project Acquisition Plan)– In other cases NASA or JPL instructions exist (e.g., NASA Safety Standard instructions for orbital

debris assessment)– Also available were examples from other projects (e.g., Juno project’s Science Data Management

Plan)• Product generation instructions were issued• GRAIL developed a detailed tracking matrix to ensure all gate products were identified,

assigned, reviewed, and signed in a timely manner– NASA gate products—required to be delivered to the SRB in advance of the PDR – Priority #1

• Some require JPL Process Owner review – JPL gate products requiring JPL process owner review – Priority #2– Other JPL gate products—Priority #3

• Review Captain determined methods for project internal review• Documentation Lead provided GRAIL-formatted document shells, and her team provided

custom graphics, technical editing, etc. as requested by the authors• Logistics Lead coordinated signatures, both on-site and remotely from a nationally

distributed team


Gate Products (cont.)


Presentation Materials• GRAIL took a thoughtful approach to defining the PDR agenda

– Tell the GRAIL story—each day of the review had a theme:• Day 1: What is GRAIL?• Day 2: What will fly?• Day 3: What supports it?• Day 4: SRB deliberations (and supplementary project presentations)

• The project employed an Outline Review well in advance • To make decisions early—no text slides allowed!

– Presenters brought in stub slides (title, key points, identification of photos/tables/graphics/video clips/etc.)

– Resulted in moving material between presentations; moving material to backup (or primary); revising flow of presentations (delta Agenda); adjusted time allocations; identified slide types for standardization

• Slide generation instructions were issued• Later the project employed a Dry Run

– Included a Do-Over Day• Finalization instructions were issued

– Followed by mini-team scrub (including export compliance)


IT and Logistics• IT needs to be designed-in from the beginning

– Engineering environment for project work (e.g., project library, Product Data Management System, electronic conferencing, etc.)

– Access controls (including participation of Foreign Persons)• For the PDR, identify the equipment (with backups) and the operators

– Cover project needs, SRB needs, and attendee needs• Logistics must start early

– Key decision: Review on-base or off? (Book early)– Arrange facility, equipment, technical support, administrative support– Key decision: Who should and should not attend?

• Include precautions for Foreign Persons

• There are a large number of “little things” that all must be done or the problems won’t be little: Have a checklist


SRB Coordination• The NPR 7120.5B SRB process is a work in progress

– 7120.5D provides the concept and the deliverables• The SRB Handbook provides some how-tos

– The Decision Authorities and the SRB Chairperson and Review Manager (RM) have significant leeway regarding “how” and “when”

• Absolutely critical: start the Board establishment process six months in advance of the first life-cycle review (GRAIL did not and was significantly impacted)

• Almost as critical: start the draft Terms of Reference (ToR) while the nominations are being processed

– Key elements to negotiate: scope of review (any special assessments), pre-review documentation deliveries (including schedule), participation of SRB members in project-internal reviews

• Establish regular communication with the SRB Chairperson and RM– Set up the repository for project deliveries to the SRB– How you deal with the SRB before the review makes your first impression

• There is great value in holding a Kickoff Meeting with the SRB prior to the life-cycle review

– Especially important to convey the project paradigm, key issues and concerns, heritage status, and readiness for the review (i.e., entrance criteria)


Summary• “Haste makes waste”: Beginning late on preparations for a life-cycle

review is asking for trouble• Although the SRB process is evolving, the essentials of preparing for a

life-cycle review are clear– Establish a review organization with clear roles and responsibilities– Identify all required activities and have a detailed schedule– Determine how to handle pre-PDR reviews, gate products, presentation

materials, IT, and logistics– Establish the SRB, and your relationship with it, early and clearly

• Leverage institutional resources and learn from other projects

• More information is available in the IEEE paper “Reducing NPR 7120.5D to Practice: Preparing for a Life-Cycle Review”

• You may request a copy from the author: [email protected]


Backup Slides• NPR 7120.5D Gate Products• NPR 7120.5D Control Plans


NPR 7120.5D Gate ProductsProducts Pre–Ph. A

KDP APhase AKDP B

Phase BKDP C Applicability GRAIL Submittal

Headquarters and Program Products

1. FAD Approved Applicable SMD selection letter

2. Program Requirements on the Project (from the Program Plan) Draft Baseline Update Applicable Program-Level Requirements Appendix (PLRA)

3. ASM Minutes Baseline N/A Waived in 7120 for competed missions

4. NEPA compliance documentationEnviro Assmt or EIS (if reqd)

Applicable Request for inclusion in Routine Payload E.A.

5. Interagency and International Agreements Baseline N/A Per SMD, no international agreement required for French

Co-Investigator

Project Technical Products

1. Mission Concept Report Preliminary Baseline Applicable Concept Study Report

2. System Level Requirements Preliminary Baseline Applicable Level-2 requirements; five sets of Level-3 reqts

3. Preliminary Design Report Baseline Applicable Project PDR presentation materials; 20 sets of pre-PDR review presentation materials

4. Missions Operations Concept Preliminary Baseline Applicable Mission Operations Concept Document

5. Technology Readiness Assmt Report Baseline Applicable Technology Readiness Assessment Report

6. Missile System Prelaunch Safety Pkg Preliminary Applicable Missile System Prelaunch Safety Package

7. Detailed Design Report Not Due

8. As-Built H/W and S/W Documentation Not Due

9. Verification and Validation Report Not Due

10. Operations Handbook Not Due

11. Orbital Debris Assessment Initial Preliminary Applicable Orbital Debris Assessment Report

12. Mission Report Not Due


NPR 7120.5D Gate Products (cont.)Products Pre–Ph. A

KDP APhase AKDP B

Phase BKDP C Applicability GRAIL Submittal

Project Planning, Cost, and Schedule Products1. Work Agreements for next phase Baseline Baseline Applicable Work agreements approval status report

2. Integrated Baseline Draft Preliminary Baseline ApplicableWBS/WBS Dictionary; Integrated Master Schedule; Project Cost Estimate; Project Workforce Estimate; technical baseline contained in the Preliminary Design Report submittal

3. Project Plan Preliminary Baseline Applicable Project Plan4. CADRe Preliminary Baseline Applicable CADRe

5. Planetary Protection PlanPlanetary Protection Certification

Baseline Applicable Planetary Protection categorization letter

6. Nuclear Safety Launch Approval PlanBaseline (msn has nuclear materials)

N/A No nuclear materials on GRAIL

7. Baseline Business Case Analysis for Infrastructure Preliminary Baseline N/A No infrastructure investment by GRAIL

8. Range Safety Risk Mgmt Plan Preliminary N/A Per KSC, this is only applicable to vehicle programs9. Systems Decommissioning/Disposal Plan Not DueKDP Readiness Products1. Standing Review Bd (SRB) Rept Final Final Final Post-PDR2. Proj Mgr Recommendation (includes resp

to SRB Rept, as appl) Final Final Final Post-PDR

3. CMC Recommendation Final Final Final Post-PDR 4. Program Manager Recommendation Final Final Final Post-PDR 5. MD-PMC Recommendation

(for Category I projects only) Final Final Final N/A GRAIL is Category II project

6. Governing PMC Recommendation Final Final Final Post-PDR


NPR 7120.5D Control Plans

NPR 7120.5D Project Plan—Control Plans Pre–Phase AKDP A

Phase A5

KDP BPhase BKDP C Applicability GRAIL Submittal

1. Technical, Schedule, and Cost Control Plan Preliminary Baseline Applicable Technical, Schedule, and Cost Control Plan

2. Safety and Mission Assurance Plan Preliminary Baseline Applicable Systems Safety Plan; Mission Assurance Plan

3. Risk Management Plan Preliminary Baseline Applicable Project Risk Management Plan

4. Acquisition Plan Preliminary Baseline Applicable Project Acquisition Plan

5. Technology Development Plan Baseline N/A No new technology on GRAIL

6. Systems Engineering Management Plan Baseline Applicable Systems Engineering Implementation Plan

7. Software Management Plan Preliminary Baseline Applicable Project Software Management Plan

8. Review Plan Preliminary Baseline Applicable Project Review Plan

9. Mission Operations Plan Preliminary Applicable Mission Operations Plan

10. Environmental Management Plan Baseline Applicable Environmental Management Plan

11. Logistics Plan Preliminary Applicable Logistics Plan

12. Science Data Management Plan Preliminary Applicable Science Data Management Plan

13. Information & Configuration Management Plan Preliminary Baseline Applicable Information & Configuration Management Plan

14. Security Plan Preliminary Baseline Applicable Security Plan

15. Export Control Plan Preliminary Baseline Applicable Export Control Plan

Taylor.randall

Technology

Transcript of Taylor.randall