U.S. Department of Energy Office of Civilian Radioactive ... · - Assure consistency and...

U.S. Department of EnergyOffice of Civilian Radioactive Waste Management

TSPA-SR IssuesManagement Plan

Presented to:DOE/NRC Quarterly QA Meeting

..- / ,. I / / 1

Introduction

Recent Quality Concerns- 2 CARs

* Model Validation

* Software

- TSPA-SR Quality Concerns

* NRC Telecons (May 4 and 9, 2001)

* NRC Letter (May 17, 2001)

Ym p Yucca Mountain Project/Preliminary Predecisional Draft Materials 613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 2

Systematic Continuing Issues

* February 12, 2001 - BSC Assumed Prime ContractorRole on YMP

* Evidence of Continuing Quality Problems

* Initiated Management Plan to Correct QualityProblems

YA V Yucca Mountain ProjectlPreliminary Predecisional Draft Materials 613-Williamns-QA-Mtg-TSPA-Mgt-Plan.ppt 3

Quality Initiative Issues

* Document Integrity- Quality and traceability of documents and analytical models

that will be subject to the public process

Root Cause Determination (2 CARs)- Root cause assessment and action plan for

* Model Validation

* Software Verification

YM P Yucca Mountain Project/Preliminary Predecisional Draft Materials 613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 4

Chronology

5/4-1712001 - Identification of errors by NRC and subsequenttelephone calls / correspondence with NRC

* 5/18/2001 - BSC Board Meeting

* 5/22/2001 - Bechtel mobilizes executive management team

5/29/2001 - Bechtel mobilizes senior project management team fromOak Ridge and Denver to finalize action plan

* 6/4/2001 - Bechtel executive management approves Quality Initiativeaction plan

6/4/2001 - Mobilization to support plan

Y M SP Yucca Mountain Project/Preliminary Predecisional Draft Materials 613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 5

Quality Initiative Goals

* Assure the quality/sustainability of technicalreports/analyses supporting the YMP work

* Establish process improvements toperformance for continuing phases

improve projectof work

IYJ VP Yucca Mountain ProjectPreliminary Predecisional Draft Materials,"', amendment, � A� ��; I'll,

613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 6

Overview

* Systematic Approach

* Regular Reporting on Progress and Results

* Immediate Corrective Actions

* Short Term Corrective Actions

* Longer Term Corrective Actions (Based on QualityInitiative Investigations)

* Highly Experienced Diverse Team

YM P Yucca Mountain ProjectlPreliminary Predecisional Draft Materials 613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 7

Action Plan Scope

* Immediate/Short Term Actions

Short Term (through end of FY01)

- Document Integrity- Management Stand-Down on Software Development

- Root Cause Assessments

Long Term and Ongoing Actions

- Process Improvements

- Responsibility/Accountability

Y M P Yucca Mountain ProjectPreliminary Predecisional Draft Materials 613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 8

Document Integrity Strategy

Horizontal review across key documents

- assure consistency of inputs and conclusions

Vertical reviews of the SSPA documents andsupporting analysis (both volumes)

- assure consistency and traceability

* Vertical review of TSPA Rev. 0, ICN 1

- assure traceability, consistency, linkage tosupporting models

Y M p Yucca Mountain Project/Preliminary Predecisional Draft Materials 613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 9


Horizontal Reviews- DEIS Supplement, S&ER, SSPA Volumes I & 2, and

TSPA Rev. 0, ICN 1

- Ensure consistency of technical inputs andconclusions

- DEIS Supplement and S&ER will be pace settingdocuments since they are already issued

- Duration:* 3 weeks review

* I week comment incorporation

YM P Yucca Mountain ProjectlPreliminary Predecisional Draft Materials 613-Williains-QA-Mtg-TSPA-Mgt-Plan.ppt 10


* Vertical reviews of the SSPA documents andsupporting analysis

- Assure consistency and traceability

- Each volume

* Staggered Overlapping Reviews* Duration:

> 2 weeks review

> 1 week comment resolution

TrM Ar" Yucca Mountain ProjectPreliminary Predecisional Draft Materials 613-Williams-OA-Mtg-TSPA-Mgt-Plan.pot

11111_ _ . .

Document Integrity Approach

Prepare review guidance checklists- Reference checks

- Consistency checks

- Traceability checks

- Error checks

- Input and output checks

Identify bins for collecting daily review results formanagement review

d Y M neliminay Ped i iSiTal rfNaeials 61;- Wlmp1

J MP~ri Yucca Mountain Project/Preliminary Predecisional Draft Materials 61 3-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 12

Document Integrity Management

Weekly Review of Results

* Upon Completion of 1Management Will Ass

YM P Yucca Mountain ProjectlPreliminary Predecisional Draft Materials

lorizontal and Vertical Reviews:Fess Need for Further Action

~~~~~~63Wilans-AMgTP-g-lnpt1613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 13


* Vertical review of TSPA Rev. 0, ICN 1- assure traceability, linkage to supporting models, and to

identify errors

- Duration:

* 4 weeks review

* 3 weeks comment resolution

I Sk i/ Yucca Mountain Project(Preliminary Predecisiona Draft MaterialsYM>, ~Yucca Mountain ProjectlPreliminary Predecisional Draft Materials61-WlimQAMgTPMtPanpt4- I 11-1


Quality InitiativeResults of Initial Investigation

Programmatic/Process Issues- 4 Deficiency Reports

- 3 CIRS Items

* Technical Issues- were mostly known to technical personnel

- further assessments still in progress

- all assessed to date have minimal or no impact

YM .P Yucca Mountain Project/Preliminary Predecisional Draft Materials 613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 15

TSPA-SR Rev. 0, ICN 1DRs CARCIRS

#1577 - Develop reviewprocess for responses toNRC informal requests

BSC-01-D-078 - Out-of-Bound,< Models

BSC-0I-D-068 - Unqualified codes(WAPDEG & FEHM) used in

V TQP A

#1580 - Investigateerrors identified by NRC

h-P-

YMSC-01 -C-002

Software IssuesX ".L z 1.

I

-

#1581 - Investigateorigination, checking, &approval process

BSC-01-D-077 - Output DTNsrevised or superceded w/odocumentation in reports

BSC-01-D-080 - No DRs developedwhen quality of TSPA wasindeterminate

(~~~~~~~~~~~~~~~~~~~~~~~~}h~~i/0Ml4}i Pear~ gon1m1 i= /


Corrective Action Requests

* Institute Immediate Actions

* Conduct Root Cause Determinations- Model Validation (May 3, 2001)

- Software Verification (June 2001)

IY MlP Yucca Mountain Project/Preliminary Predecisional Draft Materials

mand "'I N -- lx � �r- - - --613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 17


Initial Immediate Actions

- BSC Management stand-down to control the furtherdevelopment of software (June 7, 2001)

- Initiated teams to begin model validation and softwareverification actions immediately

- Initiated formal root cause analysis in compliance withprocedural requirements (June 4, 2001)

- General Manager Meeting to Emphasize Expectations(June 11, 2001)

YA V Yucca Mountain ProjectlPreliminary Predecisional Draft Materials 613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 18


* Formal Root Cause Analyses- Single Team Will Conduct Both Root Cause Analyses to

Ensure Integration of Common Causes

* Model Validation

* Software Verification

- Utilize Tap Root Process (Mandated by Project Procedures)

IYM P Yucca Mountain ProjectPreliminary Predecisional Draft Materials11,17' -�e' �IZAI'�:



Root Cause Assessments- Team Composition

* Team Leader* Technical Experts and Independent Outside Consultants

* Project Liaison* Administrative Support

Y M -Y ucc M rri- -_ X 6Atan#t 20

1'7M 1J Yucca Mountain ProjectiPreliminary Predecisional Draft Materials 61 3-Williams-QA-Mtg-TSPA-Mgt-Plan ppt 20


* Immediate Actions: Model Review- Initiate a review of the existing models that lack

compliant validation and document the results ofthe review

- Review will categorize:

* adequate confidence for intended use in SR butrequiring further documentation prior to LA

* inadequate confidence in the use of the model forSR requiring immediate impact assessment orfurther validation

W Y MiI, j, isoa Dr M rYM P Yucca Mountain Project/Preliminary Predecisional Draft Materials 6 13-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 21

Model ValidationDRs STIR CAR

LVMO-00-D-046 - Draft UZ testconceptualization model validation doesnot meet AP-3.I OQ, Rev 1, JCN 1(Closed into DR- 119)

LVMO-00-D- 119 - Sampling of AMRsused to support TSPA-SR foundinadequate documentation of modelvalidation

STIR BSC-01-004Concluded thatmany modelsacross a broadrange ofAnalysis/ModelReports were notin compliancewith proceduralrequirements forvalidation

YMSC-01 -C-001

Ineffective correctiveaction regardingmodel validationLVMO-00-D 151 - Igneous Consequence

Modeling AMR contains modelvalidation deficiencies

LVMO-01-D-007 - SZ radionuclidetransport model validation is unclear

LVMO-O1-D-050 - four models in EBSPhysical and Chemical EnvironmentalModel AMR used subjective criteria notdelineated in procedure for validation

O W W idg , , v,;YM P Yucca Mountain Project/Preliminary Predecisional Draft Materials 61 3-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 22


* Immediate Actions: Software- Software Review

* Review existing software and prepare appropriate verificationdocumentation

* Initiate revisions to the software procedures to provideappropriate requirements and controls for softwaredevelopment and configuration control

hf ,.If 7 fflf_-_~~~~uc Monti Prjet/rlimnr Prendecsiona Drf Maeral 61 d -WilfiarsQ-t-TP- - Ia Xpp 23_


-' I

Longer Term Actions

Procedure Revisions/Enhancements

* Baseline Management/Controls

* Corrective Actions Identified by Root CauseDetermination

YM P Yucca Mountain ProjectPreliminary Predecisional Draft Materials 613-Williains-QA-Mtg-TSPA-Mgt-Plan.ppt 24

Impact of Unqualified Data and Software

* Compile unqualified/TBV inventory

* Identify information not needing qualification

* Conduct vertical trace from source to TSPA-SR input parameter

* Determine significance to TSPA-SR input parameter and results

* Prepare documentation of findings

* Prepare summary of conclusions

* Review prior to release

IY M P Yucca Mountain ProjectlPreliminary Predecisional Draft Materials'r �2,, , ��

6 13-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 25

U.S. Department of Energy Office of Civilian Radioactive ... · - Assure consistency and...

Documents

Transcript of U.S. Department of Energy Office of Civilian Radioactive ... · - Assure consistency and...