11

CM HOW-TOCM HOW-TO

DETAILED DISCUSSIONDETAILED DISCUSSION

22

OBJECTIVEOBJECTIVE

Upon completion of this training Upon completion of this training you will demonstrate an you will demonstrate an understanding of how to perform understanding of how to perform a CM evaluation.a CM evaluation.

33

REVIEW QUESTIONSREVIEW QUESTIONS

Why are both a Why are both a macro and micro macro and micro approach taken approach taken when evaluating when evaluating CM?CM?

Describe Phase 1 Describe Phase 1 and 2 work at INPOand 2 work at INPO

What is the What is the relationship of relationship of Appendix 2 to Appendix 2 to Appendix 1 of the Appendix 1 of the How-To?How-To?

How should How should Appendix 1 and 2 Appendix 1 and 2 be used during the be used during the evaluation?evaluation?

How might the How might the perception of perception of margin differ margin differ between between engineering and engineering and operators?operators?

What is the main What is the main difference in the CM difference in the CM delta assessment delta assessment sheet?sheet?

44

REVIEW QUESTIONSREVIEW QUESTIONS

Why are Phase 1 Why are Phase 1 and 2 key to a and 2 key to a successful CM successful CM evaluation?evaluation?

Of what value is the Of what value is the CM questionnaire?CM questionnaire?

Why must a CM Why must a CM evaluator always evaluator always keep in mind the keep in mind the status of the status of the enablers? enablers?

What are some What are some bases for limiting bases for limiting on-site scope?on-site scope?

Explain the Explain the difference between difference between a fundamental and a fundamental and high level attribute.high level attribute.

For what two For what two functional areas functional areas must the CM must the CM evaluator/analyst evaluator/analyst determine if a focus determine if a focus is needed on-site? is needed on-site?

55

CM HOW-TOCM HOW-TO

CM is a broad CM is a broad area to evaluatearea to evaluate

Many plant Many plant functional functional departments departments support CMsupport CM

66

APPROACHAPPROACH

Method based on 3 pilotsMethod based on 3 pilots Addressing Addressing

enablers/attributesenablers/attributes

– General approachGeneral approach

– MACRO & MICRO MACRO & MICRO approachapproach

– 11STST and 2 and 2NDND pilots pilots addressed all addressed all attributesattributes

– 33rdrd pilot limited work pilot limited work on site (reduced team on site (reduced team size) station buy-in size) station buy-in on site scopeon site scope

Must narrow scope Must narrow scope of site workof site work

Must identify issues Must identify issues early for E3 early for E3 successsuccess

FOPs are the FOPs are the organizational organizational weaknessesweaknesses

Must make early Must make early call on functional call on functional areasareas

77

TWO PHASES OF REVIEW/ANALYSIS TWO PHASES OF REVIEW/ANALYSIS AT INPOAT INPO

KEYS TO SUCCESSKEYS TO SUCCESS Phase 1Phase 1

– Determine focus Determine focus areasareas

– Determine Determine additional specific additional specific information information neededneeded

Phase 2Phase 2

– Review detailed Review detailed documentsdocuments

– Prepare details for Prepare details for site worksite work

88

PHASE 1PHASE 1

Review normally Review normally requested inforequested info– Includes CM Includes CM

questionnairequestionnaire– Determine vertical Determine vertical

reviews and potential reviews and potential issuesissues

– Request specific Request specific documentsdocuments

– Document examples: Document examples: ODs, DBDs, Mods, ODs, DBDs, Mods, AOPs, NOPs, eng. Evals, AOPs, NOPs, eng. Evals, 50.59s, calcs, complete 50.59s, calcs, complete condition reports, condition reports, specs, program specs, program documents, etc.documents, etc.

99

PHASE 2PHASE 2

Review specific Review specific documentsdocuments

Limit on-site scopeLimit on-site scope– Call on functional focus Call on functional focus

(RE &DE)(RE &DE)

– Enablers/attributes not Enablers/attributes not being pursued on sitebeing pursued on site

– Focus areasFocus areas

Develop preliminary Develop preliminary PDSsPDSs

Determine site Determine site activitiesactivities

1010

PHASE 2 Cont’dPHASE 2 Cont’d

Vertical slice Vertical slice (potential for new (potential for new issues) issues) exampleexample

Status Status enabler/attribute listenabler/attribute list

Evaluation plan 95% Evaluation plan 95% completecomplete

Functional area Functional area focus callfocus call

1111

PILOT EXPERIENCEPILOT EXPERIENCE

It took 10 man-It took 10 man-days for phase 1 days for phase 1 & 2& 2

Counterpart Counterpart relationship is relationship is key to a key to a successful CM successful CM evaluationevaluation

1212

OBSERVATIONSOBSERVATIONS

Observation for Observation for each enablereach enabler

Team Manager Team Manager reports to site reports to site management on an management on an enabler basisenabler basis

Paints a better CM Paints a better CM picturepicture

CM evaluator owns CM evaluator owns CM enabler CM enabler observationsobservations

1313

COUNTERPARTSCOUNTERPARTS

Counterpart team part Counterpart team part of eval teamof eval team

Continually reinforce Continually reinforce E3 process E3 process (counterpart (counterpart appreciation of CM appreciation of CM effect on other effect on other departments)departments)

Explain precursor Explain precursor AFIsAFIs

Explain less focus on Explain less focus on examples and more examples and more on whyson whys

1414

HEADS UPHEADS UP

Expected to provide Expected to provide input to management input to management model (late first week) model (late first week) Key in discussing whysKey in discussing whys

Mark OEO bubble chart Mark OEO bubble chart to indicate strong or to indicate strong or weak areas by 2weak areas by 2ndnd Thursday Thursday (do not assess)(do not assess)

Debrief as a team Debrief as a team (focus on whys – (focus on whys – example)example)

1515

MOST USEFUL UPFRONT INFO MOST USEFUL UPFRONT INFO ON THE 3 PILOTS ON THE 3 PILOTS

Event infoEvent info System health System health

reportsreports CAP databaseCAP database DBDsDBDs NRC reportsNRC reports 50.54 response 50.54 response

documentsdocuments Vertical slice Vertical slice

summary reportssummary reports Engineering Engineering

evaluationsevaluations

Specific calcsSpecific calcs Specific modsSpecific mods Specific temp modsSpecific temp mods ODsODs Specific 50.59sSpecific 50.59s Self-assessmentsSelf-assessments Specific program Specific program

documentsdocuments Specific proceduresSpecific procedures

1616

HOW TO WALKTHROUGHHOW TO WALKTHROUGH

Main document (Key Points)Main document (Key Points)– Must narrow scope of work on siteMust narrow scope of work on site– Have observations and preliminary PDSsHave observations and preliminary PDSs– INPO must status all OEOs to utility CEOINPO must status all OEOs to utility CEO– Responsible for functional area calls on RE Responsible for functional area calls on RE

and DEand DE– Analysis at INPO is part of evaluationAnalysis at INPO is part of evaluation– Fundamental and high level attributesFundamental and high level attributes– Micro and Macro approachMicro and Macro approach– CM performance problems CM performance problems (example)(example)

1717

ATTACHMENT 1, EVALUATION ATTACHMENT 1, EVALUATION APPROACHAPPROACH

An attempt to get to specific An attempt to get to specific actionsactions– Vertical sliceVertical slice

– Specific activitiesSpecific activities

– Program reviewsProgram reviews

– Process reviewsProcess reviews

– Passive component reviewsPassive component reviews

– Power UpratesPower Uprates

– Operating MarginsOperating Margins

1818

ATTACHMENT 2, ATTACHMENT 2, ENABLER/ATTRIBUTE LISTENABLER/ATTRIBUTE LIST

Cross reference to Cross reference to info request items info request items and attachment 1 and attachment 1 itemsitems

Suggested actionsSuggested actions Attribute meaningAttribute meaning Status during evalStatus during eval

1919

ATTACHMENT 3, MARGIN ATTACHMENT 3, MARGIN MODELMODEL

Common Common terminology for terminology for discussions with discussions with counterpartscounterparts

Based on Based on NSAC/125NSAC/125

Does not include Does not include safety margin safety margin terminologyterminology

2020

ATTACHMENT 4, CM ATTACHMENT 4, CM QUESTIONNAIREQUESTIONNAIRE

Analyze for trends and insightsAnalyze for trends and insights Pilot resultsPilot results Share results with counterpart Share results with counterpart

(opportunity to get counterparts (opportunity to get counterparts involved)involved)

Support services puts data on Support services puts data on Excel spread sheetExcel spread sheet

2121

ATTACHMENT 5, ATTACHMENT 5, INFORMATION REQUESTINFORMATION REQUEST

A lot of information to look at A lot of information to look at during Phase 1 during Phase 1

2222

ATTACHMENT 6, CM ATTACHMENT 6, CM PROGRAMSPROGRAMS

Pilot evaluations were based on margin Pilot evaluations were based on margin managementmanagement

Going forward focus is on specific programs Going forward focus is on specific programs (listed in attachment 1)(listed in attachment 1)

Going forward evaluate programmatic aspects Going forward evaluate programmatic aspects alsoalso

Evaluate programs identified in Attachment 1 Evaluate programs identified in Attachment 1 (depth of review should be based on (depth of review should be based on indications of weaknesses)indications of weaknesses)

Other programs identified in Attachment 6 Other programs identified in Attachment 6 should be evaluated based on review/analysis should be evaluated based on review/analysis of plant info of plant info

2323

ATTACHMENT 7, CM ATTACHMENT 7, CM ASSESSMENTASSESSMENT

Process similar to Process similar to existing processexisting process

Evaluator to provide Evaluator to provide information to the information to the group. group. The wisest of The wisest of men cannot answer all men cannot answer all the questions of a the questions of a fool.fool.

Delta sheet to contain Delta sheet to contain a narrative for each a narrative for each

enablerenabler (see (see attachment 9) attachment 9)

2424

ASSESSMENT CRITERIA, ASSESSMENT CRITERIA, ATTACHMENT 8ATTACHMENT 8

Latent Latent weaknesses that weaknesses that are not affecting are not affecting plant plant performance performance (1&2)(1&2)

CM weaknesses CM weaknesses are affecting are affecting plant plant performance (3-performance (3-5)5)

2525

DISCUSSION EXAMPLESDISCUSSION EXAMPLES

– CNS EQCNS EQ

– Comanche Peak Comanche Peak AFW modAFW mod

– Seabrook Seabrook equipment data equipment data basebase

– Comanche Peak Comanche Peak power upratepower uprate

– CNS CCWCNS CCW

– Comanche Peak Comanche Peak fuel fuel