Harvey elliott

42
PRT 114 03 January 2012 Architecture for Cost Analytics Process Environment 1 of 42 Los Angeles Washington, D.C. Boston Chantilly Huntsville Dayton Santa Barbara erque Colorado Springs Goddard Space Flight Center Johnson Space Center Ogden Patuxent River Washington N Ft. Meade Ft. Monmouth Dahlgren Quantico Cleveland Montgomery Silver Spring San Diego Tampa Taco Aberdeen Oklahoma City Eglin AFB San Antonio New Orleans Denver Vandenberg AFB Tony Harvey Daren Elliott NASA 2012 PM Challenge February 22, 2012

description

 

Transcript of Harvey elliott

Page 1: Harvey elliott

PRT 114 03 January 2012

Architecture for Cost Analytics Process Environment

Architecture for Cost Analytics Process Environment

1 of 42

Los Angeles Washington, D.C. Boston Chantilly Huntsville Dayton Santa Barbara

Albuquerque Colorado Springs Goddard Space Flight Center Johnson Space Center Ogden Patuxent River Washington Navy Yard

Ft. Meade Ft. Monmouth Dahlgren Quantico Cleveland Montgomery Silver Spring San Diego Tampa Tacoma

Aberdeen Oklahoma City Eglin AFB San Antonio New Orleans Denver Vandenberg AFB

Tony Harvey

Daren ElliottNASA 2012 PM Challenge

February 22, 2012

Page 2: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 2 of 42

Project Lifecycle Process Context

Cost Analytics Framework Overview

Fundamental Cost Data Data Iteration Cost Analytics Tools for Cost Analytics Cost Analytics in the

Project Lifecycle

Outline/Agenda

Page 3: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 3 of 42

High-level Project Lifecycle Definition Phase (Pre-Phase A)

Simple Definition of Functionality with Value Proposition (High Level Cost and Schedule )

Acquisition Phase (Phase A) Detailed Definition with Cost and Schedule through End-of-Life

Development Phase (Phases B to D) Cost and Schedule updates

Operation Phase (Phase E) Cost and Schedule Updates

Use Cost Analytics in Each Phase

Project Lifecycle Process Overview

Page 4: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 4 of 42

Definition Phase Acquisition Phase Development Phase Operations Phase

ConceptDefinition

MeasurementCriteria

ProjectDefinition

ManagementDecisions

Cost / ScheduleCalibration

FeasibilityAnalysis

PerformanceAnalysis

ProjectImplementation

ManagementDecisions

ProjectModification/Sustaining

PerformanceAnalysis

Project Analytics Data Store

AnalysisTools

ReportingTools

ProjectDatabase

ProjectManagement

Database

Project Life Cycle Conceptual View

Page 5: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 5 of 42

Infrastructure Goals

Functionality Provide Cost and Schedule Data Management Provide Cost and Schedule Analysis Tools Provide Project Engineering support for Performance analyses Provide Program Management support for Schedule and Budget

excursion analyses

Maintainability Support Easy Database Changes Support Easy Tool Additions Support Data Load/Unload

Page 6: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 6 of 42

Infrastructure Options

Infrastructure Options for Technology Solution Use a Web UI and MS/SQLServer

Hosted on Network Servers Accessible to Authorized Users in NDC domain

Use Desktop Application and Apache Derby Database Installed and Executed on a PC/Laptop Restricted to PC Users Uses Network Drives for inter-User communications

Page 7: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 7 of 42

Users

IP Network / JSC VPN

MOPCost Analysis Data

Authenticated Database

Network Servers

(1) Prepare Cost Data XLS File(s)

(3) File Uploaded into

DB

(2) Log into Infrastructure

to upload

Web Infrastructure

(4) Create Reports

Page 8: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 8 of 42

Network DriveTransfer/Reporting Medium

Embedded Database

(1) Prepare Cost Data XLS File(s)

(2) File Uploaded into

DB

Desktop Infrastructure

UserCost Analysis Data

(3) Export Cost Data and Reports

Page 9: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 9 of 42

Fundamental Cost Data

QUESTION: What do you get when you… ? Identify EVERY Cost Driver and capture them in an Excel Spreadsheet Identify the Schedule Tasks associated with each Cost Item Separate different Cost Data Types into separate Tabs

E.g. Material, Travel, Level of Effort, Software Development scope

ANSWER: Something like…

CxP MOP Cost Analysis Data Requirements (CADRe) CADRe data is a NASA HQ requirement to demonstrate “credible

cost estimates”

MOP delivered CADRe data to HQ up to MOP PDR

A Normalized data format was used for the MOP CADRe data suitable for storage in a relational database

Tecolote developed a CADRe database on an MOD network server

Page 10: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 10 of 42

Changing to Schedule Oriented Cost data

MOP CADRe data was Cost Data allocated to Fiscal Years

When the Schedule changed the Cost data needed to bechanged to re-spread it across Fiscal Years to reflect the Schedule changes

Recently the CADRe data has been redesigned to become Schedule Oriented Cost Items are associated with Schedule Tasks Changes to the Project Schedule automatically re-spread the cost

Page 11: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 11 of 42

CADRe data

What data is supported? Schedule Data

MS/Project files can be used to supply schedule data All costs are associated with a Schedule Task

Work Breakdown Structure (WBS) Data CADRe data can use ANY Project defined WBS All costs are associated with a WBS Item

Travel Cost Data Material Cost Data Level of Effort Cost Data Software Development Cost Data

Page 12: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 12 of 42

Schedule Data

Subject Matter Expert

Schedule Task Name Start End Duration Predecessors % Complete Status DateLow

MultiplierLikeliest Multiplier

High Multiplier

MSProj11 10/3/2011 9/30/2020 2347 10% 15Jun2012 0.9 1 1.2Kickoff 10/3/2011 10/3/2011 0 100% 15Jun2012 1 1 1APA Development 10/3/2011 4/26/2013 410 62% 15Jun2012 0.9 1 1.2APA Design 10/3/2011 10/21/2011 15 1 100% 15Jun2012 0.9 1 1.2APA PBR 10/21/2011 10/21/2011 0 3 100% 15Jun2012 1 1 1APA Implementation 10/24/2011 3/29/2013 375 63% 15Jun2012 0.9 1 1.2APA User Interface 10/24/2011 3/29/2013 375 4 50% 15Jun2012 0.9 1 1.2APA Constraints Checker 10/24/2011 11/2/2012 270 4 70% 15Jun2012 0.9 1 1.2APA Database Manager 10/24/2011 11/9/2012 275 4 60% 15Jun2012 0.9 1 1.2APA Schedule Manager 10/24/2011 8/24/2012 220 4 80% 15Jun2012 0.9 1 1.2

ID Task Name Duration Start Finish Predecessors% Complete

1 Kickoff 0 days 10/3/11 10/3/11 100%

2 APA Development 410 days 10/3/11 4/26/13 62%

3 APA Design 15 days 10/3/11 10/21/11 1 100%

4 APA PBR 0 days 10/21/11 10/21/11 3 100%

5 APA Implementation 375 days 10/24/11 3/29/13 63%

6 APA User Interface 375 days 10/24/11 3/29/13 4 50%

7 APA Constraints Checker 270 days 10/24/11 11/2/12 4 70%

8 APA Database Manager 275 days 10/24/11 11/9/12 4 60%

9 APA Schedule Manager 220 days 10/24/11 8/24/12 4 80%

10/3

10/21

Qtr 4 Qtr 1 Qtr 2 Qtr 3 Qtr 4 Qtr 1 Qtr 2 Qtr 3 Qtr 4 Qtr 1 Qtr 2 Qtr 32011 2012 2013 2014

Page 13: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 13 of 42

WBS Data

WBS # WBS Name

1. Another Planning Application1.1 APA Management1.2 APA Development1.2.1 APA Systems Engineering1.2.2 APA Implementation1.2.2.1 APA User Interface1.2.2.2 APA Constraints Checker1.2.2.3 APA Database Manager1.2.2.4 APA Schedule Manager1.2.3 APA Deployment1.3 APA Sustaining1.4 APA Modifications

Page 14: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 14 of 42

Single Config

QtyNum

Configs

Unit Spares

Qty Assoc. TaskCost

DistributionLow

MultiplierLikeliest Multiplier

High Multiplier FY11 FY12

1 1 - APA Development Start 0.90 1 1.2 $0 $5,253

Material Cost Data

WBS # WBS NameActivity

TypeMaterial

Type Material Description BOEPurchase

TypeUnit Price

$FY of price

1. Another Planning Application Dev COTS HW Development Server BOM #3 Buy $5,000 10

Schedule Task Name Start End Duration

MSProj11 10/3/2011 9/30/2020 2347Kickoff 10/3/2011 10/3/2011 0APA Development 10/3/2011 4/26/2013 410

Page 15: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 15 of 42

Travel Cost Data

BY of price Assoc. Task

Cost Distribution

Low Multiplier

Likeliest Multiplier

High Multiplier FY11 FY12 FY13 FY14

10 APA Development Level 1 1.1 1.2 $0 $9,855 $5,783 $0

Schedule Task Name Start End Duration

MSProj11 10/3/2011 9/30/2020 2347Kickoff 10/3/2011 10/3/2011 0APA Development 10/3/2011 4/26/2013 410

WBS # WBS NameActivity

TypeNum

PeopleNum Trips

Num Days /Trip

Per Diem

Daily Lodging

Cost

Trip Travel Cost

BY of price

Total Cost (BY)

1. Another Planning Application Dev 2 4 3 $75 $150 $1,000 10 $13,400

Page 16: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 16 of 42

Level of Effort (LOE) Data

WBS # WBS Name Cost TypeActivity

Type Assoc. TaskLevel of

Effort FY11 FY12 FY13 FY14 FY15

1.1 APA Management FTE Dev APA Development 0.5 - 0.50 0.29 - - 1.2.1 APA Systems Engineering EP Dev APA Design 4.0 - 0.20 - - - 1.2.3 APA Deployment EP Dev APA Deployment 4.0 - - 0.28 - - 1.3 APA Sustaining EP Sus APA Sustaining 2.0 - - 1.02 2.00 2.00 1.4 APA Modifications EP Mod APA Modification - - - - - -

Schedule Task Name Start End Duration

APA Development 10/3/2011 4/26/2013 410APA Design 10/3/2011 10/21/2011 15APA Deployment 4/1/2013 4/26/2013 20APA Sustaining 3/29/2013 9/30/2020 1957

Page 17: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 17 of 42

(SEER) Software Data

WBS # WBS NameCost Type

Activity Type

Size Units

Newly Developed

Size Pre-exists

% change to Pre-exist

1.2.2.1 APA User Interface EP Dev KSLOC 70 - 0%1.2.2.2 APA Constraints Checker EP Dev KSLOC - 81 10%1.2.2.3 APA Database Manager EP Dev KSLOC - 50 10%1.2.2.4 APA Schedule Manager EP Dev KSLOC - 90 10%

Size Reuse

% change to Reuse

COTS Type - Size

# Separate Programs

Software Phase At Estimate Language Application Type

- 0% None 2 Proposal Java Graphical User Interface- 0% None 2 Proposal Java Expert System- 0% None 2 Proposal Java Data Warehousing- 0% None 2 Proposal Java Data Warehousing

Development Method

Development Standard

ROM Size / Staff Year

Staff Years

Assoc. Task for Phase1 FY11 FY12 FY13 FY14

Incremental DO-178B Level C 4.0 8.75 APA User Interface - 5.74 3.01 - RUP Full DO-178B Level C 4.0 3.43 APA Constraints Checker - 3.12 0.30 -

Spiral DO-178B Level C 4.0 1.83 APA Database Manager - 1.64 0.19 - Spiral DO-178B Level C 4.0 3.70 APA Schedule Manager - 3.70 - -

Schedule Task Name Start End Duration

APA User Interface 10/24/2011 3/29/2013 375APA Constraints Checker 10/24/2011 11/2/2012 270APA Database Manager 10/24/2011 11/9/2012 275APA Schedule Manager 10/24/2011 8/24/2012 220

Page 18: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 18 of 42

Data Iteration

Cost Estimation Events are used to record Multiple Data Snapshots in the Database MCR, SDR, PDR, CDR, etc. Quarterly Baseline Reviews Monthly Status Reports Weekly Project Reviews

Multiple data snapshots provide more opportunities for Cost Analysis Performance analyses from comparing two snapshots

Schedule Performance Analyses Cost Performance Analyses

Trending analyses Changes in scope over time Changes in Cost Estimate over time Changes in Schedule over time

Page 19: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 19 of 42

Requirements + Design

Budget

Cost Loaded Schedule

I D Task Nam e

41 SRR42 Design, Fab. Dev. Test …43 CDR44 Dev. Q ual. Unit Fab.45 Dev. Q ual. Test and Modif icat ion46 Q ual . Test Faci l i ty (SSC B2) Avai l abl e47 DCR48 Flight Unit 1-4 Prod.49 Flight Unit 2-4 Prod.50 Flight Unit 3-4 Prod.51 Flight Unit 4 Prod.

4/ 1

10/ 9

9/ 15

11/ 30

2006 2007 2008 2009 2010 2011 2012 2013 2014 2015

A plan to do the work

Work to be done (i.e. estimated labor + material cost)

Effort

Technology

Resources

Productivity Metrics

06 07 08 09 10 11 12 13 14

Cost ProfilesCost

analytics

Basic Cost Analytics

Page 20: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 20 of 42

ProjectCompletion Date

Budget

ExternalEvents

Total Project Cost(w/ LOE)

I D Task Nam e

41 SRR42 Design, Fab. Dev. Test …43 CDR44 Dev. Q ual. Unit Fab.45 Dev. Q ual. Test and Modif icat ion46 Q ual . Test Faci l i ty (SSC B2) Avai l abl e47 DCR48 Flight Unit 1-4 Prod.49 Flight Unit 2-4 Prod.50 Flight Unit 3-4 Prod.51 Flight Unit 4 Prod.

4/ 1

10/ 9

9/ 15

11/ 30

2006 2007 2008 2009 2010 2011 2012 2013 2014 2015

= Source of Uncertainty

Work to be done (i.e. estimated labor + material cost)

Effort

Technology

Resources

Capacity to do work

Utilization

Productivity Metrics

06 07 08 09 10 11 12 13 14

$

p

Emperical Heuristics

Project Risks

Cost Loaded Schedule

A plan to do the work

Cost ProfilesCost

analytics

Extended Cost Analytics

Requirements + Design

Page 21: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 21 of 42

Tools for Cost Analytics

SEER-SEM for Software Estimation

ACEIT for Cost Estimation

ACEIT for Cost and Schedule Confidence Level Analyses

Schedule Comparison for Schedule Performance Analyses

Cost Profile Comparison for Cost Performance Analysis

Page 22: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 22 of 42

Cost Analytics in the Project Lifecycle

Definition Phase (Pre-Phase A) Project Business Case Justification

Acquisition Phase (Phase A) Detailed Budget Analyses

Development Phase (Phases B to D) Development Cost and Schedule Performance Analyses

Operation Phase (Phase E) Operations Cost and Schedule Performance Analyses

Page 23: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 23 of 42

Phases A to EPre-Phase A

Process/ Data Flow Architecture

Project Business Case

Project Scorecard + Detailed Cost / Schedule Data

Planning Data Updates

Updated Cost / Schedule Data

Data Mined from Development

Process

Budget Data

Heuristic Data / Metrics

Project Analytics Database

Project Dashboard

Multi-Project

Dashboard

Page 24: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 24 of 42

Data Collection - Project Definition

Primary Focus is the “Business Case” Use Business Case Surveys Use Business Case Scorecard Use CADRe Detailed Cost Data Collect Risk (Threat) Data Collect “Replaceable” Costs

Costs that will occur if Project is NOT performed Costs that will be replaced if Project IS performed

Create Business Case Summary from input data Summarize detailed cost/schedule data Derive ROI data

Page 25: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 25 of 42

Business Case Data

Status items created include Project Scorecard Cost Profile Savings (ROI) profile Project Schedule/ Milestone Chart

Quantitative Cost Savings $381,000

Category Rating ScoreReuse >80% 27Extensibility Med 9

ReusabilityMultiple Groups 9

Flexibility Significant 15Standards Compliant 27Ops Need Mandatory 45

Ops ScopeMultiple Groups 9

$ Avoidance Med 15

Accessibility Some 12Security Low 18TouchPoints Med 6

192Qual Score Context 56%

Integration Complexity

Qualitative

ROI/NRI after 10 years

Balanced Project Scorecard

Future Software Cost Avoidance

Customer Satisfaction

Page 26: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 26 of 42

Data Collection - Project Development

Cost and Schedule Data is collected and stored throughout the Project Lifecycle

– Capture the pre-kickoff baseline data– Establish reporting cycles for capturing

data iterations– Process Data for status and performance

analyses

Page 27: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 27 of 42

Project Schedule Status

Schedule data captured in database

Summary Status charts created for Project Dashboard

Page 28: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 28 of 42

Project Cost Performance

Shows Planned vs. Actual Cost Performance

Burn-down Chart shows Baseline Cost-to-complete over time and Actual Costs

Page 29: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 29 of 42

Project Schedule Performance Metrics

Provides Performance Indices for Schedule Tasks much like EVM indices

Compares two iterations of the Project’s schedule

Measures actual progress against planned progress during interval between schedules

Identifies Schedule items that need attention

Provides Projected Task Duration based on measured performance

EXAMPLE

Name Start Finish DurationPercent

CompleteStart Slip

Finish Slip PDWS PDWP ADWP SV SPI SCPI

Old Duration

Projected Duration

Task 1 1-Jan-00 12-Jan-00 12 100% 0 2 10 10 12 0 1 0.834 12 12Task 2 5-Jan-00 14-Jan-00 10 80% 0 0 10 8 10 -2 0.8 0.8 10 10.5Task 3 8-Jan-00 17-Jan-00 10 70% 0 0 8 7 8 -1 0.875 0.875 10 10.43Task 4 14-Jan-00 18-Jan-00 5 0% 0 0 2 0 2 -2 0 0.715 5 7

Page 30: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 30 of 42

Project Excursions (What-Ifs)

Program Management must handle many pressures to control projects due to Budget Cuts Project Overruns Multiple Projects Competing for limited Funds

Cost Analytics must support Schedule Excursions Budget Constraint Excursions

Page 31: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 31 of 42

Web Framework Status

There is a CxP MOP CADRe Database on an MOD Network Server

The Web UI to the MOP CADRe DB can be used to Import and Export data

CxP MOP users can request access to the Web UI

CxP MOP users can be authorized to access to the Web UI

The SEER-SEM tool runs on user request to create Software Development Estimates

The new Database Schema for Schedule Based Cost Data has been defined

Page 32: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 32 of 42

Desktop Framework Status

Developed Primarily as an Analytics Tool Development Platform

The UI supports multiple database instances

Tools exist to Import Schedule Based Cost Data Export Cost Data Spreadsheets Update CADRe data from Project Schedules Create Schedule Performance Status Create a Milestone Excursion ACEIT model data Perform Budget Constraint Analyses

Page 33: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 33 of 42PRT 114 03 January 2012

Thank YouTony Harvey ([email protected])

Page 34: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 34 of 42

Backup

CADRe Submission to HQ

Detailed Process Flow Charts

Multi-Layered Management Concept

Detailed Business Case Results

Page 35: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 35 of 42

1

ProgramPhases

Formulation Implementation

AO-DrivenProjects

TraditionalWaterfall

Development or Directed

Missions

Flight ProjectsLife Cycle

Phases

Pre-Phase A:ConceptStudies

Phase A:Concept

Development

Phase B:

Preliminary Design

Phase C:

Detailed Design

Phase D:Fabrication,

Assembly & Test

Phase E:Operations &Sustainment

Phase F:Disposal

CR

2

1

Select Step 2

DownSelect Step 1

CDR Launch

3

3

4

4

LegendGPMC Mission Decision Review/ICR

All parts of CADRe due 30 days after site review

CADRe delivered; based on Concept Study Report (CSR) and winning proposal

4 CADRe, All Parts90 days after launch,as built or as deployed configuration

CADRe, Part C only duringlast year of planned project life

3 Update as necessary30 days after CDR

1

2

5

5

5

1a

CADRe update, if necessary

2

CADRe update, if necessary

1 1a

2a

2a

2a1

All parts of CADRe due 30 days after site review

NASA HQ requires CADRe submissions 5 times in a project’s life

PDRSDR

When is CADRe Data Required?

Page 36: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 36 of 42

Project Process Details

Page 37: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 37 of 42

Program Management Detail

Page 38: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 38 of 42

Multi-Layered Management Concept

Page 39: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 39 of 42

Project Cost Profile

Provides statement of Resource Requirements over time Total Cost per BCC By Tasks using WBS

Shows Cost Breakdown over time Collect CADRe Data at Detailed Level Identify Summary WBS Items in Detailed Data

By Activity Type Shows cost separated by Development, Modification, and Sustaining

$0

$200

$400

$600

$800

$1,000

$1,200

$1,400

$1,600

$1,800

$2,000

FY07 FY08 FY09 FY10 FY11 FY12 FY13 FY14 FY15 FY16 FY17 FY18 FY19 FY20

RY

$, M

Task I Task II Task III Task IV Task V

Source Data Type

Activity Type Cost Type FY10 FY11 FY12 FY13 FY14 FY15

SW Dev FTE - - - - - - SW Mod FTE - - - - - - SW Sus FTE - - - - - - SW Dev EP 17.49 8.72 - - - - SW Mod EP - 3.87 7.74 7.71 3.85 - SW Sus EP - 0.51 1.03 1.03 0.51 - LOE Dev FTE 1.00 0.50 - - - - LOE Mod FTE - - - - - - LOE Sus FTE - 1.00 2.00 2.00 1.00 - LOE Dev EP - - - - - - LOE Mod EP - - - - - - LOE Sus EP - 5.00 10.00 10.00 5.00 - Trav Dev Travel $319.91 $165.10 $0.00 $0.00 $0.00 $0.00Trav Mod Travel $0.00 $1,807.01 $0.00 $0.00 $0.00 $0.00Trav Sus Travel $0.00 $0.00 $0.00 $0.00 $1,736.13 $0.00Mat Dev Material $0.00 $0.00 $0.00 $0.00 $0.00 $0.00Mat Mod Material $0.00 $0.00 $0.00 $0.00 $0.00 $0.00Mat Sus Material $0.00 $0.00 $0.00 $0.00 $0.00 $0.00

Page 40: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 40 of 42

ROI Chart

Shows Costs vs. Savings Per BCC

Calculate Savings From CADRe Detailed Cost Data “Replaceable” Costs

Costs that will occur if Project is NOT performed Costs that will be replaced if Project IS performed

As Costs change ROI can be Re-Calculated

Page 41: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 41 of 42

Project Scorecard

Provides Qualitative Rating

Final Score can be used for Option comparison

Identical to current BCC scorecard With textual rating

drop-down lists

Data provided by Project team and stored in DB

Quantitative Cost Savings $381,000

Category Rating ScoreReuse >80% 27Extensibility Med 9

ReusabilityMultiple Groups 9

Flexibility Significant 15Standards Compliant 27Ops Need Mandatory 45

Ops ScopeMultiple Groups 9

$ Avoidance Med 15

Accessibility Some 12Security Low 18TouchPoints Med 6

192Qual Score Context 56%

Integration Complexity

Qualitative

ROI/NRI after 10 years

Balanced Project Scorecard

Future Software Cost Avoidance

Customer Satisfaction

Quantitative Cost Savings 10 yr ROI $381,000 $381,000 $381,000

Option 1 Option 2 Option 3Reuse >80% < 10% 30-40%Extensibility Med High LowReusability Multiple Groups Limited Use Throughout MODFlexibility Significant Complete LittleStandards Compliant Non-standard LittleOps Need Mandatory Nice to have Big benefitsOps Scope Multiple Groups Limited Use Throughout MOD$ Avoidance Med None LowAccessibility Some Restricted Not restrictedSecurity Low High LowTouchPoints Med Med MedNumerical Score 192 57 141Qual Score Context 56% 17% 41%

Qualitative CriteriaQualitative

ScoresFuture

Software Cost Avoidance

Customer Satisfaction

Integration Complexity

Page 42: Harvey elliott

PRT 114 03 January 2012 Approved For Public Release 42 of 42

Project Schedule/ Milestone Chart

Provides Summary Schedule Data

Schedule Data is collected in CADRe data

CADRe data can be updated from Project Schedule

CADRe data identifies Summary Schedule items

Milestone Chart created from Project Schedule data held in the CADRe data