One NASA Cost Engineering Database (ONCE) Overview & Update › sites › default › files ›...

Office of the Chief Financial Officer

One NASA Cost Engineering Database (ONCE)

Overview & Update

2016 NASA Cost Symposium

NASA: James K Johnson and Eric Plumer SAIC: Mike Blandford and Julie McAfee

1


Overview •  ONCE and CADRE Background

–  Brief overview •  By the Numbers

–  CADRe Dashboard –  Download Dashboard –  User Dashboard –  Model Downloads –  Numbers Summary

•  Enhancements –  Model Portal & Electronic Library –  Data Comparison –  Interface for viewing CADRe –  Search expansion

•  Quality Assurance Activities –  Achievements Summary –  Average Completeness Metrics revised –  CADRe Health Report –  Contacting Inactive accounts

•  Conclusion –  ONCE & CADRe Breakout Session: XYZ Day & Time & Location

Note: All numbers shown current as 17 Aug 2


Last Time…

–  ONCE 2.0 is significant improvement and puts the database at the center of CAD’s OCFO SID efforts to build and improve the NASA community.

–  ONCE is now the center of OCFO SID’s efforts to empower analysts and improve cost estimating at NASA by providing access to:

•  CADRe Data

–  Active filtering for custom user reports –  CADRe Library

•  Auxiliary Data –  Normalized datasets

•  Reports and Insight –  Dynamic graphical & tabular reports –  Structured database reporting

•  Models and Tools –  Model Portal sharing access across community

3

CADRe Data

Auxiliary Data

Reports and

Insight

Models and

Tools


What is ONCEData.com?

•  www.ONCEDATA.com (aka once.nasa.gov, aka oncedata.msfc.nasa.gov, aka “ONCE”) is a government website managed by HQ SID that provides access to technical, cost, and other programmatic information about NASA Projects.

•  The data primarily comes from CADRe documents which

4

have a Part A, B, and C –  Part A = Long narrative (MS Word doc) –  Part B = Technical Data (MS Excel file) –  Part C = Cost/Programmatic Data (MS Excel file) –  CADRe is the Agency’s formal cost data collection initiative as outlined NPD

71205.E. CADRe is paid for by SID and performed during KDP’s on Projects.

•  The website provides a user interface to search and retrieve data from the CADRe’s –  Enables analysts and estimators to quickly build analogy datasets, perform

historical analysis, develop cost estimating relationships, etc.

•  Users can output the data retrieved from ONCE to MS Excel for their own specific analysis needs –  Project estimation, independent estimation, research, proposal

development, etc.


ONCE BY THE NUMBERS

5


CADRe Dashboard

155GB & 60K Files

422 Total CADRe, 188

Completed Post-Launch 6


User Dashboard

465 Total Users

Yearly Growth > 15%

7


Downloads Dashboard

20GB Transferred

New Chart integrated to display most downloaded

CADRes

Top 5: MAVEN, MSL, NUSTAR,

LADEE, IRIS 8


Model Downloads

869 Total Model

Downloads Top Download: NICM

9


Total Model Downloads

10

•  641 Total Unique Model Downloads •  Model Download trend is positive •  Updates to the Model Portal drive download

spikes

•  Top Downloads: –  NICM (158) –  Polaris (87) –  ACEIT* (69) (*Includes JACS) –  TCASE (62) –  Argo (50) –  MOCET (42)


Top Downloads

11

•  NICM – 158 •  Update

spike

•  Polaris – 87 •  FY16Q3

spike

•  ACEIT - 69

•  TCASE – 62 •  Reducing?

•  Argo – 50

•  MOCET – 42 •  Strong

open


Numbers Summary

•  Total CADRe = 422 –  2016 = +24, 2015 = +47, 2014 = +41, 2013 = +40

•  Total Project = 133 –  67 PDR, 59 CDR, 45 SRR, and 43 LRD

•  Total User = 465 –  2016 = +81, 2015 = +145, 2014 = +81, 2013 = +53

•  Total Size = 60k documents and 155GB –  CADRe Library and Symposium Library most popular

•  Total Model Downloads = 867 –  2016 = 427, Total Unique Downloads = 641 –  Top 5 Models are: NICM, Polaris, ACEIT, TCASE, Argo, MOCET –  Top 5 for 2016 are: NICM, Polaris, MOCET, ACEIT, PRICE-H

12


ONCE ENHANCEMENTS

13


Model Portal & Library Updates

•  Expanded the Model Portal: –  Added:

•  MOCET –  Mission Operations –  Aerospace Corp. (M. Hayhurst)

•  NASA FSW Prototype –  S/C Flight Software –  NASA JPL (J. Hihn)

•  PCEC CS –  Project Cost Estimating –  NASA MSFC (A. Prince)

•  PRICE TP & PRICE-H –  TruePlanning & Hardware –  PRICE LLC

–  Updates: •  NICM VII

–  Also integrated the NICM VI dataset •  Polaris

–  Risk & JCL analysis –  Booz Allen Hamilton

•  Expanded the Libraries –  PCEC

•  Library created to house PCEC Normalized Files

–  OCFO University •  Training & learning materials

*some models or versions not available to non-CS

ONCE Model Portal – 14 Available*

14


Updated ONCE Interfaces for Viewing CADRe

•  ONCE Interfaces for viewing CADRe’s were updated –  Accessible via Status Screen

•  Reflect new structure and data in the CADRe v6.0 Template

•  Interfaces now mimic CADRe template

•  Includes new visuals

Project Schedule visual from CADRe data

15


Updated ONCE Interface – Cost

View toggle, CADRe Notes, & Export

Pie Chart Cost

Summary 16

$ by WBS by

FY


Update ONCE Interface – View Technical

•  Updated interfaces viewing the Technical CADRe data

•  All technical summarized and organized in exportable document format

17

Save & Export

Organized summary of Tech

data


Update ONCE Interface – Full Text Search

18 18

Search CADRe/Source Document by File Type

Full text search of over 60,000 files (123 GB) stored in CADRe Library.

Cost Symposium Search: Full text search all cost symposium documents


Updated ONCE Interface – Search by File Type

19 19

Search CADRe/Source Document by File Type

Select File Type

Results with Filename


ONCE

Quality Assurance Activities

20


QA Achievements - Summary

•  12 Data Completeness Dashboards –  Software (4), Schedule (4), System Level

Parameters (4) •  12 Quality Assurance Dashboards and Tools

–  Schedule Only QA, Data Trends, CADRe Part, Tech Input QA, QA Notes/Improvements, QA Costs by Phase , QA Costs by FY, Technical WBS, and Cost WBS

•  Integrated new Software, Schedule and SLP Dashboards that are more representative of the average data completion as opposed to a CADRe receiving credit for one field being completed –  As suggested in the ONCE demo at the 2015

Cost Symposium

21


QA - Data Completeness Dashboard – Average

22

Displays total data completion for each data type rather than

representing CADRes with any

data

FSW Data Collection activity started with HQ, JPL, GSFC, and

APL


QA - ONCE/CADRe Health Report

•  Created a Health Report for each CADRe –  Displays completion metrics and data

matching metrics between CADRe and ONCE data.

•  ONCE team uses Health Report to identify possible inconsistencies between ONCE and CADRe data.

•  Provides a Summary of: –  Part B Summary Completeness Levels –  Part B by Parameter Completeness

Levels –  CADRe & ONCE data matching statistics

23


QA – User Account Management – Inactive Accounts

24

•  ONCE Staff perform User Account Management on a regular basis and as required for managing a database in compliance with NASA policies and best practices –  Part of this management includes Inactive Account

Review •  Recently, users with Inactive Accounts are being

contacted –  Inactive Account = Not used in at least 1 year

•  All users who have accounts that are identified in the automated process have been contacted –  Provides context, contact info, etc.

•  Users receive letters from the ONCE team that are aligned with their level of inactivity –  Low = advises to login and see new features –  Medium = gives timeline for login before automatic

suspension occurs (end of Calendar year) –  High = identifies automatic suspension in 1 month and

provides opportunity to renew •  This will help the system improve over time and begin

warning users up to a year prior to account suspension •  Integration with NASA NAMS & NDC provides

automated identity and credential verification –  Users can also remove access to ONCE themselves via

NAMS if it is no longer needed


25

Conclusion

•  ONCE continues to grow and expand – Data, Users, Models, Reports, Features, QA

•  Quality Assurance is a core activity for ONCE team – Leverages automated reports & features – Metrics to gauge health & target specific areas for improvement

•  Traceability continues to be a high priority – Source Data à CADRe à ONCE

•  ONCE Users, Power Users, & Others Invited to: – ONCE Breakout Session:

•  XYZ Date & Time •  TBD Location

•  Until next time…or wait…is there more…?


Introduction to the Quarterly Database (QDb)

•  SID previously operated the C&S Db (Cost & Schedule Database) –  CAD joined SID in 2016 and began leveraging ONCE to help SID

•  Goal: Utilize capabilities of ONCE to quickly enhance the availability of Project Quarterly data

•  Source Data: Consolidated Quarterly data sheets by Project –  Approximately 51 Projects –  Quarterly data back to approx. FY2007Q1 –  964 individual quarterly datasheets = 99.7% complete (only 3 missing)

•  What is the QDb? Automated import, analysis, and review of Quarterly Datasheets –  Online SQL database that leverages the CADRe/ONCE architecture –  Supports automated review, import, analysis, and visualization of Quarterly data –  Provides a controlled and authoritative file library of Quarterlies and other valuable information –  Multiple dynamic outputs, charts, and dashboards with full export to MS Excel/PDF/Image –  Integration with NASA IDMax/NAMS and NDC for user credentials and permissions

26


Program Pie Chart – Example with Active Filters “All P/p from FY2016Q2 by LCC Budget”

Left Filters used to select Programs or Themes

Filter on any FY Quarter

Multiple data sections available from the Quarterly Datasheet

27


Project Pareto Chart – Example with Drill Down “JWST Project FY2016Q2 LCC vs Mgmt Estimate vs MD UFE”

Quickly select any single or multiple Projects

Select multiple Estimate Types to plot different sections of the Quarterly

Datasheet 28


Automated Review Area Initial Review of Incoming Quarterly Datasheets

29

Tabs support review of entire Quarterly datasheet file

•  Automated review of incoming quarterly datasheets as they are submitted •  Utilize the data table and graphical outputs to compare the incoming (current) vs last

(prior) quarter


Import QA Area Verification Check of all Quarterly Datasheet

fields/values

30

Project current Quarter and prior Quarter

OK vs Error to quickly display any import issues

Tabbed views to switch between Quarterly

sections

Statistics on File Import including as of date

•  Automated Review Area + Import QA Area = Total QA Coverage for Quarterly Data –  Automated Review area is focused on incoming quarterlies for the current quarter and their initial review –  Import QA area is focused on the second step, automatically importing the data into the QDb and verifying

•  Import QA is a second step check to ensure all values were correctly imported into the QDb –  Automated review area can provide the first check, and allow analysts to perform comparative analysis


Import QA Area Verification Receipt and Report

31

Print and export to multiple file types

Project specific Verification Receipt with summary totals

•  Import QA area also contains Verification Check –  Verification check is able to provide

printable report •  Results are summarized to provide

easy to understand totals –  Determine whether the information was

correctly imported into the database •  Section summaries provide insight into

specific problems –  Summary, Cost, Schedule, Contract, etc.

•  Percentage displayed should always equal 100% –  Anything less indicates an error at a lower

level which can be viewed on the Import QA area

One NASA Cost Engineering Database (ONCE) Overview & Update › sites › default › files ›...

Documents

Transcript of One NASA Cost Engineering Database (ONCE) Overview & Update › sites › default › files ›...