Tradespace: Informed Decision-making for Acquisition · ERS Extranet TRADESPACE TOOLS Pingfederate...

17
ERS NDIA SYS ENGINEERING CONF – OCTOBER 2017 1 Distribution A Distribution A Tradespace: Informed Decision-making for Acquisition 20th Annual NDIA Systems Engineering Conference October 26, 2017 Timothy Garton Computer Scientist US Army Corps of Engineers Engineer Research Development Center

Transcript of Tradespace: Informed Decision-making for Acquisition · ERS Extranet TRADESPACE TOOLS Pingfederate...

Page 1: Tradespace: Informed Decision-making for Acquisition · ERS Extranet TRADESPACE TOOLS Pingfederate (Authentication) Active Directory (AD) External Developers AD manages database of

ERS NDIA SYS ENGINEERING CONF – OCTOBER 2017 1Distribution A

Distribution A

Tradespace: Informed Decision-making for Acquisition

20th Annual NDIA Systems Engineering ConferenceOctober 26, 2017

Timothy GartonComputer Scientist

US Army Corps of EngineersEngineer Research Development Center

Page 2: Tradespace: Informed Decision-making for Acquisition · ERS Extranet TRADESPACE TOOLS Pingfederate (Authentication) Active Directory (AD) External Developers AD manages database of

ERS NDIA SYS ENGINEERING CONF – OCTOBER 2017 2Distribution A

Distribution A

Tradespace Analytics - Set-Based Design

POINT-BASEDDESIGN

SET-BASEDDESIGN

The space spanned by completely enumerated

design variables

Single

Advanced analytics allow engineers to investigate more thorough design solutions sets

Potential Solution Space

Adjust

Adjust

Learning Points

Iterate if required

Tradespace - the set of processes, program and system parameters,

attributes, and characteristics required to satisfy mission profile

Page 3: Tradespace: Informed Decision-making for Acquisition · ERS Extranet TRADESPACE TOOLS Pingfederate (Authentication) Active Directory (AD) External Developers AD manages database of

ERS NDIA SYS ENGINEERING CONF – OCTOBER 2017 3Distribution A

Distribution A

ERS Tradespace Concept

HPCMP and S&T ResourcesMission Context

Environmental Rep.

Advanced Modeling

Tradespace Analytics

Architecture

Cost models-ilities

….other

ERS CLOUD COMPUTING ENVIRONMENT (CCE)

Currently Applied ERS Advanced Tradespace Analytics

Efficiently

discover key

performance

parameters

(KPPs)

Expand Tradespace Fully

•Early concept tool

•Functional /

component breakdown

•Explore tradespace

edges

High-fidelity Models

Parameter Sweeps:

Design Variations

•Highly computational

•Sifts through millions of designs

•Refined set of specifications for

viable design solutions

Performance Assessments

Performance Metrics

10,000x Improvement in

productivity in

Analysis of

Alternatives

DEFINE ANALYZE

Page 4: Tradespace: Informed Decision-making for Acquisition · ERS Extranet TRADESPACE TOOLS Pingfederate (Authentication) Active Directory (AD) External Developers AD manages database of

ERS NDIA SYS ENGINEERING CONF – OCTOBER 2017 4Distribution A

Distribution A

Tradespace Exploration Processes

High-Fidelity

Simulations

Systems

Properties

“ilities”

Mission

Modeling

Performance

Modeling

physics-based

models analyze

new designs

evaluated in

various

performance

scenarios

analyzed from

a systems

perspective

assessed in the

context of possible

operational

missions

Historical

Data

known designs

are used in

formulating the

tradespace

Se

ed

ing

Modeling

Tradespace Creation“Define”

Tradespace Analysis“Partition”

Exclusion

Selection

Comparison

Tradespace

is gradually

narrowed

Globally

optimum

solutions are

revealed

Remaining

designs are

compared and

contrasted

Page 5: Tradespace: Informed Decision-making for Acquisition · ERS Extranet TRADESPACE TOOLS Pingfederate (Authentication) Active Directory (AD) External Developers AD manages database of

ERS NDIA SYS ENGINEERING CONF – OCTOBER 2017 5Distribution A

Distribution A

Decision Analysis:Integrated Processes with Trade Analytics

PROGRAMCONSTRAINTS

MISSIONEFFECTIVENESS

MISSION-LEVELSIMULATIONS

PHYSICS-BASED DESIGNS

EXPERTISE & MANAGEMENT

MODELS& DATA

POSSIBLE ALTERNATIVES

Page 6: Tradespace: Informed Decision-making for Acquisition · ERS Extranet TRADESPACE TOOLS Pingfederate (Authentication) Active Directory (AD) External Developers AD manages database of

ERS NDIA SYS ENGINEERING CONF – OCTOBER 2017 6Distribution A

Distribution A

Technical Requirements of Data-Driven Decisions Tools

Tradespace tools must:

• Have a traceable history

• Utilize cutting edge search and decision analytics

Quickly

find

dominant

variables

Trace

Requirements

and link

systems to

output

Allow novice and

advanced data exploration

Visualize trades between

dominant variables and

requirements

Page 7: Tradespace: Informed Decision-making for Acquisition · ERS Extranet TRADESPACE TOOLS Pingfederate (Authentication) Active Directory (AD) External Developers AD manages database of

ERS NDIA SYS ENGINEERING CONF – OCTOBER 2017 7Distribution A

Distribution A

Ontology Models:Consistency in System Communication

Original system breakdowns by ontologies or SysML, along

with requirements, are tied to the tradespace

• Inserts greater accuracy and verification into the analytic processes

• Passing the metadata gives us insight into how to analyze the data

• Direct mapping via SysMLWBS MILSTD-881C (soon 881D) is an OSD-CAPE requirement

Page 8: Tradespace: Informed Decision-making for Acquisition · ERS Extranet TRADESPACE TOOLS Pingfederate (Authentication) Active Directory (AD) External Developers AD manages database of

ERS NDIA SYS ENGINEERING CONF – OCTOBER 2017 8Distribution A

Distribution A

Data Metrics

Humans PC Web HPC

Size of Tradespace

Co

mp

lex

ity

10s 1000s 100000s Billions

Today Tomorrow

Page 9: Tradespace: Informed Decision-making for Acquisition · ERS Extranet TRADESPACE TOOLS Pingfederate (Authentication) Active Directory (AD) External Developers AD manages database of

ERS NDIA SYS ENGINEERING CONF – OCTOBER 2017 9Distribution A

Distribution A

Tradespace Analytics – Data Analysis and Visualization Tool

Beta-Release Status:

• Supplied acquisition community a

web-based environment for storing,

visualizing and analyzing data

• Allowed for access and annotation

by multiple parties for any given

location;

• Provided the base for a collaborative

decision support environment.

– Gaps in previous environments forced

point-based design methodology.

• Successfully supported MBSE and

data filtering

– Previously available MBSE were

expensive and resource heavy – requiring

local resources and administrative

personnel, required expensive licensing

agreements.

Acquisition Cost AnalysisEngineering

Training

MissionData

MissionContext

Physics-based

models

T&E…

VMs

DATA &RESOURCES

DESIGNS &SOLUTIONS

LifecycleData

Tradespace Analysis

Page 10: Tradespace: Informed Decision-making for Acquisition · ERS Extranet TRADESPACE TOOLS Pingfederate (Authentication) Active Directory (AD) External Developers AD manages database of

ERS NDIA SYS ENGINEERING CONF – OCTOBER 2017 10Distribution A

Distribution A

Tradespace Analytics Beta ReleaseLessons Learned

• Use of ParaView Web - generating interactive visualizations of large data-sets and annotation capabilities

• Role Based Access Control (RBAC) needed to execute R-Scripts in a secured environment; implementation in a complex collaborative environment is challenging.

• Working on secure authentication mechanisms that couple with customers local access control policies is an ongoing and important DoD issue.

The FY17 Beta Release of TradeAnalyzer to a number of DoD

Users resulted in important lessons and changes

ERS Tradespace development is now focusing on the user-oriented approach in preparation for DoD-wide implementation and adoption

Page 11: Tradespace: Informed Decision-making for Acquisition · ERS Extranet TRADESPACE TOOLS Pingfederate (Authentication) Active Directory (AD) External Developers AD manages database of

ERS NDIA SYS ENGINEERING CONF – OCTOBER 2017 11Distribution A

Distribution A

Tradespace Analytics and Visualizations

Page 12: Tradespace: Informed Decision-making for Acquisition · ERS Extranet TRADESPACE TOOLS Pingfederate (Authentication) Active Directory (AD) External Developers AD manages database of

ERS NDIA SYS ENGINEERING CONF – OCTOBER 2017 12Distribution A

Distribution A

Updates to Architecture

• Web Hosted• Access Control• Collaboration

• Shared Notebooks• Shared Data

• Versioning• Analytic Packages• Scalable• Portable• Reproducible• Distributed

• Spark• Hadoop

10:40 - Resilient Tools: Building an Agile Framework for the Analysis of

Environmental Impacts on Military Systems Dharhas Pothina, PhD - ERDC

Relevant ERS Talk

Page 13: Tradespace: Informed Decision-making for Acquisition · ERS Extranet TRADESPACE TOOLS Pingfederate (Authentication) Active Directory (AD) External Developers AD manages database of

ERS NDIA SYS ENGINEERING CONF – OCTOBER 2017 13Distribution A

Distribution A

Network Access

ERS USERS

EXTERNAL INTERFACE

HPC.MILERS SEGMENT on the DRENerdc.dren.mil

DEVELOPMENT ENVIRONMENT

SOURCECONTROL(GitLab)

SOURCECONTROL(GitLab)

ERS Internal

ERS Extranet

TRADESPACETOOLS

Pingfederate(Authentication)

Active Directory (AD)

External Developers

AD manages database of valid users

PING provides:• Two-factor authentication• Single sign-on• Accepts multiple industry

standards

Cloud Specifications4 GPU have been added to the 96-processor cores, 2.0TB RAM, 42 TB storage

.mil accessibleExternal .mil access is white listed

EXTERNAL INTERFACE

EXTERNAL INTERFACE

USER’S ENVIRONMENT

INDUSTRY COMPUTING INTERFACE

Industry Model API

Industry Model API

ECCA hostingSOAP/REST

Service Interfaces

Trusted Systems(White Listed)

Access ReqSeparate

HPC Accounts

10 GBNetwork

Connection

HPCFirewall

PORTAL

PORTAL

PORTAL

PORTAL

PORTAL

AFRL

ARL

ERDC

MHPCC

NAVY

Browser AccessPort 443

Trusted Systems

(White Listed)

Trusted Systems(White Listed)

DRENInternet Interface

ERS Software Team

Page 14: Tradespace: Informed Decision-making for Acquisition · ERS Extranet TRADESPACE TOOLS Pingfederate (Authentication) Active Directory (AD) External Developers AD manages database of

ERS NDIA SYS ENGINEERING CONF – OCTOBER 2017 14Distribution A

Distribution A

Questions

Page 15: Tradespace: Informed Decision-making for Acquisition · ERS Extranet TRADESPACE TOOLS Pingfederate (Authentication) Active Directory (AD) External Developers AD manages database of

ERS NDIA SYS ENGINEERING CONF – OCTOBER 2017 15Distribution A

Distribution A

Backup Slides

Page 16: Tradespace: Informed Decision-making for Acquisition · ERS Extranet TRADESPACE TOOLS Pingfederate (Authentication) Active Directory (AD) External Developers AD manages database of

ERS NDIA SYS ENGINEERING CONF – OCTOBER 2017 16Distribution A

Distribution A

What is a Tradespace

• Tradespace is the space spanned by completely

enumerated design variables. It is the potential solution

space.

• Tradespace can also be defined as the set of processes,

program and system parameters, attributes, and

characteristics required to satisfy mission profile.

• The enumeration of a large tradespace helps prevent

designers from starting with point designs while

allowing them to investigate more thorough design

solutions sets.

Page 17: Tradespace: Informed Decision-making for Acquisition · ERS Extranet TRADESPACE TOOLS Pingfederate (Authentication) Active Directory (AD) External Developers AD manages database of

ERS NDIA SYS ENGINEERING CONF – OCTOBER 2017 17Distribution A

Distribution A

System-Supported Collaboration Supports Data-Driven Decision-Making

Acquisition Cost AnalysisEngineering

Training

MissionData

MissionContext

LifecycleData

Tradespace Analysis

Physics-based

models

T&E…

VMs

Needs (…ilities)

Previous Design

Successes, Lessons-learned

• Manufacturability

• Affordability

• Reliability

• Sustainability

• Usability

• Testability

• Etc.

HPCMP Resources

S&T Resources,Research

Rapid, Reconfigurable

Systems

AcquisitionSolutions

ERS Tradespace Analytics support Collaborative Processes