OOI...

24
OOI CyberInfrastructure Conceptual and Deployment Architecture CI

Transcript of OOI...

Page 1: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

OOI CyberInfrastructureConceptual and Deployment Architecture

• CI

Page 2: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

Overview

• Goals and Objectives• From Requirements to Architecture• OOI-CI Services Architectural

Pattern• Logical Architecture• Domain Models• Example Deployment Scenario

Vision

Process

Results

Concepts Deployment

Page 3: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

Goals and Objectives• Provide a consistent, structured, up-to-date representation

of the OOI CI architecture and design–– include operational views, as required by users and decision include operational views, as required by users and decision

makers, makers, –– include deployment and process views, required by CI include deployment and process views, required by CI

implementers and subsystem architecture and design teams. implementers and subsystem architecture and design teams.

• Establish a common terminology and integrated architecture

• Provide a preliminary design as a decision point for the OOI about future program development

• Establish a basis for implementation of the CI subsystems–– In compliance with stakeholder requirementsIn compliance with stakeholder requirements–– As expressed by the User Requirements Document, System As expressed by the User Requirements Document, System

Requirements Document and Concepts of Operations Requirements Document and Concepts of Operations –– CostCost--effective scalable solutioneffective scalable solution

Page 4: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

Integrated Requirements and Architecture Design Process

*

*

*

*

*

1

*1..*

*

Domain-DrivenArchitecture Design

Business Processes,Use Cases, User Stories,

Requirements, Risks

ArchitectureDocument DoDAF Implementation

Page 5: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

Requirements

OOI CI Architecture &

DesignOOI CI

User Req.OOI CI

System Req.

ORIONConceptual Arch.

OOI CI Architecture

User Req.Workshops

OOI CI Requirements

Engineering

OOI Science Prospectus

User/Scientist provided documentation

Req. Categories:• Integration and Interfacing• Resource Management, Data Storage and Data Management• Data Analysis, Modeling and Dissemination• Presentation and User Interfaces• Documentation and Development Process• Security, Safety and Privacy Properties• Quality Properties

OOI User & System

Requirements

Page 6: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

Requirements to Architecture

1. OOI will enable powerful new scientific approaches by transitioning the community from expedition-based data gathering to persistent, controllable observations from a suite of interconnected sensors.

OOI System Requirement

Page 7: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

Requirements to Architecture

1. OOI will enable powerful new scientific approaches by transitioning the community from expedition-based data gathering to persistent, controllable observations from a suite of interconnected sensors.

OOI System Requirement

a) The OOI shall enable persistent, controllable observations from a networked sensor grid

OOI CI System Requirement

Page 8: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

Requirements to Architecture

1. OOI will enable powerful new scientific approaches by transitioning the community from expedition-based data gathering to persistent, controllable observations from a suite of interconnected sensors.

OOI System Requirement

a) The OOI shall enable persistent, controllable observations from a networked sensor grid

OOI CI System Requirement

• Persistence: • Data Services Network

• Control: • Control Services Network• Common Operating Infrastructure

• Observations:• Modeling Services Network• Control Services Network• Data Services Network

• Networked Sensor Grid:• Instrument Services Network• Common Operating Infrastructure

Design

Page 9: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

Requirements to Architecture

1. OOI will enable powerful new scientific approaches by transitioning the community from expedition-based data gathering to persistent, controllable observations from a suite of interconnected sensors.

OOI System Requirement

a) The OOI shall enable persistent, controllable observations from a networked sensor grid

OOI CI System Requirement

Inst

rum

ent

Inte

rface

Service/Data Connector

Cyber-Infrastructure

COIMessaging, Data Dist, Policy

Data/StorageInterface

Com

puta

tion/

Grid

Inte

rfaceControlModeling

Instrument Data

CEIProcessing

• Persistence: • Data Services Network

• Control: • Control Services Network• Common Operating Infrastructure

• Observations:• Modeling Services Network• Control Services Network• Data Services Network

• Networked Sensor Grid:• Instrument Services Network• Common Operating Infrastructure

Design

Page 10: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

Requirements to Architecture

1. OOI will enable powerful new scientific approaches by transitioning the community from expedition-based data gathering to persistent, controllable observations from a suite of interconnected sensors.

OOI System Requirement

b) A migration path shall be established, from expedition-based data gathering to persistent, controllable observations from a networked sensor grid

OOI CI System Requirement

Inst

rum

ent

Inte

rface

Service/Data Connector

Cyber-Infrastructure

COIMessaging, Data Dist, Policy

Data/StorageInterface

Com

puta

tion/

Grid

Inte

rfaceControlModeling

Instrument Data

CEIProcessing

• Open SOA based architecture• Stepwise introduction of capabilities

over staged releases

Design

Page 11: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

DoD Architecture Framework

AV-1

Overview & Summary

AV-2

Dictionary

OV-1

High Level Concept Graphic

OV-2

Operational Node

Connectivity

OV-4

Organizational Relationships

Chart

OV-5

Operational Activity Model

Conceptual Architecture

Architecture & Design

OV-7

Logical Data Model

OV-3

Operational Information

Exchange Matrix

OV-6

Operational Activity Sequence and

Timing Descriptions

AV-All Views OV-Operational Views SV-Systems Views TV-Technical Views

from AV-1

Page 12: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

DoD Architecture Framework

SV-5

Operational Activity toSystems Function Traceability Matrix

SV-2

System Communications

Network Design

SV-4

Systems Functionality Description

SV-8

Systems and Services Evolution

Description

SV-1

Systems, Nodes & Interfaces

TV-1

Technical Standards

Profile

TV-2

Technical Standards Forecast

SV-6

Systems Data Exchange

Matrix

SV-10

Systems Functionality Sequence and Timing

Description

SV-11

Physical Schema

SV-3

Systems-Systems Matrix

SV-9

Systems Technology

Forecast

SV-7

SystemsPerformance

Parameters Matrix

AV-All Views OV-Operational Views SV-Systems Views TV-Technical Views

from AV-1

Page 13: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

Highlights of OOI CI Capabilities• Common Operating Infrastructure (COI)

–– Integration platform, communication conduit, orchestration, crosIntegration platform, communication conduit, orchestration, crosss--cutting cutting issues including identity/policy/governanceissues including identity/policy/governance

• Common Execution Infrastructure (CEI)–– Transparent Transparent executionexecution environmentenvironment on flexible on flexible computecompute infrastructureinfrastructure

• Data Network–– Federated data, metadata and its preservation via data streams, Federated data, metadata and its preservation via data streams,

repositories and catalogsrepositories and catalogs• Control Network

–– Management of Management of statefulstateful and and taskabletaskable resourcesresources• Modeling Network

–– Coherent frameworks for modeling, analysis, and consumption of dCoherent frameworks for modeling, analysis, and consumption of dataata• Processing Network

–– Resource access & scheduling of computations/executionResource access & scheduling of computations/execution• Instrument Network

–– Interactive and coordinated access to instrument platforms & Interactive and coordinated access to instrument platforms & instrumentsinstruments

Page 14: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

OOI-CI Services Architectural Pattern

Messenger

Router/Interceptor

Policy

Messenger

Router/Interceptor

Failure Manager

...

<<OOI CI Service>> S

...

<<OOI CI Service>> S.n

Service/DataConnector

<<OOI CI

Infrastructure Services

>>EncryptionService/Data

Connector

LoggingService/Data

Connector

Failure Manager

Service/DataConnector

...

Service/DataConnector

S.1

Service/DataConnector

S.2

Service/DataConnector

<<OOI CI

Application Services

>>

S.n.2

Service/DataConnector

S.n.m

Service/DataConnector

<<OOI CI

Application Services

>>

S.n.1

Service/DataConnector

Service/DataConnector

Logging

Service/DataConnector

Encryption

Service/DataConnector

Policy ...

Service/DataConnector

Service/DataConnector

<<OOI CI

Infrastructure Services

>>

Page 15: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

OOI-CI Services Architectural Pattern

Router/Interceptor

Messenger/Communicator

Service/Data

Connector

COI-Core Applications

Services

COI-Core Infrastructure

Services

<<Facility>>

Facility Defined Policies

Data Services Network

Process Services Network

Control Services Network

Instrument Services Network

Model Services Network

CEI Services Network

Science User/ Operator Interface

Page 16: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

OOI-CI Services Architectural Pattern

Inst

rum

ent

Inte

rface

Service/Data Connector

Cyber-Infrastructure

COIMessaging, Data Dist, Policy

Data/StorageInterface

Com

puta

tion/

Grid

Inte

rfaceControlModeling

Instrument Data

CEIProcessing

Page 17: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

OOI CI Model

Inst

rum

ent

Inte

rface

Service/Data Connector

Cyber-Infrastructure

COIMessaging, Data Dist, Policy

Data/StorageInterface

Com

puta

tion/

Grid

Inte

rfaceControlModeling

Instrument Data

CEIProcessing

CO

I Interaction & M

ediation

Process Definition

Observation R

equest

Process Definition

Data R

epresentation

CO

I Interaction & Mediation

CO

I Interaction & M

ediation

CO

I Interaction & Mediation

CO

I Interaction & M

ediation

CO

I Interaction & Mediation

Service Agreement

ProposalProcessing Status,

Data Product

Service Agreement

Proposal,Process D

efinition

Data Product,Process

Ontology

Registration, C

omm

unication

Page 18: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

COI Services Network

GPS Clock O10Policy Validator O9

Policy Enforcement O3Identity Management O1

Authentication O2 State Management O4 Logging O6

Router/Interceptor O7

Messenger/Communicator O8

ID Inform

ation O

N1, O

N2

Authentication O

N3, O

N4

Policy, E

vent O

N5, O

N6

State, E

ventO

N7, O

N8

Event ON

11

Time

ON

16, ON

17

Policy

ON

14, ON

15

Instrument SN I0Data SN D0 Modeling SN M0Control SN C0Processing SN P0

Science User/Operator Interface U0

MessageON12, ON13

Service/Data Connector O13

Message ON22, ON23

ON32, ON33

ON24, ON25

ON26, ON27ON28, ON29

ON30, ON31

ON34,ON35 Coastal-Global Scale Node A2 (*)

Regional Scale Node A1 (*)

Research Laboratory A4 (*)

Classroom Facility A5 (*)

Governance O5

Service Registry O12

CEI SN E0

ON36, ON37

Service ID

O

N20, O

N21

Conversation

ON

9, ON

10

Registration, C

omm

unication

CO

I Interaction & M

ediation

AN4, AN9

AN3, AN8

AN2, AN7

Inst

rum

ent

Inte

rface

Service/Data Connector

Cyber-Infrastructure

COIMessaging, Data Dist, Policy

Data/StorageInterface

Com

puta

tion/

Grid

Inte

rfaceControlModeling

Instrument Data

CEIProcessing

Page 19: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

Instrument Services Network (high-level & in context)

Adapted from Figure 4 of OV2

Inst

rum

ent

Inte

rface

Service/Data Connector

Cyber-Infrastructure

COIMessaging, Data Dist, Policy

Data/StorageInterface

Com

puta

tion/

Grid

Inte

rfaceControlModeling

Instrument Data

CEIProcessing

Page 20: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

Detailed Model of an Instrument Platform

Source figure: Exhibit 13 of Ov7 - Instrument Platform

Instrument Platform

*

Power Source

needs

Modemuses

Rover

Docking Station

GliderBuoyProfiling Platform

Mid Water NodeMooring Surface Float

Cable

attaches to

* attaches to

runs alongNavigation Strategy

Long Range Navigation

Short Range Navigation

communicates to

Tomography Signal

Tomography Path* 1

uses

*

Actuator*

Sensor

*

<<policy enforcer>>Instrument Proxy

COI Command Message

consumes

<<resource>>Command Message

Instrument Command Message

1

1

consumes

understands

Raw Data Message

COI Data Message

Instrument Data

Messageproduces

Location*

Science Ontology

expressed in

produces

Translator

delegates

Raw Data Translator

Command Translator

Attribute

Type

Location* Attribute

...

Bottom Ladder Frame

Communication Mechanism

<<resource>>Instrument

Inst

rum

ent

Inte

rface

Service/Data Connector

Cyber-Infrastructure

COIMessaging, Data Dist, Policy

Data/StorageInterface

Com

puta

tion/

Grid

Inte

rfaceControlModeling

Instrument Data

CEIProcessing

Page 21: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

Instrument Platforms Instrument

InterfaceObservatory

Node

Marine Net INTERNET

Shore Side Operations

ResearchLaboratory

~

~

~

~

~ ~

~

~

~

Candidate Sites forCyber Points of Presence

Community

Team

Shore Side

Water

Land

Individual

Operational Authority

Researchers

Cyber Operator

Marine Operator

CyberinfrastructureOperations

Teragrid and OSG Provider

~

Geographical Location

Candidate Deployment for CI

Page 22: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

Instrument Platforms Instrument

InterfaceObservatory

Node

Marine Net INTERNET

Shore Side Operations

ResearchLaboratory

~

~

~

~

~ ~

~

~

~

Candidate Sites forCyber Points of Presence

Community

Team

Shore Side

Water

Land

Individual

Operational Authority

Researchers

Cyber Operator

Marine Operator

CyberinfrastructureOperations

Teragrid and OSG Provider

~

Geographical Location

Candidate Deployment for CI

Instrument

Interface

Service/Data

Connector

Cyber-

Infrastructure

COI

Messaging, Data Dist, Policy

Data/Storage

Interface

Com

putation/Grid

InterfaceControlModeling

Instrument DataCEIProcessing

Instrument

Interface

Service/Data

Connector

Cyber-

Infrastructure

COI

Messaging, Data Dist, Policy

Data/Storage

Interface

Com

putation/Grid

InterfaceControlModeling

Instrument DataCEIProcessing

Instrument

Interface

Service/Data

Connector

Cyber-

Infrastructure

COI

Messaging, Data Dist, Policy

Data/Storage

Interface

Com

putation/Grid

InterfaceControlModeling

Instrument DataCEIProcessing

Instrument

Interface

Service/Data

Connector

Cyber-

Infrastructure

COI

Messaging, Data Dist, Policy

Data/Storage

Interface

Com

putation/Grid

InterfaceControlModeling

Instrument DataCEIProcessing

Instrument

Interface

Service/Data

Connector

Cyber-

Infrastructure

COI

Messaging, Data Dist, Policy

Data/Storage

Interface

Com

putation/Grid

InterfaceControlModeling

Instrument DataCEIProcessing

Instrument

Interface

Service/Data

Connector

Cyber-

Infrastructure

COI

Messaging, Data Dist, Policy

Data/Storage

Interface

Com

putation/Grid

InterfaceControlModeling

Instrument DataCEIProcessing

Instrument

Interface

Service/Data

Connector

Cyber-

Infrastructure

COI

Messaging, Data Dist, Policy

Data/Storage

Interface

Com

putation/Grid

InterfaceControlModeling

Instrument DataCEIProcessing

Instrument

Interface

Service/Data

Connector

Cyber-

Infrastructure

COI

Messaging, Data Dist, Policy

Data/Storage

Interface

Com

putation/Grid

InterfaceControlModeling

Instrument DataCEIProcessing

Instrument

Interface

Service/Data

Connector

Cyber-

Infrastructure

COI

Messaging, Data Dist, Policy

Data/Storage

Interface

Com

putation/Grid

InterfaceControlModeling

Instrument DataCEIProcessing

Page 23: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

Thank you

Page 24: OOI CyberInfrastructureoceanleadership.org/files/Conceptual_Deployment_Architecture_CI_OOI_PDR.pdfIntegrated Requirements and Architecture Design Process * * * * * 1. 1..* * Domain-Driven.

Internals of a CyberPoP Network Design Scenario

Deployment Concerns:

• Security• Performance• High-availability• Scalability• Offsite Mgmt• Scheduling• Resource Mgmt

Ethernet Switch

VLA

N

NTP

, H

TTP

, S

MTP

, etc