A New Approach to Sustain Legacy Satellite Ground SystemsTraditional Approach New Approach to...

1
Traditional Approach New Approach to sustain legacy satellite ground systems Conceptual Implementation to a Single Subsystem Within Legacy Ground Segment (e.g, GOES-NOP SPS subsystems) Conceptual Implementation to a Small Scale Satellite Ground Segment (e.g, NJGS) Mission A Mission Mgmt, Prod. Gen, Prod Distr Server Network Infrastructure Facilities Infrastructure OS App 1 App 2 App n Mission B Mission Mgmt, Prod. Gen, Prod Distr Server Network Infrastructure Facilities Infrastructure OS App 1 App 2 App n Mission C Mission Mgmt, Prod. Gen, Prod Distr Server Network Infrastructure Facilities Infrastructure OS App 1 App 2 App n As-Is GOES-NOP SPS subsystem architecture Conceptual To-Be GOES-NOP SPS subsystem architecture with manual failover and static resource allocation (SPS prime, backup, dev) Server Network Infrastructure Physical/Virtual Data Center OS SPS 1 GIU GSU GRU Server Network Infrastructure Physical/Virtual Data Center OS SPS (SOCC, WBU, FCDAS) GSU 1…n GIU 1…n GRU 1…n SPS DB Server Network Infrastructure Physical/Virtual Data Center OS SPS (SOCC, WBU, FCDAS) GSU 1…n GIU 1…n GRU 1…n SPS DB Server Network Infrastructure Physical/Virtual Data Center OS SPS (SOCC, WBU, FCDAS) GSU 1…n GIU 1…n GRU 1…n SPS DB Server OS SPS 2 GIU GSU GRU Server OS SPS 8 GIU GSU GRU Server mySQL mySQL OS SPS DB1 Server OS VM VM SPS DB2 JPL NOC JPL NOC Lifecyle managed through orchestration with auto-scaling and capacity rules Lifecyle managed through orchestration with auto-scaling and capacity rules File Manager CNCs JTCCS 1 JTCCS 2 JTCCS 3 JSEQ 1 JSEQ 2 NOAA Server 1 NOAA Server 2 UTCCS Dev 1 UTCCS Test 1 JSEQ Dev 1 JSEQ Test 1 NOAA Server Dev 1 NOAA Server Test 1 CNCs TM-NRT TM-NRT TM-NRT Dev TM-NRT Test WebServer Test WebServer Dev DMZ File Manager ESPC Primary Router NJGS Primary Router NJGS Standby Router LAN Switch LAN Switch Firewall NIDS NIDS Firewall – ADR (Primary and secondary domain controllers – AA – HIDS – Backup System – Patch Management – McAfee Anti-Virus – NAS (Long term storage) – CM – Altiris Inventory Control – Tripwire Audit Control and Logging – DRPPC (2) – ETS (2) – Printers NJGS Primary Router EUMESTAT ESPC Standby Router LAN Switch LAN Switch MGMT Dev Data Data Data Data Data Dev External Dev External MGMT File Manager Dev File Manager Test WebServer WebServer DMZ Ops Test & Dev Ops Management Equipment Test & Dev ESPC NJGS System Architecture SOCC File Manager Orchestration Ops Server 1 Container 1 Container n CNCs JTCCS 1 JTCCS 2 JTCCS 3 JSEQ 1 JSEQ 2 NOAA Server 1 NOAA Server 2 UTCCS Dev 1 UTCCS Test 1 JSEQ Dev 1 JSEQ Test 1 NOAA Server Dev 1 NOAA Server Test 1 CNCs TM-NRT TM-NRT TM-NRT Dev TM-NRT Test WebServer Test WebServer Dev DMZ File Manager ESPC Primary Router NJGS Primary Router NJGS Standby Router LAN Switch LAN Switch Firewall NIDS NIDS Firewall – ADR (Primary and secondary domain controllers – AA – HIDS – Backup System – Patch Management – McAfee Anti-Virus – NAS (Long term storage) – CM – Altiris Inventory Control – Tripwire Audit Control and Logging – DRPPC (2) – ETS (2) – Printers NJGS Primary Router EUMESTAT ESPC Standby Router LAN Switch LAN Switch MGMT Dev Data Data Data Auto Follower Server 1 Server n Server 2 Running Provision Monitor Data Data Dev External Dev External MGMT File Manager Dev File Manager Test WebServer WebServer DMZ Ops Test & Dev Ops Management Equipment Test & Dev ESPC Mission Management Resource Lifecycle Control Plane Conceptualized NJGS System Architecture SOCC Ops Server 2 Container 1 Container n Ops Server 3 Container 1 Container n Ops Server n Container 1 Container n Orchestration Dev Server 1 Container 1 Container n Dev Server 2 Container 1 Container n Dev Server 3 Container 1 Container n Dev Server n Container 1 Container n Mission Mgmt Mission 1, 2, … n Server Network Infrastructure Enterprise Management Facilities Infrastructure VM OS OS Spec. HW Prod. Gen. Mission 1, 2, … n Prod. Dist. Mission 1, 2, … n Container 1, 2, … n ©2017 ERT, Inc. All Rights Reserved ERT, Inc. 14401 Sweitzer Lane, 300 Laurel, MD 20707 www.ertcorp.com A New Approach to Sustain Legacy Satellite Ground Systems Ye Men, Rachid Dahmani, Shahram Tehranian, Rob Haynes, Indy Saggu Traditional monolithic architected satellite ground systems operated with stove-piped model in a multi-missions environment Mission specific hardware dominated acquisition strategy during refresh and upgrade cycle Expensive procurement with long lead cycle and myriad of hardware platform, network, operating system, and applications to upgrade and update Difficult to maintain and operate over long lifecycle of missions as technology landscape evolve quickly Rigid hardware-based architecture style limiting interoperability among missions Decomposition of hardware dominated ground systems (e,g, ingest, mission planning and mgmt, processing, product gen, and product distribution) into f Granular microservices oriented architecture f Microservices implemented with containers such as Dockers f Docker preserving binary interface and implementation of legacy mission applications with all its dependency rolled into a single cohesive unit of deployment Microservices managed by orchestration engines (Docker Swarm or Opensource Kubernetes) using rule-based capacity management in resource life-cycle management within Enterprise Management layer Separated control plane between mission management and production generation and distribution results in flexible system architecture, allowing f Mission management and product generation and distribution to each evolve on its timeline and needs f Incorporate technology appropriate of unique requirements of mission management vs product generation and distribution (Stringent Uptime vs Big Data) Containers are natural extension and first class citizen to Cloud to create hybrid infrastructure of on-premise and Cloud SPS Functional Overview A critical element of e GOES NOP Spacecraſt Support Ground System (SSGS) SPS is responsible for the real time (rt) ingest and processing of the GOES sensor data to produce GVAR data stream. SPS also supports the Orbit and Analysis (O&A) determination function. e Sensor Processing System Database (SPSDB) maintains SPS initialization parameters on flat files and provides backend mySQL database storage/archival/query of satellite information such NLUT, CORT, and etc. Current operational deployment: 8 SPS and 3 SPSDB at WCDA, 1 SPS and SPSDB at FCDAS, 1 SPS and SPSDB at WBU. Current system architecture: Blade chassis with 2 blade servers and 2 expansion cards running Solaris 10 and zones providing all processing functions, GIU, GRU, GSU and SPSDB runs as separate VM co-located on other GOES-NOP servers NJGS Overview NOAA, in partnership with EUMESAT and NASA/JPL, has been operating the NOAA Jason Ground System (NJGS) to support the operation of Jason-2 and Jasion-3 satellite missions. Jason-3 is the follow-on for Jason-2, with NOAA using a microwave radiometer, precision orbit determination components (e.g,, Global Positioning System (SPS), launch services, associated engineering services, the Jason-2 command and control, and data processing capabilities. EUMESAT provides spacecraſt, altimeter instrumentation, precision orbit components, ground system and operations. NJGS has been operational and deployed at SOCC, WCDAS, FCDAS, and ESPC. NJGS Functional Blocks Overview Mission Management: JTCCS: Responsible for spacecraſt and earth terminal command and telemetry processing NOAAServer: Responsible for file processing JSEQ: Responsible for schedule and command processing CIG: Responsible for telemetry ingest and processing and command transmission CNC: Provides operator access to and control of other subsystems DRPPC: Provides telemetry analysis and monitoring ETS: Provides office line analysis and engineering tools Ideal Re-hosted implementation Single physical server with RHEL 7.x hosting multiple SPS and SPS DB running Docker containers Up 6 EDT cards, pair of 3, co-located within one server to serve as conduit of GVAR data input and output GIU, GRU, GSU processing functions, implemented as Docker container, are stacked to form a single logical unit of SPS unit with SPSDB partitioned into standard Docker image of mySQL and custom legacy SPSDB Docker image Potential reduction of servers from 10 to 3. Legacy mission application interface and implementation persevered as it is with only change of deployment of unit. Product, Data Generation and Distribution: FileManager: Generates various user products, and provides file collection and distribution between internal and external ESPC systems WebServer: Host a web site containing composite logs generated by FileManager, hosted the NRTAVS website, displays the LogMonitor application for visualization of log errors TM-NRT: Generates high level products (OGDR) from raw data (LTM) ESPC workstations: Monitor and control the status of FileManager and WebServers Idea Refresh Implementation: Separation of control plane between mission management and product data generation and distribution Mission management resource lifecycle via Virtual Machines using affinity and anti- affinity rules Product, Data resource lifecycle via Container orchestration using capacity rules and auto scaling Virtual Desktop Infrastructure to streamline and simplify O&M lifecyle of applications Potential reduction of 30+ servers to 10-

Transcript of A New Approach to Sustain Legacy Satellite Ground SystemsTraditional Approach New Approach to...

Page 1: A New Approach to Sustain Legacy Satellite Ground SystemsTraditional Approach New Approach to sustain legacy satellite ground systems ... ETS: Provides office line analysis and engineering

Traditional Approach New Approach to sustain legacy satellite

ground systems

Conceptual Implementation to a Single Subsystem Within Legacy Ground Segment (e.g, GOES-NOP SPS subsystems)

Conceptual Implementation to a Small Scale Satellite Ground Segment (e.g, NJGS)

Mission AMission Mgmt, Prod. Gen, Prod Distr

Server

Network Infrastructure

Facilities Infrastructure

OS

App 1 App 2 App n

Mission BMission Mgmt, Prod. Gen, Prod Distr

Server

Network Infrastructure

Facilities Infrastructure

OS

App 1 App 2 App n

Mission CMission Mgmt, Prod. Gen, Prod Distr

Server

Network Infrastructure

Facilities Infrastructure

OS

App 1 App 2 App n

As-Is GOES-NOP SPS subsystem architecture Conceptual To-Be GOES-NOP SPS subsystem architecture with manual failover and static resource allocation

(SPS prime, backup, dev)

Server

Network Infrastructure

Physical/Virtual Data Center

OS

SPS 1GIU

GSU

GRU

Server

Network Infrastructure

Physical/Virtual Data Center

OS

SPS (SOCC, WBU, FCDAS)

GSU1…n

GIU1…n GRU

1…nSPS DB

Server

Network Infrastructure

Physical/Virtual Data Center

OS

SPS (SOCC, WBU, FCDAS)

GSU1…n

GIU1…n GRU

1…nSPS DB

Server

Network Infrastructure

Physical/Virtual Data Center

OS

SPS (SOCC, WBU, FCDAS)

GSU1…n

GIU1…n GRU

1…nSPS DB

Server

OS

SPS 2GIU

GSU

GRU

Server

OS

SPS 8GIU

GSU

GRU

Server

mySQL mySQL

OS

SPS DB1

Server

OSVM VM

SPS DB2

JPL

NOC

JPL

NOC

Lifecyle managed through orchestration with auto-scaling and capacity rules

Lifecyle managed through orchestration with auto-scaling and capacity rules

File Manager

CNCs

JTCCS 1

JTCCS 2

JTCCS 3

JSEQ 1

JSEQ 2

NOAA Server 1

NOAA Server 2

UTCCS Dev 1

UTCCS Test 1

JSEQ Dev 1

JSEQ Test 1

NOAA Server Dev 1

NOAA Server Test 1

CNCs

TM-NRTTM-NRT

TM-NRT Dev

TM-NRT Test WebServer Test

WebServer DevDMZ

File Manager

ESPC Primary Router

NJGS Primary Router

NJGS Standby Router

LAN Switch

LAN Switch

Firewall NIDS

NIDSFirewall

– ADR (Primary and secondary domain controllers

– AA– HIDS– Backup System– Patch Management– McAfee Anti-Virus– NAS (Long term storage)– CM– Altiris Inventory Control– Tripwire Audit Control and

Logging

– DRPPC (2)– ETS (2)– Printers

NJGS Primary Router

EUMESTAT

ESPC Standby Router

LAN Switch

LAN SwitchMGMT

Dev Data

Data

Data

Data

Data Dev

External Dev

External

MGMT

File Manager

Dev

File Manager

Test

WebServerWebServer

DMZ

Ops

Test

& D

ev

Ops

Managem

ent Equipment

Test & D

ev

ESPC

NJGS System Architecture SOCC

File Manager

Orchestration

Ops Server 1

Container 1

Container n

CNCs

JTCCS 1

JTCCS 2

JTCCS 3

JSEQ 1

JSEQ 2

NOAA Server 1

NOAA Server 2

UTCCS Dev 1

UTCCS Test 1

JSEQ Dev 1

JSEQ Test 1

NOAA Server Dev 1

NOAA Server Test 1

CNCs

TM-NRTTM-NRT

TM-NRT Dev

TM-NRT Test WebServer Test

WebServer DevDMZ

File Manager

ESPC Primary Router

NJGS Primary Router

NJGS Standby Router

LAN Switch

LAN Switch

Firewall NIDS

NIDSFirewall

– ADR (Primary and secondary domain controllers

– AA– HIDS– Backup System– Patch Management– McAfee Anti-Virus– NAS (Long term storage)– CM– Altiris Inventory Control– Tripwire Audit Control and

Logging

– DRPPC (2)– ETS (2)– Printers

NJGS Primary Router

EUMESTAT

ESPC Standby Router

LAN Switch

LAN SwitchMGMT

Dev Data

Data

Data

Auto FollowerServer 1

Server n

Server 2

Running

ProvisionMonitor

Data

Data Dev

External Dev

External

MGMT

File Manager

Dev

File Manager

Test

WebServerWebServer

DMZ

Ops

Test

& D

ev

Ops

Managem

ent Equipment

Test & D

ev

ESPC Mission Management Resource Lifecycle Control Plane

Conceptualized NJGS System ArchitectureSOCC

Ops Server 2

Container 1

Container n

Ops Server 3

Container 1

Container n

Ops Server n

Container 1

Container n

Orchestration

Dev Server 1

Container 1

Container n

Dev Server 2

Container 1

Container n

Dev Server 3

Container 1

Container n

Dev Server n

Container 1

Container n

Mission MgmtMission 1, 2, … n

Server

Network Infrastructure

Enterprise Management

Facilities Infrastructure

VM OS

OSSpec. HW

Prod. Gen.Mission 1, 2, … n

Prod. Dist.Mission 1, 2, … n

Container 1, 2, … n

©2017 ERT, Inc. All Rights Reserved

ERT, Inc.14401 Sweitzer Lane, 300Laurel, MD 20707 www.ertcorp.com

A New Approach to Sustain Legacy Satellite Ground SystemsYe Men, Rachid Dahmani, Shahram Tehranian, Rob Haynes, Indy Saggu

�� Traditional monolithic architected satellite ground systems operated with stove-piped model in a multi-missions environment�� Mission specific hardware dominated acquisition strategy during refresh and upgrade cycle �� Expensive procurement with long lead cycle and myriad of hardware platform, network, operating system, and applications to upgrade and update�� Difficult to maintain and operate over long lifecycle of missions as technology landscape evolve quickly�� Rigid hardware-based architecture style limiting interoperability among missions

�� Decomposition of hardware dominated ground systems (e,g, ingest, mission planning and mgmt, processing, product gen, and product distribution) into�f Granular microservices oriented architecture�f Microservices implemented with containers such as Dockers�f Docker preserving binary interface and implementation of legacy mission applications with all its dependency rolled into a single cohesive unit of deployment

�� Microservices managed by orchestration engines (Docker Swarm or Opensource Kubernetes) using rule-based capacity management in resource life-cycle management within Enterprise Management layer �� Separated control plane between mission management and production generation and distribution results in flexible system architecture, allowing �f Mission management and product generation and distribution to each evolve on its timeline and needs �f Incorporate technology appropriate of unique requirements of mission management vs product generation and distribution (Stringent Uptime vs Big Data)

�� Containers are natural extension and first class citizen to Cloud to create hybrid infrastructure of on-premise and Cloud

SPS Functional Overview �� A critical element of The GOES NOP Spacecraft Support Ground System (SSGS)�� SPS is responsible for the real time (rt) ingest and processing of the GOES sensor data to produce GVAR data stream. SPS also supports the Orbit and Analysis (O&A) determination function. The Sensor Processing System Database (SPSDB) maintains SPS initialization parameters on flat files and provides backend mySQL database storage/archival/query of satellite information such NLUT, CORT, and etc. �� Current operational deployment: 8 SPS and 3 SPSDB at WCDA, 1 SPS and SPSDB at FCDAS, 1 SPS and SPSDB at WBU.�� Current system architecture: Blade chassis with 2 blade servers and 2 expansion cards running Solaris 10 and zones providing all processing functions, GIU, GRU, GSU and SPSDB runs as separate VM co-located on other GOES-NOP servers

NJGS Overview  NOAA, in partnership with EUMESAT and NASA/JPL, has been operating the NOAA Jason Ground System (NJGS) to support the operation of Jason-2 and Jasion-3 satellite missions. Jason-3 is the follow-on for Jason-2, with NOAA using a microwave radiometer, precision orbit determination components (e.g,, Global Positioning System (SPS), launch services, associated engineering services, the Jason-2 command and control, and data processing capabilities. EUMESAT provides spacecraft, altimeter instrumentation, precision orbit components, ground system and operations. NJGS has been operational and deployed at SOCC, WCDAS, FCDAS, and ESPC.

NJGS Functional Blocks Overview Mission Management:�� JTCCS: Responsible for spacecraft and earth terminal command and telemetry processing �� NOAAServer: Responsible for file processing �� JSEQ: Responsible for schedule and command processing �� CIG: Responsible for telemetry ingest and processing and command transmission �� CNC: Provides operator access to and control of other subsystems�� DRPPC: Provides telemetry analysis and monitoring �� ETS: Provides office line analysis and engineering tools

Ideal Re-hosted implementation�� Single physical server with RHEL 7.x hosting multiple SPS and SPS DB running Docker containers�� Up 6 EDT cards, pair of 3, co-located within one server to serve as conduit of GVAR data input and output�� GIU, GRU, GSU processing functions, implemented as Docker container, are stacked to form a single logical unit of SPS unit with SPSDB partitioned into standard Docker image of mySQL and custom legacy SPSDB Docker image�� Potential reduction of servers from 10 to 3. �� Legacy mission application interface and implementation persevered as it is with only change of deployment of unit.

Product, Data Generation and Distribution:�� FileManager: Generates various user products, and provides file collection and distribution between internal and external ESPC systems�� WebServer: Host a web site containing composite logs generated by FileManager, hosted the NRTAVS website, displays the LogMonitor application for visualization of log errors�� TM-NRT: Generates high level products (OGDR) from raw data (LTM)�� ESPC workstations: Monitor and control the status of FileManager and WebServers

Idea Refresh Implementation: �� Separation of control plane between mission management and product data generation and distribution�� Mission management resource lifecycle via Virtual Machines using affinity and anti-affinity rules �� Product, Data resource lifecycle via Container orchestration using capacity rules and auto scaling �� Virtual Desktop Infrastructure to streamline and simplify O&M lifecyle of applications�� Potential reduction of 30+ servers to 10-