Sentinel-2 Payload Data Ground Segment - ESA...

17
We care for a safer world Sentinel-2 Payload Data Ground Segment Olivier Colin - S2 PDGS Project Manager Sentinel-2 Preparatory Symposium, ESRIN 23.04.2012

Transcript of Sentinel-2 Payload Data Ground Segment - ESA...

We care for a safer world

Sentinel-2 Payload Data Ground Segment

Olivier Colin - S2 PDGS Project Manager

Sentinel-2 Preparatory Symposium, ESRIN 23.04.2012

We care for a safer world

Contents

• PDGS System Overview

• Data Access Concepts

• PDGS Procurement and Schedule

Sentinel-2 Preparatory Symposium, ESRIN 23.04.2012, O.Colin 2

We care for a safer world

The Sentinel-2 PDGS

• An element of the Sentinel-2 system responsible for: – Sentinel-2 payload and downlink planning

– Sentinel-2 data acquisition, processing and dissemination

– MSI calibration and performance monitoring

– Product quality verification, calibration and validation

– Mission performance monitoring and control, while contributing to the monitoring of the payload and platform in coordination with the Flight Operation Segment (FOS at ESA/ESOC)

• A component of the GSC ground infrastructure responsible for: – feeding Sentinel-2 products to the GMES Services through the GSCDA similarly to

any GMES Contributing Mission (GCM)

– providing direct access to Sentinel-2 products through GMES operational services and according to the Sentinel-2 Data Policy

Sentinel-2 Preparatory Symposium, ESRIN 23.04.2012, O.Colin 3

We care for a safer world

PDGS Context in S2 System

• The S2 PDGS interfaces with:

– The Sentinel-2 FOS for mission planning,

– The Sentinel-2 Satellites, for X-Band data reception

– The Coordinated Data access Services for providing integrated services to GMES users

– GMES users for direct access to S2 data

– The EDRS satellites for Ka-Band data reception and the EDRS Ground Segment for coordination activities

– Local Ground Stations and other Collaborative Ground Segment entities

– CNES/CST and ESA/ESTEC during the Commissioning Phase

Sentinel-2 Preparatory Symposium, ESRIN 23.04.2012, O.Colin 4

We care for a safer world

PDGS Technical Challenges

• Very large volumes of data to

be managed on ground

• Complex and innovative data

processing (L1C)

• System end-to-end

reliability/performance and

long-term sustainability

Large Volumes

Processing Complexity

Operational Reliability/Sustainability

Sentinel-2 Preparatory Symposium, ESRIN 23.04.2012, O.Colin 5

We care for a safer world

High-Level Design Drivers

Reliability,

Performance,

Sustainability

High Volumes

Data Handling

scalable design,

parallelisation,

distributed

archives

Simplify for

robustness Embedded

redundancy

on critical

components

high system

automation

assessment &

control of

system/mission

performance

Data-driven

design

Minimise /

optimise I/O

within and

across sites

Adapt product

to user needs

Flexible

design to

support

evolutions

Sentinel-2 Preparatory Symposium, ESRIN 23.04.2012, O.Colin 6

We care for a safer world

Data Volume Challenge

• Systematic Observation Scenario – MSI pixel supply rate (490 Mbps) is ~ 50x that of

ENVISAT MERIS/FR

– In average ~17 minutes of MSI operation/orbit 0.8 TBytes daily of compressed raw data for one satellite (1000 CDs!)

– Equivalent continuous raw data supply rate of ~170 Mbps (compressed) to be sustained with two satellites

– One 100km x 100km MSI image weights ~500MBytes (J2K compressed)

• Systematic Processing scenario – Sustain this flow down to the availability of high-level and quality proof

products in the archives ready for downstream usage

– Product archive of 27 Petabytes after 12 years, and over 1 Terabyte / day expected polling from the users

High-level products

at the user’s sites PDGS 170 Mbps

ingestion, calibration, radio/geo correction, ortho-

rectification, QC, archiving…

Sentinel-2 Preparatory Symposium, ESRIN 23.04.2012, O.Colin 7

We care for a safer world

Physical Layout (1)

• The S2 PDGS is made of:

– 4 Core Ground Stations (CGSs) for data acquisition, processing and data access

– 2 redunded Processing & Archiving Centres (PACs) for long-term data archiving and data access, as well as reprocessing

– One Mission Performance Centre (MPC) for Image quality control and Cal/Val

– One control centre for mission and system control (PDMC)

– An interconnecting wide area network for internal data circulation

– Network points of presence at CGSs and PACs for user data access over the global archive

Data Access Index

DAX

Collaboration Support Service

Reference Platform

Mission Planning

Mission Config. & Control

MPL

MCC CSSRP

Monitoring & Control

M&C

DataCirculation

DC

PD

GS

Da

ta M

an

ag

em

en

t

Ce

ntr

e (

PD

MC

)

DataAccess

Gateway DAG

Mission Ref. Files

DAX metadata updates

DAX

server I/F

DAIL

front-end

Front-End Services

FES

Mission-Plan|Acquisition-Schedule,

POD products,

MRF/Configuration

GSCDA/MPA reports

System-

configuration &

maintenance

Operator

Interfaces

MMUS

transactions

MSI

Decomp.

SW

MMUS

Archive &Inventory

DataProcessing

Control

DataCirculation

DataAccess

Gateway

On-LineQualityControl

Instr. Data

Processing

DAG AI

DPC

IDP

OLQC

DC

Monitoring & Control

M&C

PAC (Processing /

Archiving Centre)

PDIs

DAG server

Configuration data

Queries to

DAX

PDIs

& all other data

Long-Term ArchivingService

LTA

Data-Access Index

(backup)

DAX

Processing Option LTA Option DAX Mirror Option

DataReception

Archive &Inventory

DataProcessing

Control

DataCirculation

DataAccess

Gateway

On-LineQualityControl

Instr. Data

Processing

DAG

AI

DRX

DPC

IDP

OLQC

DC

Monitoring & Control

M&C

DAG

server

Acquisition-Schedule-Plan

MRF/Configuration

RF signal

MSI & HKTM PDIs

MRF/Operation-Reports

Queries to

DAX

CGS

MPC

PDMC

PACs

CGSs

Sentinel-2 Preparatory Symposium, ESRIN 23.04.2012, O.Colin 8

We care for a safer world

Physical Layout (2)

• CGS (Core Ground Station) x4

– Matera

– Maspalomas

– Svalbard

– Alaska

• PAC (Processing/Archiving Centre) x2

– Farnborough (UK)

– Madrid (Spain)

• MPC (Mission Performance Centre)

– Still to be selected

• PDMC (Payload Data Management Centre)

– ESRIN, Frascati

Maspalomas

Matera

Svalbard

Alaska

Farnborough Frascati

Madrid

Sentinel-2 Preparatory Symposium, ESRIN 23.04.2012, O.Colin 9

We care for a safer world

< 100 minutes

Level-1B and -1C

products

Processing of all data up to Level-1C within 100 minutes after satellite downlink

PDGS Processing Concept

Sentinel-2 products

CGSs

PACs

Archive &Inventory

DataProcessing

Control

DataCirculation

DataAccess

Gateway

On-LineQualityControl

Instr. Data

Processing

DAG AI

DPC

IDP

OLQC

DC

Monitoring & Control

M&C

PAC (Processing /

Archiving Centre)

PDIs

DAG server

Configuration data

Queries to

DAX

PDIs

& all other data

Long-Term ArchivingService

LTA

Data-Access Index

(backup)

DAX

Processing Option LTA Option DAX Mirror Option

DataReception

Archive &Inventory

DataProcessing

Control

DataCirculation

DataAccess

Gateway

On-LineQualityControl

Instr. Data

Processing

DAG

AI

DRX

DPC

IDP

OLQC

DC

Monitoring & Control

M&C

DAG

server

Acquisition-Schedule-Plan

MRF/Configuration

RF signal

MSI & HKTM PDIs

MRF/Operation-Reports

Queries to

DAX

CGS

Centralised

& transparent

access

Long-Term availability from PACs

Short term rolling availability from stations

internal circulation

< 100 minutes after station acquisition

within typically a week

Sentinel-2 Preparatory Symposium, ESRIN 23.04.2012, O.Colin 10

We care for a safer world

Timeliness

The timeliness pattern is cascading from the observation pattern relative to the core station network, it will range typically from:

- 100mins from sensing in direct station visibility

- between 3h and 24h otherwise

0-1

1-2

2-3

3-4

4-5

5-6

>6

Average download ageing (hours)

Age of the data (in hours) accumulated on board

at the time it is received at the PDGS ground station

Example of the timeliness pattern at summer solstice with the network of ground stations (Matera, Svalbard, Maspalomas, Alaska)

Sentinel-2 Preparatory Symposium, ESRIN 23.04.2012, O.Colin 11

We care for a safer world

User Product Concept

• Product contents are defined by the user at query/download time – Area of interest

– Selected product components (level, bands, metadata, etc)

– Formatting/Packaging options

• Data Handling – Product data is archived as elementary

product “granules” (slices for L1B or tiles for L1C) following a geographical split

– Product granules are assembled during download into the final “User-Products” transparently to the user

Data-driven processing/archiving User-driven data-access

Sentinel-2 Preparatory Symposium, ESRIN 23.04.2012, O.Colin 12

We care for a safer world

S2 PDGS System Highlights

• Systematic operation concept

• Challenging performance - All processing systematic within an orbit

• Huge data volumes and petabyte scale mission lifetime archive

• Innovative Level-1C and product concept

• On-line data access from a Federated System of Stations and PACs

Sentinel-2 Preparatory Symposium, ESRIN 23.04.2012, O.Colin 13

We care for a safer world

Sentinel-2 Specific Procurements

• PDGS Core Procurement – Most sub-systems procurements

– Instrument Processors and Mission Performance Assessment sub-systems via Best Practices ITTs

– Integration Verification & Validation activities

• Sentinel-2 Mission Planning

• Sentinel-2 Atmospheric Correction prototype processor – To be integrated in the Sentinels User Toolbox

Procurement Approach (1)

Sentinel-2 Preparatory Symposium, ESRIN 23.04.2012, O.Colin 14

We care for a safer world

Procurement Approach (2)

Sentinels Common Procurements

• Demodulator and Front-End Processor (DFEP) – Common procurement for S1/S2/S3

• Next Generation User Services for Earth Observation (ngEO) – Common procurement for Sentinels, Explorers and TPM

• GSC Infrastructure Procurement & Operations – CGS Procurement including operation SLAs (in negotiation)

– PAC Procurement including operation SLAs (in negotiation)

– Network WAN infrastructure procurement and operations, ITT planned mid 2012

• Sentinel User Handbook and Exploitation Tools – Common procurement for S1/S2/S3

• Precise Orbit Determination (POD) – Common procurement for S1/S2/S3, ITT planned end 2012

• Station Resource Allocation (SRA) – PDGS Sentinel-1/2/3 Coordination facility for mission planning, design in preparation

Sentinel-2 Preparatory Symposium, ESRIN 23.04.2012, O.Colin 15

We care for a safer world

Delta-hardware deployment for S2B

PDGS Deployment for GSC Operations (Ramp-up phase)

S2 PDGS Schedule

System Requirements Review: Passed Preliminary Design Review: Passed Critical Design Review: Q4 2012

Sentinel-2 Preparatory Symposium, ESRIN 23.04.2012, O.Colin 16

PDGS Development

Initial PDGS deployment for satellite Commissioning

S2A Commissioning

LS2A End 2013

Full S2A

mission capacity

(2014)

Jan 2013 LS2B 2015

LS2A + 3 months

Product availability

S2B Commissioning

Full S2

mission

capacity

S2A S2B

We care for a safer world

Thank you!

Olivier Colin, Barbara Angelucci, Olivier Barois, Gioacchino Buscemi, Enrico Cadau, Maurizio Cao, Andrea Cavallini, Steven Delwart, Eric Doyle, Steffen Dransfeld, Pierre Femenias, Antonio de la

Fuente, Ferran Gascon, Javier Gorrono Vinegla, Bianca Hoersch, Nigel Houghton, Gian Piero Izzo, Cristiano Lopes, Borja López Fernández, Fabio Lozito, Davide Moretti, Francesco Nisi, Mats

Onnestam, Alessandro Piro, Cristiano Silvagni, Andrea Simonini, Nityaporn Sirikan

Sentinel-2 Preparatory Symposium, ESRIN 23.04.2012, O.Colin 17