(A)ATSR archive at the NERC Earth Observation Data Centre Matt Pritchard, Jack Abolins, Brian...

40
(A)ATSR archive (A)ATSR archive at the at the NERC Earth Observation Data NERC Earth Observation Data Centre Centre Matt Pritchard, Jack Abolins, Brian Maddison & Matt Pritchard, Jack Abolins, Brian Maddison & Chris Mutlow Chris Mutlow NEODC / CCLRC Rutherford Appleton Laboratory NEODC / CCLRC Rutherford Appleton Laboratory

Transcript of (A)ATSR archive at the NERC Earth Observation Data Centre Matt Pritchard, Jack Abolins, Brian...

(A)ATSR archive(A)ATSR archiveat theat the

NERC Earth Observation Data CentreNERC Earth Observation Data Centre

Matt Pritchard, Jack Abolins, Brian Maddison & Chris Matt Pritchard, Jack Abolins, Brian Maddison & Chris MutlowMutlow

NEODC / CCLRC Rutherford Appleton LaboratoryNEODC / CCLRC Rutherford Appleton Laboratory

(A)ATSR Archive at the NEODC

What is the NEODC?

• NERC Data NERC Data CentresCentres– Data Data

managementmanagement– CurationCuration– Support for UK Support for UK

EO communityEO community

(A)ATSR Archive at the NEODC

NEODC Datasets

• Commercial satellite imageryCommercial satellite imagery– LANDSAT, SPOT, …LANDSAT, SPOT, …

• NERC ARSFNERC ARSF– ATM, CASI, LiDAR, Digital ATM, CASI, LiDAR, Digital

Aerial PhotographyAerial Photography

• NEXTMap BritainNEXTMap Britain– IfSAR 5m terrain model of GBIfSAR 5m terrain model of GB

• ATSR UBT archiveATSR UBT archive– ATSR-1, ATSR-2ATSR-1, ATSR-2

• NEODC interfaceNEODC interface• ESA SSEESA SSE

services.eoportal.orgservices.eoportal.org

• (A)ATSR Archive(A)ATSR Archive– 3 missions, 1 format3 missions, 1 format

(ENVISAT)(ENVISAT)

(A)ATSR Archive at the NEODC

NEODC Datasets

• Commercial satellite imageryCommercial satellite imagery– LANDSAT, SPOT, …LANDSAT, SPOT, …

• NERC ARSFNERC ARSF– ATM, CASI, LiDAR, Digital ATM, CASI, LiDAR, Digital

Aerial PhotographyAerial Photography

• NEXTMap BritainNEXTMap Britain– IfSAR 5m terrain model of GBIfSAR 5m terrain model of GB

• ATSR UBT archiveATSR UBT archive– ATSR-1, ATSR-2ATSR-1, ATSR-2

• NEODC interfaceNEODC interface• ESA SSEESA SSE

services.eoportal.orgservices.eoportal.org

• (A)ATSR Archive(A)ATSR Archive– 3 missions, 1 format3 missions, 1 format

(ENVISAT)(ENVISAT)

(A)ATSR Archive at the NEODC

NEODC Datasets

• Commercial satellite imageryCommercial satellite imagery– LANDSAT, SPOT, …LANDSAT, SPOT, …

• NERC ARSFNERC ARSF– ATM, CASI, LiDAR, Digital ATM, CASI, LiDAR, Digital

Aerial PhotographyAerial Photography

• NEXTMap BritainNEXTMap Britain– IfSAR 5m terrain model of GBIfSAR 5m terrain model of GB

• ATSR UBT archiveATSR UBT archive– ATSR-1, ATSR-2ATSR-1, ATSR-2

• NEODC interfaceNEODC interface• ESA SSEESA SSE

services.eoportal.orgservices.eoportal.org

• (A)ATSR Archive(A)ATSR Archive– 3 missions, 1 format3 missions, 1 format

(ENVISAT)(ENVISAT)

(A)ATSR Archive at the NEODC

NEODC Datasets

• Commercial satellite imageryCommercial satellite imagery– LANDSAT, SPOT, …LANDSAT, SPOT, …

• NERC ARSFNERC ARSF– ATM, CASI, LiDAR, Digital ATM, CASI, LiDAR, Digital

Aerial PhotographyAerial Photography

• NEXTMap BritainNEXTMap Britain– IfSAR 5m terrain model of GBIfSAR 5m terrain model of GB

• ATSR UBT archiveATSR UBT archive– ATSR-1, ATSR-2ATSR-1, ATSR-2

• NEODC interfaceNEODC interface• ESA SSEESA SSE

services.eoportal.orgservices.eoportal.org

• (A)ATSR Archive(A)ATSR Archive– 3 missions, 1 format3 missions, 1 format

(ENVISAT)(ENVISAT)

(A)ATSR Archive at the NEODC

(A)ATSR Archive - background

• Project backgroundProject background– Hadley Centre Climate Prediction Hadley Centre Climate Prediction

ProgrammeProgramme•Requirement for common-format set of Requirement for common-format set of

products covering 15 yearsproducts covering 15 years• Inputs to climate change researchInputs to climate change research

– NERC / UK EO communityNERC / UK EO community•Dedicated (A)ATSR Archive for researchDedicated (A)ATSR Archive for research

– RAL involvement with (A)ATSRRAL involvement with (A)ATSR•Design / build / consultation / operations / Design / build / consultation / operations /

calibration / validation / data management / calibration / validation / data management / community supportcommunity support

(A)ATSR Archive at the NEODC

(A)ATSR Archive - overview

UBT Level 2archive

Level 1barchive

Archive Product

Processor

AATSRL2

ATSR-2 L1b

ATSR-1 L1b

ATSR-2 UBT

ATSR-1 UBT ATSR-

1 L2

ATSR-2 L2

ATSR-1

METEO

ATSR-2

METEO

AATSR L1b

AATSR L2

AATSR METE

O

Archive Product

Processor

ingest

AATSRL1b

ingest

(A)ATSR Archive at the NEODC

Products from (A)ATSR

• Products from (A)ATSRProducts from (A)ATSRProductProduct DescriptionDescription ATSR-1ATSR-1 ATSR-2ATSR-2 AATSRAATSR

ATS_TOA_1ATS_TOA_1PP

GBTR at full resolutionGBTR at full resolution **ATS_NR__2ATS_NR__2PP

GST at full resolutionGST at full resolution **ATS_AR__2PATS_AR__2P AST at 0.5AST at 0.5° & 10 arcmin resolution° & 10 arcmin resolution **ATS_MET_2ATS_MET_2PP

METEO product: AST & ABT, 10 arc minMETEO product: AST & ABT, 10 arc min ATS_AST_BATS_AST_BPP

Browse product 4 x 4 km resolutionBrowse product 4 x 4 km resolution jpegjpeg Preview imagePreview image

*already online*already online

(A)ATSR Archive at the NEODC

Delivery mechanism

• Storage structureStorage structure– 80 Terabyte archive80 Terabyte archive– 1 file structure:1 file structure:

• mission/YY/MM/DD/productmission/YY/MM/DD/product

• Methods (self-service access)Methods (self-service access)– FTPFTP– HTTP (Data browser)HTTP (Data browser)

• Searchable metadata catalogueSearchable metadata catalogue– map interfacemap interface– Metadata inspectionMetadata inspection– Preview imagesPreview images

(A)ATSR Archive at the NEODC

Delivery mechanism

• Storage structureStorage structure– 80 Terabyte archive80 Terabyte archive– 1 file structure:1 file structure:

• mission/YY/MM/DD/productmission/YY/MM/DD/product

• Methods (self-service access)Methods (self-service access)– FTPFTP– HTTP (Data browser)HTTP (Data browser)

• Searchable metadata catalogueSearchable metadata catalogue– map interfacemap interface– Metadata inspectionMetadata inspection– Preview imagesPreview images

(A)ATSR Archive at the NEODC

Data browser

(A)ATSR Archive at the NEODC

Data browser

(A)ATSR Archive at the NEODC

Data browser

(A)ATSR Archive at the NEODC

Data browser

(A)ATSR Archive at the NEODC

Data browser

(A)ATSR Archive at the NEODC

Data browser

(A)ATSR Archive at the NEODC

Data browser

(A)ATSR Archive at the NEODC

Data browser

(A)ATSR Archive at the NEODC

Data browser

(A)ATSR Archive at the NEODC

Delivery mechanism

• Storage structureStorage structure– 80 Terabyte archive80 Terabyte archive– 1 file structure:1 file structure:

• mission/YY/MM/DD/productmission/YY/MM/DD/product

• Methods (self-service access)Methods (self-service access)– FTPFTP– HTTP (Data browser)HTTP (Data browser)

• Searchable metadata catalogueSearchable metadata catalogue– Example from existing ATSR-1/2 UBT archive Example from existing ATSR-1/2 UBT archive

interfaceinterface– Map interfaceMap interface– Metadata inspectionMetadata inspection– Preview imagesPreview images

(A)ATSR Archive at the NEODC

ATSR-1 & 2 UBT Archive

• Online accessOnline access– SearchSearch

(A)ATSR Archive at the NEODC

ATSR-1 & 2 UBT Archive

• Online accessOnline access– SearchSearch

(A)ATSR Archive at the NEODC

ATSR-1 & 2 UBT Archive

• Online accessOnline access– SearchSearch

(A)ATSR Archive at the NEODC

ATSR-1 & 2 UBT Archive

• Online accessOnline access– SearchSearch

(A)ATSR Archive at the NEODC

ATSR-1 & 2 UBT Archive

• Online accessOnline access– SearchSearch

(A)ATSR Archive at the NEODC

ATSR-1 & 2 UBT Archive

• Online accessOnline access– SearchSearch

(A)ATSR Archive at the NEODC

ATSR-1 & 2 UBT Archive

• Online accessOnline access– SearchSearch

(A)ATSR Archive at the NEODC

ATSR-1 & 2 UBT Archive

• Online accessOnline access– SearchSearch

(A)ATSR Archive at the NEODC

ATSR-1 & 2 UBT Archive

• Online accessOnline access– SearchSearch

(A)ATSR Archive at the NEODC

Archive availability

•NEODC (A)ATSR archiveNEODC (A)ATSR archive–Dedicated facility for UK usersDedicated facility for UK users

(NERC & Cat-1)(NERC & Cat-1)– [email protected]@rl.ac.uk

•ESAESA–Non-UK usersNon-UK users

[email protected]@esa.int

(A)ATSR Archive at the NEODC

AATSR Products

AATSRAATSR

Level 1b Level 1b (ATS_TOA_1P)(ATS_TOA_1P)

(A)ATSR Archive at the NEODC

AATSR Products

Level 2 averaged (ATS_AR__2P)Level 2 averaged (ATS_AR__2P)

(A)ATSR Archive at the NEODC

Online archive

• Current coverage: Level 1b productsCurrent coverage: Level 1b products

(A)ATSR Archive at the NEODC

Online archive

• Current coverage: Level 2 full-resolution productsCurrent coverage: Level 2 full-resolution products

(A)ATSR Archive at the NEODC

Online archive

• Current Coverage: Level 2 averaged productsCurrent Coverage: Level 2 averaged products

(A)ATSR Archive at the NEODC

Archive Product Processor

The Archive Product Processor

(APP)

CfE STEP

ERS Mission Orbit & Phase Information

Set of sequential SADIST-2 UBTs from the NEODC Archive

Ungridded Orbit ProductATS_TOA_UP.En

ATSR-2 Reflectance Calibration Tables

State-Vector &Time-correlation

Envisat-Style ATSR Auxiliary Data

Envisat-styleATSR-1/ATSR-2 L1B

ATS_TOA_1P.En

Consolidate for Envisat::

· Stitches together SADIST-2 frames· Removes tape-to-tape overlaps· Prepares Envisat MPH contents· Generates Orbit/Time data· Generates min/max sensor temps· Removes blanking-pulse negation· Preserves blanking-pulse info· Generates processing/QA log

SADIST-2 To Envisat ProcessorAATSR Prototype Processor modules for:

· Geolocation (Courtesy ESA/GMV)· Gridding (Courtesy ESA/GMV)· Cosmetic Filling· Land/Sea Flagging· Cloud-flagging

and also must:· Switch between ATSR-1 and ATSR-2 Aux

data· Transfer ungridded data into PP

structures · Use the PP's "Output_GBTR" module with

ATSR-1 and ATSR-2 switches

Orbit Min/Max Temperatures

(A)ATSR Archive at the NEODC

First outputs

ATSR-2ATSR-2

Level 1b Level 1b (ATS_TOA_1P)(ATS_TOA_1P)

(A)ATSR Archive at the NEODC

Archive benefits

• Processing facilityProcessing facility– Generation of product extractsGeneration of product extracts– Processing against entire archiveProcessing against entire archive

•Projects e.g. Projects e.g. ATSR-ClimateATSR-Climate•Reprocessing / evaluation datasetsReprocessing / evaluation datasets

• Supply of validation dataSupply of validation data• Delivery methodsDelivery methods

– OGC WMS / WCS ?OGC WMS / WCS ?

• Replacement of current products with Replacement of current products with outputs of ESA AATSR reprocessingoutputs of ESA AATSR reprocessing

(A)ATSR Archive at the NEODC

http://www.neodc.rl.ac.ukhttp://www.neodc.rl.ac.uk

[email protected]@rl.ac.uk