Page 1 Federated Earth Observation (FedEO) Demo & Future Activities CEOS WGISS Meeting #40 28...

Federated Earth Observation (FedEO) Demo & Future Activities

CEOS WGISS Meeting #4028 September – 2 October, 2015

Harwell, Oxfordshire, UKHosted by United Kingdom Space Agency

(UKSA)

M.Albani, P.Mougnaud, A.Della Vecchia (ESA)Y. Coene (Spacebel)

WGISS#40 | FedEO Demo | Harwell, UK | 1 October 2015

DEMO Slides


Overview

• Demo Architecture

• EO Portal Client

• Catalog and data access– Sentinel-1

– LDS DISSHARM (SeaSat)

– Cryosat

– CNES Theia

– JAXA CATS-I, NASA ECHO

• Ongoing and future activities– DLR

– ROSCOSMOS

– SSARA


FedEO Collection search

OSDD is collection-specific.

FedEO OpenSearch (B2)

FedEO

I15 (B3)

OSDD

GPOD VA4

Collection Search

@ESA

IDN ECHO

OSDDOSDD OSDD

OSDDOSDD

synch/convert (fedeo/cwic)

ISO

ISO

ISO

ISO

ISO

OTHERS

OTHERS

Synch


JAXA CATS-I

CDS DAIL

EUMETSAT

M2CS

CSCDA

SCIHUB

CNES THEIACNES TAKE5

CRYOSAT-2DISSHARM

DLR

GEOSERVICE

OSDD

SMOS

OSDD

FedEO Granule search

FedEO OpenSearch

OSDD

…

GPOD VA4

Granule Search

@ESA

Datasets

EUMETSAT

ISO

DC

EOP O&M

EOP O&M

CDS DAIL

CCM

CCM…

CWIC

…

FedEO OpenSearch

DLRVITO CNES

ROSCOSMOS

JAXA

CATS-I

M2CS

SpiritSPOT4

SPOT5

Landsat

SMOS

ASF

OSDD is collection-specific and exploits (ISO/Atom) collection metadata such astemporal extent (<dc:date>) and sensorType if available.

SSARA

SciHub

INDERSINDEX

DISSHARM LDS

Synch


INDEX

CRYOSAT-2

NASA ECHO

In progress

In progress

• Additional Collection Metadata accessed via I15 EP and OpenSearch– Has positive effect on #collections that support 2-STEP search in

FedEO.

Work performed – Collection Metadata


Overview





– Cryosat

– CNES Theia



– ROSCOSMOS

– SSARA


EO Portal Client

• Test version @Spacebel:– http://eoportal.spacebel.be:8090/web/eoportal/fedeo

• Test version @ESA– http://www.eoportal.uat.esaportal.eu/web/eoportal/

• Operational version @ESA– TBD


http://eoportal.spacebel.be:8090/web/eoportal/fedeo

http://www.eoportal.uat.esaportal.eu/web/eoportal/

EO Portal Client


EO Portal Client

• Current implementation:– Two-step search via a single OSDD endpoint (Atom responses).

– GUI built from OSDD• Exploiting <Parameter> info: Pattern attribute, minimum, minInclusive,

maxInclusive attributes, <Option/> elements etc.

• Configurable "blacklist" to hide certain search parameters deemed less useful for Portal end-user.

– Pagination based on rel="first", "previous", "next", "last" Atom information provided by server. totalResults info no longer required.



Includes CNES THEIA, Cryosat-2, ASF, LDS-DISSHARM etc.

EO Portal Client

• Future versions– Improved treatment of multi-word queries

– Autocompletion of "organisation" and "platform" based on info in Parameter extension in OSDD.

– Broader support for "organisation" and "platform" search parameters

– Presentation of <link rel="icon" ../> associated with collection (e.g. Agency logo)

– Access to ISO metadata and EOP O&M metadata from the client.


Overview





– Cryosat

– CNES Theia



– ROSCOSMOS

– SSARA


Sentinel-1

• Improvements:– Additional collection EOP:ESA:SENTINEL_1

allowing many search options L0, L1, GRD, …

– Preserve pre-existing EOP:ESA:SENTINEL_1_L1_GRD etc. for backward compatibility.


Sentinel-1 (Granule download)


Sentinel-1

• Sentinel OSDD updated:– provide info about user registration

– Info used by CwicSmart client


ESA Online Dissemination LDS-DISSHARM


LDS-DISSHARM (Collections - SeaSat)


LDS-DISSHARM (Granules - SeaSat)


LDS-DISSHARM (Collections - Landsat)


LDS-DISSHARM (Granules - Landsat)



Cryosat (Collections)

• 1 collection, 15 product types, >350000 granules

Cryosat (Granules)



SMOS (Collections)

• 82 collections,> 170000 granules


SMOS (Granules)


CNES Theia (Collections)

• 5 collections

CNES Theia (Granules)


Accept SSL certificate in browser to see thumbnails.

CNES Theia (Granules)


JAXA CATS-I (Collections)

• 71 collections available…


PALSAR @JAXA (Granules)


PALSAR @JAXA (Granule Download)


NASA ECHO (Collection search)

• 4524 Collections …


NASA ECHO (Collection details)


NASA ECHO (Granule search)


NASA ECHO (Granule details)

• ..


Provides also access to rel="describedby" if media type is HTML.

Ongoing work

• Catalog & ordering integrations– DLR, EUMETSAT

– ROSCOSMOS

– SSARA


DLR (Collections)

• 157 collections


DLR (Collection Details)


ROSCOSMOS (Collections)

• IGDIS ERS Catalog, providing about 22 platforms, currently modelled as a single collection in FedEO.– Many footprints being multi-polygons… work in progress.


ROSCOSMOS (Granules)


ROSCOSMOS (Granules – Meteor-3M)


ROSCOSMOS (Granules – Monitor-E)


ROSCOSMOS (Granule Details - RapidEye)


Quicklook in TIFF format.

SSARA (Collections)

• Work in progress…


SSARA (Granules)

• To be completed


Overview





– Cryosat

– CNES Theia


• Ongoing and future activities


FedEO future activities


Ongoing/future Activities:FedEO Consolidation & Population

• Consolidation of FedEO Concept/Scenarios as part of the ESA and European EO Ground Segments

• Consolidation of interfaces with existing European catalogues and addition of new catalogues, e.g.:

– Extend number of downloadable collections from ESA DISSHARM LDS accessible through FedEO

– Extend number of orderable collections (OGC 06-141) with EUMETSAT and DLR

– Provide access to CNES THEIA 2.0 when available.

• Population of FedEO Collection Metadata Catalogue for ESA and European Missions

• Consolidation of access from GEO DAB Broker, tests with non-European catalogues

• Collaboration/interoperability/interfacing with CWIC, NASA ECHO


EO Portal Client Improvements

• Access to ISO, EOP O&M 1.0 and EOP O&M 1.1 metadata via "More" button (detect atom:links with "alternate" and "via")

• Auto-completion of platform and organisation search parameters based on Param extension info from OSDD

• OpenSearch Gateway to include link "rel=icon" to collection search results giving visual indication of origin of collections.


Organisation

RESTful interface - Discovery

• Content negotiation– Atom,

– JSON-LD

– RDF/XML

– Turtle

– HTML+

• Resource extensionWGISS#40 | FedEO Demo | Harwell, UK | 1 October 2015

HTML Response (Collections)

• Tools:• https://developers.google.com/structured-data/testing-tool/

• Example: • http://geo.spacebel.be/opensearch/request/?httpAccept=text/

html&platform=sentinel&startRecord=1&maximumRecords=5


https://developers.google.com/structured-data/testing-tool/

HTML Response (Collections)


RESTful Interface – Linked Data

• Provide (experimental) W3C Linked Data Platform interface, http://www.w3.org/TR/ldp/

LinkedDataGateway<<Application>>

SeriesContainer<<LDP Container>>

+GET()+HEAD()+OPTIONS()

Series<<LDP Resource>>


Datasets<<LDP Container>>


Dataset<<LDP Resource>>


/series<<Path>>

/{series-id}<<Path>>

/datasets

<<Path>>

/{dataset-id}<<Path>>

• Content negotiation

– RDF/XML

– Turtle

– JSON-LD

• HTTP Methods

– GET

– HEAD

– OPTIONS


http://www.w3.org/TR/ldp/

platform

1skos:

Concepttrdf:type

skos:

Concepttrdf:type

«http://gcmdservices.gsfc.nasa.gov/kms/concept/

1c53d85e-3792-4081-9748-192fd3140aa6»

rdf:about

"http://gcmdservices.gsfc.nasa.gov/kms/concept/

c7279e54-f7c1-4ee7-a957-719d6021a3f6"

rdf:about

instrument

1

"SENTINEL-1"

skos:prefLabel

"The SENTINEL-1 mission is the European Radar

Observatory for the Copernicus joint initiative of the

European Commission (EC) and the European Space

Agency (ESA). …"skos:definition

"http://gcmdservices.gsfc.nasa.gov/kms/concepts/

concept_scheme/platforms"

skos:inScheme

Linked Data

"SENTINEL-1 C-SAR"skos:prefLabel


RDF/XML Response

• Example 1:

– Tool: http://rdf-translator.appspot.com/

– http://geo.spacebel.be/opensearch/request/?platform=sentinel&httpAccept=application/rdf%2Bxml


http://rdf-translator.appspot.com/

RDF/XML Response

• Example 2:

– Tool: http://graves.cl/visualRDF/

– http://geo.spacebel.be/opensearch/request/?query=MOD15A25&httpAccept=application/rdf%2Bxml


JSON-LD Response (Collections)

• Tool:• http://codebeautify.org/jsonviewer#

• Examples: • http://geo.spacebel.be/opensearch/request/?httpAccept=application/

ld%2Bjson&organisationName=vito&startRecord=1&maximumRecords=1&recordSchema=iso

• http://geo.spacebel.be/opensearch/request/?httpAccept=application/ld%2Bjson&platform=sentinel&startRecord=1&maximumRecords=1&recordSchema=iso


http://geo.spacebel.be/opensearch/request/?httpAccept=application/ld+json&organisationName=vito&startRecord=1&maximumRecords=1&recordSchema=iso





http://geo.spacebel.be/opensearch/request/?httpAccept=application/ld+json&platform=sentinel&startRecord=1&maximumRecords=1&recordSchema=iso





JSON-LD Response (Collections)


Improved Search responses

• Generalise support for {geo:geometry}– Allow point search, search by polygon

• Improved indexing of metadata– Update CWIC metadata ingestion from IDN to extract "platform"

and "instrument" names

– Different backend server

• Support {sru:stylesheet} to let client choose the presentation of the HTML responses.– Presentation in-line with different Portals…

• Support recordSchema=gmd, gmi, cmr (TBC) to obtain different flavours of ISO metadata in responses.


Improved Search responses

• Faceted Search– “allowing users to explore a collection of information by applying

multiple filters” (*)

– E.g. provide links to (dataset series) results per group (e.g. FedEO, CWIC, ECHO, VA4, GPOD, CSCDA etc.) or other classification.

– Easy way:• <Query role="subset" title="series-x" eo:parentIdentifier="series-x"

totalResults=xxx .../>

– Can also be integrated in Atom-based responses using rel=« »:• Advertise number of items (if known): thr:count=123 (http://www.ietf.org/rfc/rfc4685.txt)

• Other approaches at http://www.feedbooks.com/api/facets and http://opds-spec.org/specs/opds-catalog-1-1-20110627/#Facets.

(*) http://en.wikipedia.org/wiki/Faceted_search


http://www.ietf.org/rfc/rfc4685.txt

http://www.feedbooks.com/api/facets

http://opds-spec.org/specs/opds-catalog-1-1-20110627/

API Documentation

• Update FedEO Client Partner Guide with additional capabilities.

• Make available online API documentation with examples. Technology being considered:– Swagger (http://swagger.io/), RAML (http://raml.org/)

– W3C Hydra, ApiDoc (http://apidocjs.com/)


http://swagger.io/

• Questions ?


Page 1 Federated Earth Observation (FedEO) Demo & Future Activities CEOS WGISS Meeting #40 28...

Documents

Transcript of Page 1 Federated Earth Observation (FedEO) Demo & Future Activities CEOS WGISS Meeting #40 28...