Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… ·...
Transcript of Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… ·...
![Page 1: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/1.jpg)
PEPSPlateforme d’Exploitation des Produits Sentinel
Search Visualize Download Process
Jérôme GASPERI
![Page 2: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/2.jpg)
The PEPS platform is the french Collaborative Ground Segment for Sentinels data.
It would store and provide access to all Sentinel 1-2-3 products
![Page 3: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/3.jpg)
PEPS Phase 12015-2017
![Page 4: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/4.jpg)
Catalogue
Admin
IngestionTraitementprécablés
Stockage)PEPSBULL)HPSS
Dev88&8Processing
Hub8ESAUtilisateurs
SQL
SSH
Admin
HTTP Développeur
Interactif
BatchBatch Continue
Type8d’usageNFS8ou8HTTP
Firewall8STRE8+8STRI
Accès8distantsécurisé
WAF8+8Firewall8STRE
Firewall8STRE8+TRI
![Page 5: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/5.jpg)
Store
![Page 6: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/6.jpg)
Catalogue
Admin
IngestionTraitementprécablés
Stockage)PEPSBULL)HPSS
Dev88&8Processing
Hub8ESAUtilisateurs
SQL
SSH
Admin
HTTP Développeur
Interactif
BatchBatch Continue
Type8d’usageNFS8ou8HTTP
Firewall8STRE8+8STRI
Accès8distantsécurisé
WAF8+8Firewall8STRE
Firewall8STRE8+TRI
Store
![Page 7: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/7.jpg)
20177 PB
Sentinel storage in Toulouse CNES data center in late 2017
Store
![Page 8: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/8.jpg)
20177 PB
Sentinel storage in Toulouse CNES data center in late 2017
DV
Ds
Store
![Page 9: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/9.jpg)
Store
Bull HPSS
2 PB
7 PB
Hard drives
Tapes
Automatic migration based on rules
Seamless retrieve
NFS mount
CNES data center - Toulouse, France
![Page 10: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/10.jpg)
Store
During ingestion process, each product metadata is semantically enhanced using iTag Web Service
![Page 11: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/11.jpg)
Image footprint
Store
![Page 12: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/12.jpg)
Image footprint
World coast
Toponyms(Countries, Regions, States)
Population density
Land cover
…etc…
Information layers
Store
![Page 13: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/13.jpg)
Image footprint
World coast
Toponyms(Countries, Regions, States)
Population density
Land cover
…etc…
Information layers
[…etc…] { "name":"Europe", "id":"continent:europe",
"countries":[ {
"name":"Italy", "id":"country:italy", "pcover":37.02,
"regions":[ {
"name":"Valle d'Aosta", "id":"region:valle-d-aosta",
"states":[ {
"name":"Aoste", "id":"state:aoste",
"pcover":37.02, "toponyms":[] } ] } ] }, […etc…]
Store
![Page 14: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/14.jpg)
Land cover
Descriptive keywords
« Human readable » location
![Page 15: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/15.jpg)
Store
Ingestion is a one line REST POST requestcurl -X POST -d @metadata.xml https://admin:[email protected]/resto/collections/Sentinel1
![Page 16: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/16.jpg)
Store
Ingestion is a one line REST POST requestcurl -X POST -d @metadata.xml https://admin:[email protected]/resto/collections/Sentinel1
Action
![Page 17: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/17.jpg)
Store
Ingestion is a one line REST POST requestcurl -X POST -d @metadata.xml https://admin:[email protected]/resto/collections/Sentinel1
Action Metadata path
![Page 18: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/18.jpg)
Store
Ingestion is a one line REST POST requestcurl -X POST -d @metadata.xml https://admin:[email protected]/resto/collections/Sentinel1
Action Metadata path Secured endpoint
![Page 19: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/19.jpg)
Store
Ingestion is a one line REST POST requestcurl -X POST -d @metadata.xml https://admin:[email protected]/resto/collections/Sentinel1
Action Metadata path Target collectionSecured endpoint
![Page 20: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/20.jpg)
Distribute
![Page 21: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/21.jpg)
Catalogue
Admin
IngestionTraitementprécablés
Stockage)PEPSBULL)HPSS
Dev88&8Processing
Hub8ESAUtilisateurs
SQL
SSH
Admin
HTTP Développeur
Interactif
BatchBatch Continue
Type8d’usageNFS8ou8HTTP
Firewall8STRE8+8STRI
Accès8distantsécurisé
WAF8+8Firewall8STRE
Firewall8STRE8+TRI
Distribute
![Page 22: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/22.jpg)
PEPS distribution based on resto
Same as in the THEIA CNES distribution center 1
1
Distribute
![Page 23: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/23.jpg)
resto is an Earth Observation search engine compliant with OGC / WGISS EO OpenSearch standard
Distribute
![Page 24: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/24.jpg)
resto
PEPS
![Page 25: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/25.jpg)
iTag
resto
PEPS
![Page 26: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/26.jpg)
Query AnalyzerGazetteer
Administration
iTag
resto
PEPS
![Page 27: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/27.jpg)
Query AnalyzerGazetteer
Administration
Abs
trac
t D
atab
ase
Acc
ess
Laye
r
PostgreSQL Driver
iTag
resto
PEPS
![Page 28: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/28.jpg)
Query AnalyzerGazetteer
Administration
Abs
trac
t D
atab
ase
Acc
ess
Laye
r
PostgreSQL Driver
iTag
resto
HPSS
PEPS
![Page 29: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/29.jpg)
Query AnalyzerGazetteer
Administration
RES
T W
ebse
rvic
es
Abs
trac
t D
atab
ase
Acc
ess
Laye
r
PostgreSQL Driver
iTag
resto
HPSS
PEPS
![Page 30: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/30.jpg)
Query AnalyzerGazetteer
Administration
RES
T W
ebse
rvic
es
Abs
trac
t D
atab
ase
Acc
ess
Laye
r
PostgreSQL Driver
iTag
resto
Search
Visualize
Download
Users
HPSS
PEPS
![Page 31: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/31.jpg)
Query AnalyzerGazetteer
Administration
RES
T W
ebse
rvic
es
Abs
trac
t D
atab
ase
Acc
ess
Laye
r
PostgreSQL Driver
iTag
resto
Search
Visualize
Download
Users
DELETE
POST
Admin
HPSS
PEPS
![Page 32: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/32.jpg)
SearchDistribute
![Page 33: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/33.jpg)
![Page 34: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/34.jpg)
Coastal
![Page 35: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/35.jpg)
Coastal
town
![Page 36: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/36.jpg)
California
Coastal
town
![Page 37: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/37.jpg)
California
Coastal
town
spring
![Page 38: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/38.jpg)
California
Coastal
town
spring
without clouds
![Page 40: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/40.jpg)
Distribute
![Page 41: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/41.jpg)
12 000 000Sentinel2 simulated granules metadata
Distribute
![Page 42: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/42.jpg)
12 000 000Sentinel2 simulated granules metadata
INGEST TIME0.4s
i.e. rate of 150 products per minute
Distribute
![Page 43: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/43.jpg)
12 000 000Sentinel2 simulated granules metadata
INGEST TIME0.4s
i.e. rate of 150 products per minute
Mix of geo-temporal and keywords queries
SEARCH TIME0.2s 0.6s
1 user 100 concurrent users
Distribute
![Page 44: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/44.jpg)
DownloadDistribute
![Page 45: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/45.jpg)
SSO(Not activated yet)
![Page 46: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/46.jpg)
RightsSSO(Not activated yet)
![Page 47: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/47.jpg)
Rights One clickSSO(Not activated yet)
![Page 48: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/48.jpg)
Rights CartOne clickSSO(Not activated yet)
![Page 49: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/49.jpg)
Rights CartOne click
Simple HTTP GET Recovery on error Apache direct serve - X-Sendfile Metalink support
SSO(Not activated yet)
![Page 50: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/50.jpg)
Rights CartOne click
Simple HTTP GET Recovery on error Apache direct serve - X-Sendfile Metalink support
Bandwith 1 Gb/s shared among all users and CNES projects (to be upgrade to 10 Gb/s in 2016)
SSO(Not activated yet)
![Page 51: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/51.jpg)
<?xml version="1.0" encoding="UTF-8"?><metalink xmlns="urn:ietf:params:xml:ns:metalink"> <published>2015-05-30T19:31:56+0200</published> <file name="0f99edd2-f18b-5b80-b4a2-d021d76c20d0.zip"> <version>1.0</version> <language>en</language> <url priority="1">https://peps.cnes.fr/resto/collections/S1/0f99edd2-f18b-5b80-b4a2-d021d76c20d0/download?_tk=cf55e9902f511e65711ea623d2ebcfd249d99780</url> </file> …etc…</metalink>
Metalink
![Page 52: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/52.jpg)
<?xml version="1.0" encoding="UTF-8"?><metalink xmlns="urn:ietf:params:xml:ns:metalink"> <published>2015-05-30T19:31:56+0200</published> <file name="0f99edd2-f18b-5b80-b4a2-d021d76c20d0.zip"> <version>1.0</version> <language>en</language> <url priority="1">https://peps.cnes.fr/resto/collections/S1/0f99edd2-f18b-5b80-b4a2-d021d76c20d0/download?_tk=cf55e9902f511e65711ea623d2ebcfd249d99780</url> </file> …etc…</metalink>
MetalinkREST GET url
![Page 53: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/53.jpg)
<?xml version="1.0" encoding="UTF-8"?><metalink xmlns="urn:ietf:params:xml:ns:metalink"> <published>2015-05-30T19:31:56+0200</published> <file name="0f99edd2-f18b-5b80-b4a2-d021d76c20d0.zip"> <version>1.0</version> <language>en</language> <url priority="1">https://peps.cnes.fr/resto/collections/S1/0f99edd2-f18b-5b80-b4a2-d021d76c20d0/download?_tk=cf55e9902f511e65711ea623d2ebcfd249d99780</url> </file> …etc…</metalink>
Metalink
Volatile magic token (bypass authentication)
REST GET url
![Page 55: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/55.jpg)
Process
(2016)
![Page 56: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/56.jpg)
Catalogue
Admin
IngestionTraitementprécablés
Stockage)PEPSBULL)HPSS
Dev88&8Processing
Hub8ESAUtilisateurs
SQL
SSH
Admin
HTTP Développeur
Interactif
BatchBatch Continue
Type8d’usageNFS8ou8HTTP
Firewall8STRE8+8STRI
Accès8distantsécurisé
WAF8+8Firewall8STRE
Firewall8STRE8+TRI
Process
![Page 57: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/57.jpg)
Process
HPC50 Teraflops
![Page 58: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/58.jpg)
Two kind of processing for two kind of users« Developers » vs. « Normal Users »
![Page 59: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/59.jpg)
Developers + Have access to a unix account (VMs) + Have read access to data (i.e. filesystem) + Can deploy their processes (docker, SPARK) + Can launch massive processing + Can magically bind their process to WPS
![Page 60: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/60.jpg)
Normal users + Know nothing about VMs ! + Have read access to data from either from
HTML client or from Web Services + Can launch pre-existing processes provided by
the platform either from the HTML client or from WPS endpoints
![Page 61: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/61.jpg)
PEPS to integrate multiple initiatives ESA Coastal TEP, SparkInData, etc.
![Page 62: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/62.jpg)
!
PaaS
Market)Place
IaaSServeurs Données
SSO WPS
App App App App
Thematic)Services
ApplicationDevelopment
Data)Science
Labo)1
Labo)2
PME)1
PME)2
PME)3
Utilisateurs
Plateforme)thématique
Serveurs
Données
WPS
SSO
THEIA
Serveurs
Données
WPS
SSO
Process
![Page 63: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/63.jpg)
Foreseen architecture
![Page 64: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/64.jpg)
PEPS and interoperability
![Page 65: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/65.jpg)
Focus on « pragmatic » interoperability
![Page 66: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/66.jpg)
Focus on « pragmatic » interoperability
Major functionalities are built as standalone Web Services so they can be used in/by other projects (e.g. iTag, QueryAnalyzer)
![Page 67: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/67.jpg)
Focus on « pragmatic » interoperability
Major functionalities are built as standalone Web Services so they can be used in/by other projects (e.g. iTag, QueryAnalyzer)
Keep simple REST Web Service
![Page 68: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/68.jpg)
Focus on « pragmatic » interoperability
Major functionalities are built as standalone Web Services so they can be used in/by other projects (e.g. iTag, QueryAnalyzer)
Use JSON for Web Services (e.g. search service provides ATOM output only for standard conformity ... but GeoJSON output is the default).
Keep simple REST Web Service
![Page 69: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/69.jpg)
Focus on « pragmatic » interoperability
Major functionalities are built as standalone Web Services so they can be used in/by other projects (e.g. iTag, QueryAnalyzer)
Use JSON for Web Services (e.g. search service provides ATOM output only for standard conformity ... but GeoJSON output is the default).
Keep simple REST Web Service
Next step would be to move to (Geo)JSON-LD (i.e. linked data) and ... to standardize JSON output in OpenSearch (?)
![Page 71: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/71.jpg)
Example GeoJSON output from EO search
Paging
GeoJSON FeatureCollection
http://goo.gl/fZFlCy
![Page 72: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/72.jpg)
Example GeoJSON output from EO search
Paging
GeoJSON FeatureCollection
Each result is a GeoJSON Feature
http://goo.gl/fZFlCy
![Page 73: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/73.jpg)
Example GeoJSON output from EO search
Computed by Query Analyzer Web Service
Paging
GeoJSON FeatureCollection
Each result is a GeoJSON Feature
http://goo.gl/fZFlCy
![Page 74: Search Visualize Download Processceos.org/document_management/Working_Groups/WGISS/Meetings/… · 29/9/2015 · Market)Place IaaS Serveurs Données SSO WPS App App App App Thematic)Services](https://reader034.fdocuments.in/reader034/viewer/2022052101/603ae10643bc99684e28b2c5/html5/thumbnails/74.jpg)
Example GeoJSON output from EO search
Computed by Query Analyzer Web Service
What was searched by the server
Paging
GeoJSON FeatureCollection
Each result is a GeoJSON Feature
http://goo.gl/fZFlCy