Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned...

25
Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 1 Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss J. Klausen 1 , L. Cappelletti 1 , N. Horat 1 , B. Calpini 1 , T. Pröscholdt 2 , L-P. Riishojgaard 2 , K. Monnik 3 , L. Nunes 2 , and Members of TT-WMD 1 Federal Office of Meteorology and Climatology (MeteoSwiss), Zurich Airport, Switzerland, [email protected] 2 World Meteorological Organization (WMO), Geneva, Switzerland 3 Bureau of Meteorology, Melbourne, Australia Acknowledgment: Financial support from Swiss Federal Department of Foreign Affairs (FDFA), The United Nations and International Organisations Division (UNIOD) … Where Observational Requirements Meet Observational Capabilities WIGOS & OSCAR

Transcript of Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned...

Page 1: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 1

Federal Department of Home Affairs FDHA

Federal Office of Meteorology and Climatology MeteoSwiss

J. Klausen1, L. Cappelletti1, N. Horat1, B. Calpini1, T. Pröscholdt2,

L-P. Riishojgaard2, K. Monnik3, L. Nunes2, and Members of TT-WMD1Federal Office of Meteorology and Climatology (MeteoSwiss), Zurich Airport, Switzerland, [email protected] Meteorological Organization (WMO), Geneva, Switzerland3Bureau of Meteorology, Melbourne, Australia

Acknowledgment: Financial support from Swiss Federal Department of Foreign Affairs (FDFA), The United

Nations and International Organisations Division (UNIOD)

… Where Observational Requirements

Meet Observational Capabilities

WIGOS & OSCAR

Page 2: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 2

Outline

• WIGOS

• WIGOS metadata standard and exchange format(s)

• OSCAR/Surface

• Outlook

Page 3: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 3

“If you don't know where you are going,

you'll end up someplace else.”

― Yogi Berra

WIGOS

Page 4: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 4

WIGOS (WMO Integrated Global Observing System)

• A governance framework for WMO and co-sponsored observing

systems, surface-based and space-based

• A strategy to do more with less

• An information resource

RequirementsSurface

capabilities

Space

capabilitiesAnalysis

SORT

Page 5: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 5

How to do more with less?

• Specify requirements

• Document existing cababilities

• Identify gaps

• Collaborate and integrate

− Identify partners

− Eliminate unnecessary redundancies

− Automate

− Streamline data operations

Example: Mbour, Senegal

CIM

EL C

E370 lid

ar

CIMEL Aeronet radiometerTEOM

Davis AWSShaded pyranometers

Page 6: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 6

WIGOS Targeted observing systems

• WMO Observing Systems

− Global Observing System (WWW/GOS)

− Observing component of Global Atmospheric Watch (GAW)

− WMO Hydrological Observing System (WHOS)

− Observing component of Global Cryosphere Watch (GCW)

• Co-Sponsored Observing Systems

− Global Climate Observing System (GCOS) (WMO-IOC-

UNEP-ISC)

− Global Ocean Observing System (GOOS) (IOC-WMO-

UNEP-ISC)

Page 7: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 7

RRR and OSCAREvolve observing systems rationally → WIGOS “Rolling Review of Requirements” Process

Enable adequate use of observational data → Operational Meteorology, Climatology, Public Health, …

Metadata & Analysis of Observing Systems Societal Impact

Requirements

Analysis

«Critical Review»

Improved

services for

society

Guidance

for Action

Capabilities

Surface-based

observing

systems

Space-based

observing

systems

RRR

«Know what we

need»

«Know what we

have»

«Know the

gap»

«Fill the gap»OSCAR/Surface

OSCAR/Space

OSCAR/Requirements

OSCAR/Analysis

Page 8: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 8

“If the world were perfect, it wouldn't be.”

― Yogi Berra

WIGOS metadata

standard and exchange format(s)

Page 9: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 9

WIGOS Metadata StandardApproved by WMO Cg-17 (2015)

https://wis.wmo.int/WIGOS-MD

▪ Land, ocean, space

▪ Fixed, mobile observing facilities

▪ In-situ, remote-sensing instruments

▪ Physical, chemical, biological, hydrological observations

▪ Weather, climate, warnings, …

1. Observed variable

2. Purpose of observation

3. Station/ platform

4. Environment

5. Instruments & methods of observation

6. Sampling

7. Data processing and reporting

8. Data Quality

9. Ownership and Data Policy

10.Contact

2016 - 2019

XML schema

& API

Page 10: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 10

WIGOS metadata exchange format(s)

WMD

Record

Observation

Observing

facility

Equipment

Deployment

DataGeneration• Schedule

• Sampling

• Processing

• Reporting

«WIS»-type

metadata

Extensions

XML

WMDRXSD

Page 11: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 11

OSCAR/SurfaceReference implementation of WMDS

Page 12: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 13

Public web interface

Finely tuned

search

Management console forregistered users

Detailed stationreport

Various search targetsand results export

possibilities

Industry-standard

technology stack

▪ Oracle DB, ArcGIS

▪ JEE, AngularJS

Safe and secure, traceable

Page 13: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 16

Restricted management console

• Stations

− Basic characteristics

− Photos

− History

• Observations

− Location

− Variable

− Methods

− Instruments

− Quality and uncertainty

− History

• Contacts

• Bibliographic references

& documents

Page 14: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 17

GUI interface to API endpoint for testing ...

• Upload full records or increments

• Register or update stations,

observations, deployments, contacts, …

• Flexible + powerful = tricky!

Generate XML

copy/paste

log

new/updated report

Page 15: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 18

REST API for search and upload

• https://oscar.wmo.int/surface/rest/api?_wadl

• Public (GET) endpoints, e.g., station search

• Private (POST) endpoint requiring security token

for upload of XML and different scope

− NMHSs → their territory

− World data centres → global

− Instrument experts → instrument catalogue

Page 16: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 19

“Cut my pie into four pieces, I don’t think I could eat eight.”

― Yogi Berra

Outlook

Page 17: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 20

(Re-)link data centres to OSCAR/Surface

API

JCOMMOPS

WRD

E-PROFILE

WINPROF

Amdar

WHOS

C3S 311a Lot2

WDCGG

WDCA

WDCRG

WOUDC

NDACC

Vol A

Page 18: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 21

Link NMHSs to OSCAR/Surface

• Primary candidates are the larger services with own metadata

repositories

− Export WMDR records in XML

− Upload to OSCAR/Surface using API

DWD

UKMO

MF

MeteoSwiss

Page 19: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 22

OSCAR/Surface &

WIGOS Data Quality Monitoring System (WDQMS)

OSCAR/Surface‘surface pressure’

Declared

Received

Page 20: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 23

Improve OSCAR/Surface API

• Extend API to allow retrieval of

− Full and partial station records as

• WMDR records (XML, JSON)

• WIS records (XML, JSON)

− Lists based on parameterized searches

• …

Page 21: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 24

Furthermore …

• Integration of OSCAR toolset

• Integrate ABOS

• Multilingual support

• Evolve web application’s functionalities, workflows …

Page 22: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 26

Training

Morocco 2015

Please let us know about your training needs!

RA III Lima 2017

RA IV Habana 2018

Page 23: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 27

“If you ask me anything I don't know, I'm not going to

answer.”

― Yogi Berra

Questions?

Page 24: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 28

Thank you for your attention

• For more information:

[email protected]

[email protected]

Page 25: Where Observational Requirements - Arctic · 2018-12-06 · Public web interface. Finely tuned search Management console for registered users Detailed station report. Various search

Jörg Klausen et al. | 8 October 2018 | CIMO TECO 2018, Amsterdam | 29

MeteoSwiss

Operation Center 1

CH-8058 Zurich-Airport

T +41 58 460 91 11

www.meteoswiss.ch

MeteoSvizzera

Via ai Monti 146

CH-6605 Locarno-Monti

T +41 58 460 92 22

www.meteosvizzera.ch

MétéoSuisse

7bis, av. de la Paix

CH-1211 Genève 2

T +41 58 460 98 88

www.meteosuisse.ch

MétéoSuisse

Chemin de l‘Aérologie

CH-1530 Payerne

T +41 58 460 94 44

www.meteosuisse.ch

MeteoSchweiz

Operation Center 1

CH-8058 Zürich-Flughafen

T +41 58 460 91 11

www.meteoschweiz.ch

Federal Department of Home Affairs FDHA

Federal Office of Meteorology and Climatology MeteoSwiss