The Mediterranean Data portal - EMODnet Physics€¦ · Coriolis/France •Link with international...

The Mediterranean Data portal

EMODNET ADRIATIC meeting, Split, 3-4 December 2013

Leonidas Perivoliotis

Hellenic Center for Marine Research, Greece

Background on the data collection, processing and distribution in the Mediterranean: Platform-oriented data centers

20 ARGO floats deployed from VOS (few hours delay)

Daily satellite SST interpolated in RT on model grid (one day delay)

XBT VOS high resolution system (12 nm along track and full profile transmission, few hours delay)

Multiparametric buoys in: Ligurian Sea, Adriatic Sea and

Cretan Sea (few hours delay)

Open ocean monitoring by gliders (few hours delay)

Scatterometer DAILY winds analysis, 1/2x1/2 (one week delay)

JASON-1, GFO, ENVISAT, T/P Sea Level Anomalies

(few days delay)

T/¨P

ENVISAT

ERS

JASON

GFO

Collects and process data from Insitu platforms in the

Mediterranean Sea The regional node for the Insitu component of Marine Core

Service (MCS) Single point access for data provision to Med Marine Forecasting

Center (MFC) Distributes added value (quality controlled) data in a unique

format Built through MyOcean I&II, but it supports the Mediterranean

observing component of major EU projects in Operational Oceanography (Jerico, Perseus, FixO3).

Continuous expansion in terms of capacity in order to become the Regional Insitu MONGOOS Data Center.

The Mediterranean Data Portal

Infrastructure built on EuroGOOS strategy and supported through MyOcean I&II projects

Insitu Thematic Assembly Centers (TACs): A regional organization

Black Sea IOBAS/Bulgaria all data

Baltic Sea: SMHI/Sweden •Temp & Salinity : BSH/Germany •Current: SMHI/Sweden •Sea Level: DMI/Denmark •Bio : FMI-Syke/Finland

South West Shelves: Puertos Del Estado/Spain •Mooring : PdE •Underway data: Coriolis/France

North West Shelves: BSH/Germany •Temp & Salinity : BSH/Germany •Current: SMHI/Sweden •Sea Level: DMI/Denmark

Global Ocean : Coriolis/France •Link with international network s: Coriolis/France •ARGO: Coriolis,BODC,BSH •European Vessels: NIVA/Norway

Arctic: IMR / Norway all data

Mediterranean Sea : HCMR/Greece •Mooring : HCMR/Greece •XBT/CTD: ENEA/Italy •Drifter & Argo: OGS/Italy •Glider and Argo: Coriolis/France

16 Partners/ 11 countries Ensure the link with :

•International networks •EuroGOOS ROOSes •SeaDataNet

Process data in a common but distributed manner for MyO & ROOSes needs

The core tasks for the Insitu TACs

Define common distribution means: vocabularies, formats, organization, monitoring tools,…

Build a reliable distributed architecture for in-situ data delivery to Marine Forecasting Centers (MFCs) and MyOcean users

Converge on common quality control procedures and flag conventions

• Enhance the T&S basin scale consistency methods for global ocean and adapt them to regional scales, if possible

• Develop methods for Quality Control of biogeochemical data both in real time and delayed mode and provide recommendations for acquisition of biogeochemical data from various platforms

Turn into operation enhanced calibration/validation methods

The Role of Mediterranean Insitu TAC

Number of parameters:

•Physical: T&S, current, sea level

•Biogeochemical: Chlorophyll/Fluorescence, Oxygen, Nutrients

•Atmospheric: Air Temperature, Wind, Air Pressure

•Sea State: Waves (Significant Height, Direction, Period)

•Any additional parameters that may be available (radiation, sound data, etc.)

Integrate in-situ data in product accessible through global and regional portals

•Common format

•Common NRT QC

•Common Quality flags

•Common distribution tools

•Single access point

Ensure a minimum level of quality on the data delivered

• In Near real time ( 24h to a week)

• In delayed mode

Assessment of the products at basin scale

Required by MyOcean

The Insitu TAC relies on close collaboration with:

EuroGOOS – Coordination of the observing networks in European scale

JCOMM - Coordination of the international observing networks

SeaDataNet which consolidates the NODC network and provides delayed mode products

Temperature & Salinity data

Mediterranean observing capacity: Fixed stations MONGOOS inventory, updated on October 2013 – http://www.mongoos.eu

Total number of stations

Meteo parameters

Waves data


Current recordings

Sea level


Data acquistion:

• Data are collected through direct links with the Production Units

• Data are converted in a unique format (Oceansites netcdf v1.1 compatible)

• Extended guidance for new partners in order to provide all the necessary information

Quality control:

• Apply automatic quality control procedures on each parameter, elaborated in coherence with international agreement (in particular SeaDataNet).

• Procedures applied after agreement with the data originators in order to avoid conflicts and effort duplications.

Validation/Assessment :

• Assess the consistency of the data over a period of time in an area. The aim is to detect possible incoherencies with nearby data that could not be detected by automatic QC.

Distribution:

• Disseminates the data through MyOcean/EMODET to the external users


Main functions

Data acquisition

Main steps:

• Direct connection is established (usually through ftp protocol) between the Med portal and the data provider

• Information is provided about the required metadata that should be supplied together with data (ex. station position, date, frequency of measurement, platform name, depth of each sensor, contact person, PI, etc.)

• Guidance is also provided on how the required daily and monthly files should be created.

• Information exchanged about the QC procedures

• Data are provided in the originator’s native format, no need for conversion to NetCDF. This procedure is performed by the IT staff of Med portal.


The Mediterranean Data Portal Sample of data global attributes – NIB Vida buoy

Data carry complete information about the originator and the assembly center(s)

Real Time QC Function :

Quality Control procedures are applied in:

• Temperature and Salinity

• Sea Level

• Current from drifters or Current from moorings

• Bio-geochemical (Still under development)

Implementation

• automated procedure that should avoid flagging good data

• applied through an agreement with the primary Production Unit

• In most cases minor corrections are applied to the flags that have already been assigned by the Production Unit


Meta data-implementation and/or verification: Position, Date, Method, Specification, PI, Processing, Comments

Automatic QC for Argo, gliders, CTDs and XBTs Visual QC QC Flag Scale

Test 1: Platform identification Test 2: Impossible Date Test Test 3: Impossible Location Test Test 4: Position on Land Test Test 5: Impossible Speed Test Test 6: Global Range Test Test 7: Regional Global Parameter Test 8: Pressure Increasing Test Test 9: Spike Test Test 10: Top and Bottom Spike Test Test 11: Gradient Test Test 12: Digit Rollover Test Test 13: Stuck Value Test Test 14: Density Inversion Test 15: Grey List (Argo, Glider) Test 16: Gross salinity or temperature sensor drift (Argo, Glider) Test 18: Frozen Profile Test

code Meaning 0 no QC was performed 1 good data 2 probably good data 3 bad data, but correctable 4 bad data 5 value changed 6 below detection limit 7 in excess of quoted value 8 interpolated value 9 missing value A Incomplete information mandatory for automated QC

Extended QC: Comparison to a climatology and the surrounding measurements: objective mapping or local interpolation method. Other comparisons.

•display Meta data •display the profiles •T/S diagrams •time/depth plots •scatter plots •maps displaying location •control of spikes and other irregularities •control of density profile if extended QC is included, visual QC can be reduced to be only applied on alerted profiles

Real-time quality control on temperature and salinity data

Test 1: Platform identification Test 2: Impossible Date Test Test 3: Impossible Location Test Test 4: Position on Land Test Test 5: Impossible Speed Test Test 6: Global Range Test Test 7: Regional Global Parameter Test 8: Spike Test Test 9: Climatology Test 11: Instrument range Test 12: Rate of change in time Test 13: Stationary Test

Automatic QC for time series


ftp Serv.

HCMR

Data

Base

Mooring

Data

Vessel

Data

Glider

Data

Cross-Validation of T, S

Float

Data

VALIDATION

RT FILES DM FILES

HCMR Data Base

In-Situ Product

Validation of Temperature and Salinity data

Validation procedure: Cross-validation of the physical variables (T, S) as derived from VOS, moorings, floats and gliders. The estimated differences will be analyzed as a function of the spatial and temporal distances between the measurements


The portal structure is in compliance with MyOcean standards


HCMR Moorings

(M3A, Poseidon network)

ENEA CTDs/XBTs

OGS Drifters – ARGO DM

IFREMER Gliders ARGO RT GTS

Additional Providers

(CNR, OC-UCY, ISPRA, NIB, OGS,…)

HCMR

MONGOOS Regional DU

Me

dite

rranean

In Situ

TAC

Daily files

T S

B i o c h e m I c a l

Real Time QC

ftp Serv.

GDAC

External Users (RIU, EIA) -Public, -Standard, -Specific -Privileged (Downstream)

MFC’s

The Med portal contains

data beyond the

MyOcean portfolio by

hosting all the available

data from the different

platforms (meteo &

wave data, additional

marine parameters)

PdE Mooring + tide gauges

EMODNET PP

The Mediterranean Data Portal – Production line

Monitoring performance

Daily recording of several indicators regarding data capacity, quality of information and timely update of the portal from the data originators


Data availability on 27th of November 2013 (1990-now)

126 profilers 42 active

27 Gliders 3 active

95 moorings 66 active

1298 drifters 6 active

134 XBTs 3 active

72 CTDs

82 Thermosalinographs

6 active

2168 unique platforms

30258 total files


Building historical data sets • Historical datasets have been created for the time period since 1990

(depends on each platform’s availability) • Data sets were produced merging the monthly files • Validation/Assessment procedures have been applied • The historical dataset building was not possible in some cases due to

metadata inconsistency

Platform type Number of different platform codes

Number of historical netCDF created

Drifter 1283 1283

Profiler-Glider 334 334

Vessel 298 298

Mooring 92 52

etc 35 35


1600 cruises (1990-2012) from SeaDataNet : 35332 T&S casts

Assessment of historical data set

Data aggregation from SeaDataNet


Data availability (active stations) on 27/11/13

EMED is clearly Under Sampling (at least in NRT)


View on the data - Gliders: Levantine Sea, April 2012

Start

End

Start

Start

End

End

Temperature and Salinity data collected through a glider mission in Levantine Sea during April 2012. The presence of the newly formed Levantine Intermediate Water (LIW) with salinity values higher than 39.1 psu is clearly identified between 100-300m.

Moreover, as the glider is moving northwards, enters in a area of anticyclonic movement, as it can be seen by the deepening of the temperature and salinity contour lines.

View on the data - Moorings: Long time series data, Pylos, Ionian Sea

Three years T&S data between 0-500m from the POSEIDON buoy in Pylos. The LIW signal, between 150-400m, is clearly stronger in 2010 with higher values both in salinity (>39 spu) and temperature.

View on the data - Drifters: Ligurian and Balearic Seas, April 2012

Start

End

The well known westwards surface flow along the Italian and French coasts towards the Gibraltar straits has been verified by the drifters trajectories released in the area during April 2012. Surface waters are 2-3oC warmer in the Ligurian Sea compared with those observed around the Gulf of Lions.

None of the drifters released in the Ligurian Sea entered the Gulf of Lions. It seems that the presence of an anticyclonic movement inside the gulf does not allow the entrance of the drifters and push them more westwards. The trajectory of the only drifter released inside the gulf verifies the existence of this anticyclone.

CNR - ISMAR Expecting 7 mooring stations Currently receiving data from 5 moorings NADR-SNG, Data from: 01/01/2013

Parameters: DRYT, WSPD, WDIR, TEMP, PRES Molo-Bandiera, Data from: 05/07/2013

Parameters: DRYT, WSPD, GSPD, WDIR, TEMP Molo-Sartorio, Data from: 05/07/2013

Parameters: SLEV ISMAR-Head-Office, Data from: 05/07/2013

Parameters: ATMS, PRRT PALOMA, Data from: 05/07/2013

Parameters: TEMP, DRYT

Data Aggregation through Jerico Project

OGS Expecting 9 mooring stations Currently receiving data from 2 moorings ADN-MAMBO1

Parameters: WSPD, WDIR, RELH, ATMS ADN-MAMBO4

Parameters: WSPD, WDIR, RELH, ATMS Currently only latest data available. Expecting

monthly files along with the other moorings

ISPRA Expecting 15 mooring stations Data from 12 moorings available in monthly directory. Daily

transmission from 9 moorings. ANCONA-61218 Starting date of data: 01/06/2013 CATANIA-61207 Starting date of data: 01/06/2013 CETRARO-61211 Starting date of data: 01/06/2013 CIVITAVECCHIA-61216 Starting date of data: 01/06/2013 CROTONE-61210 Starting date of data: 01/06/2013 LASPEZIA-61219 Starting date of data: 01/06/2013 MONOPOLI-61215 Starting date of data: 01/06/2013 PALERMO-61209 Starting date of data: 01/06/2013 PONZA-61214 Starting date of data: 01/06/2013 VANEZIA-61220 Starting date of data: 01/06/2013 CAGLIARI-61221 Starting date of data: 12/08/2013 MAZARA-61208 Starting date of data: 29/08/2013 Parameters:

RELH, TEMP, VDIR, VSMC, VTDH, VTPK, WDIR, WSPD

NIB-MBSS 1 mooring station VIDA

Parameters: EWCT, NSCT, WSPD, WDIR, DRYT, RELH, TEMP, PSAL

Data from: 17/06/2013

Expansion the data capacity – Engage more partners

Further expansion expected through PERSEUS project



A closer look in the Central Mediterranean

Green Stations: Already in the MED portal

Brown Stations: Agreement reached for their dissemination – Not yet available (remaining ISPRA stations)

Red Stations: Known to operate – Not in the Med portal

Stations positions according to MONGOOS inventory, updated on October 2013


Focus on the Adriatic Sea Acquired stations

Gulf of Trieste : OGS and CNR-ISMAR coastal facilities have been aggregated through JERICO project

ISPRA stations have been acquired through EMODNET

NIB MBS - Vida station (Slovenia) has been provided to support the expansion of the MED data portal


Focus on the Adriatic Sea Missing stations

CNR – ISMAR offshore stations : PTF Acqua Alta, Meda Gargano, BB, DD – Discussions on dissemination agreement

OGS : E2M3A Station – Agreement has been reached

Croatian stations (HHI, IZOR ) are missing

Data from Adriatic Stations – T & S


Data from Adriatic Stations - Sea level


Adriatic Sea (already presented) Corsica/Sicily

Data from offshore platforms operated by CNR-ISMAR is missing

Malta Coastal stations are missing (T&S, sea level)

Cyprus Missing coastal stations (T&S, sea level) Data from glider missions is included

Turkey Data from Mediterranean platforms is missing

Israel Coastal stations (T&S, sea level) are missing

Northern African coast No data is available – Limited knowledge about capacity

Known gaps in spatial coverage


Data capacity • Engage more partners to contribute their data in the portal – Filling the

known gaps. • EMODENT Adriatic meeting is the first coordinated action to gather and

disseminate the missing data to the marine community. • Building stronger connections with Northern African countries.

Development • Complete support for the data conversion from any kind of input to

OceanSites NetCDF format. • Data base support for the whole extend of the data • Enhance QC system • Plans for development a regional data visualization and downloading system

Future plans under EMODENT support


• The building of Mediterranean Data portal has been funded by

MyOcean I & II projects in order to become the regional node for the insitu component of the Marine Core Service (MCS).

• It’s the integrated forward step from the platform-oriented data centers that exist in the Med.

• It is established in compliance with EuroGOOS regional implementation policy, enhancing the expected MyOcean capacity by engaging new partners and hosting additional parameters.

• It supports all the major Operational Oceanography projects in the Mediterranean (Jerico, FixO3, Perseus) through the assembly and process of the relevant data. The participation of Med portal in these projects increases the data interoperability and prevents the unnecessary duplication of efforts.

Summarizing


• It is one of the main components of the EMODNET

• The majority of the data coming from insitu platforms in the Mediterranean is already available, but significant known gaps in spatial coverage exist, especially in the Eastern part of the basin

• Collecting the missing data will complete the real-time marine information of the Mediterranean enhancing also the forecasting products that are delivered through various centers along the basin

Summarizing


Supporting a Sustainable Ocean Observing System

Contact details

Leonidas Perivoliotis Institute of Oceanography Hellenic Center for Marine Research Telephone: +30 2291076400 Email: [email protected]


Thank you for your attention

The Mediterranean Data portal - EMODnet Physics€¦ · Coriolis/France •Link with international...

Documents

Transcript of The Mediterranean Data portal - EMODnet Physics€¦ · Coriolis/France •Link with international...