tmsi m

arc

h 2

00

0

1

cori

olis

Quality control and dissemination of real time data - methodology andadvanced available technological tools

the Coriolis data centreexperience Gilbert Maudire, Loïc Petit de la Villéon, Catherine Maillard

SEAMER 2000

tmsi m

arc

h 2

00

0

2

cori

olis Pre-operational and Operational

Oceanographic Programmes

• Pre-operational data management TOGA-WOCE-CLIVAR Global Subsurface Data Centre

• CORIOLIS-ARGO real-time data processing

• Pommier, Pomme • GYROSCOPE (Atlantic)• MFSPP (Mediterranean)

tmsi m

arc

h 2

00

0

3

cori

olis New Questions Asked

• Access to observational data of temperature within 12 hours after their production

• Access to other types of data within 48 hours within their production

• Access to statistics, gridded data, combinations with delayed mode data, graphs, maps and products

• Assess a standardised level of quality to the data

tmsi m

arc

h 2

00

0

4

cori

olis Sensors currently

producing time data

• Lagrangian profilers : PROVOR, APEX..

• XBt, Xctd• Thermosalinographs

tmsi m

arc

h 2

00

0

5

cori

olis CORIOLIS Data Centre

• to process European floats– provor– other floats

• to combine various in-situ measurements• to insure interoperability with argo data centres

– data formats– common quality procedures– real time data exchanges

• to gather global data sets for European users

Partners : IFREMER, SHOM, IRD (ORSTOM), METEO-FRANCE, CLS-ARGOS

tmsi m

arc

h 2

00

0

6

cori

olis data centre functions

Interoperability with argo

data base (RDBS)catalogue - archive

gts(meteo-france)

mailmailing lists

WWW(full data set)

controldata quality control

technical monitoring of equipments

data collectmailinternetgtscd-rompaper...

disseminationpublic / private

productsgraphics and charts

statisticsanalyses

cd-romor other support

on request

quality insurance for exploitation hardware & software management - backup

models(Mercator, Soprane)

tmsi m

arc

h 2

00

0

7

cori

olis a provor cycle

descending profile10 hours

immersion drift profile5 to 15 days

ascending profile5 hours

surface drift profile10 hours of argos transmission

tmsi m

arc

h 2

00

0

8

cori

olis

argos internet ifremer

provor incoming data

data processingstore the messagecheck the address sendergenerate the cyclesactivate decoding

cls-argosads service

mail

internet mail major issues•data processing naturally performed « on the fly »•data integrity (no loss or errors on data)•smtp protocol includes re-transmission in case of trouble•strategic service for ifremer•standard service from telecom operators

tmsi m

arc

h 2

00

0

9

cori

olis quality control

• complies with international recommendations– IOC, ICES, MAST

• two levels– automatic control– visual control for dubious profiles

• gtspp quality flag scale

tmsi m

arc

h 2

00

0

10

cori

olis quality controlqc1

qc2

tmsi m

arc

h 2

00

0

11

cori

olis provor

decoded cycle ascii file

*Provor profiler : <Identificateur flotteur PROVOR>*Float cycle : <n° de cycle>

*Descending vertical profile*Date : yyyy-mm-dd hh24:mi (QC=9), Estimated position : <Latitude>,<Longitude> (QC=9)Date Time Pressure Temperature Conductivity Salinity(yyyy-mm-dd) (hh24:mi) (dBar) (°C) (mS/cm) (P.S.U.)1999/10/07 23:58 2 27.52 44.901999/10/08 00:04 56 18.21 44.81

*Ascending vertical profile*Date : yyyy-mm-dd hh24:mi (QC=9), Estimated position : <Latitude>,<Longitude> (QC=9)Date Time Pressure Temperature Conductivity Salinity(yyyy-mm-dd) (hh24:mi) (dBar) (°C) (mS/cm) (P.S.U.)1999/10/15 10:30 3980 2.52 44.90...1999/10/15 10:40 2378 5.21 44.81

*Immersion drift*Date : <Heure de fin de descente>Date Time Pressure Temperature Conductivity Salinity(yyyy-mm-dd) (hh24:mi) (dBar) (°C) (mS/cm) (P.S.U)1999/10/08 04:55 1200 2.22...

*Surface driftDate Time Latitude Longitude Positionquality Surface temperature(yyyy-mm-dd) (hh24:mi) (HDD MI.mmm) (HDD MI.mmm) (Argos scale) (°C)

*Technical status*Probes : Internal time : hh24 :mi Pressure offset : 99.99 dBars Internal pressure : 99.99 dBars CTD drift measurements : 999*Engineering : Valve motions : Surface : 99, Descending : 99 Pump motions : Surface : xx, Descending : xx, Immersion : xx First stabilization : dd/mm*Data reduction : Descending profile : PRSEP : 9999 dBars, NTS : 9999, ETS : 9.99°C, NCS : 9999, ECS : 9.99 mS/cm NTF : 9999, ETF : 9.99°C, NCF : 9999, ECF : 9.99 mS/cm Ascending profile : PRSEP : 9999 dBars, NTS : 9999, ETS : 9.99°C, NCS : 9999, ECS : 9.99 mS/cm NTF : 9999, ETF : 9.99°C, NCF : 9999, ECF : 9.99 mS/cm*Transmission : Received frames : 9999, complete : 9999, CRC OK : 9999, recombined frames : 9999*Positionning : Class 1 : 9999, Class 2 : 9999, Class 3 : 9999, Rejected locations: 9999

tmsi m

arc

h 2

00

0

12

cori

olis formats

• dissemination– ascii : medatlas/coriolis– binary : netcdf– gts/tesac– others on request (gtspp, tsdc)

• data collect– provor, sippican mk12– gts (bathy, tesac)– gtspp– medatlas/coriolis

tmsi m

arc

h 2

00

0

13

cori

olis provor on the web www.ifremer.fr/coriolis

tmsi m

arc

h 2

00

0

14

cori

olis provor in pommier area

tmsi m

arc

h 2

00

0

15

cori

olis interactive map on the web

tmsi m

arc

h 2

00

0

16

cori

olis provor temperature map

tmsi m

arc

h 2

00

0

17

cori

olis atalante xbt and ts data processing

coriolisdata base

oracle8derived from toga/woce

mailinmarsat

quality control gtsdissemination

webinterface

atalante

disseminationto models

uploading

tmsi m

arc

h 2

00

0

18

cori

olis tables of coriolis data-base

immersion_driftid_plateform_codeid_cycle_numberid_start_station_codeid_end_station_codeid_date_timeid_date_qcid_latitudeid_longitudeid_location_qcid_immersionid_immersion_qcid_temperatureid_temperature_qcid_conductivityid_conductivity_qcid_salinityid_salinity_qc

provor-config pr_plateform_codepr_typepr_versionpr_crc_typepr_cycle_periodpr_immersion_drift_periodpr_launch_datetimepr_launch_latitudepr_launch_longitudepr_reference_datetimepr_reference_internal_datepr_probe_codepr_experiment_id

stationst_station_idst_station_typest_station_datest_date_qcst_station_latitudest_station_longitudest_position_qcst_oceanst_marsdenst_experiment_idst_station_numberst_plateform_codest_plateform_motionst_plateform_nodc_flagst_institution_codest_institution_gtspp_flagst_archiving_datest_probe_codest_recorder_codest_archiving_statusst_dupliate_flagst_duplicate_station_idst_naturest_qc_status

psal-vprof pvp_station_idpvp_immersionpvp_valuepvp_value_qc

temp-vproftvp_station_idtvp_immersiontvp_valuetvp_value_qc

plateformpl_plateform_codepl_plateform_namepl_plateform_nodc_codepl_plateform_typepl_institution_code

provor_programming pg_plateform_codepg_prog_parameterpg_prog_value

surface_drift sd_plateform_codesd_cycle_numbersd_start_station_codesd_end_station_codesd_datetimesd_date_qcsd_latitudesd_longitudesd_location_classsd_location_qcsd_temperaturesd_temperature_qcsd_conductivitysd_conductivity_qcsd_salinitysd_salinity_qc

cndc-vprofcvp_station_idcvp_immersioncvp_valuecvp_value_qc

psal-vprof-header pvh_station_idpvh_profile_qcpvh_level_numberpvh_max_levelpvh_digitizationpvh_validation

temp-vprof-headertvh_station_idtvh_profile_qctvh_level_numbertvh_max_leveltvh_digitizationtvh_validation

cndc-vprof-headercvh_station_idcvh_profile_qccvh_level_numbercvh_max_levelcvh_digitizationcvh_validation

provor_tech_status pg_plateform_codepg_cycle_numberpg_prog_parameterpg_prog_value

probepb_probe_codepb_probe_descriptionpb_speed_coef_apb_speed_coef_b

recorderre_recorder_codere_recorder_description

beaconsbc_beacon_codebc_plateform_code

provor_tech_parametertp_tech_parametertp_descriptiontp_programingtp_status

2

2

tmsi m

arc

h 2

00

0

19

cori

olis provor cycling

launching reference date reference date + 1 period

cycle 0does not match

the period

cycle 1 cycle 2

cycle period cycle period

argosargosargos