1

Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement

a.k.a. QARTOD to OGCa.k.a. Q2O

Project Status Brief to NOAA IOOS Program

January 29, 2009

2

Once upon a time ….

3

4

Community activities were addressing individual parts…

5

Bringing together community membersas Q2O Team

Janet Fredericks - WHOI, MMI, MVCO, QARTOD Mike Botts/Tony Cook - UAH, OGC SWEJulie Bosch - NOAA, MMI, IOOS DMAC, QARTODHarvey Seim/Sara Haines - SECOORA, NCCOOSPhilip Bogden/Eric Bridger - GoMOOS, IOOS DMAC, SURA, MMI,

OOSTethys

Luis Bermudez - SURA, OOSTethys, OpenIOOS, MMI, OIE

6

What is Q2O?What is Q2O?

Funded by NOAA CSC/IOOS (January 2008 – December 2010)

Deliverables:• Implement the QARTOD recommendations into the OGC Sensor Web

Enablement framework providing SensorML profiles for QARTOD tests and

• Documenting results by providing a tutorial and• Test the deliverables by implementing services at participating data

centers

Methodology: • Bring together IT specialists with domain experts (for waves, in situ

currents, CTD observations and Dissolved Oxygen)• Partner with community building projects such as OOSTethys and MMI

7

What does that mean?

What do we have (know) to start with?

• A sensor (wave buoy or ADCP) with certain characteristics

• A sensor history• QA info associated with a

sensor• Deployment characteristics• Methods to process the data• QC Tests to apply to the

data• …• …

What information can we provide to data users via systems (OOSTethys, OpenIOOS)?

• What sensors we have available as a service

• Description of the sensor• Description of where / how /

when it is deployed• List of the processing methods

used on the data• List of the QC tests applied• The criteria used in the QC

tests• The results of the QC tests• The data• …

How do we convey that information in SOS?

Get Capabilities• Lists available data offerings

• Returns SensorML

Describe Sensor-Provides sensor and deployment characteristics and processing methods

-Returns SensorML

Get Observation-Provides the data, test results and points to file with processing/test info

-Returns O&M

8

What had/has to be done by Q2O?

QARTOD - WAVES - QC RECOMMENDED TESTS

• Engage QARTOD experts• Gather QARTOD information

– identify recommendations• Define Processes

– input / output / criteria

• Develop vocabularies• Convey as SWE instances • Test implementation• Develop Guidance • Applied by OOS

implementers

12

Some activities to date …

Kick-

off M

eetin

g - Feb

08

Q2O

, QARTO

D Lea

ds, O

GC

SWE a

nd OIE

Wav

es a

nd Curr

ents

Exp

erts

Mee

ting -

Jun 0

8Pote

ntial W

aves

Imple

men

ters

and V

ocabula

ry E

xper

ts

Mee

ting -

Aug 0

8O

OSSI W

orksh

op - W

aves

and

Curren

ts V

ocabula

ry a

nd

SWE R

evie

w -

Nov

08W

aves

and C

urren

ts

Hands-

on SW

E

Imple

men

tatio

n - F

eb 0

9

Initi

al D

raft

Q2O

Wav

es

Vocabula

ry

Initi

al S

enso

rML

Demonst

ratio

n

SWE C

oncept D

emonst

ratio

ns /

Use C

ase

Scenar

ios

Engaged

wav

es im

plem

ente

rs

(CO

MPS, V

IMS, C

DIP, N

DBC) in

voca

bulary

and S

WE d

evel

opmen

t

Draft

Q2O

voca

bulary

regis

tere

d

and L

esso

ns le

arned

pro

vided

to im

plem

ente

rs; R

efin

ing S

WE

Content a

nd test

pro

cess

esPra

ctic

al G

uidan

ce to

imple

men

ters

Initi

al S

enso

rML In

stan

ce

& SOS im

plem

enta

tion

MVCO L

ive

Senso

rML

& S

OS offe

rings

13

Take QARTOD tests and flags and code them into OGC/SWE instances.

Each test is defined as a process that is described with input and output

E.g.,RangeTest has inputs (data) and parameters (min,

max) and outputs (data, QC flag)

The details…

14

The details… defining processes

15

The details… developing vocabularies

16

The details… on the Q2O Project website

http://q2o.whoi.edu- materials available to public- account access (working materials)

17

Status…• Draft general QA/QC vocabulary (including waves tests)

registered at MMI• Draft MVCO waves implementation nearing completion• Lessons learned

– vocabulary development – generation and registration of vocabulary/ontology– SWE process chains, parameters, components,…

• Beginning of Guidance document and example files• Waves implementers signed on (COMPS and VIMS)• Gaps identified for QARTOD community to address

18

What's next?Q2O – develop generic waves profile from Q2O instances; get

cookbooks online; complete tutorial; continue with QARTOD currents, CTD and DO. Demonstrate computation of waves parameters from triplet processing

QARTOD – demonstrate Q2O project to QARTOD community and bring back better defined tests and algorithms (discussion of gaps for implementation)

IOOS DIF Coordination Ingest SWE observations with QA/QC descriptions and flags; evaluate and apply additional tests; document in SWE offerings?

OOSTethys into OpenIOOS - utilize QA/QC flags

SUGGESTIONS?? (and Thank you!!)