1 Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement a.k.a....

15
1 Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC- Sensor Web Enablement a.k.a. QARTOD to OGC a.k.a. Q2O Project Status Brief to NOAA IOOS Program January 29, 2009

Transcript of 1 Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement a.k.a....

Page 1: 1 Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement a.k.a. QARTOD to OGC a.k.a. Q2O Project Status Brief to NOAA IOOS.

1

Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement

a.k.a. QARTOD to OGCa.k.a. Q2O

Project Status Brief to NOAA IOOS Program

January 29, 2009

Page 2: 1 Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement a.k.a. QARTOD to OGC a.k.a. Q2O Project Status Brief to NOAA IOOS.

2

Once upon a time ….

Page 3: 1 Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement a.k.a. QARTOD to OGC a.k.a. Q2O Project Status Brief to NOAA IOOS.

3

Page 4: 1 Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement a.k.a. QARTOD to OGC a.k.a. Q2O Project Status Brief to NOAA IOOS.

4

Community activities were addressing individual parts…

Page 5: 1 Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement a.k.a. QARTOD to OGC a.k.a. Q2O Project Status Brief to NOAA IOOS.

5

Bringing together community membersas Q2O Team

Janet Fredericks - WHOI, MMI, MVCO, QARTOD Mike Botts/Tony Cook - UAH, OGC SWEJulie Bosch - NOAA, MMI, IOOS DMAC, QARTODHarvey Seim/Sara Haines - SECOORA, NCCOOSPhilip Bogden/Eric Bridger - GoMOOS, IOOS DMAC, SURA, MMI,

OOSTethys

Luis Bermudez - SURA, OOSTethys, OpenIOOS, MMI, OIE

Page 6: 1 Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement a.k.a. QARTOD to OGC a.k.a. Q2O Project Status Brief to NOAA IOOS.

6

What is Q2O?What is Q2O?

Funded by NOAA CSC/IOOS (January 2008 – December 2010)

Deliverables:• Implement the QARTOD recommendations into the OGC Sensor Web

Enablement framework providing SensorML profiles for QARTOD tests and

• Documenting results by providing a tutorial and• Test the deliverables by implementing services at participating data

centers

Methodology: • Bring together IT specialists with domain experts (for waves, in situ

currents, CTD observations and Dissolved Oxygen)• Partner with community building projects such as OOSTethys and MMI

Page 7: 1 Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement a.k.a. QARTOD to OGC a.k.a. Q2O Project Status Brief to NOAA IOOS.

7

What does that mean?

What do we have (know) to start with?

• A sensor (wave buoy or ADCP) with certain characteristics

• A sensor history• QA info associated with a

sensor• Deployment characteristics• Methods to process the data• QC Tests to apply to the

data• …• …

What information can we provide to data users via systems (OOSTethys, OpenIOOS)?

• What sensors we have available as a service

• Description of the sensor• Description of where / how /

when it is deployed• List of the processing methods

used on the data• List of the QC tests applied• The criteria used in the QC

tests• The results of the QC tests• The data• …

How do we convey that information in SOS?

Get Capabilities• Lists available data offerings

• Returns SensorML

Describe Sensor-Provides sensor and deployment characteristics and processing methods

-Returns SensorML

Get Observation-Provides the data, test results and points to file with processing/test info

-Returns O&M

Page 8: 1 Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement a.k.a. QARTOD to OGC a.k.a. Q2O Project Status Brief to NOAA IOOS.

8

What had/has to be done by Q2O?

QARTOD - WAVES - QC RECOMMENDED TESTS

• Engage QARTOD experts• Gather QARTOD information

– identify recommendations• Define Processes

– input / output / criteria

• Develop vocabularies• Convey as SWE instances • Test implementation• Develop Guidance • Applied by OOS

implementers

Page 9: 1 Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement a.k.a. QARTOD to OGC a.k.a. Q2O Project Status Brief to NOAA IOOS.

12

Some activities to date …

Kick-

off M

eetin

g - Feb

08

Q2O

, QARTO

D Lea

ds, O

GC

SWE a

nd OIE

Wav

es a

nd Curr

ents

Exp

erts

Mee

ting -

Jun 0

8Pote

ntial W

aves

Imple

men

ters

and V

ocabula

ry E

xper

ts

Mee

ting -

Aug 0

8O

OSSI W

orksh

op - W

aves

and

Curren

ts V

ocabula

ry a

nd

SWE R

evie

w -

Nov

08W

aves

and C

urren

ts

Hands-

on SW

E

Imple

men

tatio

n - F

eb 0

9

Initi

al D

raft

Q2O

Wav

es

Vocabula

ry

Initi

al S

enso

rML

Demonst

ratio

n

SWE C

oncept D

emonst

ratio

ns /

Use C

ase

Scenar

ios

Engaged

wav

es im

plem

ente

rs

(CO

MPS, V

IMS, C

DIP, N

DBC) in

voca

bulary

and S

WE d

evel

opmen

t

Draft

Q2O

voca

bulary

regis

tere

d

and L

esso

ns le

arned

pro

vided

to im

plem

ente

rs; R

efin

ing S

WE

Content a

nd test

pro

cess

esPra

ctic

al G

uidan

ce to

imple

men

ters

Initi

al S

enso

rML In

stan

ce

& SOS im

plem

enta

tion

MVCO L

ive

Senso

rML

& S

OS offe

rings

Page 10: 1 Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement a.k.a. QARTOD to OGC a.k.a. Q2O Project Status Brief to NOAA IOOS.

13

Take QARTOD tests and flags and code them into OGC/SWE instances.

Each test is defined as a process that is described with input and output

E.g.,RangeTest has inputs (data) and parameters (min,

max) and outputs (data, QC flag)

The details…

Page 11: 1 Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement a.k.a. QARTOD to OGC a.k.a. Q2O Project Status Brief to NOAA IOOS.

14

The details… defining processes

Page 12: 1 Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement a.k.a. QARTOD to OGC a.k.a. Q2O Project Status Brief to NOAA IOOS.

15

The details… developing vocabularies

Page 13: 1 Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement a.k.a. QARTOD to OGC a.k.a. Q2O Project Status Brief to NOAA IOOS.

16

The details… on the Q2O Project website

http://q2o.whoi.edu- materials available to public- account access (working materials)

Page 14: 1 Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement a.k.a. QARTOD to OGC a.k.a. Q2O Project Status Brief to NOAA IOOS.

17

Status…• Draft general QA/QC vocabulary (including waves tests)

registered at MMI• Draft MVCO waves implementation nearing completion• Lessons learned

– vocabulary development – generation and registration of vocabulary/ontology– SWE process chains, parameters, components,…

• Beginning of Guidance document and example files• Waves implementers signed on (COMPS and VIMS)• Gaps identified for QARTOD community to address

Page 15: 1 Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement a.k.a. QARTOD to OGC a.k.a. Q2O Project Status Brief to NOAA IOOS.

18

What's next?Q2O – develop generic waves profile from Q2O instances; get

cookbooks online; complete tutorial; continue with QARTOD currents, CTD and DO. Demonstrate computation of waves parameters from triplet processing

QARTOD – demonstrate Q2O project to QARTOD community and bring back better defined tests and algorithms (discussion of gaps for implementation)

IOOS DIF Coordination Ingest SWE observations with QA/QC descriptions and flags; evaluate and apply additional tests; document in SWE offerings?

OOSTethys into OpenIOOS - utilize QA/QC flags

SUGGESTIONS?? (and Thank you!!)