End-to-end Data Management for Operational Observation Systems

Presented to the Workshop on the

Ecological Impact of Hypoxia on Living Resources

Sharon MesickEcosystem Program Manager

NOAA Coastal Data Development CenterMarch 2007

Overview

• End-to-end data management projects

– SEAMAP / Gulf of Mexico Hypoxia Watch

– WCO – NODC Conduit

• Adopting best practices for an Operational

Observation System

Five Data Management Functions

• Discover– Look, find and get data, data products and information

• Access– To data and information

• Archival– Storage and maintenance

• Products– Quality Assurance, development and maintenance

• Outreach– Facilitate stakeholder awareness

SEAMAP / Gulf of Mexico Hypoxia Watch

• Partnership project

– NMFS, CoastWatch, NCDDC

• Manual data development process

– Interoperable standards addressed

• Metadata, geospatial

– Discovery, access, archive requirements

met

• Multiple public access points

Hypoxia Watch Data Management Flow

ProductsGIS & JPEG

NODCArchival

NCDDCMetadataCatalog

NCDDCClearinghouse

NodeMERMAid

NCDDC Data Development-------------------------

• Receive / QC data• Geospatially enable• Generate contours• Generate metadata• GIS Integration• Product generation

Multiple Public Access Points

• Direct Data Access

– Ocean Archive System

• Data Access

Applications

– Internet GIS

• Metadata Search

– NCDDC Portal

– FGDC Clearinghouse

– Geospatial One Stop

• General Access

– Hypoxia Web site

Gulf of Mexico Hypoxia Watch Program

http://www.ncddc.noaa.gov/ecosystems/hypoxia

West Coast Observing System

• Partnership project– NMSP, CeNCOOS, PISCO, NODC, NCDDC, others

• Operational, end-to-end system– Automated, extensible system

– Interoperable standards addressed• OPeNDAP, metadata, geospatial

– Discovery, access, archive requirements met• Multiple public access points

End-to-End Data Management

Multiple Public Access Points

• Direct Data Access

– NODC OPeNDAP Server

– OPeNDAP.org

– Ocean Archive System

• Data Access

Applications

– Internet GIS

– WCOS Portal

• Metadata Search

– NCDDC Portal

– FGDC Clearinghouse

– Geospatial One Stop

• General Access

– SIMoN (Sanctuary

Integrated Monitoring

Network)

– CeNCOOS OceanObs

Access Catalog Holdings

Publish

HypoxiaCatalogWebsite

NCDDCFTP

Server

NODCRetrievalProcessHypoxia

Catalog

NCDDC WCO-NODC Conduit

-------------------------

HypoxiaWatch

LUMCON

NGoM/CI

Other

NODCOPeNDAP

Server

NODCArchival

NCDDCMetadataCatalog

NCDDCClearinghouse

NodeMERMAid

•Determine new data•Retrieve new data and metadata•Convert data•Call XML-RPC server to generate and publish metadata•Package results and send to FTP site

XML-RPC Server----------------

•Convert metadata to FGDC XML•Publish to various systems

Send Retrieve

Publish

Publish Publish Ingest

Send Metadata forConversion and Publishing

Retrieve newData and Metadata

End-to-End Hypoxia Data Management

Summary

• WCOS – demonstrates an operational, automated system– Readily extensible

• Coral Reef Early Warning System• Flower Garden Banks, other NMS

• Proposed hypoxia data management system ensures a strong integrated approach– Consistent data standards and procedures– Engages regional partners in data assembly– Supports discovery, access, delivery, and archive– Real-time, NRT and collections

References:http://www.ngi.msstate.edu/hypoxia

Contacts:

Russ Beard, NCDDCActing Director

russ.beard@noaa.gov

Sharon Mesick, NCDDCEcosystem Program Manager

sharon.mesick@noaa.gov