Crossing the Digital DividePresented by: Fernando R. Salas

David Maidment, Enrico Boldrini, Ben Domenico, Stefano NativiCUAHSI Conference on Hydrologic Data and Information Systems

Logan, UtahApril 22, 2011

CUAHSI

Introduction and Motivation

Source: Iowa State University Department of Natural Resource Ecology and Management

Searching for Climate Data

What is the Digital Divide?

Observations and Time Series

Geographic Information Systems (GIS)

Climate Observations and Grids

Remote Sensing

Interoperability ChallengesObservations Data

• Measures variables over a discrete space-time domain

• Stored in tables, relational databases and geodatabases

Gridded Data

• Measures variables over a continuous space-time domain

• Stored in large multi-dimensional arrays in specialized formats

How can we connect these very different worlds together?

Hydrologic Information Systems

Observations Data Information Model

Data Source United States Geological Survey (USGS)

Network National Water Information System – Unit Values

Sites Colorado River at Austin

Variables Streamflow

Values 2,500 cfs at 8:30 am onJune 19th, 2011

Gridded Data Information Model

Data Source National Climatic Data Center (NCDC)

Dataset North American Regional Reanalysis (NARR)

Grid Size 32 kilometer

Variables Temperature

Values78 deg. Fahrenheit at 8:00 am onJune 15th, 2000

Time 1

NARR

Data Cube

Space {x,y}

Time {t}

Variable {vi}

Space {x,y,z}

Time {t}

Variable {vi}

THREDDS Data Servers

WCS

WMS

NetCDF

OpenDAPHTTP

Distributed File Sharing Systems

Source: http://www.esrl.noaa.gov/thredds/catalog/Datasets/NARR/catalog.html

Enables users to access large quantities of gridded data using standardized data services

WFS

WFS

Building a Series Catalog for Observations Data

Datacart – a collection of data series organized thematically

Observations Metadata Catalog- Source- Site Name- Location (Lat/Long)- Variable Name- Variable Units- Concept- Start Date- End Date- WaterML URI

WFSWFS

WFSWFS

Building a Series Catalog for Gridded Data

Datacart – a collection of data series organized thematically

Observations Metadata Catalog- Source- Coverage Name- Location (Lat/Long Box)- Variable Name- Variable Units- Concept- Start Date- End Date- WCS URI

Building a Catalog of Services

WFS

WFS

CSWTime Series Raster Series

THREDDS ServersHydroServers

WaterML

NetCDF

Services Stack Framework

• Catalog Services for the Web (CSW) enable metadata services describing observations data to be registered in a catalog of services.

• Web Feature Services (WFS) enable data services to be completely described by metadata in a series catalog.

• Sensor Observation Services (SOS) and Web Coverage Services (WCS) enable observations and climate data to be conveyed through the internet in a standardized manner.

Catalog

Metadata

Data

Services

CSW

WFS

SOS

Catalog

Metadata

Data

Services

CSW

WFS

WCS

One Common Ontology

CUAHSIOntology

Precipitation Precipitation

StreamflowTurbidity Snow

Cloud Cover

PrecipRainfallRainTotal Precip

PrecipRainfall

RainTotal Precip

HydroPortal – A Catalog Service

…enables data discovery across multiple data sources and types…

Geoportal Extension of ArcGIS implements Catalog Services for the Web (CSW)

GI-cat Service Broker

• GI-cat broker catalog mediation/adaptation solution

• Standard based solution– Support to several international and community

standards, including THREDDS, WCS, WFS, CSW.– Support to several standard discovery interfaces,

including CSW 2.0.2 AP ISO, OpenSearch• Successful harvesting of more than 400,000

resourcesCourtesy of Enrico Boldrini from the Earth and Space Science Informatics Lab

A SOA Broker/Mediator component

Service Provider

Server

Service Registry Publish

Find

Bind

Protocol sharingBind

Service BrokerMediator

Order

Harvest

Service ConsumerClient

Courtesy of Enrico Boldrini from the Earth and Space Science Informatics Lab

Service Providers

Server

Discovery capability

Inventory capability

Access capability

CSW ISO

CSW ebRIM

CSW/ebRIM-EO GBIF

GBIF

THREDDS/OPeNDAP

THREDDS/OPeNDAP

WCS WMS

WCS WMS

CDI

Processing capability

OpenSearch

CSW-Core

GI-cat Broker/Mediation component

Service Consumer

ClientMediator

GI-catService Broker / Mediator

Functions:- Mediation- Distribution- Messaging- Persistence- Access- .....

CSW-ISO

CSW-EBRIM CIM/EO

INSPIREportal

ESA-HMA portal

Registry

Harvest

GEO portalWFS

WFS

OpenSearch

WPSOpenModeller

GeoNetwork CSW client

Web browser

ArcGIS ExplorerCSW client

Courtesy of Enrico Boldrini from the Earth and Space Science Informatics Lab

Catalog Services

Interoperability Enabled by Standard Web Services

CSWHydroServers

THREDDS Servers

HydroCatalog

Data Services

CSW

Integrated Search

Hydrometeorologic Information System

HydroCatalog

HydroDesktopHydroServerWCS

SOS

WFS

CSW

Questions?