SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for...
-
date post
22-Dec-2015 -
Category
Documents
-
view
218 -
download
0
Transcript of SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for...
![Page 1: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/1.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the
Hydrologic Sciences
David ValentineIlya Zaslavsky
David R. Maidment
![Page 2: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/2.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Overview
• Introduction• Technology• Present• Screenshots• Near Term• Future
![Page 3: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/3.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Hydrologic Science
Hydrologic conditions(Fluxes, flows, concentrations)
Hydrologic Process Science(Equations, simulation models, prediction)
Hydrologic Information Science(Observations, data models, visualization
Hydrologic environment(Dynamic earth)
Physical laws and principles(Mass, momentum, energy, chemistry)
It is as important to represent hydrologic environments precisely with
data as it is to represent hydrologic processes with equations
![Page 4: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/4.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Consortium of Universities for the Advancement of Hydrologic Science, Inc
(CUAHSI)
• Supported by the National Science Foundation
• Develops cyberinfrastructure and services for hydrologic science in US universities
• Legally independent organization based in Washington DC
• SDSC is the cyberinfrastructure partner
CUAHSI HydroView Components
HydrologicSynthesis
HydrologicObservatories
HydrologicInformation
Systems
MeasurementTechnology
![Page 5: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/5.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Operating Systems and Software Use
![Page 6: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/6.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Water OneFlow Web Services
• Like Geospatial OneStop, we need a “Water OneStop” – a common window for water data and models
• Advancement of water science is critically dependent on integration of water information
![Page 7: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/7.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Technology
• Commercial of the shelf (COTS) software• Leverage ongoing cyberinfrastructure projects
• Geosciences Network (GEON)• Share data between Earth Science disciplines• Grid computing capabilities
• Web Services
![Page 8: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/8.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Operating Systems
• ESRI ArcGIS • Microsoft SQL Server
• Custom Models• ArcHydro • Hydrologic Observations
Database
• ASP.NET• Web services• Web interfaces
• Provides • a platform that scientists are
familiar with, and have developed, and a presently using to develop, software.
• GEON Stack• Java Portlets (Gridsphere)• Grid Authentication (GAMA)• Distributed Storage (SRB)• Grid Processing Capabilities• Workflow Capabilities
• Provides • data registration• searching• an archive• Shared architecture for
Geosciences
![Page 9: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/9.jpg)
Multi-platform Design Central CUAHSI HIS Node (Windows) GEON Data Node (Linux)
Data
Apache TomcatIIS Web Server
ASP . Net
Geon Software Stack
SQL Server
Proxy
ArcGIS
Technologies
HDASHODM
Web
ServiceWeb
Services
Web Serviceproxies
Data
Remote CUAHSI HIS Node (Windows)
Data
IIS Web ServerASP . Net
SQL ServerArcGIS
Technologies
HDASHODM
Web
ServiceWeb
Services
Web Serviceproxies
Remote CUAHSI HIS Node (Windows)
Data
IIS Web ServerASP . Net
SQL ServerArcGIS
Technologies
HDASHODM
Web
ServiceWeb
Services
Web Serviceproxies
Remote CUAHSI HIS Node (Windows)
Data
IIS Web ServerASP . Net
SQL ServerArcGIS
Technologies
HDASHODM
Web
ServiceWeb
Services
Web Serviceproxies
Remote CUAHSI HIS Node (Windows)
Data
IIS Web ServerASP . Net
SQL ServerArcGIS
Technologies
HDASHODM
Web
ServiceWeb
Services
Web Serviceproxies
Remote CUAHSI
HIS Nodes (Windows)
![Page 10: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/10.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Present (1/2)
• Water OneFlow Web Services• NWIS, AmeriFlux, DAYMET, MODIS
• Databases• Hydrologic Observations Data Model
• HDAS - Hydrologic Data Access System• A map-based access system to hydrologic data
• We provide production access to data sources via webservices, and access via a map-based interface
![Page 11: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/11.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Present (2/2)
• Problems• Occasionally, Geon Services do not work in proxy• CUAHSI ArcGIS server interfaces (eg HDAS) have
problems being wrapped in a portlet, and were not designed to be wrapped.
• Producing a node distribution with COTS
![Page 12: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/12.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
![Page 13: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/13.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
![Page 14: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/14.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
![Page 15: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/15.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
![Page 16: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/16.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
![Page 17: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/17.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
![Page 18: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/18.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Demo-Data Registration
![Page 19: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/19.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Near Future
• Water OneFlow web services • Standardize methods• Refactor present services• Provide codebase for community development• Dataset specific methods
• ESRI ArcHydro server extension• Point of presence distribution• Documentation
![Page 20: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/20.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Future
• Make it easier• URL-Based access methods
• Data
• Non-Map access methods• Ontology search• Site browse• Attribute browse (by HUC, State, County)• Others (tell us)
• Tools
• Documentation
http://ws.cuahsi.org/station/ameriflux/stationID/Variable/xmlhttp://ws.cuahsi.org/station/ameriflux/stationID/Variable/excel
![Page 21: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/21.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Summary
• CUAHSI HIS is a community driven effort.• COTS or open source• CUAHSI cyberinfrastructure will be a multi-
platform infrastructure that leverages the GEON Infrastructure, and commercial software.
• Web services will allow for flexible development• Community-developed implementations can replace
commercial implementations. • MapWindows group is developing an OpenHydro data model to
provide an open source implementation of the ArcHydro datamodel.
best tool for the job.
![Page 22: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/22.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Questions
• Sites• http://www.cuahsi.org/his/
• Listing of web services
• http://river.sdsc.edu/HDAS/• Map interface to National Water Information System
• HIS Contacts• [email protected]• [email protected]
![Page 23: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/23.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
![Page 24: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/24.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
![Page 25: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/25.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
WaterOneFlow Web Services
Data access through web
services
Data storage through web
services
Dow
nlo
ads
Upl
oa
ds
Observatory servers
SDSC HIS servers
3rd party servers
e.g. USGS, NCDC
GIS
Matlab
IDL
Splus, R
D2K, I2K
Programming (Fortran, C, VB)
Web services interface
Web portal Interface (HDAS)
Information input, display, query and output services
Preliminary data exploration and discovery. See what is available and perform exploratory analyses
HTML -XML WS
DL
- SO
AP
Hydrologic Information System Service Oriented Architecture
![Page 26: SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649d775503460f94a58bb7/html5/thumbnails/26.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
WaterOneFlow Web Services
Data access through web
services
Data storage through web
services
Dow
nlo
ads
Upl
oa
ds
Observatory servers
SDSC HIS servers
3rd party servers
e.g. USGS, NCDC
GIS
Matlab
IDL
Splus, R
D2K, I2K
Programming (Fortran, C, VB)
Web services interface
Web portal Interface (HDAS)
Information input, display, query and output services
Preliminary data exploration and discovery. See what is available and perform exploratory analyses
HTML -XML WS
DL
- SO
AP
Hydrologic Information System Service Oriented Architecture