The Ocean GIS Initiative: Esri's Commitment to Understanding Our Oceans
ESRI's Support for Standards in ArcGIS: Building GIS ......ESRI's Support for Standards in ArcGIS:...
Transcript of ESRI's Support for Standards in ArcGIS: Building GIS ......ESRI's Support for Standards in ArcGIS:...
ESRI's Support for Standards in ArcGIS: Building GIS Standards and their Role in Interoperability
David [email protected]
Jeanne [email protected] Sankaran
What we are going to talk about
Interoperability and standardsGeowebESRI activities
Interoperability – exchanging and using knowledge
3
Technical interoperability
Semantic interoperability
?
the ability of two or more systems or components to exchange information and to use the information that has been exchanged *
* IEEE
4
Four types of interoperability
• Technical– Machine to machine connections– Software module interaction– APIs– Formats…
• Semantic*– Understanding concepts, terms– Special disciplinary vocabularies…
• Human– Cooperation– Education…
• Legal /Policy– Intellectual property rights, ownership– Exchange agreements, …
=
5
ESRI - Understanding the importance of Interoperability• Technical
– Multiple platforms– Focus on broad-based IT standards– Published APIs & formats – Support multiple formats & projections– Unrivaled support for relevant geospatial standards
• Semantic– Encourage, coordinate, publish community data models– Facilitate metadata standardization and management– Interoperability Extension
• Human– Training– Publications– Promoting geographic awareness
• Legal /Policy– Geography network and data programs– Support security and geo-rights
management community
UNIX®XML
SOAP
WSDL
UDDI
Things that make interoperability succeed
• Laws– Copyright– Business
Agreements– Authorization
• Infrastructure– Networks– Interfaces– Hardware
• Knowledge– Metadata– Quality– Exposure– Training
STANDARDS
A standard is an agreementbetween a provider and a consumera reference document enabling interoperability
CONSENSUS TECHNICALSOLUTION
mechanism
Standardsa floor to innovation
DEMOCRATICMECHANISM
TECHNOLOGYTRANSFER
Standards make things workIncrease efficiency
global standards = global efficiency
UC2008 Technical Workshop 11
Standards for Geographic Interoperability
Thun Riyadh
Santa Monica mountainsFirenze
UC2008 Technical Workshop 12Arima valleyValparaiso
Managua Badaling
Standards for Geographic Interoperability
13… an Information System for Geography
GIS Abstracts Geography into a Modern InformationTechnology Framework
Metadata
ModelsMapsMaps
GeodataSets
DataModels
Geodatabase
EncapsulatingReal World Knowledge
Data Management
1. GeoVisualization2. Decision Support3. Serve to others
ps
GIS
1…Abstracting Geographic Knowledge
. . . Together They Represent the Building Blocks of Geographic Knowledge
Geodata Sets
Process and Workflow Models
Maps and Globes
Metadata
Data Models
GIS abstracts geography into five basic elements
Process and Workflow Models
Metadata
Geodata Sets
Data Models
GIS Standardization functional areas
Maps and Globes
Basic Geographic StructuresGeometry, topology, coordinate
reference systems
Content DescriptionStandardized Data Models, Feature
Catalog Modeling languages, Application
schemasMetadata
Data ManagementDatabase management
Data Formats Structure, Syntax, language, API
VisualizationSymbology, cartography, display
GeoWeb ServicesWeb Catalog, Web Services, SOA
Building blocks ofgeographic knowledge
… building the foundation of the geospatial infrastructure, brick by brick ...
ESRI participates through ANSI/INCITS L1
www.ISOTC211.ORG
Basic Geographic StructureISO 19107 Spatial Schema (Geometry)
Content DescriptionSchemas for defining the Rules, Relationships, Definitions, and Behavior ISO 19109 Rules for application schemas
<element name="Building" substitutionGroup="gml:AbstractFeature"><complexType>
<complexContent><extension base="gml:AbstractFeatureType">
<sequence><element name="extent" type="gml:SurfacePropertyType"/><element name="address">
<complexType><sequence>
<element name="Address" type="ex:AddressType"/></sequence>
</complexType></element><element name="type" type="ex:BuildingTypeType"/>
</sequence></extension>
</complexContent></complexType>
</element><complexType name="BuildingPropertyType">
<sequence minOccurs="0"><element ref="ex:Building"/>
</sequence><attributeGroup ref="gml:AssociationAttributeGroup"/><attributeGroup ref="gml:OwnershipAttributeGroup" />
</complexType>
UML</ l
GML
UML/GML Data Model/Application Schema
Content DescriptionData Format ISO 19136 GML
Geography Markup Language (GML)
XML schema for representing geographic features (attributes, geometries, relationships, etc).
XML based encoding standard for geographic information
Leverages a wealth of mainstream (beyond the geographic community) standards, tools and practices
Content DescriptionData Format
UC2008 Technical Workshop 23
Different disciplines view/understand the world very differently
Managua, 1972
• Volcán Masaya–Tourist attraction–National park–Biological reserve–Disaster mitigation area–Geological formation–Volcanologist study area
Street
Name
Content DescriptionCommunity standardized schemas to define rules, relationships, definitions, behavior
ESRI and ANSI Standardized GIS Data Models
• Address• Agricultural• Atmospheric• Base Map• Biodiversity• Census-Admin• Boundaries• Defense-Intel• Energy Utilities• Environmental • Forestry• Geology• Groundwater• Health
• Historic Preservation & Archaeology
• Homeland Security• Hydro• IHO• Land Parcels• Local Government• Marine• National Cadastre• Petroleum• Pipeline• Telecommunications• Transportation• Water Utilities
••Water
Simple feature classHaul Contains Z values
Contains M valuesGeometry Point
NoNo
Data typeField namePrec-ision Scale LengthDomainDefault value
Allownulls
OBJECTID Object IDSHAPE Geometry Yes
HAULJOIN Long integer No 0VESSELCODE Long integer No 0
CRUISE Long integer No 0HAUL Long integer No 0
STATION_ID String No 7SSTEMP Float No 0 0
BOTTOMTEMP Float No 0 0EFFORT Float No 0 0
DataSourceID String Yes 50
TableDataSource
Data typeField namePrec-ision Scale LengthDomainDefault value
Allownulls
OBJECTID Object IDDESC_ String Yes 35
SOURCE String Yes 35CONTACT String Yes 20
PREC String Yes 20CREATE_DATE Long integer Yes 0LAST_UPDATED Long integer Yes 0
DataSourceID String Yes 50
TableFishCatch
Data typeField namePrec-ision Scale LengthDomainDefault value
Allownulls
OBJECTID Object IDHAULJOIN Long integer No 0
SPECIESCODE Long integer No 0LATINNAME String No 28
COMMONNAME String No 21WEIGHTCPUE Double No 0 0NUMBERCPUE Double No 0 0
Relationship class
NamePrimary keyForeign key
TypeCardinalityNotification
Forward labelBackward label
No relationship rules defined.
DataSourceHasHaul
Origin table Destination feature class
SimpleOne to manyNone
HaulDataSource
DataSourceDataSourceIDDataSourceID
HaulName
Relationship class
NamePrimary keyForeign key
TypeCardinalityNotification
Forward labelBackward label
No relationship rules defined.
HaulHasFishCatch
Origin feature class Destination table
SimpleOne to manyNone
FishCatchHaul
HaulHAULJOINHAULJOIN
FishCatchName
Local government
Homeland security
Agriculture
Cadastre
http://www.esri.com/software/arcgis/geodatabase/about/data-models.html
Created locally, regionally, nationally, globally by community Subject Matter Experts
1. Digital orthoimagery2. Cadastral data 3. Geodetic control4. Elevation 5. Hydrography6. Transportation7. Government Units
Candidate ANSI/INCITS-L1FGDC Framework Theme models
Semantic interoperability – standardizing content description
My view Your view
ArcGIS Data Interoperability ExtensionMapping my lexicon to yours
Content descriptionGeographic Metadata - ISO 19115:2003
• Metadata - Data about Data– Information that describes a resource (data, service, etc)
so it can be understood–Ensures we find and use the right data for the right
purpose and use it correctly• Geographic metadata
–Geographic area covered–Currency–Rules of use–Positional accuracy–Data dictionary–Means of encoding–Datum–Map projection
• A Key interoperability technology:–Producers explain their product–Users learn about products
28
Metadata provides meaning to geographic information
Recent activities in ISO TC 211• Newly published standards
– ISO 19115-2 Extensions for imagery and gridded data– ISO 6709 Standard representation of geographic point location by coordinates– ISO/TS 19104:2008 - Geographic information - Terminology
• Emerging standards (sample selection)– ISO 19110 Amd 1 Methodology for feature cataloguing - Amendment 1 – ISO 19142/3 Web Feature Service/Filter encoding – ISO 19144 Classification Systems – Part 2: Land Cover Classification System
LCCS– ISO 19148 Linear referencing– ISO 19150 Ontology– ISO 19152 Land Administration Domain Model (LADM)– ISO 19156 Observations and measurements
• New work and upcoming revisions– ISO 19113 Data Quality– ISO 19115 Metadata– ISO 19117 Portrayal– ISO 19119 Services – NWIP Quality assurance of data supply
GIS - Evolving to a web service environment
. . . Dynamically Integrating Our Common Geospatial Knowledge
• Viewing services• Data Services• Application Services
GeoWeb
GISServices
Web Services Networks
Open Geospatial ConsortiumSpatial connectivity
Vision
A world in which everyone benefits from geographic information and services made available across any network, application, or platform
Mission
Deliver spatial interface specifications that are openly available for global use
33
OASIS/IETF / W3CInfrastructure:
o WSDLo UDDIo SOAPo XML
ISO & Other NationalDomains: o Object/Abstract o Modelso Content o Vocabulary
nal
t
Where does OGC fit in the ‘standards’ world?
OGC Web Services
35
Global Map http://wwAbstract: vector data
NOAA Weather httAbstract: point featur
Landsat http://www.NAbstract: 30m satelli
Catalog Service-WebMetadata publishing/search service
Web Coverage ServiceImagery and gridded data publishing/processing service
Web Map Service Geospatial “picture” publishing/viewing service
I-295
Web Feature ServiceGeospatial feature publishing/streaming service
GetCapabilitiesCapabilities
GetMapMap Image(PNG, GIF, JPEG)
(HTTP protocol)
…<LayerLimit>16</LayerLimit>
<MaxWidth>2048</MaxWidth><MaxHeight>2048</MaxHeight>
</Service><Capability>
<Request><GetCapabilities>
<Format>text/xml</Format><DCPType>
<HTTP><Get>
<OnlineResource xmlns:
…
WMS ClientArcGIS Server
Web Map Service - WMS
OGC Web Services providing an open interface
WebServer
ArcGIS
ArcGISServer
ArcView
Minnesotamapserver
WMSservices
Nativeservices
Web Browser
AutoCAD
GeoMedia
Oracle
MapExtreme
“getMap” WMS Request
Request (HTTP CGI form)
Response (JPEG file)
OGC interface
One data file… …many different maps!
OpenGIS Styled Layer Descriptor ( WMS-SLD)
… and non-graphicportrayals!
Web Feature Service - WFS
GetCapabilitiesCapabilities
DescribeFeatureType
Feature Schema
GetFeaturesFeatures
2.
(GML Schema)
(SF GML)
(HTTP protocol)
WFS Client
222
ArcGIS Server
GetCapabilitiesCapabilities
DescribeCoverageType
Coverage Schema
GetCoverageCoverage
2.
(GeoTiff, HDF-EOS, DTED, NITF, GML)
(HTTP protocol)
WCS Client
22
ArcGIS Server
Web Coverage Service - WCS
Catalog Service – Web ( CS-W)
GetCapabilitiesCapabilities
DescribeRecord
Schema of catalog Info Model
GetRecordsRecords
(HTTP protocol)
CS-W ClientArcGIS Server
OGC Catalog Services - Web
Catalog
Specific Data Model
Registry Information Model
describes
Mapped to
Stored By Serves
Uses
Based On
eb-RIMISO
FGDCDublin Core
EO
FGDCISO ISO 19115,19119
Metadata
DataService (WMS,WFS,WCS, …)
Resource
Global Map http://wwAbstract: vector data
NOAA Weather httAbstract: point featur
Landsat http://www.NAbstract: 30m satelli
Catalog Services in A GeoPortalGateway for your GIS enterprise/SDI
3-D BaseMap
(Cache)
2-D Base Map
(Cache)
OGC Web
Services
TrackingServices
GIS DataData
Streams
BrowserMobile
Desktop GIS
Geo-processing
Services • Search• Channels • Link Browser Map• Download:
• ArcGIS Explorer• Toolbar for ArcMap• …
• Collaboration
Web Services Platform
2-D &* 3-DDesktop Viewers
Enterprise GeoPortal Data Warehouse
Client Applications
Service Provider
ServiceService Provider
DataService Broker
DataDescription
2 D &* 3 D
Service Requester
Client
Catalog Services
Catalog
Catalog Services
Catalog
GIS Portal Toolkit
ServiceDescription
Recent activities in OGC
• Newly published– WCS 1.1.2 Coverage service– WCS T 1.1.4 Coverage service –Transaction extension– SOS 1.0.0 Sensor Observation Service– OpenLS Core services 1.2.0– CityGML 1.0.0– OpenLS Tracking Service 1.0– KML 2.2.0– GeoXACML 1.0 eXtensable Access Control Markup Language– CS-W ebRIM registry service
• Best practices– EO Extension for CSW ebRIM– KML Standard Development– SWE Architecture
• OGC testbeds– EC 08 OGC web and sensor services for ISR in support of command and control– GEOSS GEOportal in support of disaster management and Society Benefit Areas– OWS -6 SWE, GPW, DSS, AIM
• Revision– Almost all are being revised
45
Standards DevelopmentESRI provides leadership in the development of many standards and contributes to over 50 more
• ESRI serves many roles within OGC–Principal member–Actively participates:
• Technical Committee • Planning Committee • Board of Directors• All three OGC programs
– Interoperability program–Standards program–Community Outreach and Adoption program
–Current chair or co-chair• Metadata Working Group (WG)• Web Map Service WG
–Sponsors • Open Location Services Initiative
https://empirechallenge.net/Pages/Default.aspx
SOS-T
SPS WNS
SPSClient
SOS Producer
SOS Producer
SOS Producer
SOS-T
SOS WCS WFS CSW
WNSClient
WNSSOSClient
SDIClient
WNSClient
TPEDApplications
Analysis/ExploitationApplications
SOS Producer
WMS
Observations FeaturesCoverages
WPS
WPSClient
ObservationsObservation Processing Node
t//PP //D
Information Management / Processing Node
Resource Management Node
Analyze / Exploit Node
Discover sensor (availability, coverage, capability, capacity)Nominate, task and cross-cue sensor collectionRetrieve sensor observation, alert and forward
Store and process [and catalog] observationsAccess and distribute
CSW SOS
Access and distributeDiscover resources (sensors, observations and products)View, measure and analyze observationsRetrieve findings
SOSClient
Leica
DIA SensorWeb
DIA SensorWeb
ESRILeica DIA SensorWebDIA SensorWeb ESRI
CompusultESRI ESRI
ESRITASCLeica
Retrieve sensor observation, alert and forward
Compusult
ESRI
ESRITASCLeica
Compusult
Projects/TestbedsEmpire Challenge 2008
Projects/TestbedsGEOSS GEOSS (global earth observation system
of systems) is a technical architecture to share data & services
80+ countries officially sponsor (US Government team led by NOAA, USGS, NASA , …)
ttp://earthobservations.org/geoss.shtml
The vision for GEOSS is to realize a future wherein decisions and actions for the benefit of humankindare informed by coordinated, comprehensive and sustained Earth observations and information.
49
Projects/TestbedsINSPIRE
The INfrastructure for SPatial InfoRmation in Europe (INSPIRE) creates a legal framework for the establishment and operation of a European SDI.
The INSPIRE Directive defines a set of requirements which cover the topics metadata, network services, data specifications, data and service sharing, and monitoring and reporting.
http://sdi.jrc.ec.europa.eu/
• Registered SDIC member• ESRI/JRC CRADA• Drafting Teams for Implementation
Rules• Participate in Technical Workshops• Develop prototype portal
NSG Doctrine, Policies,Standards, and Guidance
50
GEOINT Standards Working Group Inaugurated Jan 05
ctrine, Policies,NSG DoctrinStandards and Guidance
• Mission–Populating the DoD IT Standards Registry (DISR) with
GEOINT Standards–Community forum for evolving GEOINT standards
and vetting issues
• Goals–Advance GEOINT interoperability across the National
System for Geospatial Intelligence (NSG)– Mandating relevant standards using the DISR–Advocate other standards relevant to the NSG
DGIWG
51
• ESRI Participation–Attend TP meetings
when possible–Review and comment
on developing documents
–Test developing standards
SecretariatDGIWG
PlenaryDGIWG
DirectorDGIWG
Policy & Technical Strategy Group
Requirements & Outreach Group
Data StructuresTechnical Panel
Services and InterfacesTechnical Panel
Data AccessTechnical Panel
Project Teams Project Teams Project Teams
Technical Coordinator
Thematic Coordinator Imagery
Thematic Coordinator Portrayal
52
Conclusion: WHO are the Players?• ISO TC211 – Geographic information= international
• OGC – Open Geospatial Consortium = international
• GWG – Geospatial-intelligence Standards Working Group=US DoD & IC –DISR.
• Digital/Defense Geographic Information WG – DGIWG = Defense standards process
• NATO/NSA - IGEOWG = MC&G related STANAGs
• INCITS-L1/ANSI – InterNational Committee for Information Technology Standards – Geographic information
• FGDC – in the US (data content standards, metadata…guidance)
• IHO-Transfer Standard Maintenance and Application Development Working Group=Hydrographic Standards
• INSPIRE –– Implementation Rules based on ISO, OGC, CEN TC 287 standards and specifications
• The United States Board on Geographic Names – geographic names
• ‘Industry Standards’ – NIEM, etc.
• W3C & OASIS – web IT standards (xml, SOAP, REST….)
Supporting interoperability through active participation:
Implementations–Platform–GIS standards–IT/industry standards
Development–International Standards–Regional Standards–National Standards–Information Community Standards
UNIX®
Projects/Testbeds– Empire Challenge 2008– GEOSS :– INSPIRE– Kentucky Watershed Modeling Information
Portal– Geospatial One-Stop– NATO Core GIS
Organizations– ISO TC 211– OGC– ANSI/INCITS –L1– CEN– Global Map– GSDI– DGIWG– IHO– GWG
Supporting interoperability through active implementation:
. . . Providing An Open & Standards-based Environment. . . And Enabling Successful Collaborative Systems
Simple feature classHaul Contains Z values
Contains M valuesGeometry Point
NoNo
Data typeField namePrec-ision Scale LengthDomainDefault value
Allownulls
OBJECTID Object IDSHAPE Geometry Yes
HAULJOIN Long integer No 0VESSELCODE Long integer No 0
CRUISE Long integer No 0HAUL Long integer No 0
STATION_ID String No 7SSTEMP Float No 0 0
BOTTOMTEMP Float No 0 0EFFORT Float No 0 0
DataSourceID String Yes 50
TableDataSource
Data typeField namePrec-ision Scale LengthDomainDefault value
Allownulls
OBJECTID Object IDDESC_ String Yes 35
SOURCE String Yes 35CONTACT String Yes 20
PREC String Yes 20CREATE_DATE Long integer Yes 0LAST_UPDATED Long integer Yes 0
DataSourceID String Yes 50
TableFishCatch
Data typeField namePrec-ision Scale LengthDomainDefault value
Allownulls
OBJECTID Object IDHAULJOIN Long integer No 0
SPECIESCODE Long integer No 0LATINNAME String No 28
COMMONNAME String No 21WEIGHTCPUE Double No 0 0NUMBERCPUE Double No 0 0
Relationship class
NamePrimary keyForeign key
TypeCardinalityNotification
Forward labelBackward label
No relationship rules defined.
DataSourceHasHaul
Origin table Destination feature class
SimpleOne to manyNone
HaulDataSource
DataSourceDataSourceIDDataSourceID
HaulName
Relationship class
NamePrimary keyForeign key
TypeCardinalityNotification
Forward labelBackward label
No relationship rules defined.
HaulHasFishCatch
Origin feature class Destination table
SimpleOne to manyNone
FishCatchHaul
HaulHAULJOINHAULJOIN
FishCatchName
• Content Standards
Data Models
Metadata (19115/19139)
ETL = Extract, Transform & Load Data
Transformation Procedures (ETL)Formats
Schema
Semantic
T
• Web Services Standards
Web Services
OGC/ISO
DXF, KML . . .
WMS WFS WCS
WMS WFS WCS Catalog
ArcGIS Desktop
ArcIMS / ArcGIS Server
WFS-TGML
• Management Standards
• Visualization Standards
• Standards Organizations•Development•Advice
• GIS Education• Providing Data and Services• ESRI Press
• Basic Structure Standards• WWWWWWWeeebbbbbbb SSSSSSeeerrrvviic
Thanks!