Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data &...
Transcript of Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data &...
![Page 1: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/1.jpg)
Semantic Technologies for Spatial Infrastructures
An update on progress in Program 3 of the
CRCSI
Professor Geoff West
![Page 2: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/2.jpg)
• Commenced January 2012 • Initial discussions and landscape/literature search • Consultations with 43plers, jurisdictions, agencies, CRCSI, VANZI, ANZSM • Joint ANZLIC/CRCSI meeting, April 2012 • CRCSI Conference, Brisbane, May 2012 • GSDI 2012, Quebec, 2012 • Further literature search of main journals/conferences • Generation of documents:
– Research Strategy – Addressing the milestones
• CRCSI Board – endorsement • Final approval from ANZLIC, PSMA, Program 3 Board (CRCSI), RIC (CRCSI), REC
(CRCSI) • Engagement Workshops – done • Project proposal generation – done • Projects running – now!
Research Strategy Consultation
![Page 3: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/3.jpg)
• Vision: – “Seamless access to the right spatial knowledge at
the right time, in the right format, at the right price”
• Outcomes: – Intelligent search and discovery – Vertical and horizontal linking of data and
processes – Orchestration of web services – Crowd sourced integration – Fast and effective big data querying – Supply chain management and processing
Vision and Outcomes
![Page 4: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/4.jpg)
User demands Core research Test beds Use cases Adoption
From Drivers to Utilisation
Artificial Intelligence
Supply Chains
Semantic Web Web-based
Search
Querying
Crowd Sourcing
Marketplaces
Orchestration
Data Integration
Licensing
PSMA
GA
GLOBES
FSDF
SLIP
LINZ
ASDI
FSDF
SLIP future
Health
Urban planning
Big data queries
Biomass business
Property models
Federal data integration
State data integration
Disaster management
Research activities
![Page 5: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/5.jpg)
Landgate DSE LPI PSMA crowdsourcing
…
Users Catalogues
Ontologies Vocabularies
Metadata
Data & Metadata
High Performance Computing
ABS BoM GA Private Sector
…
Big Data co-located with orchestrated processing, modelling and prediction
Data Data
Data
Data
Modelling Local Orchestrated Processing Search
Querying
Visualisation Inference
Data Integration
Smarts - code
Search
Modelling
LINZ
… …
Existing open software standards and architectures e.g. SISS
Solution: Linking Data and Processes
![Page 6: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/6.jpg)
• Don’t want data, want results – Leave data where it is, run processes in situ – Use web services – Use standards (OGC, W3C, OASIS etc.) – Utilise many online sources
• Want stability of sources – Cool URIs – Persistent URIs
• (www.handle.net, http://dx.doi.org/10.1000/182)
Principles
![Page 7: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/7.jpg)
Semantic Web technology stack visualization (Benjamin Nowack 2011)
Elements of the Semantic Web
![Page 8: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/8.jpg)
Spatial Information Projects
• Funding: $600k per year • Project 3.01 – Search and Discovery, Federated Models
• Research Fellow – Curtin: Dr David McMeekin • Three PhD students – Curtin • Curtin, NGIS, Amristar, PSMA, Landgate (WA), DEPI (VIC) • Co-supervision of students – CSIRO: Simon Cox, Paul Box
• Project 4.17/3.03 – Querying big data, orchestration – 3D/4D datasets • Joint P3/P4 project • Research Fellow – GA • Research Fellow – QUT • QUT, GA, DEPI (VIC), OEH (NSW), DSITIA (QLD)
• Project 3.02 – Supply chains, orchestration, crowd sourcing, licensing • Research Fellow – Curtin: Dr David McMeekin • Research Fellow – Curtin: Dr Lesley Arnold • Three PhD students – Curtin • Three PhD students – Canterbury • Curtin, Canterbury, Landgate (WA), DEPI (VIC), DNRM (QLD), LINZ, PSMA,
Omnilink, NGIS, AAM, OSP • CSIRO involvement
• Project 4.1X – Biomass Business 2: Farmer centric crowd sourcing • UNE, Canterbury
![Page 9: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/9.jpg)
PhD Student Status – April 2014
Original plan!
Original plan!
![Page 10: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/10.jpg)
PhD Student Status – April 2014
![Page 11: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/11.jpg)
The Modern PhD Student!
![Page 12: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/12.jpg)
• Good queries: – “Who should I evacuate
from the flood zone in the next 24 hours?”
– “Am I at risk of death/injury by purchasing this house?”
– “Which houses are unoccupied after the earthquake?”
• Bad query: – Give me all the data you’ve
got, I’ll work it out!
• How about:
Search and Discovery – Tristan
From nbc.com
http://sensorweb.ncsa.uiuc.edu/api/event/tornados?intersects= http://sensorweb.ncsa.uiuc.edu/data/map/state/USGS/Illinois Using Linked Data in a heterogeneous Sensor Web: challenges, experiments and lessons learned Liang Yua & Yong Liub, IJDE, Sept. 2013
![Page 13: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/13.jpg)
• “how does solid water melting influence stream flow in the Arctic Region over the summer?”
P3.01: Search and Discovery - Tristan
Semantic-based web service discovery and chaining for building an Arctic spatial data infrastructure, Li et al (2011), Computers and Geosciences, Vol 37.
event state change
place time
![Page 14: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/14.jpg)
• Can Google find everything? – getcapabilities WMS soil Italy – Google Search Appliance – Voyager – Omniscient – Geonetwork – Swoogle – www.opensearch.org – www.ontology.com – www.govpond.org
• Generate rdf triple stores of derived metadata?
P3.01: Search and Discovery - Chet
![Page 15: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/15.jpg)
P3.01: Federated Data - Jeremy
Given FSDF models • Jurisdictional models examined and
generated • Federate seamlessly from jurisdictions • Leave data where it is • Linked data including fonts, colours
etc.
![Page 16: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/16.jpg)
• Research – models and tools: – Integrate disparate and complex
multiple supply chains – Integrate crowd sourcing into
supply chains and combine with authoritative data
– Model the various crowd sourcing data suppliers
– Model business rules, people – Deal with currency, provenance
and versioning of spatial data – Link data and processes vertically
and horizontally e.g. from LGAs up to the Commonwealth and across different datasets
P3.04: Supply Chains – General
Primary suppliers
Final customers
![Page 17: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/17.jpg)
VIRTUOSO Universal Server: •Middleware and database engine hybrid. •Combines the functionality of a traditional RDBMS, ORDBMS, virtual databases, RDF, XML, free-text, web application server and file server functionality in a single system. •RDF data can either be stored directly in Virtuoso or can be created on the fly from non-RDF relational databases based on a mapping. •SPARQL query statements can be written to fetch the resulting dataset as XML files and then the resulting datasets will be used to analyse model appropriateness and update the source geo-databases.
P3.04: Supply Chains - Latha
![Page 18: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/18.jpg)
Supply Chains – What the Developer Wanted
![Page 19: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/19.jpg)
Collaborative Ontology Generation- Reza
Collaborative Ontology Development for the Geosciences
Collaborative Ontology Development for the Geosciences, Reza Kalbashi et al, Trans. In GIS, 2013.
![Page 20: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/20.jpg)
Linking Geospatial Data to Ontologies - Reza
![Page 21: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/21.jpg)
• Investigate landscape • Model processes, activities, data and links
– UML
• Utilise Semantic Web techniques – URIs – RDF, Ontologies, Rules, Description Logics – Traditional databases, data formats
• Build Tools – Web-based
• Evaluate
Research Methodology
![Page 22: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/22.jpg)
Project Governance
![Page 23: Semantic Technologies for Spatial Infrastructures · Ontologies Vocabularies . Metadata . Data & Metadata High Performance Computing Private Sector ABS GA BoM … Big Data co -located](https://reader030.fdocuments.in/reader030/viewer/2022041121/5f36872d62461f4a731f394f/html5/thumbnails/23.jpg)
• Spatial data landscape continuously changing • Now have a large team to address many
aspects • Commonwealth and Jurisdictional projects • Use of standards:
– OGC, W3C, OASIS
• Use open software and architectures
Summary