UPM – Project Meeting Innsbruck - Feb/March 2011.
-
date post
19-Dec-2015 -
Category
Documents
-
view
216 -
download
1
Transcript of UPM – Project Meeting Innsbruck - Feb/March 2011.
UPM – Project MeetingInnsbruck - Feb/March 2011
Slide 2 of x
WP1 – D1.1 - TOC
1. Introduction (UPM)2. Characterization Mechanisms for Single-
Modality Unknown or Changing Data Sources
3. Characterization Mechanisms for Multi-Modality Combinations of Unknown or Changing Data Sources
4. Conclusion (UPM)
04/18/23
Slide 3 of x
WP1 – D1.1 – Single Modality
1. Characterization Mechanisms for Single-Modality Unknown or Changing Data Sources
◦ 1.1 Sensor Data Streams: Semantic Model Generation (UPM + JSI + EPFL)
Obtain domain ontologies based on metadata about sensors + numeric values obtained from them --- UPM
Relate these sensor data sources with other external knowledge sources (e.g., from tags to Cyc/DBPedia) --- JSI
In all cases, overarching usage of SSN Ontology for sensor sources description (demonstrated with various platforms, like GSN, Pachube, ad-hoc deployments, etc.) --- JSI, EPFL, UPM
◦ 1.2 Text Streams: data analysis (JSI) e.g., Twitter
04/18/23
Slide 4 of x
WP1 – D1.1 – Multi Modality
2. Characterization Mechanisms for Multi-Modality Combinations of Unknown or Changing Data Sources◦2.1 Near Real Time Mapping between Textual
Sources and Social Networks (JSI)◦2.2 Ontology-based Data Integration for Multi-
Modality Data Sources (UPM) Integration of sensors with relational databases
(e.g., current continuous temperature values with average (normal) values for a region)
04/18/23
Slide 6 of x
Background Previous work at UPM:
◦ Mapping data streams to ontologies◦ Use ontological schemas to write queries over streaming data
sources ◦ Rewriting SPARQL-Stream queries into declarative stream
queries (e.g. SNEEql)◦ Experience in Flood environmental sensor data.
6
Calbimonte, J-P., Corcho O., Gray, A. Enabling Ontology-based Access to Streaming Data Sources. In ISWC 2010.
Slide 7 of x
Ontology-based Data Access
Query translation
Query EvaluatorC
lient
Stream-to-Ontology mappings
SPARQLStream (Og)
[tuples]
Stream Engine (S3)
Ontology-based Streaming Data Access Service
Relational DB (S2)
Sensor Network (S1)
RDF Store (Sm)
SPARQLStream algebra(S1 S2 Sm)
Data translation
q
[triples]
SNEEql
Slide 8 of x
EPFL GSN
Deployment for SwissExDistributed environment: GSN Davos, GSN
Zurich, etc.◦In each site, a number of sensors available◦Each one with different schema◦However overlapping concepts in the schemas,
e.g. temperature◦Metadata stored in wiki
Federated metadata management:◦ Jeung H., Sarni, S., Paparrizos, I., Sathe, S., Aberer, K., Dawes, N., Papaioannus,
T., Lehning, M.Effective Metadata Management in federated Sensor Networks. in SUTC, 2010
8
Slide 9 of x
Initial look at GSN SwissEx data
Mirror data available.Web service interface:
planetdata.epfl.ch:22001/services/GSNWebService?wsdl◦ListVirtualSensorNames
wannengrat_gupf_unten wannengrat_unterhalb_felsen wan2 wan_sen7_2008 wan_sen4_2008 etc
Each one has a schema (attributes and types, etc)
9
Slide 10 of x
GSN getting data
getMultiData◦ Can request for a specific virtual sensor◦ Can request data from ALL sensors◦ Queries configured (can add new queries as well)
Sample query:◦ select pk, air_temperature, relative_humidity, incoming_shortwave_radiation,
outgoing_shortwave_radiation, net_shortwave_radiation, wind_speed_50cm, wind_speed_100cm, wind_speed_200cm, wind_speed_max_50cm, wind_speed_max_100cm, wind_speed_max_200cm, wind_direction, precipitation, battery_voltage, timed from wannengrat_tib3 where timed > 1271638922851 and timed <= 1298473500346 and pk < 9223372036854775807 order by timed desc (size: 20 offset: 0)
10
Slide 11 of x
GSN getting data
The web service parameters allow basic query configuration:◦Include all/some fields (fieldNames)◦Add basic selection conditions◦Add aggregations◦Indicate lower/upper time (time-based
selection)
11
Enabling Semantic Integration of Streaming Data Sources
Slide 13 of x
Idea
Add Ontology-based distributed query processing:◦ provide me all temperature sensors that have shown higher than 30 degrees◦ Use ontological schemas fro queries, internally map to the appropriate sensors◦ Query rewritten and dispatched to the appropriate GSN instances◦ Return query results URL
GSNDavos
GSNZurich
GSNChur
WikiMetadata
query
Distributed QP
Slide 16 of x
WP1 – SSN Ontology
Status : Stable◦http://www.w3.org/2005/Incubator/ssn/wiki/ima
ges/3/36/Ssn.xmlUsage :
1.Data Discovery and Linking2.Device Discovery and Selection3.Provenance and Diagnosis4.Device Operation Tasking and Programming◦http://www.w3.org/2005/Incubator/ssn/wiki/Rep
ort_Motivating_Use_cases#Use_cases
04/18/23
Slide 17 of x
Ontologies overview
SWEET
Service
Coastal Defences
Ordnance Survey
Additional
Regions
Role
DOLCE UltraLite
Schema
FOAF
Upper
External
SSG4Env infrastructure
Flood domain
17
SSN
Slide 18 of x
Ontologies
Infrastucture◦ Core sensor network ontology◦ Service and schema ontologiesDomain◦ Flood use case ontology network
18
Slide 19 of x
Ontology module
Class
Individual
Subclass-of property
Type property
Object or datatype property
Equivalent to a restriction in an object property
Subclass of a restriction in an object property
Legend
Module
Class
= objectProperty only | some
objectProperty only | some
property
Class
Class
Class
Individual
Slide 20 of x
Skeleton
Device
Deployment
PlatformSite
System
Process
ConstraintBlockMeasuringCapability
OperatingRestriction
Data
Overview of the SSN ontology modules
Slide 21 of x
Skeleton
Device
Deployment
PlatformSite
System
System
onPlatform only
hasSubsystem only, someSurvivalRange
hasSurvivalRange only
OperatingRangehasOperatingRange only
hasDeployment onlyDeploymentRelatedProcess
Deployment
deploymentProcesPart only
deployedSystem only
Platform
deployedOnPlatform only
attachedSystem only
Device
Sensor
SensingDevice
Sensing
implements some
observes only
hasMeasurementCapability only
inDeployment only
SensorInput
detects only
isProxyFor onlyObservationValue
SensorOutputhasValue some
isProducedBy some
Process
Process
hasInput only
hasOutput only, some
Input
Output
Observation
observedBy only
featureOfInterest only
observationResult only
Property
observedProperty onlyhasProperty only, some
isPropertyOf some
sensingMethodUsed only
includesEvent some
FeatureOfInterest
ConstraintBlock
ConditioninCondition only
MeasuringCapability
MeasurementCapability
forProperty only
OperatingRestriction
inCondition only
Data
Overview of the SSN ontologies
Slide 22 of x
CommunicationMeasuringCapability
MeasurementCapability MeasurementPropertyhasMeasurementProperty only
Accuracy
DetectionLimit Drift
Frequency
MeasurementRange
PrecisionResolution
ResponseTime
Selectivity
Sensitivity
Latency
Skeleton
EnergyRestrictionOperatingRestriction
OperatingRange OperatingPropertyhasOperatingProperty only
EnvironmentalOperatingProperty MaintenanceSchedule
SurvivalRange SurvivalPropertyhasSurvivalProperty only
EnvironmentalSurvivalProperty SystemLifetime BatteryLifetime
OperatingPowerRange
Property
Sensor and environmental properties
Slide 23 of x
Data
Device
Deployment PlatformSiteSystem
SystemDeploymentRelatedProcess
Deployment
Platform
Device
Sensor
SensingDevice
Sensing
SensorInput
ObservationValue
SensorOutput
Process
Process
Skeleton
ObservationProperty
FeatureOfInterest
DOLCE UltraLite
Situation Method RegionObject
Event
QualityEvent
InformationObject PhysicalObject
Process
DesignedArtifact or
Alignment to DOLCE UltraLite
Slide 24 of x
Ontologies
Infrastucture◦ Core sensor network ontology◦ Service and schema ontologiesDomain◦ Flood use case ontology network
24
Slide 25 of x
Service ontology
coversRegion
hasTemporalExtent
hasSpatialExtent
hasDataset
hasInterface
hasServiceType
containsOperation hasParameter
includesProperty
includesFeature
hasEndpointReference
25
hasSchema
hasStyleURL
WebService
StatefulWebService
xsd:string
sw:Dataset
sw:Region sw:SpatialExtent
sw:TemporalExtent
ssn:Property
ssn:FeatureOfInterestsm:Schema
xsd:anyURI
Interface Operation Parameter
DataAccessInterface …ServiceType
OGCS.T. SSG4EnvS.T. GeoJSONS.T. XMLS.T. RSSXMLS.T.
Schema MetadataSSN
SWEETXSD
ISO 19119
Slide 26 of x
Schema Metadata ontology
hasExtent
hasPrimaryKey
hasAttributeor
hasSQLType
hasTimestampAttribute
26
equivalentToProperty
Extent
Relation Stream
Schema
DatabaseSchema DataStreamSchema
PrimaryKey
Attribute
TimestampAttribute
ssn:Property
SQLType
SSN
Slide 27 of x
Ontologies
Infrastucture◦ Core sensor network ontology◦ Service and schema ontologiesDomain◦ Flood use case ontology network
27
Slide 28 of x
Coastal Defences ontology
locatedInRegionssn:hasProperty
hasOceanRegionProperty
28
ssn:Property ssn:FeatureOfInterest sw:Region
AssetProperty OceanRegionProperty
Asset os:TopographicObject
OceanRegion…
…
TideHeight WaveHeight
SSN SWEET
OS
Slide 29 of x
Features and properties Physical atmosphere• Air temperature• Wind speed• Wind direction• Visibility
Asset• Height• Condition• Class• Width• Inspection date• Maintainer• Location• Mastermap Id
Flood plain• Water depth
Flood zone• Flood zone type
Flood defence policy• Strategic defence option
Ocean region• Wave height• Tide height
Vessel• Location• Name• Bearing• Type• Size• Callsign• Speed• ETA
Road problem• Location• Road identifier• Description• Event time
29
Slide 30 of x
Additional Regions ontology
• Coastal Defence Partnership• Coastal Defence Partnership (Modelled area)• Solent• Solent (Modelled area)• South East England• South East England (BRANCH)• South East England (CCO)• Southern Coastal England (CCO)• Solent (AIS live)• South East England (Highways Agency)• South West England (Highways Agency)
30
sw:Region
gz:NamedPlace
Slide 31 of x
Role ontology
hasRegionOfResponsibility
hasResponsibility
undertakesTask
foaf:member
31
assumesRole
hasPositionoccupies
hasSubOrganization
ssn:hasProperty
hasRelatedProperty
hasRelatedFeature
isFulfilledBy
definesisAssignedTo
appliesTooperatesWithin
ssn:Property
ssn:FeatureOfInterest
Position
Role Task
Responsibility
Duty
foaf:Person
foaf:Organization
sw:Region
SSN
SWEET
FOAF
Slide 34 of x
WP2 – Contribution Plan
Tools for transforming geography objects (GML, Oracle Spatial, etc) to RDF◦http://mccarthy.dia.fi.upm.es/geometry2rdf/◦Geometry2rdf presentation for more detail
04/18/23
Slide 35 of x
WP4 – PlanetData VocabularyDocument uploaded on wiki WP4 page (Jan 2011)
◦ Feedback and comments?
Analysis of existing vocabularies◦ Identify prominent features of analyzed vocabularies
General Purpose Vocabularies◦ DC
Dataset Purpose Vocabularies◦ Dcat◦ Void
Stream Purpose Vocabularies◦ Pachube Information Model◦ Sstream◦ SSN
04/18/23
Slide 36 of x
WP4 – PlanetData VocabularySome Examples - SStream
Pollution sensor measuring CO2 emission◦Continuous◦Valid for 1 hour
:COSensor1 a ss:Sensor.:COSensor1Stream a ss:ContinuosStream;
ss:expires P1H;contains :COSensor1StreamContent.
04/18/23
Slide 37 of x
WP4 – PlanetData VocabularySome Examples - PachubeNot clearly defined
◦Based on its APIEnvironment properties
◦Static vs dynamic◦Outdoor vs indoor◦Live vs frozen
: MadridStreet1 a pachube:Environment;pachube:location_lat 40.26;pachube:location_long 3.42;pachube:environment_disposition "Static";pachube:environment_exposure "Outdoor";pachube:environment_domain "Physical";pachube:feed_status "Live";pachube:hasDatastream :COSensor1.
:COSensor1 a pachube:DataStream.
04/18/23
Slide 38 of x
WP4 – PlanetData VocabularySome Examples – Sstream+Pachube
Sensor on Fred◦ Heart rate◦ Private data◦ Restriction to hospital◦ Every 5 minutes
:Fred a foaf:Person;ss:sensor :HeartSensor.
:HeartSensor a ss:Sensor;ss:attachedTo :Fred.dc:description "Heart rate sensor".dc:publisher _:bnode1.
_:bnode1 a ss:PeriodicStream;ss:publishedBy :HeartSensor.ss:dataType xs:decimal.ss:contains _:bnode2.dc:accrualPeriodicity _:bnode3.
_:bnode2 a ss:StreamContent;rdfs:about <http://fredHospital.org/fred/heartRate.trdf>;pachube:ip_restriction :HOSPITAL_IP.
_:bnode3 a ss:Frequency;} ss:duration P0Y0M0DT0H5M.
04/18/23
Slide 39 of x
WP4 – PlanetData vocabularySome Proposals
Dynamic dataset properties◦ Expiration properties◦ Continuous/periodic◦ Feed status (live/frozen)
Subjective/Objective properties◦ dcat:dataQuality◦ ssn:precision
Location properties beyond standard geographic features◦ mobile or static location◦ indoor or outdoor
Access Control◦ Public sensors: pollution sensors◦ Private sensors: heart-rate sensors◦ Allowed/blocked sources◦ Access duration◦ Frequency limit
04/18/23
Slide 40 of x
WP4 – Relevant Data sets
Channel Coastal Observatory◦Pending final confirmation that it can be used
AEMET (Agencia Española de Meteorología)◦Currently working on its transformation.
Demonstrator soon
InfoTerre : In/Out?PSA : In/Out?Sensorbase : In/Out
04/18/23
Slide 41 of x
WP6 - curriculumMotivation
◦ Comparison with Relational DB storage
Streaming data models◦ Unbounded streams◦ Tuples, Windows◦ Timestamps◦ K-constraints
Query Languages◦ Relational
operatorsWindow operators, temporal operators
◦ Aggregators◦ Joins
Semantic streaming data◦ RDF Stream data models◦ SPARQL extensions for RDF
Streams◦ Reasoning with Streams◦ Complex event processing◦ Linked Streaming Data
Query processing◦ Continuous queries◦ Window evaluation◦ Aggregates evaluation,
approximative queries◦ Static optimization◦ Query optimization, statistics◦ Load shedding◦ Sampling
04/18/23