I1-[OntoSpace]Ontologies for Spatial Communication

John Bateman, Kerstin Fischer, Reinhard Moratz

Scott Farrar, Thora Tenbrink

2

I1-[OntoSpace]

user

Rolland

Pioneer

Provision of natural dialogic interaction concerning user tasks in a spatial context

presentation of spatial information communication of spatially-situated actions

Focusing on RE-USABILITY of components and EXTENSIBILITY of approach

producing NON-TASK SPECIFIC solutions

Motivation

3

I1-[OntoSpace]

Difficulties

different perceptual systems of human and robot: necessity of mediation

discourse situation influences linguistic choices

determining factors as yet unknown

4

I1-[OntoSpace]

Two problem areas for investigation

Complexity of negotiating spatial relations Variability of reference systems Discoursal negotiation processes Situational factors

Unfamiliarity of interaction situation Communication with an artificial interlocutor Choice of linguistic expressions No knowledge about robot‘s functionalities

5

I1-[OntoSpace]

Reference systems

Intrinsic: Localisation of object by reference to the intrinsic

properties of another entity, e.g. speaker‘s front: “The ball is in front of me”

Relative: Presence of relatum required:

“The ball is in front of the table” Group-based reference if one of several similar objects is

referred to: “The leftmost ball”

Absolute: the earth‘s cardinal directions (north, south)

6

I1-[OntoSpace]

Perspectives

Speaker-centered: Intrinsic: “The ball is in front of me” Relative: “From my point of view, the ball is to the right of the

table” Absolute: “to the north of me”

Listener-centered: Intrinsic: “The ball is in front of you” Relative: “From your point of view, the ball is to the right of the

table” Absolute: “to the north of you”

7

I1-[OntoSpace]

Our approach

Elicitation of data in experimental settingsanalysis of linguistic choices in relation to situational parameters (spatial settings and tasks; robot appearance and behavior)

Integration in a single functioning system modeling of dialogue mechanisms achieving flexibility of interpretation by modularity

Ontology mappingFlexibility of mapping mechanisms required: the discourse model informs how the domain model concept is to be subordinated in a given context

8

I1-[OntoSpace]

user

Empirical Investigation

linguistic negotiation alignment, shaping,

grounding

conceptualization of spatial agents register, conceptualization, shaping

spatial configurations group-based, routes and landmarks,

consistency and frames

9

I1-[OntoSpace]speech recognition agents

speech recognition output interface

where is the beer?

analysis component

(CG based: stringsemantic representation)

dialog

manager

generation component

speech synthesis agents

string with speech synthesis markup

in the fridge!

Architectural overview (I1/I3)

10

I1-[OntoSpace]speech recognition agents

speech recognition output interface

where is the beer?

analysis component

(CG based: stringsemantic representation)

dialog

manager

generation component

speech synthesis agents

string with speech synthesis markup

in the fridge!

Architectural overview (I1/I3)

11

I1-[OntoSpace]analysis

componentdialog

manager

generation component

Architectural overview (I1/I3)

12

I1-[OntoSpace]analysis

componentdialog

manager

generation component

Architectural overview (I1/I3)

conceptual

linguistic frame of referencelinguistictasks

non-linguistictasks

13

I1-[OntoSpace]

Inter-ontology mediation: Close relationship but not identity

conceptual

linguistic frame of referencelinguistictasks

non-linguistictasks

14

I1-[OntoSpace]

SPATIAL REPRESENTATIONS LINGUISTIC REPRESENTATIONS

Solution method pursued

Achieving interaction between system modules using ONTOLOGIES

DOMAINS

ONTOLOGIES

inter-ontology mediation

15

I1-[OntoSpace]

SPATIAL

SPACE-INTERVAL SPACE SPACE-POINT

ZERO-D-LOCATION

THREE-D-LOCATION

ONE-OR-TWO-D-LOCATION

Mann, Matthiessen, Bateman, Moore, Kasper, Arens (1985)

Upper Model Ontology(small extract)

in

on

at

Chat-80 ontology (small extract)

Warren and Pereira

GEOGRAPHICAL FEATURE

AREA POINT LINE

BRIDGE

TOWN

inter-ontology mediation

?

on the bridge * on the town along the bridge * along the town across the bridge * across the town at the bridge at the town* in the bridge in the town

Task-dependent mediation required

16

I1-[OntoSpace]

I1: Targetted results

development of a comprehensive spatial ontology development of linguistic ontology for handling linguistic

tasks representation of all ontologies in OWL and CASL

specifications specification of principles and methods for inter-ontology

mappings specification of discourse-history and robot-

conceptualisation conditionalistions of the mappings

17

I1-[OntoSpace]

Interest areas

spatial ontology linguistic ontology ontology formalisation

dialogic linguistic HRI contextual conditioning of linguistic

interaction and linguistic form

18

I1-[OntoSpace]

Distribution of labour with respect to dialog functionality

• Human Language Technology

• Computational Dialogue Components

• Empirical investigation of dialogue properties

• Development of spatial and linguistic ontologies

I3-[SharC]

I1-[OntoSpace]

• Ontology specification and processing

I4-[SPIN]