A Platform for Object-Action Semantic Web Interaction Roberto García, Juan Manuel Gimeno, Ferran...

A Platform for Object-Action Semantic Web Interaction

Roberto García, Juan Manuel Gimeno, Ferran Perdrix*, Rosa Gil, Marta Oliva

HCI and Data Integration Research Group

Universitat de Lleida, Spain

*Segre Media, Spain

Contents

• Introduction

• The Rhizomer Platform

• Use Case: S5T Project

• Conclusions & Future Work

Rhizomer Semantic Content Management System


Introduction

• The Semantic Web is here......but difficult take off in the “real world”

• Problem: “it is complicated to use it” [1]– Even for researchers/advanced users [2]– No just browsing, also edition (Wiki-like)

[1] Shadbolt, Hall, Berners-Lee. The Semantic Web Revisited. Intelligent Systems 21(3), 2006

[2] Heath, Domingue, Shabajee. User interaction and uptake challenges to successfully deploying Semantic Web technologies. 3rd Semantic Web User Interaction Workshop, 2006

Introducción

• Human-Computer Interaction ↑Usability

– User tasks analysis:• Web: reduced set and clearly defined• Web 2.0, 3.0: wider set, still to define

– Action-Object Paradigm • Hierarchical actions menus• Select action (e.g. “Open”) and the object (e.g. “File”)• Reduced usability in heterogeneous object domains


Introduction

• Semantic Web – Facilitates data integration– Heterogeneous objects

• Look for a more appropriate interaction paradigm…

• Object-Action Paradigm– Appropriate for heterogeneous domains– Select object, then from available object actions– Cognitively, easier to organise/identify objects– Semantic Web :

• Ontologies organise objects, restrict available actions


Contents

• Introduction





Rhizomer

• Platform for Semantic Content Management and Human-Semantic Web Interaction– Based on Web 2.0 technologies

• Client (AJAX) / Server (REST)

– Web 3.0 data model• Semantic metadata store: RDF(OWL) / SPARQL

– Generic metadata browsing• HTML + Javascript

– Object-Action Interaction Paradigm• Semantic Web Services



Rhizomer

• Server part:– REST interface over repository

• Jena, Sesame,…• GET: SPARQL end-point• PUT/POST/DELETE:

RDF metadata management

– Semantic Web Services• OWL-S descriptions

– Service Profile: Process, hasInput, hasOutput• REST adapters for

– Javascript APIs (e.g. Google Maps), SOAP,…

MetadataStore

Rhizomer

GE

T

PU

T

PO

ST

DE

L

search new edit delete

Rhizomer

• Client part:– AJAX (asynchronously send queries and metadata)– RDF/XML ─XSLT HTML (browsing)– “Semantic” forms (edition)

• RDF/XML ─XSLT FORM ─Javascript RDF


RDF

<HTML/>

<HTML/> SemFORMS

JavaScript

Contents

• Introduction





S5T Project

• S5T Spanish research project (TIN2005-06885)

– Scaleable Semantic personalised Search of Spoken and written contents on the Semantic Web

• Application in the Segre media group– Newspaper, TV, radio and web site– Internal use (media house): facilitate content

production, history tracking, contextualisation,…– External use (web users): advanced services (e.g.

news personalisation, semantic podcasts,…)


S5T Project

• Semantic annotation of audiovisual content– voice text (keywords) semantic annotations

• Rhizomer: user interface for browsing/interacting with content and associated knowledge


Search Engine

Search API

Media

word

Annotation Ontology

word

Media Browser

Ontology Browser


S5T Project: query

• Queries:– Metadata– Content (transcript)

• Words• Concepts title

date

genre

transcript

Search

+

Add property

GE

T

MPEG-7 Ontology

NewsML Ontology

S5T Ontology

s5t:Audiospecific propertiesP rdfs:domain s5t:Audio or

s5t:Audio owl:Restriction on P

(or superclass)

?query=

DESCRIBE ?s

WHERE {

?s dc:title ?y0;

s5t:genre ?y1.

FILTER regex(?y0, "…") && ?y1=<…./SubjectsOnto# 11000000> }

<form method=“GET” onSumbit=“formToSPARQL”><input type=“text” name=

“http://purl.org/dc/elements/1.1/title”/>

<input type=“text” name=“http://purl.org/dc/elements/1.1/date”/>

…

</form>


S5T Project: store

• GET SPARQL endpoint

• Metadata store– Jena, Sesame,…

• DESCRIBE queries by default. Facilitate:– Browse heterogeneous metadata– Without a priori knowledge

• DESCRIBE implementation– Concise Bounded Description +

rdfs:labels for all selected resources

• Result: RDF/XML

http://rhizomik.net/~rosa

http://...vcard#ADR

http://...vcard#StreetJaume II, 69

http://...vcard#Locality

Lleida

http://...onto#affiliation

http://www.udl.cat

http://...rdf#type

http://...rdfs#label

Rosa Gil

http://...rdf#type

http://...onto#Professor

http://...rdf#type

http://...vcard#work

http://...onto#University


S5T Project: store

• DESCRIBE http://rhizomik.net/~rosa: CBD(…~rosa) = Fragment A U rdfs:labels

Fragment A


S5T Project: browse

RDF2HTML

GET RDF2HTML

<s5t:Audio rdf:about="http://www.segre.com/audio/20070323-bm.mp3"> <dc:title>Butlletí Migdia</dc:title> <dc:date>2007-03-23</dc:date> <s5t:genre rdf:resource="&srs;11000000"/> <s5t:transcriptResource> http://www.segre.com/audio/20070323-bm.xml </s5t:transcriptResource></srt:Audio> http://www.segre.com/ audio/ 20070323-bm.mp3 a Audio

title Butlletí Migdia

date 2007-03-23

genre politics

transcript http://www.segre.com/audio/20070323-bm.xml

Referrers

http://rhizomik.net/.../NewsCodes-SubjectsOnto#11000000 a Subject

label politics

descriptionLocal, regional, national and international exercise of power, or struggle for power, and the relationships between governing bodies and states.

Referrers

http://www.segre.com/audio/20070323-bm.mp3

http://www.segre.com/audio/20070323-bm.mp3


http://…/s5t.owl#Audiotype

title

date

genre http://...SubjectsOnto.owl#11000000

2007-03-23

Butlletí Migdia

Change/Add

+

Add property

RE

ST

PU

T

RE

ST

PO

ST

RE

ST

DE

L

http://www.segre.com/ audio/ 20070323-bm.mp3

edit or new

edit new del

transcript http://...com/audio/20070323-bm.xml

S5T Project: edition

edit – del – new

http://www.segre.com/ audio/ 20070323-bm.mp3 a Audio


date 2007-03-23

genre politics


Referrers


S5T Project: edition

• Semantic form:

<form method=“PUT/POST” onSumbit=“formToNTriples”><input type=“text” name=“http://...w3.org/.../rdf-syntax-ns#ID” value=“http://www.segre.com/audio/20070323-bm.mp3”/><input type=“text” name=“http://...w3.org/.../rdf-syntax-ns#type” value=“http://rhizomik.net/.../s5t.owl#Audio”/><input type=“text” name=“http://rhizomik.net/.../s5t.owl#genre”/

value=“http://.../NewsCodes-SubjectsOnto#11000000 ”/>

…</form>

– PUT: description for new resource– POST: replace resource description

<Subject,…

Predicate,Object>

Predicate,Object>


S5T Project: uploading

• Semantically annotate uploaded content(facilitate metadata creation)

• Content-type specific metadata extraction plugins– Audio: text-to-speech– Text: keyword detection, disambiguation

• OpenCalais, Freeling,…: named entities

– Photo: EXIFtoRDF,…– …


S5T Project: interaction

• Given a resource (object)…determine available services (actions)

• Resource description: type, properties, values,…



date 2007-03-23

genre politics


Referrers



• Services descriptions:

– ID: Service Adapter URL– hasInput: an OWL Class

• Service applicable to any resource classified in this class

– hasOutput: output content type• text/html, application/rdf+xml,…

http://rhizomik.net/services/play a Process

label Play

hasInput http://rhizomik.net/.../s5t.owl#Audio

hasOutput text/html

Referrers



• For each resource:– Processes s.t. resource rdf:type hasInput Class

• Call: REST PUT/POST RDF resource• Adapter: service invocation

(Javascript, SOAP,…)



date 2007-03-23

genre politics


Play Referrers



Butlletí Migdia (23/03/2007)

La mobilització en contra dels transgènics i en favor de Josep Pàmies també ha servit per introduir altres reclamacions. En aquest cas, alguns dels col·lectius de la lluita contra aquests cultius demanen que la Universitat de Lleida rebi una especialització en Agricultura Ecològica. Asseguren que serien uns estudis pioners que servirien al centre per recuperar prestigi.

Search Keyword

Browse Term



date 2007-03-23

genre politics


Play Referrers

Search Keyword: describe resources whose transcript contains keyword…

Browse Term: describe the concept annotating the keyword

http://www.udl.cat a University

label Universitat de Lleida

lat 41.37

long 0.37

Map Referrers


• Map any resource with lat/long:

<process:Process rdf:about="http://rhizomik.net/services/map"> <rdfs:label>map</rdfs:label> <process:hasInput> <owl:Class rdf:ID="GeolocatedEntity"> <owl:intersectionOf rdf:parseType="Collection"> <owl:Restriction> <owl:onProperty rdf:resource="&pos;lat"/> <owl:minCardinality>1</owl:minCardinality> </owl:Restriction> <owl:Restriction> <owl:onProperty rdf:resource="&pos;long"/> <owl:minCardinality>1</owl:minCardinality> </owl:Restriction> </owl:intersectionOf> </owl:Class> </process:hasInput> <process:hasOutput>text/html</process:hasOutput></process:Process>

• Service Adapter includes GoogleMap Javascript • The same for events (Timeline, Calendar,…), etc.


Contents

• Introduction






Conclusions

• Content Management System based on semantic metadata

• Framework for Human-Semantic Web Interaction

• Flexible – Projects: S5T, Rhizomik,…

• Extensible– Plugins for visualisation, interaction and

metadata extraction• Usable

– Preliminary usability tests

Future Work

• Assisted metadata edition– Properties and values recommended based on

available ontologies

• Create basic services set– Map– Time line– Calendar– Plot…

• Complete usability test


Thank you for your attention

More: http://rhizomik.net

Roberto García

http://rhizomik.net/~roberto

A Platform for Object-Action Semantic Web Interaction Roberto García, Juan Manuel Gimeno, Ferran...

Documents

Transcript of A Platform for Object-Action Semantic Web Interaction Roberto García, Juan Manuel Gimeno, Ferran...