GLOCAL Event-based Retrieval of Networked Media

GLOCALEvent-based Retrieval of Networked Media

NEM Concertation MeetingBrussels, Feb. 3-4 2010

SOME DATA ABOUT THE PROJECT

NEM – Concertation meetingBrussels, Feb. 3-4 2010FP7 248984 - GLOCAL

THE CONSORTIUM


• Content-based retrieval systems failed so far to provide general-purpose, reliable systems:– semantic gap– content vs. context

• New tools are needed to represent, organize, index and access media, which should be:– Intuitive and user-centric (near to human way of organizing data)– Effortless (do not bother the user with complex and time-consuming

annotation, tagging, cataloguing, etc) – Scalable and extensible (support ever increasing types and amounts of

media documents)– Distributed (suited to widespreading media-driven social networks)

GLOCAL OBJECTIVES


• GLOCAL envisages a solution to such problems by exploiting three major assets:– The use of events as a primary mean to contextualize

data– The interaction of peers at local and global level to build

a social intelligence as the way to automate media organization

– The construction of new search paradigms based on the above elements

GLOCAL S&T ISSUES


THE GLOCAL MODEL

Events are entities with attributes and relational attributes (links) to other entities (e.g., events,locations, people, media)

Related events (event network):• Sub-event relationship (granularity)• Cause-effect relationship (causality)• Temporal relationship (continuity)• …

Media populate events:• Events contextualize media (experiential dimension)• Many-to-many relationship (viewpoints):

•One media linked to many events

•One event linked to many media

Linked persons

Linked locations

EVENT(UID)

NEM – Concertation meetingBrussels, Feb. 3-4 2010

FP7 248984 - GLOCAL

Query: a set of metadata from the event model– Simple or composite (QbyText, QbyExample, QbyMetadata, ..., as well as their

combination)– No need to specify all parameters (metadata)– Takes into account uncertainty (e.g., temporal and geographic range)

QUERY Refinement and navigation mechanisms –Query answering produces a ranked list of pointers to the event net–Refinement through hyperspace navigation (graphics, interfaces)

ExampleEvent: text description What “Soccer match Milan”

Time: temporal range When May 15, 2008

Space: geo location Where Milano, ItalyEntities: actors, objects Who Milan, Beckham

Sample media Which Photo of 1st goal


GLOCAL SEARCH

Event: Soccer match Milan,

Milano, 21.3.09

Original query:“Soccer match Milan”

Sub-Event 2

Sub -Event 1

EXAMPLE: A SPORTS EVENT

FP7 248984 - GLOCAL NEM – Concertation meetingBrussels, Feb. 3-4 2010

Sub-event Beckham

goal


Milano, 21.3.09Matches with other teams, same league

Other SIMILAR events


EXAMPLE: FINDING SIMILAR EVENTSOriginal query:“Soccer match Milan”


Milano, 21.3.09

Other Milan Soccer matches at different TIME

Previous event of the same soccer team


EXAMPLE: FINDING PAST EVENTSOriginal query:“Soccer match Milan”


Milano, 21.3.09

Other events in nearby PLACES

Other events around Milano

on 21.3.09



EXAMPLE: FINDING CO-LOCATED EVENTS


Milano, 21.3.09

Sub-event Beckham

goalSub-Event 2

Sub -Event 1

Events withsame actor

Other events with BECKHAM

Matches with Beckham in

different team Victoria Beckham



EXAMPLE: AN EVENT NETWORK…

• Which are the enabling technologies?– Event modelling (media & knowledge)

– Event instantiation (matching models to reality: create, evolve and

maintain events)

– Event population (effortlessly attaching media to events)

– Event sharing (sharing event structures and contents)

– Event-based indexing and search (using events to access media)

– Event-based interfacing (putting the user in the loop)

GLOCAL TECHNOLOGIES


kkk

GLOCAL SCENARIOS


Five initial use cases with a lot of UGC content on the web and main events with a rather large set of content (text for metadata, event modeling,

photo, video, graphics)

GLOCAL Event-based Retrieval of Networked Media

Documents

Transcript of GLOCAL Event-based Retrieval of Networked Media