Utilizing Semantics in the Production of iTV Shows (ESWC 2009)

7
Utilizing Semantics in the Production of iTV Shows European Semantic Web Conference (ESWC 2009) Demonstration paper Georg Güntner, Dietmar Glachs, Rupert Westenthaler Salzburg Research Forschungsgesellschaft m.b.H. Date: 03/06/2009 Location: Hersonissos, Greece Presenter: Georg Güntner

description

This slideshow was used to present a demo paper during ESWC 2009 in Heraklion (Crete). The paper gives an overview of the semantic aspects of an advanced, semantics-based broadcasting production support system designed to enable the creation of interactive multi-channel television shows. The “Intelligent Media Framework” forms the middleware of this system and was developed in the context of the European integrated project LIVE. The envisaged “intelligence” is based on formal, machine understandable descriptions of the content and the events. We demonstrate the successful usage of the system by a broadcasting corporation in a field trial with several hundred end consumers, conducted during the Olympic Games in Beijing, August 2008.

Transcript of Utilizing Semantics in the Production of iTV Shows (ESWC 2009)

Page 1: Utilizing Semantics in the Production of iTV Shows (ESWC 2009)

Utilizing Semantics in the Production of iTV Shows

European Semantic Web Conference (ESWC 2009)

Demonstration paper

Georg Güntner, Dietmar Glachs, Rupert Westenthaler

Salzburg Research Forschungsgesellschaft m.b.H.

Date: 03/06/2009

Location: Hersonissos, Greece

Presenter: Georg Güntner

Page 2: Utilizing Semantics in the Production of iTV Shows (ESWC 2009)

02 June 2009 2(c) LIVE Consortium, 2009 (www.ist-live.org)

Ingredients of the Demo

• Starting point: Imagine a mass media event with

– 23.000 athletes

– 14.000 officials

– 6.500 events

– 1.100 teams

– 12 parallel video live feeds

– 200 archival clips

• The vision: The production of a– real-time

– non-linear

– interactive

– multi-channel (5 channels)

video show in broadcasting quality

• Implementation– Development of a real-time production

support system

– “Intelligent Media Framework” based on semantic concepts deals with

• aggregation

• storage

• propagation

• filtering

• visualisation

of contextual information

– Annotation, detection and extraction of “knowledge”

– Recommendation and personalisation

• Performance indicators (field trial)– 3 x 2 x 5 x 5h = 150h of material

– 110.000 action messages sent

– 18.000 terms in 65 vocabularies

– 100.000 activities detected and stored

– 18.000 knowledge items created

Page 3: Utilizing Semantics in the Production of iTV Shows (ESWC 2009)

02 June 2009 3(c) LIVE Consortium, 2009 (www.ist-live.org)

Scientific and Technological Challenges

• Development of an intelligent content model

– Understanding of the LIVE domain (broadcasting, events, staging,

sports, …)

– Research on knowledge and

information requirements of the

LIVE staging process.

– Foundational grounding for

interactions between content

and knowledge

• Development of an intelligent media framework

– Understand standards of the domains (MPEG-7, NewsML, IPTC, …)

– Information integration for internal and external information sources

– Storage of and access to intelligent content objects

– Support the real-time character of the LIVE staging environment

ContentAnnotation

Subject Matter

Annotation

Information

Item

Content Item

Propositional

Description

ProfessionalUser

conceives

expresses

interprets

Content Description

about

realises

Classification

Structured

Classification

EventSituation

Staging

Situation

subclass of

• NewsML

• MPEG 7

Intelligent

Media Assetcontains

contains

Page 4: Utilizing Semantics in the Production of iTV Shows (ESWC 2009)

02 June 2009 4(c) LIVE Consortium, 2009 (www.ist-live.org)

The Knowledge Model

Activity modelPart of the event domain model

Term modelExtension of SKOS

Event

Activity

sequenced by

performs

attitudetowards

plays

proper part

participate

Role Task

Social-Individual

acts for

setting for

sequenced by

Course

EventSetting

Design

satisfies

Individual

AgentAgent

acted by

GroupGroup

subclass of

member of

Event domain modelBased on the participation and the agent-activity pattern

Intelligent content model (media assets)Based on the information object design pattern

Page 5: Utilizing Semantics in the Production of iTV Shows (ESWC 2009)

02 June 2009 5(c) LIVE Consortium, 2009 (www.ist-live.org)

Human annotation toolRecommender tool Feedback analysis tool

The LIVE Production Support Toolset

Staging consoleLIVE production support system

Page 6: Utilizing Semantics in the Production of iTV Shows (ESWC 2009)

02 June 2009 6(c) LIVE Consortium, 2009 (www.ist-live.org)

LIVE Staging of Media Events

See you soonin the demo session!

Follow us into the era of semantically enhanced interactive TV production.

Page 7: Utilizing Semantics in the Production of iTV Shows (ESWC 2009)

02 June 2009 7(c) LIVE Consortium, 2009 (www.ist-live.org)

Contact

• Further information

– Web site: www.ist-live.org (see D7.4 for a reference to the IMF)

– Showcase website (soon): www.ist-live.org/showcase

[email protected]

• Presenters:

– Georg Gü[email protected]

– Dietmar [email protected]

– Rupert [email protected]

Salzburg ResearchJakob Haringer Strasse 5/3A-5020 SalzburgAustriawww.salzburgresearch.at