Download - Utilizing Semantics in the Production of iTV Shows (ESWC 2009)

Transcript
Page 1: Utilizing Semantics in the Production of iTV Shows (ESWC 2009)

Utilizing Semantics in the Production of iTV Shows

European Semantic Web Conference (ESWC 2009)

Demonstration paper

Georg Güntner, Dietmar Glachs, Rupert Westenthaler

Salzburg Research Forschungsgesellschaft m.b.H.

Date: 03/06/2009

Location: Hersonissos, Greece

Presenter: Georg Güntner

Page 2: Utilizing Semantics in the Production of iTV Shows (ESWC 2009)

02 June 2009 2(c) LIVE Consortium, 2009 (www.ist-live.org)

Ingredients of the Demo

• Starting point: Imagine a mass media event with

– 23.000 athletes

– 14.000 officials

– 6.500 events

– 1.100 teams

– 12 parallel video live feeds

– 200 archival clips

• The vision: The production of a– real-time

– non-linear

– interactive

– multi-channel (5 channels)

video show in broadcasting quality

• Implementation– Development of a real-time production

support system

– “Intelligent Media Framework” based on semantic concepts deals with

• aggregation

• storage

• propagation

• filtering

• visualisation

of contextual information

– Annotation, detection and extraction of “knowledge”

– Recommendation and personalisation

• Performance indicators (field trial)– 3 x 2 x 5 x 5h = 150h of material

– 110.000 action messages sent

– 18.000 terms in 65 vocabularies

– 100.000 activities detected and stored

– 18.000 knowledge items created

Page 3: Utilizing Semantics in the Production of iTV Shows (ESWC 2009)

02 June 2009 3(c) LIVE Consortium, 2009 (www.ist-live.org)

Scientific and Technological Challenges

• Development of an intelligent content model

– Understanding of the LIVE domain (broadcasting, events, staging,

sports, …)

– Research on knowledge and

information requirements of the

LIVE staging process.

– Foundational grounding for

interactions between content

and knowledge

• Development of an intelligent media framework

– Understand standards of the domains (MPEG-7, NewsML, IPTC, …)

– Information integration for internal and external information sources

– Storage of and access to intelligent content objects

– Support the real-time character of the LIVE staging environment

ContentAnnotation

Subject Matter

Annotation

Information

Item

Content Item

Propositional

Description

ProfessionalUser

conceives

expresses

interprets

Content Description

about

realises

Classification

Structured

Classification

EventSituation

Staging

Situation

subclass of

• NewsML

• MPEG 7

Intelligent

Media Assetcontains

contains

Page 4: Utilizing Semantics in the Production of iTV Shows (ESWC 2009)

02 June 2009 4(c) LIVE Consortium, 2009 (www.ist-live.org)

The Knowledge Model

Activity modelPart of the event domain model

Term modelExtension of SKOS

Event

Activity

sequenced by

performs

attitudetowards

plays

proper part

participate

Role Task

Social-Individual

acts for

setting for

sequenced by

Course

EventSetting

Design

satisfies

Individual

AgentAgent

acted by

GroupGroup

subclass of

member of

Event domain modelBased on the participation and the agent-activity pattern

Intelligent content model (media assets)Based on the information object design pattern

Page 5: Utilizing Semantics in the Production of iTV Shows (ESWC 2009)

02 June 2009 5(c) LIVE Consortium, 2009 (www.ist-live.org)

Human annotation toolRecommender tool Feedback analysis tool

The LIVE Production Support Toolset

Staging consoleLIVE production support system

Page 6: Utilizing Semantics in the Production of iTV Shows (ESWC 2009)

02 June 2009 6(c) LIVE Consortium, 2009 (www.ist-live.org)

LIVE Staging of Media Events

See you soonin the demo session!

Follow us into the era of semantically enhanced interactive TV production.

Page 7: Utilizing Semantics in the Production of iTV Shows (ESWC 2009)

02 June 2009 7(c) LIVE Consortium, 2009 (www.ist-live.org)

Contact

• Further information

– Web site: www.ist-live.org (see D7.4 for a reference to the IMF)

– Showcase website (soon): www.ist-live.org/showcase

[email protected]

• Presenters:

– Georg Gü[email protected]

– Dietmar [email protected]

– Rupert [email protected]

Salzburg ResearchJakob Haringer Strasse 5/3A-5020 SalzburgAustriawww.salzburgresearch.at