Structured Media for Media Integration & Document Authoring

Tien TRAN_THUONG and Cécile ROISIN

Project OPERA - INRIA

Grenoble - France

Work Context and Objective

Structured media

Multimedia Document: Set of basic media: audio, video, text, image, HTML, etc. Multimedia document model: the way to integrate a set of basic

media in time, space and hypermedia Madeus language Authoring & presentation system for multimedia documents

Madeus editor

Objective: semantic media fragment integration and authoring more complex and efficient documents

Current media fragment integration Anchor and Area elements

Decompose media into spatial/temporal segments for hypermedia and fine-grained synchronizations (CMIF, HyTime, SMIL)

Ex: Area in SMIL2.0<video src="http://www.inrialpes.fr/operaVideo">  

<area id="Madeus"

begin= "5s" end= "7s"

coords= "84, 249, 188, 272"

href ="Madeus-Editor.html" />

</video>

Active area

absolute specification,

no structure and

lack of signification

The fragment attribute of the Area element provides naming facilities for external structured media<area fragment="Madeus-frag" 

href="Madeus-Editor.html" />

Structured media

Atomic media is a media node in a document that refers to a media content

Structured media is a media node in a document that refers to a media content and includes or refers to a structure description of that media content

Multimedia content description

DCMES: Dublin Core Metadata Element Set RDF: Resource Description Framework Mpeg7: Multimedia Content Description Interface

Need a multimedia content description model for composing multimedia document

Experimentation in Madeus

Structured video: sequence, scene, shot, videoEvent, videoObject, etc.

Structured audio: speech, music, sound, audioEvent, audioObject, etc.

Structured free text: word, phrase, sentence, paragraph, etc.

Media structure description

Temporal/spatial synchronization of video/audio fragment with other media or media fragments

Hyperlink/tracking/erasing action on video objects

Hyperlink/highlight action on text fragments

Media fragment integrationAllows

Authoring multimedia documents

Video

Media integration

Image

Audio

Free text

Media content

Multimedia document

Media is directly used atomic media Media description process before used

structured media

Analysis & Generation

Authoring media content

description

Media content model

Media content described by

standards (Mpeg7)

Conclusion and Perspectives

An authoring tool for complex multimedia presentations

Export to presentation-oriented formats Fragments authoring for media (Image, Audio,

Free text) Import of multimedia content description

standards (Mpeg7) Need for media analysers to be integrated in my

tool