Semantic driven multimedia presentationslynda/talks/2002/smartstyle02.pdf · – Presentation more...

14
Semantic driven multimedia presentations prof. dr. Lynda Hardman CWI, TU/e Multimedia and Human-Computer Interaction

Transcript of Semantic driven multimedia presentationslynda/talks/2002/smartstyle02.pdf · – Presentation more...

Page 1: Semantic driven multimedia presentationslynda/talks/2002/smartstyle02.pdf · – Presentation more than a list of URL’ s • In the future – part of the Semantic Web • Application

Semantic drivenmultimedia presentations

prof. dr. Lynda HardmanCWI, TU/eMultimedia and Human-Computer Interaction

Page 2: Semantic driven multimedia presentationslynda/talks/2002/smartstyle02.pdf · – Presentation more than a list of URL’ s • In the future – part of the Semantic Web • Application

2

User-tailored Multimedia•Large amounts of multimedia information

stored in databases•Accessible via the Web

–Presentation more than a list of URL’s•In the future –part of the Semantic Web•Application areas

–Digital libraries–Cultural Heritage–Online training

Page 3: Semantic driven multimedia presentationslynda/talks/2002/smartstyle02.pdf · – Presentation more than a list of URL’ s • In the future – part of the Semantic Web • Application

3

One size doesn’t fit all

Page 4: Semantic driven multimedia presentationslynda/talks/2002/smartstyle02.pdf · – Presentation more than a list of URL’ s • In the future – part of the Semantic Web • Application

4

Media design is expensive

Need to tailor presentations, but there are• too many users, differing in

–language, abilities, level of expertise, task, ...

• too many devices–PC, PDA, mobile, voice-only, no audio, …–bandwidth and other QoS parameters

Page 5: Semantic driven multimedia presentationslynda/talks/2002/smartstyle02.pdf · – Presentation more than a list of URL’ s • In the future – part of the Semantic Web • Application

5

User Query MM

DB

MetadataDB

Cuypers Engine

Cuypers Engine

Page 6: Semantic driven multimedia presentationslynda/talks/2002/smartstyle02.pdf · – Presentation more than a list of URL’ s • In the future – part of the Semantic Web • Application

6

Demo

Page 7: Semantic driven multimedia presentationslynda/talks/2002/smartstyle02.pdf · – Presentation more than a list of URL’ s • In the future – part of the Semantic Web • Application

7

Rembrandt

Caravaggists

Presentation structure depends on content

Clair-obscur

16311628

1638

1623

1628

Page 8: Semantic driven multimedia presentationslynda/talks/2002/smartstyle02.pdf · – Presentation more than a list of URL’ s • In the future – part of the Semantic Web • Application

8

16311628 16381623 1628

Example Presentation Structure

Rembrandt

Clair-obscur

Caravaggists

Page 9: Semantic driven multimedia presentationslynda/talks/2002/smartstyle02.pdf · – Presentation more than a list of URL’ s • In the future – part of the Semantic Web • Application

9

Presentation Structure depends on Style

description

title

title

description

description examples

title

description examples

title

Page 10: Semantic driven multimedia presentationslynda/talks/2002/smartstyle02.pdf · – Presentation more than a list of URL’ s • In the future – part of the Semantic Web • Application

10

Style Depends on Content

Chiaroscuro & Rembrandt

The Stone Bridge (1638)

Chiaroscuro & Rembrandt

The Stone Bridge (1638)

Page 11: Semantic driven multimedia presentationslynda/talks/2002/smartstyle02.pdf · – Presentation more than a list of URL’ s • In the future – part of the Semantic Web • Application

11

Design dependencies

Content

Presentationstructure Style

abcdefghijk

abcdefghikabcdefghijkABCDEFGHIJKabcdefghijkabcdefghijk

Page 12: Semantic driven multimedia presentationslynda/talks/2002/smartstyle02.pdf · – Presentation more than a list of URL’ s • In the future – part of the Semantic Web • Application

12

User Query MM

DB

MetadataDB

Cuypers Knowledge Sources

DesignModel

Cuypers Engine

DiscourseModel

DomainModel

UserModel

DeviceProfile

?

?

?

Page 13: Semantic driven multimedia presentationslynda/talks/2002/smartstyle02.pdf · – Presentation more than a list of URL’ s • In the future – part of the Semantic Web • Application

13

Conclusions•Generating multimedia presentations requires

– making design dependencies explicit– taking these dependencies into account

•Semantic Web has the potential to– encode knowledge we use – reuse knowledge already available

•Cuypers system provides an experimentation platform

Page 14: Semantic driven multimedia presentationslynda/talks/2002/smartstyle02.pdf · – Presentation more than a list of URL’ s • In the future – part of the Semantic Web • Application

14

This research is supported by

•NWO I2RPIntelligent Information Retrieval and Presentation

•NWO CHIMECultural Heritage in an Interactive Multimedia Environment (start date Nov 2002)

•NWO NASHNetworked Adaptive Structured Hypermedia

• Images courtesy of