21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

Informatikdienste / IT-Services

REPLAY - Enhancing audiovisual recordings towards multimedia learning objectson a large scale

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

REPLAY - Enhancing audiovisual recordings towards multimedia learning objectson a large scale

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

Outline

• Status quo in lecture recording

• REPLAY – key features

• Future developments

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

Outline

• Status quo in lecture recording

• REPLAY – key features

• Future developments

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

Production: Content

• 12 lectures / week à 90 minutes 70%

• events (speeches, conferences etc.) 20%• promotional/informative films, misc. <5%• legacy, digitization (VHS, DVD, others) <5%

• > 500 objects in 2007

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

• audio & video (“classic”)• audio & content (“podcast”)

>80%• audio & video & content (“custom-made”)• audio (mp3, ogg)

Production: Formats

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

Production: Classroom setting

Webcam (Backup)

AMX (irrelevant)

Beamer

PlayMac

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

Production: PlayMac

power supply

audio levellerEpiphan

XLR

Mac mini

Géri Engler

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

Production: Signals

XLR audio

VGA out

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

Distribution: podcast.ethz.ch

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

Status quo: Shortcomings, limitations

• manual work• designed for podcast• no content-based access• no searchability• no standardization• no scalability• …

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

Solutions?

• Mediasite/SonicFoundry• Echo360 (Apreso Classroom/Anystream)• Lecturnity• PLAY (SWITCH)• Podcast Producer (Apple)• …

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

REPLAY: Overview

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

REPLAY: Workflow

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

REPLAY: Key features

• Providing access to the intellectual content of audiovisual material

• Freedom of choice in distribution formats and devices

• Possibility to access content many years from now

• Make audiovisual content learning objects

• Allow for academic citation of audiovisual content

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

REPLAY: Key technical features

• Scalability through distributed architecture

• Uses Java J2EE, mostly platform independent

• Plays well with external components, e. g. encoding engines

• Provides easily customizable workflows

• Employs standards (Dublin Core, MPEG-7, ...) wherever possible

• Adjusts to your needs through plugin architecture

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

REPLAY: Classroom

• Automated capture of VGA/ DVI- VESA modes- cross platform

• (Levelled) Audio • Automated camera tracking (DynaPel)

• No user interface• Scheduling via iCalender (rfc 2445)

• Non-contact recording

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

REPLAY: Classroom setting “PLAYMOBIL”

• GNU-/linux-based• Python• Unigraf capture

card• 4xvideo-in (Chipset

BT848)

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

REPLAY: User Interface

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

REPLAY: User Interface

Search

Static Metadata(Dublin Core)& Annotations

Timeline / isochronic

Search results(timeline-

based)

Player &Interactivecomponents

metadata (MPEG-7)

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

End-to-end solution

Automated production

Indexation

Archival

Searchability of objects

Interactive usage

Open

Scalable

Standardized Extensible

Platform-agnostic

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

Podcast Producer vs. REPLAY

Podcast Producer• production• encoding• publishing / distribution

• “archival” (H.264)

REPLAY• production• encoding• publishing / distribution

• long-term archival (H.264, DV)

• persistent identification (DOI)

• indexation• searchability

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

Podcast Producer vs. REPLAY

Podcast Producer• player

• proprietary

• Apple HW

REPLAY• user-interface

• open• standard-oriented

• Platform agnostic

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

REPLAY and e-learning

• Creation of teaching knowledge pool

• From TV-style consumption to interactive usage

• Personalized/customized learning experience• Collective enrichment (Wiki, Web 2.0)

• Turn audiovisual into learning object

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

REPLAY – the project

• REPLAY 0.3 released in April 2008

• REPLAY 1.0 will be operative at ETH by the end of 2008

• Lesser GNU General Public License (LGPL)

• replay.origo.ethz.ch (development platfform)

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

Further developments

• Integration of speech recognition• Isochronic tagging• Online editing• Ontology support• Accessibility

21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich

• www.replay.ethz.ch

• replay.origo.ethz.ch

• replay@id.ethz.ch