Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

32
31 March 2008 Integrating Paper and Digital Information Spaces The iServer / iPaper Solution Beat Signer Global Information Systems Group ETH Zurich http://vub.academia.edu/BeatSigner

description

Presentation given at DFKI research seminar, German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, Germany, March 2008

Transcript of Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

Page 1: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008

Integrating Paper and Digital Information Spaces

The iServer / iPaper Solution

Beat Signer

Global Information Systems Group

ETH Zurich

http://vub.academia.edu/BeatSigner

Page 2: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

Paper in Everyday Settings

Page 3: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

Input Devices

Page 4: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar44

Digital Pen and Paper

Developed by Anoto

Different pen manufacturers

Logitech, Maxel, Nokia,

Adapx, Livescribe ...

Pattern space

60 million km2

Page 5: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

Interactive Paper

Linking active areas to resources

image

video clip

Page 6: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

iPaper @ ETH Zurich

Cross-Media

Link Infrastructure

Tools

Publishing

Applications

Page 7: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

Interactive Paper Applications

Enhanced Reading

interactive paper maps

interactive festival brochures

educational materials

auction brochures

scientific publications

Enhanced Writing

proof-editing system

photo album

researcher's notebook

mammography

search system

Paper-Based Interfaces

PaperPoint

image retrieval / digital libraries

video analysis tool

educational games

Artists' Installations

Lost Cosmonaut

Generosa Enterprise

Interactive TableTops

http://www.globis.ethz.ch/research/paper/applications/

Page 8: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

PaperPoint Presentation Tool

Mobile presentation tool

Non-linear presentations

Paper-based real-time

annotations

Digital whiteboard

Multi-pen support

brainstorming

Page 9: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

EdFest Project

Page 10: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

EdFest Demo

Page 11: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

EdFest Architecture Overview

XCMcontent publishing

platform

iServer/iPapercross-media

link server

Context

Engine

Client

Controller

Active

Components

Text-to-Speech

EngineICR Software

handwriting

recognition

Metadata DB Appln DB

Link DB

Context DB

iPaper Client

Page 12: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

Content Publishing Framework

XCMcontent publishing

XML data of

festival venues

and events

iServer / iPapercross-media link server

• paper link data

• active areas

• layers

• digital resources

• user model

import

publish

PDF

XML link

definition

data

iPublishpublishing framework

Structure Style

XSL CSS

Page 13: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

Design of Interactive Paper Documents

Page 14: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

Rough Guide

Page 15: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

PaperProof

Page 16: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

Paper-Digital Structural Mapping

Dual document representation in digital and

physical document spaces

Page 17: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

Print-n-Link

Citations build the basis

for a scientific web of

publications

Use digital services to

search / retrieve cited

publications

Automatic authoring

Page 18: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

Other iPaper Applications …

PaperWeb Natural History Museum

Lost Cosmonaut (Axel Vogelsang) iTable (Google Earth)

Page 19: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

Different Types of Link Authoring

Manual authoring of links

Content publishing framework for Interactive Paper

EdFest brochure – PDF and links generated from

publishing database

Automatic authoring of links based on document

analysis (PDF)

Print-n-Link system for scientific publications

Collaborative authoring based on P2P link sharing

Page 20: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

Digital Link Authoring Tool

Page 21: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

iPaper Architecture

Page 22: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

RSL Metamodel and Resource Plug-ins

iPaper

Shape Page

Application Database

DB ObjectData/Metadata

Query

Movie Clips

Time Span /

Spatial InfoMovie Clip

HTML Documents

XPointer XHTML

Document

Selectors

Entities

Resources

link

Page 23: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

Links

Users

LayersPlug-ins

Structure

Active

Content

Page 24: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

RSL Links

Page 25: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

RSL Structural Links

Page 26: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

RSL Structural Links …

Structure over data

e.g. regular document (chapters, sections, ...)

reuse of resources transclusion (Ted Nelson)

context-dependant structures

Structure over structures

structural composition of data and substructures can

be combined

Page 27: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

RSL Structural Links …

Structure over links

put different navigational links in relation to each other

e.g. single structural link to define linear order over

set of links trails and tours

Page 28: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

Active Content

Execute code (services) on the client and server side

Active Component

A

Active Component

B

Active Component

C

iS

erv

er

AC Manager

Server

R

eq

ue

st S

en

de

rActive Component

Stub B

AC Names

ACS Manager

C

lien

t D

evic

e

AC Names

Client

HT

TP

Page 29: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

Active Components

Button

Slider

Slider2D

DateSelector

Browser

MapSelector

Rating

Capture

CaptureAndSpeak

Image

Sound

Movie

SQLClient

XCMRequest

ClientCtrlRequest

PaperPointControl

PaperPointAnnot

...

Page 30: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

iServer Interfaces

Java API

XML import and export

Web Service

Interface based on XML and XSLT

XHTML

WAP, i-mode

VoiceXML

Page 31: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

Conclusions

General framework for interactive paper

Cross-media information server

extensibility (resource plug-ins)

link service acessible through various APIs

active content

Novel forms of interactive paper publishing and

paper-based user interfaces

Page 32: Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

31 March 2008 Beat Signer <[email protected]> / ETH Zurich DFKI Seminar

References

iPaper webpage

http://www.ipaper.inf.ethz.ch

YouTube videos

http://www.youtube.com/user/ethglobis

Fundamental Concepts for Interactive Paper and

Cross-Media Information Spaces, B. Signer,

Dissertation ETH Zurich Nr. 16218, 2006