i3 - Recent iServer, iPaper and iGesture Developments

5 December 2007

i3 – Recent iServer, iPaper and iGesture Developments

Beat Signer

http://www.beatsigner.com

Institute for Information Systems

ETH Zurich

CH-8092 Zurich, Switzerland

http://www.beatsigner.com/

5 December 2007 Beat Signer / Institute for Information Systems / [email protected] 2

iServer Extensions and Modifications

RSL (resource-selector-link) model is the new

name for the underlying iServer model

Context Resolver

Layers

Structural Links


3

RSL Context Resolver


4

RSL Layers


5

RSL Structural Links


RSL Structural Links …

Structure over data

structural relationship of different resources

e.g. regular document (chapters, sections, ...)

possible to reuse the same resource in different

structures transclusion (Ted Nelson)

context-dependant structures based on context

resolver concept


RSL Structural Links …

Structure over structures

reuse of complete substructures

structural composition of data and substructures can

be combined

Structure over links

put different navigational links in relation to each other

e.g. single structural link to define linear order over

set of links trails and tours


8

Links

Users

Layers Plug-ins

Structure

Active

Content

5 December 2007 Beat Signer / Institute for Information Systems / [email protected]

RSL Metamodel

Beat Signer and Moira C. Norrie, As We May Link:

A General Metamodel for Hypermedia Systems,

In Proceedings of ER 2007, 26th International Conference on

Conceptual Modeling, Auckland, New Zealand, November 2007


10

Digital Link Authoring Tool


Digital Link Authoring Tool …

Extension of iServer authoring tool, Adriana

Integration of earlier student projects (e.g. active

component authoring tool)

Focus on the iPaper authoring plug-in but later

other plug-ins may be integrated


iPaper Templates

Links that occur on multiple pages (e.g. controls,

headers, footers) should not have to be repeated

Templates can be defined on document or

individual page level

Multiple templates can be combined (page and

document level)

PaperPoint currently uses a single template to

define the functionality available on all slides


iServer / iPaper Infrastructure

Resource plug-in management

Application management

Pattern space management, Monica Frisoni

I/O pen connector (Bluetooth), Claudio Hatz

...

13


PaperPoint v0.5

New design / functionality

colours, pointer types, …

Single step printing

process

User studies, Elke

interviews

lab sessions

long term usage


PaperPoint v0.5

Beat Signer and Moira C. Norrie, PaperPoint: A Paper-Based

Presentation and Interactive Paper Prototyping Tool, In

Proceedings of TEI 2007, First International Conference on

Tangible and Embedded Interaction, Baton Rouge, USA,

February 2007


Interactive Table (iTable)

Pen-Based Google Earth Browser Pen-Based Drawing Tool

Photo Browser Photo Browser (Slider)


Interactive Table (iTable) …


Interactive Table (iTable) …

Extension of iTable interface, Matthias Geel

calibration of beamer and input area

general desktop control active components

Applications

Pen-based Google Earth Explorer

Pen-based Drawing Tool

Photo Browser

…


19

19

Rough Guide


Query by Sketching (QbS)

Pen-based sketching

interface

University of Basel

GlobIS group

Michael Springmann, Adriana Ispas, Heiko Schuldt, Moira

C. Norrie and Beat Signer, Towards Query by Sketch,

Second DELOS Conference on Digital Libraries, Pisa, Italy,

December 2007

Start date: October 2007 (2 year project), Adriana


PaperWeb

Automatic authoring of

active areas

all hyperlinks become

interactive on the

printout version

21


Remote Sketching on Paper

Integration of Skype and

paper-based remote

sketching, Hermann

Hofstetter

HCI group University of

Konstanz, H. Reiterer

GlobIS group


Powerwall, Konstanz

Facts

5.20 m x 2.5 m

8 beamers

4640 x 1920 pixels

soft-edge-blending

Visualisation of large data sets

Input devices

3D tracker, laser "pen", mouse

iPaper as a new input device?


Wellness Game Project, Shanghai

Science, Technology &

Culture Festival, May 2008

Projects

Thai Chi, Native Systems Group,

Dennis Majoe

China Gates, Native Systems

Group, Art Clay

Real Time Panorama, Native

Systems Group, Jürg Gutknecht

iPaper Project, GlobIS Group,

Moira C. Norrie


Multi Digital, LZ Medien


26

26

PaperProof

Planned user studies,

Nadir & Elke

Definition of new gestures

for edit commands?

Nadir Weibel, Adriana Ispas, Beat Signer and Moira C. Norrie,

PaperProof: A Paper-Digital Proof-Editing System,

Proceedings of CHI 2008, 26th International Conference on

Human Factors in Computing Systems (Interactivity Track),

Florence, Italy, April 2008


iGesture Framework

http://www.igesture.org

Open Source (Apache 2.0)

initial release February 2007

1682 downloads

Presented at ICDAR 2007

FKI Group, University of Berne

DFKI, Germany

Computer Vision Center,

Barcelona


iGesture Framework …

New input handler for graphics tablets and

Tablet PCs, Michele Croci

Beat Signer, Ueli Kurmann and Moira C. Norrie, iGesture:

A General Gesture Recognition Framework, Proceedings of

ICDAR 2007, 9th International Conference on Document

Analysis and Recognition, Curitiba, Brazil, September 2007

Beat Signer, Moira C. Norrie and Ueli Kurmann, iGesture:

A Java Framework for the Development and Deployment of

Stroke-Based Online Gesture Recognition Algorithms,

Technical Report ETH Zurich, TR561, September 2007


Geco (Gesture Control)

Mapping of gestures

(iGesture gesture sets),

Michele Croci

hotkeys

command line calls

…

Initial release (freeware)

planned within next month


Department Events

Maturandentage 2008

January 8/9

PaperProof and PaperPoint

Jahr der Informatik

visit different locations

PaperPoint as presentation tool?


iServer

layer

|Layers|

layer

Active

Layers

resource

Containers

activeComponent

Active Com-

ponents

medium

Media

medium

Movies

medium

Images

medium

Webpages

OnLayer

Contains

(1,1)

(1,1) (0,*) (0,*)

document

Documents (0,*)

shape

Shapes

partition (2,*)

(0,*)

rectangle

Rectangles

ellipse

Ellipses

polygon

Polygons

circle

Circles

complexShape

Complex

Shapes

HasShapes

page

Pages OnPage

Contains

Pages

(0,*)

(1,1)

(1,1)

(0,*)

Resources

parameter

Preferences

link

Links

user

Users

group

Groups

individual

Individuals

HasMembers

HasTarget

(0,*)

(0,*) (0,*)

(0,*)

(0,*)

(0,*) (0,*)

(1,*)

(0,*)

(0,*)

(1,1)

(0,*)

partition partition

(1,*)

CreatedBy

RefersTo

Has

Preferences

parameter

Properties

selector

Selectors

resource

Resources

HasSource

(0,*)

AccessibleTo

InaccessibleTo

(0,*)

(0,*)

entity

Entities HasProperties

Users

Plug-ins

Links

(0,*)

Layers

iPAPER

iSERVER

i3 - Recent iServer, iPaper and iGesture Developments

Technology

Transcript of i3 - Recent iServer, iPaper and iGesture Developments