Virtual Cockpit:

Terbu AlexanderInstitute for Computer Graphics and

VisionGraz University of Technology

An AlternativeAugmented Reality User

Interface

Graz University of TechnologyAlexander

Terbu

Virtual Cockpit

ContextMotivationOur ApproachIntegrationComponentsConceptsPrototypeEvaluationConclusionFuture Work

Motivation - why we did it

Approach - ideas & realisation

Prototype - screenshots

Future Work - ?

Graz University of TechnologyAlexander

Terbu

Virtual Cockpit

ContextMotivationOur ApproachIntegrationComponentsConceptsPrototypeEvaluationConclusionFuture Work

Panels (PIP) - physical strain & limited in size

Navigation - hard in complex menus

Widget - still mainly 2.5D

Selection - tracker calibration dependent

Graz University of TechnologyAlexander

Terbu

Virtual Cockpit

ContextMotivationOur ApproachIntegrationComponentsConceptsPrototypeEvaluationConclusionFuture Work

Device - pencil (PEN)

Interface - primary viewing plane aligned

Widget - 3D sphere with any content

Navigation - hierarchical structure

Selection - auto-enlargable elements

Graz University of TechnologyAlexander

Terbu

Virtual Cockpit

ContextMotivationOur ApproachIntegrationComponentsConceptsPrototypeEvaluationConclusionFuture Work

user level

Studierstubekernel level

system level

app1 app3

V irtualC ockpit

Co

nte

xt m

an

ag

am

en

t

w idgets

runtim e

DI V Open I nventor

netw orkhardw are

graphicshardw are

StbAPI

app2

Graz University of TechnologyAlexander

Terbu

Virtual Cockpit

ContextMotivationOur ApproachIntegrationComponentsConceptsPrototypeEvaluationConclusionFuture Work

status are a

sav eload

liv e rm ain

ana-ly ze

one hie rarchiele v e l up m inim ize to

taskbarm ax im ize

&ce nte r

close

quickstartw idge t

taskbar

m e nubarsubpane l

zoom e d v ie w

re al v ie w

snap-shot

"pin" at curre ntposition

Graz University of TechnologyAlexander

Terbu

Virtual Cockpit

ContextMotivationOur ApproachIntegrationComponentsConceptsPrototypeEvaluationConclusionFuture Work

M AINPANEL

SUBPANEL

W IDGET

W IDGET

SUBPANEL

W IDGET

W IDGET

Graz University of TechnologyAlexander

Terbu

Virtual Cockpit

ContextMotivationOur ApproachIntegrationComponentsConceptsPrototypeEvaluationConclusionFuture Work

Graz University of TechnologyAlexander

Terbu

Virtual Cockpit

ContextMotivationOur ApproachIntegrationComponentsConceptsPrototypeEvaluationConclusionFuture Work

livermain

ana-lyze

snap-shots

modify

Graz University of TechnologyAlexander

Terbu

Virtual Cockpit

ContextMotivationOur ApproachIntegrationComponentsConceptsPrototypeEvaluationConclusionFuture Work

sav eload

liv e rm ain

ana-ly ze

subpane l

zoom e d v ie w

re al v ie w

snap-shot

status area(sh ow s at least cu rren t Su bPan els menu title)

Graz University of TechnologyAlexander

Terbu

Virtual Cockpit

ContextMotivationOur ApproachIntegrationComponentsConceptsPrototypeEvaluationConclusionFuture Work

(Auto-)enlargable SubPanels

Graz University of TechnologyAlexander

Terbu

Virtual Cockpit

ContextMotivationOur ApproachIntegrationComponentsConceptsPrototypeEvaluationConclusionFuture Work

Hierarchical menu structure

Graz University of TechnologyAlexander

Terbu

Virtual Cockpit

ContextMotivationOur ApproachIntegrationComponentsConceptsPrototypeEvaluationConclusionFuture Work

„Silk panel“ for enhanced depth cue

Graz University of TechnologyAlexander

Terbu

Virtual Cockpit

ContextMotivationOur ApproachIntegrationComponentsConceptsPrototypeEvaluationConclusionFuture Work

Graz University of TechnologyAlexander

Terbu

Virtual Cockpit

ContextMotivationOur ApproachIntegrationComponentsConceptsPrototypeEvaluationConclusionFuture Work

Test Setup - select one of 6 main / 6 sub colors

Subjects - 18 in total, mostly from TU Graz

Method I - „think aloud test“ with cam

Method II - written questionary

Method III - time measures for tasks

Graz University of TechnologyAlexander

Terbu

Virtual Cockpit

ContextMotivationOur ApproachIntegrationComponentsConceptsPrototypeEvaluationConclusionFuture Work

Plot of timings, grouped by tasks and UI‘s

Graz University of TechnologyAlexander

Terbu

Virtual Cockpit

ContextMotivationOur ApproachIntegrationComponentsConceptsPrototypeEvaluationConclusionFuture Work

Acceptance ratings for PIP/PEN, VC and pencil

Graz University of TechnologyAlexander

Terbu

Virtual Cockpit

ContextMotivationOur ApproachIntegrationComponentsConceptsPrototypeEvaluationConclusionFuture Work

Efficient for complex layouts

Fast and intuitive navigation

Easy selection

Reduced tracker calibration dependency

Interaction possible even with very small PIP

Graz University of TechnologyAlexander

Terbu

Virtual Cockpit

ContextMotivationOur ApproachIntegrationComponentsConceptsPrototypeEvaluationConclusionFuture Work

Map some more 2D widget behavior (Cooperation with FH Joanneum)

Improve on VC positioning possibilities

Indroduce animation for navigation and selection

Further evaluation

Extend PEN with scroll wheel

Graz University of TechnologyAlexander

Terbu

Virtual Cockpit: An Alternative Augmented Reality User Interface

Zzzzzzzzzzzz ?