![Imaginary Phone: Learning Imaginary Interfaces by ... · other sensing options, such as gloves [11], Skinput [6] or depth cameras. We chose to use a time-of-flight depth camera, because](https://static.fdocuments.in/doc/165x107/5f94facc3c97923de722efb9/imaginary-phone-learning-imaginary-interfaces-by-other-sensing-options-such.jpg)
imaginary phone— learning by transfer
55
imaginary phone— learning by transfer sean gustafson christian holz patrick baudisch
description
imaginary phone— learning by transfer. s ean g ustafson c hristian h olz patrick b audisch. or projector. to achieve ultimate mobility: sacrifice screen limited to gesture-based interaction. gesture pendant [ISWC’00]. - PowerPoint PPT Presentation
Transcript of imaginary phone— learning by transfer
imaginary phone—learning by transfer
sean gustafsonchristian holz
patrick baudisch
or projector
gesture pendant[ISWC’00]
to achieve ultimate mobility: sacrifice screen limited to gesture-based interaction
but spatial interaction (pointing) is the interaction style of current devices.
bring spatial interaction back, despite non-visual
imaginary interfaces= “touch screen without the screen”
?but the big problem is learning
imaginary phone
for this to work…
1. users repeatedly perform a task usinga physical device
transfer learning
transfer learning
2. this builds up spatial memory, eventuallyallows performing the task without phone
to make this work, we make imaginary phonemimics the layout of the physical phone
1. imaginary phone prototype
2. does transfer learning work?
prototype
what we used
our new camera
TUIO over WiFi
does transfer learning work?
main hypothesis:
through repeated use of a physical deviceusers learn how to operate the imaginary counterpart
learn map target
with repeated use of physical phone, users build up spatial memory
spatialmemory maps to the hand
on the hand users target accurately
1) users build up spatial memory?
learn map target
“Do you have an iPhone?(and do you like chocolate?)”
experimenter
participant
%
Daily Weekly Rarely
71% 67%65%
resultsresults
percentage ofcorrectly placed apps
apps used
2) does spatial memorymap to the hand?
learn map target✔
there was a second condition
select on handselect on phone prop
%%
results
percentage ofcorrectly placed apps
%%
results
percentage ofcorrectly placed apps
3) on the hand, users target accurately?
learn map target✔ ✔
select on palm
select in empty space select on palm
50% more
accurate
learn map target✔ ✔ ✔
if users know 70% of functions…do we need to train them to 100%?
no, actually knowledge of a single function gets you started
conclusion
1996 2007 imaginary
:= a shortcut for mobile device
Image of phone left on counter as your walks out the door.
next goal: leave your phone at home
imaginary phone—learning by transfer
sean gustafsonchristian holz
patrick baudisch
![Imaginary Phone: Learning Imaginary Interfaces by ... · Imaginary Phone: Learning Imaginary Interfaces by ... Our depth camera is a PMD[vision] CamCube that provides frames at 40Hz](https://static.fdocuments.in/doc/165x107/5ae222be7f8b9a097a8c8939/imaginary-phone-learning-imaginary-interfaces-by-phone-learning-imaginary.jpg)
