A Nose Gesture Interface Device: Extending Virtual Realities
description
Transcript of A Nose Gesture Interface Device: Extending Virtual Realities
![Page 1: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/1.jpg)
A Nose Gesture Interface Device: Extending Virtual Realities
![Page 2: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/2.jpg)
2
Saved the most important for last
“A Nose Gesture Interface Device: Extending Virtual Realities”
Tyson R. Henry, Scott E. Hudson, Andrey K. Yeatts, Brad A. Myers, and Steven Feiner, Proceedings of UIST ‘91, November 11 - 13, 1991, Hilton Head, NC, pp. 65-68
http://www.acm.org/pubs/citations/proceedings/uist/120782/p65-henry/
![Page 3: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/3.jpg)
3
Some of the most important VR work ever published Had its own special session at
UIST ‘91 Reprinted in Presence (the main
VR journal), April 1992.
Will recreate the presentation here
![Page 4: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/4.jpg)
A Nose Gesture Interface Device: Extending Virtual RealitiesTyson Henry* University of New MexicoScott Hudson* Carnegie MellonAndrey Yeatts University of ArizonaBrad Myers Carnegie MellonSteven Feiner Columbia University
*at the University of Arizona in 1991
![Page 5: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/5.jpg)
5
Motivation
Current virtual reality systems are just too limited
Goal: improved sense of presenceExtensions to other
sensesFull body interaction
![Page 6: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/6.jpg)
6
Rhino-Virtual Realities
The potential of the nose has been sorely neglected in previous systems
To remedy this we have developed ...
![Page 7: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/7.jpg)
7
The DATANOSE™
![Page 8: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/8.jpg)
8
Offers Support for True Multi-Modal Interaction
Works with conventional graphical interfaces...
![Page 9: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/9.jpg)
9
![Page 10: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/10.jpg)
10
A New Suction Based Dragging Technique: “Hoovering”
![Page 11: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/11.jpg)
11
Also works with older (text based) interface styles...
![Page 12: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/12.jpg)
12
![Page 13: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/13.jpg)
13
Hardware Design
The Early Prototypes…
![Page 14: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/14.jpg)
14
First Prototype
Fully functional– Exceeded all specs
But unexpectedly did not gain user acceptance
![Page 15: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/15.jpg)
15
Design iteration
Next prototypes miniaturized the olfactory output system and explored new commercially appealing packaging...
![Page 16: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/16.jpg)
16
Rabbit Nose Platform
Worked better, but whiskers interfered with interaction
![Page 17: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/17.jpg)
17
Next Iteration
Didn’t work very well...
![Page 18: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/18.jpg)
18
Pig Nose Platform
Issues with users squealing
![Page 19: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/19.jpg)
19
Dog Nose Platform
Drooling problems...
![Page 20: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/20.jpg)
20
This one didn’t work at all
Subjects had an inexplicable urge to tell bad puns
![Page 21: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/21.jpg)
21
After a few small modifications it worked better
But pun problem persisted
![Page 22: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/22.jpg)
22
The final prototype...
![Page 23: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/23.jpg)
23
Groucho Marx Nose Platform
![Page 24: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/24.jpg)
24
DATANOSE™ Features
Full featured miniature olfactory I/O system
Fully mobile operation
![Page 25: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/25.jpg)
25
Works in the lab...
![Page 26: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/26.jpg)
26
Down the hall...
![Page 27: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/27.jpg)
27
To places mobile computing has never gone before...
![Page 28: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/28.jpg)
28
Advanced Interaction Techniques
3D Rotation Task– True User-Centered Rotation
![Page 29: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/29.jpg)
29
![Page 30: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/30.jpg)
30
![Page 31: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/31.jpg)
31
![Page 32: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/32.jpg)
32
![Page 33: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/33.jpg)
33
![Page 34: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/34.jpg)
34
Interacting with Multiple Devices
The DATANOSE™ works smoothly with conventional I/O devices...
![Page 35: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/35.jpg)
35
Keyboard
![Page 36: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/36.jpg)
36
Mouse
![Page 37: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/37.jpg)
37
Valuators (Knobs)
![Page 38: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/38.jpg)
38
Also has great potential in computer supported cooperative work applications...
![Page 39: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/39.jpg)
39
![Page 40: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/40.jpg)
40
Finally, can support fluid interaction with large data sets...
![Page 41: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/41.jpg)
41
![Page 42: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/42.jpg)
42
Applications:An Example Virtual World
Searched for an appropriate application domain...
![Page 43: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/43.jpg)
43
Applications:An Example Virtual World
Implemented: Dog’s World–A user’s view
![Page 44: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/44.jpg)
44
![Page 45: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/45.jpg)
45
![Page 46: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/46.jpg)
46
![Page 47: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/47.jpg)
47
CSCW Extensions:
The Collaborative Dog’s World...
![Page 48: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/48.jpg)
48
![Page 49: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/49.jpg)
49
A New Toolkit
To avoid the high cost of developing rhino-interfaces, a new toolkit was developed
SYSTEM– An acronym standing for...
![Page 50: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/50.jpg)
50
A New Toolkit
To avoid the high cost of developing rhino-interfaces, a new toolkit was developed
SYSTEM– a System that reallY doeS creaTE
user interfaces that have really nice featuMs
![Page 51: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/51.jpg)
51
Uses The Seeheim Model
A major advance in itself
![Page 52: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/52.jpg)
52
More Important ...
We have been able to answer the most important research question about the model...
![Page 53: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/53.jpg)
53
Uses The Seeheim Model
What is that little box at the bottom!?!
![Page 54: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/54.jpg)
54
Important Discovery
The Seeheim model works much better if you put everything in the little box
An improved model...
![Page 55: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/55.jpg)
55
Improved Model
![Page 56: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/56.jpg)
56
The Final SMELL-HEIM Model
![Page 57: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/57.jpg)
57
Another Major Advance
A completely new approach to dialog management– Did an extensive literature search
Never been done before– Will revolutionize UI software work
![Page 58: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/58.jpg)
58
Another Major Advance
A completely new approach to dialog management– Did an extensive literature search
Never been done before– Will revolutionize UI software work
Finite State Machine Controllers!
![Page 59: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/59.jpg)
59
SYSTEM supports easy to use graphical editor for FSM controllers
![Page 60: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/60.jpg)
60
SYSTEM supports easy to use graphical editor for FSM controllers
![Page 61: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/61.jpg)
61
Usability Testing
Significant new testing after the paper was submitted
![Page 62: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/62.jpg)
62
User Testing Results
Really Really Liked ItReally Liked ItSort of Liked It
Hated ItSubject #1 Subject #2
![Page 63: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/63.jpg)
63
User Testing Results
Both users really really liked it!
Really Really Liked ItReally Liked ItSort of Liked It
Hated ItSubject #1 Subject #2
![Page 64: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/64.jpg)
64
Future Work
Extending to other body parts
– DATA ARM™
– DATA EYEBALLS™
![Page 65: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/65.jpg)
65
![Page 66: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/66.jpg)
66
Future Work (cont.)
Extending to other body parts
– DATA FOOT™– DATA MOUTH™
Warning: Our research shows that these devices should not be used together!
![Page 67: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/67.jpg)
67
Conclusion
Overall a dramatic breakthrough in virtual
research
![Page 68: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/68.jpg)
Questions?
![Page 69: A Nose Gesture Interface Device: Extending Virtual Realities](https://reader035.fdocuments.in/reader035/viewer/2022062309/56814889550346895db59e40/html5/thumbnails/69.jpg)
69