Input and Interaction - Stanford HCI...
-
Upload
duongxuyen -
Category
Documents
-
view
237 -
download
0
Transcript of Input and Interaction - Stanford HCI...
![Page 1: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/1.jpg)
Input andInteraction
michael bernsteinspring 2013cs376.stanford.edu
![Page 2: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/2.jpg)
2
Recall: Skinput
![Page 3: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/3.jpg)
3
Recall: Omnitouch
![Page 4: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/4.jpg)
4
Recall: SenseCam
![Page 5: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/5.jpg)
Input and interaction research
� How can the user interact fluidly with the world around them?� New input modalities: e.g., depth cameras� New output modalities: e.g., pico projectors� New user vocabulary: e.g., gestures
� This research is often driven by, or involves the creation of, new hardware
5
![Page 6: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/6.jpg)
6
Bolt. “Put-that-there”: Voice and gesture at the graphics interface. SIGGRAPH ’80.
![Page 7: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/7.jpg)
Put That There
� Contribution: combined gesture and voice input
7
![Page 8: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/8.jpg)
Put That There
� Contribution: combined gesture and voice input� In a closed world
7
![Page 9: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/9.jpg)
Put That There
� Contribution: combined gesture and voice input� In a closed world� With a toy goal
7
![Page 10: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/10.jpg)
Put That There
� Contribution: combined gesture and voice input� In a closed world� With a toy goal� Using simple manipulation operations
7
![Page 11: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/11.jpg)
Put That There
� Contribution: combined gesture and voice input� In a closed world� With a toy goal� Using simple manipulation operations� Using a laser attached to the wrist
7
![Page 12: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/12.jpg)
Put That There
� Contribution: combined gesture and voice input� In a closed world� With a toy goal� Using simple manipulation operations� Using a laser attached to the wrist
� In many ways, our goal since 1980 has been to relax those assumptions
7
![Page 13: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/13.jpg)
8
Wellner. Interacting with paper on the DigitalDesk. CACM ’93.
![Page 14: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/14.jpg)
8
Wellner. Interacting with paper on the DigitalDesk. CACM ’93.
![Page 15: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/15.jpg)
DigitalDesk
� Contribution: fluid boundaries between digital and physical objects
9
![Page 16: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/16.jpg)
DigitalDesk
� Contribution: fluid boundaries between digital and physical objects� In a constrained space
9
![Page 17: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/17.jpg)
DigitalDesk
� Contribution: fluid boundaries between digital and physical objects� In a constrained space� On a small set of tasks
9
![Page 18: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/18.jpg)
DigitalDesk
� Contribution: fluid boundaries between digital and physical objects� In a constrained space� On a small set of tasks� With predefined behaviors
9
![Page 19: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/19.jpg)
DigitalDesk
� Contribution: fluid boundaries between digital and physical objects� In a constrained space� On a small set of tasks� With predefined behaviors
� Again, we work to relax these assumptions
9
![Page 20: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/20.jpg)
Input technologies
10
![Page 21: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/21.jpg)
11
Dietz and Leigh. DiamondTouch: a multi-user touch technology. UIST ’01.
Tabletop
![Page 22: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/22.jpg)
12
Han. Low-cost multi-touch sensing through frustrated total internal reflection. UIST ’05.
Tabletop
![Page 23: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/23.jpg)
13Hinckley et al. Pen + touch = new tools. UIST ’10.
Pen
![Page 24: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/24.jpg)
14Izadi et al. KinectFusion. SIGGRAPH ’11.
Depth sensing
![Page 25: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/25.jpg)
Sensing biosignals
15
Saponas et al. Enabling Always-Available Input with Muscle-Computer Interfaces. UIST ‘09.
![Page 26: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/26.jpg)
Machine learning model for muscle interfaces et al.
16
30 millisecond sample
x6 Sensors
![Page 27: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/27.jpg)
Machine learning model for muscle interfaces et al.
16
30 millisecond sample
Root Mean Square (RMS) ratios between channels
Frequency Energy10 Hz bands
Phase Coherence ratios between channels
x6 Sensors
Features
![Page 28: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/28.jpg)
Machine learning model for muscle interfaces et al.
16
30 millisecond sample
Root Mean Square (RMS) ratios between channels
Frequency Energy10 Hz bands
Phase Coherence ratios between channels
x6 Sensors
Features
Support VectorMachine
![Page 29: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/29.jpg)
Machine learning model for muscle interfaces et al.
16
30 millisecond sample
Root Mean Square (RMS) ratios between channels
Frequency Energy10 Hz bands
Phase Coherence ratios between channels
x6 Sensors
Features
Support VectorMachine
user specific model
gesture classification
![Page 30: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/30.jpg)
Sensing biosignals
17
Cohn, Morris, Patel, Tan. Your Noise is My Command: Sensing Gestures Using the Body as an Antenna. CHI ’11.
![Page 31: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/31.jpg)
Output technologies
18
![Page 32: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/32.jpg)
19
Willis et al. SideBySide: ad-hoc multi-user interaction with handheld projectors. UIST ’11.
Handheld projectors
![Page 33: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/33.jpg)
20
Follmer et al. Jamming user interfaces: programmable particle sti!ness and sensing for malleable and shape-changing devices. UIST ’12.
Physically actuated material
![Page 34: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/34.jpg)
21
Lee, Post and Ishii. ZeroN: mid-air tangible interaction enabled by computer controlled magnetic levitation. UIST ’11.
Magnetic levitation
![Page 35: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/35.jpg)
22
Wilson et al. Steerable augmented reality with the Beamatron. UIST ’12.
Projectors
![Page 36: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/36.jpg)
23
Willis et al. Printed Optics: 3D Printing of Embedded Optical Elementsfor Interactive Devices. UIST ’12.
3D printing
![Page 37: Input and Interaction - Stanford HCI grouphci.stanford.edu/courses/cs376/2013/lectures/2013-04-24-input/CS... · Input and Interaction ... Skinput. 3 Recall: Omnitouch. 4 Recall:](https://reader031.fdocuments.in/reader031/viewer/2022022017/5b8293467f8b9ae97b8eb7a0/html5/thumbnails/37.jpg)
Skill sets for input research
� Learn “enough to get by” in...� Electrical engineering� Mechanical engineering� Computer graphics
� Known techniques for research in these domains often have direct mappings onto open questions in input
24