Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse...
-
Upload
melanie-hudson -
Category
Documents
-
view
213 -
download
0
Transcript of Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse...
![Page 1: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/1.jpg)
Interaction with Surfaces
![Page 2: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/2.jpg)
AimsLast week focused on looking at
interaction with keyboard and mouse
This week◦Surface Interaction◦Gestures
![Page 3: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/3.jpg)
Surface
What do we mean by surface?
![Page 4: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/4.jpg)
4
Touch ScreensVery durable – only input device
to survive at Disney WorldArm fatigue can be a problem
◦Tilt the screen (lighting)◦Surface to rest arms
![Page 5: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/5.jpg)
Types of SurfacesLots of different types:
◦Resistive – two layers when press down they collide
◦Capacitive - layer that stores electrical charge, touches the monitor with his or her finger, some of the charge is transferred to the user
◦Surface acoustic wave system - two transducers and reflector can sense when wave has been disturbed
![Page 6: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/6.jpg)
Modelling User InteractionWould be nice if you could
calculate the time required to point at an object.
![Page 7: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/7.jpg)
7
Fitts’ Law (1954)Predictive Model of time required
to point at an object – nice formulae
Can determine optimal location and size of buttons
Time required to complete hand movement was dependant on the distance users had to move (D)
The target Size (W)
![Page 8: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/8.jpg)
8
Fitts’ LawIf it took 2 seconds to select a
target that was 10 cm away might expect it to double if 20 cm away to 4 seconds not the case
Increasing size of the target from 1cm2 to 2cm2 enables users to point more rapidly
Start and Stop times are constantMT = a + b log2 (D/W+1)
![Page 9: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/9.jpg)
9
Fitts Law and usersKnow your users!Fitt’s law well established for
adultsNeeds refinement for other users
such as children and elderlyAge can effect speed and
accuracy
![Page 10: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/10.jpg)
Study performed using mouseRepeating action ofSelecting two
targets1= Young adults2= 5 year olds3= 4 year olds
Study performed using mouseRepeating action ofSelecting two targets1= Young adults2= 5 year olds3= 4 year olds
Juan Pablo Hourcade, Benjamin B. Bederson, Allison Druin, and Francois Guimbretiere. 2004. Differences in pointing task performance between preschool children and adults using mice. ACM Trans. Comput.-Hum. Interact. 11, 4 (December 2004), 357-386
![Page 11: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/11.jpg)
Social InteractionEven with this knowledge design
for interaction problematic when you have multi-user interaction
Example multi-player games on large displays (Video)
![Page 12: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/12.jpg)
From GUIs to NUIsNatural User InterfaceFocus on natural way of
interacting with devicesConcept around for long timeNewton Message Pad Apple 1989Hand writing recognitionAWFUL!
![Page 13: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/13.jpg)
13
GesturesNatural ways to interactVision recognition used to
capture hand movement and gestures in front of a white board
Widely researched area in HCIWii Accelerometer based gesture recognition
![Page 14: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/14.jpg)
State-Transition ModelDirect touch
Idle Active
Finger lands
Finger lifted
Finger moving in air
Finger moving on device
![Page 15: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/15.jpg)
15
Gestures
The actual shape Filtered to interpret a circle
![Page 16: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/16.jpg)
16
Gestures Shaking – basic note
entryTilting - subdividing
note durations in the stored sequence.
Tapping - tap for lower and higher notes.
Tossing – used to pass music to another deviceWeinberg, G., Godfrey, M., and Beck, A. 2010. ZOOZbeat: mobile music recreation. In Proceedings of the 28th of the
international Conference Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA, April 10 - 15, 2010). CHI EA '10. ACM, New York, NY, 4817-4822
![Page 17: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/17.jpg)
17
GesturesIssues
◦Training usually required◦Remembering gestures = Gulf of execution
◦Nothing happens = Gulf of evaluation Need to understand cause movement
constraints are reached
◦No real standards – Apple defined gestures ?
◦Can programme your own
![Page 18: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/18.jpg)
18
What’s this gesture?
![Page 19: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/19.jpg)
19
What’s this gesture?
![Page 20: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/20.jpg)
20
GesturesSurface established gestures
![Page 21: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/21.jpg)
21
GesturesSurface user defined gestures
![Page 22: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/22.jpg)
What about Fat FingersUser touches
device large part of finger contacts surface (system not realise it)
Can’t see the pixels that are being targeted – finger is in the way
Video
![Page 23: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/23.jpg)
Gulf of CompetenceGulf occurs when
learn something one way and then have to relearn it another
For example mouse to keyboard shortcuts
Mouse to gesture interaction
![Page 24: Interaction with Surfaces. Aims Last week focused on looking at interaction with keyboard and mouse This week ◦ Surface Interaction ◦ Gestures.](https://reader036.fdocuments.in/reader036/viewer/2022062802/56649e845503460f94b85639/html5/thumbnails/24.jpg)
24
Summary GesturesHow many could a child
remember?Would they need training?Is this part of the system or one
you created?Need to discuss issues for your
assignmentOne of major input methods to
consider