UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE...
Transcript of UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE...
![Page 1: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/1.jpg)
Ken Hinckley Seongkook Heo (KAIST & MSR)Michel Pahud Christian HolzHrvoje Benko Abigail Sellen Gavin SmythRichard Banks Kenton O’Hara Bill Buxton
for MOBILE INTERACTION
PRE-TOUCH SENSING
![Page 2: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/2.jpg)
Michel Pahud Christian HolzHrvoje Benko Abigail Sellen Gavin SmythRichard Banks Kenton O’Hara Bill Buxton
Ken Hinckley Seongkook Heo (KAIST & MSR)
for MOBILE INTERACTION
PRE-TOUCH SENSING
![Page 3: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/3.jpg)
![Page 4: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/4.jpg)
TOUCH IS
ANALOGand
CONTINUOUS…
IF NATURAL HUMAN
![Page 5: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/5.jpg)
(x,y)
Then why do we boil the
down to flatland?entire vocabulary of mobile touch
![Page 6: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/6.jpg)
Much of what characterizes ‘touch’ startsbefore contact
and originates
beyond the confinesof the screen.
![Page 7: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/7.jpg)
AN INSTANT IN TIME…FROM TOUCH AS A POINT,
![Page 8: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/8.jpg)
TO A WHOLE WORLD THAT SURROUNDS IT…
![Page 9: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/9.jpg)
![Page 10: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/10.jpg)
This treasury of contextual detail—
the combination of hover and gripthat we collectively refer to as
pre-touch—has been lost to mobile interaction.
![Page 11: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/11.jpg)
![Page 12: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/12.jpg)
SENSOR
/technology
– Self-capacitance is well-known. Not our contrib.
fogale-sensation.com
![Page 13: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/13.jpg)
You’ve probably heard about hover, or seen examples of control gestures in-air.
![Page 14: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/14.jpg)
You’ve probably heard about hover, or seen examples of control gestures in-air.
The focus of pre-touch isn’t on such overt, ‘foreground’ gestures.
![Page 15: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/15.jpg)
You’ve probably heard about hover, or seen examples of control gestures in-air.
The focus of pre-touch isn’t on such overt, ‘foreground’ gestures.
Instead, pre-touch is primarily about the ‘background’ of the interaction—
![Page 16: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/16.jpg)
You’ve probably heard about hover, or seen examples of control gestures in-air.
The focus of pre-touch isn’t on such overt, ‘foreground’ gestures.
Instead, pre-touch is primarily about the ‘background’ of the interaction—
what happens before, the framing, the context.
![Page 17: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/17.jpg)
This is a design space paper.
![Page 18: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/18.jpg)
This is a design space paper.
We explore an emerging modality, breadth-first across a number of
possibilities.
![Page 19: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/19.jpg)
This is a design space paper.
We explore an emerging modality, breadth-first across a number of
possibilities.
But we do not go depth-first into any one technique in exhaustive detail.
![Page 20: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/20.jpg)
WE EXPLORED:
1) ANTICIPATORY REACTIONS
2) RETROACTIVE INTERPRETATIONS
3) HYBRID TOUCH-HOVER GESTURES
TO ILLUSTRATE THIS DESIGN SPACE,
interface contingent on grip and hover
approach trajectory informs touch semantics
on-screen touch + above-screen aspects
![Page 21: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/21.jpg)
WE EXPLORED:
1) ANTICIPATORY REACTIONS
2) RETROACTIVE INTERPRETATIONS
3) HYBRID TOUCH-HOVER GESTURES
TO ILLUSTRATE THIS DESIGN SPACE,
interface contingent on grip and hover
approach trajectory informs touch semantics
on-screen touch + above-screen aspects
![Page 22: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/22.jpg)
WE EXPLORED:
1) ANTICIPATORY REACTIONS
2) RETROACTIVE INTERPRETATIONS
3) HYBRID TOUCH-HOVER GESTURES
TO ILLUSTRATE THIS DESIGN SPACE,
interface contingent on grip and hover
approach trajectory informs touch semantics
on-screen touch + above-screen aspects
![Page 23: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/23.jpg)
WE EXPLORED:
1) ANTICIPATORY REACTIONS
2) RETROACTIVE INTERPRETATIONS
3) HYBRID TOUCH-HOVER GESTURES
TO ILLUSTRATE THIS DESIGN SPACE,
interface contingent on grip and hover
approach trajectory informs touch semantics
on-screen touch, simultaneous with hover
![Page 24: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/24.jpg)
WE EXPLORED:
1) ANTICIPATORY REACTIONS
2) RETROACTIVE INTERPRETATIONS
3) HYBRID TOUCH-HOVER GESTURES
TO ILLUSTRATE THIS DESIGN SPACE,
interface contingent on grip and hover
approach trajectory informs touch semantics
on-screen touch + above-screen aspects
![Page 25: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/25.jpg)
WE EXPLORED:
1) ANTICIPATORY REACTIONS
– when fingers away, no UI. Only content.
– so we fade in (0.2s) … later fade out (1.2s)
– since we’re fading in anyway… take liberty– to fade in context-appropriate controls.
TO ILLUSTRATE THIS DESIGN SPACE,
ad-lib interface : key ideas
– approach suggests intent to engage
but…
![Page 26: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/26.jpg)
WE EXPLORED:
2) RETROACTIVE INTERPRETATIONS
3) HYBRID TOUCH-HOVER GESTURES
TO ILLUSTRATE THIS DESIGN SPACE,
interface contingent on grip and hover
approach trajectory informs touch semantics
on-screen touch + above-screen aspects
![Page 27: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/27.jpg)
WE EXPLORED:
– when fingers away, no UI. Only content.
– so we fade in (0.2s) … later fade out (1.2s)
– since we’re fading in anyway… take liberty– to fade in context-appropriate controls.
TO ILLUSTRATE THIS DESIGN SPACE,
ad-lib interface : key ideas
– approach suggests intent to engage
but…
![Page 28: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/28.jpg)
WE EXPLORED:
– when fingers away, no UI. Only content.
– so we fade in (0.2s) … later fade out (1.2s)
– since we’re fading in anyway… take liberty– to fade in context-appropriate controls.
TO ILLUSTRATE THIS DESIGN SPACE,
ad-lib interface : key ideas
– approach suggests intent to engage
but…
![Page 29: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/29.jpg)
WE EXPLORED:
– when fingers away, no UI. Only content.
– so we fade in (0.2s) … later fade out (1.2s)
– since we’re fading in anyway… take liberty– to fade in context-appropriate controls.
TO ILLUSTRATE THIS DESIGN SPACE,
ad-lib interface : key ideas
– approach suggests intent to engage
but…
![Page 30: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/30.jpg)
WE EXPLORED:
– when fingers away, no UI. Only content.
– so we fade in (0.2s) …
– since we’re fading in anyway… take liberty– to fade in context-appropriate controls.
TO ILLUSTRATE THIS DESIGN SPACE,
ad-lib interface : key ideas
– approach suggests intent to engage
but…
![Page 31: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/31.jpg)
WE EXPLORED:
– when fingers away, no UI. Only content.
– so we fade in (0.2s) … later fade out (1.2s)
– since we’re fading in anyway… take liberty– to fade in context-appropriate controls.
TO ILLUSTRATE THIS DESIGN SPACE,
ad-lib interface : key ideas
– approach suggests intent to engage
but…
![Page 32: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/32.jpg)
WE EXPLORED:
– when fingers away, no UI. Only content.
– so we fade in (0.2s) … later fade out (1.2s)
– since we’re fading in anyway… take liberty– to fade in context-appropriate controls.
TO ILLUSTRATE THIS DESIGN SPACE,
ad-lib interface : key ideas
– approach suggests intent to engage
but…
![Page 33: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/33.jpg)
WE EXPLORED:
– when fingers away, no UI. Only content.
– so we fade in (0.2s) … later fade out (1.2s)
– since we’re fading in anyway, take liberty– to fade in context-appropriate controls.
TO ILLUSTRATE THIS DESIGN SPACE,
ad-lib interface : key ideas
– approach suggests intent to engage
but…
![Page 34: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/34.jpg)
WE EXPLORED:
– when fingers away, no UI. Only content.
– so we fade in (0.2s) … later fade out (1.2s)
– since we’re fading in anyway, take liberty– to fade in context-appropriate controls.
TO ILLUSTRATE THIS DESIGN SPACE,
ad-lib interface : key ideas
– approach suggests intent to engage
but…
![Page 35: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/35.jpg)
WE EXPLORED:
grip + hover
TO ILLUSTRATE THIS DESIGN SPACE,
multiple
contexts
![Page 36: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/36.jpg)
(“dialing”)
even adaptation ofcontrol gestures
![Page 37: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/37.jpg)
WE EXPLORED:
1) ANTICIPATORY REACTIONS
calm revelation
3) HYBRID TOUCH-HOVER GESTURES
TO ILLUSTRATE THIS DESIGN SPACE,
approach trajectory informs touch semantics
on-screen touch + above-screen aspects
ad-lib interface
![Page 38: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/38.jpg)
WE EXPLORED:
1) ANTICIPATORY REACTIONS
calm revelation
3) HYBRID TOUCH-HOVER GESTURES
TO ILLUSTRATE THIS DESIGN SPACE,
approach trajectory informs touch semantics
on-screen touch + above-screen aspects
ad-lib interface
![Page 39: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/39.jpg)
WE EXPLORED:
1) ANTICIPATORY REACTIONS
calm revelation
3) HYBRID TOUCH-HOVER GESTURES
TO ILLUSTRATE THIS DESIGN SPACE,
approach trajectory informs touch semantics
on-screen touch + above-screen aspects
ad-lib interface
![Page 40: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/40.jpg)
WE EXPLORED:
2) RETROACTIVE INTERPRETATIONS
3) HYBRID TOUCH-HOVER GESTURES
TO ILLUSTRATE THIS DESIGN SPACE,
interface contingent on grip and hover
approach trajectory informs touch semantics
on-screen touch + above-screen aspects
![Page 41: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/41.jpg)
WE EXPLORED:
1) ANTICIPATORY REACTIONS
2) RETROACTIVE INTERPRETATIONS
3) HYBRID TOUCH-HOVER GESTURES
TO ILLUSTRATE THIS DESIGN SPACE,
interface contingent on grip and hover
approach trajectory informs touch semantics
on-screen touch + above-screen aspects
![Page 42: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/42.jpg)
WE EXPLORED:
2) RETROACTIVE INTERPRETATIONS
3) HYBRID TOUCH-HOVER GESTURES
TO ILLUSTRATE THIS DESIGN SPACE,
interface contingent on grip and hover
approach trajectory informs touch semantics
on-screen touch + above-screen aspects
![Page 43: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/43.jpg)
WE EXPLORED:
2) RETROACTIVE INTERPRETATIONS
3) HYBRID TOUCH-HOVER GESTURES
TO ILLUSTRATE THIS DESIGN SPACE,
interface contingent on grip and hover
approach trajectory informs touch semantics
on-screen touch + above-screen aspects
![Page 44: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/44.jpg)
WE EXPLORED:
2) RETROACTIVE INTERPRETATIONS
3) HYBRID TOUCH-HOVER GESTURES
TO ILLUSTRATE THIS DESIGN SPACE,
interface contingent on grip and hover
approach trajectory informs touch semantics
on-screen touch + above-screen aspects
0ms(touch down)
temporal trajectoryfor a small target
temporal trajectoryfor a large target
-200ms
30mm
single-finger distance above touchscreen
20mm
10mm
-400ms-600ms-800ms-1s
![Page 45: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/45.jpg)
WE EXPLORED:
2) RETROACTIVE INTERPRETATIONS
3) HYBRID TOUCH-HOVER GESTURES
TO ILLUSTRATE THIS DESIGN SPACE,
interface contingent on grip and hover
approach trajectory informs touch semantics
on-screen touch + above-screen aspects
![Page 46: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/46.jpg)
WE EXPLORED:
1) ANTICIPATORY REACTIONS
2) RETROACTIVE INTERPRETATIONS
3) HYBRID TOUCH-HOVER GESTURES
TO ILLUSTRATE THIS DESIGN SPACE,
interface contingent on grip and hover
approach trajectory informs touch semantics
on-screen touch simultaneous with hover
![Page 47: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/47.jpg)
WE EXPLORED:
2) RETROACTIVE INTERPRETATIONS
3) HYBRID TOUCH-HOVER GESTURES
TO ILLUSTRATE THIS DESIGN SPACE,
interface contingent on grip and hover
approach trajectory informs touch semantics
on-screen touch + above-screen aspects
![Page 48: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/48.jpg)
WE EXPLORED:
2) RETROACTIVE INTERPRETATIONS
3) HYBRID TOUCH-HOVER GESTURES
TO ILLUSTRATE THIS DESIGN SPACE,
interface contingent on grip and hover
approach trajectory informs touch semantics
on-screen touch + above-screen aspects
![Page 49: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/49.jpg)
WE EXPLORED:
2) RETROACTIVE INTERPRETATIONS
3) HYBRID TOUCH-HOVER GESTURES
TO ILLUSTRATE THIS DESIGN SPACE,
interface contingent on grip and hover
approach trajectory informs touch semantics
on-screen touch + above-screen aspects
![Page 50: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/50.jpg)
INFORMALEVALUATION
![Page 51: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/51.jpg)
and they’re predictive.”
“feels very natural to my hand,” allows
– adapt to hand size?
Ad-lib interface (video player)
“I like the transparent controls,
“a single hand in a comfortable position.”
– controls should appear more quickly?
![Page 52: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/52.jpg)
– per user adaptations may also be helpful
Overall
– The one-handed adaptations stood out
– But all techniques had proponents
– Ballistic vs. fine taps: great for some users,
– current heuristic doesn’t consider grip.– not so much for others.
![Page 53: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/53.jpg)
CONCLUSION
![Page 54: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/54.jpg)
CONCLUSION
![Page 55: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/55.jpg)
Pre-touch holds great promise for fresh approaches to many challenges in mobile touch
interaction.
Our work has only just begun.
![Page 56: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/56.jpg)
Seongkook
TO ILLUSTRATE THIS DESIGN SPACE,
Heo
![Page 57: UIST 2014 Talk - microsoft.com · PRE-TOUCH SENSING. Michel Pahud Christian Holz ... 2) RETROACTIVE INTERPRETATIONS 3) HYBRID TOUCH-HOVER GESTURES TO ILLUSTRATE THIS DESIGN SPACE,](https://reader034.fdocuments.in/reader034/viewer/2022042405/5f1c9d5aecb536770a3e5519/html5/thumbnails/57.jpg)
WE EXPLORED:
2) RETROACTIVE INTERPRETATIONS
3) HYBRID TOUCH-HOVER GESTURES
TO ILLUSTRATE THIS DESIGN SPACE,
interface contingent on grip and hover
approach trajectory informs touch semantics
on-screen touch + above-screen aspects
Questions?