Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

54
Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan

Transcript of Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

Page 1: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

Simple vs. Compound Mark Hierarchical Marking Menus

Shengdong Zhao, Ravin Balakrishnan

Page 2: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

2

Compound Mark Technique

Page 3: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

3

Compound Mark Technique

Page 4: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

4

Compound Mark Technique

Page 5: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

5

Compound Mark Technique

Page 6: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

6

Compound Mark Technique

Page 7: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

7

Compound Mark Technique

Page 8: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

8

Advantages

Seamless novice to expert transition

Page 9: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

9

Advantages

Seamless novice to expert transition

3.5 x faster than linear menus

Page 10: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

10

Advantages

Seamless novice to expert transition

3.5 x faster than linear menus

Scale invariance=

Page 11: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

11

Limitations – Error Rate

Breadth/depth/speed/accuracy trade-off

[Kurtenbach and Buxton, 1993]

Compass4

Page 12: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

12

Limitations – Error Rate

Breadth/depth/speed/accuracy trade-off

[Kurtenbach and Buxton, 1993]

Compass4 Compass4-4

Page 13: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

13

Limitations – Error Rate

Breadth/depth/speed/accuracy trade-off

[Kurtenbach and Buxton, 1993]

Compass8

Page 14: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

14

Limitations – Error Rate

Breadth/depth/speed/accuracy trade-off

[Kurtenbach and Buxton, 1993]

Compass8 Compass8-2

Page 15: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

15

Limitations – Ambiguous Marks

S-S-N

Page 16: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

16

Limitations – Ambiguous Marks

S-S-N = S-N-N

Page 17: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

17

Limitations – Ambiguous Marks

S-S-N = S-N-N

compass8-3: 22% ambiguous

compass4-4: 57% ambiguous

Page 18: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

18

Limitations – Physical Space

NE-E -NE -E

Page 19: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

19

Compound Mark Technique

Page 20: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

20

Simple Mark Technique

Page 21: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

21

Simple Mark Technique

Page 22: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

22

Simple Mark Technique

Page 23: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

23

Simple Mark Technique

Page 24: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

24

Simple Mark Technique

Page 25: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

25

Simple Mark Technique

Page 26: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

26

Simple Mark Technique

Page 27: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

27

Compound vs. Simple

Compound Mark Technique

Simple Mark Technique

Breadth vs. DepthCompass4:max. depth 4

Compass8:max. depth 2 Possibly more depth

Ambiguity Yes NO

Space usage Grows quadratically Theoretical constant

Physical Motion Single zig-zag stroke Multiple simple strokes

Page 28: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

28

Compound vs. Simple

Compound Mark Technique

Simple Mark Technique

Breadth vs. DepthCompass4:max. depth 4

Compass8:max. depth 2 Possibly more depth

Ambiguity Yes NO

Space usage Grows quadratically Theoretical constant

Physical Motion Single zig-zag stroke Multiple simple strokes

Page 29: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

29

Compound vs. Simple

Compound Mark Technique

Simple Mark Technique

Breadth vs. DepthCompass4:max. depth 4

Compass8:max. depth 2 Possibly more depth

Ambiguity Yes NO

Space usage Grows quadratically Theoretical constant

Physical Motion Single zig-zag stroke Multiple simple strokes

Page 30: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

30

Compound vs. Simple

Compound Mark Technique

Simple Mark Technique

Breadth vs. DepthCompass4:max. depth 4

Compass8:max. depth 2 Possibly more depth

Ambiguity Yes NO

Space usage Grows quadratically Theoretical constant

Physical Motion Single zig-zag stroke Multiple simple strokes

Page 31: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

31

Research IssuesSpeed and accuracy

Hierarchy depth

Input footprint

Spatial overlap

Timeout threshold

Mark directions

on-axis off-axis

Page 32: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

32

Experimental Setup

Page 33: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

33

Input Footprint

1.25’’ x 1.25’’

3.5’’ x 4.25’’

7.8’’ x 8.8’’

Page 34: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

34

Experimental Design

Page 35: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

35

12 participants x

Experimental Design

Page 36: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

36

12 participants x

2 techniques (compound, simple) x

Experimental Design

Page 37: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

37

12 participants x

2 techniques (compound, simple) x

3 input footprint (small, medium, large) x

Experimental Design

Page 38: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

38

12 participants x

2 techniques (compound, simple) x

3 input footprint (small, medium, large) x

4 layouts (compass4-2, 4-3 , 8-2 , 8-3)

Experimental Design

Page 39: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

39

12 participants x

2 techniques (compound, simple) x

3 input footprint (small, medium, large) x

4 layouts (compass4-2, 4-3 , 8-2 , 8-3)

= 9216 menu selections in total.

Experimental Design

Page 40: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

40

Accuracy

Overall: Compound (80%) vs. Simple (93%)

100%90%80%70%60%50%40%30%20%10%

0%

Acc

ura

cy(%

)

4,2 4,3 8,2 8,3 4,2 4,3 8,2 8,3 4,2 4,3 8,2 8,3

Menu Layout (breadth, depth)

Page 41: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

41

Accuracy100%

90%80%70%60%50%40%30%20%10%

0%

Acc

ura

cy(%

)

Off

On

Mix

Off

On

Mix

Off

On

Mix

Off

On

Mix

Off

On

Mix

Off

On

Mix

Level 2 Level 3 Level 2 Level 3 Level 2 Level 3

Large Medium Small

Page 42: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

42

Speed

4,2 4,3 8,2 8,3 4,2 4,3 8,2 8,3 4,2 4,3 8,2 8,3

Menu Layout (breadth, depth)

4

3.5

3

2.5

2

1.5

1

0.5

0

Tim

e (

in s

eco

nd

)

Page 43: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

43

Speed

Off

On

Mix

Off

On

Mix

Off

On

Mix

Off

On

Mix

Off

On

Mix

Off

On

Mix

Level 2 Level 3 Level 2 Level 3 Level 2 Level 3

Large Medium Small

Tim

e (

in s

eco

nd

)

5

4

3

2

1

0

Page 44: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

44

Input Space Usage

0

20

40

60

80

100

120

140

160

1 2 3 4 5 6 7 8 9 10 11 12

Participant ID

Are

a (K

ilo

Pix

els

)

compound

simple

0

10

20

30

40

50

60

70

Are

a (K

ilo P

ixe

ls)

Large Medium Small

Comp4 Comp8 Comp4 Comp8 Comp4 Comp8

2 2 2 2 2 23 3 3 3 3 3

Page 45: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

45

Results SummaryFaster, more accurate

Increased hierarchy depth

Mark direction no effect on accuracy

Unaffected by input footprint

Space efficient

Timeout threshold: 2s upper bound

Page 46: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

46

Menu Transition Alternatives

Furniture

Fruit

ToolAuto

Furniture

Fruit

ToolAuto

Hammer

Nail

ScrewSaw

Furniture

Fruit

ToolAuto

Hammer

Nail

ScrewSaw

Furniture

Fruit

Auto Tool

Nail

ScrewSaw

HammerFurniture

Fruit

Auto Tool

Furniture

Fruit

ToolAuto

Nail

ScrewSaw

Hammer

Page 47: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

47

Backtracking Alternatives

Sun

Thurs

Tues

Mon

Wes

Sat

Fri

Season

Month

Date Day

Furniture

Fruit

Auto

Hammer

Nail

ScrewSawTool

Page 48: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

48

Future Directions

Novice to expert transition

Mode errors

Page 49: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

49

Acknowledgements

Mark Chignell, Michael McGuffin,Jingnan Yang, Xiao Wu, Faye Baron, Rick

Bodner

Experiment participants

Members of DGP and MIE lab

UIST Reviewers

Page 50: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

50

Questions

Page 51: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

51

Formula for Calculating Ambiguity

Let B be the branching factor of the menu (e.g., 4, 8)Let D be the depth of the menu (i.e., number of levels)Then, the total number of leaf nodes = B^DNumber of leaf nodes with unambiguous marks =(number of marks with maximal number D-1 inflections) +(number of marks with no inflections at all) =

B*(B-1)^(D-1) + BExample calculations:compass8-2 layout = 8*(7^1) + 8 = 64 (i.e., all leaves)compass4-4 layout = 4*(3^3) + 4 = 112 (43% of all leaves)compass8-3 layout = 8*(7^2) + 8 = 400 (78% of all leaves)

Page 52: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

52

0

0.5

1

1.5

2

2.5

3

3.5

4

4,2 4,3 8,2 8,3 4,2 4,3 8,2 8,3 4,2 4,3 8,2 8,3

Menu Layout (Number of items, depth)

Tim

e (in

sec

ond)

compound

simple

Large Medium Small

0

0.5

1

1.5

2

2.5

3

3.5

4

4,2 4,3 8,2 8,3 4,2 4,3 8,2 8,3 4,2 4,3 8,2 8,3

Menu Layout (Number of items, depth)Tim

e (in

seco

nd)

compound

simple

Large Medium Small

Drawing TimeReaction Time

Page 53: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

53

Drawing TimeReaction Time

Page 54: Simple vs. Compound Mark Hierarchical Marking Menus Shengdong Zhao, Ravin Balakrishnan.

54

Experimental Setup