Challenges in Designing a Menu System with Touch-less Technology

© Omek Interactive, Ltd. All rights reserved. © Omek Interactive, Ltd. All rights reserved.

CHALLENGES IN DESIGNING A MENU SYSTEM WITH

DEPTH MOTION SENSOR TECHNOLOGY

Shachar OzGame & UX Designer

Omek Interactive Studios

© Omek Interactive, Ltd. All rights reserved.

MENUS ARE FORGOTTEN ABOUT .OR, WHAT CAN DRIVE USERS CRAZY ?


MENU SYSTEM DESIGN GUIDELINES

• Confident users understand:– where they are– where they were– what can they do– how can they do it


3D DEPTH SENSOROR, WHAT IS IT ?


TOUCH-BASED TECHNOLOGY


TOUCH-LESS TECHNOLOGY


DEPTH MOTION CAPTURE

Body trackingNatural gesturesFree from controllers

×Tangible feedback×100% stability×Accuracy


CHALLENGESOR, HOW TECHNOLOGY INFLUENCE DESIGN ?


CHALLENGES OF MOTION CAPTURE• Feeling of a click :

virtual tangibility• Active & inactive modes • Am I in control ? • Inner delay of the interface

http://en.wikipedia.org/wiki/File:Alphanumeric_keyboard.jpg


CHALLENGES OF MOTION CAPTURE• Feeling of a click• Active & inactive modes :

differentiate between user behaviors

• Am I in control ? • Inner delay of the interface


CHALLENGES OF MOTION CAPTURE• Feeling of a click• Active & inactive modes • Am I in control ?

feedback for the users• Inner delay of the interface


CHALLENGES OF MOTION CAPTURE• Feeling of a click• Active & inactive modes • Am I in control ? • Inner delay of the interface :

cannot predict the user


DEALING WITH CHALLENGESSELECTING AND SCROLLING ITEMS


Selecting Items

• Click gesture : imitate mouse

• Hot-spot• Grand gesture• Swipe in • Grab gesture


Selecting Items

• Click gesture• Hot-spot :

hold cursor above item and wait

• Grand gesture• Swipe in • Grab gesture


Selecting Items

• Click gesture• Hot-spot• Grand gesture :

grandiose arm movement• Swipe in • Grab gesture


Selecting Items

• Click gesture• Hot-spot• Grand gesture• Swipe in :

continuous feedback

• Grab gesture


Selecting Items

• Click gesture • Hot-spot• Grand gesture• Swipe in • Grab gesture :

pinch or fist


Selecting Items

Responsiveness v x v v v

Active & inactive

v x v ½ ½

Stablilty x v v v ½

Comfortable ½ v x v v

Usability v v x ½ ½


Scrolling Items

• 2D cursor : imitate mouse

• 1D cursor• Static active spot• Dynamic active spot• Grand gesture


Scrolling Items

• 2D cursor• 1D cursor :

scroll on one axis• Static active spot• Dynamic active spot• Grand gesture


Scrolling Items

• 2D cursor• 1D cursor• Static active spot :

magnifying glass• Dynamic active spot• Grand gesture


Scrolling Items

• 2D cursor• 1D cursor• Static active spot• Dynamic active spot :

magnifying glass++• Grand gesture


Scrolling Items

• 2D cursor• 1D cursor• Static active spot• Dynamic active spot • Grand gesture :

grandiose arm movements


Scrolling Items

Responsiveness v v ½ v v

Active & inactive

v v x v v

Stablilty ½ v ½ v v

Comfortable v ½ v ½ x

Usability v v ½ v x


Pagination

• Just another button: hot-spot / click• Grand gesture: Minority Report• Drag n’ drop: scroll the entire list


User Real Location

• Camera view: what the camera sees?

• B&W: grey scale colors• Freeze!: control over the character• Trapezoid: view playfield from up• Note over character: main area of

concern


Feeling of a Click


CONCLUSIONSOR, WHAT DID WE LEARN ?


Conclusions

• Tracking: essential constant feedback

• Gesture: toggle action modes


User Expectations

• One hand based control scheme• Grandiose gestures only once in a

while• Constant feedback for each

movement


Depth Sensor Menu Design Guidelines• Consistency • Simplicity• Feeling of control• Feedback • Comfortable


Future Experiments

• Sound based feedback (for blind)• Speech based / speech components


References

• Frosted Glass / CAMPAR• EyeSight• Dance Central / Harmonix• Adrenaline Misfits / Konami• Omek Interactive Studios• Media Center / Primesense• PointGrab• Powerup Heroes / Ubisoft

• Huang J., White R.W., Buscher G. (2012). User See, User Point: Gaze and Cursor Alignment in Web Search. CHI’12, May 5–10, 2012, Austin, Texas, USA

http://www.youtube.com/watch?v=jORsG8AG72I&feature=player_embedded

http://campar.in.tum.de/WebHome

http://www.eyesight-tech.com/

http://www.pointgrab.com/

http://research.microsoft.com/en-us/um/people/ryenw/papers/hidden/huangchi2012.pdf

http://research.microsoft.com/en-us/um/people/ryenw/papers/hidden/huangchi2012.pdf

Thank You For Listening ,

Shachar OzGame & UX Designer

Omek Interactive Studioswww.OmekInteractive.com

[email protected]

Challenges in Designing a Menu System with Touch-less Technology

Design

Transcript of Challenges in Designing a Menu System with Touch-less Technology