YAGBUX project - Yet Another Gesture Based User Experience

22
Gesture-based web navigation* that rocks *Navigation web gestuelle but at

description

YAGBUX is a project I've done at Télécom Saint-Etienne (tse) last year.It was about creating a gesture based web interface.Moving a finger (or two) moves a spot on screen that activates a "hover" on some areas or click them.

Transcript of YAGBUX project - Yet Another Gesture Based User Experience

Page 1: YAGBUX project - Yet Another Gesture Based User Experience

Gesture-based web navigation*

that rocks

*Navigation web gestuelle

but at

Page 2: YAGBUX project - Yet Another Gesture Based User Experience

Interaction Designers answer 3 questions:

Bill Verplank

How do you do? How do you feel? How do you know?

Page 3: YAGBUX project - Yet Another Gesture Based User Experience

Interaction design

Page 4: YAGBUX project - Yet Another Gesture Based User Experience

How do you do ... ?

button

handle

Page 5: YAGBUX project - Yet Another Gesture Based User Experience

How do you do ... ?

button

handle

Precision

Expression

Page 6: YAGBUX project - Yet Another Gesture Based User Experience

How do you feel ... ?

coolhot

Marshall McLuhan theory

Page 7: YAGBUX project - Yet Another Gesture Based User Experience

How do you know ... ?

maps

paths

Page 8: YAGBUX project - Yet Another Gesture Based User Experience
Page 9: YAGBUX project - Yet Another Gesture Based User Experience

Web navigation

Today

Page 10: YAGBUX project - Yet Another Gesture Based User Experience

what about using this ?

Page 11: YAGBUX project - Yet Another Gesture Based User Experience

Let’s rock !

Page 12: YAGBUX project - Yet Another Gesture Based User Experience

MaterialsObjectives Computer x1Webcam x1Adobe Flash ® x1Time x100 hoursLong iTunes playlist x1

Live motion tracking on a flash object

Detect hovering on multiple buttons

Clicks !

Page 13: YAGBUX project - Yet Another Gesture Based User Experience

1Open

Page 14: YAGBUX project - Yet Another Gesture Based User Experience

2write YAGBUXpoc.as

YAGBUXcamera.as

YAGBUXpoc.jsYAGBUXpoc.js

YAGBUXbutton.as YAGBUXcursor.as

Page 15: YAGBUX project - Yet Another Gesture Based User Experience

YAGBUXpoc.as

YAGBUXpoc.jsYAGBUXpoc.js

Main fileyou can create buttons on the fly

// cursors // ,

and specify a region for a cursor

poc = Proof Of Concept

Page 16: YAGBUX project - Yet Another Gesture Based User Experience

YAGBUXcamera.as

YAGBUXpoc.jsYAGBUXpoc.js

sets up a Web cam for capturing motion

Page 17: YAGBUX project - Yet Another Gesture Based User Experience

YAGBUXcursor.as

YAGBUXpoc.jsYAGBUXpoc.js

sets up a cursor that follows the motion in YAGBUXcamera

Page 18: YAGBUX project - Yet Another Gesture Based User Experience

YAGBUXbutton.as

YAGBUXpoc.jsYAGBUXpoc.js

sets up events for an invisible hotspot per YAGBUXcursor

Page 19: YAGBUX project - Yet Another Gesture Based User Experience

3write again...

Page 20: YAGBUX project - Yet Another Gesture Based User Experience

4say hello to your screen !

Page 21: YAGBUX project - Yet Another Gesture Based User Experience

That’s it !

by Lahmam.com - made with love on a mac

Page 22: YAGBUX project - Yet Another Gesture Based User Experience

Demo time !YAGBUX yet another gesture based user experience

Publicis & Hal Riney conceptDontclick.it