Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

38
Utah School of Computing Gestures CS5540 HCI Rich Riesenfeld Fall 2007

Transcript of Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Page 1: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

GesturesGestures

CS5540 HCI Rich Riesenfeld

Fall 2007

CS5540 HCI Rich Riesenfeld

Fall 2007

Page 2: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Gestures Studies Gestures Studies

• Following Gesture material from: • Following Gesture material from:

Hand Centered Studies of Human Movement Project, School of Kinesiology, Simon Fraser University, February 1996

Page 3: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Gestures-1Gestures-1

• Praying (two flat hands up together) • Begging (flat hand) • Expressing anger (raising a fist) • Derogation (middle finger up) • Accusation (index pointing) • Live or die decisions in the Roman

amphitheater (thumb up/down)

• Praying (two flat hands up together) • Begging (flat hand) • Expressing anger (raising a fist) • Derogation (middle finger up) • Accusation (index pointing) • Live or die decisions in the Roman

amphitheater (thumb up/down)

Page 4: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Gestures-2Gestures-2

• Hitch hiking (thumb up, hand moving sideways)

• Legal and business transactions (handshake, judge hammering)

• Waving and saluting • Counting (fingers and/or hand) • Pointing to real and abstract objects and

concepts (index, hand)

• Hitch hiking (thumb up, hand moving sideways)

• Legal and business transactions (handshake, judge hammering)

• Waving and saluting • Counting (fingers and/or hand) • Pointing to real and abstract objects and

concepts (index, hand)

Page 5: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Gestures-3 Gestures-3

• Conducting an orchestra (variety of both gestures with arms and body)

• Traffic control of cars and airplanes (hands flat pointing or moving)

• Shaping of imagined objects (hands tracing out curves and shapes)

• Martial arts, fighting (variety of movements of arms and body)

• Conducting an orchestra (variety of both gestures with arms and body)

• Traffic control of cars and airplanes (hands flat pointing or moving)

• Shaping of imagined objects (hands tracing out curves and shapes)

• Martial arts, fighting (variety of movements of arms and body)

Page 6: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Gestures-4 Gestures-4

• Dance (Balinese dancing) • Gesturing by singers (hand and body

movements) • Stock exchange operations (various

hand shapes) • Affective gestures (hand touching) • Rejective (index up moving left & right) /

appreciative (hand clapping) gestures

• Dance (Balinese dancing) • Gesturing by singers (hand and body

movements) • Stock exchange operations (various

hand shapes) • Affective gestures (hand touching) • Rejective (index up moving left & right) /

appreciative (hand clapping) gestures

Page 7: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Gestures-5 Gestures-5

• Game playing (hand signs to communicate with partner in card games)

• Game scoring (cricket, basketball, soccer, rugby, football)

• Dinner table actions (commanding waiter to refill wine glass)

• Positioning of real (remote or close) Control Panel operations (mousing, steering a vehicle)

• Game playing (hand signs to communicate with partner in card games)

• Game scoring (cricket, basketball, soccer, rugby, football)

• Dinner table actions (commanding waiter to refill wine glass)

• Positioning of real (remote or close) Control Panel operations (mousing, steering a vehicle)

Page 8: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Gestures-6 Gestures-6

• Moving, touching and interacting with objects

• Silent and non-verbal communication (shrugging, holding one's own earlobe, scratching)

• “Italianate" gestures (two hands open shaking)

• Moving, touching and interacting with objects

• Silent and non-verbal communication (shrugging, holding one's own earlobe, scratching)

• “Italianate" gestures (two hands open shaking)

Page 9: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Gestures-7 Gestures-7

• Mimicry and pantomime (actions and objects are depicted with hand/body movements)

• sign language (a complete linguistic communication system)

• Mimicry and pantomime (actions and objects are depicted with hand/body movements)

• Mimicry and pantomime (actions and objects are depicted with hand/body movements)

• sign language (a complete linguistic communication system)

• Mimicry and pantomime (actions and objects are depicted with hand/body movements)

Page 10: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Gestures-8 Gestures-8

• Shimmering hand (maybe, maybe not)• Sign language (a complete linguistic

communication system) • Aircraft carrier landings• Dog training• Gambling signals at a casino

• Shimmering hand (maybe, maybe not)• Sign language (a complete linguistic

communication system) • Aircraft carrier landings• Dog training• Gambling signals at a casino

Page 11: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Pictograms - 1Pictograms - 1

Page 12: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Pictograms - 2Pictograms - 2

Page 13: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Pictograms - 3Pictograms - 3

Page 14: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Pictograms -4Pictograms -4

Pictgram standardMAYON OF LOND ON

Page 15: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Pictogram standardMAYON OF LOND ON

Pictograms - 5Pictograms - 5

Page 16: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

                             

                              

                              

Special Need Group: DiversSpecial Need Group: Divers

Page 17: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

                             

                              

                              

“Help”

“Which direction?”

“Boat"

Page 18: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Underwater Communications and Hand Signals - 1

Underwater Communications and Hand Signals - 1

Page 19: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Underwater Communications and Hand Signals - 2

Underwater Communications and Hand Signals - 2

Page 20: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Underwater Communications and Hand Signals - 3

Underwater Communications and Hand Signals - 3

Page 21: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

ARFF Emergency Hand Signals - 1ARFF Emergency Hand Signals - 1

Aircraft Rescue and Fire Fighting (ARFF) Communications

Page 22: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Recommend EvacuationRecommend Evacuation

ARFF Emergency Hand Signals - 2ARFF Emergency Hand Signals - 2

Page 23: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Recommend StopRecommend Stop

ARFF Emergency Hand Signals - 3ARFF Emergency Hand Signals - 3

Page 24: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Emergency ContainedEmergency Contained

ARFF Emergency Hand Signals - 4ARFF Emergency Hand Signals - 4

Page 26: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Plane Director Using Hand Signals - 2Plane Director Using Hand Signals - 2

Page 27: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Ready for Launch Ready for Launch

Plane Director Using Hand SignalsPlane Director Using Hand Signals

Page 28: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

Complete Final Turn

Up(Instructions to pilot)

Suspend Catapult Operation

All Clear or Affirmative

Brakes off or Brakes

On

(Fist clenched = Suspend Operation)

Page 29: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

I have control. (Taking over from previous controller)

Hang Fire(Pilot to hold on until further instructions)

Lower Launch Bar

or Raise Launch Bar

The pilot salutes when ready to launch.The Plane Director returns salute to acknowledge pilot's readiness.

Page 30: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

ConclusionsConclusions

• Like poetry, extraordinarily succinct• Can be highly Universal, International

- Subject to back cultural misinterpretations

• Increasingly widespread use- Olympics- Travel- Commerce

• Like poetry, extraordinarily succinct• Can be highly Universal, International

- Subject to back cultural misinterpretations

• Increasingly widespread use- Olympics- Travel- Commerce

Page 31: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

End End

Gestures Gestures

Page 32: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

BOOKMARKBOOKMARK

Page 33: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.

BOOKMARKBOOKMARK

Page 34: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.
Page 35: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.
Page 36: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.
Page 37: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.
Page 38: Gestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007.