CMPS 261 – Project Proposal

Visually Representing American Sign LanguageTranslations

Victor Geislinger

Background/Motivation

● American Sign Language (ASL)● Fingerspelling (FS)● Handshapes

– Basis of language

Background/Motivation

● Interpreters– Emergency– Inaccessible– Expensive

● Learning Tool– Feedback

Method

● Collect Data via Leap Motion Controller– Focus on hand(s)/finger(s)– Real time capture

http://reviews.cnet.com/input-devices/leap-motion-controller/4505-3133_7-35823002.html

Method

● Categorize individual letters– Form hard to determine

● Classify group shapes– Easier to guess– “Autocorrect” feature

Method

● Transitions sometimes exist as one unit– “J” and “Z”– Double letters– “I-L-Y”– “A-I-R”– “B-U-S”

Output

● Gives interpreted word/sentence● Color coded to give likely letter from shape

group

Output

● Features other possible guesses– Given by opacity, position, and/or hierarchy tree

● Gives timeline of duration of letter– Possibly used to visually see speed of speech

Potential Issues/Challenges

● Identifying letters from same group– Difficult/impossible to do with current technology

● Differences in style/accent● Transition lengths● Output might have to many possibilities