Slide 1

Development of Communication aids for Deaf-blind people using Smartphone Shunsuke Takeno,Ryoji Yukino, Yutaka Tange, Yoshitaka Arakawa Dept. of Electric and Computer Eng., Maizuru National College of Technology Slide 2 1. Introduction: About The Deaf-Blind 2012/12/10-11 2012 Japan-Taiwan Symposium on iGO Technology 2 The Deaf-Blind people Lose more than 90% of sensory information Means of Communication Handwritten Braille Etc UbitzkyBraille writer Supporting Devices Etc Slide 3 1. Introduction: The problems 2012/12/10-11 2012 Japan-Taiwan Symposium on iGO Technology 3 Deaf-blind people always need helpers The protection of their privacy is difficult. Imposing heavy burdens on helpers. The poor portability of supporting devices Most of them need to be connected to a PC. We need to learn a special language To communicate with the deaf-blind people, we need to learn communication methods for them. Slide 4 1. Introduction: Finger Braille and Smartphone 2012/12/10-11 2012 Japan-Taiwan Symposium on iGO Technology 4 Good Portability Good Communication Function High Performance Slide 5 2. System 2012/12/10-11 2012 Japan-Taiwan Symposium on iGO Technology 5 Android Bluetooth Module Microphone Camera I/O Device Bluetooth Module PIC Input Sensor Output Sensor Finger Braille Data Functions Translating between Text and Finger Braille Translating between Voice and Finger Braille Finge r Braill e Voice, Text Slide 6 2.1 System: Functions of I/O Device 2012/12/10-11 2012 Japan-Taiwan Symposium on iGO Technology 6 Smartphon e Input Sensor Output Sensor Bluetooth Module PIC Interface Magnetic Sensors Vibrators Slide 7 2.2 System: Functions of Smartphone application 2012/12/10-11 2012 Japan-Taiwan Symposium on iGO Technology 7 I/O Device Hello Speec h Documents Enables us to input Speech or Document via microphone or camera Outputting Speech or Text Hello Compatible with other applications ex) E-mail, Telephone... Slide 8 2.3 System: Translating Finger Braille into Kana 2012/12/10-11 2012 Japan-Taiwan Symposium on iGO Technology 8 Advantages Makes development simpler Makes processing faster Makes the system more adaptable (Easy addition of other alphabets) We have used Associative Array to translate finger braille into Kana. Key3 Value2 Key1 Value1 Key2 Value1 Key3 Value2 Key4 Value3 Data Table Slide 9 2.4 System: Input Recognition of I/O Device 2012/12/10-11 2012 Japan-Taiwan Symposium on iGO Technology 9 Sensor1Sensor2Sensor3 Input2 Starting Trigger Any sensor is on Finishing Trigger All sensor is off Sensor3Sensor2Sensor1 010 111 101 101 111 Sensor3Sensor2Sensor1 100 100 110 110 100 110 Input1 110 111 SimpleHigh Recognition Precision & t Slide 10 2.5 System: Movie 2012/12/10-11 2012 Japan-Taiwan Symposium on iGO Technology 10 Movie Translating Finger Braille into Kana Slide 11 2.6 System: User Evaluation 2012/12/10-11 2012 Japan-Taiwan Symposium on iGO Technology 11 The System is very useful for us. Wed like you to make letters larger and clearer. Please hear opinions from others and improve system. School for the blind and the deaf in Maizuru, Kyoto Prefecture Slide 12 3. Conclusion 2012/12/10-11 2012 Japan-Taiwan Symposium on iGO Technology 12 Productization Future Improvement: Speeding up in operation More user-friendly in GUI Development of other I/O devices Opinion poll Designin g System Feedback of opinions Improvement of System Trial Test Slide 13 Thank you for your attention ! Please feel free to ask any questions