Morse Code as an Morse Code as an Enabling Enabling

TechnologyTechnologyJeremy Cribb and Doug DaniellJeremy Cribb and Doug Daniell

Comp 190, Gary BishopComp 190, Gary Bishop

22 April 200322 April 2003

What did we do?What did we do?

Sharp Zaurus PDA Sharp Zaurus PDA with Morse code with Morse code input and Text-to-input and Text-to-Speech (TTS) Speech (TTS) FeedbackFeedback

Explored ideas for Explored ideas for making mobile making mobile devices universally devices universally accessibleaccessible

What is the purpose?What is the purpose?

Electronic notepad that is relatively Electronic notepad that is relatively inexpensive, very portable, and inexpensive, very portable, and enabled for a variety of users, while enabled for a variety of users, while still functional for allstill functional for all

To demonstrate the feasibility of To demonstrate the feasibility of adapting PDAs/embedded systems adapting PDAs/embedded systems for blind or physically disabled usersfor blind or physically disabled users

Recap - What is Morse Recap - What is Morse Code?Code?

Invented in 1800s – a binary code of Invented in 1800s – a binary code of dits and dahs is used to convey dits and dahs is used to convey information quickly, often over large information quickly, often over large distancesdistances

Advantages for ETAdvantages for ET FlexibleFlexible Simple and inexpensiveSimple and inexpensive Rapid text entry ( ≤ 30 wpm)Rapid text entry ( ≤ 30 wpm) Enables many users who otherwise Enables many users who otherwise

could not communicate with computerscould not communicate with computers

What were the problems What were the problems with existing solutions?with existing solutions?

Expensive (~500)Expensive (~500) Hardware Hardware

dependent - dependent - desktop/PCMCIA desktop/PCMCIA support requiredsupport required

Not very portableNot very portable Each application is Each application is

very specializedvery specialized

Improvements by our Improvements by our ProductProduct

Serves a need for blind/disabled/all usersServes a need for blind/disabled/all users Helpful for communicationHelpful for communication

ALS, MS, or the speech impairedALS, MS, or the speech impaired Low requirements for physical ability Low requirements for physical ability

(ALS)(ALS) Mobile w/long battery lifeMobile w/long battery life Cost EffectiveCost Effective Reduces the hardware requirementReduces the hardware requirement

Standard serial (9-pin/USB) supportStandard serial (9-pin/USB) support

Why the Zaurus SL-Why the Zaurus SL-5500?5500?

Linux!Linux! Relatively inexpensive (~$200)Relatively inexpensive (~$200) Stereo output / microphone inputStereo output / microphone input Bluetooth wireless-capableBluetooth wireless-capable Standard serial interfaces (RS232 & Standard serial interfaces (RS232 &

USB)USB) Standard removable flash memoryStandard removable flash memory Built-in text completionBuilt-in text completion

Incremental Design Incremental Design ApproachApproach

1.1. Construct a functional Morse-to-Speech Construct a functional Morse-to-Speech application in Python (pyMTS) on a desktop application in Python (pyMTS) on a desktop systemsystem

2.2. Research TTS options for PDAs, and install a Research TTS options for PDAs, and install a usable system on our platform of choiceusable system on our platform of choice

3.3. Port the pyMTS application to a PDA PlatformPort the pyMTS application to a PDA Platform

4.4. Hardware Improvements: add a custom serial Hardware Improvements: add a custom serial or wireless input deviceor wireless input device

5.5. Software Improvements: an accessible OS for Software Improvements: an accessible OS for PDAs? Additional software tools for M.C. PDAs? Additional software tools for M.C. Education?Education?

Details of the DesignDetails of the Design

Flite TTS library (optimized version of Flite TTS library (optimized version of the open source TTS Festival)the open source TTS Festival) ongoing project at Carnegie-Mellonongoing project at Carnegie-Mellon lightweight version of the open source TTS lightweight version of the open source TTS

FestivalFestival coded in C for speedcoded in C for speed http://http://www.speech.cs.cmu.edu/flitewww.speech.cs.cmu.edu/flite//

PythonPython Zaurus-optimized versionZaurus-optimized version PyQT windowing libraryPyQT windowing library

DeliverablesDeliverables

pyMTSpyMTS ROM image with ROM image with

all software all software installed?installed?

Ideas for ImprovementIdeas for Improvement

Adding Serial Interface layer for attaching Adding Serial Interface layer for attaching hardwarehardware

Wireless Bluetooth cable-replacement Wireless Bluetooth cable-replacement solution (~$50)solution (~$50) www.pellico.com/zaurus/hardware/bluetoothDevwww.pellico.com/zaurus/hardware/bluetoothDev

Kit.htmlKit.html

What are the next steps?What are the next steps?

Extend hardware support to serial Extend hardware support to serial interface. Example - wireless bluetooth interface. Example - wireless bluetooth inputinput

Insert Morse as an optional kernel Insert Morse as an optional kernel module into the OSmodule into the OS

Design a full TTS/Morse environment Design a full TTS/Morse environment for a PDA (Mobile JAWS/MorseShell?)for a PDA (Mobile JAWS/MorseShell?)

Design tools to encourage users to Design tools to encourage users to learn Morse codelearn Morse code

ConclusionConclusion

With minimal investment we were able With minimal investment we were able to develop an application that with to develop an application that with further development could serve a further development could serve a important role for a great variety of important role for a great variety of users, regardless of ability. With (a users, regardless of ability. With (a whole lot) more testing and whole lot) more testing and development, and building upon some of development, and building upon some of our basic ideas, it should be possible to our basic ideas, it should be possible to create a fully speech enabled PDA with create a fully speech enabled PDA with flexible input.flexible input.