Special Access TechnologySpecial Access TechnologyChapter 7Chapter 7

On-screen KeyboardsOn-screen Keyboards

Kristen Eklund &Kristen Eklund &

Jolene Hyppa MartinJolene Hyppa Martin

IntroductionIntroduction

Later chapters focus on individual Later chapters focus on individual areas of on-screen keyboard useareas of on-screen keyboard use Our chapter introduces many terms Our chapter introduces many terms

relating to this topicrelating to this topic Uses terms standardized by the Uses terms standardized by the

Common Terminology for Switch Common Terminology for Switch Controlled SoftwareControlled Software (ACE Centre, 1990) (ACE Centre, 1990)

These terms are shown initially in These terms are shown initially in yellowyellow

IntroductionIntroduction

On-screen keyboardsOn-screen keyboards Any keyboard displayed on a computer screenAny keyboard displayed on a computer screen Accessed using pointing devices or switchesAccessed using pointing devices or switches Not just the “qwerty” keyboardNot just the “qwerty” keyboard

Floating palettes for drawing programsFloating palettes for drawing programs Shortcut menusShortcut menus ToolbarsToolbars Pull-down menusPull-down menus Clip art menusClip art menus Specialized pop-up menusSpecialized pop-up menus ““qwerty” keyboard displayed on the screenqwerty” keyboard displayed on the screen And much, much more!And much, much more!

IntroductionIntroduction

The The itemsitems presented for selection by an on-screen presented for selection by an on-screen keyboard are called a keyboard are called a selection setselection set Items are also referred to as:Items are also referred to as:

CellCell KeyKey ButtonButton

Selection set is also referred to as:Selection set is also referred to as: GridGrid SetupSetup WindowWindow LayoutLayout

When a scanning program is used, a When a scanning program is used, a highlighter highlighter indicates which item is currently available for indicates which item is currently available for selectionselection

Selection setsSelection setsItemsItems

HighlightingHighlightingPromptsPrompts

IntroductionIntroduction

Items in selection sets may be text or graphics or bothItems in selection sets may be text or graphics or both Items can be selected by:Items can be selected by:

Point and clickPoint and click DwellDwell Scanning and switch useScanning and switch use

Goal is to enable user to use standard programs such as:Goal is to enable user to use standard programs such as: Word processorWord processor DatabaseDatabase SpreadsheetSpreadsheet Drawing programsDrawing programs GamesGames EmailEmail Web browser Web browser

Who might use an on-screen Who might use an on-screen keyboard?keyboard?

Early writersEarly writers People who have difficulty using a keyboardPeople who have difficulty using a keyboard

Limited ROMLimited ROM Poor fine and/or gross motor control, but able to use head Poor fine and/or gross motor control, but able to use head

pointing device (CP)pointing device (CP) Good head control, but poor limb control (SCI)Good head control, but poor limb control (SCI) Combination of physical and other problemsCombination of physical and other problems Impairments resulting in ability to use only one or two Impairments resulting in ability to use only one or two

switchesswitches Individuals with specific reading or writing difficultyIndividuals with specific reading or writing difficulty

Helped by visual and/or spoken promptsHelped by visual and/or spoken prompts Word predictionWord prediction

Selection Set Design & Selection Set Design & LayoutLayout

Arranging the items in the selection Arranging the items in the selection set is an important considerationset is an important consideration Goal is to choose the best arrangement Goal is to choose the best arrangement

for clientfor client Most programs offer many selection set Most programs offer many selection set

optionsoptions Many of those that don’t can be changed Many of those that don’t can be changed

by using by using selection set editor selection set editor programprogram

Selection Set Design & Selection Set Design & LayoutLayout

Some options include:Some options include: QWERTY keyboard layoutQWERTY keyboard layout

Suitable for those familiar with this layoutSuitable for those familiar with this layout Good for those who need access to all the keys on a standard Good for those who need access to all the keys on a standard

keyboardkeyboard Confusing for young users & beginnersConfusing for young users & beginners Unlike actual keyboard, little or no speed advantage of this layout Unlike actual keyboard, little or no speed advantage of this layout

in an onscreen formatin an onscreen format Alphabetic layoutAlphabetic layout

Better for young users and beginnersBetter for young users and beginners Always faster than “qwerty” for those familiar with alphabet, but Always faster than “qwerty” for those familiar with alphabet, but

not “qwerty”not “qwerty” Frequency of use layoutFrequency of use layout

Easier & fasterEasier & faster Good for those with learning difficultiesGood for those with learning difficulties

Selection Set Design & Selection Set Design & LayoutLayout

Word selection setsWord selection sets Phrase selection setsPhrase selection sets GraphicsGraphics PicturesPictures SymbolsSymbols

All of these options may include synthetic or All of these options may include synthetic or digitized speech prompts or other digitized speech prompts or other visual/auditory prompts to assist with selectionvisual/auditory prompts to assist with selection

Selection Set AppearanceSelection Set Appearance

Things to consider:Things to consider: SizeSize

Larger items may be necessary, but that decreases Larger items may be necessary, but that decreases total item optionstotal item options

Item spacingItem spacing Items placed further apart may be selected with Items placed further apart may be selected with

better accuracybetter accuracy ShapeShape

Items arranged in a Items arranged in a single linesingle line Items arranged in a Items arranged in a gridgrid Items arranged in a Items arranged in a flip chartflip chart Items arranged in a Items arranged in a custom designcustom design

Selection Set AppearanceSelection Set Appearance

Frame StyleFrame Style SquareSquare RoundRound ButtonButton

Changing frame can be helpful to Changing frame can be helpful to differentiate type or function of itemsdifferentiate type or function of items

ColorColor Aid in visual discriminationAid in visual discrimination

Selection Set AppearanceSelection Set Appearance

Text FontText Font Lower case is preferred for young childrenLower case is preferred for young children Simple upper/lower case for most adults Simple upper/lower case for most adults

Rachel’s example in clinic classRachel’s example in clinic class Highlighting and PromptingHighlighting and Prompting

VisualVisual Customized foreground/background color or graphic Customized foreground/background color or graphic

changeschanges Avoid low contrast color combinationsAvoid low contrast color combinations

AuditoryAuditory Helpful for those with visual, learning or perceptual Helpful for those with visual, learning or perceptual

difficultiesdifficulties Bells, beeps other soundsBells, beeps other sounds Digitized or synthetic speechDigitized or synthetic speech

Speech MUST be synchronizedSpeech MUST be synchronized

Selection Selection

Three methods of selectionThree methods of selection Pressing the mouse buttonPressing the mouse button SwitchSwitch Dwell (wait time)Dwell (wait time)

Feedback of selection may be auditory Feedback of selection may be auditory (beep) or visual (flash on screen)(beep) or visual (flash on screen)

Selected by “pressing for action” or Selected by “pressing for action” or “releasing for action”“releasing for action”

Keyboard ActionsKeyboard Actions

Send textSend text Word processingWord processing

Send graphicsSend graphics Insert pictures or symbolsInsert pictures or symbols

Cursor keys and control key combinationsCursor keys and control key combinations e.g., bg Hello there bg (start and end of line)e.g., bg Hello there bg (start and end of line) e.g., bP is a print signal e.g., bP is a print signal

Sticky keysSticky keys Control + letter (e.g., control + c = copy)Control + letter (e.g., control + c = copy)

Acceleration FeaturesAcceleration Features

PredictionPrediction Most frequently or recently used words Most frequently or recently used words Reduces number of selections while increasing Reduces number of selections while increasing

the speed of writingthe speed of writing Abbreviation ExpansionAbbreviation Expansion

Short abbreviation stands for longer wordShort abbreviation stands for longer word Smart PunctuationSmart Punctuation

Automatically adds spaces after punctuation Automatically adds spaces after punctuation marks and capitalizes the first lettermarks and capitalizes the first letter

Scrolling word listsScrolling word lists Lists of words beginning with each letterLists of words beginning with each letter

Computer/Program ControlComputer/Program Control

These features improve speed and These features improve speed and increase ease of useincrease ease of use Automatic startupAutomatic startup Save/load user settingsSave/load user settings Open set automatically with applicationOpen set automatically with application Open applicationOpen application Switch applicationsSwitch applications

Speech/Sound ActionsSpeech/Sound Actions

Two types of speechTwo types of speech 1- digitized (recorded speech or sound)1- digitized (recorded speech or sound) 2- synthetic (computer generated)2- synthetic (computer generated)

Most programs have speech control Most programs have speech control to change voice, pitch, volume, etc. to change voice, pitch, volume, etc. of speechof speech

Selection SetsSelection Sets

Selection set editorSelection set editor Program for creating and changing settingsProgram for creating and changing settings

Instant editingInstant editing Changed automatically without editor programChanged automatically without editor program

Editor accessible by userEditor accessible by user Special access to program to edit setsSpecial access to program to edit sets

Import text file to selection setImport text file to selection set Load file and creates word-bank selectionLoad file and creates word-bank selection

Selection sets supplied and availableSelection sets supplied and available Ready-made selection setsReady-made selection sets

Problems with Selection Problems with Selection (mouse or pointing device)(mouse or pointing device)

Difficulty hitting small items on the screenDifficulty hitting small items on the screen Accidentally selects items next to the Accidentally selects items next to the

intended selectionintended selection Can move the mouse, but can not operate Can move the mouse, but can not operate

the mouse buttonsthe mouse buttons Difficulty seeing the mouse pointer on the Difficulty seeing the mouse pointer on the

screenscreen Writing is slowWriting is slow

Solutions to These ProblemsSolutions to These Problems

PracticePractice Slow mouse speedSlow mouse speed Increase spacing between items on the screenIncrease spacing between items on the screen Use another switchUse another switch Use dwell selectUse dwell select Increase the size, shape, or color of the mouse Increase the size, shape, or color of the mouse

pointerpointer Onscreen highlightsOnscreen highlights Use acceleration tools, use frequency of use Use acceleration tools, use frequency of use

layoutlayout

Learning to Use On-Screen Learning to Use On-Screen KeyboardsKeyboards

Make it simple and funMake it simple and fun Start with large targets and gradually Start with large targets and gradually

fade to smaller targetsfade to smaller targets

Sample Programs for LearningSample Programs for Learning Living BooksLiving Books Kid Pix (drawing programs)Kid Pix (drawing programs)

Programs Using On-Screen Programs Using On-Screen KeyboardsKeyboards

Most are suitable for the computer-literateMost are suitable for the computer-literate

Many are expensiveMany are expensive

EZ Keys for Windows ($1,000)EZ Keys for Windows ($1,000)

Each specialize in specific areas Each specialize in specific areas (e.g., graphics, speech, writing, classroom)(e.g., graphics, speech, writing, classroom)

Other ProgramsOther Programs

WivikWivik Program designed for independent access without Program designed for independent access without

focus on speech outputfocus on speech output

EZ KeysEZ Keys Designed for users with communication Designed for users with communication

impairment because of speech outputimpairment because of speech output

DiscoverDiscover Windows and Macintosh compatibleWindows and Macintosh compatible

Programs for the ClassroomPrograms for the Classroom

Advantages of Advantages of Programs designed Programs designed for classroom use for classroom use include:include: Low costLow cost Text and graphicsText and graphics Restrict access to Restrict access to

certain userscertain users Ready-made Ready-made

selection setsselection sets

Programs for Programs for Classroom Use:Classroom Use: 1- Clicker1- Clicker

Inexpensive, Inexpensive, compatible with all compatible with all computer systems, computer systems, designed for designed for classroom useclassroom use

2- Windows Switch 2- Windows Switch and Pointand Point

Inexpensive, effective, Inexpensive, effective, flexibleflexible