II

PHOTOGRAPH THIS SHEET

S IL ; :.

LEVEL J ava( I -ea/ INVENTORY

z Aontem~ C#9SVoece &Co4?";,f#on a. ai rriu+ Modald~ f . e

w Tescce. z*&,qk Zhm+ .(,vb*4 sk j,, f~e 3-C A'rcaDOCUMENT IDENTIFICATIONTC T 0e.f, da . ; \0401fe IFoh. 2 ). l

DISTBIrON STATEMENT A

Approved to- public release;Dib-tribuiton Unlimited

DISTRIBUTION STATEMErT

ACCESSION FOR OfKris GRAMDTIC TAB D] 4UNANNOUNCED aL f,usTIICA O lllELECTE E

a ~~JUSTIFICATION OT118i I OCT 16 1981 I

BYDISTRIBUTION /AVAILABILITY CODESDIST AVAIL AND/OR SPECIAL DATE ACCESSIONED

DISTRIBUTHON STAMP

8110 15klDATE RECEIVED IN DTIC

PHOTOGRAPH THIS SHEET AND RETURN TO DTIC-DDA-2

-TI FORM 70A DOCUMENT PREESSING SHEET-DTIC OCT 790A

~ --~A

NAVAL POSTGRADUATE SCHOOLrMonterey, California

THESISVoice'Recognition as an Input ModalityI

for the Tacco Preflight Dat- Insertion TaskIin the ?-3C A.-,.raft ~

by

John Laughlin Taggart Jr. ICharles Darwin Wolfe I

3 March 1981

Thesis advisors: Doug Neil RGary .Poock

Approved for public release, dtstribution unlimited. i

iti

S- c XM _

SECURITY CLASSIFICATION OF THIS 6AAGE (Ut1%ou Dat S. neered) _______________

REPORT DOCUMENTATION PAGE BFREDISRCIN

V EPR 4MUR2. GOVT ACCESSION NO. 3. RZCIPIENT3 CATALOG NUMBERq

4. TTLE ~d Sb~lt.) . YYPC OF REPOR-. A PEIOO COVERED

Voice recognition as an input modalit Masr's Thesifoy the TACCO preflight data insertion Mrh18task in the P- 3C aircraft 6- PERFORMING ORG. REPORT NUMBER

V7. AUTHOR(@) 6. CONTRACT OR GRANT NUNER(s)

John Laughlin Taggart, Jr., and

9. PERFORMING ORGANIZATION NAME AND ADORESS 10. PROGRAM ELEMENT. PROJECT, TASKM AREA A WORK UNIT NUMUERS

ltNaval Postgraduate School3Monterey, California 93940

1.CNvaLLN OFFICE NAME AND ADORCSS 12. REPORT OATE

NvlPostgraduate School March 1981Monterey, California 93940 IS. NUMBER OF PAGES

14 MONITORING AGENCY NAtME A AOORESS1 dferentfro Cnring 011fice) 15. SEUIYCLASS. (of this taon

UnclassifiedIS. OECLASSIFICATION/OOWNGRAOING

SCIIEOULE

IS. DISTRIBUTION STATEMENT (of this X011H)

Approved for public release, distribution unlimited. M

17. OISTP18UTION STATEMENT (of the abstract entered IR Stock MIf it dioen *hRw)

1S. SUPPLEMENTARY NOTES

soI

It. KEY WORDS (Coathwe an fevwr* side itf ocooav and Idealty by block embot)

P-3C, TACCO, Voice Recognition, Speech Recognition I

20. ABSTRACT (Conthwm. an revrn. Ol*b It 8*0000M7 ME idvf I s-F - jAn exneriment was conducted to compare accuracy and entry Ispeed capabilities of a standard keyboard with the ThresholdTechnology T-600 voice recognition unit in the performance of -an operational data entry task in the P-3C aircraft. A computer -program was written to simulate the data entry capabilitiesof the P-3C operational software. Thirteen military officersexecuted a P-3C Tactical Coordinator's preflight task of entering

kD,~P 1473 EDITION OF I NOV 60 IS OIOL9TEfS/N 002-O4~ 601 SCuniTy CLASSFIcATION4 OF T$HIS PAGE (tMW D918 8011~)

20. cont.data into the Stores Management and Navigation Preflighttableaux.

Overall, voice entry was found to be faster for theStores Management data entry task and slower for theNavigation Preflight tableau task, with comparable acc-uracy. But, for subjects with prior voice input exper-

bohience, tablex input vcewas faster than keyboard entry for i

bot talax

DD ora 147

F1 0111-0 1*tIioW"spsrhieD*to"s

Ac~nrovadi f nr cp)i) r r1 o ~ ~ Ie-iI i tsI r i b It I ion r)1 r rn r

Vn ire rhpce)o1 1 mor , ict ri [ n tt ;,I n oxd, I it Yfnr tho Td3rcP Pr-f I inht 1),t~ a. prl rt n i, sk

Jo)hn 1 IAtj,'PhIi (- 1IqrL Jr.

h .A i r i rmec;t a foi Ph r it Lbei o

h fnr I tjq rn j) n ,e

ro(jijreetsfr h ee of

- - - - - - -- - - -- --

Aorrmrvpd by

Cha ASW Academic 'orour,

Aca emic Dean

ABSTRACT

4n experiment was conducted to compare accuracy and

en~try soeed capabilities of a standard keyboard with the

Threshold Technolooy T-600 voice recognition unit in the

airraf. Acomputer program was written to simulate the

datA en aanilitaek in the P-Coeaina otee

Threnmilitary officers executed a P-3C Tactical

[Coordinator's preflight task 6ientering data into the

Stores~ Mbnagement and Navigation Preflight tableaux.

Overall# voice entry was found to be faster for the21

Stores Management data entry task anu slower for the

Navioation Preflight tableau task# with comparable accuracy.

Butt for sublects with prior voice input experience, voice

input was fast'ir than keyboard entry for both tableaux.

urn--

TABLE OF CONTENTS

PAGE

T. INTRODUCTION ................... 9

A. THE P-3 MI3SION ......

B. GENERAL CONSIDERATIONS IN MAN-COMPUTERINTERACTION .... ................... 12

C. SPEECH RECOGNITION - AN OVERVIEW ............ 13 1

D. PREVIOUS WORK WITH VOICE INPUT .............. 20

II. METHOD .......................... * ............... 31

A. VOICE INPUT HAROWARE .. o........... 31

B. THE SIMULATION "...........................* 34

1. The Purpose of the Simulation .......... 34

2. Simulation Descriotion .................. 35U

3* hardware 39 eoeooeeeeoeooe.oeoeog

4. Simulation Software ............. ,,oo°. 39 I

C. THE EXPERIMENT .....e..................... 42 '1. Design considerations ...... 42e......e 42 1:2. Subjeets 45 m

3. 'faterials ...,.,... ,~.,,.,.. 46

4. Proedupes .... 4...C... ... ...

5o Data Analysis .,...,,,@,°°e,.° so. RESULTS ..................................... 52

A. ENTRY SPEED .......................... 55 [B, OPERATIONAL. ERRORS ,,,-.,.,e....e66

C. ENTRY ERRORS ........ 66

Fi

D. EXPERIENCE WITH VOICE INPUT ................. 74

E. OTHER CONSIDERATIONS 80

IV. CONCLUSIONS AND RECO,4MENDATIONS ................. 81

A. CONCLUSIONS •......................... 81

TIB RECOMMENDATIONS ............ 83

APPENDIX A. SIMULATION TABLEAUX .....°............... 85

APPENDIX B. SIMULATION PROGRAM FUNCTIONAL OUTLINE *, • 89

APPENDIX C. VOICE RECOGNITION USERS GUIDE ........ .... 91 a

APPENDIX D. SIMULATION OVERVIEW ....................... 92

APPENDIX E. SIMULATION FAMILIARIZATION ............... 97

!PPENDIX F. PREFLIGHT DATA SHEETS ....................o I

APPENDIX G. VOICE INPUT VOCABULARY ................ .o109 i

APPENDIX H. DATA FORMS*-o-*.*****................

APPENDIX I. RECOGNITION ERROR SUMMARY ............. .*11S

SIMULATION PROGRAM LISTING ...... ............... . .. .t122

LIST OF REFERENCES .,..... .. ,,,,... ...... .. 133

INITIAL DISTRIBUTION LIST o . . 0o ... ° o....... ,134

21Ii

6

I _ ~ _

LIST OF TABLES

NUMBER N A M E PAGE------------------ -----S C0~ --- 0-------eeeee-- ----

I. RAW DATA TRIAL ONE S................... 3

TI. RAW DATA TRIAL TWO ............. ..... 54... SU

III. MEAN ENTRY TIME SUMMARY ....................... , 56

IV. ANOVA: STORES MANAGEMENT TABLEAU ENTRY TIMES ... 57 !

V. ANOVA: NAV PREFLIGHT TABLEAU ENTRY TIMES........ 58

VI. ANCVA: STORES MANAGEMENT TABLEAU ENTRY TIMESTACCO VS OTHER BACKGROUNDS ................... 64 j

VII. ANOVA: STORES MANAGEMENT TABLEAU !OPERATIONAL ERRORS...... ........... .... *....... 67

VIII. ANOVA: NAY PREFLIGHT TABLEAU I

OPERATIONAL ERRORS .................. ............ 68

I!IX. BASIC ERRORS - STORES MANAGEMENT TABLEAU ....... 69

X. ANOVA: BASIC ERROR RATESTORES MANAGEMENT TABLEAUBY ENTRY METHOD......................... .. 69

XI. UTTERANCES WITH.GREATER THiAN TWO PERCENTRECOGNITION ERROR RATE...............,.... 71

XII. VOICE ENTRY TIME AND BASIC ERROR RATE eBY EXPERIENCE LEVEL ............................ 76 1

II

,111

LIST OF FIGURES

NUMBER N A M E PAGE----- S----- ---- - --- ---- 'I

1. CONCEPTUAL DESIGN OF !HE EXPERIMENT .............. £3

2. MEAN ENTRY TIMES -

STORES MANAGEMENT TABLEAUTRIAL I VS. TRIAL 2 *........................... 9

3. MEAN ENTRY TIMES -

NAY PREFLIGHT TABLEAUTRIAL I VS. TRIAL 2 ........... .. , ..... 60

L4* MEAN ENTRY TIMES -

STORES MANAGEMENT TABLEAUVOICE VS. KEYSET ENTRY ..................... 61

5. MEAN ENTRY TIMES -NAV PREFLIGHT TABLEAUVOICE VS. KEYSET ENTRY 6...................... 2

6. DISTRIBUTION OF ENTRY TIMES -STORES M44AGEMENT TABLEAUEXPERIENCE VS. INEXFERIENCE

WITH VOICE ENTRY ....................... ..... 77

7. DISTRIBUTION OF BASIC ERROR RATESSTORES MANAGEMENT TABLEAUEXPERIENCE VS. INEXPERIENCEWITH VOICE ENTRY 78

8. DISTRIBUTION OF ENTRY TIMES -NAV PREFLIGHT TABLEAU

EXPERIENCE VS. INEXPERIENCEWITH VOICE ENTRY 7.....ooo....... .............

4 3"i 2jw

g27t

N~~I ,

I n

sol )r nrfe r;,-SD. Tf a~ETE~%I)~Cen rrra

co!YmmunlcetlOn c an eccr' e ovP r e~~o ff- l -'Iin- th t-3 nrn -a>n 1hjnr, jfl the l envirmre - m ao u-nn-

[ eat e nee t o he h%!orinuslv enter-- t , _

sucn as rccu rs our In2 ore f'i-2nt da er st rc r

weaoons i-ventory anj nev1aetion rret-Iiofr -aa n*-*

j weanon sy-sterr.

The P-IC is -i four enuine, Ioii win;- ai rcraft -desio4

for oatrol a3nd! Antisutarine warfare. Tt carries a- reM wOfj

t,'Ive ofies ndenisev ecmi iaofn. ar

Javioator Communicatnr (ULVC3')I, Fliont Pn-no~er R~~ej-Stat ion lIe and 3 (SSlSS-2, S*) , Infli-aht tel;cknCeI an a ndO an 7Oi-dnancetan.

The mission of the P-3f is varied0 ana inclr,-es Serh

and R--gc-ue, Ptboto/Recon, andl Mintnie n Addto to '

ersr ?k of ASif . The ASW task o' W-e -c i

* I=

deoetion I e I her t1inf n -r43tr prti

nt t j-ZS 1S -issor r~c-e r% eavCe'etP rssess a.

t S

t a ea

zrc sn and is- I :t ace----S ~aa?~ e r one ra tor S

F and va-ious aircraft e-luu-nt. Vtt~n nr-cse hs

1fl01JV tr,:

1. Control, synchronize, s _ -a--aeo n

I ~~tactical and auxiliaryo- raV

*r . rvide for roeroolo I yi.4 4 C T aa *.-r S~ je i nflight recovery orev~ Bing oos -ht an-alysis of

2- theM -ission.f

."anace a-a cont rol te ai rcraft avfato --Ste0-S. ]4. Vanaoe search stlore A--4 weac-nn 1nvart-r-0s

5. control search store -no w-aoaffn lae ij6 . Cotn-unicete with *Vher St at --s via oatsa in and

7. oniorand control srObof'-uv rece-iver assionwerts. _

R anaoe ano control the ei@CttoiC SUPC easureS

q. Perform orefliont - ai noe- testinG Ofj

F associated eouioment.A f

most of the date tnat is Oorresen - mte AS-l isW

bsdOn instructiors that are Contained i ,-! t- one rat* ional

orogras- which is loaded into ---orv 4-rn-- A -A-netic ta.

10-

'14.

Additionally, oata which ~s rission sreri fic i s loaded onto

the end Of the ooera-.ion;?. Proor;%n t ar,; i nt o a o r e fIi oht

data insertion nrog1 ram or VD1P ky oersonnol from trie 5SW~r.

nne of the areas of difficui~y :n coinrietina the PUTP is

the insertion of qearch stores into t~e tStorns Management"

tableau. Search stores t~re comorised of sonooouvsp smoke

"Stokrs andqmet bihterooreeu C~aqiqrteteetsa

and subsequent to lo-idinn of the oo'-rallional r rog ram'. ]he

distractions from other crewmemvers and because of the-

redunant nature of the task.

Previcus studiest byt e Ikef. 11 and Fueoe and Greer

iRef . 21 have looked at the work load of crew members and 1have exr~lored the' Possible use 04 iUtofpated speech

technolooy to increase onerator nerforrnance during various

portion' of the P-3C mission. This stuav will evaluate. the -'use of the Model 1600 Threshold Technoloay, Tinc. Vjoice

recoanition unit durinq pre-tlicdht dita etitry tasks

oerformed Dy the Tactical Coordinator in the P-3C aircraft.

I-Results of the voice data entry method will be compared

with those usinq standard kjeyboard entry Method considering

the metrics of 1) entry speed, and 2) accuracy.

R~. GENERAI. ru!%STOFRA I UN'S I 01 UM~t INf~TI~G NI

Mori has fine cnannel - qupecn -with which he flops most

of his comrruniratinq wiOh other necole, and three channels-

manual, visual and audio - with which ne 'foes most of his

communicatinn with his Mach::-es. Tn oenera1, manual m-'ans

are uspdj in -ran-comoutpr communiration and visual means are

used in comouter-man communications. Keyboa3rds, of ccou rse,

are the rnrimTArv inout device in most aoolications, However,

that dopsn't -ean that thr-y are, '-ecessarilv, the oest tyoeF

for most acouiications. The followina Qutestions ShOUld heI

1. Ters the inorut al'ohanurneric:, strictlv digits or words,

or senten'ces etc.?

2 Tsthe inr)Li' strictly formatted.'

3. Ts there considerahle mental or visual effort reouired

to menipulate the diate before it can be entered?

4l. To what extent will the inout ke interective with thecomputer?

~.What wil I bte thfe mob iIi tyv requirements f or thenoerator.

6. Ts it desirable for the operatL.& to he able to performseconcdarv tasks alono with the data entr-y taskl?

7. Will the oroerator be unider unusual environmental

Stress?

8. Wfho will the ocerators be?

q~How much experience will the operators have w t h thedata input device?

Or. How important is -incrut error rate to the application?

1-1. How~ important is entry speed to the apolication?--

12

12. ~Il I the onerator he re-aiui redq to i nterf ce wi tf oth Pr

nPeritors while 1 iq tisinn thp inotit diev ice?

r.SPFECH RFLOGMITIrliq A,, 0% FRV1Fv

Al human l ang t~ o; of q ro u o 9 f 5o un Ms ca IeI ea

Dhonernes which atr C, elli by the interaCt-.o of various

speech articulators: lios, tor-ou, , teeth and palate. Ihere

are five, ceneralil accepted catejories of Articulation

rRef . and 41~

1. PLOSTVFS or SIl'PS which act to stop the passaqe ofIa ir, Such as 't' in "too" .

2. FRI~CAITVES which ape caused by fnrmina a narrow slitfor air oassage; Such as 'th' in the word 'their'.

3. LATERALS whicr are formed by closing the middle lineof the mnouth;i qucn as ']* in the wor'd 'laurih'.

11. TRTLLS which are formed by the raoia vibration of anlarticulator SuCh as the t rilIIe # in FomI anguaaes.

S. VOWELS which are formed by unobstructed air flow overthe vocal chords.

In English, there are about lb different vowel sounds

and 2? different consonant variations* orovidiino "about 38

different ohonemes. Besides the actual sound generated by

the different cateaorie-s of ohonemes, the intensity or power

generated varies sig~nificantly fro," case to caze. Vowels

allow much more nower trins-nission thtan consonants, with the

greatest di'fference oeing about 28 d8 a factor of

approxizmsteiv 68-0 (Ref. 31!

Speech lauality' is a rather elusi-ve term, but can be

thought of as a measure of two qualities! oitcb( frequency )

13

t 41w.C

and louaness (power). Intrilit-Ility s a n even more

elusive rnarameter. Tt varies with oualitv, context,

vocabulary size aond haC~orounj noise level. Generally,6

tntell I i iitiv I C enhanced when the s iz e of the users

v ocabulary is reduced, as is the case with air traffic icontroller-to-aircraft comrmunications (Ref. bil. Both the

nilIot of tne aircraft and the cont rfoIIe use standard

ohraseology from a defined vocabulary for the bulk of thei r

transmissions. Also, intelligibility is enhanced in this

situation by the ex.Pectatinn on the part of both

narticipants -the controller and the% cilot -as to what the

other will say, in effect, further reducing the size of the Ivocabulary. Aircraft comnmunications also make use of

another aspect Of int'lIlioihility: that of improving the

Dower of the sooken sounds by usino the phonetic alphabet

instead of standard letter oronuinciations or the use of the

word Orocero instead of 'UK'. ISince human speech often in processed by electronicj

systems, 6nother factor to consider is that of freouency

filterino. Some phonemes,, such as the * ssss' sound are

sharoly affected by filtering of frequencies above IA KiIZ,

while most short vowels are affected by filtering c

frequencies below 1 KH-Z. Althouoh frequency components of

human speeen vary between men and women, from nerson to

aerson, and even from day to day f',)f a single person, most I

are contained withIn the- range of 40~0 H7 to 4000 HZ. The

4.l~

L

INA

bul k is hetwpen Vri7 anI 3 tWZ rwPf. 5. Generallv,

filterino will not make sppern unirtelliolhle. However, it

will make it seem 'unnatural.

The very nature of sceech, with its rich endowment of I

sounds, inflction: iios end variety, mak S it an

extremely difficult modality to ouantily. Lea (0ef. 51 nuts u

it this way:

"No two utterances are exactly alike, and the

communicative ability of spech is due to resemblance

between successive utterances."

Thus, it would seem that the real challenge of human

speech n.ocessinq by machine is to determine what features

carry the information in sreech And then use them to process

the utterance and decioher its 'meanina'.

Conceptually, there are a numoer of aroProacles to the

development of a human sneech orocessing machine (Ref. 51:

1. ALOUSITCAL SIGNAL APPROACH: treats the problem as

ourely one o4 determining the fleauency spectrum of

the speech input. This orocess l.o' been enhanced by

the develooment of the rast Fourier Transform (FFT)

aloorithm which allows a considerable time savic indoing the spectral analysis.

2. SPEECH PRODUCTION APPROACH: considers the methco of -

speech Droduction in humars and attempts to decioher -

: tne speech by considerino the effects of vocal tract

resonances, vibration of the vocal cords# and methods

* of articulation.

3. SENSORY RECEPTION APPROACH: Sugqests that speech

could be deciphered by duolicatino the processes that

occur in tre ear a,6 the 4-nt-arrtive components of

the brain.

4. SPEECH PERCEPTION APPROACH! Attemots to extract

features and make' categorical distinctions that are .,'

exoerimentally established as being important to human

MWr

___ __s_ !

Zr - 7-

,erceotion of speecn. all so-called vowel-listinuishers fall into tih- cateoory.

Soeecn processino syStpns: are naturallv divided into two

distinct catecories: continuous s0e0'0 systems and isolatea

soeecn svste,'s. Isoltpd sceec" systems oenerally deal with

distinct utterances, tvpicl'v of uo to two secon-is in

length [Pe 4 . 6). Also, most current systems require a 10o

Is rause between utterances iRof. qj. N-te the use of the

term utterance vice word, as the ut terance may consist of a

single word or a ohraqe. jzolated speech processors have

found their way into industrv in qreat numbers. ]hey allow IA mail service employee to nv his hands free to rroperly

orient packaqes so that he may announce their destinations

to the voice recognizer. They Der-it oaraolegics to use use

£ voice-controlled wheelcnAirs. lhev are used on oroduction

lines and per-pit user mobility in performino ouality

assurance tasks. Most current isolated speech orocessors

utilize a f:rm of soectral analysis to 'recoonize' the

input.

Continuous sneech nrecessinq systems have an inherently

more difficult analysis to oerform. They must actually

interpret the spoKen languaoe. This is a monumental

undertakina. Even if we do not consider the oroblem of

interpreting homonvms-- words which have exactly the same

sound - there remains the problem of defining word

boundaries within the Context of sentences. The boundaryf

16

_2

sounds of a word 4rp hiohly oeondent on whet words occur

immediatply before and aftor it as it is spoken. Also I

Contractions Occur freoupntly, further molifyinn the word

sound. Thus, the phrase "would you net..." mioht Smund

more like "wouja get..." when ectuall% sooken.

The locical follow-on to a Syste- which could recognizeMEt

continuous speecn woulo ue one which actually 4ould oe able

to understand it. Tnis is anot'her quantum lear, i n

complexity. V'hen humans communicate with -peech, they use a

CMODex, learned ben3vior which considers many a,;pects of

the incomino pattern of soeech. A human considers the I

context of the utterance, the task b-inq performea and his ii

understandinq of Englisn syntax to form an expectation of -

what the words will be and what they should mean. !hen he t

Performs semantic analysis on his oerception of what the

utterance was to determine if it makes sense [ef. 111. if

not, the process is repeated. This iterative Process is

continued until the inout makes sense.

Continuous speech recoqnition Svstems do currently

exist, and they do work. However present tecnnolocy has not

been able to provide the execution soeed n6cessary to allow

these machines to operate at anyth-ino aooroachino real time.

They may take many minutes to Process 30 seconds of speech.

Tt is certainly valid to ask wLy it is that, given che

difficulties involvedt we continue to pursue the use of

speech as an input modality.' The answer has manv facetst

17

IrI

some of which Are more obvious tkan others 1Ref. 71. First,

it is speech Whirh T.an uses in nis daily communications with

others. Thus it is bOth convenient and natural Tf

artificial svn t ax or unnaturally restrictive vocabularies V

can be avoiapd, the qoeech input lanquaae requires very

little learninq or adantation as woulP oe necessary with

special kevboara cooes. peech is a very high caoacity input

modality. ]Able 1 shows that tna date rate achieved when

speaking non-technical orose is nearly twice that achievable

ty the skilled tvPist. I!s ino sneecht i t i s oossiole to !=

communicate with otner oeOolI and the computer|.

simultaneously. This .av have advantaaes in certain time-

critical anolications.

A maior advantage of usino snpch input is that it

allows the user unusual mobility. Since the input device is

a microphone, nenerallv worn as an attachment to a head

band, there is comolete freedom within the area allowed by

the length of the nicroohone cord to move about a. work area. KThere is actually freedom to move in any of the three axis,

to any arbitr.-y orientation. At the same time, the system

also allows suoplementary tasks to be oerformed as the vdtce

input is being made. Certain, inDuts to critical operations

may reauire verification before continui'n on to a

subsequent step. Generallv, this would require two

successive keyboard inouts. This orocessreould be performed

J18 - f

2= .t vlrrrr ..... . .. .

f

IHmore auickly if voica input was , sed As a verification or IIorimarv command innut device.

One nuitP interestino asnert of Qp-ecp com-u-ication is

that each Person's voicn oualitieq And- -anneris-s are ouite

unique, and may be used to verify the soeaker's identity. KThe qualities of the vnice als- channe for a sinole Person ,

from oay to day, in response to stresa, Pmotional conoitiOnl,

cols and other factnrs, which may cornrlicete the oroblem.

However, aiven a sonhisticated enough orocessor, these

chanoes coul be uSeo ov a mechine to tell its user that he

has heen unoer too much stress a-a that he shoulo see a

doctor and ston workino so nard-I

Of course, soeech inout is not a Panacea ano it has its

disadvantaces. Ihe constraints of a-tificial syntax ano

hiahly restrictive vocabularies may outweigh anv claims to Iits beino natural, thus renuirino consioerable learnina.

Backaround noisp can adversely offert the recognition

accuracy of the machine. The individual differences in

voice characteristics which -rakes it Possible to verifv a

oerson's identity, also qenerally makes voice input systems

one Person machines. Thij is meneraliv manifested by the

requirement for a training session, during which a

-roSoective user will soeak each word of the vocabulary up

to 10 times. The results are loaced onto a cassette tape,

which must then be read by the machine orior to its use by

ary new user.

19

0. PRFvTu-IS .dn' WIT" VoirF IPIIl

A techrical r eort ndM 1 Qi°ed in 6ppte-o-r 1977 by JThreshold icI'ncIo-lMv Jnc. ftr thn --rnmA Air DavelIooent

Center,e 4 . i descr-il-es emrk which compareo the Y

effectiveness ni thrpe -jiffp p t input levices u-'er

various conditions. The thrpe i out aevic-s tasted wPre a

cOmmOn rorouter terminal, a braf oen, ano the OIP 100 voice

recoanition system cuilt T Tnresrml Tecn!hOeOy Ike

Graf oe- is a somewnat unusual dr1viCanhich is used in the

same Afnner as the more modern oiait.zer taclet or CPI lightrfl.. it allows the us-r t- innut a woro ov touching the

Oevice to the place w^ the wnrd anoears on a menu'.

The treft oen 'ifferst *r-m the -ore -odern oevices in that jiit generates a snark when oressed4 anainst the menu the souna U'

of which is received by sonsors located around the

oerioherv of the menu area. The sensors allow the system to S I -

thus fix the Position of the pen when it was Pressed against [the renu, thus, locating the desir.o inout string. I

There were two cateflories of tests used in the

Comoarison: a hion speed Oita entry task and a hich I'cOmPlexity data entry tasw. ie high sneed data entry task

renuired subjects to enter strinas of characters as they

were oresented on a Rurrnunhs 16 character Self Scan

display. Numerous fectors were used as variables during

- - this experiment, among them:

1- Length of Strings

20

3. The tyne o# chiracters, 0e-1hniirc or srcl

Tne h-ano occunation tastc, ~fef jsed, con-si st ed of the'j

renuire-rrent to si-ultaneouslv deoress tno cushbuttons

seosrated !v III inchas o.'fo rp the reoui red i nout strinos Iwoujld- I-e disolavyed -or- tn0 Qurrouo7hs unit. *

Tne results were categorized by factors affecting entry Ispeedi, inout error rate, and-. ooerational error rate - a

measure of erors ren'ainino ifter the noerator corrected all

of his ct'served errors. Tn this test, the keyboard was the Lfastest device - renu ir ini 20 vercent less t imeF per

character than voice wtich finished last in speed. This was [

fri 'Parilv -a resulIt of t 6te r, jc n h ioher A nout error rateI

e0Ofstrated by the voice unit - twice that of either of the:I

other modes. Al~oanumeric dat;a r e qui rred. -225 Percent more-

time than nume r ic ent-ry for all of the devices anid wast

jugdthe most sianificant vaibe affec-tino data entry[1

speed. T h-er e was no s ion, f ic ant difference in the-

operational error rate amiong the6 varidus entry devices. The

most significant factor affectina the errors remainiria ~after -

c-orrection mas the type of characters used. Alohantfmeric

Strings hao neagrly -twice the ?rror rate as pure numeric

strings. This w As partially attributed ,to r-eadin-g of r- -

inepetto rrors such as mis takiiio -3 zero for the -

letter 'o' or tbe number o'e f or. the W1;tter ''

21 - -

-~ \ tiI________ - -Q

-A- ~ ..-

The secona enar:l cateanrv -f tasts co-norisaO what waS

called tne hi0 h conloxitv data entrv tak. iHs task

simulated an air trarffc control flinht r|in aendments ano

corrections scenario. !he desired amendment was aiven to

the subjects 'I text for- And thay were required to enter

the cha n nto the sySten. The sutiects were first

reouirec to enter tn* category o f the amiend!e nt (CAN-CEL a

flight, ameno routin-1, At jOFF A *i aht, etlc after -hicn

the SyStem would o-esent orootS to Ootain the octa recuirec

to carry oult thn recuest. The text o f tne detired chance

contained aI1 of the information reaured to make the

cnar-oe. Poweve-, in the text verSion,'the date items were

not presented in the sane secuence in which the system

oromnts reoueste4 the data. thus tht subjects were recuired

to interoret the text version to determine the oroper

responses to the system oromots.

The Sbg-I~ ficant variat:'*-3 included hand occupation,

subject experience with the entry -evice and number of

trials already completed. 4aain, factors affectinp the

three cateoories of entrv speed, operational error rate, and -

input error rate were examined. The choice of entry device

was a sionificant factor in entry soepa, with the voice

system and Caf Den not sionificantlv different, out both

about 30 percent fatter than the kevboarOeven tnouoh the

keyboaro uSers were permitted to use two-letter

abbraViations o r the commands.

-" 22

... . -

Exverien ce ieval, flfaP r orovarlel a n eic-n greater

variance in e-ttv svpel. IIc, inc-epse in entry time per woro

f or anqanoeriencedi kev-oar use-so. us'~na tne kevooara as t he 1

LZ --)'~trv dievice was 5:6 oercnh. Tno- increase for inercerienceo

Graf Den use6rs usiao the braf Den As the entry device was 14

nercent: and' 1nr, lnpxneriele vnice rttoonitior svste0~

ujsers, onlt C p.cent' I fUSr it wOUla appear that

inexoerlenced- ;-asers of voice input achieve their max1imum

daainput sreeo with m'urrtls rcieta inexperienced

users of KevhoarA input. Not? t-1:t ti-is is indicateo for 11enItry spee-d only' The lueStion of e-ntry accuracy wilI te

addressed subseauentlv. i60-he in occue-ation task rqO-cuire

depressing both- of tote pusho=uttons previously -ention.ed for ZI

3.5 seconds for each inpOut -.essaoe. As rniont he expected, I-F this task affected the Gaf ppn users (30 Percent slower)f

LIand the keyboard use-S (26 percent slowier) to a much greeter1

extnt han the voice uSerst0 nercent Slower). lAqithere were no siZ iicn differences between the

three ent ry de vi ces InA operational eoror -rate.

Sioniticantly, though, the bUtlk of the vomice syste*p errors-L

-were reeeonitibn errorstie h-ioh basic-error rate) _;hile the

malority of the errors with tie other two systems were

Peadlino or interpretation errors. As a group, the

finexpoerient~ed users of all three incut deie ufrd a SO3

cercent increase in total, word errors after correction.

There was no signi'lfI Cant i ndicat ions of differences in this

_423 -

observation amonQ tra. tnrer n'Prodecz. T-tus, i: arrears

that although ontrv sonei suffers te ss *r nexoerincef

with voice 4-out as tne ontrv -on'e. *ne br ror rate s a 64-utI

SO oerre-t hicaher renardltqs -j ntry -~ Incombination I

tendeo to increate the nukr.f roaejina errors. th csic

'rror rate o4 tne voice inrut srF45e. ws to-r t i es hIner

; ta- tnAt of tne oth~er ten -o-es. This WaS cue to its 0--or

recoonition perf nr-atnc Anl con'usinQ error cIorre-ztionf-[systeffz- The cnkrroction al~*~ lic.go-a -3 hcspace Plr a

j -orevious character or an erase no' the entire jflout line.I

There was sn~me confusion ovprt meaning of thne correction

woras, So that the LQASE cema-0-_- was occaspionally useo wheni

a oacksoace was Aesiredi, thrb recauiring the entire tireJI

to h-e reentered. Aaoit ional IV. -h e coor recognition

oerfor-ance led t~o numerous incorrect watches with these

correction words, causino addtin0 cnusion.

An FAA recort relIeasel i n Aucust 1070t tRef. 91,

describes work done by its evoerimental center on the use of

a voiceL innut system in a sirculated air traffic control1

environment. There wer;e actuallyv two ecXOrimaflts eonducte6.il

the first ex-am-med just the recoonition accuracy of the VTP

100 voice recoonition unit manufactured nY Thresbola-

desc formive of the data eA-trv laguaqge already in use wt

Tn., uin avcauar ~ tad2d teh

keyset svstc-m,. lhe secnn -r1*ri-~ent comnareo the sneel

and accuracy of the voice innut Kyqtpip with tnat of a eyspt

System currently in use within Vhe a r traffic control I

System.

Tn the first experi iint, a- %o-rational vocabulAry %as

divided into three sul-vocahularips: Nlessaqe tynest15

woros), renqraohical Fixes( ? wnrds) and Dioitt ano Control

Words(Ie words). f)ato for each -f these subvocab|laries was

maintained saparatelv. rhe suhvocaciularies were toen each

expanoed into e list Consistlnq of ten renetitions of the

member words randomlv ositioneki so that the Messane list

contained ISO words, the Fixes list ?10 words, ano the

Dinits and Control words 00U. Each subject was required to

read these lists durinq multiple testina sessions - ten

sessions for the tessaoe ano Fix subvocabularies an five

sessions for the Lontroe words subvocaularyi a

The resuitq of these tests demonstrated some interesting

characteristics of thp voice irout orocess. Considerinq an ierror to ne either a fpilure to recocnize an input(ie. no

output strino) or an incorrect match, the Messaae

subvocabulary had the hionest error rate with 3.2 percent-

the Fixes subvocabula-v nad the next highest with. 2.2 and

the Diaits and Control words had the lowest with 1.8

percent. The Message subvocaoulary also was the first

vocabula-py tested, followed b-y the Fixes vocabulary and,

finallv, the Control words vocabulary. Thus, the subnects

L

25

tendea to decrmpse tnpi- err-r rdte as they 0airpo

exoerience with toe SvStem. Tpe -iroo from .? Percent to

I.P percent renrpsonts a " nercent iecrpose in error rate,

a figure wnich Areas closelv witF tim results of reference

l Ref. ,1 vresenteri orviousl y.

Tt i s also i-port -it to note the variability in the

error rate within each quhvoc4oularV. There are words in Ieacn which show error rateq frnm one fourth nf the averacie

to four times or more ot tle averane rate. Not shown on the Itables is the fact tnt fhe performance of individual

speakers shows similar variability. T he individual soeaker

Prror rates varied from zero to nearly 7 percent. From one-

half to two-thirds ot the errors reported for the most z

error-oronp words were accounted for oy one or two of the

sneakers.

Thp secfsno experiment was deSioned to compare the

nerformance of the voice input system to a currently used Ikeyset aevice in scenarios which simulate an actual ATC -

nonredar control position task snmewhat similar to that useo

in the HCDE exnerimet descrioea in reference [Ref. 8]. Two

sets of 100 realistic messaaes were constructed using the

three subvocabularies tested in the first experiment. These

two groups of 1041 messaaes were further aivided into four

oroups of ?5 messanes which were used as a sinole run with

sh-rt rest periods oetween -oups. The proportions of the

various cateoories of messages was carefully controlled to

26

-iMU~ate thP aoo'-Yivlate Tr'Y hiCh > cm'ntrollep h)Ul(

5actuatl IV ee whi e :ic' UA 1 1 Euorforminq the Pon ra d ar

controllers OO~itiOn iob in an rnrout'o Centpr. The order of

the mess'4ues "as rar-voom, -pPt h essages didH not

W noreSent uate in the S.irne order as tlie svsterr reluireo it to

he enteren. 11hjr Ya s necgassary tnr e.ric' of the operators

to translatr. the dlesired entry into trie Syntax Which his

entry rdevirce reouire-d an,4-i order thl rdaa So that the host

system -nuld accppt it.j

Five onerators Oarticinated in this testr Only one of

whom hiad particinatei in the first exoerimont. Thus, four Iof the five hadl no exoprience with voice e-ntry dievices ano

renuired oasic trainini in the -,3rooer lisp of that system. It

shoula als0 be noted that tthp kevset entry device did empoloy

so cafl ed 'quick act ion ' uttoris for the most common mpssaae

types. This allowed the Pntr\y Of the msore frequently

encountered me Ss ane t yoes w it h a sinale key stroke. AllI

other message tynes ovre entlrad usina a two character

abbreviation.

I Data was collected on hoth data entrv sneed and error

1 rates for each of the five narticioants. Total errors were

divided into three grouos,accordina to their cause:

1. LANGUAnE errors caused by usino an incnrrect command,such as "droo traCK" on the voice svste.!n or "IRS" on

£the kevset instead of "cancel" or "CN" respectively.

2. FORMAT errors caused bv not using oroper delimitersor so8ces between the narts of an input message.

ii 27'IE

2[

3. ChAt-,ALTLP errors CAuSed hy reco nitinn arrors with the voice innut nr KPyStroLe errorq with the Keyset.

Voicp innut de-onstratea a significantly lower overall

operational rror rate. That is, errors rma1iinng -fter the

operator naa finishe the trial. The overall rate for voice

input was less than half of that 4 nr the Keyset.

Sionificantlv, the voice itouL demonstrated ;ts forte for

easily handlinq St rCtlv formatted nutcut Lv a formatting

error rate of zero. The character error rit3 was 25 prcent i

S:less, ara the lanouage Prror rate was b6 nerc-nt less using

voice incue. The fact thit ]anou~qp errors are three times

more frenuent usin the kevset than th-y are u~inq the voice I

system quvo ots the concert of ' natural lanouage'i

advantaqe for voice Inout. Cnrrohoratina data was cathered i 1

on the 'translatinn time' for each message - defined as the

time Period hetween receiot of the desired message by the I

operator and nis first data entry. This rouohly

corresOnog to the time reouired to translate the text Areouest into a syntactically correct system message. VI

Throughout the testing there remained a distinct advantaqe

for the voice inptjt in this area. Tnitialv, the 7:_

translation process took 50 percent lonqer with the keysetL

This advantaoe continued to accumulate until near the end of

teStino, as the users of t-he voice system became more adept

it using it, translation time was 100 oercent l'nger with

the-keyset. Aoain, there was considerable variance in error

28

-1 _ _ _ _WE]

A-i

rates a-mono tne five o-epators, wifnr ver1ce inpout showing t1ke

most extre-re effacts. I Ie ' 10 - 3 t ' ones, orndjc -o v- or-re r otI

maan it uoe -iore e rro rs t h;4 t he 'he qt ' o-ns.

The results for tnP Iatae entry r a tes showed no clIea r

advanta4p to either )a' ut -'vice wrian all of the input

messages were consifierea, altho-jqhk thce fastest rate- wasrecoried oy o orerator wriile ujsir- voice inout, ana theR

Slowest rate wAS recorded by' ore onerat-op usini the KPYset.

z::::rhe::enat ti f anal yl scon-;i Her:-Ionly tnp:tynesof

messages whi r!h reou ire-' sho rt c o m -a n Hs and mostIy dig)i t

the current work. ]he conclusionc have Provided the Iincentive to pursue i nractical 3prllicatio-n of voice input

technalooy to current Fleet oroblems. A brief summary of jthese conclusions aornears hello-.

1. Voice innut tech-clony his been demtonstrated to have adefinite aovantaae in Oata entry rate ano/or accuracyover k'evboar-j devices for aproliCationS requiringsuhstantial mer-tal or visual effort, or tho~sereouirinn. tereicus, strictly for~matted inout.

2. Very hiah recoonition accuracy is possible withcommercially avail,)ble units.

3. A users lack of exoerien~e affects The data entryspeed of voice input mr.uch less than it does keyboardinnut. This suggests that 'trainees' mialit achieve4their 'raximu' inDut speed with voice input much soonerthan they would witn Keyboard input.

r 4. Discr~ete word voice recooriition units are not wqellsuited for date entry tasks reauiring entries of larme

_ _ _ _ 17 -29

A0_ __ _-

numters of sin'-ije CnaraCtetr~s mrn)uos 04 ThiCh cannot jt, e o u tp ut b y t t v nice iflf)ut un It with a singleut te rar CP

~.Cu-rent voi ce i rr'ut kin i Are sensitive to operatorCnracteristics ano nrav reali re erir othI

vocabuidry if those characteristics chanaeaporpciah1 v,

A. data e-trly (J-vico shoula hav, a sirnnI',looical a n tiPasily undsrstnodi Correction svster. I

30L

A. VCITCF TN~PuT PA~APE

h !he Thresno1'H AIJO is a -isc--ete snepch vrecoqnit ion unit

f-anu #(N ttiroad by 1hresholo~ Techrlolocy Tnc, Pe Irai-, New I

Jersey. it has Avotbauldry Cainaci ty cf u utt er anc e s

each 'nf which ran he fro- n.1 to two seconds in lenatn. A ~

minimumi IVO ms P-itie is renuir-o netwe-n uttprances in order ifor the macninp 4-o aafin- qoperh boundAries. An oerator may

speak As raoialy aq he d-sOreso as there is n o requirement[

for nile to wait Ket~ae- uttpranceq for the machine toI complete orocecs'inn ^n thie orevin'us one. rowever, the 100 ms

oause must nccur hetw-en eachi o4 thp utterances. Processinq Itime is deoencent on the size of the vocabulary fRef. b1.

However, typical t imriS are oracticallv instantaneous

averauino ?50) ms as renort-d by Porock tRef. 101. The ranae 1

is aoroximateiv 100 mq to 500 mns. Procpssing time may be

reduce-I t~y restricting the vocaoularv search to any of uo to

16 different sets of suovocahularies. fhe words in each may [he exclusive or shared a-.onQ any or all of subvocabularies.

The system consiqts of an analog speech orocessor, an

LST 11 microccnniuter with a diqital inout-outotit interface, :a display screen and keyboard, a iicroohone/P'eamn, and a

Cartridge tape ~ri ve. Ttie speech processnr and ImiCrocomouter are nackaqed in a single unit abovt the size I:

31

o f horal utae, ~ ~ b rpmnotelIY ocate0 aur' to

2000) feet 4rorm t"e r eTCinnfl cnroents. tlectronicallv,

the svste' -1c'~ Yi~ any TA stanrjd)rd P3-23er or 2n m'a

Crrorlt 10Oo Ir't OPV'Cp An"~ it-. inn-i a P oe a r tc a

==host Computor I I le; t n At f rom a Common' Vev)o a r tPrm Ina.

Thus, thorn is no %pecial nr-ocessira. rpquire-i of thle o Ut pt

be4ore it car. he usedi ry t'e niost qystem.

The sueech processor uqe An Undliqcboqed algorithmf to

extraCt the signiica3nt cntmC'oneflts of the snpch inou*. Tt

then converts tnmsp 'n:.s-igJhtq' into 1-intal sionals which

can c.e vrocesspa hv the micrpocomouter. the microcomputer

41ses a-~other onaiscioseuaQ loorjthm to Compare the ciigitizea

iflOut wi t h '.'at haq been stored in its volatile

serriconciuctor eor. 1' tr.- mecessarv numner or ciualitv of

char,,cteristiCS aora5e 4 t h a nv o f t hose stored for the

vocabulary, a ~t ch i s iec I ared, and t hse predetermined

Output t str.flg ntv to 16 charicters is transmitted to thle

host system. Tf no tc'is -ade, an~ audiole tone 7#S

produced to so in-jic;t. .

9efore the Svstem is usee~, however, the onerational

vocabulary must be 'trained*. frainino consists of speaking-

each of the utterances in the vocabularv 10 times in

succession leavifln th-e -inim 100 ms pause between each.

The system. must also op aiven the Character strings whichJ

are to De outou! when a memoer OT the vocabularv is

recoarlized. These outout strinas are determined bv the-

3 2

VA _

_

operit -r ort ior t' th:- svs'-m'q Ise an-! entereH 'nce usl'"Io

the the ter,'in~I kPytbo-rA. n'ir- t~j~ h e en c omv Ioe ted,

the contents 0 f t he i"r or 1 j t Pr core ~pqrv wnerP t Ii s

infor.,ndion iS Storer-! is rea- O'jro a~ cissetto tane usir'Q tthe

taoe orive ijrst. Trnis -tis t ke oi)r., for the? f irSt user a ftF-r

07 a new Vocabulry has h'ean 'ASfah I1isheA. SUuseriuent users

need oniy reaO' tkis rnaqt-r t~np into t'e 'iraCt ine anO perforr,the I-raininq, after wnick their V for-ab'u 1a.Y i S r e a on to

thei r tane fnr SLU~Sequ~rt -uSp.

Th- Threshol'-! 600) has t.n ovelational ro'ies: huffereo

and ur.-ufferpu. i r t he 'snhu ff,?re1 i jnpf t hP sys temr f inds Ia match for tnp svoken utteraInCe, the rt-spective ouitput Z

Strina iS sent irnrreiatelv to the h -sr. 74 dce watck was

not correct, the~n, of Course~, an 1nr % utnut strino isIsent w itrhout n IV;z4 t'he oneraror A. Ot,.ortunjty tointerve.ns?. This in conrarat7,I to standard tyoewriter

which outs a Character on the Daipr as soon as a key is

Strucik. At this 9o7int, any error Corro~tjori is a function

o f tnp host svste-. It no suf~i errnrs can be tolerated, or

if error correction on the host system is oarticuiarly Idifficult, the buffered MOde m~ay be In this mrode, the

T-6On acts like a Stanlara ferminpl which- allows YOU to

check your input and make any necessary Correct-ions before2

you send the inout to the ho-st with a 'CArMPIAGF RETUIJr'n= 'EIJTFR I T;vp T-6u0 oervnits u;3 to 12P- innruts to be stored :n-

the buffer, then -sent in a 0--cK mnde with a sinole transmit

33

comment. Iwo -o-rpc 4i1 n roljt ino S Ire av a I ao)e in the

hufforpo moop. i.-fle aI~ ~ tn nrei S ouu trinonS

(which are st ii n t e :nj t fe r' tn re S P iue nt allV dieIe tesH.

The ser oni- jolIetos t Ie ent r- con tonl to' tn.> buf fer.£

R*IHF SV--uiLATJif-

Tr-is socti-in oascric'as th~e s~mu!-tior, ')seu ir, evelua~i-yvoice .3n keS j nnpt *or th.- T-rUFI orti lbataenr

task jin tno F-3C aircra3ft; n -gjinilf Att- LaomP a-nerai

consiaratiCnS, vnflre~silflf t- t ke hardware uiseO P eaa

*jnish'no with A Zepscrrict i-n n f the simuIat ion zronram Iitself.

I Thfb Purpose nt tlhe -Si'tn Ia t'o-

T ne rurvnsp cf tie sirruietion rogram is trt crovirHe

a Meanls by- Which th onr'or-5nre of a voice input device

coul De evaluated uts ino a- onerat ililel vocabulary t o

tr~r 11n Ira Onner.t naI da te nhDut function. The

the P-3C ARKn natrol aircraft The Specific tasks involve

informigo Tanprrrrgtlidaha ito entr iTRSYAA -NT

anted n tyVicalO prefluigh dta intox th Sifau AtAreMsEtNh

tablau ad to hanfl- tp ineraciveexchanoe o

infrmaionhy n oaxrtnrsimlatna ho AC~~sdata entry

funct ions.

34

iJ- - - 2

T n a lo it ion r, t e or-e v-a tinn -m II u- at l n wa s

necessrv f^r tn- urori o D-rtinent aata on Fsubjects' ncrfnrsancp c -rctrv t aS .s nber f

nossirle -PeasureSs- f ert i ve-st r-A ts) were-C i P

Two, hnw-vnr, were jjllei -ost relovant accuracy ano entry

speed; ano the sIu'atInn rn- g4thered necessary

statistics or- rnoeb -:t--

M? Svnul at ;nn Descript ion

Three tahleaux f-o- the P-Sr onerational software 1

are functional in the Sl-u13tIon: T=fL 6TUPLS YANAGLMEI

and !AV DREFLIGrT. TnP T!.flY t-nlea is jisolaved on a

standara video t-rmi-al Crt when the sirulation is f'rst

calIea un - ee aooe-ax a4 The l'*&FA taoleau is a corplete

reoresentatinn o' that founj in the actual aircraft as every Ktableau ava;ble to An noprator in tat aircraft Is

Oresentes. rroP the T=;ntY, the simulation allows the

operator tn select either tfe SqPRS M.ArGEMFNT tableau or iLNV DPFLIGHIT tableau Dv eterino the aonrooriate line

numoer - see aovenlir A.

Once the desirpo tanleag is displayed, the operator

has a number of functions availacle to operate on the dnta.

A nex.t line function Provides a means hy whiptn lines in the

tableau may be accesteI senuentially. Any inaividual line

may be accessed usina an enter line number f tnccion. A

subsequent naoe of the STO S MANAGEMENT tabieau ma, be

displayel using the next oeae function. Correction

-- =-- -- --- - ------ _--=--- -.. . .. . . .. .. .. .

functions op r-r it a qh& -7o -h ,vio':sly enterec

Character a s .ith -%n o-iarv ty-ewriter -or a ntLETL

LINE w hich al le,&q 41-iletbon of the, Pntire strinn of enterea

Character's, nertnitting roer'trv of correct iata. Ale rt s are

r Presente-i to jrnf-r- tn- no-rallr that an 1onv.ilicd line nu'noer

has been recniectea, tnat 0,e currert line # 'js no modifiaule

characters in it or t.*IL ithe clirlent line is the last line

of the Dage.

TnP simulnation alsm o (-M'CtS Oat4 o0 a nunoeDr o f

irnodrtant 'eactors u Sed i o 1t Pr n in 4 he mpiasure of

effectiveness of the two inout jovices. ]he t ime renui rea

to pnter the test riat a i s l.=int-i-e- SeCearatel-, for the

sTnkFs MANAGcMEN4T a- 'AV PcfI 1rriT tableaux. Thie ti--e is

Measure~j as the. sum of the neridos between the ti-e the

ctirznr is oro-perly onSitioned -ready to accept mnout - ano

the j:A R;;I A G F FIt* is sent. The~ nuroer of tim'es that the

nELETE III#' and' 9ArK5PaCF funrtion5 Are used for each

tableau iq also countp--. This i's later used as en indicator[

of input eernr rate. when the simulation run, consistina of

data entry for the two teoleaux, is Comocletedt the data in

the tatieauxt as entprea toy theb ooDrtnr, is p a C d in a

IUN~TX file for subseau?nt eaeluation Of otierational err-or

f rate ov the 'IVTX utility "VFVF Also, the entry Itimes, and

delete line/Diacksoace, counts are displaved on the screen at

4 36

1XM ___

Trio syst-nnOpScr3 *1nP. q~ fear nas hbee n kent

aenera1 , to nr-v IOPa n~ fVPrV ~ t' it c a'ebit'- eS. M

foll(o.ina few reranrnzs jl -rt.-nt

f~ aja fctors

aSvert'; ^ t e svste= 'in S 2 Pkd et Ai.

T h0. tunc t'c- i iel tr th -,p r atr a3r e

icentira1 ftn r htn f t a tnroleaux. -'hen the re-cjuested

MJtableau is Inily rrsne Pn fis tr wt ha

mo~froe inorai"'- t 0 or4o ie-i isclaved at

the bo'to:, of tn ' sreQ:o, tider *-Ie ahl (seo the l astIcae o t RprenaOii Li--e innn us' spsitioned o

the newt line qfirecti-y ueil the- tr St moo0ifiabe characterI

nft tfle Crnot li n I ia * C r Iat - inut. 'i i:- a

slint-tly Jifferent - f~u unctionally euilnt -S

Present at ion f ro tnfl iA I -C3f icra t that system

olaces the cufrsor un~er tro i al-'i P ci1aratters 01 the

actual line in thef taolei--". th~us writjflo over tie orevious

data, as the curs r si I over any non-oifal A

characters. Tn tne acru~u' Svs te- then. there is n Fgenerate Prompt or inCut line.

T n'S i s n c.t considered' a

sianificanT departure rom- fc'el i v t o tne P-3C system.

althouch during trne S F-nulettor0 trials, subjects W itht

orevious P-3( ewnerience Ais l wxre*Ss A oreference for the[

method use1 in the gim'ulation r-ec zuse they felt it made

spotting errors easier. Ourroi- the initial 3sign chase of

the sioul at ion =JevODl ft noe t;jIt tn2_.!iy E the actuall systemso

*etno of handling tfl at input was not Cnsidereil as

37

-77 -1z' V

crri t tcrielt 1% ha zt cvtt V t. ha e

f orm~at t io 'soar Ina-fl tf te Trlus tne si'muiati

hanole s t he ioiti oI ne aa So thkat It + Is not

necessary toC Drov]A an IKtereween thp --gta

I elements o-- a line.

A-prtn it- ~ ns- In rn!2 out area on the

neren itese itqj1 edt

Ct 1 tih T -.p Q n n t b'aJ e u e=ces-

seduentiall -y 5-isn: It' k e 'v inilowed by a

CFkR1 CQTA- IF P RU Mc- a iuaii 'I - enri- Wn n di0iZ

n lie nunoe r o ow'en 4b. a A"' : 4 is nlacn the

= desiredI lire irtn tne prm~ -0% T k fucto

is avallaole hpen t n ~i~~ 4T tlu '5

displayed. it reouires- aCtiv_=tinf o t he tJEL1 PA GF 'cV

foiloe rfcvr fai CQ!G Fi'R T h? TrigP-EX reav be recisplayea

usiflo the !NflEY key foline tivU.6TG Ttfj

The re a re t 1* c. rec t1on kCvs available. -1heI' m by moves te cursor- t n t' rv sV enre

character An" !ilows the 'onerao-or to reenter that character.$

BACKaSPACE hy be Wzed to m-ve thIe cur~artacvt the

beginnino ef th~e Iflflh i It i f fies ired . DEEIE LhUE.

followed by a CkQjiT AGE -MWR42 howeker IS a fatter ehdj;This function deleteS-al o-f the vbharaeterS entere-d on tlpe

ifout lAsint -afn reoostions- t he. cUrL3or to tTt i

*601if iib!le chat-at' ter of tat lin_ Tfe onp er a tor 'ma- Then ---

reenter tkc data.~ thisfunct -fvwirl? S6e'i_*t ov.f ferent

Xa

71 6. ACNW - ---

than t..e t)LF rF --io(A'~~ u~c'n 'r, the nircraft hiCh

del et es t e charac t s P- t ?rp'c f or t he Ii ne and termi nat fs

the oata i nDut fuCt i Tho- sr a t f unc ton then

reou irieS t he onro t .- reter he P u node if

add'itionail chang-s -3-e oeSirPJ.

3. araware

T h g s;iuilat ion h ar (,;ar e on.SsstS ent irelIY o f

oquio~raft oo-ratea bv tne N~aval Postoraduate School Comouter

Laboratory. The miaintra're com-outers were PDP 11-50'si

manufactured by Digital Eouiompet tornoration. Thp terminal

was a stanlarij0 U 0 ib 1nt e I iaan t terminal -anufactu,-ea b y

Oatarne'ia Cono. Ihe mooel variant used consisted ofI

separate keyboard a nr CRT units which nerni,ie the CO( to

he offset from the keyboard1. This oermitted duplicating the

aircraft confinuratiOn where the CP SOffSet Vertically

from the KeYset.

i F. imulation SoftwareThe simulatinn software was written by the authors

entirely i- the "C" proorafnrini_ lanauage. The supporting Ldata retrevial macros were written for a FW6/UNIY version 6

time snarina operating System - Which also was written iPrimarilv in the L lanouaae. while the QueSt ion of a[

l anguage for the simulation rrogram was first beingf

considered, it becam~e apoarent that the Droject called for a

Structured I Ancluage I one we Il sui ted t o moaularized

Programming techninues. 'ei ther o f the authors had P en

39

extensive oacw~orotiru-4 i n the 4,nerA i Sis0i neS Of COMputer

science# or the specific arpc if oevelopino interactive

comoutpr orngqra'ns. However, they were familiar with the

Pascal P,,oarqmmring innounop and -any Characteristics of that

PE;lanquaae qeemaO well suitei to the reqcuirementl of the

simulation - particularly the r-cord and clr Vrbe

c o nstru c ts. Pascal was l at er r-i e c t eo because o f

undesirahle inonjt/outout and file-handling idiosyncrasies of

the avaiIaul e c onn-lIe r . C., the9nr aooearei as a Ii kel y

candida--tte for thin simulationi crcaram lanauage for a number

of reasons:

1. Tt is a structured lanquaaie with Pascal-record-likeconstruct s (structures)

?. t interfaces easily with th#e oeratino systemj-

3. It easily sunoorts interactive oroorammir'g

In addition to the obvious goal of simulatina the

dlata inout functions of the P-3C softwapr, there were a t

number of other ideils to which the authors strove in

develoning t h,? simulation software. F rom a Personal [viewroint, it was stronalv desired that the program be

'readable' with no 'maoic numibers' (mysterious constants) or

tricky code. That is to say* since neither of the authors

had any previous exnerience in C orogc'arnminq, they wanted

the code to be easily understood and "debuagable". This was

Accomplished Primaerily through the use of comments when the

Purpose of the code was not obvious, the liberal use of the

40:

"-'-

is

- - ~ - - ~ ~ - - -------- ---

I)EFINE ,tatement to set valups for constants of, create macro

f unctions, ana a strict mrodularity b,.;ich aiviaeS the proaram.

into ciscr-le! functional elements.

Af t er P-'rfonmino some in it iAlI teas t q it hecamreK

obvious tht A rrit'irca Rrea of th- simulation which hiad

FIR formerly not receiveri any consioeration was the problem of

Ireal timre' nrncessina of trne screen data on an occa ,ionally

heavily loaaeo timp snarino system. Mlore soecifically, each

tableau hia twentv-fnrep lines -.-f data to foe written to the

screen (twenty taoleau lines Plus alert line, oromot line

endinpt line blanking - e nedxA.), and even with

the termincil ocverating at 90QO beid1, writing each character

on each line every time a sinofle line was modified, or when IN

a NEXT LTNE reauest was sent was introducing unrealistic

delays waiting for the system to write the tableau to the

screen. Direct cursor addiressing, a techniciue which is

apoarently usPO in the aircraft system, was initially

considebr, but reiectea as it was believed that this would

make tr-e simulation deoen-dent on a single type of terminal,

and i-. was desired to make the simulation as hardware-[

indeoenae',t as Possible,

The solution wes to restrict, to an absolute

minirnu-' the numoer of lines written each time a command or

data was entered. Thus, when data is entered to modify a

line, a maximum~ of three lines is written to the screen; the

modified line, an alert if necessary (or removed if no

41.

%

longer necessary), and A new orrmnt Iin . dnen a NFXT LINE

or a sfecific line rejust is -e-t, a saxium of two lines

is written: %n al rt if necesSarv tor rpmoveOd), and a new

oromot line. All othe- li-es re-ain 4isolaved, unchanqed.

Of c(urse, every line nt a tar'eau Tvust he written when that

R tableau is Initially disrlayea, or when, for the S1nRFS

MANA(EMLNT tahleau, a -WT ,cF request is orocessed.

However, this scheme nerzits oata entry at a normal,

unrestricted so-ed unoer all out tHe most extreme system

loads.

A ornoram listino foilOsS tme aooendces. For those

who are more interested in a functional desct-intion of the

j simulation prooram. a osetAo-core outline of the major

routires ar!'-ars : ;:te'c .I

C. THE EXPEPIMEPNT

The ob ective of the r-i1enr wat to evaluate the use

of voice recn.,rition as Ir i _ut modal itv for oref light data

in the P-3C ASK ai-craft considerino the NIOE's of input i

speed and accuracy.

1. Desion Considerations L

Figure I shows the exoer*imental design graphically;

a treatment by treatment 1y suhject aDoroach. [here were,

in fact, two such exoeri'ents: one for the Stores Manaoement

tableau data entry taak and one for the Navigation Preflight

tableau data entry task. The exoperiment was designed to

42

- -- - -- W

ICA'

12I w

CD,

I -

a) LI

I.-f~t LI! A~~Lii

U)-

cr-~ Lai

t-e

43 L

_ _ _ 6

simulate sctujAl soft.war- An-4 r .w re Confiaurat ions of the

P-3C aircraft, srec iiiv ekre TaCtiCal1 Conrelinators

ositinn durinq Oreflight. T" r jCrd coi-'runicates witr- the

computer thrnuan his M-itrix select switches ana Vat r;X

readout switches for tactical co'-ta-ol o~f his ',,ulti Data

MEDisplav, and thronn the TLI'Cp y-or for control and

h-viewino Of Navioation ,At, Ttia so.s, ni

Tntelligence oAta availall via th_.n.Snt a tact~4 cal

simulator was not availahi- for us in the conduct of t'nis

experiment it was not fea;sitle toC evaluate the vcc rI

mality to control a tactical '-colav and the dyn,---ic

interactions involveH in so Hoina. Th ava~lability of the-5

#eQuiovient in the Naval PostorAmiuate cho Computer-

Laboratory allnwpd the desion of simulation for use ir.

inoutir'Q -ata into trie crefliont tablpux of the P-3C. The

Datamedia Elite 2500 CRT was used as th-e disolay device for

both the Keyset anJ voice recoanition methods of entrv.

During the keyset entry trials the disolay Console was

Ot)Ys!Celly seoarated from, the subjects which required them

to Physically move their heads in order to verify a data

entry. The senaration of the console and the keyset eauates

td the separation of the [AC(7's 'Keyboard and the ARO in the

T he PVcabularv f or the voice input unit was

restricted to 61 entries in orcer to minimize the time

*reauired for traiiinq arid verification of the vocabulary. A

414

complete operational vncibulirv Woulo have 140l to 190

entries. Rastrictinoa the vnc~omjlirv to Al en t r ies I C not

=co-sioprpi to save -iffect-j the proc-esSinn tirres of the

Systen. -)c -l1l f r=m sect i nt T I t nat ot her ir-veStlaatorS

- MED have indc at e ( t )at t he I ar(jer vocakUlary would not be

MR exnectoa to CazuS- noticeat'hy lner nreCesSinq times for the

I ;voice racnamition tin it f rk, R-f. 10;. 4owever, the

effect that lroer v-Caouliarv would nave on the

recoonition error rate iq not know. t

?. qbjects

Thirteen subiects rarticipated in thp exo(rifment o n ia volunteer basis witn n,) mornetarv incPntive. Ihev inclucea I

twelve m~ale officers and one female officer froft the Navy

and A r-y, all1 0 Wt whnIT we re students a t the Naval I-PoStnraouate School. Five wore enrolled in the ASh Icurriculum, sever. were enro.lle'I in the UnerationS AnalysisjI

curriculum ano o-e as enrol lea in tne Computer Science

curriculum-. Mi Ii tarv experience levels ranged from jLieutenant to Lieutenant Comn-naoer in the Navy and Captain

in the Army.. All subjects had previous experience with some

= type of keyboard input to a compouter system with experience

level ranqitig from novice to oroficient. Four of the

subjects were eitner P-3C or S-3h TACCOqs and had previous

experience with the prefliqht data entry -tasle of the =exoeriment using the mauai keyboard entry imethod of either

the P-3C o.- S-3A. Only on-e of the subjects had ever usedI

45 U

voicP recoonition ePrinT.nt. Tne^ other t~plve ari 'itner

seen n-mr uqe-i voice recornition crinr~nt kefore.

-a'erials useao +nr'v io ronauct of the Pxn)eri"!ent

i nc I ij!J

a. AtyflifQ ZOS!' wliCr, was tuse to determine a sub)jec tsME SO( 'eve1 i- jri-- a sta-oar-4 tyflevritor key/board.

110 5. i yu e f or. usi-0 tnp voice reroonition System I(annenlixV

C. A s - -ul at ionn overv iew I anrrnd i x wn wi ch desc r i ed +o jsubjects, the nrHeCt've of the exneriment, thes1ulaf ion that %-as to -' --sea alertsrentrv Iommands

Is ~n cnrrect~ons,.1 a oy of tne tableaux that were

to ce rollfsa. Id.A sirulatinn tamii1iariZati4cn Capnenoix t)which w as

-4e s in eo to jive eacr, stioiect timp to oecom- 'amiliarwith data entry 'oito tle s'mulet ion. The noel oef t h isacrenli x was to- a IVn_ sueoiects to read and onysi callyI Uenter renresentative eata into tne sim.ulation usinga!-Orr. voi ce and kevonaro innut nooalIi ty. It also UThilowe.1 subilectz to DrCOCICe uiJnfCi correctiono-roceoures fnr tle Sjmula tion.

e* Profliaht lets iao-renoix F )whicrh consisted of threeI ',4fergnt ict6 sheets.

!iAviaation Preflinht daeta, wvhich wan usedl to fillin tns? Mavioati-n Preflioht tableau.

(2) Voice Snnnt.uy Status Chart, which was used 'to

fill i" the Stores manaciement tableau using thevoice iTodelitv.

!3) Ksyhoarli S3ootiuy Status Chart, which was used tofill in, the Stores Manaceme-t tableau using the Skeyboard modality. The only difference between -the voice and koytoerd Sonohouy Status Charts wasthe ase 3f true svlbols for the deoth and lifesettings of the sonobouve. For trials where

voice Was the input mojalitv, the deotns (shallowor deD) an thelife settinas (Short o oo

(S or 01 and trle lif settings aor 1 sdol

t

- ~-~r-= -~= ~ __ _46

the first 't-tter rt the .nr- 4s. A!hole ir~s wereused for tno- Voice qoohu Status C.art to avoioconfusinn o-tween sla~low ens short ,n i Ch mightother~ise ecru .e n kj ItCsfr the svmbol.ulther tha- those rinon jiifferences ho0t r St at usCh-arts corntaine- tr.- sane dAti.

Svoabulary list (anoixf nich consisted of the

IMP 61i words usedI to i-vut da tA to the simujation orogramn.Tnp voce1'u1 cry acs Kont at a minimum lenoath so as t 0

eef t'eaonzI e soon, i n t-ainino thethreshold Pbvl a4s i as was practiceole whi le still'raintainino ont'ni us a .10 of voice te-chnclIoay. ihevocahulary list kaq rnrep Columns of informiation. TheF6U~i MU. colu'r is use(_ to conmunicate with the f-oOOT no PPOt4 T Cni1u- Containq ut te rances th1)at eacnsuh jeC t tra'nea Asn., uqeri wnon inoutting data to the

simulation. i4-e th-ies colujmn headasu nUTP'J1 comt;ins Icharacters that -Ire son! to taPr Paramredia ?500 for I'rout to the Siiujlqtjon proorAmt,. For exampl e wo rorumrbo r 10 requires; top sujbject to sneAk the utterance :"tten isnn" ibitterarnCa, when rcgie ovtheTb6ufl will sen'j the cutout 'xrxl~xxxL' ("x" defines aIflank space) kt - a tfAla O eed ia ;)50U. The utterancesays to se-g three sraces,a ten, three soaces, ano theI 1ett-r L wlhicn stanos for "ion" to the Datan'edia 2500for inout to the si-1ulAtion tableauix.

Q . t nurber -3f 'orms we-e usedI to record each subjectsda a-I ri n heexperimnent (aooenli x H ) T hese

inc Iuo~oo

(j' A Vhire Necoon-ition Data Sheet for each trialwr'ere time an-4 error data here recorded.I

(2) An operational error Sheet that "-4s compiled by

the I!i T A system which comoared the data enteredDv eacn subject with a mnaster file of tableauxcontents reqjjent in the UNIX memory.

(3) A manually kent ioo of T-5O0 recognition errors4for each voice trialran 4 ,

f4A) A Voice Input Exoerimnent Questionnaire 4thichsolicitec gen-ral impressions of the voicerecog~nition system usefulness and expectations.

F"II- 4 E

LI r-.ccoures

f '"st staaie n r -e-tir'- -UIkJ-CtqS ;P If'ii1UalV With the

exoeri -entpr ano A -- t, '1 ve Mi !Ute t -i no t&St. Ta no

were he~n a iver. di S~t O f 1 ~ido, T.traswi

dIeSCriker' tnp rurp-S- e%: th- e-xoprim-nt, OD~ratic-' Of the

w ~voice r-co .ntion v~'ic~rni n-&ee~arv to use the

IRR ~~S i -u 1atI (n , an-! - c 01 1 0 t n tr'm Fa'niliarj7atjo-, handout

whlich t "ev -nO I!-r e lorl' a Syte'i fami!iari?aejr~nI

[workei .3ne i a'. C c-Di ' "USi-i fhe VOICS r<PCO-aition

SvsteT". Tne exneri-ev-tr s'-ciwe,4 Poch sutiect now to wear

a nd u~e the npadsat cmoe-one an-1 'low to eff-ctively use

*hp voice syqten. rliOwlnr; thiq hasic familiariZation Pach

Iu j ~ c I~ Iiv e S~ v o ~ ~ v l t a n d t r a i n ed t &,e

vocabulary 'jn~' r~eo~ar an-' monitorin, of the

exoer i 'erter.

Pepin nf *, rpounri noise level - in 0)8A - wastaken. durina the trainima session and entered into the

subjects "Voice iRecnnijnn Fxnerimient Cover Sheet" for

later reference. DACk9roun-l noise level reading wasL

obtained eacth tive subiectq nerformed a voice entry trial.V

After conmoietina- traininn of the vocabulary each

subject Spok,- each of tho 61 worls four tim~es. Tf the T-000

!!8de a correct m~atch for thee of the four utterances it was

considerea that the word was oroorly trained for

4P

=

recoonition. T;f tn.er tr rfte o, t rr f vUrU ttte r ancS

were correctlY _ ,t C i_ - se t t s'~et relrainel tnet

r-articjilr fnrc. This firer~ 505$jftr vrre n a-,! '~nn

half hours in~ !enotn.

Tn' s#-cnd o-' tsiT- i saes f t~ I-s xert

rrecui r-o the suciprcto 1 Ij in tle otcores Vaae..e-t ano

F =~~av Pr-fliont tahloau :A t~ r4%r.Laf u:c s

to I1 inl tflp [ti 4 IeZv vith -eta containeo; on tnp -lata

Sheets in aaren-aiz F. li-ev wer ro.4uireA to enter the -leta

twice f -r ieacn i r ai' o-ce- -is;nn v-ice s ' r-nce using the

feyooaro r-try ?et'-oH. the suc~ets were renlonlv tolit into

to e--ua g1 rouvs. irh , N renrf~r-f- tn-c *irst rumn of the

Trial snovoicea r'nut. T-^ -tfer Or-Un us-no kevt'oard for

thp first run of tn- Trial - rf t---eon trial the orOer

was 0everseo. a~e emkorrirarn wan rt-en in this fashion to

cotmte- tna effert of le !rn--ni 3 Q0?C and ACcuracy.

In ujcsrerurne4 *o- the SCcoflO st 40e vetWee-n

one arc three Jays, after co-v' eti qg sstnn one. this aee

them a chance to l-ok over the fat-:;iirization mat*C4a1.I

The subjects steonel! throuob -h- famulimrization orocedures

-during the first naif ,nur Of t$ke session. Durin6 the

re~ainino 4aS minutes the subiez7ts executed the first trial

of the experiment. Faeft t-iel consist"c of cerforrino theF

Ftask ofl entering oreflioht date into the Nay Preflight

tableau and sonobtour inventory Into the ~Sctres Manooeinent

tableau. Both che kevset and voice.modaiities Vei usej

49

wit t one n=l of t' e 3moer, sr" Z tr k-Y Se" e- ry

-ethr-z! ne-4 the n ther ef -~ :v~?ety=e tn r-f

fi rst T rial. Si-ce lit t t ia meoc ~ac~q

the ec r~fl~ astst r'- st!ec ?-I * rro t rCi IT

t hc 5t!c!Of-t oxrerl.,nreA4 0-;U tooe ust5 -3 flo rorrPCtlIof

---- co uros rorrectifin r ern-~~in 1~ nu0t1 ere -

cons-.le-d t o te tcev V Ar ;1fI S n -~- c-n-st n4 hne

schefiulon oet we-n "flu t 0- r- -C lr

seSS iCan. rflC t'lt- Sastfl-n t r~ v- t n-rm h

i dentlical3 tasks esr a-vrSe oar-er. Afte-r

Fineri-ent 2uiesmnlar t. --- tciitPo their

oeneralimreso zou er vt'

. )ara AnaiySis

y 'rats, t abee , 1r er met -0. h raw dat a

Of innut sceed, the cnrrecto -ca1con as usedI as an [indicator Of inpu!t orsr error rate, and3 In h roeedL

=tableaus were eva",ined, to t- Aetermifla -P~rtt'a ei-'-rs-

errors remaining a'ter t; zk co-o'etion. [:so

9____ pil

tr-p- -sIe

AE.t e.j ri~ " -r S I ="c

~aavmn~t #-p S-o x~p~

I--

Iner Tr S r~r -ra a~ wIF It~ i 'n Te enrI ~ ~ ~et~~e~ in '~~-ic t ~ec~~rf -r rrr

Anid et r vsoee, f ~ M oerattanAl erro-r rat"-a-

nata e~itv ti~a~t ae t St~n~ a *fa i v

was ste two 04tr4~~a wr oftct1 ~V en try vet nn0 and ti-s r c.;. M aa- aarr

I -Stan--ara- 'tn::tmOt k. r t 9 A D-v suk,hict analysis -f ijaiac r- a-pi~z- f tne 4,3ta

were emav~une" uslfl- ime A mIvS15 '- vj-ialce -cfl~ml ' it

-

a~oeard that there -int r- r-relatinns not anTitiflrel"

the mner~entr ~~r I-rovr Pates were t-sf rof-

US-ino t a Ar~in --asop- --r-A1=

L

"LTZ4

vo c I I0A rc FIff O= e

adveant C^'Ve r COn~n ?1rI <ov -'-sert h~ --a r rrtArce nrf

sPC itfi c onerat-n-i tsk r--s( T Se C ritical

EM -easurnrontS -,ro -ftrv : - _- c e ra o-A rasl r ror rat e, die. -entrv n rrcrs ^Sirnl -r'e t detsctoo nv tc oeret ~r and

Wflr ra?~rn- n-;tn-jte .- ask -

errors werle tatbu Iat e-1, b'ut a-v z IF foss'o~v exolein S In -t' ~ ilranc-es .M

t tites. Iw 1 literen* thefux mr se r

j effects nfulnkie n~ ~re -ore ~~naeu

L Slu~ie' NSere one Jlt-verce orovbneS -ore t*,r- 1n -jo nt

* d~~ata Outnut-es W.tn t _ tores Vron e t a n h

r ess anvefltaO*us Sl tutt ior whgrn one Ujtterenre eives nriy

jonte !,it Oata nut~t-as w~w the d oigi -Dy-dji enryvi

the v -vt'a tion Nzfi~tt~.emu. Iso trialIs were used to=

allow exiraio %f the ir-teraictinr o si'bea anc accuracy

with exneri-rnce. itle re-a Its eq nr esnte ri a wie the-se

Consitnelatio-as -3uven Orirar, at tentn Ht.;ever, -hI

alvaino te. Cat it be e aoparent t t ~e

'nteeecuionws nao tak.en olare. ;n4 tnese alitional re SultsE

are Pres-- ,nti. The ent ire raw data sotn r

the two tra*S cp si tahles i. and- T'.

52

t4

TAPL r 1.

t ! I)t J A T"T,1 A ;,

II NiF

SUPJ oDL (seroro) r;, T,'v OPFKAI [UNA LS* J

v cqI I A

I,

696 164 u 4 1 nV S9o 16. Io 1 I

670 165 1: 0 1 r

V 43A

4 K 457 109 0 1 1 1FV 530 11I 0 I 0

5 K 619 13b 0 0 2 0

v 136 1C0 10 I6 K 5?7 105 5 0v 560 1 r, 8 5v ?

K 6 2 118 7 1 2 0V 767 145 15 0 PK 051 211 1 0 0 0

v Ad? 17o 1i 0 1 0

9 K 667 133 1 1 a iv 572 133 7 0 1 0

t0 657 1I15 0 0 0 0V 521i 1 0 6 o 0 0

11 K 701 121 2 0 1 0V 619 122 10 1 0

12 K 71? 119 3 1 0 0V 592 1?9 14 1 i

13 K 513 u 4 0 0V 447 81 3 0 0 n

(14) V 437 P0 1 6 0 0--------- W------------------------------------aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa- f* S : STORES MANAGEMENT TABLEAUJ V * VOTCE ENTwY

N : NAV PREFLIGHT TABLEAI K : KEYSET ENTRY

53

T. . 11 L2 L_=

T*:LIIF Ti

A. I T T-AI Tf r.

UPJ UIL. . (_ e ont CP T tIAL

VLE5 ,., 9 u 0

0 6 2 1t, i

4 N 04147 I

v 9,2 -7 0 0,v 1J 7 1 5 0

K 51 io 15 . 0

9 A26 1t9 17 2 0

84 K pb Ii X 2 uuv 6o 17$ 4 0 0 0

K 69 1 5 i 0 0

• 10 K 5'411 11!a 0 0 0 U,v 1l, 1IJ 0 3 0 0 II

11 K 685 1 35 13 0 4 0 |i

V 126 137 3 0 2 0 1:

12 K QI Q9 7 Q1 0

13 K 19?) 75 4 0 v 0v 371 79 4 n 0

(14) v 32? 71 2 0 0 0----------------------------- ---------

4 54_-R_K _- _

'1 _ - *

A. ENTtY SPrLr

TahIl I11 oives a su..rV ot the -rean entry times for

the two tabIPaux hy tria!s, anz' entry method. For eacn

tableau, there -is a significant ditference in entry time

both bet een t e tri-is An' (sntry methoo, ihe statistical

treatiient is Showr, in 'ahisS IV and V. Figurp 2 compares

the ent v ies o- trial no n o two for tne Stores

manaoe-ent taolea~z. Ie keylet was Q.1 percen, faster on

trial e ana the voice was ! .6 oercent fester on trial 2 (p

[ O.Ofl Thp A.WnvA InaicetoO nO siqniticant interaction 1

between L riI entry nethoi. Fioure 3 shows the same Idata for the avigation refi t tableau hhere trial 2P times were, 30ain, faster: ty II.o oercent for kpyset and by

9.0 Dercent tor voice Mo < (.15). There was also a 4

sionificant oiffe-ence i soepa oetween the entry methods

for the tvn tabl|atix. Figtirp n shows the comparison for the

Stores -anagement tahIeau, where voice entry was 9.7 percent

faster than kevset ent-y (n < n.i). Fiaure 1 ahows this I

data for the Navioation oreflight tableau where the keYset _

was 1'.7 oercent faster than voice entry (p < 0.1) The

reversal of fastest e-try method between the two tableajx

orobably reflects the character-bv-character inDut reouired

for voice input in the Navination Preflight tableau and the

multiple character ootput use of voice for the StorLrs

Manaaement taoleau.

55-

_ _ _ _ _ _ _ _ _F_ _ _ _

- -- - -- - -------- - - - - - - - - ---

6 19

tra i*63 2qW

60 1221

V

ti -i 1i2 13881

trial je 63714144i

-- -- -- - - -- - - -- - - -- - -2-- - -- - -

1P -11

-ML

58 _______

~~ ---- - _ _ _

I AUI E T V

ANOVa STORLS MANWrELMEt .9 TA13LEAU ENTRY rTMFS

SOURCE SS ef rnqF

TOTAL 761b,2?0.9? S1

SUBJECTS 423,813.9? 12

entry 44,0go.b9 1 £J4,0 0..bO 4.53 < 0.10

Trial '6,760.07 1 56,760.07 9.93 < 0.01

L x 1 832.01 1 832.01 0.1A .S

er F Ilb,bQ4.31 12 9,724.53

er T 68t562.93 12 5,713.58

er F X T 94,L4c.99 12 4,538.08

-- ------------------------------------------- -------------

E : entry method1 - voice or keysetT : trial - I or 2en : errorN .S. :not significant

P* probability of error

SO C S9 ad f S F

-- - -- - -- ---- -- - - - -- - - -

TOTAL55r74.98 5

e rPCF A14.9 at F - o_ P

TCTA F 5Y,7 1A 4451-A

SUBJ~rTS2 9l1.03 1?

Enr 6,671.5 meho voice.5 9.5 <0.01

T. x tra 1592 1r 25.5 021 NS

er er ror 3'S69 1 b5

ft 7

AIF : ntrymethd-voce o keyetEI T tril - orX

N.S. not ignifcant

=j -c -c

I-- ____ --2

C141LLI

S CD

-JL

n IC CDj-o to -J

(SUN03IS :13WII ASN3 N1:

C-4I

IL __ 4:::c*

LLI-

C~LIC/)LLJ..J

LU~J c)

LL L.

uJ O~ f

C-) (D C

(saNO33S)3111 AHLLN3 NOWI

60

Ca

_Li

M: C/

C/)i

CD cm ij

LiA Li

(SO033S

1 1-

UJU

C)

Lu-I

I-L c, Li-I

LLJ~i -

LLIQ~ ~z.I

LiJ

10 C) a)~ C)J t-D C) i

(SUNO)JS) I3W I1I AHLN3 N3

62

Aodt ional analv;is i inc ated tba there as also a

significant 'hfterenre a-ono the sc T ects tar Sto 5

-Manacement tableau oata entry times, aithouan at o suh

difference could be found for "aviction prefiiaht tableau -

data. Si-ce each suoject had been aiven a tynino test, ANLvA

was examined for any difference between tne ti-es recorued

for the fast typists (-Qrater than 30 WPUI and the slow

tynists. No such difference was found. Data had as "een

recordeo on each suojects' warfare soecialty. The group"O2'

contained 4 officers (subjects 1,4,5 and 131 who a

Previously qualifieo as Tactical Cooruingtors. This asoect

was examined and a sionificant difference Was founo between

the times for the TACCO grouo end 'others' Group. The

statistical results are Shown in table V. nn trial two the

TACLOs' mean tima was 23 Percent 1 arter than 'ho 'other'

aroun (0 < 0.i). There wes no sionifica-t difference

between the crouns on trial one, n-ossiblyv because e-ve-ryone I

was Still learning abuout the- simulation at- --is Point "

There are some adoitional factors t- consider h n.

evaluating the entry sPeed data for the keyboard. "ote from

the reoroduction of the Stores management tableau data in

j appendix F that there is a pattern , the data. That is#

for a number of consecutive lines, the sonooouy type and

F hydrophone depth setting remain the same C as in q _

while the remaining data on the Iines runs in -mmer c..

seouence such as : 101, IlL, 12 Lt 13 L .. 17 Lietc. Some

63

41 1

IF------ -----------------------------------

TOTALt (scns]±T" 0 : 4QOII 2

---------------------------------------------------------- --------

564!

-v-I

0n t ua'v e ' -3=- and netA

a large i'-1acl of-.!i n s~eet aQCI' .

Sir-c* v=1 * DQUC h ~ta

asoects -f t- S.r~ 1 isia y was-oe

horictl fra 1 v1-3v t-e sa-e. OistaflCe as the-

ve- I- I-' b a ! I -

Arrf 47,rM V*, TI-gg nrr=='di olaces an

aodiio- lt-nri tr sin~cees ot :%ave t he

lat a -ee k e '- is field- of vzww

aadti~r~ b" - ** arje tsus reducd

{the eftact of t =- 0 ft tekyse', entrv

F that 0' reou irfl i~~au novCLlt

Sheet, It t k ey oar cde b-

data =' -- t t -- nerfar h -trv orcs Snee oroerlyi

numeriiswCe 13-rl' occur inactual p3

rnrtoe*~ cnr1o0 -tto -ewbat faster --ea.- entry

speerv t _r3 -ge W- e' - t 1 fl e oerationS. r

Wn e-iat ewtl this artual~v a f ed t he emDe rimenltl a ta is

not k nr n._

j~~I T0er is ie toii-a fatrslh Minfl 9 ave

affected- T Ie vcfyb0C;%2d otrv scoen i ti ezoerim-et. ITe

ir-0 45t tenIet di~ f ifert t act il1e teec-oacfrtan-

stendar3 keyboard Sat~h as-Is used in the --x ftftvIe

k~eti' ttaicrftrn~ira s -- P Celiib~eratC.-m orect

-ev ae-rsin Ik -.-t wo re fnt~~ij

gI:

.....

Icr

however : o4tta~~iVnr _'

a M o- Ac t a teeu o-ve

trialt -- a 'e-t- ard !'- t 1ej

1il -e f 4X-lrail that ;c-r tn

ffexoor.~t Zoe ~ - ifr e- t -er-eratuna -rr

rates S~~e t-o-S~~ tras S

r r~i~ v 0-

As~~ rs v rnct. ~ y prr rat e xas -not

wa ne!o~wr. r f 5fl~[ were for Tohis

a- 4We-y V~ '= rr

ewrastOA ac~ -=--r AM -sn t wer s o the

sttitialtrat t .~e-l' ri-ificrs=' nicfsren

btnflv the ~ rr rr ~ * h Wo1 C -- a -ee

snouC caiC_ ='l ae esca 1 -4- - - diUfferetce

feo-e toe wee -t. -- oerc0 - r ter e v - e ar u.OS)

fo -- -- ~s

| FIt E VIT

AN"JVA S 1- -7 P k ~FtqT TAR:.FAII nPFHN' JuNAL FiRPGRS

SOURLF SSF

r--I

W TOTAl E, 1

--- SUBTECIs ja2. Z7 I?

Ent5 1 2.591.?i ?..9.

Ir i 1 1 1 .54 O.4J3 .S.

i x I .. 9 .03 1.

er F ! 1.31 1? 1?.I]

er T 43.07 1? 3.r9

F : entry -t0o' - voicp or keysetT : trial - 1 or >er : errorN.S. : not sigifi

: prohability error

67.

T A RLF v T 1T

AN:OVA NAV PPl-rLTGHT TARLFAII UPLPATINAL FfPUPS

SOUP~CF F 0*F

PSIFFpwTOTAL 11 .p1 51

Lnt ry ? 41 2. 211 1 .00 V..

T r iA1 .?1 2.211 0 . 19~

E x T 0.715 I t. 3A 0.05 N .S.I

e r F 26 .0 12 2 .21j

er T ILI?.74 1? 11.90

-------------------------------------------------------------------------------------------------

F : er'"y mathod voice or keysetT : tri a] orer e erro rNJ.S. :not signficant

= o : robability of error

68

T AIALF TX x

i3AST(. L'oflS - fl. Fj OA~AGF.'FNT TAPLFAII

v LV S; 1 VOICL "qU6JFCT 1,10. Fk.DOPS) !?iP.%) tQf& RATL(%)A

3 Ui 0.6 142.4 1 0. 33.65 0 .

P ?0 .1?5 *7 1 7 ?.7 P7 11.?8 3 0 .9C 17 79 0 1 .

100000.0 31 1 15 ?.3 13 2.01

13 8 1 .3 7 1 .

MEAN: 6.0 1.? 1S.? ?.41

-----------------------------------------------------------------------------------------

RATE* numtqr of er-lors / Unumher of data items] *1001

*** see text ***I

TA!ALP X

ANOVA: I3ASTC EPROR RATFVSTOPES NIANAGEIMENT TABLEAU

SY E.NTRY METHOD)

TREATMENT SS 'if MS F

ENTRY NIETHOOJL .4.85 1 F14.85 8.,45 < 0.025error' rTTRY 2?7.59 24 9.48

4 69

-~ P!

--

TIthe oi ce unit. j 1 a ore is a rathe, i~a1n

stateqent when the Z36p rate IS P.U nerCprnt -samall Shift

in trip at'solutz raite D,1 rooure a -itspronortionetel,

larger shift in trip, eiati-e rftm.

It vas observe-' aarlv in the vnire InPUt dePvice trFairirou

seSSiOrS that tne vic~cuiry weS rroViolino a rea:l ch-allenae

to t hP recogniti-n Harw d re - hr were a nurrLer o f

= seouences Of utter-,nces Ir the vccah-uiary wlicn Y.~re very-

s iil Iar. The or-luos nf Cre-nrel numI~er/I'yrophorc, depths

were SuCh a bePIlercp. Triere was really not rouck ilitterence

-=betceer, "fH11IIE L"fG' ,"FF'r- L N-rC A~ IN"L qjxjF P-7L LUNb",

for exwmole, or iv1-I Y Tjj C!t" "I VUI!i Y Tf-Q0LE ShPHq~T' apo

"TW~t'lY f-I~F Sr-,OrU." Oic trir thrust Cf trip eyui'riment das5

to use voice entry in a n-rtir~I manner, however, there wereIno Charg4es to tne vocabtu'ary tr eccomolate this Problemr.

The hicfler input error rate recordeou fo-r the voice input was

likely a r -Sult -!f ti-is 1Ieci~zion. Table x7 show.s all of the

ftutterances for wnich an error rate ireater then two percent

I ~was recorded. vnote thAt or'eiaht Utterances -1 ecn

I of tne vocabulary -arcnunteo for 71.0 -nercent of the entry

j errors, an only three ors-5prcent of the vocabulary-

accounted for 'I1.2 Dercent of the entry errors. A cursory

examination was made of t"-e recognition accuracy frthe

troublesome utterances with the numbhers sooker as "TW_-:eTaG-"r

instead of "TnE-TY-1wOvu and "l-TAx vice ~S1ITE EkN etc.#

These preliminary 'ifVeStlQat'On Indicated that thPe[

4 7U

I A61 t (

IITTLRAI\!CFS vT Tq rk;7ATt,9 THANq 2 F? "NPtr~r,%T f Ttjj FiPUP PATE

% of TOTALI I T P IfFAS CFIRPupS u S mj

?M 2 Sm-ORT 17*.6

23 SHOR~T 12.0*

21 8 HPR T107* i

r20 SHORT

1PALS 7 71 . 60.1 x 41.2% 30.5 X

.71

recOo-nition error rat e V.t ndJedi Iower 'J i na thi s

tecnnioaje. t~cnr-rlbte 1ist of racouritior errors recordea

over t Ie course of t he ent re Pxnerinert tsopears in aoflendix

The jr~t s e Ct on ls ts t he utterances in the

vocabulary, With alljC c'- r:nCOrt-tCt Matches rP c or (Ied( fo r

INe=ch !he secorAi sector- 1istq -sch incorrert match ana all

of tI-e vncqou!Arv utteraiCe-S with wnjclh each was incorrectly

Aa consenu-nce 04 tnA oroole- pnCountered with these

few utter:ances, after the first 4ew subjects had comoleted

their first voicc inout trials, a channe Was made in the

exneri-ental nrocpd'jre to prevent this 4rom oiasing the

entry tilme oatp. Ti an -rror occurred ano the subjeCt

CaUgfit the error, he was civen an oportunity to delpte the

line &ro reenter tke dAta correctly. Tf, on the second

atte-titt anotngr recoonitinr, error occurred, and the stib 1ec t

incorrect data ana continue. These 'recognition Passes'

occurred in 'O.b Percent of the voice entries, although te

clid not occur on any trials performed by the 'Pxoerienced'

voice Pntry usorS.

It is likely that ePntrv errors affected overallI voice

entrv sneea to a greater axtent than thev affected thej

keyset entry sreear Particularly wii the Stores tManaoehment

tableau date. t.ntry errors in th. H'avioation Prefli'-ht

tableau were rather ouick to Correct with the 'BACKSPACE'

f un-t inn on either unit, since both svstems used a single

72.

inout, sinole data outnu4 -ode witi= tnat taoueau. Howeer,

corrections tok sam'ela * irrmer -Itt, the vnice svste in

the Stores Mannoelnn {trlepu. P cIl- F nat the two

correction functi-tns evai ib'e we'e PACKSPALF and rLLETL

LINE. Ihe btcwSPArE o-ietrc the ore,inus character and the

REKr DELETE LIE deletec the enti' -urr-rt .ine. Sirce t'e

troublesome utterances dere a1 1 ctenne' oumber/Snooouv life

inputs, they ere a-Yeys thp seco-d utterance tor a line.

Thusr the correction ontion with voice hCs to enter six

8A1KSPACF cow.-anos (the voice outnut contained three blanks Ibetween the data itp-c) end reenter only the incorrect

output or enter a DEl ETE LINF co-n-and and reenter both the jcorrect And incorrect ntQut on +he line. Since the later

!option was auicer - it too!- five tn sever, ser-onos on the

avera:e - it was the oreferrpo method and was encouraoed.

Corrections on the kevsat were much faster. ana were iI

aenerallv made with toe CP(KSPaCE key since it coulo be

activated very raoiOlv. with these corsiderations, it seems

reasonable to conclude that voice entry times would have||,

been considerably faster i4 the number of recoqnition errors

could nave been reduced for those eight troublesome

utterances.

It occurred to tie authors that, as a orouo, the former

TACCO's mioht have a lower inout error rate than the 'other'

aroup because of experience cained in talking on aircraft

radios. However, when this was examined usina the

73

t_

N a vio--l#ion rr~f I I ht t au Ieau ent ry error da-ta, no

sianitic~ant i'ferprce coulo t- found. W'hether this Was clue

to so'- n'f the 'nther' orouD h-:virno sim.ilar Pxneriencer with

1is a-s f2orL2 1nqt-jnter or hethpr the oremrise was not b

W ~TniS catpoorv arose 4rom tle examination of the data

After the exneri-ent was concluded. It had not been

Consio-,rs-d in tha exr'eri-ental desion nrimarily because of

the ai t 4 ut ty I n acouimini voi)unte-r subjects with voice

inout exnericonce. It ha'4 bean a Sumedl frorm the start r~aft a

oersoin fa-iliar with voic- entry would be more e'fective

Ithan z Or-e one 0;, had a total o f onl I hal f 'iour's

exnerieqce wit n the system, as Hirl twelve of the Subjects

when tke-v startel their first trial in this experiment.

Roth of the aithors haH used voice inout curinq a orevious

voice entry project. On took part in the complete

oxeri-entfsuoiect 3) and one c ornoIe t ed only the voice

entr-y trials. Sinoce two data noints do not makce for very[

Cood stqtistical inference not muich can be Said w~ith

statistical sianificance about the followina comparisons.

However, they are oresenteo because they oo orovide some

insicrnt into the capabilities of the voice input system whenI used ov reasonably eyoerienced personnel.

714

977 p-~--=.- - --

Tab], YIT summarizes tke r-s3uits fnr hotn tahleaux ky

exoerionce with voice entry. ror t1e 5to-es Manaoe-ent

tableau, tt. two exoerienc- vo1 e entry ueos demonstratea

3A oercent faqtPr mezri entry timp. Ike Oistficution -f

entry times amorn trne S'i suoiectq oroe:rs in f i ir- 6 Note

that none of the ineyp-rie-cPd qro-IO nd entry times as fast

or faster than the 2 exoerienceo users. lhe aistribution of

inout error rates for the Stores * narment tableau is shown

in figure 7. Tho oxnerienced usars had a inout error rate

of 1.t vercent, wnich is aonrnachino the overall kevset

average If 1.2 percent s'own in table TA.

Onp of the most interestino r-sults, however, is the

sDectacular Increasa in entry soeem for the "avioation

oreflinht fabloau demonstrated by the 2 -xoerianced voice

input users. Fioure A shows the distrioution of Nav

Orefliaht tableau entry times bY exoerience level. Taole

XIT, shows the mean entry time of the 2 exoerienced users to

be 48 percent faster than that of th- inewoerienced oroun.

This mean, at 394 seconas, is sliahtiy faster that the

fastest kevset time recorded for that tableau, and 36

Poercent faster than the mean kevset time (over both trials)

of 608 seconds. !his sugoests that voice input may be

Considerably faster than keyboard innut even for the leastJIadvangateous (for voice inut) circumstance n caracter

by-cbarecter data inout.

75

VuTCF FtjTRY T LL A00J( hb ST i EP tr-R R~A IF fy L P r T~ C r E

(trials I and d C-rii-ine)

MAR F At,~

n

12 1PJLVPEiRTEN-!FO

VOTCE FrfTkY IjSFRS b1 40 2.4fh ~ FxPPEjFiCEr,

VIC IETYI5kS 397-

p EOCErd CHANGE: -A 4

*ERPUP RATE (no. nf errors /(f no. mf oata iternsJ 10I-e t r

7 6

__ _ _ _

_ _ _ L

DISTRIBUTION OF ENTRY TIMES2 STORES MANAGEMENT TABLEAUEvil EXPERIENCE VS. INEXPERIENCE

WITH VOICE ENTRY

700

V IVr 60 -INEXPERIENCED EXPERIENCED_1 14

00

U,

400- -Ii

300

MIMAN IEIREN U M B E R

M MEANSIUR 6

DITIBTO GFBSI RRRRAESTORS MAAGEMNT TBLEA

ISPRBINOFBCE ERRORRAESED

uii

WITHR VO7 NR

Ii

~7 3. NXERECDERECI

:PC_ I-

t-

lilt i- :L I- Ir=WIL

LL I'S iLUS

-fl AIM

47

-6* 3W

after

Tf m<a in-- tr - e.n r v--c- t - onzt - a~t

a t -n u_ _- c_ -t i e r n e -f n n a n

nt eyent- S-r-en.semd

=-

.. a s u°r _.Pf+A. s

Tt IS ~A? re~t~n 0~~ C- ~u~ec t e

Co-Dar n - 0oC r~rvo ety~= a- t-t t el1v

witho t er S es - t9k

theorabeSt tiore a&e hel

-ucns ort f the freee thet ~

-7-

reasone three s a d I tuse oe

in-t in eey a taSnsa -- 18-4-

UR

r f they S bt s h n i+r te-e--o- .... ++ -" - 'Cid* t---+ *n i__t

t witn te fo reS " a-'- -un-ou -task by...

-ue . _on tree = .t treec the

lessru t iouev.P any - 1 e---.+s+ c"e: e + - I CO+I?+I errors.- Th

I- - m =~- I I"' qesr~~ ~' hich aske

resonss wre ~ne~=- -~=80ifte huh ' Nrday~atosoe h

1+

cn, * C1JU',S AND~F~~f

The' Pxeriment ,ptS t~jro test tnP 0' of e ntr y

speed an-i norerntior'al error ra)te oatwepn vnire t,?cinioue add

LAI keyooano~ tPChflii~ii f-r D-Pfliciht cp,'ta e-ntry rt o th P-3L

ASW 1c-t

was ni- t acain nierPeo,)roinoth- xreriance jfel of then

test suoiects. Af I1 n ft t'e s uh ec t W w.,e f arniIi a W wit h anci

had USPI KayP-oar'1 entry qyqtomq nrior to the ewcerimiant. T t

must be emothAsiz'd that the sub+jacts were very inexoprienced

w iIth voice antrv terhrinos. Even after the exoeriment was

concluieli ti-e Amount of time th.~t test subjects had

accumulateI or, the I-bOO opS one ano one-half hiours, which

incluopo the time 5o~ent trajninq the vocabulary. The- two

exneria-ce,' users were not experts i- usina voice systems,

but as mr(-innea earlier had comoleteo e Previous excoeriment

usino the f-AOO.

WhPen a e t r i n o c')nclusions o f the exoeriments two

fa ct o rs ts u st t c:)nsiaer-. ihese are:

I . The type of voice data entrv. which was eithermultiple charzcter input for the Stores tManagementt ablJeau, oil Char~ct-or-hy-character input f or therNavination Preflight tibleau. P

2. Yhe exoerier,ce cf the usp r s.

81

-ARa~ced or. t 'e risu its f rorr f h St rps Yn~oplment - I alit,

proficiencv of the users, ano stiniertivo re-arks received

from t-pe test suhiec"S c- tr. rost-evu,-rimptit oupstinnnaire,

it was conclu'jea fh~t vnice entry of n-re-fliiht cta into

Mr the P-IL wepon qvet- r~s f~istsr Ird leq fatiquinq than

Leyspt entry. Aiit ion aIIv, wth i nc rpa ed Pxexreric e us -a

the 'ioico systo-T, the ease 0' Iata entrY a-c! sneeao*0 inPUt

coii opconn m nre P ronotinced4 as ws ohserve.-i with the two

F exnerienre1 users nt the 1 -cN%~

Raqe-4 nn th rpat ~t. vination i- efiiaht tatletu

the voipce mro-e was si-.-nific~rItv nl': wr'r than~ the keyboara

rorle. 1his has been torr-e out i nrpvious literature with

the conCluson that ckAractrov-cnaracter input favors

kevooar-,? nrtry Twetho'Zs. Oowevpr th.% experienced suiojects,

USino te voic e -01' 1i t we re at- Ie t o complet a the

NaVioatinn Preioit task faster than the keyboard entry

times of any n- the i-eitperienced subjects. As a final 3

conclusion it -an, i'e stateA4 that even in a task which Hoes

no'- favo-r trne voice -ode of entrvt such as with the R

22::oatn relgt task, --n -xoeriencwd user of voice

kevboara mettods, and with an inctit error rate that is

82

III~01P ___ _ __I

q*PLC OMMF;riA T fI~

To effectively imole-ent a 'Jnire S-5tf- for a niatform fsuch as the ~ t is; r e c m-P n fr t r'At t t-e aasiore r:

1.FxAmine tflo tas In i't nic , tr& vc~icp syst'r~ is to be

kuseJ.

?. etemin tse vcab~rvtkt isuse-4 t- the ore atorswhon enuaq-d jr tfle tdsk.titin. eqinn th~e voire reoZjiIt 1,n vj.CA.v)ulrv to eouate withthe natural voc'abularv' rf crerators when nnaned inth,- task.

FTest t he vocabularv in oner at i na SCPnarios to

He te r i np t n r s et n f i rpoutj t is-recranized

5. etrain ths0 oroule- %utteran0S

6. Tf retraininQ does nt' surot~ntinily redluce therecoonition errors, tnon Tnfjifv th- utteranCe, keeoingiroHIfiCatiOnq clOSA to rhe jx-raon nt the Onerators.

7. Determine nonulation size nf the unerators for a

narticuir~r tastL. The qtr,llier *np nornul 3rIon Sizp, the'pore tailoredl thp n vCahularv can up to the ina~ividual.

Some considlerations wrien anolyinoI current voice svstems

to the P-3fl:

1. The vocabulary Cnust be traineo 1r, tho bd-ekarouno noise

in which it is irntenoeOa to bie used. The recognitionerror rate of the T-600 is low as long as it is useain the same DdA level and hackqpound freauericy

sPectrum as it was trainea in. IT the difference inthe level of hackoiround nniSe IS areater than about 7flBA from that in whicrh it was tr~inedr the recognition

error rate wil I tno- an inc-reas& tPef . inJ.2. Crewmemoers neea tn COT-unicatp with each other over

the TCS thus causing some oroule"-s in diesion of a dualcominic~tionS System.

3. Voice innut is not the Depst inout -netnird for allcaseso thus the rpauire-m,:t to maintain thecCurrentkevboard and matrices.

83

This eyoerino~nt kas shnw"- tha~t t-ir i 5i, 1m ;,or t innn ~f

thP P-5r- m i Sqi nn tri-It voice en~try ws more c0 4 iprt tnan fthe st- ,nea-r voyho.are Ont ry current I v in use. S IJLr t i Vel I Vi

test quhjpcts on~ thp wnnrlo qt~tod that voicp enlrv was -Nuch

less f~tiauinq tkan ",t nla-I "d YbOarl entry. The voi~.e -oe)

Ieau irP a f ar I-ss p-v e -ha n~ ;nil Ieao- Tnvp; ent to ente-r

1PNORdata. In fact it renuji rpo on'ly thpt thle suoiects rove their

'-yes fr oT t he invontory li st to the APU and t- k Jt Cou'o

b e arauei that the novelty of voice entry -,e-C rpsvosiole

for the test subiects rvst-onse. O-iile thisq 4 eactor was not

Itested in tmf exnetl'nentr it is the Autnr1Os oninion T hat

novelty Wias but a minor factor. Voice -,ntrv is a naturalIand comifortable innut '-ediumr to 1) conouter s-,ster,.A

Give, the Te'noth of the, P-* C cmiSSinn and-'o 'unt of it a

Iwhich Must t inQut, to the svstce- for nrocessina it is

sconarios for voice jata inout f-r the P-3C. Voice Hata

intcouild he a significant factor in c!cjA alt rtnes.-, when a-

I engt h of mission is ronsidierri. 0,1 t the n-ennina extendea a

Mission P-3C uograde, i s role coul'J be consior~pale.

i

84

29

- - ---

A t,

IT-~U L T j 'J L bI t y ~

Ol3 4z pF-z T A T

QJ ACnrU'Q~fIC 5 T A T tS

AI Cj j~j t- TP C C;-T11

I~~~ VF* iA FW;:

IK T

IIACI - p -tIFx.

851

7- -- - -~- -_ -_ on

I

2I

LI

Li2 fl >, .' OF LI

LI

a 1 .41 2 19 b

- O TipF- L( (I I

7 7 " ' 2 S 2 b

M 3 la7-4 9 04! 7 3

o! 2 ' 1 ." Pu 3I

1t 4 Q5 i L

12l4 L15 40 Q 5 A 4 L

16 07 m7 15 L

17 Pt 7 5) 05 3 L

11 a 2 P 5i 1 17 L

13ic ~ n w 2 r

IT -

-~ I

LnC ty

-y

43 5 05 -e A

5 b ) 1:1

6 7 QS* A7 S 05 -

ME 9 Cc 5;

P 60 Q5 (Z

10 6 T , L

ONE 6e Qai7112 63 (PC " 7

1. 64 7 o., 2 , i

6 4i

15 66 C '16 67 n"g7

17 68 Q ' 7,1 69 nOL7

LOG T y C 0 L

J l 75 -4-41fC% 7o V Z)

6 77 ni

7 7b 4C 9 Qif 412

rz I111 R C 053 r94 053 r

16 87 53 87

L nL T P n F

0~4 0l57 I?IJ Q5Ob ) 51

SoOa n" -Z " L

6 07 n5

7 0 8 5 o L

Q ji O '41 " 4

I i n? I l ii I ( b 5<IC101n Q, dl 2I S

1? 10$ qq!f ! i L• 13 In, l ! L

16 107 1" C 5 L17 108 nAt 10 L[ 1 9 rZ 41 1; 7

II 11, ' • =Id

N ! V 9 L F t . - II

u I ir07 T')QF: I~ HOP D AT FP Z ' 7 Q01 L A 1 37 ,a NI

LONA 10 4I

15 DpmorE A rP

06 PPI '-'A Y T SR: v

07 nor-'f I I

UP BALK4 UIP T 14i

00° , -- uP 0 "

12 IFF CnDEs1m OnE 1 : 35.

15 ,-'ONE3: 92 n o-

17 Rur,0o/SO : ,-5 -,, 9

i *** ALF .T A Qpra *I *PPOFMPT LT VF 4t*

: 88

" "J

442

I I t,

~~ ~lN( oferfflrw 'OtsSacKtT' E t 0ci- SiScreAte f ile f,r jrt r orrptoi tzabieeus* call !TIT1TAI 171!' t-- ;iti3lize tNe:,eaStrujctu-eq oH *0 set o n oa 3 t. -f% de x

c L

Sn re-Vontv Uti f eie e

oacksoace countsFON write cnnootal taonl'eus to j-jv fil s1 ~ lto e I

INDEY 1Iidisolav TN~ ala n- u h iuain

* isnlIayI IL'FX tte au 0&-d "L IJLtpopJ atrML si 'njlI t ion terotinat ion i s reusnCall PREFL~TO ;%t.d CONOcfSrO A--S!) ~ t

t ~ty the oneretor=

f FNn TN~PEx

PRFFLI I) ( nanrile v 5t'eV a nd-=iictnI"O_ 97- pcrT~ tablea3u!

ft l I TfFGFIt t bIe mu ano1 orompt lineftwhile inoUt is tan !NDEY repauest -1o

c call Uj'PJT( r -oe ss te nnutexecute 3SJ"l -0crn to sum- un i nout tineSCalI CaIECKL T --r E to etee-t re if al_ .

s required _ Iset val up for nnut 1ine Crs~or olacemefltc caI SKI MPA r, IL w r ite 3ln c anoed i ne,

EDwht-TLEr nPnt u t 0O% t ~ t'fC

IiSONOSTRSOi [ h annu d awasry and --di ficatitonIof STOWF ~aNEFT talau I

Call "l itrutA

-- - - - ---.-

II

I lou t il ' ' i-ro e

SI,f -

Oi

I IMI

I I;

4~dt-V ;ljY rj

U31 ~ E -nr FCA'iT1 V ~YTL L '

THF QZlr;L UF THE MA -

* p n P tTm ru%'s iII'Itf-

T--C - ii'si

FrP TFL~U .jAI K Tj TA -- t. t2Z N TZUIJ C I 0P l0TI

JJE THEr VrJfSp- - Pi-iC$ TNT -- ALL ELIUV' qT

.'tv 119 f SPEAKING rFrr !..jjI:DEh Tl~A 1t41N- I T r.r Tn KEEP TO&CarL-

F T~tRJ TLNI 7OIt Y7M S_ Ei rI iG0qn &EUTR

*It CEpTaTJ, T11 C f. L ,T4C A- - UT1EHAr

R umn r- ^ f NG Trz'AlNK~ 'I M!D _49I-1MS.T c T-L REENt IV E A11DY G lri A_ ~:TI L IIILLII ztrfI~t F !)-uPILTNHE'S F P!IISES

It

;nit

'ne iteciv nt t' ~ 's~' t~ & aluat t~-

use ofthe gTj un~rzrit A- an ino- Apd-ica

for oref IP-At in £ ji a' .ya C- C

ran uso t njis s i = lon v ct -a tam.I ar w~ith the

cornmands neceSSc81rw En v0--- -,~r WVIn rou'z-- rae Svste. TnAx

[ is the c-urr-OSe 0f m~~~=~n

[ ao -~r, Arotre-ei tab --- Witt- e thn

1: a e-~of A~la:vin--I. Loont h i s'i Pnr-.. Az.-,aiz~u~i vit the

dtae t-~O8S onrk -r -nj - h t F t one

vtablpa --e~f cry4 iv - r0 rtcti~ or eifti-

inoir tha rto eirt-n - E a_ J- f55n hsI

pxro t'flt 01'. - ab I -eAg - two ;% - .4 e~~ ta t -u

~rtab' C s &a4nr fceen te 5ra on t

F ~ ~ n ac 0_tualr tos~ hI i ~ se ee otels

Th. voer- at. *tr 'ta a~ v~n t thee taei-s.th aletF aIea Aa~o I. A birt will acorNee

actual- C ts - n- ar- O__rfa.r te ls

tontent Sif- she 4 -3t, s ... data so niin hich. ~

renut reS votr ateft" 1ese ale r ts e4li he -e-crWb-

store fuliv later,

Ttr-e-4iatelv 6-e'ow he err A- isteooc le."ere iSljsoiavea' t' ,in-r e l ine woich i-72

ava v-f or dai inout 'ut *r- f- in of the

tatlIeau b e0in S eit~ a ru~ "~ f %-,we.--! ano

characters. T-er edt-;whc sectio-

ts m-odifiable a s tS eCt i ~f -n sra~'nnd'es

that for -flu. Thi s is ta ino- * *n. This is where thesyste- Cuso will aooeArW tie Swntiu _gG a o--character I nn c-ink in line -- 9- a #~oro=frLat

tot It6IaSoe Ietn rt m lal

c haqraTer in t__e otorr-ut line. Eetouhthe uate in the

IS 2

iiA____ ___ -

lat.i ' =~jm "ny.

n-re~a t j n t~ n- c -w-.r~r 'i

f o ra tt u p i- hr-O uaa n z n te. a

Salwaysl e 4 e~ o Q_'. Ad W.- ot~t

'eaoino rer--== :e 01 v1e-C - . src - In ;:w mo-Cut

when efltfr1ns- ' P %;%-

rel at ive v~ tno Cfc ̂nA- t SCk as 11- 1-

suh.Qr R Dn U st i 3 eauFonta is l I C + i . O'~z _n

icf t e--~ an-.- va fA-y_

-- r_ e avv

rec e i vestr'nc filI y S-- -tra tnre vacrf t 1,*aircraft. wnerP r, S-~a arc-tseterMlflo, t4 the

I-sounds a re t cs e of r i n P

IW 4

= - -- 'F -

=:q-i &:Pii-- ---- -- - - T- - - --- - - - - -

S-T

- - r. , 7 er

era C..s _-_ -=

I L

08cel b . oAt

1 -_--- -- -

Ia - -ai QI-s

I__

-aD -_ i-. - I.--=I fan -I== ",E ,~a~~i s-'=avi

I --~l

__ '- - * = - '

I

W I~A PY (F V U-T CF T PJT q~F OMj~

DESIPRD ACTIflI4 'iPU'<E" I?"P1U

ENTEP nATA "FNTEQ1

DISPLAY LINE n FOK ,IiOT!ATu "I-jNL <n>"

I3ACKSPACF "IAACkRPACF"f(backsrace one ciaractor)

DELETE OTNE "nELETt. LTNF"

(erasp entire iflcot lire)

DISPLAY NEYT PAGF nf 14'0 LAYj "NEXT PAGF" 1

(SIPES fArAGF[MFi4T nn! y)j

DISPLAY TWDLY TJARLEAU ofT Nf)f&KX

DISPLAY STORES MANAGEFui1T TARLPAMI "STORFS MANAGEMENT"(acnplieable onl y wher, T -91EX i sdi spl ayed)

DISPLAY NAV PRFFLIGHT TABLEAUj "NAV PREFLIGHT"

(aoplicable only when YnDEX isLdi sp! aed)

L

'AN

A , -tk --' -'

P116 PCIII

INVALID LT N F t,1 kFu-'it~v LTINF DoUF Ib

NO' tll1j.I TRY AGAIN~

Nrh-M0DIFYARLF I i'It. is~i~ RO

SF L Ff-T A kDi *YASIL

EN~D QF PACE C1I'Af1 PQuM'PT LIEJS3 THF LASf LTNF OF

THE L*,IRUILY IOISPLAYFU PAGF /NONjE

96[

- -

Orior to runningj the expari''nt you will Ve given timeto become fa-jllar with the nata entry into thne rorpter by

Of atat 0t,, enere ot _ cotrol fndnotitne Simulatio

nvevie setio. t c ommand Will beutlzdi th

famiiarzaton xce~iewhichi follows.

V 0C r)A A I Y FA AT L T AP17 AT 1 M

3. nislav Snres anagemnent tab-leau: use cori-ana "STORES""MAAGFFNT; t-A 4ISIJVWill t'~en show the first page of

the Stores Manaaement tableau.

4. Advance through the 9 cacies Of the stores manaaementtableau usinai the conmnH "NFXT PAQCE". The last line of each

oa e SYS mor-#indicatina another aoe follows. Thefina Pae ds~as -nd-in it's last line indicating thatno urter age evst.Use the Commarid "iNFXT PAGE" to

return you to the first naoo of the tableau.

9. Retujrn to the index tableau bv usina the command"INjDEX". The -index may be Called uo at any time other thanwhen a line is in the Process of being modified.

6. fl~splay Nay Orefljght tableau: W4ith Index Ci~olayed usethe command *NAV PREFLIGHT". The disolay will show the NayPrefljgih( tableau.

7. Data entry!a. Mav Preflioht displayed

enter time"2 2 0 U O "0""0 "0" "ETIER"

line 1 220000

CL

I 97'

= - -

line 2 ready

ente" date

line 2 09 01 o1 *

line 3 ready

enter latitude" "7n "211 "4f .. ..o" "3 . .'tTH

ine 3 7 2 4 L34

I ine L! reaHy ,

n t ar 1 0o n i t U O ei"I "2 "t" " It "0 " 2 11 4 1# " vNF S T "

line 4 122 n3 2T

lime 5 ready: line h nows "non-modifiable

line" cue. Go to line 11 to enter mode I for

IFF rodeo- -

enter -o-e 1)" f"3" "5" "' IFR"

line 13 3351in- 1I reaov

enter ole 2 i"b" "5 "" "2" "ENIER"

line l0 6SU?line i reaov

enter riode 3"7" -7" "7" "7" "ENTFR"

line 15 7777

line 16 ready: line 16 shows "non-modifiableline" cue. Go to line 17 by using either the

command

"LINE)?", or Th-EYT LINE"line 17 ready 'Ienter bureau number of a/c and snuadron number

"I" "93" "9" "2" "0" "4" "1" "qm "97NTER"

line 17 159?OU 19

line 18 ready

enter call si-"MIKE" "MIKE" "1" "2" "3" "ENTER"

line 18 1Wi23line IQ realy

enter crew ano- event number

"Tau "0" *MIKE" "I" "I" -MTKE"

line -10 10 MIP, atso cue end of cage"

K] R.

I.- - .

CtlvI.Oh1 t n i7lri>h jpnrf:~ EMIDYe a nda re-entercorr-ctly, For axa nr n nje should hive been OC3U vice

Call up line I- -usinn th rommend "LINF 1 L4

Fnter correcti-n

line 15 ready

If the error is detect- orior to the "enter" cormand abacksoace 1unction vav to u ~ed ty usino the command

"BACKSPACE".: Exanol e:

Line 15 is oPina molified. The desired code is 7777 ano

your inouLt is 77o7 a - the command "ENTPH" has not been

uttered isp the command "bpCW6PAC E" to mive hack one space

oer utterance and then irsertinn the correct co4e 77"7" "7"

"ENIFR". Another methno of correctinq the error is to use

the "nELETE LINE" function wnich outs you back to the first

data entry point of tne line beinq modified.

E_.amole:

Lire 1 is oeina nifier- as above and the desired code

is 7777 while your innut was 7767 and the commanI "ENTER"

has not been uttereo. use the command "DELETE LINE' and you

will he returned to the first modifiable space in the Vine.

Re-enter the correct 3ata.

b. Data entry in Stores -anaoement tableau: nith Index

displaved use commanr "STOPER MANAGEMENT".

All entries into the stores inventory are accomplished

hy two utterances. The first utterance is the sonobouv tyce

and it's depth settiro? e.o. "41 DEEP". This is a SSQ41

lofar bouy usina a deep deoth setting. The second uttefance

is the sonobouv channel -u-ber and its duration (how long it

will transmitt before it deactivates)f e.o. "2$ SHORT".

This is a channel 23 with A short life setting. This secondutterance also has an entsr function asociated with it that.

will disolay the entry momentarily in the cueina area and

then enter it into the inventory while simultaneously

displaying the next seauoantial line for modification. .Observe the format of the tableau race. The cueing and

99,°FSii

data en? rv aren i s at rh- bottom o' tr- rn. The f irstnumber disnlnypr from- tho left Is rth lino rti-ber o f the

displayed CaQo. 1"e Sec _ond t wo -utbers in-1irete wh-ere theh1ouy IS ohysically stcre4 nn the aircraft.

The se--ue-c- nf Oat entry is as f0? inw,. '

Peaov for entry La W' YX V XYX ,ENTEP 6qWaIc P51 1e r chqnnel ?3 short lf-n t" sneaK-Inothe Zornmands "Uj Ori(cf '$P3 Lo~qJG" wit- -. %rnrt nausoheteveen :srtrieq.

WMod if i eo line: 3 i'- (fil P e23 S .iI aooear 'n i ne

3 abova and tl IS tUYX Y XY X nn-w apnears the

cueina area.

Enter the foilrwioo houys into the svste-Z L1, deev 10Icino, 41 shn11 04 11 1c ,no, '3 shallow iS IonG, in locations15, 16, andi If resnesrivolv.

CUPRECT IPNS

The sa-e cnrrec-tion nreocedureS a o rIv a~ oeu !f orce. For

examnie: PourV i-cat ion 1I fshoulId he a q5 Oe IS lono vice53 Shalljow ir Lonq. Correct this fly CA 11'flJ on line no. owhich is .nvqere OUV 1ocatioin 17 is held rn this nacie. Usethe com"mand1 "LINE6 line 6 is now -isnlayeo in the cueingarea and is rgaly for moaificetiotn. Enter the correct date,as betore; "5 r "1~5 LnNG"

The 'enrKSPhCF' commandi mar De uJsed her- it 8-, error isdetcte ~n0-~first utterance of teline, i.e. b~ouv type

and1 Peoth. qinc' there .1re 3 characters in the original -utterance, "QACKrhCF" would need to op uttered three timesVto put the cursor in the first ffodi f iab Ie nosition. Thecorrect data cou~d then oe entered. Enter the t-ouvs 01 theattached oo=uv status chart to become familiar with the' entryand correction functions. Another method of correction isthe coinmanA "DELETE LiNEs. 'QFL'ETF LINE' can be used w~enFmodif'ino a line which has not been been entered. As before-it will retu-rn the cur'sor to the first mrodifiable character

o f the line beiflo aodifiea.

KtY6OIAQD Q-AJA ENTRY FAMAILIARZATION4

1. hider Aisplaved

?. Display Stores Management tableau: Stores Msanagevient isline I of the tr.dex. To dispiay. any line of any di-splayed

- age the oterator -Dust enter a-'two diuilt number for- thatline. Procedure: with index di solIay-bd depress "0" "I'

100

A .1

TfO. Stores M.qoso~t~ nnw -isrlayed o- monitor.

A. dv ar-C t h ro uah t- Inc fve -qS ot qt,ras -dna,3ement b-Sy

Usino the 'next nanie kev

4. %turn to fflp T ndepx by 'is inol 1 "LJFN" (terrinetescurrent tahleau entry).

S. isl av av Pr-aflj nhtr Tah1--oau: ntPr t o Qloit linefliamoer fnzr -!PV PreflIi oht, df fl *FT=P

6. 1)lata jn fl-va. Nav Pro-flioht

Enter time? kepyst or ry 2?0000 'E-T7RFntered data ,ill r-&an in Cupinq areauntil is Jearegsed.

1 ine I ?2irviUl ine 2 remAnv

enter date N-"

l ine 2 -'191AjI1ine 3 r e a a

enter latitun-e

Si ne 3 3 7 2 !4 0314line '4 reaAv

e.-ter loncj-,itu-de

line 14 12?-- A3 24A#line 5 reaa-v

Iine 5 NONA -MO&,-TFTARLF: 00 to line 11 Hntrmod4e I

339q "FNIFR" ~line 11 -35l ine 14 reedy

S oenter mode 2-650i2 "ENTER"

li ne 15 ready

enre" mole -31£

line 115 7177

211101 jK= VM

lie If, r at

line I o -o, ,-,1o e ln to ine 17

Since 1? ic- -nIv one line o -- it "ENTEP"

enter hu-eau ,f -,ie r o i rCr -A -n H squadron nuirer15Od -9 -rTQ, -

I ine 17 jrea "- 1lie AP r e aA

enter call SiaVI?23M "E;NIE9"

line jP M12t

line l0 rea-A--

enter cre-!/evertlOMl[iM "Fv-,TE'-line 10 10 Lil1 also "EI) r 0AC-E CUE"

COPPEr ITh-c

Cell uo e. line in wiiich error occu--el and reenter

data.

xpmoi p: ,Aode ? snnuld na.ve been '653' vice '6542'

call un line 14 hy hittino 14 "FTER".

enter correct lata6534 "ENTEO"

line i4 rea'y4

A baCt snace funct;on is alsn available,, if a'. err')r isdetectea orior to- n;tting tne "%YTER" key jurino line

rModification. Each "BACWSPACE" moves the cursor one space

hac as with the "RACKSPACGE" command in the voice mode.

Proceoure: "BACKSPACE" to the error; enter correct data ano r

complete the entry for tha line then "ENTEP W it into the

system.

b. STORES MANAGFT--T ra'a e-try

FntrieS into the Stores manaaement tableau follows the

same rules as the vo~ce entrv with wo differences. 1) V

Each cheracter requires a keyset denression' e.o. Q # min

*DO N2" 07" O H"F NTED" and 2) Fach line must be .-anuslly

entered-by using the enter ko vice the automatic entry of

the voice mode.

Procedure:

,02

n _. ..

fljsplav tre iYnLy -v 'pi.Tr-1zstno ri Sr IIF" dioAy

Stores F0a n anent by eressmnq vl! li~" Fnter h~ours in

bouy iocatinns start in- wlth 1oce4t on 4i & to new t ae

by denressing IJ )Vr-' Iisnac starts with lorati-n3(Hit "i""FodEP" n~' r to~ec' 3 o f StarosL

Manaac,~ent. r. is vo-iq -tarrs. wit), roijy izton S" -ayo

are renay to ent-r -to~ei;z Fnter tno'~i~n oy

lc at~c bo)u v

57 411"

r forrectians rale With the three Petrnds uisra eforentendfl un w hen thp arrir was discove-ro i.e. either

aftr c-petig n etr oraur inoan entry aid or io r3

entering it into the inventor 1 -.

Correct loce-tion S-5- tn- ro~ 47 5 PO S

Prncpeaur P location 5is in line u of current noeI. eoress (1 FTD1ie 9-J rea'Jv

enter 'S25"FgTtR"line 4 U.7 S 1z

Enter the nUOVS on rne attached bo-,uv stA-tuS chart to

rkbecome familiar 1ith the entry -and correct ion fun-ctions. 1

= -

- - -.-- -----------

VF T .. .. ............. ...... ..

L-± 110. 8 i

Tv ................................. . 1

C tAAR5)Th................................ mu[ A ~.......................

.. ..... . ..ai A -r . .;3 j

1 FF C0 nt$l. .. .. .. .. .. .. .. .. .. . .. .~ 1.5

520

-104

-" - -;. 9". .._ , ,".'

wr wr

CA.ca

122 1

4ii j Y

RX

0

SONO TORAG RwC

LI53~~E leI1dc

24 1 6" V 41IIII77 41t- _ r

76g 416 jdr Z4t.1 A

106

awW41msa4a.

ME-

<:7 . -H

"j-

%n'In'

E1 iii o

- - - * * - -. - - --. * vi

O~ %a a

%o:zoit Itll

- I ,. -I - .. 2

it

I

. 1

SONO STORAGE RACK ISTATUS CHART

NO. SSQIoEP1iT1' lio. i L77 41 3 d 4L

7S 41 d S s a 11 l76f 4 9b f01 L]

1 - ,F1

7 1 8 24 . 109 4 1 1 L L1

-. .87 53 8d 107 4L 2s

_. -211" Tl .-S924 106 41 ~ 14 L

3 d f - .'7 I

-as 5110941

108

414 --

-~- - 5 __ __*KNEW-

-. -- -

\'VClT LF Qfg C T1 " 'VArtRLUJt APRY

T . I

h 6

R7 F71/

1 0 L V!rwxxl'lxxxLcc-r>1 'I LcIIrxxjilxxxLccr>

12 1 d L V~jG xxxl?xxxLc-cr>

1 3 1 ) Lr~ (IPxxl3xxxL<cr>I14 1 i Lfl0 fl yxxl'JxyxLccr>15 15 Lr01Nr xxxl~xxxLccr>16 10 1 fi1 : xxxlbxxxLc<cr>

17 117 L0 r',C xxxl7xxxL~cr>16 1c HOLQI xxxl~xxxScr>

20 ?G S t i DT xxx2Oxxx3cr>?I Ij b-HUPI ,xEx2lxxxS~cr>22 1'd 5t4QR xxx2?xxxS<cr>

?4 ?4 $r-HPI xxx23xxxS'cr'

26 1 -FE 4 x 2x x FLcf8 II -txxx5xD cr

31 1 SHALLOW~ S7xxxS

32 1 Nn E Y Tccr>33 MIAY ORFFLIGHT 10<cr >

34 SIPS !MA71uAGFMENT 0 1 c r>35 NOIN Nccr36 WE ST Wccr>37 R~rKqpALF CONTROL H318 ~EY1 LIN Fcr39 EN T ER <cr>ag 0NET PAGE n~c 0>41 LI'VE I O1<cr>

109

r I,

____ - -= - -= -- = - __ ____FN

1)3 . U' .s03<Cr>

'U 4tL "k71<c r>a4L I MEt 5- O$<cr>

9 L i'NE 9 09<Cr>

;vt90 16 1~' 1O<cr->91 L IN5 I 1 1 <C r>

52LI N I :' 2<C l~r>

Lir lb lt-hI6<c r>9z7 L I NE 17 17 <cr >98 L't I E I <Cr

t;9 1IN 1 9<Cr6061 DELETE LTN'F CUNTR:IL V <cr>

DATA FORrMS

S** V 0 1 t. L" P r C 0 "r T T l ' A T A H tt F F T *

.r tJdF.. .. .... DATE ......

-PUN VI/V /1$1/KP/ -1JfRt. t410UF: V/ K FILENAME...........

i

1-- t

*********** .... RT~' ... NAV PRF!h 3..*..*..*~**

- -

111 -

!-p

STOR_ _ MAN - -FtT ....... NAV PREFLIGHT ..*....

N .LIW'E DELETES . . O BACKSPACES .. .. ..

_.CONDUrIED -Y: hOLFE /TAGGART

vn it

...... ........ : .................. ..

.. ...........I* ... .. .. . ... . . . . . . . . . .

. . . . . .. . . .. . . . .. ..

....... 0 ... .. .. .. 0.. ...

. 6 0 0e.6.. 0 .. .:: ....

00 6 6 6 . 6 . . . . .. .e.. . . . . ..

****. VGTCF INPUT FAPLRPT-"l ,13LSi T0J M."AIPE *****

WARFARF SPErIALTY .........................................................

1. Tn general, d o you lik the idea of voice data input?

VERY -'L" NEIUPAL NOT AT ALL

7 4 1*1

1 2. Tr generl, wotld you likIe t- sp voice innut in every Iday tasks vourself, if it were anzIicahi ( i

K1VERY 1 LtIPA NUT Al AtLL

7 6 ?

3. Po you think that voice innut Fad an advantage over thekevspt nDut for the btores ?tanaoe-ent tableau data? If so,

what was it?

VERY vJ-!JLw NtIJTPAL NOT Al ALL

7 6 '4 7 1

... ........................... .....

............................................. ILI. Do ynu think that voice inout ha- an advantage over the

kevset for tne Nav Preflicht tab-leau data? If so, what wasit?VERY I'CH NLUTPAL NOT AT ALL {

75 4 2

~ ***********..** ...... *.....*S.

So Do you think that voice inrut has apolicatioreS in vour

military soecialty? If so, what would they be?

VERY MUCH NEUITRAL NOT AT ALL

7 6 4 2

0 113 {j

RECOGNITION ERROR SUMMARY

t r 0PW T I TU N RPUR SU Mt-By uITiERAw'C

P3 FE OF PEciCENT -F7MCI- FNC EPRP UCIWjPL.1jCFS ' TT -I VUP

lay------------------------- --------------- -------------

7EPo

nNF ti16E IA1 .

THREF O .

FIVETI

SEVEN lT0.

FIGHST TtiPEF- 31.STA .

P.41

I OG12 LON( 0.7.10 LONG; 3 1.!

12 LOlNG

13 LONG 10- LW~ ON 0.4-

17 0;.G 0 .

14 LONM 131.LONG 5 1 .A

L'1

_---l ~H OF PFRCENI OFIJTTLRANC,,F RF -rL -; p-nE CFs TOTAL FRORSI~

--

15 LONG _b LuNG 3 p.a

i[Z tU G0 1 OGAL

1 17 L LOULN G1I, ' I'G 2 0.7 :

JLUNG 0 '.7

11 LONG I3 LUNG 2 n.?i-, A L !t '4.8

18 SHORT r-2~~~ hfI9SNOI 2? StifIR 2 0.11.

20 SHOPr eK tORT 1 0.024 qhORT 0 P.7ci SHO'RT 2

• 0.7

21 SHOPT C SHORT 22t;. SHORt 22 8.

SSO 0.7

22 SHORT 21 SHORTAn ,hOT 1 1.1

23 ShORT 454 16.119 SHORT 4 1.510-

3 SHOPT 20 S-ORT 3 1.12 SHiORT 1O.3

2, SiORT il

24 SHORT 23 SHORT I O _.U21 SHORT 2 0.7

2;? SHORT I n.4 L2S SHORTt* I OA

25 SHORT 2 SHORT I 0.0

SIIHORJ 1 0.4

-I.

i -115

--- -- -- -- - ------- -- --------- - --- -- -- -- -

At=--_

tMU BFNg uV PERCENT OP,,UTTERPAN'CE L-PRPR £sCtfRE %:C rj- .TUTAL EwRURS o.o..

II

m1 4 SHALLO. 5'3 SALLu t. e -

47 VEEP ! DEFP . 0.7

147 SHALLn,

53 VFEP -,53 SHAt Lnn..

T N-EEP LiNF 3 0.11

NAV P~FLIGTSTRS MANAGFmFNT

NORIHWEST

RACKSPACF NEXT LTo- 1 0.-4-OP T H 1 0.0

SNEXT LTNE FIVE 1 0.4

ENTER SIX l O.a

TnHPEE 1 0.0F-fHT I 0.a

6 2.2TM'CX 1 0.0

NEXT PAGELINE 3LINE 2LINE 3LINE;L -1-L 5

SLINE 6|LINE 7

ci-A

-

- -

UTTEPANU -L _

LiNEL.i NL 9LI1NE j'

LINE 11r INE i?

Ii~~~~ LINE13L7Ch

S~ ~ lNE L TPJ 15 20

LINE It £L INt 16LINE ;7L INE I

LINE '

MIKL F T vF r

DELETE LONf

[ mi A~U 8CH 1

F:7

= -

1, M_)- M

k F L~~ t, M I~ TA L & DRlR b i t ) hI

iA. a t -r,r uC , i R-- E F S I T &L ERRO F S

ZE~o 1 0.4 4c 0 . 4a ti=t

0 .zl

TI. I

FU0.4=

FIVE C'Fxr LM

I! i-gi~t ZNFR !0.4

iI 9| LONG " ,g

IZLNGI L*nGr 0.7

16 L~n , p9o7 -

7 0.7

Ti LOON371 * b LI-0 L i T

11-8-" \ *

- I- -- _

o -- ==- - - -11_ . .:

M ict ,.% . . ::, • , :

17

17~ t LN SU

I-4

1XC SHF PE F1TO

22 Li'~

20 01 T.

20 sha~i 220.

21 -SHORT20.

222 SHOR 1 0 Q - u

#3 SHR1 21 3- T

24 CjiM K.1.

41 SHALORT2 :w

47 DEEP47 L0.

V,~

- i

[RR ~ ~ ~ -- --- ----. '- 0 ° -- ----r -------------------------PROR

3 FD

N .1

-° ~AV P RFFl I

-=- -Pt ,N -.-A TLTKLSP

3 PACK3pf. L

_.

NOET L t T f BACeSACEu H :

LNEE 0 F

NEY 1 PAFL T

L I E

L NE 3 c

L- I tP&

LiEi pA ,F

LI td E

L I fat 5

LINE 10,

INe i ILIVE.

L INE 11

LINE L I

SI NE IQ LINE 1

FRPUI U- 1 k ,r UfCI{!k - MCF.5 TnTAL ERRORS

~I INE .

T.- Li3t. 17FLIRFF TO.4LINE 16

LIt.i LF 13 U 0.~4EINE T0MIKE

~DELETE LTNE

* (OPer') T JU I 0.4FOL-'- I V.4 ,

;bIX 1 0.4

SETGHF 1 0."

20 SmnRT U.721 ThnRT 2 0.721 SriORT 0.4 a41 nt:P U 4

NEXT INE I 0.4i -

ENTFi 6 2.2

f J

121

W5

SIUATO LITN

0icld tsaf-h

de in S-9 -v9

:dP i n ZOUI Ir t ' ff1

tSIMULATIONMLISTIN

: deie1AOtMacline 0-14FFlYma ?gal0 -j, /.tGDV"YIPLA

"n /* oi Ouvcc? Ul 'veci) e

Macfin.e LmFVT I-. C14It 1 *

Uorfine FtuS,,1 fl*ka£g tfjnob tlL""tLP'

iacfine PIJrC

Eda f ine !DF~f I r / t j~~Juz t50

Macfine 'IS4PI n~o f"Awne 4Macfine LFI 4t'~ 2n r* CNtrfl of lie*/ on

racf ine Lf,1jt~~y;

Mdefine F LE r.IN PNa-fine IDUF3 1A

Odefin £FNUflO FIMFI I ?AL41

M in e tLraeufivA1 a

M~fn 1FN2 * fubta ie nasl~

Woefin.~ Jamtd~~i j

ELIn FfeujPit 3 f ig ooit dhytel notiodin d-IA~ I i

Itructbaa-Awhrso F,0P 1L~F'1 I

MAI

ift nchr rrnqr,nu: A~ DI -3mi1U)

VALE~ ~ !apn E-41 urd l)# ~4

2rrt(TnY nn2 o D

printf*TE0? V' A t ,j Ln 2 ;" '%i ~ ttW10)rItfeluut 9U0i)

v anf*NnITE1 L1 DU ChrecLr,fl1 r)

2 tet t -; tv?*:1**

putci a viFA?0:140tpnnf~fl~t 'S2 t ~f*~siel.tOCf~~lUajtdtunI-1V

:oot ri tff/w adldipla and L02:2;Ctn Ofu$tit S wQt~f tuflftaleau

0e~tI 2 teonesrnimlie2 h#3lS~i0GL

wr f pusttoro2a IftSONG!~)M moc a Ll);V~leo ZFLE

t*tA a* in;n *1LNF LMSM

eoftotrsrI 1' ~anda 4Inlay nd ahiflctl~f of tunsUA-un tbeu I*- 7abl-- c';>ONOL

-i Q. 74* ~ ~ -J* , I

10v-- r w r _

b=~arr A-wr i t-b ~ .t ,o w i .n~ a 0t a j ,L fS vA )while F-n tor

ftlir~l nel indet!

i t iWf~tONOO-Creoe A.t

else Pr~ : r~j;

wriu i j / tboAe'lS t rb4norn infton ,LhotJA

linehva't a line

nchar A~lt,*0l0et arinvt tchriniou; 11tPOxf

Siteholdcer lnecas 0: I$ s Aa

swswitc (Mce)

case 0:tcs Its /4at w55nE cn-3 t

tweak:k

Cas *t'tcase t'1: f# nex re us I

term a:

-Ca fnu *6*eno to44ln? nmer*

re kS

tS V Aa DAR

l'C ~ 'o' ft1 * I I I. the . a it v #li = In - q [

l1-e A C

*rrl INYVAL~fl LINtE ktIPERI;

Iffraaieeu MAVJ 1* pneeft noflSEOlfirbl#ljnom from O*iftQ sodifie4 0F~~c~eGCS sstirin::cg*cMi. litoet :aie 161

I odl lnetnrs)

bbreak;

return!IFFt Sotb~ckSt ~ &ese just eit#4 prawo' line We

outcbarOEtEII

genutl oi 15Iftfbteta lA)

s OMli fatindll? n alfftU*

suitdrchinJ

ftect k4 I1:ewritebroaot

-aeIndmmlento 16;

imftn 16 42~

135 ~ ;km

jR~~~R 2;j' 5-,- -

-,2-AA' -*, .V-

case 24case tet1c~se Is:eas' 17!

a Innent =- IS;breakS

case 3*vaplnith% Iin

4ent 14

case 4

cas r. ~ ack llcs 1*tc.As. lb*

cult.. c

I /Z lftt1u A: Iy)a

*pod :FAL3O!;

writerPrort)5

irwrt :,.tSes oe o4 " On-ftio * 0 ;M s-

- , *ki~~~Dat tof laie cn ~le

outcuor(b esetl 4cScdoe)

ME m

J-4'

____ 44 4 ~OF ~Za-

Char bbutw*0ut:1In- i;

fI

wn* I t a

L 1I/- for.. A/

r fla~~Chr *qtnut~iriil.ilfOft apr.oess 1-nDUt ,It it 5 aot a S~ekar 'p1 Tina. naal? cane, or linte no. a~h~ t *

START I

.hflli(.n = etcnrll 4Cal 4

42t-cam enarcount 3 t o tee #S#tar-mcina Prior to-

- famine of struc? Of

wis* - -

- Luau. f fiUshiS out C of

tuwtvet- 1Oti -

* *f li-e CFWST~lL~4*14fleufRl

1UI

Ae~euiP

- 0~3 - - CAL

retueto)$ Is to uIput I

I tnetinput *1

Checktiunetl 1 1* flctermine 4f Alert is teantred foe requmgted lin*/*

switchchtsbleeu)

r b~hlhSiNiWA z

es *-age Oz~

IT-Fg = 305 -A-res &s'Fu OF ParA.

I rnv-sftUtWLI LAML IM. *1-breolf.Cas Oltwtclne Ueas 4.C-s- IV*Cs*a)5

Iftwoul

e*'p O.Cm %Cs 12ae usIq-as,2.128 q& FDOFP I

rtm1Q

Cole 1%IWFA:swittn june11

cocaal 0*cq P~ae1

line 16;brpaok)

default:iftline '191 k

line : 7; .

& defaulft

r * I. isln £witchjtnhleav) S/

urlioraDej I e~-ilta Alert if reftef'as1, 'lear it if it IS no lonaecF ruzui-el. up %k. to% tin.k if neither of thewi. a/.~

Case HLh~

lStimetut t:

cittepo #1al 1,00; 4 Inirigiz r n to dasf~e ta!bsfutin sma

11 X @.BLAF-Litf"uMAT file

I' MEl.~

printfR IMIZL1 WE

fpt cnL on~-a~129

1.3 Ufaae(~refiiih, r)trio ~ c Prare~71ps

*c lo'te fpa) .*/

~uv yst4. to buffrf inaut made 4/

odh~iI f aji~, 16 n&Out tew b~t IV

Lx a~o~4) 16/ -e? 'r'-t~ o 4*9- Inrjt wode 0/

ot t I

in! varrgt;

:::2: Ol ?t. awc$-LAtk1 aq :#*) to UAI4PtA4. as 14"e oc a

An *1law 4 ltisty ot Sfll "a "AV teblnn" atin* -,rucLl

IsW WnmIrI

I - *'llie :fin

z j~NNWr(~sttn~

'L

tt Atntipl) 01 /A inNi,? is ialig lineal

can If

ISP break;

defaultfbrpekI

Yas ari-cwit, .'m.N.y terifetS t)a 5/a Ina-*IPJEI

oedefault

DfitfI' I~to; L t~h)

whltw I'em Ias)'[ reitfl: ta4;~sI~ al ofifct in f '4aV 4MPI4Tte5auDfm 4# via-a mrieup v nd vel* th1

Ye?.ifife I.

COrrfrselbls14

Ie~wg-gtaat wasc

wtn41tfic~aavaieq9 13 /4a"9 le4f1r aibe *nhler~l Tsr.) I

tt t.

IUS

miq~cs ~n 4c~ S~a 7 .

inden I i

in-fo.-t Isi.nen Vet no ti-

~t~=Mr

Ft

r nI

.Final Ta6tk Reprr, 'v.,1 IAi r Uovosl oment Center c*,nt ruc~t

number Mb72A9-7P-P!-17O, Critif!A Insules in Airborne

Aonnilctlons of Spe-ech PCoqminn, Wayne A. Lea. (no

Maote given)

P. Fjnil Report, (romtract NqOuOh'J-77-C-O'JUI, Uffice of Navni

Resemr'ch Taske ?i1-IbA, Tnterrtpd Apn1iCntlons _of

Automateri Speech Technolor~v Final Peaort,, R.L.Feuge and

C..rer 114 Fehroary 19-7g.

3. Mcrormiclep' E. J., Human FpACtors in Fnomineprina and

4. Final Per'ort, nffice of Naval Peset~reh Contract Number

NOOO1'4-77-C-0570, Review of 'the ARPA SUJR Project and

Survey-of urntTerrnolopy in -Speech Unrderstandina,

Lee, W. A., qr Shoun, J. F., January 1979.

5. '.ea, W. A., Trend~s in Speech Recoanition, Prentice i1~ll,

1 9PIO .

6. Threshold Technoloay Inc., rhroshold 600 Uqer s Mfnua1

June 197A.

7. Oefensp Advancod Risearch Aa ny R-l3Rb-APPA, The Use

of Speech for Man Computer CommunicAtion, R . lurn,

Jlanuary 1974. AID 71706e.

A. Rome Air Daevelopment Center, RAO)C-.R-77-30b, AutomaticP~ate -Entry Analyin, Threshold Technology Inc.,

September 197i.

9. Fedrml Aviation Administratimn Report Number, FAA-NA-

79-20, Contract Number ?lQ-151-100, Voice Data-Entrv in

Air Traffic Control, D. W. ronnollvy, July 11979.-

10. Navel Postqraduate 3chool Report NPS53-80-0Ib,

Fxcerlmerits With Voice Tnout for Command And Control;

*Usling Voice Input to Opernt *Distributed ComputerNtwor-k-, G. K. Poock, April 1.9F;..

I1I Naval Postgraduate School ' Repor't NPS'-dI800

Fl fects Certain Background Noises on the Performancesof,

a Voice Recognition 5Systemv, R., S.. Elster, Spembe r

19I800

Best AvalbeCp

INITIAL DISTRYBUTTON LIST

Na. Copies

1.Defen 'se Technicel Inf'Ormation Center 2Carderon Stat ionAlexandria, VirGinia 22314

2. Library,p Code 0142 2Naval Postgraduate SchoolMonterey, California 93940

3. Library, Code 55 1Navel Postgraduate SchoolMonterey, Callformia 9390

4. Office of Research Administration ICode 01?ANavel Postgraduate SchoolMonterey, California 93940

S. N avel Postgraduate SchoolMonterey, California 9390ATTN: J. Arirna, Code 54AA I

R. ElIstor# Code 5*4EA 1W. Moroney, Code 55MP ID. Neilp Code 55NI 2G. Poock, Codle 5SPX 20G. Rahe, Code 52RA 1

6. Thomas Brendgord IAmerican Sterilizer Company2424 West,23rd StreetErie, Pennsylvania 161S2

7. Donald Le Parks1Crew Systems Technology.Boing Commercial Airplane CompanyP. 0.0 Box 3707MS 07-08Seattle, Washington 98124

8,0 Diple-Inge-Hartmut, Mutochler coviWisseancheft'Le MltaeboitirFraunho?*eq'!nstftUte- fUp"In jo tmat Ion-und1,

Rintemr"' 'trobe, 19D-7SOQ girllsruhe IGerMany

*134

9. J. Mike ByrdGeneral Dynamics

Mail Zone 8227-1P. 0. Box 85106San Diepo, California 92138

10. Robert L. StarkeyNuclear Power Generation DivisionBabcox and WilcoxP. 0. Box 1260Lvnchburg, Virginia 24505

11. Berry Drake IHuman FactorsITTGreet Eastern HouseEdinburgh WayHarlow EssexEngland

12. Kenneth C. Bite ITexas InstumentsP. 0. Box 2909

MS 2201Austin, Texas 78769

13. Walt GoedeConsultant31051 Hawksmoor DriveRancho Palos Verdes, California 90274

14. H. Rudy RamseyITT1000 Oronoque LaneStratford, Connecticut 06497

15. Ivan BelyeaLear Sieglerp Inc,,4141 Eastern Avenue S. E.

Grand Rapids, Miehigan 40508

16. Co E. (Ned) WilkinsMTSetManmMa~hine InterfaceSystem Dsitgn DepartmentTRWOne 8 pece Pork

Reo•o e rClt-i 92078 FIN :-

---- .- " " -U

--

~zoi- -9k

II

17. Matthew F. CarrolllRwSystems Analysis Department A

MS 75-1900One Space Park -

Redondo Beach, Califoenia 42078

18. R. H. CochraneEng Mgr - Human FactorsAT&T Long Lires IRoom 4C154i~Redminstea, New Jersey 07921

19. Roger L. Kuhn 1Director - ErgonomicsHealth ServicesIndustpial Relations StaffVGenera) Motors Corporation3044 West Grand Boulevard =

IJDetroit, Michigan 84202

20. Jeffrey E. Miller oNorthfop CorporationElectronics Division23CI West 120th Street

Hawthorne, California 9?050

21. Michael L. SchneiderSperry UnivacComputer Scientist

P. 0. Box 500Blue Bell, Pennsylvania 19424

22. Richard N. ArmstrongU. S. Army Human Eng LabSax 476Ft. Rucker# Alabama 3636?

23. Gayle L, Berry 1Industrial and Systemt EngOhio State University

Olt1 Nell AvenueColumbus, Ohio 43210

24. David J, Chron IIndustrial EnOneeringuoivei'sfty of Nebraska - LincolnLincoim Nebecaska 6658i

1_6+

t - P

25. Chris HoleSRL - Human Factors Eng.

2800 Indian Ripple RoadP yton, Ohio 454410

2b. Aaron Marcus 1Como Sci and Apol Math DeptLawrence Berkeley LabUniv of CaliforniaBlde 50B Rm 2238Berkeley, California 94720

27. Larry C. LambHarris Coro

MS 22/2-419P.O.. Box 37Melbourne, r!oride 32901

28. Rodney EldenMomt Consultant

=5 Middle RoadBronxville, Naw York 10708

29. Ing. L. Van Breda 1Defence and Civil Inst.

of Environ. MedicineP. 0. Box 2000 Ws1133 Sheppard Avenue WestDownview, OntarioCanals M3M 39V 30. Carl RosengrantICode 8141NO$C-San Diego, California 9215

31. Pency woo1~~R 84-17

Merck and Company

sou 2000Rahwey, New Jersey 07065=V

-2. fet wiener C o a 3i2333NSAMoffett Field, California 9403S 9ii

13 -WE 1i7v4 4 5 -'10zfl

I

Ii

' 33* Anthony BessaeinCode 3522

~~NUSC-|CNewoot, Rhode Tsland 02840 Of0oNeooo.t,

34. Bruno Beck 1ARADC/IRAA

S Griffiss AFBRmep New York 13441

35. John F. BoehmDIRNSA ATTN: P542F!2 Meade, Maryland 20755

36. R. Breauxr4 Code N-711

NAVTRAEOUTPCEN4 Orlando, Florida 32813

k3

37. CDR Peul Chateler =U' U0US RZE

Re Roo 3D129

Wasiteon , D. C 20301

1 36. ClA- otr =Mail Step 2390?

r NASAMoffett Feid, talifurnia 94103S

34. Diane Davis If--

I Coce $Co5 %'%oort, Rhode raland 02840

40. Edward De Gregerio I

Code 3Sa2Newoort, Rhode Island 02840

41. Tice Os Young.I-U.S. Army Engineer Tooograpic I1- Lob Research. Instftute I

Ft. Selvoirs Virginia 22060

42. Joe Dickenson 1*U. S.Army Ap6l-ed T*ch Lab

-Ft. Etstiia Virginia 21662

* r

__ t i 4 q _

-r3 - .~- ~ - $ 4 X

43. HArold C. Glass

U. S. Postal Lab11711 Perklawn Dr.Rockv4llet Maryland 29852

*4. Henry HeiffCode 45q

UNRArlin3ton, Virginia 22217

45. LCDR Steve HarIs6021

~NAD(- Wa:minster, Pennsylvania 189714

'b6. warren G. Lewis~NOSe

Code 8231San Diego, California 1215?

07. John T. Mastersonr U. S. Postal Lab

Rockville, Maryland P0852

08. Don McKechniet AFAMRL

WPioht Patterson AFOOhio 45433

49. Thomas J. MooreAFAMRL/iBAWrioht Patterson IFSOhio 45433I 't

'2. CAPT Vince MortimerAFAMRLIB8Mi P~Wight Patterson AF8 <.Ohio 4531

51. IJames HoskoAcoustical -Sciences DivBE1

Pensacola? Florida 3250852, CArT Leslie_ Ko, Scofield

U S. Army Signal Ctr.IFort Gordonr Georia 3090S

i-139

53. C. Skriver6021

NADCWarminster? Pennsylvania i8974

54 S. 4is StraatveitNUSCCode 317New London, Connecticut 06320

55. Leahmond TyreFLTMATSUPPOFFICECode Q333Mechanicsburg# Pennsylvania 1705S5

_56. Eric WerkowitrF- AFFDL/FGR

Wright Patterson AFBF Ohio 4S433

57. T. Weiner Code 4043

NADFCNerminster, Pennsylvania I8974

58. LT Jeff WoodardI RADC/JRAA

I Griffiss AFORome, New York 13441

59. COR Chuck Hutchinsi

|- NAVAIPS-YSCOM i

AIR-34O-F

Jefferson Davis HighwayArlinoton, Virginia 20360

60. Major W 11iam Mac~arrie OfficArmy Communicative Tech* Ofiiee

Box 4337Ft. Eustisr Viroinia ?3604I 61. Charles WayneRS4NS AFt. Meade, Maryland 2075S

A2. Lockwood AnndAvionics R&I-DAVAA-EPort Monmouth, Mew Jersey 07703

140 I-1 0 B

03. j. N. McConnellARI

(PERI-OU)5001 Eisenhower AvenueAlexandria, Virginia 22313

64. Richard McKinleyAFAMRL B6A

Wrioht Patterson AFBOhio 45433

65. George Doddington 1Texas instrumentsBox 225936MX 37!Dallas, Texas 75243

66. N. Rex DixonIBM Research CtrBox 218Yorktown Heights, New York 10598

67. Victor Zue I

MITCambridge, Massachusetts 02139

68. Jared Woif

50 Moulton StreetCaembridge, Massachusetts 02139

69. Norm Warner -

Code 6021Warminster# Pennsylvania 18974

70. Robert LyncharE-Tech316S McCrory PlaceOrlando, Florida 32803

71. CUR James Goodson ;NAMRLhASPensacola, Florida 32508

72. H, E. Brown -Aremment Div/XRC

Egiin AF, Florida 32S42

_1___

73. Carl WilliamsAcoustical SciencesNAMRL

Pensacola, Florida 32508

74* Andrew Cruce

Systems Eng Test Directorate57030

Patuxent River, Maryland 70470l

75. Thomas Cullen I

1201 F. St., NwWashington, 0. C. 20220

76. Klaus Brosius =

E. St..NWashington, D. C. 20224

77. Arnold Craft iUSPS R&O Labs1I11 Parklawn CriveROcievilp Maryland 20742

76. Irv AlderAan I

ARIS001 fisenhower AveiueAlexandria# Virginia 22333

79. John Phillios I

Code 7232

San Dieao, Colifornia 92152

W0 ayne LeeB89 Sanford CourtSante Barbara. Caliornia 93111

8 ran Deeklmn

Code 330MAVFLEX_2S11 Jefferson Davis HighwayAruinatent Virginia 20380

= r=142a

A2. Bruno WitteCode 8302NoseSan Diego, California 9215?

8-I3~ wiis. DeikeCode 8302Nose

Sen !:~; cifornia925

84. LCDR J. DietzlerARPAsYPTO1400 Wilson Blvd-Arlinaton, Virginia 22209

85. Richard Pew -

88N

50 Moultonl St.Cambridge, Massachusetts 20138

1- 86. Merlin Thomas1

1. E. Dept.i13 Electrical Eno. Bldgj IUniversity of Mi ssou r i-ColIusbieaColumbia, Missoiri1 64211

87. Me. Tolcott1QNR

Code 455= 00 North Quincy_ Street

Arlinoton, Virginia 22217

AS. B.elc3 QNR

Code 455S

800 North Quincy Streetz

Ari1tn Virginia 22217 >

S oulton-StreetA-CamriderMassachusetts 02138

p information Sciences Inst.4676 Admiralty Way- ---

Man Del Rev, California 908911 :113

01. R. KolbNOSCCode Cd6San Dieco Cal ifornia 9215?

LIeCPACFLT, Code 64Box 6

Pearl Hebort Hawaii 96860

93* Danici SaoalowiCZSRIAT Center

33 Pavenswood AvenueMenlo Park, California 94025

ca. Russ Hammond

1911 North Fort Hver Drive

Suite 1200Arlinoton, Virginia 22209

G5. Stu ParsonsIIQ7O Via Escuela DriveSaratoga, California 95070

'5. Don ChaffinIndustrial Eng. Dept.UniverSitv of Michic"nAnn Arbor, Michigan 38104

07. wait Hancockindustrial Eno. Dept.University of FichiganAnn Arbo-# Michigan 08104

98. Dennis McCall i

NOSC i-Code 8242San Diego, California 9215

99. Marvin DenicoffONR

Code 437SOON. Quiney StreetArlington, Virginia 22217

4I'

144

--:) ; i. ' ° ° -oO

100. John SchilINOSCCode 8i23San Diego, California 92152

101. H. MoroanWharton SchoolUniversity of PennsylvaniaRoom W-83

Dietrich HallPhiladelchia, Pennsylvania 19*04

102. Oan c'wtzerNAVELEI)

PME to2511 Jefferson Davis Highway

Washinoton, 0. C. 20360

103. R. Kahn

ARPA-IPTO1400 Wilson Blvd.Arlingtri, Virqinia 22209

104. Tom Martin?TTT'

1829 Underwood Blvd.Delpan, New Jersey 08075

105. Craig FieldsARPA-CTO1400 Wilson Blvd.Arlington, Virainia 22209

106. A. L. Slafkosky

Scientific AdvisorCommandant of the MarinesCode R- R1Washinqton, 0. C. 20380

107. Jesse OrlanskyInst. for Oefense Anelysis400 'ay-Navy DriveArlington, Virginia 22202

105. Glen AllgalerCode 8242NOStSan Diego California 92152

145

, )(

h39. Dan Poami iIerAV#MPL/HEPWright PattersonAFB

7Z I

2511 Jefferson Davis HighwayArlinoton, Viroinia 20360

111. J. machado'code 310NA VAtE2511 Jefferson Da3vis HighwayArlington, Vircinia t!0360

112. CAPT J. W. Armstrong6485 Sugar Creek AayOrleans, OntarioCan-ada Kit IYI

113. LICL J. A. Wallinoton,SWIM OAS ENG. 4Department oA National Defence101 Colonel by DriveOttawag OntarioCanada KIA OK2

114. R. Vonusa

GrIffiss AR;Rome. New York 13441

US5. AI- --CU ark H. Smith

9500 Braddock RD.Fairfax, Viroinie 2203

13.Chria Harlot

515 Tecbnpology OtwasreCambDrifter Masachusetts 13

II?. Pat-l Thordarsion

DEC146 "amr StreetHL3-2E41Maynard, MassachusettsOi3

II i46

112. joh-n Gould

TIhornas J. Wet-son Research Ce-ttarRox?1Yorktown Maiohts, NRet Vort 09

119. Leon Ler-man -4

nldq. A10

Lockheed M 'SWe afd Spate

Sunnyvalar Cal f -r i1a 94 oeb6

120. "-aro t a- PriceR1intachnologv. Ilac.3 02?" Rosemi-rv LaneFalls Church, Vir-'inia 22042

121. maj'oe Warrent Watkins1 SRADO?2Vandenbeo AreCalifornia 93437

12?. OIi n Caomobe--1WICAT1160 Scut h State Street

Suite %01Drem#"tb855

123. Georroe Harr-isTRI! Field OfficeCCPACFL Staff

*/ ('W-34Pearl "&-arr Marali Qb'06

1243. Letw Hann

Wrig't Patterson Afl

SOn Io, 415433le

It2- RobletL.ShLewineso m -assacnse-ts -0?73

VPTI-it- akGoe rv

Sfl ~ir aetu

Pn runo, Cal*Ifornia 44066

IZ.LCDRCLf--Ies Wolf:e 21So 3 Camsnenil1e way

ra ig#Cifri 21