Arthur Melvin Farley Ca rnegi e - Me I Ion University ...
Transcript of Arthur Melvin Farley Ca rnegi e - Me I Ion University ...
AD/A-004 090
VIPS: A VISUAL IMAGERY AND PERCEPTION SYSTEM; THE RESULT OF A PROTOCOL ANALYSIS. VOLUME I
Arthur Melvin Farley
Ca rnegi e - Me I Ion University
Prepared for:
Air Force Office of Scientific Research Advanced Research Projects Agency
May 1974
DISTRIBUTED BY:
mh y#MAMl Tar hair ■! lafarB^iaa CMvlikA
U. S. KPARTMENT OF COMMERCE
r"" " .. i I
I
I I
Best Available
Copy
•
TT\TTAQ«;TT-Trn StCUNlTV CLASSiriCATlON OF THIS PAOC <H^•>n t)»- Frtmr-dl
REPORT DOCUMENTATION PAGE 1 NCPORT NUMBEH 2 COVT ACCtSJION MO
«. TITLE <i>a iubtul»)
VIPS: A VISUAL IMAGERY AND PERCEPTION SYSTEM; THE RESULT OF A PROTOCOL ANALYSIS , VOL I
r AuiHonr«;
Arthur Melvln Farley
• PCN^ORMING ORGANIZATION NAME AND ADDRESS
Carnegie-Me lion T'r.iverslty Computer Science Dept. Pittsburgh, PA 15213
11. CONTROLLING OFFICE NAME AND ADDRESS
Advanced Research Projects Agency 1400 Wilson Boulevard Arlington. Virginia 22209
• 4. MONITORING AGENCY NAME * AOORESSfU dillmnitt horn Lcnltolllng Olliei)
Air Force Office of Scientific Research (NM) 1400 Wilson Boulevard Arlington. Virginia 22209
RKAD INSTRUCTIONS BF.KOKE COMPLETIN-. FORM
) RECIPIENT'S CATAwfiC NUMQCR
i TVRC Br REPORT • PERIOD COVERED
Interim
• ■ PERroRMINC ORC. REPORT NUMBER
•• CONTRACT OR GRANT NUMBCRffJ
F44620-73-C-0074
10. PROGRAM ELEMENT. PROJECT, TAS< AREA A WORK UNIT NUMBERS
61101D AO-2466
It. REPORT DATE
May 1974 II. NUMRER OF PACES
158 IS. SECURITY CLASS. (»1 IM» fpotl)
UNCLASSIFIED
11«. OeCLASSiriCATION/OOMNGRADINO SCHEDULE
I«. OISTRISUTION STATEMENT (ol IM» HtpoH)
APPROVED FOR PUBLIC RELEASE; DISTRIBUTION UNLIMITED.
IT. OlSTRHUTlON STATEMENT (»I Ih» •»•(racl infr»4 In Bleck JO, II 4UI»t*nt htm Rtport)
IS. SUPPLEMENTARV NOTES
It. KEY WORDS fCMiiMu* an r*v«r<« tlät II n«ca«*wy m%ä Idmnllly t* Mack niffli»«0
R^prortur^H ttv
NATIONAL TfCHNICAL INFORMATION SCRVICE II S Department of Cornrr'prfp
Spnngfujl.l VA IIVA RKB SUUET10 OUNGE 20. ABSTRACT <rMt«fHM M »»«•• (i4* ii i»c««fwy an« «Mniifr »r »'«ck mMik«o VIPS is a program Clmplamented in LISP 1.5) wihic embodies a psychological theory of visual imagery and form per ccptlon. An experimental task was designed which required subjects to perform perceptual activity over an extended time frame. The subject was required to mov( a small viewing hole about a presented line drawing until being able to produce a verbal recall description and drawn reporduction of the whole picture. The sub" Ject was also instructed to "think aloud" during the hole movement prodecure. Transcriptions of selected video-tape protocols served as the immediate basis for VIPS design. Relevant research results of cognitive psychology provided addition
DO.KTnUn CDiTioNoriMov..i.o.soL.T« y UNCLASSIFIED (continued)
SECURITY CLASSIFICATION OF THIS PAGE <*■*>•* Dmlm EnltrtdJ
* . 20. abstract (continued)
al design criteria. Behavioral correspondences between protocols and equivalent traces of VIPS activity indicate theory sufficiency. The theory proposes that visual form perception is a constructive activity involving the coordinated use of several memories and processes, which are defined. The resultant visual image (the perception) is realized by the integration of a succession of views of (fix- ations upon) the external environment stimulation. A proposal for the form and content of symbolic visual imagery is developed as a necessary part of VIPS. A comparison of recent research indications leads to the proposal that flexibility of information representation is a fundamental aspect of human cognition.
i ! 1
I
a
VIPS: A Visual Imagery and Perception System;
the result of a protocol analysis
Volume I
Arthur Mclvin Farley
Department of Computer Sciertce Carncgie-Me! Ion University
Pittsburgh, Pennsylvania 152]3 May, 1974
Submitted to Carneglc-Mellon University in partial fulfillment of the requirements for the degree of Doctor of Philosophy.
This work was supported by the Advanced Rerearch Projects Agency of the office of the Secretary of Defense (F44620-73-O0074) and is monitored by the Air Force Office of Scientific Research. This doc- ument has been approved for public release and sale; Its distribution is unlimited.
1 i
PNETACI
TMIS WORK WAS PROMPTED B< A NUMBER Of £X?E^;£\C-S WHICH iNOKATEO TO
ME THAT VISUAL PERCEPTUAL EXPEIQCNCI IS NOT itVtSI MERtLV A REFLECTION Of
THE iTATF OF AN EXTERNAl 5TIMJLATi\c; ENVIRONMENT THIS UO TQ A OESIR" TO
UNOi »STAND HOW THE WCEPTUAl PROCESSfS OF VISION CRE4TC PSRCEPTtONS
FROM THE STRfCTuREO ITMJLATXM VACHMG THE RETINA THE INVESTIGATION IS
AS VET INCOMPLETE, VIPS BEING AN INITIAL M03EL RiOUlRING FORTHER EXTENSION
AND SPECIFICATION
I GRATEFULLV ACKNOWLEDGE TME HELP OC M MERCEDES "BIMMT KQST^AS IN
THE PREPARATION 0' THIS MAVJSCRPT AND THE "ELP OF OR. THOMf.S VORAN IN THi
IMPLEMENTATION OF THE IMAK.TV A'fl POK&Wi ?V3T:M
/<
bradiaK.
*i
ABST~,\CT
v:::>s rs a program (om;:~'em!!n:ed '" US? 1.5) wa .~h embodoes a psycho!03r: Jl
t ~?o· ; of vosuJt tmaa~ry and form per :~;,!.on. ,\n ox;:lartmental t •• ;. was da:.• J .,ed
un! ol b~tn~ able t ) produce a verbal rc:J,l ce~:r.;:~t .Jn and dra·Nn reproduct.on ~I !he
whole prcture. The subject was also tnstru;l~d to ":,,ml<. aloud• durtn& :he h::~:a
movement pr;,cadure. Transcr .pltons of selected .. d~J·Ia;:~e protocols serv.:!d JS the
•--n--ne~ral!! basts l or VIPS desrgn. Rele 1ant rese~rch r:!~ult!O of cognrltva p:;y::,o!oay
provrded addtl tO,al des1gn crrteraa. Beha·JrOral o~rc~;:~or:::lences belweel'l ;:~r ;,':;,: :>'>
and equt1alent lrJces of Vl?S ac!11rl y rn::lr:a:e l h:!ory sufftctency. The theory
vo:;~Fol una•:p (:ne per~!!plton) •s realized by the tnlegralton of a suc~es~•on of 'I'!!'NS of
(frxa:·o .• s u;:~on) lh:! c:.~!.Jrnal c.,·~~~on:r~'ll s!tm!Jiatr:>n. !\ proposal for the fOr "n nd
tnfor .. ,at.oo rci)rcseniO!hOn rs 3 i.JndJ:r.e.,t JI J~;:~ect .>! hum.l., cognrtron .
• ' :r'
VOlUMt I
TABLE OF CONTENTS
3
Ci'APHR 1 1 Introduction
Imagrr, I hisTowr or iMAOte» 1 MEANING «T "IMA«" b VISUAL IMAGE SPtCinCATION 8 VISUAL IMAGE ClASSIf ICATH» . . 10
Vi5u»i fo"n Pe'Crption 11 CLASSICAL THEORV li CtSTALT THEO.* 13 TOPMAL A.^OMECMArjICJL PATTERN PECOCNITION AN ALTERNATIVE • OONSTMUCTIM THEORV 15
jot'i o* t^e Thesis la Th^i.s Cort»»! Gu'd» . . 21
CHAI
1 '
.4
CHAPTER 12 E»pe'-ents jnd An^/sn »
TLIBJECTS ?1 EXPfRIANT I ?6 UPPK-ÄW II ?8 STIMULI CHAHAC^ERISTICS
2 Anaiytif Jl DATA TRANSCRIPTION 31 IRANSCRIPTiONUSt 34
2. 1
?9
CHAPTCR 13 The Kjge »»»•i^ntjt.o"
1 ^igf Wep'p'.p'-t»l>C" Cfite'u 38 2 'he Vi-.u«! I^'ip.» Ppp-esf'ji on 41
SVMH'lJC »M'RtSfNTATION 41 IMAGE CWJNKS 42 IMAGE CMUW CHARACTERISTICS . 44 VfRTE» CHUNK 47
CHA'
1 •■
2 •
-'
IMAGE 900» "XESS - TRAVERSAL" OBJECT CHUNK LINE CHUNK ■LINE .52 SIDE CHUNK . FACE CHUNK
49 51
53 54
1NTERCHUNK RELATIONS ... 5? EQUIVALENCY AND REDUNDANCY . .. M IMAGE REPRESENTATION FLEXIBILITY .
Tha Imige m VIPS ... 60 59
CHAPTER 14 Th» fo'm and Activity o' VIPS 63
Syst»m Overvew 63 THi MEMORIES 64
I. PICiPICtur») . . 65 << VRIVisuH Reguler) 67
VI ... 68 EKP and ATT 69 DIR »nd RAN . 70
3 STM (Short T»rm Memory) .71 Components 0* Long Term Memory ... 73 4 LTM'Long Term Memory) ... 73 6 RL'M (Re-ognit'On Long Term Memor,' 74 6 1TM'Intermeddle Term Memor/) . 76
THE PRiJCESSES a I VI SYS (V'Sual Input Process) ... 7» Process S'm.'anlies 80 Process Control Structure 8? ? AA SYS (Av.imiljtiOn Accomodal.On ^'OCl-SSI 3 PEC SYS (RlCop.mtion Process) 84 4 INC SYS ilNCorpor.it.on Process) 8h
Die S.'tem .n Action 86 A PROIOCOL - PROGRAM TPACE SECJtNCE 86 'MfORETICAL IMPLICATIONS 9? OOAl PELATEO tPlSODES 93
.-si
CMAPTER 1% vits Eitownwi
n 1 Memory t «tensicin TCLTM (temporal Contc»tuai long term Memory) SLTM (Semantic LOng Term Mrmory) 98
2. Three - Dimensional Pictu'e Perception . 99 RELEVANT PROPOSALS 100 A THEORY 101 PROTOCOL INDICATIONS . 103
*b
/*
'I
SPAn.H Cor.SISUNCV . 104 FUHTHER WOTÜOX mOKATlONS 109 jenerdltjt'ü Vt^u^' Inidge ^nd Perception System 109 IMAGE Gt\fRALi;ATION . , 109
EUMMT OENOUitttTiaN 110 PEBCEPriON SYSTEM GENEBALI.'ATION U-".
THE PfCF-Tl'.!'. GOAl .. IN PERIPNERAL ViSiOH 116 PERIPHERAL iNF0»MAT10N RtPHEScNTATiON .118 THE SINGLE (INITiAL» riXATIOM . 119 EVEMOVEMEW SEQUENCES 123
CHAPTER lb Conclu^njn 129
Study con p^'^on . 12'» IUYIOR-S BLOCKS . 129 .: WtWS STIMULUS rNCOCINO . . 131
M.1RAN-0 PATH IMAGE n3 RE PRE SE IM f A T ION COWPARISDN 134
Fiesib.' ly o* Rep'Cientjtion .. 135 LANGUAGES OF ART 136 A THEORY Of rOGNIIiOM 138 PSYCHOLOGICAL INDICATIONS ■ M4 RELATED PROPOSALS , l<»5 THE ROLE OF REPRESENTATION , 147 ruture Rts»»rch, Conduvon 14*
REFERENCES I»)
ALL APPENDICES ARE FOUND :, VOLUME II
K//
.-
/ ^.
V;r3 A V ua> i^üge'y ina Percept on Sysle"";
Cna:'er LI - Introauct'Oi
The t tie 0' !hi« thesis coive^s the dual nature ot its content Both th« imjjery
sys'otr' usei to 'eD'^.ent vsuat mtor-matic" and tr-e oercept'jji p^ocesi>es used to
u-je-Mand lha external v%utl enure--- -t are invest gated Tnesi l«0 concerns are
not "dcie-'rtäni but rainj-, t-e, a'» tunaa^entai, nttrreiated
'his tn-foojeto'» chapter * rj» presents a o.-^ef h.story o' me ideas aoout visual
imagery ^nd pe'eept on T-en tnere t* 'ows a statement ot tue goais ot the tnesis
Finally, an euilmf ot content is presented to guide the reader through or to th»
cnap'e's tnat touow.
1 I">aEe'y
M15T0PV Of IMAGEPY
>jger, has had tl ups and dOwns m psychO'Ogy Prior to the t*entietn century,
PSyCnoogy WM eSSentia y a Pa't ton 0' ph lOSOpny concerned wlh the *0r«.ngs Of
In« -nnd. The pr.mary Bass lor any theory at mat t ■•■» was nlrospecton Imagery
and 'e a'-M mental st : concepts -egned '.^pre ne as theoretical constructs
Cia-np.on-. ot '.^cn introspective theories, .n: uding Wni-am lames and f Ö
r.tcrcner, cons-.lentiy noted the important roe piaypo by imagery 'h thought ^nd
peri eption James de-.cr.bed the meaning ot conc-t-te «vords to be "--ensory imapi---
/
■
!
.
; thts view to include abstract term mean'ngs as we'
Uut at the very t'me '.rese two men *ere ae.eooiig such ideas 'mȣ**r> ,--id
related n-entaiist'C CttiKtpli *ere ueärnrng their rap.a ae^cent from pro-nmence Triey
weT ioo^ !o oe aiwo^t co-"p'ete'v apanaoned as vi^t tneoret.ca^ coostfucts m
Amtrictn p^vcnoiogy Thi» 'ap>a («U was primarily the PMU*< O* the en"erg.n^
behavippiit.c OutiOO* One MME go*' Ot tn s out'OO* w*s to minimise In* m*e. entiai
constructs •mtlifig Between a g.-en <npul ituMul and tre re^u'ting rffbpo^M. Be.n^
such an intereMia^ construct, rr,agtfy came under attach
Imagery n^d oeen aire,id, shaken by several e"ppr.mental results, whim furtner
acted d'j. a calaty«! tor tne tm^rgftAC« Ot bena/iorism L^perirrent«, in |ht rote learn *£
of nonsense s>liac»»es, first carried Out o, Ebbinghau'.e (18(45), seemed to indicate tne
*■ «pendability ot mage CttntrucH ferna'd's C"1'* rt«ultt indicated that memory
imagts were not actually »aithful reproduc'on<. ot rtatity, even for people clamtinf
"photog'aphtc" memor, capability. The tiiuW0\j'& eioer.rnents supplied further
evidence for (h.niung m the absence of conscious maftry
Such damaging experimental I nd.njs prodded an impetus for the rise of
behaviorism Behaviorism immedate1/ set to wO'H to oeve'op a more pars.momous
theory of thought and ^omor^ M.oivin| only verbal concepts One of its 'eading
representatives John Watson wrj'e:
"1 shou."* th ow out imagery altogether and attempt to show that practicai.y ell natural thought goes on m terms ot sensor motor processes m the larym [word encodings]"' (Watson, 1913, p. 174)
Another primary goal of behaviontm was the objectificaliOn of psychological
observation. Thus, the method of introspection fell to near disuse and general
ispicion. At Watson further wrote:
*.
metiofl'-, "C ■ Ve '.c t-' ■ .» ue o' l-^ aa'* aepc'ae^t upon rne reaa *ev A fh which t"c, lend t^err.se .e'j To ■"'c-p'etit 0" m te-mj ot COhse Ousnes» " wo d . p <58'
Beh*. O'-sts such »s A.t*fo^ oe e.ed Tnat t'-e n«rvOut w»l#* d-d "Ot ra.e even
"tea »ctivjton ihoepe"ae'ce, tnal (ii sMrnjiiliOi («t.vitom derived nt<*st*ri<)
*'orh ^e'-ve 0'g»n p'Ote'ses, Thus, ^igtry i^d ntro<.pect on »e'e contf»öctos Ta
D« t p'«"" ses
Lwperi'v.er;»! psvchc;-,"'' n the first hall t-t t^s centu^/ tended to *of«
e«ck)$ivei> with (Mily con''oi »Be .e'O«1 »lioc »ti"4 as e'per.n-entji mjte'il. Thu
oM» i mvo ed the use o* ••O'lenie s> aoes. cei''j a sluat on »•■f s not
conducive to t>-e use o- 'eoo't o' »ager» iP« . o. i9''i' T>vj resee'ch ^.^^ewO'n
p »/ed « s gn.t.rjnt roe n »eepng -age*, dO'-i-ant n psycnO'Ogy in ton;-»»!, the
sever»! .ntrospect .e rctulti ot t-e pe- oa st. I u' iea -»ge con»''jct«.
A'ouno i960, ii-ege'y oega" to '»■e'^e'ge. due to an af.un-uet on of poll positive
*n3 ■•■...<• ,!■ tecto-s E«pe'ment» results mdicatn^ tne en stence »nd use ot mege'v
provided the pos.tive tecto^s Th* growth o* psycnopne»m»cOiORy ana senso'
deprivation reteccn p-o-'dea numerous reports o' na'utinjtory .mages fieu'oogcal
n/e;tig»tions, pin cu'ariy those n.oi^ ng o 'ect stin-jijtion Jt 11« br»in (Penlie d ana
jaspe's, i9bili, atso p'Oviaefl reports ot ■"ifi't
Concurrent^, the goais o) c-..c"3 0g :a research e>oer e-ea radical change
'"e joai 'or research ro* heta-ne the rea'itaton o* dela-ed ana iiperative moae's 0'
Ih« i>«nav nj organsm Mode Ou idmg h«d not oeen a goa 0* »it ier introspect ve or
behavionstic psychology, Out dd oarro* criteria ana tehoique froii both Mode
inputs and Outputs cou a he tnccHed ooject vely agamsl aat» (behavionstic), but the
j
4
psychologosl agaon bcc.1'ne a sourte or cnet'-S ·or .,e mo-.e as des•e" •' r
,ontrospecl tve l. Thos prov•oco a r.1mewor1. for lhtl oncoroo· a: on or '"""~: ·'" tnl o an
obse, tovely , ,easured, ..-oocl ·b.!>~d :h•orv
i n;;> eme· d<Jnce of comoult"C rr>acnonert a.,d tre earl suc essful devo?lopmcnt <. vf
.1r t •f c .1! mt.-lltscnce se"ed :o ·:w ... a·o he , e.• vf n .. ..,a., ' "-''~&~! and ro.:o· c.,p: on ,, ..
oe· .,~ achv•ttes of nlotrl"ai J<~ pro.:ess•ne. nos menlaltst•c out oo~ prov•deo fur tner
!:rounos tor rere .... ·cd •·west ~a:·o'l .,. •mase·
l\e& t~ltve factors were '' ' 'O t"'\ O•veo " •mt~ :;e · ~ 's re·omcrt;cnc!:' The :>r •- ,t· v 0"11?
was a &<0'"''"6 dos~a: osfachon .., ,;h t ~'>e progress of be"J• o•osrn ~s ;, Bu!;.:•S .. , \ 1970 )
note!i: "tne nc. ~ense sy llaote nao ad ti s day" , and "tne promtS!.'!i of be'lavtorosl s
reM;uned unfutftlled" l n•s c ssaloslattoon led to a c esc· s~ rutony of :-e ar5uments
agaonst •magcry anc the realtzo~:ton that tn some wo~ys tney were vacuous.
ne onaccuracy of v•sual memor 1 had bee., '1eto u;, as a o•~proo' of vtsual
tmac;ery. But all modes of me~'0'Y hao re::;eateo•y bet'n shown to be tnaccur ate, not
JUSI Vt!Oual. Bartlt'll (19~.:!) noteo l h•s, tharacler ~"'3 ll'e~ or 1 as a p ar t•al con!.l r uct tO!:
o f r r.ahty and not as a reproduci •On. Bart lett w as one of tne fe..w psycnolo&•>ts o f :ne
l ome to gtve '"'•'Se• y a role '" numan beh.w .or.
The realozat.on also came that verbaity oroented thought orocesses were "~ much
•nferred or trrphctt as thos'! usms .magery. Verbal respo"'ses could be ;ust a!. weli
med•aled by onferred mentt1l tmaees as by mterred mentt~t words. In fact , results wh•ch
tnd•cate the elust~·ce of v tsual recognol ton memory '" •nfa,ts provtde an ext~mple ot ll
vesual memory (•magery) w•lh the possobthly of a verbt~l encodmg ehmtnated (Fagan,
1972). A thtrd ft~ctor was that verbal-based theor•es were ,ot ,ecessaroly more
parstiiiOneous. In vosual recogn•tion tasks and vosual matchtng ta'iks one mdeed
J
aptfd'ea 'o oe D^OPO^ ig unrtece^'y p'ocessing n th? act o* translating a;1 nput to
nan-i's or \erDa aescriptions '0' co-^par son
fc*perim!*nts noting reaction time aiftt';-c?s between name and ^isuai same-
o ife'e-* cc-npa' sons of vttuitly presented stim^- rave produced reijits ta.oraoe ;o
fria^^'y {7v»r»hy, 1'569, Po-.ner anj Kee^e, 1968. Posner and Mtfcheif. 'i9t>'* Other
9<pe' n-.gnts invo v ng concept as^oc at ons na.e appearea to indica'e tne ulilndion ot
non-*o-o, "nag-ai med adors (PaiviO, 1971). Pa • o (!971) has presen;ed a most
va'ü^D'e survey ana dscuss'On ot eipertmtntal resu ts re'evant to imagery Other
recent DOOHS IR chardson, 19"0i Segal, 1970; Chase, i973) present further rttutti and
though* relevant to imagery ana the processing ot visual information imagery has
reU-nea as a concept to oe investigated n cognitiv« psychology.
MEAN:-i3 J' ■■IVAGE"
Wnat is tne mean ng 0( |re concept "image" 'or ".magery") ' Tne tarn of (MfmitiOn
nas not proven eisy lor ps/cnoogy Accord ng to a consensus of oct on«ry
definitions an irr.ige is a menta repr^-cntaton or mitation ot anything This dt?finition
is not adequate tor pryent ps,cicjogcal purposes As further interest m imagery has
developed, proolems concerning .ts p/cciM aelin.tion nave arisen
Two definl.ons repre'entatue of differ ng approaches to the specification ot
magery fo'iow Th« modaily approach to the oetinition is illustrated »$ follows,
def.r ng the imiage or imagery as:
"non-^eroal memory representations of concrete objects »nd e ents, or non-verbal modes 0* tnought feg.imiwmation) in wn.ch such representatonc are actively generated and manipulated by the individual" (PaiviO, 1971, p 12)
The second approach, one 'trussing modality independence, is as follows:
' I
**Tht funct'on o* memory imagery is to put y« m ortet contact with HOW tnmgs ooeo, 0' tounoed, 0' feit, or tatted, «S diitmct from W^AT they reser^ü^d, *n*t (h#y sounded like, looked kirn, v f or tested MM "
(Bower, 1972. p^U
Neither definrt<on is satisfactory Pa ■. o's db^nit^on leaves ope" t^e rr<tica<
question o* how Id distinguish between "verbal" and "non-veroar representations m
the head This definition of imagery i ettiy confronts proolems ot epi'-.tcioiogica'
status, ambiguity, and possible contrad*ct<on 3art<ett notes tnestf problems to resul
from the »act that
"mcbt §.t§&9mmM% that na e üeen made about MjfM ,n traa-t onal ps/cholog/ concern fheir nature ratner than t^e.r funct'On. w^at the/ are rather tna« wnat tne^ n^a^e -t po'.s'Oie to do" (Barfiett, 1932. p2I5).
Bower's def n tion attfl re^es neaviiy upon pneno^eno.og'Cai intuition for its
meaning Bower's definition a^ain »once» ' priMtfi , tne mature of I*» imefa ano
tdte . the came p'Obiern». a'. Pai^o's Furthermore, t fai.s Oy irr.piypng !''at jhe image '.
an rnternauy oi)r.ervabie entity ofter.ng a mean', o* "atrect fontatt" with MfHOry
reiatrd tfilc^meliOn A visual 'mage it not *hat the .ittie rnan sees mvde but whet is
in-.ide tne little man that MtS.
Even atceptrng the'.e t*o det ndona' ^petftations as be^g adequaW? does not
yielc a favorao'e '.'tijat'On The d'*fering d*»?.rees of irrportance placed upon
rppre'.entat on modality leadl to differmg ar-d d ve'gert ewpprmental ronceTv. Thus,
Current imagery re-.earth >•. being conducts wttiout the benefit of an adequate and
atcepted dpdnrlion a*, ba' ■ Ceih iflvestifahOfl »*»u%1 attempt Jo clarify the concept,
both as a preconsideratipn and a', a result for discussion
The dettnitton offr^ed norc specdes the structure content, and function of tne
\
/
imagt. An age (>n gener«,; is an mltrnal symbolic wwtil 'ecestnUtion of
nlormjtion wnxh it c«p<t)ic of ae:?'>">n>ng (gu 3 ng) MhaviO' (tniDing a 'cspont«),
and which nat an internal rrooanl/ cktrtCitndiC. 'Secant c" ner« moani
"me^nmingtui" In tho caso of an ima^t rtsult ng from porcoptga) activity, "stmanttc"
imp-.es tnat t» , input mean-ng ts preserved in the representation, though not
nccvtMeily m its e«a(t torm or order Tr»dt tne in'orn at on of an image s adequate
• or benavio- determination macates a tja',c funcl.ona equivalence oet»een the -mage
■ nd senior, input Ba-tiett wlj.1) notfs 'n.s ao.iity of imjge'y to free human
behavior from strct deoenoence open tne continuous temporai sequence o'
environmenta sensory input
Images a'e but one form ot representation »itn.n Ine .nternai "sensor, order"
Tne "sensory order" (Ka,e«. .9521 Dears a .united (Out often sulficienti
correspondence to t^e "pi-.sea o'Of" o' tne ei!er-a im ronmenl Tnt eements o'
th s internal rppresentat on^ o'3er aeeop ta »e'e;' a •terences pet*een sensor»
nput wh.cn «re recessarv 'c In» rea. iat on of aaeq.ate isuccess'- I oe^a. or "ne
"ra son d'etre" of any ~>*i;e .s 'o Dfo* tie a Da's tor aaea-.<te oena. o*
Tn» mterna. moda ty cna-acte-stic dstnf.,snes mages from o!"er mrr..0ry
repre^rntat ons o» mean.ng fig p'o. Jes a bas.c 'e at onsn.p to an associated
perenptua process »sensor, mooa-!») A- operat ona> or functonai de*.n tun of
nternai n^oda.ity nas peen s*atea o» 5 ^on. as »o o*s
" nto-mat on s sto'c.' n ^ucn a war l"at t tan tie ret'ie ed D> ntema c'Ocrs'es tem&ph* to t-e et'erna. t-. ,■ - fat a'e w<ea 'o 'et' e e "•or*-at on n tne (a"esno"a ng »»ooa U 'rom ettemai sources" i^^on, I97|. pif7)
'nere'ore. Ine n<3.»j|0f. » t-i , -tft o' a (»en neaa ty s structured to re
Reproduced from ~jK^ bgrt »viUbU copy.
U- 1
t'Meitivei» ■•"J elttc-rnTiy "^tra f.nt-'orwardly) retfievAO:e ü* proce'se* .•..imorpn.c to
tlOSrf Ot |h«t pe'ceptj*' »100«'1/ Tne ."lorr- 'on s "B«'CeBti,» iy itruClu'efl" The
moa^Mly jtlr.Dule jt ai Tages .rto"*»'. on slruCtjr» caviae» < ""»»r» 'or |ht
evai-j»tiOn o* iny proposed .■'■ ..a' mage rt-presentation
ViSuAL iMAGt SPfCiflCATiON
This genefj ••"*(» del ^.ton must Be lurtner quelided M visuel terms to be
su't'C enl tor tne purpo'.es oi tie thesis As a lirst step. I^ie v.Su«! imagj s detineo as
t"« internal semantic . ■ i' ^ at vis..a. .ntor-^aton tapab^e ol aetermin.ng
vi»u*iiy-rei»ted oehav.or |i remans Id spec ty v ■■MH intormjt.on and viSuaily-reated
nenav 0' " orae' to cowpieie !«• ue'-nit'On
The inlormation «ithm a visuei image is structured so as to be slraigM-forwaraly
«ce^sbie by processes somorpnic to tnose «hen access eitema ntormat o"
"i.'¥niory sttmv'iat.on) during yisua oe'rept on Visual st mulation is acceded by a
series o* soat.aii/ related campings (scann n^i djr.ng visual percepton Visual image
access must be .'.ombrpnit in mean ng to visual stann-ng A visual .mage tht-relore has
an ituphcit. '.(«.it ally Uet.ned pO nt ot view Internal moda'ty produces a cr.ter.on tor
tne -ontent and structural characterstcs ot th« visual mage, and indicates an mil a
interreiat.onsi' p between the ■. «ua mage and the v.sua pfcept.jn process
St. . to be spee'ed are tne ( a".es ot ntormationai .a .es (symbO.si moed.ted n
tne pe-ceptu»! y-baseo structurp Internal modality MKuwc»! HM im»ge prope'ty
aiso Neuro'ogicai eiperimpn»jtion nÄ. ndicated *he «eat^re detect.on capab' t es ot
the trog, cat, and mon»e, . son (e,ei systems (Lett- n, el a . 1962, Mubei ana Aessei.
:96?, H66, 1%8) ^Sycnoogical and psythopnysc» rtsu ts h»ve indicated similar
^»n.
■W ', »"d »ct.v^ty wth.n tne n^^jn v^ o- s^ilem (8*rl etl, 1932 . N. Website.n, 1973)
The'eio'e. o^e c'*c4 o' info'-nilo^ vaiues -"Dedoea * Iht visual imigt is lh*l of the
symro s represe^'atv« ot de'i ' K e .'<su« tealufev
^n« c*1 f ■ c-as% ot ^age ■ . ^ ; D ■. s tsest spe:^ ea tnrougn a ae'.n t on of (MujUy-
'e a!e3 sehaviO' *h» <'5uai 'mage -a/ st'.» as a iO*':» 0> .olormal.on to guide two
bet" .vpe$ o" activity Oe n -"oto' Kt-^ity •■tnm a ocai, scaliei envronment Tn.»
■ ncuaes nel •" » coo-dnatpi cvsKai in, action . but aiso the control ol the head
ana eye movemenU a';50C'atpi « th the «null pe'cepton process Th« other :. Bf ot
act . t, i coghitive oena pr MvOfvMg spat a- and v.sue' feature content :«a"Cif
are 'ne architecture' p ann ng and veroa fete' o-ng ot a spatial fintmll environment or
scene 'he prme Ldgmtivf eiampe s vituil torm perception A MMM! "age is the
Oas". lor perceptual -n':". •vfs. n/po! ■■, and eipectat.ons
" ' üe adeauate tor th« determination ot tnese oehaviO's. a c-ess ot spat a
rtpr-at'On veiuet (sympos) -r jst a so necessa- > oe "noedoed "to tne sv.cture ot
the v su*' "nag*. Va ues so" ; enl tor tr« spec^cation at pas<lioh. je.'ton. and
distance irangei rrane up hut c ass o* spat>e>i> mean nglui symBo s >ee Broods
(196ä.i9'3i hat reported -es^ts '■3" se.erai las« .nierterence eiperiments »hich
na cate OOln 'ne eastence ol -itemji me^or, ~odai I es and tne spat a content ot t'e
• ntema: visuei representation Trese results a so np.cate that maging m a •• o Ja ',
-•erleres »f.th aclvily in«oi^ ng percep'un ,n trat modai l> The nt.rierence
incjcates tne cose real onsn p oetween ^age'r an j perception
In ■■ .: j-, me tuny spec ' ed detin ten ot the yisua image s •"» ntema
semantic representat On ol spate ana »tull 'eat.-« in'ormat on , struct jred to as to
b* strigntlsritiera>y 'et'e.aoe by "'e'-a processes some-pnc to those of vituel
.. •
10
perception. A viiu<l 'mage « 'urthcfn-:'« cjpiot Of Mt>n| n i Das i lor motor and
cognitive behjvior » m iegard la In* visuw •nv>ronm«nt representea
'r.e visud percept.' proce» -■»•> • lanajmentei delnitionti mlluence upon Ine
structure and content ol "e MMri '^age The visual «mage Has a cjrrespondmgly
signilicant e'leel upon Inp perception process, aclng as as an mloriraVonal guide lor
the perceptual act'vitr Tne r«age serves as source o* 'ealure eapectalions and eye
(hea (I movement control '.peci'ical'Ons a^' ng .sua perception, frnjiiy, perceptual
activity is a primary source ol visual images Tne resu'tant perception ol the current
environment is a visual image
VISuAL IMAGE CLASS" ICATiOh
The degree Ol correlation with e<lernal events it the determining factor lor one
scale ol image classification In order of decreasing eiternal correspondence, a visual
image may be classified as a perception, an illusion, a hellucinat<on, or a dream,
memory, or mental image As Sega states:
"When we have been atve to ascertain that a gi en impression shows adeouate correlai an with enternal events to satisfy our current needs, t is conventional to call it a 'perception' " (Segal, 1970)
Another comperaole classification is based upon the degree to which an image
depend* upon eiternal Isensor/) as opposed to internal sources Si mc-.i'ion lor its
content (Horowitz, 19721 At one end of the scale, dreams or mental images rely
soeiy upon internal information sources Richardson has defined mental imagery to be
those con«, ous mental eipenences which "eutt tor us m the absence ol those
stimulus conditions that are known to produce their genuine sensory or perceptual
I
-.
a
courltrptrK* (Riclwdson, 1970). Ho«*y*r, p*rc*pt.o«s. «t Ire Olh«r end of Ihe sol«,
do r>ot rtiy V0'*ly upon t>ltrn<i ntc'T4l>on \javy e.peiliic e',. «no fipcncnce
dnte'n«! tlateO h«v* cC'sittiM.y DMH srown to p*/ iimlxmi 'O'ts >n '■■■•>
• et'ztXon o> perccplu«! »««grs <nd lo e"fc: Htga conltnt iStrkdcy, i/iO, Scg« .
1970iC»'»»» »ndC'jn, 197?)
rn*st >m«g« cla»'<'(«l on si« t» must oe cont nu«, «th tht bOunö»"*i b«l***n
e.c cMM e "R inditt'nct. The c>M»«, *nd O'ttn rep caleo, sljd/ o, Pemy (1910)
hm ''^own |net In« conscous ?.;•" €'"<e of riJi -g and p*rce><<n( «re not no' f»u ,
d<stinct. In tnet study, perception is m.sUKen to be imagery As tor ine «nverse.
stuOcs Oy Goldiamona end P««k>ns ii9tB n«ve snoum tn«t .megcry cm De misteten
to be perception Visual perception ana vsuai m«gery appear to t>e nseparaoy
entangled.
i. Visual Fof m Perception
As v su*l imagery and perception ere to interrelated, consider row severe'
proposed t'ieones ot tnc OD.ec" e vitua* perception o* torn Mote tnet vituel
percept on hat been n«rro«ed to tne area 0< torm perception Tne thotis is not
directly concerned wiln Orignlness, coier, or novement perception, tnough these ma>
be oi.ic participants end/or resultants o' 'orm perception The thesis ■( «s
investigation of how the representation ot tne environment es «petially interrelated
torms is reeined
/
•
.. ;•
12
CLAStlCAl THEOSV
C'*$S'C<i Or «lom.stic theor/ prcs3»s tn»! tn« M(Ml uf"eo' 0" o' 'c- is «n
"untantcOus cone-s 0" -e« »a B^ 'unctDIMMI ■»••'tic»»" «"en Jt t)*s»a uBOn
tie V#4UM of tr^ s"-* itst d scrim<n4t}<e or homoge^eo^v patches of tn« «1 NUAIB
ii-»MfOtJ, 196?' Tf,e .<» o,0r ttnittion »10"-» »■» »jto^JtiCJIly .■■.•■•] w tn
»no ftcj'i tn« non ./'Sua1 s»ns»ttOn^ 0* tof»" Tn» nttrenfes j^e o.^sea upon pr»-
ei'Slent »"onntflj» o» kneslnetc, I«C'J». »»d ntmovtmt*\ eipcncnces wnicn f<s
•■Jton'« »f?oci»t»d •■tn ine s»nijt.o"s iGr»|0'y. 1970»
On» SOu'C* <"t Cf't , •- »0' 'n* theory '» tn« prODOsCQ j^iO"': .- ,-. n«tur« ot tn«
Perc«p|u»l inf»ren(»J ThK S»fn'I y MpkM ln«t f» p-oc«ts % not 4n«>y;<D>« »nd
tn«t »ny nt«rm«d <*« s'»*»« 0* proc«»« "| «no .'••0'"'«t on r«pr«4«nt»t.on *r« no'
(Wt^CteB1« To tn« contrjr,, -»{«"I '»s«»rt»\ n«« infl,c»t«a th» •■i«t««c« 0< t«v«rj
0«rc«Dtu<1 tt*|«t (So«riin|. i96C. ite'-r»-i, ItCi
Another proecm to' the l-eor, i tn« »..aente 'or In« t»**j-e e< -actiOn «D<iity
»nd act vily o' tne vivo" »yi'e-»' noted «bov« Thoi, the bMX vi«u»i »emiton •, not
0* MS for« Of a ret'h». ot'-'t 0* homo'erteOuS COiOr atom's Furtn«rwOr«, !her« ■
«videnc« that dslarK« 'ry :• i*t/ tie ndwMd ■ tn« "sentaton* Bario« . '0 '' hat
dfe-' -ed that th«r» H rel.ral Kliv.ty *r«et y retpontiv« to -.ufticent totalon
a>tp«rity petoee- ngnt -o it to th« too ey«t Ostanc« pe'rep' o- K th«r«lor« not
vo e y • retult el *uncOnt(.Oui >nl«r«nc«' at it proposed by th« clatscal theory
OMMMI '"TO' ,'■■ K(Ounl ol a«pth pe'etpto" n«a o««n on« of >tt "i.or «ipisnatory
tuctett«« (Got«1- 1M8)
• 1
13
GES'ALT TMtOfV
GatUt thBO'» 3».» 00*3 « » ' >:t'3" tO »lOmi! c '.'Wl'i U u»» to noti .' '
Ciettalt pjycN><og. . ew4 v •.,.» pfteplo" to oe tn» ■tfsul ol H » *PP i*t D^ O' ^ifir
o-ja'j»!>0"i! <•» to tn« cj^pel» tnccjitetea . Iuji t e,o S,. Ia«t * pro<"»i.t,,
tHWltrily, contnuty, »no t osu'e «'• c»'"#3 to ce In» 'und»"..»"!«, naves ot 'O""
oe'cepI'O" "nes» »*•, preact « tn » ■ gn ovg'r« o' s»t'«Ucl On. «nun o* mm,
loj'cjity pO'.v 0'» p*'rrc>^< o'g<^{«lant w m Uct ot rt» iea 'O' » g .en
preientna ^.'u»! Iieid ixott««. ;9J'j'
")n# (real p'oO'en 'a rj r^e-.ta't Ineor, ■, tn« ip«c'caton ot l-i- e popo'.ed
organ./at ona aws n tef*-*- »n.tn a^e not weff., ntut'.-e Oeau/atian ot t- i p'Ob.e^
n«^ >ed to attempt-, to quant.*, tnese ^ pects o1 tn« vitual «nvTOnm^nt On« such
appfoacn has oeen to app , -■o^'^aton tneor«t ca* tecrniq^es n tn« mjlytit of
D'»«nt«d visual »nv.rontrent'. ittnej.» u96<}. ;9%9l p'0^3«d l^^• lT»t compete ,
devcopad attempt ot tuen an approacn, cons o«'ing tn« j.i*,* tea m t«rms ot >ts
COntan»d '«dundani ,
Otner s •naan/ tM'ved MMM '0' pre:".«>( d«* n n| tne G«st»it cgan /atona a«'
na/t CJI ttrea th«ms«iv«s • f nwasu'n| In« imoun' ot inlor"<«tion n«c«st«ry to
ae'-c ce or pent, « l<|ur« Tn« pracao t, ol p«rc«plion, |iv«fl a pr«s«nt«d l'«id, it
men een to ne MwarsMy e ..'■ i to tuen an mlormalion measuf« This pr>ncipi« of
pe'ceplio". derived from GtttMl onins M not«d, n«s b««n cwM in« "mmimu«»
principi«" Hochberg has been involved in several attempts 10 •■pi»" tne Ihr««
dimension«! p«rc«plions of stragnt ..ne drawings m light of (lot minimum pr ncpl«
(Hocnborg .no McA isl«r, 1963; Mornoeig and Brookt, 1960» Th« proo em ol
.
\
14
»övQuite y '.peciif ng (ho-.e intuitive organt/al.'* .al laws ras no( yet ooeo «olveJ An/
measure of stimu'us cHaractvrnlici upon whih to bMt Ihi GeMaif -aw performance
r-eces-iariiy mtroOucev t^.i* measure or information.^ encodrng a« an mtern-.ediary
construct, a foreign aaa hon to tne bas'C tieor,- prtpM»!
Another proP-em 'or Gesta't theory ts that the organizational "l«««" ar« not
actually determinant*, of aehi/ipr An observer can -.oiuntan'y reverse '-gure ana
ground or choo'e uetwe«" a''3rnat yf 'gurat percec^'OOi The «MM 'or such
•livities are not part o* tee Gestalt tneo^y 0* pe'cept.on
One hilfll, most r^po-tan» fa 'ure, is that the "wnoe" to which the laws «Ppiy '*
not '.pecified 0' readn, spef-f-abie Tne fa:t ignced 0/ Gesla t perceptual theory .s
that a f^gw'e <objettl is nsnnally weeded through a succession of gtimpse« Partial
*igural regions »re *oveaii> I «ated »t u-Herenr r^mes Partei "egions may have
Sign ficant effects upon the co^p^e f'gurai percept on tS ^on, i96 7, Mochbe'g, 1968.
Gregory, I970i If Gestat a«, are oni/ «ipp<caDie to !ne tola; /•tual * c'd, tne effects
of tfese part.ai regons a^e not oo-aned If mese 'm*'er, tonta^eo rpg ons are the
"who'e" unit», for ia« app caton. Ciesta t theory fa I to offer my means oy wf to
nte^'ate the'- -ito co^p efe ! ene pertepfons
FOMMl AiNO MECHA^iJCAL PATT£ffN RtCOGMTJON
he p'Of»f<»m implpn-enl^t on tra mat^P" at'f a^ fOr'«..ii/at on of two mp'noO-. of
p.ittfrn refOgnittOn nctaa'e sow* inherent *par>..i:.p', tnri limitet'Ont of these as
pos'.'bie eip jn^t on1, o* ^isuai fprf" pe'eept-on
'emp.ate watching wa' one of the eari e'.t retrod', o' pattern refO^n.t.un to he
mpirnmied (Kaonow, i9h'> A stimulu*. it matcned aga^n',! a set Of recogn/^tM-
/
19
patterns, w'tH the "b»sl match" oe»^ th« one rtcog^ved. The method «at touna to
have limited applicability dje to tne adverse «ftects upon performance by small
variances 0» form and incre^.ng recognition set ' ze. Nmigt U967) d'SCuSses
template matchin.; « a possiü ■? e«pianat.on of Iff« perception Me notes significant
problems m accounting for otirer.ed recogn.t'On "variances over retmat po^ I on, »i/e,
anc: orientation (in %om CftSM)
Severa> ea'ly pattern recognition pjr-ams «e'e oased ut3n 'eature e^tracton
ThMt systems ircorpo'^ted .«tj, .'es to ceate md MjMl fe*tu'e operators l^nr ana
Vossier, 19^1). to adjust 'ealure *e'gnt.ngs a Q Mooerts, .960), 4nd to *0'm .aiuab>e
feature co^b-natons (Se^rage, 1959' "^ese ab' tes have b^en recently 'edisc^s^ed
by Uhr (i9T3j A m<,thematnal forp^*!.nation o* this method has indicated se^.era'
inhfrtnl limitations IP» cept'ons ; M ns», and ^apert, i9b9i A system us-* i
d <imelp''-counded feature eitractort i* nt^pauie o* cietem rung pattt-n
conrpctedne^'- Pp^.og,, ' on n conte«! is iie^cmcj -.rip siüf.* 0* a system öa'>ea soieiy
upO' feature extract 0"
AN ALURWIVE - TMI CONSTRuCTlVl TMEO»V
Tre Cassc^ a"3 Tie'ta t feor es o* ♦0"" perceot'O^ and Vie teT ate and
feature eitra^tion metnod*. o* p^tt*"- recegnton art « rPe" to h* e wr Ca«
sno'VO'T r.^ as tneorpt :a eipa^atons An «itr'natve thfOry ha4, bet'" oe e op-ng,
ba'.ed ^PG" t^e po-. t \c a^a re^at .e resets ge-p'.i'ej o^ the ir*eo'es and "^t^'Od*-
discussed Th»^ tieo*« s ra ed the const'^ct e t^eo'» 0* visua- form pe'ccption It*,
ba i p't" e s mat !be att . t» o* *Ofn per;ept on s tnf consl'uctiOn of an intern«!
rpprosentrtt on *h(n e^POd'»« tne -.tf^ctu'e uontentl o' tr>e e»t»»na vi»u*
16
unvironment itne pefcept^O"1 Thit cont^uct've .ut * ■' olves the integral »-: o* •»
sequence Ot intOf^-at'On^l nputs def' ed ♦ro*' * -«-•' s ..' eye ' ultons upon the
external en. ironmert i^ep'O^entat.on co^fuctiO" dots not «-wp', the tont<nuOu*.
genfation ot new. .n.qoe sympO' structure? Tn,s C0n$t'w;ti0t -nvotves tne seectvo
art .at'On ^nd KSO a! on o* pr«*«iitt#nl ima(«a Of image component', isywiDO'f. jna
rpidt ons), Inat unique (npt pr«v Outly ^.ee^i tm ronm^ntl cjn be pe'te ■ ea nc .at«&
the ability to create ne* *truclu,'ts from ava aoe co^ponent^ to construct a visuM
'r>iase ^ha: new v.sua d<scriinmati0nf can oe ^ea'^ed ideates IK* ability to create
ne* components tor ima^e construction
The constructive tr-eo-, o* 'iftua peTeplOn pro^d^i a stf a gnt torwaro
e«pi<ina! on for tne effects of niernai states (-e goa^si JPO" percept on Goa-s can
e'fed the selection o* act .a!ed * age coTipo^ents. c«pe'e^ce has deter', iped those
co^j/onen!', which a'e available 'O' r"agtf ^corpora'on Appropr ate Knunrlcdge ray
be activated to CO'* penmate tor erroneous st Tiulat on -^acatons 1lJ'ing pe'Lept'On
Tne tfftct« Ot water (the cer\ ',* en p-eno^e^O"! and e^eg as'es *co O'ea Or
prisnat.c) can t)t' KSimil^lod r'o ''e image constructor S'^'Uriy, »T ao -ty '0
vokmtariiy alter tne pe'^ept on o* a" en/ pomnfitl orese','s no p'ooe*' 'or t-^e theory.
Tne resonance theory o^ ocrcept on (CibfOft, i960' p'OpO'.e'. tn.it pe'fep* o-
resu'ts from a d'reel analysis o* stimulation structure In contrast to tne ■©«struct .e
theory, re'.onancp t'-ror y encounters fliffifuty i« * e ••■? ^nation ot t'e effects 0*
nlprnat states ana tne ability to 'Olunta^ly a^er percept<ons Patnc 'an t e "p. a
pi'" jrncnnn of re-.onanfr., / ■, M percept on i-, iiflter f|*"{r.tjea *'. a ;>'•■">:"(•■ jn tl
interf(>'t'n(c or ntoract on between ntcrnai '.täte-, a^fi 'f""0r^ stimulation i a', e»
(19^/) ha', evon dtscribod internal /isual reprc.entat e--. a', a form o* "inlr'trrrnce
17
«a-L" pitte"-!' Tnj; p'ooos»! ü -ot "»ue n«f», but cOn»tru:t .» jctivily Ii'Ob'.P
»si • >' O" »na »cco">oai? 0" ar se ac&cr>bec J* a tonn o* mlefte'ence
"ebo U9';9 began |ht mcae'" p5,cnoojca. (ormuMiM o* > (andrucliv*
theory o' •0"'n pa'ceot 3" -ebb's mod«i intrudes tne nte^-a! on oi npuls and t^e
oirec! on ot eye atlenion as oasc eements. H« proposes t«o casses ot h>|ht< O'ber
reu'a' units: cell »■se-ro'es a'o p^ase sequences Te assen-o ies are g'ObP-gs ot
"e^'Ons whicn a'e * re3 tregoent y ana i rnu'tantOjS'y by h.gh probab'My sti^u^s
oatto'ns Pr-ase seq-ences a'e tn» to'tner ,0 n.rg ot seve'a Sjch ceH asse^b; es
win.cn -a.e o'U-- ;t,' ^clva'eo n ;e""p0'ai seo^enc» Thu ,0'nmg acts to tat "täte
So:- seq-entai t • -'ä iso-neonat «.e an eipe;tal on) ano to o-ect attent.on upon t-e
e-. -O'-ent to acco-np'sn '-e sa'ne One p'Ooe^ s t-at -eob's p'oposa ooes -•ot
^e a'e 0'ect . to a e^e ot sensof. input, on'y dea "'. n tn oafed re^t^a p'jeesses
"■■ e jai c ae»:' nlom-at on -'ej-at on o^--J pe'cept o- s nlroducM
.i.»n locnce'i i;9öS,i9"0,i9'jl iias »eco-e a pnma'y t,gu'« n In»
nve-.tgatin ano s.iec.titat on ji 'He consf^ctue !n«0'i w p^oposc^ t at a Has c
j'.pe.t o' ■ sua pe'cept o- s an ^af , "i st'uttu'a. O'ga" jal on wnci ■• ,ives
DOSS be tue ^e ect e atte"* o" upon »no success,e nte^'at'O" ot the . sua
e-. -on^e-t Th'» o-j»n.'aton s e'^oaea o. "sc-fiatc - <cs" »-en a-e
cons^'utted to gu ae In« pe'ceptua «;■ . '. ""eie -^ps a'e |fne'ated »tco'dng to
• •ia-^a'ona a«', o' 031" J a»s ca e.pe'e-ce1 J"J Ostat i"--." r-..m pnnc.pe"'
0' gms
*" . *■ es s a;.eii's a^a a*te" ots to '«'tne' spec t» tn s Inecel ca p'Opasa^
• t'o- - cz .*'?' •■ r ■ v .''c "'.»o" » '** a ; ^ss o» Sua " a;.(»s • ',..* 'O'ni
Pt-'fi-p'O" '' S .«■' i !'( - ," 0* ".i.-^c't'/s ' . , ,.* . - .«p" iO'\rpt ^no ot .ts
Reproduced from f» Kjj avilabU copy.
I
rol# in cognitton The perceptual image 15 conMruded both as guidt tor th«
perceptual activity and a-^ product of that behavior
J Cjoals ol the The',«.
The research which .r; reported here n a further investtgatiOh and tpecittcation ot
tne corotrucli^e theory ol v 5uai form percepton Wee spec 'ically, the goals hav»
been; fl) to invest.gate the naturg of the p'Oce^'^es ana memor.es which sre involved
m IT« luaton ana intograton of success^e .lews of the environmenli i2) to
mve-itigile the nature of t^e mlemai representaton isymooiic visual .mage) which is
capable ol embodying the necessary partial and comp.ete percept.ons. (3) to specify
the result» ol the investigations in the 'orm ol an ooerational, computer-implemented
visual imagery ana perception system IVIPS) VI?S s sjen t program which has been
mplpniented .n LiSP 16 on the CVü PDP-10.
Tng motivation lor the two investigations is abundant. The need is best
eipressed by the lollowmg Uo statements:
"There 15 little e dence to gude Our thinking on now these mteg'at.ons and construct ons ta«e p'ace In led, . ittle altenton has been paid to how such processes occur at an" (Maber and He-shenson, 1973, pi 74)
"Wnat we need ■. a set of operations lor delmmg and studying the kind ol visual storage that will build up tne structures ol peroeved lorms out ol momentary glimpses" (HochMrg, 1968, p32?).
At for the goal ol specilymg the result« in the form ol a computer-implemented
model, I believe that one major factor which has contributed to the fluid state of
allays at the theoretic JI level m the failure to attempt complete specilications and
19
implementalions a* l^e iTigiry »no pirceptuil procssse^ .mplitd by a st<t«d Iheor/
Accepting the view Injt pe'ceptioi fc Tigery «re o»i.cili/ s/mbouc, mformit.on
p'Ocessmg act.viliei, tue computer jnd inert' easting programming language »/»terns
de -ISP) now provide a «ahMH* means tor tne further investigation ot tneoreticai
proposal». Not only can some . jnt ae sned on tie sulticiency question» for »ny
proposal, but through implementation design and subsequent actual System behavior,
other theory implications possiDiy not rea zed earner appear for con»ideratiOn. What
control information is necessary ana can it be feas.bly mcludt'd1 1» the information
representation concise enough to fit into a hm.tea STW lactive memory), yet rich
enough to afford thi -le.ences which sub,ects dsplay' These are omy two of the
many questions whic*- • tnnot real y be answered for a perceptual (cognitive) theory
until * completely operai onal specification and Implementation hat been realized, or at
least attempted, for a reasonable suoset of acti/ity Experimental research m
psyeno-ogy has provided Iht necessary critical mass ol design relevant information to
attempi jn initial implementation of tne theory such as VIPS.
The implementation goal here ha» been more eiitensive (inclusive) than that Of
•chirving simple input-output equivalence or correspondence. VIPS employ» a number
el n.emory component» and perceptual processct which eaplicitly contain all of the
symbolic information involved m the pe ceptuai system"» operation The memory
component» and their associates characteristics hive been interred from e«perimentai
results ol cognitive psychology (icon, STM, LTM). Thus, the model attempt» to realize
correspondence at c le»» superlic ai, internal level. The programmed system's Output
is a trace ol memory content- at selected points ol processing. A common criticism of
computer-implemented '.ode s (simulations) of human cognitive behavior has been that
!
l..
20
they necessarily employ man, h.dflen, tomoute'-o^ented, non-psyt -o'og'CJ' Optra on*
to acn.eve tfiput-Output equ>-. a.ence. Thtf ana other »-pcendy imp'emerted systems
(Nvw^l^Si MO'an,i9.'i) alter-.ot to mane tneoretca1 f.. cations espiict in |he
■ mplrnientatiOn to «■ greater eitent Ih,*n uctore and to Cipio'e (confront) the
con?.#?q itnccs
i • ,
-.
•i '^es.s Content Gude
■ o acco-^pi'sh I^e D«sic nvest.Ba'o*/ go«, t^e necessary t.rst goal o* tht the^.i
was to de.eop an eipe' »«e^ta s tuat.on *ncn *ou'3 7 eJ a»ta o* vaftM to image ano
p-'ceotuai process (»tCffccal on QKlptof 12 p'O. des a oescr.ption o» tne l*o
©■Pffments carr ed oat, o* t^e »O"*1 0* Hit OVa acqj'red, *n<j of Hit analyvs
P'oc^a.'e whicH led to tv »«uttant •..''t-^ '.pec'caton
Cn»Dte' 13 dttcriMt tn* imaf« rtprfttntjtiOfl wnich has been proposed A
discuss on of the oast Of*, gn crte» a jt ied »s *0 o*ed Dy a »u'' »"P a^aton ot tne
ft$ü t'nj rrage »pev »>;at-o'-
'>-»Dtft' 1.4 '% an eiposton o* Ihg p-oposeo pe'ceptua. p^ocesso' at an ovtrvt*
ev» Co^'.t.tjent wemo'ie«; and processes and the r inteTe'atidn .n.ps a^e fuHy
K-sc'iped Mucn o* th.*, teve» ot specittation viU be 'ee« to resutt fro»« a oer>'e to
•e'nain con-, itent »IHI enternai, 'e evant psycho'ogca- ^nd^gs and IheO'tes. espec-auy
'.D^ce^n.ng tht memcy proposais The specit.c cpe^atonai cha^acte'i^t cs and
contents o* the».e nnwof»«» a^d ^rocMMi are direct res-'*«, of the e-per menta'iy
a^q'jfed protoco< data Thu cnapter ts tre Ovf^l theoretical statement o» tne tnes.s
the second ha» of Ihi cnapte' Mfvtt to Ihittratt the proposed percepti-ai system
a^d mage representation n act.on
Cn -pier 15 dscusses poss<o e e«tens ons to tne .rrp^mented system to account
for *hc S'-ojett oeha^or upon Img tfrMrmgi ?*&*% tnree d menson «pro.ect.onaii
perception*, 'r-f perceptua theory embodied t>/ tne implemented system •. then
discussed and ihowfl to be sat s'actOf y genera ;ab<e In such a general form, rt s
sfiown to be useful m accounting tor both d.recty acquired «no ««ternaiiy noted »yt-
!
,
22
mOvi'm«n! d«t« *oa ln»-f «*ioc «Tea MtMl p*rca#t*On& Ärcowp»nF ng proposal *-»
«isO ^iOe to *v»'it |h| e«ttnson and te^e'aMijt.on o* the fjil/ inst«"t ited .^a^e
'epre^entation *or Ima rjri« «gs to •Aguri «' . tu«i e". r&- ^t"t* *nd pe' p^e^ai vision
consiu^. #|iftfH
Chapter 16, a^ the cOmuvor, cc; .»';■ In« proposed nnj^e'y lyftpff *nd ?
'■epri-'.entaf.onii structurot to otner lOmpa'si-1- propCd'' A p'e* OoftC-ption anti
d.scusiton o' a gPfloral tn« ', o( ognti on, rt'eifcn iu^^^ton^, »"d «n e«/jluat'Oi O*
tnes^ go*1 rpphtotiofl C0«C'u0i !* i '•POM
In th* '.econO .0'u-»'e, v>'jpt»f I] ; g #•« fc^pele e^po'.-tio-n o* ^e t^'ee
sopp ementar/ po'ctplj». proc*»«M ««d 0* inp two .mp.e"^««Ied KttmtlaliOn-
»<cO^Od«tiOn p'Oc»-.' .iHlpnl -tors »n.ch •'«'• oe»« "♦•"ea t'om *he ojt»"ed dat^
*ht cnapte' fete'ences *r-^eidc#s d-spi*/ng |hp dctj» «np.e^e^t^io" i's'rgs to
pvpiJ »jlier unde^tand-ng
> Cn^ptef il ?, Dtnä.O' o* the tuii/ npe-' fed a"0 p'Of'/ar^ .mp'e"'e'',ed
peTeptua. tytttm l tont'«tea '0 f^e on^e^/eo subject"', act<vity o' tou' '.e'ected
prnt ico*. A q^a-tative P ^ ,*'ii. na'.eu 0" spy*rj< »ee-a'-t quentilal -e mp«%ures ü
gwe'> Tr,e chapte' rele'e^'ei *Dperd'e-. co^t*" n^ tra^tripttOft« ot iubi*cl
. e* ,./.or drd tfKOt 0» prü,;-.*' a.t ^ity al se/e^a1 Ipvpl« ot ',peC'f)< t/
/
rfM
Chapter 12 E"p»f''nents »^o l^mtyw
This ch»pt»r rs • dt^cpton o* t^t eip»'•«"(» a-'d wb*eque«1 •naiy'^cai
proredure^ e^pio/ed « Iht aevetop^ent ot !"• pe'ceptua' p'0<e^%ng s^ste^
proposed by this th«v4 ^r« lirtt p«'t o* th« chapt*' co^side's th« •■percent n
terms oi ^jOjCCts, si mjn, req^i'ed tas«.-*, ar>d acqo red data The secona pa't
d'scuitses how thi% O'rect , ac^u 'ed data ^*% oee^ pro;essea to se'v» as * krM*l tor
the u'OpO'.ed ky«t«Mli <imn
t»per.frtentv
'*o e<per "-er'ts, eKh con?At'r»g o» se.era pa'ts. •«»■e conducted to D'Ovide the
data "ece'-'.a'* to 'n^est gate *-0'.e aspects o* hu'"*" vitufl pe'teptua: be'-a* or ot
-ntp'est *ith n the sta'eö goa •> o* th s \*t%% Tnt p« ^ar, design cte'-a tor the
t*.pc' ^ents used a'e **\s* . Je» .<t es c* the I^es s goa s As »ufh, Eipe' f^e^t 1
*.f»t tam«iierif#t tn^ suti.e' * v a ■ ass o* ■ *e d'aenngs which are Lrt#w Ifwoughout
♦ ♦■e '0;'0* ^g ta' *•■ as tt«Mul A tas* «. tuatO" s t^e" cea'ed »h Ch tor res t^e subect
' ■ '• /ate a •■■u (e-. , »n ö' pa*' a' p ctu'e v*»s to -ea^ /e a i.omp ete perception Ot
the .ti^u us The »ubjeit " ' "J.e a i»a (3 degree vi»uJ a^g'e^ ^oe abo^t a he
'Jfa*'hg i#* oftii" to '?*'te '• pe'tept O'" * s tas* » e'^s data 'e'e^ aht to
dete'"-'«'V, t^e cc'-t'^f* f " e^"s ana :ap*h t es o't^e sjb.ecfs pe'feptua s.sten
The p'r-a'. pe»cec' a ta'» o* t^e t »«.t etpe» ^e^t sne.essa'', art.» ca- T*e
'.eiO-^u e«pef mvnt p'o- if i^'a 'rc^ a "O'p hOfma vt*ual pe'cepto« ^ituat^on It
/ •
;
24
invO'ves the trac^'^g ot t^e iukjSCt^l eyf -novements a>.r | t^e peftept'O« c' - Itn«
drawing stimutc- Trese second 'esu Is are tne^ nterp'eTeo -n hght o* the integ'ative
and imAginai operat ons interred tro^ t^e pr<0' 'esuti to turiner specify a
comprehend'' e tneory
SUSJECTS
it '% not a goal ot Im» tnatu to mvestgate tn« act- co~e-'a; aspect', o' acquiring
Ire HDH'ty to etleriivei, oe'ceve straight line drawings ;i a la investigate the nature
ot Ue precedes and f^emores involved in tne developed eltect'.e perception ot sucn
pictures Therefore, perceptual capaoie subiect« were desired Tim is not to deny
that picture perception is a learned activity This has been lairly wen suoitantiated
by ch.io ob-.ervation and eiper.'rents introducing pxtures to people ot cultures which
do not use pictures as a spat al representation "nedium (Miner, H'S) L »ewse, tne
poss t>ie .nf,uence o* any preteo ng aeve.opnientai per'O'l upon tf'e mature p rto'ial
perception proce'.'. is not oen.ed
:he desired sublets were persons ta-nmar with lie dass ot line drawings to be
presented as »timuii, thus in'erentiaily insuring their possession ot a developed s,s!eti
o* cuo'dnated processes and memor es appiicaDie to t-e ptrctptiOn o* such p^tures
The chosen sublets possessed the oesned eiperence. p JS tht characteristic that
they were unaware, to a great ei'ent, ot t'e Current »esea-ch techniques and resu ts
in the tield Ot the psychology ot percept On
i Ouf subjects were used The 'neo'y to be de^eoped ne'e 'S ot the type which
has oeen called a »ni-lheory ['«we i) It accounts lor lew subiectt on relatively tew
behavioral perlormances The subjects employed were, at the time, «11 students 01
Cernegie-MeMon University, as lonows:
r ..
'juQtecl B (B > - mil» gr4dM<l( itijdtnt m compute' M>tnc*i
SjD.ect P (Paul) - male graduatt ttudtnt in mduttnn «dmimstrttioni
SuDiecl S (Sieve' - "J e graduate iludent m computer (cencei
Sub/ect G (G«en) - »ema'e senior unaergrafluate in graphic demn.
'hroujhout f-e e«pe'i">e"tai periormante« there appeared lo be no great
difference of capab^-ty nctween tub,.>ctt, though they possessed differing
bac*3'n ."js and current «tuatiors One aiception was that G showed some greater
sens tivity to KM Oengtn) characteristics in her perceptions, possibly an influence of
her graph c aesgn study (ins d fterence has Deen only noted qualitatively, >rom
anecdotal eiper mental mdicatons) Other sublet diiferencet, not in perceptual
capao't es but m ttrateges rmpo/ed, «< be dscussed <ater as results
EXPtfJIMEM 1
Ai four subjects co^oeled l^e three parts when comprise this eipe* ment
Before each pa't of fr-e eiper.ment Ine sub.ecl was presented with a copy of W*
instructions for tnat part 'ne subiect read ths aiOjd, and then was permtted to
•.tjQf the mslruc^'Ons unt I «.ure of uhderstandhg them These instructions were ail
the «formation g.ven concemr-g each eiperiment part
rne mstruct.ons for Part 1 a'e given m rigure ill Two of the reasons lo-
mciuson of this eapenment part a'e indicated M the last paragraph Of these
instructions It was fe1! lo be desirable to use a minimum of /erbal descriptions of the
pctures to be used, and as can be seen an that was said is "line drawmg" Figure 112
presents pclures ol the Iwei 'C line drawing stimuli used m Part I Trem this pert, the
I ..
2U
iXJ.iUK.-,!.:' I
PA* i 1
Fi|Uf« II. 1
!n^t ru^ r i on
You i.'iil now . -i ■ ( ted with a urif« o! 1 in« drjwingit, Yoti «r« tv»
look at i . iriuir until you .. you JI. i] I le i>( fully du cri'-in,-
it. You art t!.t i t-* i IOB* VOUI • <. > !j ..iv t'.^- ■..•ri, "i.....*;.", which will
proript to i ' • , >ftvr rwopenin '.'our < ill bt
1. orallv dcsiri'e t'H |i". Jr.n.in»*; there i^ TU> "^»rr-. ■"
do t riptlocii thou "i ei n I»' i. '■■ it-^ i ri d
•newer 4nv quefttiana I i -tv have AHJUC t V line dru'./in»:,
or >our dcttcnption
1. Jidw th%i I Inu drawing, *■ you ruLall it, on th« p4U in
trout ol you
I)d not Btftrt to d« crib« th« lint- drawing until a:ttr it IM* b««n r**-
novrd« Do nwt start drawinf Lh« Inu drawing until after >*M hAV« i* ptut« I
th« r ii di ICI iption and an^^trcd any quaatit i« I ask,
rhi. i^ .i training purlod to finllla^ls« \üU with i .v ctaai oi llna
drawir U'tfJ throughout latar «xparlnents and also to acquaint you with the
tasks ü: Je tri in ■*••'. drad'u trori ncnory«
A ■
■■:. Fifur« II 2
Ud
vM
OS
^
/d
z: Ld
..-l
26
bübieds le»rn th«l only st'jgnt i.n«s tre •mplo>ea, »nd tnat »veral aiMerenl !ypes
o» these stnighl km arm^c.'- ■•» "« eipecteo. lo.i» oe"g
U) s.mp'e two d." t^ns onai, geometric ob,fc!i. *tn or wthOut OverLiy (Figure U 2 (i> );
(?) strähnt •o'Äjrd Infee d-nersionji p-o.ectio^s ie Figure HZ (") »,
(3) impovjibe ixree d "(•-'-■on»! P'0,ections ii4 fgu'e II? (m) h
(4) transparent (ravervpiei tn'ee-Oimensionai Bro,ectiOn4 (i.e. Figure 11? dvl ).
As noted, tne suDjects aiso practiced ae'tripng tneir perceptions and
subsequent)/ drawing them tror*^ tneir constructed memory representation. This pai t
ot the enper—lent also had a hidden subject screenng purpose II the subjects were
• ncapabte o* drawing or describing from rremor/, or it their perceptions were ol the
free association typ« de "loots like my aunt's nouse"). then they could be e'imihated
However, a' ot the initial tour subjects were sufficiently successful.
The verbal descriptions given were recorded on audio tape, and the accompanying
drawing sequences were reco-ded on v deo tape to oe used at data es will be
discussed in the anal/sis section to fellow.
The instructions to Part il ol E«per ment I are given m Figure 113 ; and an ««ample
Of tb« stimuli »mpioyed is given in Figur* 114. Thu part was conducted in anticipation
Ol Part til. From Mverai pre-eiperimental trials ol Part III, it was found that a
vocabulary problem could emsl, resulting m the us« ol hand waving to d«scribe
int«rm«diat« obj«ct constructs. Tins part was thus primarily a screening part in
purpeso, though tha verbal results obtaincl and recorded on audio tap« were
considered to be valuabi« data as discussed later.
p>
Instructions
You will now be preaestW Jil
should cons der each to be a iraall
to one of those seen in the prcvit
looking at sucli a dnwing throu.;»!
view of the drawing at any ttne.
do as follows:
1. descn'je what the partial
2, give any ideas you have a
given partial picture cou
I will do one example for clarific
■
1
.■6a
KXFKHIMEI.T I
PAKT II
Fijur« 11.3
Instr ictions
Vou will now be prcMAtarf with a series of partial line drawings. You
should consider each to be a »mal. part ot a larger line drawlni; similar
to one of tbose seen in the previous part of the experinent as it one wert
looking at such a drawing through a tubi.- which allowed only a small, partial
view of the drawing at any tine. While viewing the picture you are to orally
do as follows
1. describe what the partial picture is itself
2. give any ideas you have about the whole, of which th«
given partial picture could be part
I will do one example for clarification.
Fijur. 11.4
I
21
the instructions to Part >., *re given m figu'f lib Tu- etpermentdi procedure
and tjsK o* Part til is an e«1ension o* a metnod noted b/ "Ochbe'g (I9tiöi In those
preliminary stud'ts, subjects *ere presented witti sequences ct partial views enclosed
wth.n a circle »eoresentalivt o' tne ve* 'g holft. T^e eiper'rrienter rtmamecl m
control 0» the succession .ma prtfttntatiO^ tim« 0» tne d'screte. part-ai views in Part
HI here the subject has compete cont'O1 o.er tne ho-* positioning including the drect
movennent 0* the Hoie In me nocnoe^g !as»is, sequences 0* paMiü v e*s are
presented without a rect mOvtmtfM contro or occurrence MO tWvtWfrt n those
cases had to oe totaüy mlarrtd or was imp.ed Dy direct onai arrows ntersper-.ed
Detwoen .news
Part lil tnen is t^e lifmticaftl pa't ot th s eiper.'nent Tne behav Or obla^ed h«ra
it to be moueiied and •■plained •■)/ tne program irnp.ementea perteptuai Sy'.tem Tne
"thipK out oud" .eroih/at on, ootamed he'e a-e no! nt'ospect.ve accounts by the
*.ubj'?( t cüncom.ng his Doha or Tney are pnn ** / svo*I erbai cues .ndicative o* n s
nt^rnal procp'-.s.ng status
ine pictures e"ip'0/ed m !•■• part «ere '"s ~ «• >n type" to t^o-.e ot Part I Mo
ptUre from Pa't i was errp.oved f'gure life presents piCturts 0* t» e ne drawrp
stimnn used m Part ;!I The ' o enr,o cement and .prhÄi/a'on prolofO', /erbsl
desc ription, ^nd d'aw" \ seq .en^e were a11 re^O'deci on /ideo tdpf I ♦ouno -t
vinntfD'sar, to n-.t«. que .ttons o* f'^e Mibjects concerning »npir de'" pliOfH. a1. 1 also
nad 'Ound in Part I
All the sublets «pre capable ot |his t^-t« tiowe er, A.\ suPiect* 'ound t to t)e a
ttemandtf,,', !*•> ^ncj *;■ o a tiring one o'-e Tr f»^ Qne t^n quanta! <»*/ note a
dpgrrfij^tion m pprlormjnct anrl wea'ine'.-, ol vO'ce duf ng the test protocols 0( each
I
EXJ ::->ir.-,:." i PA!: i i; i
Fifura 11.5
In t' ^.t_i_oil''
i.florf you . . a cArdbu'rd and pdpvr ohiiriJ, which will easily • o-. L
about :''•<- : .i' 1 f top, , rv this now,
P.i i - fht«ld wi 11 ■ . placed o.ci -i l i ■ lr - i ■■ ■* »ni »it : 1 ir in t vp«
to one <.•: r M oci in :'art I, rtm shieid will »liov only a b'.tll part
of thi :T .iv . i;,, to ' . .via* i- t r t., throii.. i the Itolv in th« cardboard,
io-i arc to -"u'.c the ^l- , hj : ».' . : t «■ litld, about the drawing until )OU
li-tl .. !. 'f Jc cr, mg the cv»i pli-ti» drawi ; in a faah ion . liar to that
doi.i' c • !, Vou »'til ih«.;i •■ top r o . ■ ' ■ ■ . 1 * and tli oially i.c the
dv^cripti '■". '-ou .» i ! lopi 1, in w i 1 u ■. I r.ay 'uv*.-, a; .
draw thi ;-. ■ : K .» you r. ill it - all . . . n t.» t *: Jone i n I'art '.,
: , ■ "■ ■
Figure II.6
.
7 V
v«
i • /
the tuta ect to »utensiveiy UhkM ha M'ceplu«! ao S ind mcmonts.
EX?raiMENT H
Tnu tioe' ""»"' was co^Ouclf d aooul 0"e month a'ter tiiperii»»nt I. employmi two
o' th» pr»vou, S'JB ecl» (P ,i-3 " rn* »«per ment was conducita upon tyt
mu/em»nl tf je« -J eq, pn-ent aeüg-eo ■3 cohst'ucted oy John Zouö [Souid ana
Srhat'O', 1965). 1t m,»e' a lee^'Sion camt'a 'iput .mag* Ot th» prtstnteO «ilMl
stimuli (lins d'awmg) with , camera mpjt ot a beam ot light reflected Oll the cornel
'ens ol e subject's '«It eye This mimng produces a video tape p. ->io:3i ol I i|ht
■pot moving «out ' » presented visual scene Due to the bulging ol th» »,» at the
lens region, and tne geomelrca opt cs ol retleclon, th i ngnl spot, wilrm an erro' ol
3 dt'C'ees. approaimales the current e^e tm^tion point upon the presented line
brewing
Tnis etperimenl had two parts, lie instructions to Part 1 be.ng gi.en in F gyre 11 7
figure 11.8 present-., pitlures si me stimun used m this par' Each picture was Hashed
(or app'Oiimate/ one-q-a'te- to one-tnrd second, tn.s lime be n| that 'ound to be
tn» o»»ic (average) luation t m» o' tn» e/e dunng tne scann nj ol a presented v sja
r.t rnuli (•ele'encel
T>*9 eroal deser ption given 0/ '"? -.jS.ect wa« ■- r J;J mt, together w.lh th»
d-ivihg don», was ».60' as mpc--anl da'a. as disc.-.^d i»t»r Th» »■ « --J.aT^nt
. deo tape record was a'so kfpt, lo be jt- red as a chec« to msure only • single •,-
Inet on during Ih» drawing presentation
Th» mslrucliOns lor Part II are given m Figu'e I!) Figure II 10 presents pictures
I
I -.<■ ..w ■....: II
PA
Figur« II 7
dl RTt» i.id :'Jrt II tu K>1U*, w.ll :>!• ■..•nJiutt-d on thi . . ..>.•.■. .nt
r rack uu jpput «tu- .
1 n»truct i im -
Ii ihii p-irt rou will •■ prtfM«nt«d w i: i -J vrim* JI ■ t ; 1.1: i i>ii lar in
t.pt- tu those pi.**MUtJ i , ! ,■ ie«rli«l ■ ;>f t ncnt -. ktor« eJch lim ol
• if^wi nc i • pr. tat i.l, J ■. ii » L ros!« will hf drdwn upon t i. . r--«;! i n I ronl :
im, i>ncf 'i'-«;! tit- i-it. platt-, .-on arc to look at Mi-Jtc tu- intt*rsi>ct lun
point -•: tlia cross. 1 will t'ttjn .ak«- -t tinal .-; . ■ idji I em .■: t'c i-v«
tracking Je.-ic»-, \\vuk w i U' vou continue to I ixatc v r . Inter »vt ion,
tUv line drawing ttimului will prea«nt(.-<J upon thi «cresn« ou ar« tu c >njitantl>
lixat« t K- crosi intrr ectlon throughout th«? pictur« presentation. H«v«r m^-.i
i»'ir eyes, I he •>*< track ing devlca vi 11 not« ■• ■ movanrnt, thus invalidating
mat trial .
A soon '»s t ■ , pi >. ture i ^ raaioved vou are to «t-t off tha bite plat«
and daacrtbe .»rj 11 .• wti,it .uu rt-ca 11 about the pi ^ entad drawlnn, whi iv «ketc h-
i •!< thoae parts that you can,
Mch putun-will '..- prt-.«■■I'.-'I •,.•■ i • . ^ : mttr .il, ! im-s will irv.
I
fifurm IIS
rv^
zy
u .1
:8c
■
PAK I II
In-'trucCioTi-' ^^ I
Von will now b« pr«a«ilC«d with a ■•?!•• oi partial UM drawings. Vau
should consider edih tu h« 4 ■ ull part at 4 : i- . - Iin« Jrawing similar
to one of thusu seen in the previous part oi the expet ir.ieat, as it one were
lookin.; at Mtcfa a drawins '.urou^h a tuhe which allowed only a wnall, partial
view ot the drawing at any tine. While VtWiAf the picture vou are to orally
do as tol low-.
I, Uestrile what the partia picture is it^el.'
2« give any ideas you ha e about the wtiole, ol whUh the
|iv«n partial picture <.ould be part
[ will do one example tor dar i t icat ion.
/
FlfM 1110
fr
^
ot t^O'e line Qrawinf ^ftwuii u'.cd Vitr (hält ^veraJof thp-.e we ^»peaU fron ^^M ill
o* l'ie Pf'O' ffip^fiment Ihe g pn fif.c.plon o» tt^e pfe^e^V»^ p-cTu'p »Im *<•
ftudtO taped JIU t^e res^ttng ii'^win,; »as «ept The '-re-rr /tm#r\t vdto tape
protocol •rf-, «ept. a so 1'ere wee ter pc^-es p'esented m th.s pj" to eacK
'^uo^ect
STJMU i CHA»ACTE»iST|CS
A note '^Owd oe n-aoe ^^'e ronce'i^g stimuli c^afactenstirs to' both
»».pr'iBipnt- i and ;;. ^"-j •'!» subsequent effects o* t^e'.e charecl#fttt>cs -ipo'i the
enjttsis protedu'C a^J *'i- propeted i«*|t '■e^O''/ The '»o 'mpo'tant stiwuii
chjr^te'istus *o De dist^* ■■«■
. \fe Overa :">e Q'a* tg wt
^ the i "e o'.entjtof". *t" " tne if^Ängs
A i o* *■ " «e d'awng ;■.■■•■.;, • • ;o e'ecf cpmparab'e area% ««th'n the
subvert1« '..a' ' e-d At Ine d-stances p'tse^ted. the ^e d^aw^gs in both
e«p€'irrest- ■ pa^'-t J '«er*, l c ■ v '♦/ * .e degrees o* ■ >a eng<e between thr<f
etftront* ponti rntt n-.^r,. , ». ^ -,. ^ •,*', *"a j'-e* . • ;■ .T"t o' e^e p»iOve*ents
in tipe^'^ent H 'hr ••(.•• f'f. O'sta^^fs 'tonta<"ed ^e ^egtwe*»! ■e',t■.*'■■ o' a "^e
presented p^' ■• * *. '■ " common bO •"'!'.. ^l ♦hu^ o* COmp«rabie 'e^gths in
Pert ill. ot r •(>»" '■ "nr I, o^i. one /eptea cou'd be seen at <■", one '«e Ihr* * •■
ho'e (^n.cf' '.panned appro«'mate . i jfg'ees o* /«sua a -' n n i ^me^e^»
I he '!•»■'■, üi '.i •■» l ■■;■■'■ ■'.*■' 'irt'.i ^'j ■ ■'■ '' '• the r a'".-- !•■" . ■ ' ■ • •,.
p.rtitrp we 'esu'ted in the sul ■ u*.e 0* a cor".t'i'*t ab'-o ute po*. t on^i rp^ervnee
•'»♦»nn. a-, hrfo tin»*" e»p*"! .i ''i' t jnos on the to^'i^efj tme tefment's ^ngth and
fe' 'egu'iMy m r-,-.!" • so tr\tc ta In* •..■ ■' ■■, to tmpio/ i contUnt ■-•isolut*
:is'»"ce rete'e^ce set «so 9otn c* In«« josoiut« re'erfnc« tram« hnvt *
c«<'4cter'»l c "*u»/y" tC'f«spO''0*it» 10 ftgons or nei(hbarh00<te oi picton«!
po<.'*.ons «nd Pnf,'' fdxtanccs) <Th.s Wlii b« further dscucsed and clarified in
Cnapler Hl i
Tne leconQ •■.,■',■'•■ ■,'-._•. cnarKteriStic i that only tour bat>c "e
0'>en'*l ons »f ut i jea. ?■"»« Bei-'g .ertcai, nor jontai, upper-ielt to io«er-rignt
a ago"* , «no '0«»' lett 'p upper t ghl a »go"*' *'tn le* e«iepl'0n» no im« draocng
COrtlined two Or rnore dijg0n«,i o' the we case or^enüt on « tn ditler ng S,l0pet
Tne re'ean» e.pe'""e"!* oata inotates t'al MM »t »UIUS cnaratterisdc >«d tne
4ur5j<jcts to ciatstty (perceivei. ana suOsequer,t » rerremoe', line orientation» -n terrns
0* ;ii5t tnese 'Ou Da^ir onentatons, yied.ng «grt po« Die line trave-Sing directions
(up UP, do«" 00, lett LE, r.gnt »'. aown lett - Du. up-ie« • UL, down t.ght -
OR, ,p right - uB)
'!'# exept ons Sve ' ftu'es ii ?i I a"d 11 6i ) ) pro. .:«? a^ecoola. e.oence in ta^or
ot t^e*-» interreo directs" encodinfi rhe (utt)ecti CNOjrtered, a'^d .e'Da'ir noted,
some pro'e". PJ a ** ' ', due to the „i-^- „a1 emstence o* Ihd diHerent voped, same-
direited liagona anlhin A • ng.e p'esented stimutut p fture Also sublets ne*er
ment o-ed erp« , a«, i^t/fe J* '-cpe •or "-e nes. norma v us-ng one ot tne eight
P'OcO'.ed oreito"5 »hen .e-Da » not ng ir.o.e^ent O'recton .n protocol
e': * i»' o^s o' ^e or ig*'.A\ on m tn.« lescr pt on
Crev Oos re.e4.f> (stat.st.c* researf' ^as si,,»" that s ope odgmer-ts are not
a '"r B /tea u" 'O'"- ., but 'e-a to < utter aoo-t se.era comn-on reference v entatons
ire*«-eicnsi In»* ».ee^s to no täte that hu» ans n ncrmai visual pertept'On situations
. •I
31
do remennbef directions in terms o* a relatively imM, I Mf set o* va'ues (l^ou^h, in
more generji' environments, po^Dt> ^ore than tne 0t(hl p^coosed) This custer.ng of
hum.*n O'entation peneptions has Deen IIIIIIIK noted M partia' justitna* on tor the
rt'pfesentation ot a 0 oct». word W'th s^aaows m terms ot the sa^e e ght basx
directions Wa t<-, 1972) A.*'/ does not cam a psyChoio^'cai moae' otherwise
2. Anjiy»is
DATA T»A\SCS:PT;ON
'ne data, *hicn «as «.quired fro-v tne etper ments d'SC^ssed above, consists ot
aud o tapes o# ve'tei, part ^ pictu'e, ana compiete-picto'e veroa' description*., vdeo
tapes, whicn mc'uded stmu'taneous »üdio recorcJing ot ve^ba^zatio^s, o* th« subjects*
pef'irmances o* the ho'e mov ng tain, vdeo tapes o' ^objects' d^a» ng sequences o*
reca <ed Una :■.•*,■', .meo-iapes o* tyt movement ":ann,ng sequences, pijs »ctu»'
na'd-cop, rt^awngs procijt.ed by tne subjects' througn fecalt of O'e-ented stimu^
This 'S not th* usua» stat-stica1 data gatne'ed in many psychoiOg'cai eipe' ments Thuv
no* tn.s data hti Deen used V generate fne proposed ^isua' perception tneory and
the p'0gra^-i*p emented W At inforrngt on prpcessng system reQjires eipa^at'On
Tne aud o and video tape '»■■.": ■.:■. «ere t rst transcribed <nto suitable *■.--■.
for ana<ysis These written or graphic I'ansrr pt.ons became the d-tta actually
con«, dered as tne bases 'O' sys'em '.pecification
Th# oata of tiper ^.enf 1, Pa'i 1, was aud'O recordings of compete me draw ng
descriptions and video recordings ot tne drawing actx/ity of subjects reproducing the
line drewmgs The transcnoed tQrm ot this data H •' ustated by by Figure 11 I 1 Th«
—. 0*m*m • I i
I ..
I 11a FlpralLll
l.il.l VTIME S sec.
•fey now there'• • uh
it looks
basically the shape •( a
parsllelo
rectsngualr psrallelplped except 1B
down In the lower r'.-'it hand corner
■n extra
an extra tr;angle has been
has been drawn on
«
■
II.8.S
II'c .1
It'» a right an^K- with a line blctctlnc It
and
uh
couIJ be p.4rt of a
two-Jitjfnf.ioa.il projection of a cube
or could Just bo
um
i lino bifectliig J square or
im
a diagonal of a square
Fieure II 12
I
)tc
liK» »h» com»' [SI] this part ri|ht her» loOKt l>Ka th» corn»r ot • uh [S2] ot a «quirt (S3] now, lat's s»» il I tin ... [54]
Fi|ur« 11.13
RT
il il i« going to be » »quare [Sb]
this would be th« bottom ot th» squaro [M]
• (
K
ludio dali it Iranscnbad >n t straight-torwara manne' Eidl hesitation in %f «eh is
noted by the conmencement of a new line of transcription. Any sgnidcant pause
(over 2 sec.i is noted by a '(pause)" VTIME s the appromirate viewing ' me in
seconds for that subject on that pcture.
The actual, hard copy Um drawing reproauct.on eiecuted by the sut,e:t servec as a
trameworK for the transcrpt on o* the drawing behavior, Numners and ar'U*s were
appropriately added to mj^ate the order and direction ol the drawn.; stro-v.
observed. Va'-ous features of this data contributed to the specification of tt« image
representation ol V1PS. The v ".ual concepts ana interrelationships between 'hem
which occurred m the verbal descnptiont were most mportant. Interactions between
the verbal and drawing behaviors were others
Part II of Eitperimant I was primarily of a tramin; and screening nature. The data
obtained were verbal reports based upon partial (single vertei) picture information.
These verbalizations were transcribed in a manner analogous to that ol Part I, as
illustrated in Figure 1112 The data wet marginally valuable for both mage and
processor proposals. The verbalizations provided indications of subjects' .erte«
classifications and the perceptual inferences made from such verle« classes
The date of Eapenment I, Part 111, was m the form of video-tapes of subject hole-
moving behavior, which included accompanying audio recording of subject
verbaliaations Selected protocols have been transcribed as e senes of informational
frame». Two such frame* are illustrated in Figure 11.13. The element A (see Figure
11.13) it the ordinal number of that frame in the noiocol, in the form Vi, i en integer.
Element B i* the partial view which the subject its through the hole at that punt m
tha protocol, the circle being representative el the hole opening. Clamant C is
*
33
>nc'u3*a a^iy whan '-e subitct is at i v*rt«i of tn» Ln* d'awing. It indicate« wh c
v»rle» s if view acceding to > iuwb«'ing systtm detmed by lie hrtl page ot the
Ire"ocri0ti0n (see bottom o' Figure 11.11
The recond tieid ot a transcription tfame may be empty tes in Vi) or may t^ave
'.■-ent'. D and t a^ '.Dectied contents 0 is an arrow representing the direction
o* the hoie movement occurring ai tna* point m the protocol, c « the symbolic code
used HI VIPS to represent tnat d'ect on vVhen no movement s occurring this field .s
empty. The third t^eid is used *or the transc'Ption ot ve'baliiat'Cns occurr.ng in
conjunction with the hoie oositon and movement state oehned by the hrsl fields
Tnes« verbalizations are again transcribed analogously to those of Part I.
Furth^r-nore, each speech segment .s labelled »t its end by a statement r.i.mbe' of the
form "[Si]" (I an integer1, facilitating ts reference by the te<l The compete /erbai
descriptions and reproductive drawings obtained were transcribed as for Part I, also
Figure 11.14 presents a sequence of nine protocol frames to illuttate more Mly the
noture ot the transcription and behavior
The data from E>per ment II, Part I, were audio recordinft of partial picture
descriptions and associa'ed partial drawings These resulted from the short, sngle
' «at on presentation of line drawing stimuli. The verbalizations wera transcribed as
usual, and the hard copy drawings paired to these. See Figure 11.15 for an e>ample of
the transcribed data.
The data fron Perl II of Experiment II consisted of video tapes of eye movement
protocols, audio tapes of subsequent verbal description« , and drawn reproduction«.
The eye movement sequences have been transcribed es in Figure 11.16 Clement A is
the -equential luation number, and B is the liaation duration m «mtieths ol e second
The initial sequence segment is connected by dotted line«.
I
looks ! Ke (hi corner [SI] thn pjtl rij-hl he'e looks like the come' ol a uh [52] 0* a squj'e (S3) now, let's see it I tan ,. [S4]
Figur« II 14
if it is going to be a square [S5]
this »'ould be the bottom ol the square [S6]
aha' [S7] looks lika we might have a triangular objt't [S8] instead o( a square [S9) this would be
the second sid« of the triangle [S10]
(slowlyl
(through ve'le« 8)
and this is the • H(idt[Sll]
Okay (S12J
~\
Fiiur» M IB
,Tr. .1 Vholc W.I'. 1 iW
thrtt din.n-. ional
11 -,
Iht fu-ur.- a Kquarc It couh) bl urn (pause) there was a line coming from tht- right corner going up pretty far like a dLi^onal across it •ind then up here thtrc was a very (laugh) there was a bunch of lines but I enn*t recall which way they were going or what typei of fchap. s they formd I think there wag a trl tnglc or so;nc-tliing up thcri
i___
Figure II 16
in
/
5
z
'
w
TPA^SCRIPTION uSe
The ve-o»! dec ptions ffo*« ^e" j'y o» co^peteiy pe'^e-ta ttna d'** n^' tn*t
*'"f ODtamed thfOuf»! Eipe» "-eM ;. perts I *nci ill, i^d tip»"'»«nt U, Pari u, «'ved
A». « univcrs« o* 'ntofmat'on »or th« inte't"^ct o* tn« -w^» inemory y.eo^ JuCh
rtptiont Tht trpe^ u* lyings (tomept^j fe^>emDe'ed, t.-i« re^tion-.h.p^ u».ed
bt'*e#n re^e^oe^ed p-tture 'pec't'ti and concept, pctu'e ch^rider^ltti not ivM#di
' o types o^ effOr'. occurring, ^nd the sequence o) the vefbai de'-c-pton'. »e'f ■*■
■j'.ed JS intfemai mdeetton?, p» The co^IeM »nj -itrijctj'e 0* the u^oe'^ ^f ^tQ*
'epfpsen'atiOn
Soweth'hg »u^t oe TÄ'd concpfnmf t^e 'ee-4hce o* th« .e'h*. : ■'> to !•>•
.pectcato" ot the v^u*i ^tge «'•d peTep'. on system Tne p'o'oco i.efb«i ?•'on»
• 1 iti ^te'njii states (goals, tont.fir«tiOh«J «no is '.jch do 'o"" a rea^o^ao'e DJS s
Mr process »ulc '.pecitic^tton tne',e verbad^atiOtS i'e ^ot n^ospeLt /e MS«r1 on*, as
to the nature and course at -jct.-'tx The • sua mgt which i* constructed by the
perceptual activity serve', as the se^jniic pas»« tor the Subsequent ve'b»' de'xnption
M-, 'uch, the verbal descriptors indicates lolo^^^ion tn*i must be tontaned >« or
re »diy derr/cd trom Iiiat . •,ja <m»ge
These sanse ewpfn'nent parts a'sO p'OviO*d a tO'fe^.pond ng group ot ime
drawings pe'tormed by reca1 . ply'.. 'KM tape record ngs o* the tfrtvmg -.equences
Tne tfraw<nj '.equente ■t'.fctf. grawtng hes tat ons and Use pen post'Ontftgs, a' d th#
tmal drawings n terms of errors, cor.S'Stent o-terations, and correctness at! wert aga-n
tonsidcpd ettect.ve bMM *0f inference concerning the iMgrimtig« end structure 0*
the (Omp.ete ima^.e memory rapftiewtrtig*! o* hM d'awmgs
'n» Dei*^0' pato-o's 0DU*»a M r^ptnnunt 1. Pi't Ul a^o p^o o*J "tj-n-Äto«
^e e^-ant to the '""age 'epre--#',ta'.0'" (J#s gn Thi c*lO^••, 'eo'esentatiO" Htutl ^atuf a iy
'acii'tjte rt&tM 0" 0' tn# pe'cept ,*i inf»r»nc«ft, im«ge »tttff*t<onv. «nd -nput
«ntet.rat.ons »hic^i occjr r |h« ojier ed De'-a. o^
*r*© o*nj.<or mooenrd by VIP5 • lh#l at f^e r>ote ^c ••,•. p'C 'Ocols *rom
[■ptr m*fr ;. Part [II A , tht trarscPfd v.0*3 tape p'OtOto- ■ t" ed «is The
pr^mjry bMt« fof the ftftdfiC cJe* n-t.pn «•xJ imp^e^e^tat'O^ 0* T^e perceptual
p^O(»sse* ot Vi^S 'he iimHimnTat.cn 'etlect* :^e if- 'ed e^It^daO'l-ty 0* Doth Tne
proposed p'OttfSie1- *^d "• *t\e 'ep'»«"?*! 0" To a »O't gm***' acrain of vi»u*t
sc*ne mput ana **• des'eJ fOft-at'Oh '*ittnd«D<i<ty) to The nor»«** e^e wove-nent
Sihj.ft.0« *inc LiO'hg p»f p* e'a . siO« CC^S-d*'*! O^S
Au o* th» p^otoco ^ or'-■■',d t'O"" the eipe'-^eht »e^t ro^i'Ofea at « [gw^rgl,
qua tatw», .*heroo'^ t»v#l **»!. This a^a^i'S gav* n«« to sO">* gene'a-
t na'af ♦eristics f t^e pe*rep* a p'Ocest'h^ iyster-v pus the »n^O'^at on rele-ant to
image mfnoff d*s>|n as o-scuved aoove Th.s ovt»*1 co^S'de'^.ion *as mttrumvnlil
m tre p'opo-a ot ^Oüf I>W»O»HIM processes 'set C^apte' 4) Then three protocol»
for each s ih,ect wtrr (O-^p-ete-/ transfoed a^o a^aiywd m depth To further
■ ^•.tant.ate t"e (onsf.t.jeht pe'ceptua p'Ptesse* n Te'ms of cphtro ano operators
necessary Finally, processes *ere wp-emehted to account specif ca'iy fo* four of
thei« r.gu'e III7 hd'tates Tre degree ot ana^tc '■ons-oeral on g-.e" to eech
obta ne'i proTocO'
The protocol data was (O"' dt'ed To D« two TuluaMy hteract-ng groups of
.ntormafiO« One ^rOup ■■. the h©e-•^Ove'^nT seQ^f '■ itse't, <" ter-ns of location
(vtew). movetnent, *no Renerai ^pet-o ano tme fadO's The other oody of tntormjlion
- —
i
IM
J
Fifur« II 17
* t.
*
-L •c x. 1 X
r0 % t. * *
■2- -*. * ■^
k t. 2 t. X
b % X X *
V V H H
V V H I
I"5—/ M
\ t. H H
h H 1 J H
cO o a cO
I
2
47 i y
1 -46 \
I X
i»1
(T
J J ^t
H
i -1 1
J
I
J I
»
/ ;.
WM the v»rb(liz«(iOns provided il vjnous KCMiont by lh« subjects during the hole
movemant task parlorpunct.- 'n» verbal sl*tex«nts were used as indications of
currently active perceptual goa s, realiicd recognitions, J-J attended imago memory
ntormation. Th» hote-move-ienl sequences were ana yied 10 relate movement »ub-
sequenccs to these ntcrred str*te(ic perceptual |oai( Then eKh subsequence was
further analyzed to infer its associated undariyini control tactics. In the absence of
verbalization, perceptual toais were inverses mfcred from observed movement
subsaquences with control tactics which had e<sewnera been related to a verbalized
goal
The analysis of the data obtained from Ciperiient II upon the eye-movement
tracking device was mottly cerred out at a qualitative level with the eiception of a
quantitative analysis of tuation duraton*. This data was analyzed <n light of the
perceptual system and image representation developed from the analysis of the hole-
movmg protocols. The data served as the basis for the eatensien of the implemented
proposoi, also.
Part I of Esperiment II was designed 'o yield insight mto the amount, content, and
structure of visual information entered into image memory from one initial brief
tivation upon a presented ling drawing It is assumed that the primary informational
difference between the positioning ol the hole and the positioning of the eye at e
picture location is the absence of peripheral visual information in the hole positioning
case. It is noted that e completely different motor system tor positioning is involved in
•ach case. These are taken to bo functionally equivalent.
The eye movement sequence protocols obtained from Part II of Enpenment II (two
subjects) were all studied el a general level to note any regularities of behavior
!
37
potdbly »pMi"-! Ei|M •/• movtmanl 3'Dioco » w*r« than fully trmKribvd, "«as«
bemg upon tojr picturM 'or which hoi« -3^>m«nl protocols bjr Ih* ttn» (ub|*ct( had
bs»n Inoroufhiy transcribed and analyztd E«cn saqutnc* n trtntr.bcd ts a Mquanc*
of tinatiOn». Each fiaation is reprasent d m terms of location and duration. Fiaation
duration it attumad to be directly related to the amount of prucestinf occurring at
each tuation. The sequence of fiaation location« provide indication» for tha inference
of processing ttralagiat and states
Underlying tha development ot tha proposed processing modal we« a general
consideration and an overall amalgamation ot as much relevant ptychological
mto mation at postibie Some of lhata retuitt are appropriately ralaranced throughout
tha thesis. Findings concerning short term and long term memories, their aaittanca«,
tiles, overall retrieval ttructures, . nd operating (harKlanilKt ware vnad as datign
guidet. So were idea» concerning tha rapretantation of cognitive procattat m a
production syttem form [Newell and S>man,t972). Together ell of thu eiternel input to
the proposal furnished a valuable and necessary batit tor overall «ytten character
Thus, the implemented system i« net merely a computer program which accompliehat a
simu'atien of a body of obtarvad human behavior. Tha tyttem further realita« thta
simulation through the embodiment and utilitatien et the functional umt« el the human
procetsor, at propotad from the re«ultt of recent research in cogwtiva psychotegy -
This chapter has provided seme idea et what obtar-ad behavior, Iraneribed dele,
and analytit procedure hat led to the proposed imagery and perceptual system end
theory. The foiiowint chapters ere an eaposition el that promil.
/
.
Ja
Chapter 1.3 ... The >^ge Representation
inn chapter is an eoosl on ol tn» s.^ooic ""Jge reore^er^t'On uied Ml ViPS 10
embotly vsuai intormaton Cnttfta whirn ser.eo to letern.in« the tomi o' the
rep'otent.ti on jre discussed. This is tolioweo o> a descripr on ot the epresen(at>on
rmai.y. t.ow tne miaje representat on appe^'S n Ine memoriei ot tre cognitive
ipe'i eptuaO processor x or.etiy oeiineo
1. Ima^e Representation Cr (enj
Throu^nput tne development or tne proposed image memory representation several
gud ng aes.gn criteria »ere »oo ed Possess on o' Inese entity characteristic ab ilies
Oy ti-e propo-ai were deemed lo oe necessar, 'or an adequate oelmition I'iese
necessary properties are:
J VERaAt DfSOWTION ADEJoACV - The ability to r»»;.« represtntations
whicn not oniy contain tne mtormation necistary to yieid thi complete pictur«
uescr.ptions oota «ed as data n taper m.ents I »nd ii, out a so embody tn,s information
in s/mDOUc »Iruclurei bear ng stra-gnl-torward correspondence to tnose perceptual
unit (te oojects, otner cont tsr ana re ationsnips used n most destr ptions,
1 CWAWING Bfn^VlO» AOLWOAC» ■ The »miity lo rMhM representations which
are '-utt (ient a', a source ot (control* .ntormat'On tor t^e tas» ot 0§mt*§ *rom memory,
and <»",cr. (jn iyt so used in a slrajhl-lor»aro manner to (ied the complete p ctur»
drawing sequences obt» ned as datj n tne eiptrimenls,
.M
M
3 PEBCCPTUAL ACTiv;TV ADtOiJACV - Tne »biWly to Ullm p«rti4i piclur«
reB'ti»"<»t'On »h.cn c*n. N « sl'i'ght-tor«»»ra winiwr, be dynamdlly dn tme)
»^i-e-Iea («<M«d toi 0' *il»'»a, «"fl »he« furthtrmort c»n strvt »» » sourc» 0*
•-'O'm») on <o' ob.ect ■eeog'M.O", JO»l d^ttrnnnation , and ho* (»y») mOv«m«nl
cohl'O t-'Oog^out pr'crptu* behivO'-
4 ICMMnC CHARACTt« - ■'-» ab>l<ty 10 «Hew »or tht co««ittnct of tha
oi\"»tiOn«iiy v-ro-.i !'.fn.p"''j ' ü-O reprtstntatiOhiiiy ipttnl chtrtnonttict of
visu«' 'migery '»"•»•»■O'y) m • 5tr»ight-tO'«J'a i»«rn#r;
B IKTWNOl V,.JA.:"r CHARACTER Th« ikMy to bt «ccotMd by R««n«
b»*' "g 5tr».gh(-tO'w*fd (nomorpn.r) C0"»SP0h0«nC» to Ihjl uS*d 10 KCOtt tll»rn«l
vnus1 info" Jt 0".
6. EXUNSABklTr - Tn« ttiMy to bt «■tt^dco to rttliM r«pr*Mntations o» »I
vnud p»'ceoi o-s o' '0"" m < si'» g-t-'O'wt'O BaMif
Tfn wo^a "5lr»ignt-fO'«»'3" tie ph'Jse V < it'j.git-tofwi'd tnjnitf") hn boon
CO"". 'Jent'y used «oove Tn» »ca (ph'«t) ■& to De jnoe'slooo to me*", "w.th no. or
a m •vmuf" ot, »ootonei process ^g", we'e process ng could be de'>vat<on, ttttu et'On
Of fc-rep'e-.ehlit on
"jet 'Jjct'On o' tnese 0*' gn cMe' > nsures < JUJ*- 'm*ge representjton «rmch is
cons.-.tenl « th the fxege oet n^t on o* Cnjpler I I The lirst three enter i correspond
to tr.e 'mjge'-, de''n,t onji *Dint, to se'v» as guide 'Or usuaiiy related behavior The
♦ourth crteria ret'ects tn» n>c»M» semantic character o* In» vsjai imaje's
.ntormat'on represe^tat'On Sat.i*actiOn ot th.s requ'refhtnr insures adequate
ndeoendence ot n>age content rrom the sequentat course Ot human behavior, yet
a iowt the ,mage to be a participating factor in that behavior
..
40
Th» fifth cnlani it taken di'iclly ''om thit prtviOut ifnag« dafmition. This
requirement represents the mlernel medelity chertcianstic of the visuel image. It
influences both representation structure and Ine processes which access this
structure. The last necessary ability is the result of the specific nature ot the image
representation developed here It is limited to the v sual environmenl ol slraghl line
drawings. The .-fore, the proposal clearly must be readily eitendable to be ol value.
These criteria for design ol tne visual uraga representation reflect the i>ecessary
and functional explanalor/ adeouacy required of the mage as a part of a scentific
theory of perception and imagery Tne rapresenlat.un must be a functional component
ol a system capable of providing mechanistic eipianations of empirical evidence V!PS
employs the image representation in the reproduction (simulation) ol obtained protocol
(behavior) sequences
In the above criteria there is no mention of introspective suggestion or
confirmation as being a necessary characteristic ol the proposed image representetion.
No asoect need be suggested or confirmed by consideration of conscious enpenence
Pylyshyn cautions that:
"What is eveiiebie to conscious inspection may not be what plays Ine important causal roe M psychological process* (Pylyshyn, 1973)
Furthermore, conscious e<perience s not a direct reflection of the content of
attended memory It is rather an internal phenomenon created by the application of
cognitive processes to the content o' atlenaed memory The internal modality criterion
is an indirect acknowledgement of the sensory - like nature of the conscious
eiperience of (visual) imagery
I
41
2. Th» Visual Iniaf* Raprcwntatisn
SYMBOLIC »EPBESLNTAT10N
Th« visual iinag* r«pr«Mnla(ion ot VIPS is symbolic in nature A visual imat» is •
structu. a of mtarralatad symbols Thai information is raprasantad symbolically by th«
human •s not a naw hypelhosis m psychology, as indieattd by th« (oilowmj statamont:
*My hypolhosis is ti«n thai thou(M modals or parallels reality -- that its essential feature is not 'the mind', the sell', 'sense data', nor propositions, but symbolism* (Craik, 1943, p 57)
The hypolhosis thai a visual image consists ol symbols and relelions imphos th«
primacy of the abstract m perception and cu|nilion. Without on enisling symbolic
(abstract) framework for reprasan'etion, there is only and always th« everchanginf
flu«, th« *blOOmm|, buftini contusion* ol William Janws. Cofnition knows «II only in
terms of abstract symbols and relations The pr.macy ol th« abstiact <s>mbolic) is
indicated by Our laiiur« to Imd a physical measure which is directly rdatad to any
domain o* perceptual qualities (symbols) and by the relativity of «II perceptual qualities
which implicitly makes such a linding impossible.
A computer may be described es a symbol processor. As such, it provid«> « means
for testini end evaluatin| the symbolic representation hypothesis. VIPS investijates
the use ol symbol c representation end processing as an e>planalion ler visual imagery
end perception Recent research has shawn th« ellicecy «' symbolic repr«senletion m
th« < - iputer - implemented eiplenelions ol humen b«hevior On tasks involving visual
mlormalion (Baylor, 1972; Naw«li, 1972, Mtrwi, 1973) Moran pr«s«nts an «il«miv«
«2
(urvty o* recent voro .* o 'or t^e »or'" ma coMent o* tre symooiic 'ppreientaton ot
viSudf information
IWAOf CHUNKS
Tne DdsiC unit 0* '.ulH, ^e^rg'u "läge inforn^* 0" »^thin V1P$ t% the fhunn
A visr«! inijige I? an nterre .♦tt'J r;*o .p (Mructwre* o4 ^'age cHünh, A thunn 15 *n
nterre ■ etl group of symbolic nfor•> at on e tments, Acte ^-^ to on» e'er'-ent o* * cnunk
impiei tn» .mmeaate »cces'^olily o' a otne* tonta-ta ce'ent^ and the tnfonxalien
they emD3dv There n conoderaoie e<perimenia: ev.oence »nich s favor^oie to fe
proposal 0* information fhjnK.ng in nyrran memory iV ^r, |fit| Ne«eii and Simon,
197;*) Tran'cr-bed data from tiie thesis e«pfriments provcle direct^ .«(quired,
inferential evidence for the rhun^ng of 'Sua1 ^format.on The relevant data factor ts
the consistent use ny the suoiects of a small .' n,te> set of visual concept t.pes Ealh
ronc?pt type has an associated fa's of symoonc n'ormation structures «h.ch embody
the 'npresentati.e spatial configurations of v.sual features
'his concepl-based chunk ng of v.sua information influences aH of the observed
forms Of visually-related benavior Dur ng perceplua' proctssing, .| influences the
determination of goal« and eipectations, s the unit of MWtl h/potnesei, and
accordingly affects the scann ng Icy« or noiei Of l^e ime draiemg stimulus Ih« use Of
visual concepts as the oas« for partitioning (chunking! the repr^sentalion of the image
information is most directly evident by tfw use m tne verbal recall descriptions and
protocol erbaitatiOns .ne influence eitends to the reproductive drawing behavior
observed, bemg a primary factor m determining the sequence Ot drawing strokes used
by the subiecls. Bartlelt USi7' reports sim.iar resu-ts from a recall and reprodtKtion
task
.
43
'he 'Ole »lieh 'mjge c'njnhi'.g pljy^ in the pe^cepljji procesung n d'sc^t',i.a »nd
.'J'iled i C «ter 14 tpperj < ACo";ept now presenli three groups ot diXt from
^dft 1 ot C'pc fient 1 Tnp'.e nitrate the etfect which 'n*ofmat<on chunking wiln.n
the .'Suai "^age hM upon the observed verbai and drawing reca" bthjvior They also
^st'ate th« use ol visual concep's as tht Bass for n»g» chunking. Two visual
concept t, pes are a so introduced
GrooD 11 ntrr^jces tftf jie o' the oo)ect l/pe ..sual concept (OBJECT chunn).
Both sub.ects use Iht "cross" ano "tnangie" OD,»ct concepts to embody tne visual
pfor'nat.on as shown by trie .eroai descriptions The drawing seouences further
ref'ect the use Of these visual concepts Subser^ences of draw n^ strores correspond
to the partit.oninp/, of tne rrage rhun^s äoth drawn reproductions contain errors,
nowe.er. This ndicates me nan ity J oo,ect t/pe concepts aione to represent a
p cure consisting of se.erai spatially interrelated unteracting) objects
r.rouc 12 »gam illustrates tne usi ot the object type image concfpl Furlnermore,
i 1? P and 12S introduce the u.e of tht line t/pe vsuai image concept (LINE chunk)
''e'.e three eiampes jf Group 17 prjvde more e/dence of chunking's effect upon
fr-e reproductive draw nf bena or Each verbal description reflects a dillerenl
conceptua partitioning of tt» ■■ Su»i information. The diffe'encek are apparent in tne
draw ng beiavo"-., as 5ubsequences of strokes show correspondence to the visual
cone ^ts of the reated jerba description
■Iroup I 3 !iustratef, the importanr pomt that to chunk visuef information according
to an obtecl type concent doe*, not necessarily imply the naming of that object
'■■■'{■• subject has a name for tne object type image concept used to embody th«
. •..i,i information appearing on ether side Ot the center rectengl«. The primary
A4
' ~, in of tu» cnoce o' toncep! t,pe jsed !0 Chun» »ny v su»! information H to
Mtarmina Basic cha-ide' itie» of tf» lymsolic st'jctu^e wfucn is to '»B'esent th»t
ntur-'at on This ope^at o- is mO't *u*^a-"enta tha^ ino! eQwvite*} to' varDaity
'abe ng \nam ngi that . sual ntormstio-i
O'her e»per-nentai data '3i:at» tnrsa o;-e' visua1 concept t«p»s *hlCn a^e used
as chunk l/pes m VIPS to create the v sua' mages of straight -e d'av^ngs, The«e
a'B ;ne verte>, s de, ard face dn conjuncl'O" * I» t--ee-a --ens ona project.on iwagesi
type .ouai concepts Thus, t^e-e »'e live basic icorresponjing) mage chunk types
used m VIPS, these beng VERTEX, C3j£CT, LINE, S'.Di, and ^ACE
IMAGE C-nUNK CHARACTERISTICS
There are tnree c'ai.'.»»s of elements mn^n are 'Ou^d m ewer/ mage chunk of
VIPS. There is one Chunk neane- e.ement, several Image 9ody e'emerts, and one Or
more Position elements Isee f.gure Ulli Each symbolic element is a group of
properties which -nterreiate the e ements thtmMlvM and aiso 'e'ate the element to
the appropriate visually meemngt^ symbois
The Chunk Header element serves to 'na'cate Ine type of visual concept embod ed
by the image chunk. This type s indicated by th« value of the e ement's assc. ateo
TYPE property (see ri|uri III.2). Anotntr «ssoc »'ed property is CR (Current
R»t»r«nce) which serves to reference (eftord access to) one jmege Body element of
fh» chunk'i image «Iructur». Oepei ung upon the chunk type, other propertit» er»
essocieted with th* Chunk Haider element, such is the NAME proparly of en OBJECT
type chunk'i Chunk Header «lament (tea Figure ill 2)
T .. I-i-ag* Body elements era the constituent symbolic elements of th« tamantic
y
44«
Figur« ULI
. JU'd Im9,Tö .;riunl( conjiats ofi
On« CHUNK !:h.AJKR tltBMt
j«veral IKAJE bout altacnta
One or Tora rO.SIIICN eleciant(3)
'.'h» pobbü'le aynbola for each t yp» ir«:
CHUNK HEADEK :• VI, 01, Ll, '4, :'i
IMAGa BOOT :- Xi, Al, I', .■.!, Ql
K)3ITI0K :- Pl
t »I
i
j
U4
V
O
. J
in
0
s o
>
X iu
tj ^ rj < ^ s/
^ ^ ^ ?i ^ S
S ~ \l
o~ ut d r 0; J
it «3 v5 '
(J J
Ui
e!» O
? 2 0 A
^ £: o, -2
T I«
i ^
Figur« MI 2
/s^
^
I J
I', fC
I«
1 J
P
O
.i o
r
0^
c9
5 3:
^ UI
u
w^
5 v >» J
A
1/ J
c \ -
I» «• ^ 0
/» A
.
structur« emboJ'ea ö/ the mag* c^un« This tymbOttC ctfucture is caiied the ".mage
b^dy" of <*n >mage c^unn Ai noted above, »Kh chunk t^pe has a c'.aracteristtc class
0* '■■age bod> structures a&socialtd *''h 't. ^we t^pes of image 3oüy elements are
used wthn Vi^S to red1/c tnese fliffer-ng classes 0t information structures These
typ«» a-e KIT, ANCLE, INTERNAL, END, and QuIOSct Each element t/pe -s
a st'iguished by tne prope'f e^ «wen m^i De assocated *'th it (see Figurt ill 3)
'-eie p'ooert'es ■sete^m^e a d*»e'#nl rp^e for eac^ eemenl type wth'n the image
DOdy in'oTfat 0" Structure
Caen type ü* i^age Soa, eiemen* n^ ooin manaatofy and opvj*-^ propert-e*
ö fo.iateo with t The mandatory p'Opert.es are iptcifted for e^ery gi^en instance of
*riat e^ment type within an ^age body The optional properties are mdnatcd by a
stjr, "•", m F gyre 1113 When fjrtner opt.onai properties are specified for a giv/tn
o'ement instance de'err'.ne^ tne vaue of that ins(an(.e's mandatory TYPE property
For enampie, »n instance of a KIT type tlcmant may have TvPc ^a ue ^tX iunnnoafn
: * f when oni, the manjjtory properf.es are ipec f.ea, or may nave TYPE /alue KEX
(Known EXit) *hen both opt.Ona; properties »VX (»ange Verte« eX.t) and LVX (Link
Vert«»« eXti a'e spec f^ea See appendi« A.LTM'Of tne ewparsion of the mnemonic,
Before further descrbmg tne symboi'C mage Stmetur«! which V!PS creates with
tnese d'f'erent Image ßedy elements, tr-e iast cias'i of -mage chun*. elements, the
Position type e'e^ent, requires detmition. Tr.e e^pprirrpntai results y.e'd anecdota
evidencf for the proposal that the position«, of pcture (viiual) featu'e^ are
remt mr^red n tcrm$ o* an tmprtctte ("fu///') absomte IO*: atonal coordinate »-tale
wh-ch becomes associated with tne por'.on of the visu«! fieid of .nterest (in this casa,
the whole tine draw "g stimu.us). Subjects CO'.: stently use generjhr^d positional
I
rigur« 111 3
y^ LM A A At Ä ^ ^
-^" ■s ■ 3 5 3 - u* •» o M» or ^ 2
! til .-< (J
o 2 C » r 7 O <&
< < ■* o l- t 1- r y ? ri-
#k A A A A ^- /«. A. ^ HMH
V -0 ^ •^ H
i ■1 V
V »/
9
IP
J
■f 1- ■1
r)
J
J
1 -1 -i •
J
0« ^^* 'T A A "^* -%
A-
¥ -• Ä
J Sis < v
■s •*
• « * *
rv y
* O J J
i J
0
J
IJJ a. MM
■ % A A /^ r- A A A ?• £•< i J
4 i J -« -0 k*'.
< * j NI ^ 1 ^ w v/ v/ st 5 5 IP C? Q ' > 7 5 <;
111
T
> •-
.< j
e 3 J
^ /* •* A /* ^ c ^ A A A
•4 ■ O ^ 41
> 1 is 5 v N^ A^ z^*
? -J • * ■ 4 * ^ ^ >
>C o . 1
- i
3 ^ * 1
o 1
J 0-
<v/«>n Oo - «IV-""3 «vit o R. ui* »--m\ni
^ »v> i-^
6
i» Z M J
0 a! 0 ~ »» o
■ I "
(J * t K *
Ul *
% 5 / ?
t * ' 5 "^ • t <v
n ii
/* * <* * 4 >t
■
0-
.
lew m DOtn th* \efb»' clescrp'ons and the protoco e'Dji-zations Tne aD'.'ty 0'
tn» %uDj*ctt to fe»diV ^ypDtr.es/e in« -egfient lintiagM oetween p.ctjre ^ert'tes
p'Oviae*. fu'l^f e.-iStrct Morjn ii973 ^as oeeoped »n ^<*ge ^ep'e^entat o^
wn.tn ooe^ ^ot include ^Dso'ute pof-io".! "•o'^at on ne n**, '.uDsequentiy ngtea an
■■.-■•• '• ■ . ■■,.(.'.- :■.'<-. :•■>■--? ,.^-' o-O' A " t- -t"
' p-. ■ pnratlO',
A •*,. 'on t e- »n| rmooo r ''p "t-/zy" local.en 0* eacn o* Int> Image Boa»
e •"■ 0"*'- wn.cn 't'e^enct .t ü> '"e PNUM f opef!, A Po^.t'On -itm««! ;-as t*o
^"0- A*ed p'ope^t^s. i.SP .e'l - ^ z"* pOiiIoni and JDP (Uo - Down ^o'.'Ton» ^SP
a-o -,^P eac'i *~ave se.^r po ,, D e s.^oc : a ^s 'ne at; -nu^d poM.on of tii# .■ s.a'
* e d s t^ui D'0"-en mro 'o-T^ ■« ne p^ t o^a^ a'eas. as SPO*" ■" ? gu'e UI »l Tne S'2»
eons&tency ©♦ t»e ne dfawxng (.»«u hat enabled tne tenant appitcat'On o* t^e
io:*t Ona- a't?«»? to tr^e r-»**e ict^a abscut« , 'e a'fa« - the -; ■■ •' •* ■• ■♦
* .■1 '■ p'oc ■:*■..•■ • .: j' *. ■ ■ - -r -. i'ea ■ ■. a' • ■ /r- ■ !
'• ■ ■ ■:■. r-:'„■,»: f» V A * ■ , - ' * • t' -c ■■ t * . : ■
.-,,./;-, •. ■. • ,• •■ •»., •■ • ••■, p,^ *.••'.. ,;- ti ■•■ t
. •■ ..■■.-.; ■■'■■•■.. j' V- ■ ■_■■-..- ■■ ■ ' •.■.■•
I P'I ;■• .* • -j. j. t,pi ■■"'• 'r't ■ ("-.■,.■. • on t.pe e »""«n; - ,i al
. ., ■ _. ., ,. . .■.,■■■ . . • ■, o* .■" .•■ "■, '•,- o*■ J ' p*.■ ■ . ',- ■ U- •* ■■ e
-. • , .... :. _ - ■ ■ -. •- , •'.:'■(■ c" *.*-•;••»-■ >♦ t' e
■ • )* a <» ■ ■■ :'^* t-'v .* ■., - ' . •■ ■ •■ • .« • ■ .''
* j ^ i y on< * ' •■ ■ ■ ■ ■> pe'.er". ^ ■.■■* ■,.>- i- ■■:>.; •
■' ■• ,- eni .■• '■ v ■ .-. •ep'r^f'a' " •V'iepv..» '.pi*.f • ■■- * DOü^d * ■•• '
' ■■ .. »e* -a. r :' t DOw"d 'c ' e <*'e* c* ''» i ' • .;."-*";
Reproducfd #(rom ^^M best »viUblt copy.
Vo-.hvüVxcX Kwv.S fiiur* 111 4
ov.0 0V.0
(me RV.O i ov.0 j
ORX
0«
oRX
\.VQ
Q\.0
l
.1,1, Flgura 1115
1 1 ' <—
■•.
I
47
•s * basic factor .n :-ie mtmltmnct of • «tiblt visual »ond m (pit* of thf varying
retinal md'.ations which occuf dunng constructive perceplon
In conjunction with this seven-by-seven 'eference grid 01 spatial povtior areas,
VIPS employs 5i> range or length codes, ^ne^e are, m increasing order i SH (SHorP,
Hi iMEdium), LO (LOngt, LS aong - Short), LM (Long - Medium), or U (Long - Long).
The length o* t ine ■■.eg-'ent (or ho1« rrovement) is determined according to the
numuer of pos tiorji areas traversed ^O' eiampi«, a ime segment between adjacent
areas it of length SH, while one from a comer art< to another comer area is of length
LL (ve'y 'ongl
VES'EX CMU\<
Each chunk type ana its associated ciass 0* image body structures is best
understood by tn« d'scuss jn of a representat v« eKample. As such, an eiample of a
VEWEX chunk is pr#Mntad in figure 111.6 As shown it the bottom of the figure, at
on« level the imag« chunk is Simply t linear ntt of e'emenlt. Th« Chunk Header
element (VI i occurs first .n this unear li»t, facilitating access to the element by »ny
attending process Th« order of the remaining elements at this linear litt level has no
meaningful significance.
Th« imcg« body of a VERTEX chunk consists of an equal number 0) interrelated XIT
and ANCLE typ« elements. Each XIT element repretentt on« line segn-ent «ml
direction of IM verlei (by the value of the DVX property) In Tigure 1116, X?
represent» th« UP enl Each XIT element is interrelated with two ANGLE element-, by
th« values of its associated internal vertei direction properties D1V1 and 01V2 Th«»«
properties have opposite directional values which are perpendicular to th« value of
I
Wa
Z
5 < rf 6 0 0
al »■ » r * * F -* 9
Fipjr« III.6
J I
^ »- o- 2 i- £
a 5
r
..
48
DV* In r.gyre 1116, 0!VI o' X? \% R; and DiV2 of XJ ■ iF Tnese t*o a.fect'On^i
values lhamselvcs become D'opert'es 0» tne XIT e errent, a ; edth 'ete'ence^ an
ANG-E element In Figura Illb. X2 has p'Dperties ^T and LE with RT re'erenong A3
ana LE refe't'K ng A^
An A\CiLE eie^ent e^ood'e1. tr-e v.su»l teatu'-e van^.e1 e^sting --tweer two
»djtctnt, different ai'erTea e* t difectrons o1 a verte» Chapter 1,2 has ipdvatea t^at
the'e are e<gnt dcect'Onai /aiues (symDOis) jsed in ViPS Acco'dngiy, the ANG
rrorerty of ai ''''«GLL ■-'erne"! ca"''a^.e one o* ^e ^e-e" po'.*, 3 e argle .^^bosa- its
vaiui>. Tne^e **'ir;'-' '.f,1t-'ü' ^'e ^CA acute ang^e, RTA- r ght angie, 08A- obtuse
»ng'e, STA .(faßnt (laC degree' ,i"-;e. SäA- stra.gnl acute »ng-e, SWA straight r.ght
\270 degreei angle, a^a SOA- st'a.gnt obtuse a^t; e
■\r> ANGLE e ement has t*o internji ve-te« directions a«.iOt'ated with 't. DIVl and
01V2, which Are inherited frOfn the t*o XIT e'e'oenti" p'Operlies *hich reference it.
This is illustrated m figure 111.6, DIV1 of t2 s RT a^d P< references A3, DIVl o» Kfl
-. Ui* and uP refcrcr.e'. A3 According:/, j;vi of A3 is UP and UP references X2 ;
DIV< o* A3 ■■■ n1' ana -*' re'cences Xfl Fnere s no '.gn,fiance to the cho.ce o*
i-.'.fnr^ert of ('»e t*o intern^ e'te« drpctions to DIV1 and DiV? The convention for
the asstgnfine,,t oM^e "'e* • <* er!e» arectons of an ANGi E e'en ent fac' fates
"lrev»fs»r of t^e image bod/ structure
i^AGE aOOY ACCESS - "PAVlPSA,-
To access t^e symboi'C structure of an image chunk's i^age body, a process must
firr-t gain access to the imnge cnunk as a whee ana then to one e'ement of the image
bod, (the means fo' tht$ are o-.cuS'.ed in Chapler \At The process may then access
I
49
In» contents 0» ine 'wage n03v structu'e Py seujentijlly "I'jvjrsing" .t {(rew tn«
mini »emeiti lm»g» boo> iltmanti »'e tccessea D^ "'»versal o* a.i jce
'Pte'^eiatir,; cope'tie^ 1 ,■ if^age cody «'ewents of a chunn are immediately
accessible IchunK aptntion) DLJ not accessed in parallel An irrage body element is
'..iid lo DO "tracer jed" ^nen it .'. o accessed n, tne actwe process
VV tn reference to tne V'^TX ch^nn, a process may traverse the structure trom
one O e'e^-ent to a^otner », us-r,; •■ •? same ^nterreiat^ß direcliO^ai property t^tce
In Figur» I'.lfc. RT ot «2 s ^3 ana RT o' A3 is X4 or »quivtlfnlly iBT o* (RT ot X2)) is
<-i '.ote tnat a VES'tN tn^nk s compete> tra.ersat e m t«o seqjeni ai courses
l»itn«r X2 to A3 ;o « i to A5 to X2 or X2 to Ab to X4 to A3 to X2i As such, Ih»
ttructur» s a semantra , aetj'mined. oouS.-in^ea (douoiydrected) circular list.
Tns typ» of st'uctur» will «ere oe caiied a dO-b y-dire:iea rng ot elements
Th» nage oody slfoctur» ot tre VERTEX cn^n« rep'esenls th» v.sual feature
.onf ?ura' o" at one spat a. 'Ocat on Tnus. tnere s oni» one Pos.t,on type t ement in
tne VERTEX type cnun^ facn «^age ooa» t.en-en: refe'ences tnat element by its
asso'ialed p'(üV property not ..nown n f.gure [US) A Pos tion element (liters from
a" ' ^age body eeme^t in tnat it s not la'ong witn tne Chunk Header e'empnt) a
Ira '■".aoie eiement o' 'no "a^.e struct i'e of the cnun» A Posit on element it
ndrectly access be t'oni any 'mage oody eement *hicn references it oy In»
manadatory P'.„^ propert»
09JtCT CHor*<
An OBJEC type image Chun« I schematically illustrated by Figur» 111.7 . Th»
image uody of «n OBJECI cnun» n aga n a doubly direcled ring of elements. This
!
.
,9*
Fl|ur. III. 7
I It«
H
c4
i
e
H
H
,
60
tine tu» |i«m«ntt if» of types INTERNAL and ANCLE. Tha cemmen cenfi|ur«tiOn (non
hwrarcWctl sub-structu'*) o) - aj» body «lomcntt which it ut»d n th» buildin|
block o< tha OBJECT chunk't ima|a body it tha *cori-«f' conlnurat.on. Tha lowor loft
'corner' of ti-t Fif-'a III 7, it shown m datail by Figur» III 8 Thu confifuration
roprestnts an ob;act comar, but a corn«r it not an •>phcit, hierarchical tub-
compenent o' l^e OBJECT c»unk ITJI» body ttructur».
The corner conffurafon i "r'i sgmficanlly from th« mage body Of a VERTEX
churk detcribea »sove T>-e angle ei'e' - to th« oh «ct't corner it not included in
the Mrnar'i 'rprttentaton An INTERNAL elantent he* only one internal direction
P'OpsMy (OIVII A process travartmg tha OBJECT cnui kt .mage boo/ ttructura can
not ' ■-« outtida or around the cornar* wlhoul accessing ei liner image chunk. Thit
charactenttic of tha mage representation of an object ceutet a eieda of vnual image
eccestmg which providat e bast for tha eipananca of figure - ground phanonwn»
(Ko"kj, 19361
fach corner configuration reprs. >II vitual features et one tpatai location Thua,
an ob.ect chunk hat at many ,--• ■ jn alemanlt at it nt« cornar coi guraliOns in itt
image body structure (see Figure 111.7) Tha ANGLE eien-ent mhantt the value of its
mtarnel traversal directiont (OIVI and DIV2) from the INTERNAL atemanls of a corner
m the tame manner at from the KIT elementt of a VERTEX chunk.
Two interrelated INTERNAL eiemantk span tha «patiei teparaton of two adiacanl
object 'cornart* and at tuch are repretanlativa of an obiect "tide' (which alto it not
en aipicil image component) In Figure 1117, It refarancat 119 by ill LIX property
Tr>a direction (OIX Of It) i« down (00) and the range or length (RIX Of I«» it 'ong (LO)
Invartaly, US referancat It by iti LK (link Internal eXit property, with OK (Direction
Intamal aXit) bam« UP and R« (Ra<«e Inlemei exit) being LO.
Figure III 8
"toRUU" UH? \^>nklVT\»fk ^£1 IS\^\
X*t x.
TH»fc lt»T
Owl «.t
RT ^3 Ov». VJP
R\* to \.»> tb
il t-
51
're so-vO'D^'C »e Jl o-?tiip ot a p'ocesi's I'aversji ot iwjge BOfl/ e em»"!« to lh»
oce'iit 0" of »«>'"a «KIMI sc«"'1'; aifl ^tormjt.o" jcce«in( (criltnoi »51 Become»
cur *ith the intraä;clon ol the .^J.'ECT cnunn The conterH o' »n ooject'* imege
'eo'u'.entatton a^e accessed by the sequential tfavers»! ot the i^age body element* in
a manner which is se^an»^rfi.^ eajivaient to the ot'.erved no'e movement behavior
The image reprcentat on and this operdt.onat reiationth^ ate straight 'o'*a'ö ^
extendable 'a acccmodetf "orma1 eye mo.ement behavor (Chapter lb)
i üMhermore. this traversal ot tt* image booy structures sho*s a ciose oeha.iorai
real ohship to the ..cliyity n/o .eO m Ih» generation ot dra«n reproductions Th«
-on-h»rarch cai njtjre of earn .mage body representation »nj Hit spat ai m«»n.ng o'
the ihterrei itionai propert-es ot the element', ar« two basic 'epresentation
charactt'olici whch mane possible I i straight-lo'waro apo'caton ol th s
Denavora:iy somorphic trave-sai operation lor image accessing The delinilion ol
s,mboiiC e'e^ents as property groupc a'so lac itates traversal »hi, signilicanlly ellecls
System operat on by eiimmat ng mean.ng frpm chunik Surl8<e structure (order ol
•••manU),
Llf.E CHUNK
A ^ir.E type ch mk .s illustrated by Figura 1119 II is aga^n a doubly diieded ring
Ol image body elements (a orcuar list structure) The L1N£ structure aiso introduces
t^e use o* the END and QUlOSEE type» ol Image Body e'ements Fht booy ol a LINE
type chjnK includes 'wo END type e-ements fach ENO element relertnces an
assropnate POSITION eemenl which serves to spat ally locale that nne end. Each END
piomont nas an associated property arhtch ser«es to ink that line end to the visual
■
■
Mrit cVovO^
Figur« III 9
UIL ?i ** pn
out jy oo
1»* X
Xj: **.
:/
— ~r~zT-i x^-j ,*
'>9l i «
Tips (^«.«see
t*o^ one M
u^ ?a ti ?w\
» x^ -> t«-
b2
co"!»«! embod ed »i anotfief ""jje :ijn» 'h» TYPE p'Opcrl/j value v»'.«s with lhal
e«:e"n«i cont««!.
E«ci END eem»-; ha? 'wo •nte'"»! t-a. -si a'ect:Ons »socaled wth it »LSI and
. S^ li 0* ^g travefijt o* each "Vde" ot the une Each i.If4E vhunk "side" «mpio^s
'ntg're a'«d INIEBNAt. ».p» tltmcnti to span tp«ti*l locations as in the OBJECT type
chuh». At app'opriate locat'Ohs, /e'ie«-hke :0hti|u'«t.ors trt rep'esehted by either
b/ i'e'-eated KIT »nd ANGLF a^d INTE9NA. eetientt (as ihoain in Figure ULI (a) )
or by « tmgw QuICKSEE type •lenient, as snowh m F gjre IIH (6). A QuICKSEE
e e-'-ent Ohly part ally represerts In» vertea irtormation ensitmg on that lina "sde" 11
on'/ e^oodies the number o* verte« ents ieav ng tne ^e ot f-at location ifrom that
side I. A QjlOSEE e ement doei reference a petition e ement -iy its associate:) P\JM
O'opert^. Two tra/ersai a rert'Cs are also assoc aled vnJl and TD2), which are
inherited from its neighbor ng IMERNAt, elements
"he QüIC<SEE element s ntroduced to recesent the incomplete information
aca 'ed b/ a suoiecl in tne race that tne hole is movea through a verte» on a line
without stopp ng This mcompietness 0( visu«: feature represenla' on a so typ lie»
(jer.pheral vis on input mformaton As such, an entension (generalization! ot the
QUICKSEE e.ement is later proposed as a means of symbolically representing such
ppriphera / accessed visual information'.C-apter ;bi
1U1NF
*hv iLIf^E chunK is an Incomplete LINE type chunk which m»/ occur as p»'t ot •
part ai visual imege enuting at some i^'ermeda!» ponf of t"» v sual pe'cep'ion
A cnunh of this t /pe is never )art ot the tmalized visual »mage (perfep*iOn)
■ ■-
tAZ XWIH« <-Vo»JU F'fur« 111.10
__L
^
t K|A 1
±^ 4««. ^w» «^
^
_x AJ:
—^—■%
"t^Tt VlHE
whici s the re^u'l 0' th»t p»fceptuil Rtnnty Ai such, it m not on» o( tti» live DiS'C
cnunk types «s • >a Mriitr, but it is used by VIPS l> i'^ompiish perception.
Figure II! 10(41 presents l" .stril'On at jn iL. J£ '. ) ctlunK. This chunk t/pe
wakes a dptir^te spec tu- use ot the C^ property o* its Chunk Header ee^ent CW
nd'tates the MTCRNAL ee^fnt when is to be inked to elements representing the
•nm^nent visua "to'^ation during it' ncorpo'at-on into and the compietion ot the
ma^o ooay (o* the line». Figure 11! lOtb) i ostrates Ine addition ot turtner lOtormat.or
mpletinf the line and cnang.rg »he iLi*«t chunk to a LINE chunk Note that the
.er'-r» Mke configurat on .s part ot tne resultant iVJi tfpe ti>unk
'ne CP prppe'ty ot tne Cnun» Header eifi-ent is ttmitAriiy used t>f the ^isua<
perception p'oce-s m tr-e tonstrudon ot CSÄCf t,pe chunks. Incomplete OBJEC'
chunks are not made "to su.-n a soe; a "aje l,pe -es lOBJECTI though, as tne object
mcoi-p eteness s always e-bodea «>tlun l"e ait .e pe'cent-ai goal A- ILINE chunk
may occur m con.unct on win goa'S wh.cn oo rot specit ca'iy note ts ei'Stence
SiOt CHUNK
A S10E t,pe chunk is j-.ej 'occurs* oni, n con „ret.on w Ih an associated OBJECT
or FACE thunK. I"e reiation'.iup is jstraleo n the sehen ate sketcn ot Figure III il
"•■' ' ,-e ntroduces a 'ew picton*! repre.e^tat on convention Each image 0od(
e en-ent n only 5pe;'t ea u^ one ol tiv» le'ters ndica' ng its type il INTERNAL, X-EXT,
" "■. . I, E END, . "jUICicSEEi Inis abb'evulea octonai 'epre-enlation is used
t^ro ignont the rest o' tne thesis The "usual" mtrachunk I nks (those de' ned
previOusl/i »re impi.ed to e>'.t On;/ links between image chunks a.-e nflcatea (by
the .irrows» No Posi'Oh e!eTents are r,eluded in these d'iwn rep'esentatons e ther
Figure HI 11
SI
Mli x'
/
54
In« END titmantt, when u%ed m • SIDE chunk iixa|* body, «Kh hav« only on«
intrKhunfe linn aviiljbi* lor tr«vers*i (LSI) Thus, • SIDE chunk tllowt Utwui over
only or* '(ids* of th« hne-itka m»g» «tructurt it rtprtMntt. At with LINE chunks, •
QUICKSEE •lamtni may occur in a SIDE chunk to partially rapratant an ncludad
(attmiiatad) vet« It <t th« only .'»g« bojy ttructura which it not a doubly-dir«ct«d
litt ('ing) ot e en-fits Th« olri«r 'tid«' (of th« ob|«ct't tid«) it travt'tabl« Only within
th« * «ted OBJECT chunk. Th« SIDE miy f«pr«t«nl vitual nformation to th« outtid«
0* th« object at thown by Figur« ül ■ I Or it may r«pr«tanl inlormation occu'r.ng
with n th« ob|«ct CPMOur (at thown by F.|ur« 111.19) Onl/ a rapratantalion 0» th«
ob^ct contour it m an OSJECT chunk. An, contoitual mtaraction with «n obi«ct 't d«"
it r*pr*t«nt«d in a SIDE chunk.
PACE CWJNK
Th« FACE lyp« ir a|« chuiK hat >mat« chunk characlanttict «quivalant to Xhm ut«
Of «n OBJECT chunk Ch«pt«r 15 (on aatpntiont lo tt-e <mpl«r>«nt«d VIPS) tlaUt that •
Ihree-a--- .'Onji pr0|«clicn ol a pntm-lyp« obi«ct it vitually percaived as contittmg
ol a "prim» tac«* and a«ro or more related *t«condary* )ac«t Thit prim« l«t« it
'epret«nt«d by an OBJECT tyr« chunk, with t>-« DIM (d>m«nti0n) pro, erty of th*
Chunk Header specified at THREE. All tecondar/ facet inclu4«d >n th« mage «r«
repretented m r«let«d FACE chunks Th« Chunk Header element ol e FACE chunk do«t
not have a NAME prop«rty assoc ated with it. Th« name ol a thr««-dim«nvon«l ob|«cf
it determined by th« n«m« ol th« prim« IK« chunk. Figur* 111.12 iHuttr*l«t th« uM 0*
FACE typ« chunkt m th« cont«it ol a cubic mag«
Th« Chunk H«ad«r «lamanl ol a FACE chunk end el I thrM-dimcnaion OBJECT
!
I
i
■>
I ..
3
a» i
Figur« 111 12
I
99
cnu^n h« two tpec t «»socaled orop^r^e», BDI" »ifl FD1C fD!R »ptcifw» Iht titi»!
e»1e-von d'tc'o" ot l-e pf •J">»lic p-c/'-tor. »nd BDI" tptcit'«i Ih» deplh
fl 'jctioilst «"Oc at»d win tn» ob;»cf>, p»'c«pl 0" TD1B M4 BDW »'• tn» »»m«,
««cept *•?'' FOR M do«" t»« Oap'e' 15). If« until DOS/ of * FACE cnunk it
•Jf j gut - (Of*»'*/ gtr«',itea •'0* • sp»c •■c»l M 0* fDW »"0 tn« ontntil.or ol Iht
''»>» '.eg**'«* 'ot th« prime t>te) tro*« Kfh»fh -t eitends
''e'teoH^i/ -'etttd deptn '»utiOM ttfing * Ih Ih«^ < It r d dimension to- >oc*t.on
tpo*. ' C^J vpecittcation Aj luch, 'ete'^nced Position l^pt element', jre modited by
the «dd'tion ot Ihr»» rew p'Ope-te'. P.W, PoDP, PrBP (Perceived Front Ba-n
Pos tion' PIBP »nd PuOP a'.s.ime vjiue-. ttom tne ume ciisi as LPP »nd UOP S »'
to tr e bind'n^ ot a seven-byseven ! *o a rntns ona' grd to \^9 visua1 *"t;d ot .nte-est,
tne pcteptj»1 process D nds a sevt» .a'ued oepm s:ae to tn» vnual deld tr^O (Fronl
■ ,.<r. F5H, 0»1, BV» (Bac«. SHort), BME. BLO) These symbol constitute th» das«
ne .aues to' PFBP Th« adwition oi tn» tnre» n»w positon iji»m»nl
prppe'' es ~eans tnat a (rOuD J* • lutl t»»ljr»s ot • p ctu'» et v»rt»>/ is p*rc»iv»d
", ■ • A' two interrelated iocat ons On» location <\ in ttrrr» ol th» p clur» plan» (LRP
ar-n i.DP) a-d on« it in lermt ol tn« per;eptu»liy-cr«at»d thr»e-diin»ntionai spac»
(P.P^. PUDP, PrBP).
'he bnd'i; ol this depth teal» adds th» tri.ra oimens'Onal ant to th» d m»nsion»l
6'd del.ned b, the LRP and I.'OP binding Th« resultant pro,eclionai p'an« Upac«)
dillers tro-n the usual (mathematiraiiy d«l ned) one n Inal the 0"jin ot the depth »mt
need not come de «m in» two . ■;-. c-i T ir r 5, 'e III 13 n1../rates Ihit idea,
the depln origin being bound to tne UJH üSH) p'anar location. Th« bacn dir«cl,on
'BOWi ol Inat axs in Figur« ULI] >s up - nght (URi. Tn.t . ■nction pla/t « special 'Ol«
, '
•. Figur« III
ruo
• T>WO
Figur» III 14
'7
.
to
in th» .— • rp-.., js'.ign-rent o» locitiom 1P1.RP, PJDP. PFBP) Om/ line segments ,n
lh« wm# orientation *s f»1» oe^'•, a«i$ (UR - Dt) m»y mot an >'») o» issigned aept'i
n-ean-n^ and aicofflmg!/ a'tect pe" ■■ . J cication This necessarily adds a diinension
o' pi"-'eplual amb'g^ty (duauty) to tn» p^clu'e p-ar-e
gjr» 111.1^ iil^ifates ^"at 'Ot all hrt segments .n tne depln a> s orentition are
nognc^ depth trtaning |. re segment "a" s pound to tne pri-n» ifapeiO'dall face,
wnich it percrved ■ be pa'ai ci to tne P'Ctj't pane F gure ULIB illustrates tne
Otd onal amBiguity o* Hn pe'ceplua' pro.ectiona p'ane 3ta't at pont "o" Mo^mg to
pomt "A* on line segment a (as part ot the cuBe' H pt eptually interpreted as a
movement m depth (bacO Wovmg l-o-n "o" to pomt "A" on side b Inen en s.da c las
part of tne triang e s a mo/ement on tne picture pane S^D,ects did per t.^e this
p.cture as nterreiated cube and ■' ange (see ' gjre 111.16 >■ '<■*■■ descriptions and
drawing behavior mdttate a duality of locationai specification (PLPP, PUCP, PfWf and
L«P, LlOP).
Anecdotal e«p»r menta" results led to and HUM support these proposed sroperty
aad'tions and the-r Mean.ng Thret dimensional <ocal on specifications were used d.e
oacn there", "in front of tnat") KVnen traversing mes M the BDIR diretton, subjects
often would s*/ "gomg bacn" or "now bee» nert" Yet. perceptual nferences were
made wl eh indicated t ^e manlenance of the picture plane location features ■
conj jnci'On with the three-dimensional features used in tne protocols verbalitatiors.
Ai«o, the rbal descrip: sns emplci^ed three-dimensional terms white the drawing
behavior ndtcated picture plane positional knowledge Several picture perceptions
n'erspersed three and two dimensional no »t's, aga'n mterreletng two and three
dimensional picture features (see T gure IV15) Chapter 1.5 discusMt three
uimens<onal picture perception and relevant protocols
/ I
St..
1.12.S
vrua: i sec.
Figure ill 15
Ficur« III 16
okay
now there's a uli
It looH
basically tV shape of a
p.irallclo
rectanj-.u.ilr parallclpiped except In
down In the lower rif.ht hand corner
an e- Ira
an CKira tttaacl« has been
has been drawn on
I.I2.C
VTIMtv
>:'< • rectangle In perspective and the botto
of
bottom part on the rjRht
Is made Into a trlanglr
I ,J ^—.
..
b?
INTERCHUW R£LAT10NSHIF»S
A visu»! 'mage (in V1PS) i »n inltrr»l»ltd group (itructurt) Ol im«t» chunK». T1 *
chunK types have been delied It remains to specify Ih« inttmUting property
connections wHich are used to tie th» chunks together as - omplet» visual image
Two oavc types ot imKs are used, equivalency links and spa^ 'raversing links. These
links meamnglu"/ interrelate two irnage L:ay elements, 0'.e in each ot t*0 image
chunks kS
Two varieties 0* equivalency Imks have ueen introduced Ithcugh not discussed) in
the de' - I orv, at SIDE) and TACL chunks aoove figure 111.11 illustrates how an
INTERNAL element of an OBJECT chunk may be equvalent'y linked to an END element
ot a SIDE chunk. Figure HU1 illustrates the use ol equivalency links between
INTEBNALS Ol dillermg chunks ol three •dimensional ob.ecl image. These links serve to
"strap" Ih* image together
Kquivaiency linM serve to relate two image oody elements ol dillerent chjnks that
represent tne same physical picture component This one physical (eidernal) visual
component II represented as oeng part ot two dillerent image concepts (chunks) The
links ol III 12 nnk INTERNALS which represent one line segment that is shared by two
facial images (EFL - Equivalent Facial Link). Figure 11117 illustrates similar Imka (Imks a
and b) between obiecl imafcs which share a common picture line (EOL - Equivalent
OBJtCt Link).
Another visual (picture) feature which may be represented within two imaje
chunks is the angle lealure. Equivalent ANGLE elements ot two chunks may be linked
by a pair ol associated, inversely specilied (directed) EAL (Equivalent Angle Link)
/
')6a Fl|ur« III.II
'
/
. -'
'Kb
Flpjr* ULI!
/
■ 7« Figur« 111 17
■..
•.'
properties. F.gur» 111 IS illustrittt the UM ot this mterchunh relttion. An ANGLE
element of • VERTEX ctunk it linked to one m an OBJECT chunk n » me»n« of
representing the context «I an obiect 'corner*.
The two INTERNAL elements of en OBJECT chunk 'corner* configuritien may be
equivaiently linked to two XIT elements of a related VERTEX chunk. This occurs in the
case of an object being perceived as containing a line (inside the contour) eriguiating
at that object corner, figure 11119 illustrates the use of these links (links a and b).
This f gure illustrates the use of a SIDE chunk to represent the 'inside' edge of an
object's side. This figure also illustrates the equivalency link (linns c and d) which is
used between an XIT element and an END (of a LINE type chunk) element. The
evte'nal Ml of an END element of a LINE chunk is an equivalency link
The other type of mter-chunk links are space-trivarsmg in meaning These links
occur between two XIT elements of differing LINE, SIDE, or VERTEX chunks. Figure
III 20 illustrates the use of these links (V) between a LINE af several VERTEX
chunks. The three properties OVX (Direction of Vertei eXil), LVX (Link of Verte« eXit),
and RVX (Range of Verte» eXitl serve to specify these links.
EQUIVALENCY AND REDUNDANCY
The use of equivalency links to mlerrriate image chunks introduces a necessary
degree of redundancy into thu visual image representation This redundancy is a
fundamental aspect of the semantic nature of the visual image A line segment
between two objects is meenmgfully part of both image concepts Figure - ground
phenomenon considerations reqmre thai this pert be included m each of the two image
chunks. Similarly, angles ere seen es part of en object end a* perl of e comple«
M
it, Figure III 20
1^ t
/
Vi
-e'te« where several object corners may meet The use Of equivalency l<nKs are an
enentia' factor m the reai la. on of '"put miWiHtmi * compiei v^rte« is readily
«SS-M'ated as ODiect enviro-" . ' :onte»t) Ourmg parccptja. proce.smg Tnese
equ'alenc/ links <■ so proviOe Hit necessary means of .mage traversal (pass.ng)
bttWNM chunks (concept«). Tint trivtrtal a ows the oeiav.O' necttstry to »pia'n
the perceptual (veroel) descnptiO- and drawing activitie«.
iMAGt t*tPKt»d.«iAriON rLEXIBI.rv
To satisfy the design criteria 1, 2, and 3, a most necessary characteristic was
fleiioiiity of ir.age representation. Vlenibilit/ of image representation* means that
one single line dram ng must be representabie in more than one way, reflecting the
diversity of sul t behaviors and resultml paneptont observed with regards to a
single line drawing
Th« fgures 111.17 • 111.20 illustrate tne fien.bility ol the proposed image
ropresentelion. Figures Hit7(a) • 111.20(a) exemplify the general ctess it verbal
description which is associated with each respective image repre »ntation of that on«
line drawing.
The redundancy end tle>ib<lity of the meg' '«p-esentation, the non-hierarchical
nature of the image body structures, and the .pati-i end equivalency meaning of the
element interrelations are the mam design feeture;. which allow adequate satisfaction
of the design criteria specified. The propo-ai of th.. venous image body i
their associated interrelationships yield these representation capabilities
h .. U
59«
Flpjr» III. 1 TW
Thero Is n snuHrc next to a trlanel«
tho square is to the loft of the trianrle
1
Fi|ur«III.18W
Ther^ is '■ jinuire which nrot^ i trianglt to th« rir't neotir;, ^l :.Y.e top anl bottom cornorü of th^t ait*
Fifur* 111.19(a)
i'hora is <i trapozoid which haj J line from its obtuse corner to Lh; tiotton
Fi|ur« 111.20(a)
There is a ri]-,ht an-;le in tho lower l«ft abov« that in another riiht nnilo then tu tl o rirht is a throe-exit vertex lines ^o iown anl lown-rinht fron there to hit tha botton
^.
^ •l
3. The Im.ge m VIPS
Chapttr 1.4 will discuss how th« visual im*|« Mrvtt to guidt th» pjrcaptual
bahavior of VIPS as chunks STM, and how, as t»ch STM chunk it visually conlirmod and
m«anm|(ully >nte|rat*d into th« mag», the«« chunks art transtarrod to ITM. 1TM it
th« residence of the complete »malted visual imai« (perception) resulting from th«
activity of VIPS.
TH« image chunKs ol STM are interrelated by equivalency and space trav«rting
inns, as discussed above When these chunks are incorporated into ITM further
relational links are added. These new Imks are between the Chunk Header elements of
related image chunks. Th« incorporation of image chunks is sequential at indicated.
The Order of object image chunk incorporation is represented eiplidlly by the placing
Of a (NCKT-OM relational property on the currently last ITM obiect wwch is set to
reference the new object image chunk upon its incorporation Furthermore, an object
image is >ncorparated together with its immediate en, ronntent as determined b. the
«msting equivalency h *■* of its image body elements. A prope-ty (ENV) is added ts in
object's Chunk Header dunng incorporation. This prope't/ has as value a list of thoia
image body elements which have an inter-chunk equivalency lirk. These elements
th«ms«;/es become properties of the object's Chunk Header. Each has as value th«
Chjnk Header of the image chunk which contains th« image body «lament to which it it
linked by equ .aiency.
One perceptual strategy (see Chapter 111) ir,.olv«t the perception of the picture
Outline. As chunks representing parts of this outline are ncorporated environmental
links are added between Chunk Headers. These involve the use Of the ENV property
, ^»■w •
61
^
•nd In» imtga body properties «s w<th ooj«! incorporation but tns inter-chunk linkt
in thit c«se may be space-traversng alto
Figur* 21(a), (b), c) and ' ju-e ??(»), (b), (cl IHusirat* two image representations
produced by VIPJ during the eiplanation c' !»• proUco -> upon the same line drawing
The component (a) of each figure presents the subject's verbel description
Component (b) pretentt the image's piclor ai representation as shown ■ »'o-o
Component (c> presents the ■'■..-■>. Header st'ucture produced by chunk incorporation
into ITM. The doubly directed kMfei are environmenta1 ;>nRt The uni-directionai dotted
links ere the NEXT-03 Imki mentioned above. The figure also indicates the order that
the visual concepts (cr\i^> ■ ol the image are noted in the subje't's description.
The fle«ibiiity ol tne representation is again illustrated by these two enamples.
Furthermore, tr« use of botn the equivalency and spatial links between im>we bodies
and the relational imks between Chunk Heaoei-s appears to be basic to an enplanation
of tr-e verbal and drawing descriptive behavior
Figure 21(c) includes a -e-oj ealion by VIPS which it based upon NEXT-OB link
traversal only. Figure 21(a) shows that these ab,ect concepts occur in the same order
(by d), (n), (m) and dv)) Section A of Ih» ve'baliiation is derivable from the Chunk
Header (environmental) links Section 9 indicates image body traversal ol the
recl.mgie (0184) image and at the equivalency link oetween that image and that of
S10; Section C again is de' /able solely from the environmental link» of the Chtnk
Header.
Tne verbaii»ation of Figure 2?(a) »npioys tn» wage body Imk« to a greater
degree. The first section (A) is derivable from Chunk Header links All of the rest (B)
of that verbal description it the verbalmtion of a traversal of the image chunks
according to the mter-chunk image body links jommg tnem.
;
6:
Tbe OunK Header re <l<ons in ITM add a dimension at hierarchy to the "aje
■-epresantation beyond that impi.ed By the chunking ot the visual information The tinal
form nt the visual image in VIPS (the perception found in ITM) is « helerarcttical
symDOi structure.
rijur. 111.21U
okay un I have a three-sidoi trianKlo (1) which Intersects a square on the right (ii) there IJ a rect3;'.';,le (iii) on to; of the square on the ri^ht un thlj roctaniUe un has OH«* side that is the sane slle as the square that's on the loft of the square anl then the rectanr.lc goes to the Fight anl cones down und Intersects the square urn on top of the square and then conin« off this rectangle is a four-sided object (lv) which p'jlls the whole drawing together the fuur-sided figure has aides on the rectangle the triangle and the square
^
'..'a
Figur* 111.21(b)
X
065
z A
Mas
y I
«b FIfMllLllW
tl
H n
i e 1 «
« M-i O
«Isf OU.O
•» Slfc MS « < <
ill!
I I c
i r.
-•
15 J 8.
1 1- * * t
^
^ * -
•Oc
Fi|ur« 111.22(a)
okay tho wholo thinr: wo have uh wo hivo i trlanglt in the lower left hand corner ar.i we II.T/O a vortie.-il coming up to that and it i.its a horizontal over there on tho top in 1 (pauao a verticil (;oes down -u the right a vortical i-oas down and it hitj a horizontal you «ro over to the right and there ia a right angla you nov« down to tho ie:'t there's a ripht you Mva town there's a right anglo ani there ia a bottom
I ^ >
^
bid
Figur* 111.22(b)
X X
, —*J A—**
>
63e Flfura 11122(0
*r***i*i
0
5
1 0 «
1
SK
Chiplar L4 TN» Form »nd Activity of Vlf>S
^
Th« purpose of Ihn chapter i> two-told It tir;' prttentt I tp«cific*t">n of th*
memories and processes which are coordinated participant« in visual perceplni. It
then illutlates these components m «lion by presenting an eiample segment ei a
trace of VIPS activity The image representation it also demonstrated it a guide lor
this activity
1. System O «rviow
T
T
5 «•
5 5
I i
Throughout the development ol VIPS the proliferation et memories and processes
was accepted, indeed considered valuable, when such proliferation enpedited system
design, function, and description This proliferation was tempered by the requirement
that favorable eipenmental indications for any memory proposal emst. At a result, the
p-opoted system it composed of tia memories and four processes, named at folows:
Memories:
1. Picture (PIC) (an eaternal memory) 2. Visual Register (VR) 3. Short Term Memory (STM) 4. Long Term Memory (LTM) 5. Recognition Long Term Memory (RLTM) (long term memory components) 6. Intermediate Term Memory (ITM)
Processes:
1. Assimilation - Accomodation process (AA-SV$) 2. Visual Input process (VI-SYS) 3. Recognition process (REC-SYS) 4. Incorporation process (!NC-SYS)
>
: ■*.
S4
TM£ MEMOniES
Th« mcmonet of VIPS diltff in «tveril pnmi'y ch»r<ct»ri»tic». whic" •■ -v» to
di$tirgui«h »nd at1'*» ttch ^e^O'y. Tn«:» chjrjcttr.sucs «r«:
1. the a&soC'ated ovi"ai> (s^D'a-e'emental) information structure; ? the internal character:st-cs and structure of the contained
memory elements, 3 the variabi:>ty im If we Q' adOition o' alteration of, and
■ oss of contained eir^enls) tnrougn the performance Of a perceptual task;
•V the «Mowed means of informalon accessing, b the «ssocated processes (those which can access the memory,
and now each can effect the "»mory).
The memories are not separata storage compartment', of the cognitive processor
though computer mpiementaton fosters trvs interpretation. Each active m»mO'y »
defined by the functional rpi« which its content» piay in the perceptual activity
undertaken by the system A symooi ..• symooi structure may be said to b« m one of
the active memone! (STM ^r a ceil ot Vf) when it plays the associated processing rol«.
I gure IV 1 indicates Ihe accessibit, relationships between the constitutnl
memories and processes ot V!P$ An arrow trom a memory to a process indicates that
the process can access n'c-a'on trom that memo'/ by that memory's associated
accossmg mean« An arrow '•(■•• a process to • memory indicates that tne process can
alter that memory by •ntcnrf new tlemen i or changing ••itling o-»s (Not* that LTM
is not shown, its elements p*rm«at ng iDemg) a>l memories and proctsset)
Figur» 1V.2 shows th» poss - • «tor-memory transfers Ot mformilion within the
I
I
■I -
Fifur« IV. 1
> Ü
Figur« IV?
*! 11\ « H fi a; 515: 7
1 i {
/ 1
65
tyttam. Each irrew it l»b«iltd w.th tht p'octi« cipabl* ot parlormini Ih« indicitad,
di'tcted mfcflition transltr This ligura mdicalat tha How o< viiual intermatien
with n vi?S It i> radundant with F,gura IV.l but amphMint a diHaranl tyttam atpact
1. PIC (PlCtura)
PIC n an aitarn«! memor/ (Nawall «'id Simon, 1972) and Ih« jourca of visual input
mtormation m VIPf Due to ;ne nature ot pauaptuai procatsmj. whith V1PS medals,
tha &ystam must raprasant botn subjact and anvironmanl in ordar to anplam th»
bahavior. *s such, PIC it Inat part ot ViPS which rapratantt tha anvironmant.
Elsawhara I hava dafmad par'aption to ba tn« active process by which an
organism interprets the slates 0' a subset ot its calls (Farlay, 1971) Given suKicenl
organism complenty, thata ceils are tubtats ot an organism's nervous tyttam, baing
called sensory receptors. Tha significant feature ot sensory receptor cells it thair
direct, or altactiva, link with tha organitm's surface Thit laatura Itadt tha organism
to believe that tha sensory receptor ttatat indicate conditions el • surrounding,
impinging anvironmant That this baliat it reality or illusion appears phanomanally
mdeterminanl.
In tna human organism. In« receptor cell slates which are interpreted during
visual perception are those ot the rod and cone cells el Ih« eye at organired 'o
"receptive teids* at the ratma (Laibovic, 19721 These cells (stales) form the v' jai
envonmenl Thit it the environment rapratenled by PIC. Tint it the moat calarnal
that any memory can be said to be It it the environment in term Ot tentory rather
than phytical qualities
Since involvement with actual camera mput waa to ba avoided at necessarily
.. .-
M
poking «dd't'Onj. p-sbiems jj\' ie t^e rf ^ m o* l^e tfie-. s . a" ite^n^di*!» ot» '.pt .e
'•P'»»»f>t*t or o' tr>» pictu-e wai "««ate Hn 'ipfese'tat.or cnos-" tp' th.i
oesc- p' o ■ w • M c' vfte» deiciptici, »«•> .e'lei aes;- p! on De-rg » "»*? sst o'
verle« 'eatjres This vu e* 'ep'esenlaton ha» me cna'acle* stc o< Deng co"s stent
wit»- feature mtlytit ar,' utractiO" cooosais to' tre roie o* the e/e n vsu»1
pe'cepto" Va'ou» "ej'eOiOg'Ca' a^o ps.cnopi,! cai »ludes ^a^e "-dcalea Hw
appa'eht feato'e e«trac! c- tapao ' es ot the e>e iMb*l>tt**i o* t"* v tu^i processor
(•or 'ett'ftn it* Chao'fr ;il. Trese st^des nd.cate mat this analyt'S me/ 6«
ettectcd by a h.gh-orae' Of'cept-o"- «e prutess IMJ-U, lt7I' Uhf 119731 d<scusscs
n-eehs for thi^ :ompufer trnp-eweMat'Oh o» this "^ont-end* of vtiu«. for^ percep' 0"
act v I» Each .erlei repreie' 'a' Oh o' »"iC s P'ooosed as oe hg analogous to a nt of
(eator»» which tn« e.e tOjd "et-e.» at that verte« ocatio« The M of verte»
oesc plon» rompr.s.hg PIC re^a-s co'stah' throughout fh« pe'eept^*' act < ty o»
V!PS,
G>bson li966) h»» d»1- ' bed th» serses as tie act .e s/ste^s wh.ch -egaler tie
".hvarieht structures of a-a »0* st.mu'atio** furh^n^a j» tne »eceptors" The theory
of ViPS agrees that structure does e«'St m ir*Ml it ru at on and that t s registered
during perceptua act »ify out i" argues that l" ■ s omy an .n|iei «ve. of P'Ocessing
Structure exists «s potenf-ai iftjrpiat'h m the envronment The ■n.tia. le^e of
pe'ceptuai process-g trans'O'-r. ' at structure nto Sr^ocs and re at o^s »nci «re
«"own Oy me orgervsf 'n« ,'oogca "lof*»* 0*1 W reiuits of this aired an«iy»n
are 'ou'd m PJC. «"d pots o, VI a» t'« icon ■« automat can» co structed The MMMl
"'*• produced Dy visu» p«rcept>eh ■ STM ana I'M >s I « 'etuit o' constructive
etti.ity »foin % hfiuÄncno By go»s met a-e oeyono m« mere r»gistr»»iOh of
st.mullt On «tructur« (retpn« .e)
1
17
'"• P'Ottis v;-S*S '» tf» only P'Octss «itn «cctt» 1» th« Piclyr» m«mory. Tr>n
■MMt • a: COT' '■•■•a by means ot '"e P ctu't mainory't KiOCKlfd r«(tr«nct BO<n1sr,
••»t CJ"»"' Pictu'« Pointer 1CPP1 '■ • pO'n'tr t'wlys r»lertnc»s on« Of tn« v»'te«
aetc D'On i tts. tie ng uneiogout to '■'•» Current no« pOit'On ot in« primary
-.o-r.mentai tat» vtuat on facn ve'ten oe«CriptiOn litt aoo tonlam» tne neceiia'y
spat 4 r'ormat>on to facilitate tne repovtion ng ot CPP in a way analogous to that o*
hole movement That n by '.peciticat o" ot a direction ot hole movement (See
Appendu A PIC? lor an ena^p.e 0* a 0'iC representation and aetai'S 01 the verte«
teaturet ana spat ai interreiettonshtp« used.;
2 VR (Vnuei aegnter)
The v sj*l re(isl«r cons sts Ot ' ve noependenl con« Ot mtormal On, t-ese bein|:
A DIB ■ direction lot eye-hoie moyement» 3. »AN - range (ot eye npie movement! C. tXP - eipettaton 0. ATT - attention E. VI - visual mlormatiOn
Thi« memory s utiized n viPS as a cofnmunicatien regute' between t>-e VI-S^S
process and the AA-S*S process «nd, as such, s h^hiy vanabt« throughout in«
performance df a perceptual 'ask. «.th both procatMs r-avmg the aomty to inspect
and ater its component ce is OIR and ATT may be null, or contcin a di'tctionaily
nea .ngfui mage symbol RAN may be nun or contain an mage symbol represtnting
d stance. EXP may be nun or contain an image ang'e symbol or li»l of vert««
specification symbols VI may MMNM Oe njii or contam a partial or complete imaf*
structure navinf Is origin m Vi SYS process operation
• -
VI
Th» VI ctll is propostd n the iqmvaltnt of |i t to-cjlled Sperling (Snarling, 1960)
or iconic (Neuser, 1967) visual memory. Upon VI SYS activation V! it always eiipty
(!L- to a null value) At the tim* of VI-SYS dtactivation, the cell contains ai image
representation (chunk) ol the new visual information acquired by the changing of
(mation (hole) location. This iconic image in VI is the result of the first (two) of several
active stages of information processing and abstraction (Posncr, 1969) Slemberg
(1967) observed reaction time differences indicating the presence of such a stage of
visual representation prior to the application of recognition operations
Visual information, as it appears in VI, has not yet been spatially integrated into or
m any meaningful way associated with the current perceptual image contents of STM.
This is one basic characteristic of the visual icon wnich has been inferred from
eaperimenlal results (Haber ; 1971). Another i« the independence of its contents from
the influence of any active perceptual goal. Although perceptual goals play a prim«
role m VIPS, the functioning of VI-SVS is only dependent upon the contents of PIC and
the ViMjjl Register This provides for the desired goal independence of the resultant VI
cell contents. Given visual register specifications for the movement of CPP (the hole),
the ■■ncodmg of information into VI (the icon) is 'automatic" (Shiffnn and Geisiei .973).
Finally, the results Of visual masking eipermentation indicate that Ih« icon is
susceptible to erasure from Overwriting VI also has this characteristic as it is set to
null then reconstructed with each activaton of VI-S^S The representation of visual
information m VI in the present implementation is that of an image chunk. A possibly
better choice it that of juM the vertea feature litt itteif, allowing greater fiembiiity of
STM representation
..
EXP md ATT
Th« EXP «nd ATT cell« provid« lh* >nlerm*tion nattuiry (Or th* eparation ot
"prealtantivt functions', wuch tha parctptuai tytlpn (thf9u|h VI-SVS) l>nd(
advantageous to apply The "praattanli.e tunctons* ot V1PS clil'ar from tna «holistic
lypa described by Neisser (1967), but they serve similar purposes
'he EXP cell allows the Vl-SVS process to apply a function capable ot
immediately determining whether a specified visual feature or feature configuration is
found within the newly acquired information. The function application is immediate
operating in conjunction with iconic image construction II precedes any effect by the
new input upon the current image coments of STM The contents oi VI ere not affected
by the operation of an eipectetion function. The use ot enpactalien operations in
visual perception has been indicated by venous enpenmental results (Aderman and
Smith, 1971). In VIPS, the EXP ceil is leaded with the «upected visual feature va!ut(s)
prior to VI-SYS activation An appropriate preatlentive function is applied by VI-SYS
whenever this cell has been prespecified (by AA-SYS). The results ot the function
activity (YES , NO , or CONIained) is placed m EXP prior to deactivation of the VI-SVS
process. In sor ■• cases the returned value of EXP is sufficient le determine
subsequent perceptual behavior (by AA-SYS). In such case . 1 is not accessed nor
incorporated into STM. The entenl of evaluation ot newly arriving sensory input
depends upon the predisposition of the system.
The ATT coll allow« the VI-SYS process to bypass vertices el negligible interest
to the present perceptual goal when moving to « new luation location (vertei). The
1
70
e. ewovetient resjits ct VarCuS i'.lb''' „pirate Irs lb -ty of t^e vitual svst»rn. in
VIPS. the ATT cti1 ijy De specified win t diretlic ,1 JB perpfflicu^r la that o'
the specified movement dTect on Oi«?» prior to VI-SVS actuation. As suc\ ATT
specifies a side of the I ne segment whicii is being traversed Any verle» enrou-'te'eo
during hole mo-ei-enl wmen is stra't,hl on Iht soe QI the i^ne speci'ed by ATT is
scanned througn ino hail) on me way to a luMner ne» ' ■aton location Werte«'
3'M and RAN
Th» CIS and BAN t» s a-e those nfernxtion units *no pro^de for iha necessary
communication oetwe.'n th» ■.■sjai mtormjlon processor (.isua. lone«1 and the moto^
conl-ol p-ocessor (ce:eDe.ium or Dasai ganglia) (E. V Evarts, 19T3I. «nich controls the
soecitiea bod/, head, or «.e .hole' movement act vity 'hese --ovemenl'. a'e •■pccifiea
m trrms of drecton (üi«i and ra'-ge (BAN) at lh>t com-o: level Neu'Osh/s oiogica.
'esearcn iProram. 197li has ."dcatea such an at'Sl'act »eo'esentation of motor
functions at Ine corte« e^e
yM and BAN noicatc Ine mlr.nsic roie of motor lei'erent) aclv 1, and 'hfor-aton
in vsuai perception '^ove-'-eit s ne:e5sary »or tne finaton o* new ei'e-nai
information Bjt t^ese ceils do not oni, provide n^orn-ation for VI-ST5 to efiett s.icn
mo.L'men' Their spatially meaningful va^es (sy.boit/ are incorporated >nto the v.suat
image structure 'tseif by AA-5YS BA^. s a v» ue roturned from f^e motor system in
the hole movement tasn iso j'O in ViPSi iVurophysio og ca' results h.i.c indicated
that the cortev can "Ol be part tio ^a soleiy on the b.isis of se^so'y or efferent r^erve
input connections 'he .nterpre'at on of sensory nerve states 'oerreption) involves
th« inttrpntjlion of associated o'lerent n«rv» stills (Eitlinger ct ai, 196~' Eye
' !
71
mo.emenl rMMTtH njt mdcatca In« •Htclt Of tyc mov*m*nlt upon p«rc«<v«d
position and motion
3. STM (Short Torn Momory)
Th» SHO't Term tMmory o» VIPS corrfpond» to tho notion ol »NOft tfrm ntamory
under d>scust<on in cofnitivt psychoofy todty (Miiltr, 1956, Ntwoll >nd Smon, 1972)
it reprostnts that limttd part ol numan memory which is activ* or has 'ecantiy Dean
active and is still readily accessible As such, STM is an ordered list ol < conslant
numb-.-r ol independent chunks A chunk is a collection ol symbol ir'ormatiOn such
!r~a! access to any constituent e ement ol a chunk implies the immediate accessibility Ol
ali other constituent elements. A chunk is not an independent unit nl memory, though
U is rather a pseudo seii-contameo symbol structure II is a selective activation el the
symDOis ana relations ol LTM Eacn srrcted symfoi ""aintams the potentia' use
(activation) ol <li ol its LTM assocations by the active process Tne njmeer o* chunks
in STM nas been set at nme m V1PS This numoer it «nth - the limits ol current
est-males Ol STM chunk rapjc ty Chapter ß.i snows that the "ufbe- n.ne is
necessary to eipian tne observed behavior with the present VIPS process
inrpiementations The three processes lAA-SVS. «EC-SrS, INC-SVSi other than V1-5YS
an have access to the chunks ol STM
The order ol chunks m STM m the result el th« ac' on ol two basic STM
operations The lirst is Ire insertion el a new chunk at the head el STM This chunk
may be created by the currently active process or may be translerred irem ITM or tne
VI cell ol the Visual Re|ister This insertion results in the 'pushrni* ol the enstrng
STM chunks to the back end ceusmg the lest chunk to oe lost, or 1or|ett*n* Thit
M
72
Keeps the number ot STM chunks constint. The second operation is the movement of
a current chunk of STM to the front of STM. This results from the "attendance"
(accosting) cf the chunk by the active process (either AA-SVS, REC-SYS, or 1NC-5YS).
Chunks are only lost from STM by displacement. There is no explicit decay over
time, though the oldest, non-attended chunk is the one to be lost and forgotten. This
proposal is consistent with those ot Waugh and Norman (1968) and Newell and Simon
(1972). Reitman (1971) and Shitfnn (1972) have eicpenmentaily shown that loss of
information from STM is not merely a function ol elapsed time. Reitman says:
"Forgetting is produced by characteristics of the events of filled time, not by time itself." (Reitman, 1971, pl94)
The order of STM not only is the prime determinant of chunk loss from STM, but
also plays a role m the accessing of STM. Chunks in STM are accessed by an
operation which sequentially searches (scans) STM for the first chunk satisfying a
given condition. Access (attendance) is then accomplished (or that chunk. This search
traverses STM from front to back This gives front chunks priority, possibly screening
less recently attended chunks in STM which satisfy the same accessing condition. The
conditions used to access chunks m ViPS are defined later m this chapter as common
feature« of the three processes which may access STM
It remains only to discuss the internal characteristics of an STM chunk to complete
the specification of Short Term Memory. A visually-meaningful chunk of STM is either
just an image chunk (as defined in Chapter 1.3) or an image chunk with additional
perceptual control information included. This control information is embodied within e
Special Type element , which may be appended to the head (linear lilt level) of en
)
\
(
i
.r J 1
tu
1
O
3
i i.
V
1
1
T
S
^ 5 ir 1 *•'-
•* T« «•
^»N.
73
image ctiunK of STM (see Fiju'e i/3) Ti-»re art <ouf luch Specii Type eleme-ls used
wilh.n ViPS, l^ese Deing GOL, COM, LAST, »nd OGOL. t*-h will h:,,e reie>*r>l tinlrol
properties *ss^c d!ed with it ror eianpo, the G(X e ement ^oirts the name ot the
*ctive peceotuai £0*1 HI its associated MME property A Spec J Ttp» element M
i/ ated at the head of a chunk w tn spec-ai 'eevance Is the p-esent perte ' ,ai goal,
facilitati ig th» future access (attendance) of that clunk. Tr-ough these SoeC'al Type
elements are incorporated direct'y into an .mage Chun*, their constituency is not
permanent and is strictly for control purposes. These eiements are never paM of the
final image rppresenlat on ipercept'Oni
Components of i Ong Te"r \Vmory
~
.
Long term iremory ce'^es the act'vty of visua. percept on both as a source of
relevant representat onai •■■;• -ige a-d processes and as an avaiiab'e storage
'Oca*.on for selected mean:ng»i. oerceptuai results Tne i TW, RL,TM, and '.Tw memor.e ,
of VIPG are all proposed as Deng o ffer nj, necessary componer's of Ihi» muili-
pu'pose 'ong '»rm memory LTM i« a set of interrelated pe'ceptuaiiyme^n ngtui
symnois R^TV i$ a soecaily sl'uctureo component of long term memory facilitating
object recogn,t,ons and evpertafions. jTM is an ewfension of STM which servos as the
a a.iabie long term storage area 'or seeded, resLfant mage chunks of the current
perceptual activity.
,
4. LTM lLOng Term Memory)
Th« Long Term Memory o' VIPS K»$ no overa' information structure associated
y
. ..
•4
w.tn it, Tnoug" mulmnrttd -i the : -oir»!»! » • line«' list, it it •art-', to be
cO"S'ae'e<l as t^e set c* s>mboii i.i»Die throujiout the syjtem Oy »" processes end M
a -remo'ies Thi» mciuäes f-ose »ymoo^s inlroflucea m Ch4i,;er 1.3 which delmed the
r-age representelion Thus, m s-e .-nte L^M does not tmsl »% » teperete entity at
en, but ,-r—pji»'. ell the other o'Ocesses end memories The use ot e symbol is en
«ct vet'on o* lh«t element ot ^TM (Anderson and Bo«»r, 1973) lfm set ot LTM
symbos does "ot chjnje withm \ht course ot one perceptual task Performance,
••.-;■■ theoretically t could oe altered sy 'earning processes using openence over
perlc-mancts.
Th« visually-meaningful symbols o* LTM are interconnected through the placement
o* properties representing spatial and *eaturei interrelationships, the retultrng
ntormetio- structure is a form of semantic net (OuiHan, 1HIV The e« stence of these
interrelationships affords a valuable means of 'ndirecliy accessing LTW element» For
enanpie, tne opposite propert/ ("CPPO't interrelates direct.onai symbols, «ith "(OWO
0» LD" being lacce".S'ngi PT i<;ee Apoenfli« AlTM lo' e«DO?it.on of the i«mbo.s and
;^e ^^socatea semantic 'hte're.at onshps )
6 BLTM (»eCOgnitiOn iO"g Term Memor/l
The recogntion long term memory is structured as a no"-b"ary (n-a'?i
0 SCr m "aVon net with |ltenw|| oe^g access oe through traversal from an ,n,tal
cement RMM (see fgure IVSi Tn,s memory aoes not .hange th'oughoi.1 a
oe'mptuai pe'fori-ance oy V!^S Ai noted with i TM , thyoretically it H aiterab e b,
learning processes The bas c "format on structure, operation, and possible learning
(and forgett ngi p-ofev,es of ».TM have been nvest gated previously as EPAM
(Te genbaum and S man, I HA)
■.
fftura IV 4
> .
RLTM ha* »«ocuted with it • r*(*rtnct pomltr, Iht current rKOgmiion mamo'y
pointer (CRMP). It i« uMd to KCt» the nwmery by th* RCC-SVS process, the only
process capable ot eccessinf Ri-TM. The elements of RLTM ere '.»lied recognition
memory nodes (named PMNi, i an integer) RMN1 is the initial node ot the decision
network, CRMP be."! set to il upon activation of the i,cC-SVS process At REC-SVS
acquires new relevant angle feature information from STM, CRMP it made to traverse
RLTM accordingly.
There are two special properties (COM and UQX), which may be associated with
i -•. recognition memory node, etclusive of thai node's position (interconnections)
with>n the recognition network. Either or both of these special properties may be
«peci'ied for any node If Rf -S/S is successful m constucting a complete obiect
image in STM, the COM (COMpiete) property ot the last RLT ' node referenced by
CRM-1 indicates the name of that obiect COM s specified only if a name is known for
the tr*v>rsed image object. If, on the other hard, only partial obiect information it
available to REC-SVS m STM, the UQX property of the ast node referenced by CRMP
yieios a process which will complete the image of the suggested, known obiect UQX it
specified only if a known ob.ect is suggested by the partial information in memory
There it one node acting as a tmk node in RLTM (CRMP is set to a null value) This
node is characterized by its complete lack of any anting traversal linkt and by the
aosence of both COM and UQX properties. The node is reached m traversal when the
current object angle information found by RCC-SVS is not compatible with any known
obiect, nor it part of any known obiect (See Append" A RLTM lor the definition of
the RLTM used m the implemented VIPS) Figure IV4 it a graphic representation of
that »ppendi«.
'. ..
image chunn ot STV I5ee f'tu'« i/3l Th«re t'e 'OJ' . JC« Spet'tl Tvpe elements usea
»■tnn viPS, tt-ese temg ÜÖL, COM, LAST, jnd OGOL twh will i^ve reie.*nt lOnlrui
propet'e» *4>-'c j'sd «itn it Foe e«'->pc, tn« GOL e ement "O'rti Ine n^me of the
«live p^cepluj ioai M il» «soc «tea '.i'^E prapct, A Spec i '»pe eiemem s
D;»ceä »t thi head 0» < cnun» win •. »ati re»v»rce ro :»-? p-esent pe'ce M goa.
(»C'liHtmg ,ne tutufe «cess (»ttendi-cei 0* (hit chuM ThOugn tne^e Spec i 'vpe
element» are .ncO'pO'jtea dirtcti» rilo jn .n><|t cn„n», tf-e.r cO"st'tiiency is not
pern^nent »na n itr.cl., to- conl'oi purposes These e^eme^s a'e "e-e- part ot tt-e
tin*i tinagt» rrpresenUtOi (percepLo'''
Components o* long *e"r ^»«•T1ory
long term «-emory -.e-.es the tctivity ot vuui. pe-.epten Both a* » source ol
recant represent»» O"»1 knoweoge i-'ü processes »"0 »s »n »v» »O'e slar»ge
oc»' or. lor selected mejnngi oe'ceptj»1 -esu ts Tne LTM, PtrM, »no ITv memc es
0* ViPS »re »li proposed »s o» ng dit'ermg, necess»-y comppn^r's o' tn s multi-
purpose ong term memory LTM H « set 0* interrei»teä oe'ceotu»i'»-me<'ngtui
SynDO'S PtTv it a «per»ly st'uct^ea component nt long term memory fKililetiflf
OB,ect recjgn t.ans «no ^<oettjtons. iTM is »n e»tens.on ol STM «hich ser.es »s the
» »liable lon^ term stor»ge »re» 'Z' se'ectert. resjitant . »oe chunks ol the current
perceptu». »c'w l>
4 LTM 1 Long 'erm Memo-, l
tttt Long Ter~ Memory o' ."'S »"»s no Overa.i inlorwalon structure JSSDC »led
M
76
6 UM (Intcfrxii'dte Te'w Memory >
"e e ements ot ;'M »re copes ilrom STMi o» se:ecled ""ige tnun«s Al 'he tarn
o* imtifl VIPS act.vat o". I'M 'S empty set !o .* nun v jue) iTM K unbou^nei-i n sve
and grow^, witn the aaj't.Oh o* rcw e e^ent chuh»^, tnro.j.-.nout the pe'teptudl
pertormdnce WM ho!di tue compete pe'ception i. s^*. rnage1 at the cO'Hiot'On ot
:"e perceptual activity. Ei»in»ntl are entered into ITM I'Om STM Bv lhe INC 5VS
process. An/ -ue. * Type e e""en| {.», &X) u removed ♦•o"' a se'eclea chunk pr or
to buihg copiea mtc ITM
*ne activity ot INC SV5 s egji/a-ent to a "rehearsal" oper.Vion (Waugh ana
^Jorn'in, 1966) ActuaMy V^S p'O.ides two tor-os of rehearsal operations. The
temporary means of Chunk atfjna^nce mantains an mage chunk in STM Dy mov.ng t to
the head of that oraereo "e^'Or,. Tn» more permanent means is the copying of
seieited chunks mto UM a', performed By INC-S^S
IN V!PS, four retere-ce 00 nte's »r« associated »'th ITM ana are uM./ed by VC*
"SYS to access and upaate ITM contents. FI^ST-ITM re'erences the f.rst inaRe ch^n»
enle-ed mto ITM By the cur-e"t perceptual activity vAST-ITM re<erpnies tne last
chun« of ITM FMST-08 oomts to tne first e ement irhunk) M ITM representing an
Object lOBJfCT t/pe chunk). LAS'-03 references Hw last chun« currently M UM
which represents »n oojecl
This UM proposa' is in concert with th« "assumption of unrenaBie STM". which is
discussed by Ntwe'1 11973) STM, as it has Been proposed, 15 a highly volatile,
Iran' lent storage area it »oceives content nput f'om Both intnrnai memor-es and
processes and sensory-der ed dconici scurces. It wiN also contam incorrect or
irrelevant deoris from the active prore'-s-ng of such inputs ITM it a cache like
'I
77
co^noift ot L'M- 1TM .» i rud v tccmoie tittn^.O" 01 S'M, ICsstirg ot
!•'*( tea. mea** n^ul '«age cnunns The O'Ote'.'ei which can access STM tan a sn
Kce^s ITM D, UM o* the NiCO ope-nt o" The t*tD ooe'ator e-te-'ü', me -.ea'th ',.■
a ch jn» ^at'st, "g a -pecit eo tO"(l ''on to the contenti o' [TM 1' a sat'i'adO' > cunn
5 'cona n ITM, the VEO ooe'at on ifan^te'i a copy to STW A.i .n.rge cnun«
consloct.on of »ite^a^on ■* ca"ea Out M STM Se-ectea 'eibüt a'e (opied to i^V" D/
:\C-SyS as «e* cu"eht co'teit mo'-'at on
«■jnt il9'i' D'Opo-e-, a '-.3-e«hjt tmtm ope'at.onji ae^nit on <t |TW «rrtf
•ega'd to '»nguai» iO-'D't-c mtIK ■•» O'OPO'.eS trt tonttnll 0' ITM 10 De mejn.rjtj
n'ormat.on "molefoles". »5 oop-'.ed to tne "atoms" o» STM i" VPS (M goa'S era image
tt'u'tu'es n»ust at so^e po-nt fes.dt *t $TM in 0'3e' to act \e y »ntiuence 0' i^termne
nen^vior This d't'e's t'Or tie >k.nt propo-.a. »n'h aiows cOfpie« strmtufes in ITM
to control bena.iO'
Tne "du*1 Ifaie" tneo', o* n*.emo'y pc.tu'ates a sro'I te'm rr,ei>Ofy *hicn s
fe-e'oe'etofy m nature ana a consot'dated iorg term fi.emor^ t'ace whtch s stable
ana constructed »s »n et'eet ot tne rtve'oerator/ Ktcvity This theo'f has oeen
acccniQäatea to Decode a "-«uiti-iract" theory as m.e'-tigaliOf« mto tne el'ects o'
eitK'^oconvu' i.e shoe* and je'tain drugs upon memory conso-'aat'On .na^catt tne
D'ObaD» e- stmce ot an iniermgdiate noang stage between Iht two utrern»» o' lb«
tfud trace tneor, (See )ohn, ;97'i)
Wickeigr»n il9'2i ae/eop- a muiti-lrace theory ot memor/ oa-ed on the
accessibiiit/ (strengtn deca, ot niormatiOn with elapsed time Trough eaosed tim« it
not a 'actor m Ih« definition ot VIPS memnry components, an ITM »ith * tune 'actor ot
several minutes, es is P'ooosed b^ Aicneig'tn, is cohSi»tent with the time
.. *J
- , ■fre-<". for intormdion m«<nltn«n(t which muit b» nxpoitd upon th« ITM 0>
ViPS to saplxn the ofasrrvro Ochiviof
rwE PffOCESSES
l«h o» Iht corst.luent pro e.«s ot VIPS iAA-5VS, »EC-SVS. INC-S*S, VI-SVS) PS
oet'^ed m Ih» torm o' t P'Oduc'ci »ystim. t m»«r-s <jf cogn.livt psychologml
••.■-.; which is >d«quatei/ v -•■d, i 'c/ ' I «nd illu«tral«d dstwhare (Newell and
Simon. 19^?, Neweii. 19731 A p'oouclion system is compfised o' »n ordered, fmilr sei
of product or rules, e«ch rnv^g t conation heit »no «n «t oi h*lt. Wr th eech system
ciperif.on cyde. t^e ordered set ol P«4M of tne cur-entiy «ive process is searched
«cording to the de' led order MM t production ruie s 'ound whose conaition hell $
lully s*tisli»a by tne current stele ol the '»■»/*"! me^ury (n,e*oriesl Thel rule i»
the" te'd to lire; the oper»l'Ons ot the rule's »clion heil .T e>ecuted m light ol the
me-nory ■nlflrmelioh accessed during s«tisl»clion ol lie ru'e's condition hjll The
necessery lunctons which serve lo mped the production s/stew control structure ol
VIPS processes withm LISP it »'» 'nose ir-plenented by Moren (1973) »or his VIS
■./sto-n S'M w«n»gerr.ent »no done by utility lunctons delmed by Morjn
rne proposed processes ar( oisl ng^sned by several delmlionei criteria, these
being:
1 the rreicO'ies reierenced ano operalons employed n tne conOit'Or naives ot the constituent rule»;
i1. the memor es relereneed and operal-ons employed m the action halves ol the constituent rues;
3 the degree ol process smiarity between subieclt
. •
On« outt(<ndin| op«r«tiontl di*f«r«nc« bttwMn procMMt n thai «I • procMt*
rol* m th* VIFi i /ci» of op«r(tion. AA-SVS (Ih* Mtimilalion - Kcomedttion precM»)
>s cansidcrtd to b« th« m«in proctsi <nd «II thr«« c th«fi «r« suppl«m«nt«ry
pro » - -s A4-' r$ It th« proce-.s imtxlly «ctivited, pnnginj lit« to V1PS It C«n
sub*equ«nlly K' vat« jny of th« oth«r thr«« tuppl«m«nt*ry procmti, which upon
th«ir d«>ctiv*' on yi«ld control (gtm to AA-SVS (tM fgur« IV.SI Upon o«rc«ption
con,'l«lion -'A SVS is d««ctivat«d, killmf VIPS its«if
To mitiit« th« usu*l cyclic cours« 0» VIPS activity, AA-SVS lotdt th« visual
'«g>'t«r according to Current SIM contents and th«n actvatat Vl-SVS Tt.if K
»<f«ct.v«ly « request tor n«w visual 'nput VI-SVS r»f»r«nc»s th« «at«rnal Pictur«
-■•- jry PICi, altars |h« visual r«g>st«r accordingly, and daactivatas, r«lurnin| control
to AA-SVS AA-SVS , or-oe". th« rtsuitant Visual Pag star call contants in light of
'j'rent, relevant S^M iwage chunks fith«r tne re* information can t.e consiit«ntly
assimilated Mia STM or the mage contents must b« acconodated to rea'u« th«
incorporation of the new input AA-SVS mav activate BEC-SVS to perform object
■e-c;- ! on o' iNC-SVS to incorporal« sa'<ctad STM chunk» into ITU It than reloads
■• * V<suai Register and agam activates VI-SVS Th s continues until a saliatactory
perception has been constructed as a visual image >n )TU
I. VI-SVS (Visual Input Process)
Hn VI-SVS process has several dxtrnfuishng cheraclenslict The most notable of
thes« is that it is propos«d to b« eiactly the same tor all subjects. This is the
consequent of several factors the mam one being a result of a stated goal of this
th««is Tn,s goal s l.-e development of image «l«m«nts and structures capable of
M ■..
> i o i
i
-* o
''epr9Jei* "g »' subjec!'" co^D-e'e «ra ^tef^ea^'e 'pa't.a I lint dra* ng percept ons
'u't'te',^0',e, the •■si o* wwtl (••lo'ti ODtanase *T a .e'tc» t>^ (h» tyM s
cons defed to be e^i. .»en! ♦or a< sv *s ♦O'' *^e |ivtn hrw d'a^mg envfonrnent
AnOth#P tactor w^'cn 'eadi to ts UI<QU« uniform dettnition -s the process" access
0* 0'ity tr>» ViSua^ Pe^ ^Te' aid Picture mtmories a-r.ng activjton Tre process -s Inus
• only "a-ect1/ ***ected by a"; act ve pe^ceptua jcas, wn.ch are lh# mam source o*
I tS iub.ect be^avio'' d'**erences. 're use 1» *hicn tne process -s put m,», and does very,
but ill def nt nr aoe-. "Ot
Vi-SVS •$ WM ioecji n tmt it i$ Ine only proce» «■Ih access to tne P.ctu'e
J memo'/ Thus, the Visu* inpjt process is tnt only .nle-'ice Det*een In« en. romient
'•Ktcnji visual nforiiat'On o* PJC' ana an .nt«rna. Temory (Visual ScgiSte'1 ot tne
P'Otcoed perceptual systerr , "e process s not d^ectiy ana^gous to tne rjn-an efe,
Itnougn Satner, Vi SVS s a cembmition ot me motor p-ocess cont-Oing eye t •o e)
movements and l^» process wn.ch operates upon tne eye-p'Oduced teatjr«
jS nlormat 0" to produce (construct) the MMMl iCOn
H Process |MMitrt(iM
"ne rules of tne olner Inree P'ocesses iM reference STM » their condition ha .es,
»nd are ai. primarily dependent upon the nati« ot tne current goal lor aetertimat on ot
the rule to De fired Thus an rj'es. but (or a fe« «oecal e«ceptiOns, start with two
bavc operations m their condition halves, these being "(el: GOU" (or "(el. GOL ll)">
and "((rwAME OF GOD • "I" The "tel: GOD" fondit,on operation Kcesses the STM
chun« to which the Special Type element GOL has been appended. Tne local (to the
rule) vananlo "el:" is assigned Ire accessed chunk as its value (when the variable "ll"
81
is added, "tl* <t locally «S'gnad in« viij« of t"» Cijnk Hraoe' e^emtnt o* the
•cc«st»d chunk) Tne "((NAME OF GfY)»"»' open! on deti'w.nei il tn.s fule it to be
tired m issociation • tn the current goal (e.g. ■( the n»i»ie ol the current goal K ") If
these two condition operations «re satisfied, the further conditon opera! ons of that
rule are sequentially appfO to 3TM for possible satVaction Such ru<e definition
creates a valuable parM on.rg of th« mlM of a process (oy goals), c>peditin| bom
wstem operalion and rule de* '■■".on
A "iecono similarity is tne -«edns D/ wn ch these processes gam access (give
attention) to the chunks of mfor" at'On in S'M Tne 'ui«s of lh«5e processes achieve
th.s access m only two basic wa»s O^e "eans of access has been ii-ustrateo above
by t^e "(«]■ GOD" cond.ton operation. This means of cvnk accessing depends upon
th« ensterc« Of « Special Typ« «>«>r«nt (>« SOU which has pr«viou(ly been
appended to Ine ape op' ale chun«. This 'S pre oele-mmed ipremeoilatedi attendance
of a chunk which is relevant to tne current perc*pt'jai gcai
'he other me.rs of atle-9'nj to a chunk m STM I through th« use the "(ej; II
(HAS "I)" condition oprraron. '. ot • g an integer The "lal: tl '«AS ,'')i" operat.on
locales and al* -nds '0 th« ».rst i'M chunk, if any, which contains the element "' within
• ts mage body structure Th« acc«s5ir<| operation only "vj consider the chunks of
aTM al th« top i'near lift) «vei to determine simple element containment A
successful search results m the oca binding of "•!:" to the accessed chunk >na "11" to
th« Chunk M«<d«r »i«f»en> of !"«! Chun». Th« "(f f 0 «1: (HAS "))" condition Operation
««tends tn« -.earch 'or tne de» -hunk to iTM. The operation automatically
establishes a ^opy o' th« accessed cnun» «t tn« head o' ' TM ('f found) and lotaüy
bind-, th« "el:" and "li" var ae e- as noted abo/e
I
This Kccssing of chunks by either im*|t element containment or Special Type
e'ement appendrrehl again greatly improves system operation and definition m terms
of ■ oeed and simplicity. The attendance at a chunk is achieved without encountering
the < ompte* semantic stnjcture being 'eprc-ented in the image body. As noted, there
is no attempted syntactic matching of any e ement sequences at the linear list level
and no attempted schema matching to the whole or any part 01 the image body
structure to accomplish chunk access The definition ot the symbol'C elements ol tue
T-age chunk as property groups which embody the meaning make this possioie.
Proc«s Control Structure
The position ol current goai as the primary determinant ot rule linrg implies a
definite control structure tor these production systems and thus for the cognitive
processes they represent. Upon eaci. system cycle, the GOL-appended chunk is first
attended, and the name of the current goal (NAME Of GOD is matched. Any further
relevant chunks are then attended. Chunk attendance does not involve consideration
of the chunk's info-mational content. Finally, conditions based upon the information of
the accessed chunks (and the MlMry register, if perception) are evaluated and a rule
fires producing the "desired" activity.
The current goal is an internal (mternally-denved) state which influences the
perceptual activity of VIPS m three basic ways It first determines what of the
aveilable information is to be attended durmg a system cycle. Secondly, by
partitioning the rules it determines the class Of actions possible during a system cycle,
finally, by determining actions it influences the final representation (perception) which
is realized.
f
'J
83
2 AA-SYS (Assimilation - Acca^oj.** jn Proctss'
Piaget U96''', \9^0) ^as defied ^"d a-scussed '-e tu^damentai ^ssimi.jtion-
accümoaation •Ctn ty of any itv.ng syütem wf1 en i^tcacts with its environ-pent. The
activity of visual perception 15 a pfimary f^-.'" o* Such intefaction. In the
interaction, the iyste^ rrj-it
" 'assimiiatf' t^e tyterntl wo^ld mlo t^ structo'es lh*l n^ve a^cady oeen cOflStructa) *nd secondly to read^st tnese structures as a 'unction of subtie trans'orniatiOns, e to 'aaomoaale' thtM to enlernai ob,ects" traget, ^ö"*, p8i
'he assinviat.on-accor^oaation process s the only p'ocess w th access to both 4he
newy acqured visua nfo'TatO", 'ouno -n the Vs^a Peg'.te'. ana the inage me^O'y
Currently -n STM. Given tr s ne* «iSuJl in»orn*at'On, tne tasK o( AA-SVS s either to
assmiiate it into the current image n S'M O' to aTO^odate this curren» mage *o
accompiisn integration of ne« CO"' cting v<su«< 'nfor^ation The new intprmar on may
be c . imitated by tittering tne contents of VI into S'M as a new ima^e tnunk Th*«
involves the i-nKing of (he ■cor c image to the cur'-ent mage of STW by crea! ng
approp' .lie spatai Or e(|u*vatency reiatiO"'. The as*.'miatiOn ^ay be rfctompiisned 'o,
jutt marKing app'op'-atp •l*rn«ntt Of an emsttng (hypcH^Miffftf) "^Age Chu^h <»■. De "g
conf rrred. Finally, assim^at^on way 'nvO'.'e no action jpo-- tne ei st.ng STw cor'tenrs
W^PI enpectat'Ons conce'^^g t^p new visua' input are not fulfiHed, i*e magt w»tn 01 »•
of S'M mutt ne aco^ooafed to ach.»vt cons-stency wifn tn^ input Such e«pec:at o"s
derive from a n,pot*eweä one''* •'age , frtm a pre.'Ousi-- constructed "a^e cnunK
thought to reprp'pnl ?^e pa't of the /-suai ♦'eld currently f'na'ti, or from other
> •1
posi o e pe'ceptu*1 inferences The source o* tnt nco'rect eipecl»tion --uit be
» 'e'ed or »nolher e>'5l.ng coniite"! ^jge chunk must be 'Ound to iccomodale STM
to tt-e contiictihg 'hput. PEC-SV5 «"d If»C-SVS "*, be »PD'opruttly activated by AA-
S>S to acco^pl'Sh its task
AA SVS ■■ the most h.ghly variable proress bet*reh subjects It is here that the
subiect's pe-ceptua1 »trateges a-e pmMnly represen'ed A strategy is detirpj oy a
«et ol oossoe goals, t-e ross o'e ''i-ttions between the goals, and the conditions
assocated w tn each ros ibie trans.ton AA-SVS i» the generator ot most act.ve
t.e".eotua> goa^ IO» tner trans,t onsi, and as sucn, $ tne primary •■nbodiment ot
stategy Two ;enera stratejes nave been interred to account lor the Observed
suo.ects' behavor, and a'e a-stussed n Chapte- il i
3. "EC SVS 'RECogn.tion Process;
When tne '9cogh,i,on process s actwated Or AA-SVS, it wm proceed to a ;e>s ano
*raverse various re e.ant m-aje cHunks o' snort te'm r^en*ory 9aseo uPO" the mage
n*0'mat'On encountered, t'-e process ''a.erses tne current recogntion memory
oo n-er (CVP' tn-ough »^'^ il imuittnNwdy constructs • partial or complete
Obj#c1 'mage as possbe upon ^jmpetion of th.s mage t'a.ersal an obiect naiie, a
k-o*n oo.ect goa, c that nsu'fx »nt mtormat.on s aviiiabi* l.v eitner WMI be
(Jecnted by the process, acco-ang to the COM or UQX propert, ol the recogntion
memory node Imaily relerenrfLl 0, C^M»'
'he pas c oper At c"s *h(h tra^e'se tne mage and ^ 'M do not vary with distinct
suojerts, due to th!« "act that the image s'',:tures employed by all sub,ects are the
same 'he rule with tne co"ect memory t'avers.ng ope'aton action part is
1
determined by the condition pvl beted upon the type of image (Iructure the currently
Kctsstd chunk embodies, the type o* image element rtterenced within thet image
chunk, and the currant perceptual |oai (p'tipec ' »a by AA-SVS) The depedenca ol
rut« dring upon a current goal results m REC-SVS varying between subiects Th«
regularity ol image body and ». TM structures between subjects restricts this
variability to a level Deo* IM 0* AA-SVS
« INC-SVS (INCo'poralion P-oc»ss)
When the incorporation process is activated by AA-SVS, its task is to enter copies
ol the appropriate image chunks mlo 1TM, eliminating any outdated version ol the same
image structure that may eist n iTM It it th« only process which may altar th*
contents ol ITM. (Whether a copy should be made or only a relerencing pointer
established to the chunk is KOI dear) This process may also be activated to improve
upon an enstmg ITM representation This may -woive the realization ot a more
<or, .e image or an attenipt to ei - "ale possible inconsistencies These lunctions are
di-.cwr.sed lurther in tue neit chapter
Th« basic Operations tor copying image chunks into ITM do not change with
di'lerng subjects With dillermg perceptual strategies, dillerent image chunk types will
he marked lor incorpora'ion, though Thus, similar to KC-SVS, INC-SVS hat torn«
limited variant« beiween subjtct modelt.
'
:
2. Th« Syslan w Act««
A PROTOCOL - PROCSAM TRACE SE0O£NCE
The 'est o( lh« cncptcr present« in wljstraliv« ti*mpl« ot VIPS in op«'»l'On Th»
•■•mpl« cti-'F'.ponds 10 Ih« initi«! protocol M|m*nt ot Figur« 11.14 Th« •>«mpl«
illuslr«l«s not only «yit«m op«rition Out »no )«*tur«« of protocol - profram
correspond« nc«
Figur« IV 6 pr«t«nlt Ih« two nititl protocol IrtiMt, VI «nd V2 Figur« IV7 thowt
th« compiot« hn« drawing ttmuiut involv«d with th« v«rt«i nunbenng convention that
i« n \n» Fram« VI indicates tnet vertea number 1 it initially in view, that being th«
> ,•.-' angi« v«rt«i m Ihe lower left of the line drawing Th« »ubiect censidert thu
avaiiaol« visual mlormation and ndfcales by stalem«nt [S3] that it is sufficient to
suggest (hypolhesm) a square 8y statements [i*\ [SSI •"* [Ml ,h* »ubiect
md'Cates th« invOlv«m«nt of tn s obiecl hypothesis in th« subseouent hoi« movomont
activity of fram« V2
Figur« IV 8 presents th« mitm i«gm«nl of th« COrrotpondmf lr«C« Of VIPS
activity. VIPS it activated by an «itarnal activation Ot tho AA-SYS procott a*
indicated by th« first lin« of th« tract Initially STM consists of nin« «mpty col t a*
indicated by th« hn« labelled by '0.0" This number it th« system cycle number. It it
us«d to label STM listings and will b» underlined in th« trace «Ofmontt. Upon thit
mtial activation, rule RAACO firat which activatat Vl-SVS to obtain Ih« fust viow of
Ih« lino drawing (from PIC). In VIPS, Ih« initial goal it NIL
/
-■.,
Flgura IV 5
—\
RT
'ooK'- 'ke 'h» corner [SI] HM pjrl • ,-ht t-er» loau I kc th» co'i-er o» a uh [Sc] ol a iqu.vc [53] r-OW, Vt'i IM ' 1 tan [it]
if if 'S (t ng to be a ■.qj.ire [5^]
t^is wouij be the i-ot'o" o' Hw -.quj-e [S6]
Fifura IV.7
II ,„
>^ 7
^
5 1
/ ■t
Figur« IV I AC' «1 AA i.tS
3 ■■ IS: ML
0,0 S'V I' (XI
aU-t »AAOO: TH!S ii *'-- STAH- • ■
ACT .2: VI-SVS.
": .-; v:;:GET fiosr -:;• ■ ., .,
■JA-, ;s •.:.
:
ATT ;s UP
Vi ::- V3 P-: «"i As «• A6l
30* :'> '.. 2,0 STM ■
AC »J: AA-SVS
RULE »AAO: St' FiRST i/; •• IV
i •■•. j e^'.
.10 STM:(QX ) 'LAST V3iC»x; -'..V .,; ^SP£C ," ■.- S^tC V2 TVPE VEBTto»
■'. ■- AS X7 A6» )
(»oo o o i» o
ACT .9: REC-SVS.
RULE RECO: BEGIN RfCOCNIT! . • V« 8,1 .'
COAI IS RNO •1,0 r.iM:(Grn 010i31MTV» . •.' •.■ ■••': MJECTKP4 Hi A17 !'
1')) )
M VSiCCX5! P-. ,W P.; VSPtCOJ'A-;. >'jPfC V? TYPE VFimxK» '.. ■•> AS « ' Abl )
(1000 ()()(l
■ .•.».•-■ '.' '.' •' ,•.. ■''.'.■••. •,
. . IS: SlfOJ STM. .(»I NAM 5Q0ARI I R Rl WANGLE OIM TWO TYPE OBJE^
CT/il ') ill A12 113 114 Al1) 116 ii' All 119 120 Ai . . ■ ) . /'JiCP Xb Pf.uV P4 y/i?EC (RTA DLI $Pt: V? TYPE VERTEXKP4 X5 Ag»
^ .6) ; O0 0 000o
'■
:■
Pule VII of Vt-$VS firti and conttructt th« initial iconic rniagt in VI m iccordano
with VISJ*I fi^g-Ar' and CPP valuat Ml P"or to V1PS activation. Figuro 1V.9 ■> a
schematic pictorial rtprotontalion ol th» vtrt»» iragt 'laboi'cj by tht Chunk Header
•leinenl V3) which Vl-SVS develops m VI At indicated by the STM littin| '2,0*. STM n
not affected by VI-SY5 activity
Upon VI-SVS deaclivation, cor'roi K returned to AASVS and rule RAAO fires. This
ruie "sees" Ihe first view "Ow in the Vl cell and transfers tn.s information to STM at a
new image chunk Ihe ruh a'so appends the Speial type element LAST to this chunk
and creates another STM chun« whicn consists so'eiy ol Ihe special l,pe element GOL
(tee "3.0")
Two general perceptual stategies have been inferred from the available protocol
data This has resulted in tie implementation of two corresponding versions of AA-
SVS (see Chapter 112) The strategy currently under AMUMMR " ,h<' successively
recognitmg objects until completely representing (percevrng) i-e line drawing As
such, the active goal, "(NAME OF GOD", is set to PW »nd REC-SrS is activated (ACT
.9i
Prior to a PEC-S^S activation >«ilh goal PNG, one chunk is always marked by the
element LAS! to indicate the fir-,! image chunn lo be traversed by PiC-SYS A chunk
M al.o always created containing only the eien-enl GOL That chunk is the site of the
construct-on of the new objc ' im^e
Rule PCCO (of REC-5VS) fires, .mtially settn.g CMP to RMM The 'ule traverses
the right angle Of the verto chunk V3 and accordingly sets CRMP to RMN2 (see Figure
IVfl) Furthermore, the process begins constuchon of an object image (010) in Ihe
GOL - appended chunk (see "4,0"). Figure IV 10 iliustatet Ihit partial object image
\
. ■-■
A«
87«
Kt
1— »i At
*l CV^
FiprälV.I
XiS
I I»V
o\o CV^
Figur« IV 10
M» "• X« *« xtx 10
JM tA ** u M^
Fi|ur.lV.ll
016
i*A
^-
e o^e^I Tre^e ^^e LINK a^d POW *Pr"*t Oi»??r( of ^ ;\* 'e*e"»«cei *n imjge bod,
tfrfver»»! Dy rf£C-SVS du^'^g J 5ys*em ;yce A'f" «0 »u.tHe' imjge chunks e«.sl rn
S'W 0' I'M' •»'€" *'e •ee*»"'. !o ti« d."»»! OD.CCI 'fcognition, Ll'V 0' üOL '4 Ml to
oQV Tht» PCi^ prope'ty o* GOL "j-t^t^s the a-'ett'O*' (oe'P«no ;u'*' to trte traversal
o -eit on'i *•■ fh ,5 "pe'-ced" «■• re "g "o '"e "^ a* o' ("t Oö.ect Th» eil»ct ot P";'?
upor WEC-SVS atti^ t> 's rer '••e"*-' « o* ' .;ufe g^Oo^a ivOge^e^ts PDlfl |ut0««
t'e I'a»e'4*' o' "'*g* cl uh^s jfj o^tef'-.nes *" ^h fncou^te'ej fMlure« Ungl^i) a'e
■ nte' or to tr* ou ect ano t"us fe o *hl to ts recogh'to«
In "h» prtsent CJI«. »tCO -.el» LIM O» BX, to UQ« <s the »e't»< chur« (V3) « tn«
Ohy t-«e.«ht) "•»g» hfor^«IOh iv* If» FOM 't "*• . Stt »«terhjl^v but ll'
■• .asequrht v*uei *'e Oet»'"- -ej B. V^S S^c» LI'* ot CXt. >i L^K, rut« »ECl ».r«
'0' t'e -e«l <y'.t»>r cyt'e '"e i .'« r'hpe'tv C SvNZ ito'-ent CHMP .»'ue1 . e'Oi »h«
p-oce'ii i^i *hieh (O-P'e'es '-e '«rot^es^ea "»g» s* t «q,n'e-0'--i 'apg» *h ^
4 hfjcjtej 0/ S'W 't h,-, • >• .■"• jst'jtea B< "g^'e IV il 'he rj.e sets tne
curreht goji to S»0? (St«r| »"cnh Objett ? «.me^iOh» ' 9fC-S»S aeactiv*tes i-a
cOht-0 Jgjh returns t.1 AA $V5 • ^u»e IV 121
*-e 1X021 'o' AA-S^b' • •«•.. :'»"g-« "^e go»' to *<jl »h« 0*1-4 t-« Ex^, A'',
.i-a 013 ce so' t>» Vs^» Pe>: 4te' » th viioes t»«e" It«« f-e oo.ett ■•"»ge 010 4ee
■ gu'e IV 121 The4« .»iv.e4 »'e ootj'"eo Oy *M o* tne C» p'ope-t, 0' C«.i. -".»
currenl'v re'e'ences "»ge Doay e e-e"! ill ity» MTtMALI 3)' '4 set to th» r«iu*
ot tr« Di» prope'ty ot 111 A" •. »•• to t-e .«ue ot the Div; proee'ty 01 111 ExP
■s s-t to 'he v».ue ot the A'.So'Cpe''. ■< *15. «he« s (Af.G ot '.ATT of (1,9 ot lit»)
• -
Figur. IV. 12
A;- .1 .•..'. • .
-. =.■■:,. ;TAI>T LOO«!NGi ^ •■. .%•.OBJ-:" INFO,
• : v ■ i KP « •■••• ,>. ■.: s'^iii"' 5;:r5 fOuV)
DIR :ä ='
BAN IS NIL
tu.' ;3 s-A
ftIT |S J?
V! IS V.
AT VE«'. ' .;-3
Dl»; ••
RA-.;-, LC
t»? :s -.0
ATT ;s jP
VI IS V24 P2b X2(, A3i X30 Ai9 HJS A27,
Le.
G
»•1 [57] ook . '.kt *e ■»■■gM hj.» « tf i-gu'jr object [58] "itnd Ot » ^qL«f^ [St] Ml wou'd b»
lh« teco-a »de o' '"-e tr i-|ie [SlO]
(sooty*
Figur« IV 13
llhrOuljh vertu 8)
>
■.
In th« |*n«rth(«d rult tpccilictl.on, II t i« (CR «« OOt) T)w rul» than aclivrtt* VI-
SVS (ACT .23)
Fi|ur* IV 13 raturn« to th« rw<t Mgrnant o* th« Irtmcnbad protocol. Th« ■ub.rcl
r«Kh«i v«rt«> numtwr 3 it protocol trim« V3 . Hi not«», by «l»l«m«nt [S7J, •
ditcr«p«ncy b«tw««n •■p«ct«tiont «nd th« n«w VIIU«! information. Tha Kuta anfla,
Man at mtarior to tha "lura*, ouMt tha »ubiacl to Kcomodata th« pr«vieu«ly
hypolhatitad Objact (»quir«-or-r«ctin(l«) >mi|* '"t "O* information load* th«
«ubjact to now hypothaam a tnanfia, a* indH-tiid by st«l«mant$[S8) and [S9\ Tha
•ubjact movat tha hoi« ta bagin contirmation ol Ihit now objact imifa (ttatamanl
[S10]). Tha tubjact mova» through vartan numbar • (trama V5) without hatitation.
Corraspondinfly, Vl-SVS rul« VI9 lirat, which i ate CPP to tha vartan daacnption
lit! ol vart»« nunbar thr«« (VER3 ol Appond» A.PIC) Th« ru« than altar« tha visual
ra(i(t«r accoroinjiy (t«a Fijur« IV. 14). VI contain« tha imaga rapratantation ol tha
now varta«, which it illualratad by Figura IV.15. E)" it tat to NO M th« angla laatura
ACA diflart from tha aipactad RTA v«lu«. EXP it tat by tha pra-attantiva function
CAX which is «ppliad by rula VI9 ol VI-SVS. Vt-SYS daKtivata« and control raturnt
«tain ta AA-SYS.
Rula K024 (el AA-SYS) lirat at a ratult ol tha NO valua ol EXP. K024
-•
Kcomodatat ti» objact iiM«a chunk 010 m accordanca with tha ima(a ol VI. Imaga
body alamanlt 117, Alt, 119, 120, A21, and 122 tra ramovad from tha chunk. Tha
alamantt AI8 and IK ara tltarad to torractly ambody tha iconic input in VL Tha ANQ
proporty o« AI5 it changad to ACA and tha OR and DIV1 propartiat ol II» ara
changad to UL and OL ratpactivaly. Thia action it ind««tad by STM titling tfi' «nd
illuttratad by Figur« IV.l». Tha Potition typo alamant, P29, it tddad le tha Objact
■>»■» .1
84* Figur* IV. 14
GOAL-IS K02 7.0 STM. (00L 010(NAM£ SQUARE-OR tJECTANGLE DIM TWO TYPE OBJE-
CTKP4I11 A12 Ii3 1l4AI5ll(II7 A13I19I20A2I 122) ) (V3(CH X6 PNUM P4 VSPEC (RTA DD SPEC V2 TYPE VERTEXXP4 X5 AS«
x; A6) ) ()()()()()()()
ACT«1: AA-SYS
RULE K02«: VI IS NOT AS GOAL REQUIRES
GOAL-IS: RKI 8,0 STM; (V24(CR X26 PfJUM P25 VSPEC (RL UL) SPEC TE TYPE VERTEX)-
(P26 X26 A31 X30 A29 X28 A27) ) (GOL 01(Xf:»ME SQUARE-OR-RECTANGLE DIM TWO TYPE OBJECTXP« •
Hl A12 113 114 A16ll5P2b) ) (V3(CR X5 PNUM P4 VSPEC (RTA Dt) SPEC V2 TYPE VEBTEXKP4 X5 A««
X7 A6) ) 0 0 0 0 0 0
ACT »32: REC-SYS.
RULE RKI1: A KNOWN GOAL INTERRUPT CAUSES RE-REC0GNIT10M
GOAL-IS: SK02
9.0 STM: (QOL 010(NAME TRIANGLE DIM TWO TYPE 06JECT)(P4 111 - A12 113 114 A16 116 P2S 133 A34 135) 1
(V24(CR X2i PNUM P25 VSPEC (RL UL) SPTS TE TYPE VERTEKXP25 X2- 6 A31 X30 A29 X28 A27) )
(V3(CR X5 PNUM P4 VSPEC (RTA 01) SPEC V2 TYPE VERTEXKP4 XS A8« X7 A6) )
(>()()()()()
ACT «li AA-SYS.
RULE ^021: START LOOKING FOR KNOWN OBJECT INFO
DIP IS UL
RAN IS ML
EXP IS ACA
ATT IS OL
VI IS NIL
'
I
-.',
M8
xiv, ^ fso
riffjr« IV. 15
ViH ca.o^
Figur. IV 16
1(1
Mt Ti\ A^ o\o (3.0)
Fijure IV. 17
ovo ^0)
■
I
^
.- f i
90
chur.K, associated with th« »itered "comer" The verte* image, V24, is entered into
STW from VI. The image body elements Ai5 (of 0101 and A27 10' VZJ) are nnnea 0/
•qU'vaience D'Operly XEA (Known Equ . > enl A^Gtt)
Furf-ermore, ruie K024 changes the current goal to "Ki ("erecogn ze, Known
ln'."rupted), sets C» o' GO. to Itf, ana activates RtC-SVS to aid in ■"■sf.c
accomodation. W^h rule HKI, rule RKU (of REC-SVS) (.res. Th.s rule tirU sets CSVP (o
RMNi. The rule then traverses tne oa'tial ob.ect ^mage of the GOL .ippended cnunK
(010) commencng at 116 (CR o' G0L1 CPMP accoramgi/ i. moved through the
discrimination net of RL TM. in tns ^ase, RMN1 s the noae referenced b> CHMP Ir,e
associated DO« properly yields t-ie process TR3 *h(cn f.nsnes a n.potne- zed lrang,e
■mage This is mocated Dy STM "9.0" (r.gure !V 141 af'd « i.iusliated by Figure IV.17
S'hfc a known object is again sugGested. RtC-jVS sets the goai to SK02 and
deactivates
Ruie S'<02i 'of AA-S^S» fires, setting Visu»' Register . aiues accord.ng to the
accomodated ob;ect (tnangiei "age as descr ceo aoo e, changing the goal to K02, and
act.at ng Vl-SVS 'ne trace of 'gu't IV 18 ni cates t-at rult Via f res as a resu.t of
the straighi a-g e On the AT* s,ae Of It»III njmper 8 Vi-SVS continues to mo.e CPP
m the OIR drection, 'each ng .crtt« number 2 Rue Vill fres, whicn co-pletes the
■ conic image n Vi that is 'i.ustrated By Fgjre iV 19 EXP u set to CON. which nocates
that th» e-pe ted ar-^e feature was found but s par" of a compiei ve'te« (more than
2 e>i| d.recd >s, A OuiC<SEE eiement '0431 ^s used to represent verte« 8 m the
iconic line mage
f iurt IV 20 returns aga^ to tne neit segment of protocol. Th« subject also
reaches vertei 2 as a result of tn« role movement Me indicates »«pect?-- ■
/ i
90a Fifur* IV. II
ACT .35: Vl-SYS.
WXZ VI8: ATT & EXP SPECIFIED ANO STRAIGHT ATT SIDE.
AT VERTEX VERB.
MOVE THROUGH VERB
RULE VII1: EXP « ATT A END OF LINE.
AT VERTEX VER2.
DIR IS Ui.
RAN IS LS
EXP IS CON
ATT IS DL
VI IS <L37 P42 P49 E38 WO 141 0« 144 139 145 146 E47 V48 P49 X50 A55 X64 A« 53 X52 A51)
Flfur* IV. 1»
'•
-
:■
rifur« IV.20
® fl
0 00
and «hi» it lh» third (id* [Sll]
Pigur« iV 21
ACT«1:AA-SVS.
RULE K028: EXP IS PART OF VERTEX WITH SIDE
GOAL-IS; K02 14.0 SIM; (Vfl8(CR X5? PNUM P49 VSPEC (UO DR) SPEC TE TYPE VERTEX)»
(P49 X50 A65 X54 A53 X62 A51) ) aarjc» >«*? VSPEC DIAGONAL TYPE SIDEXPAS P25 P«2 PIS ESS MO -
111 Q« I« M5Efl7) ) (Ga 010<NAME TRIANGLE DIM TV. 0 TYPE 0BJECTXP4 111 A12 113*
114 A15 I16P26I33 A34I36P49> ) (V24(CR X26 PNUM P25 VSPEC (RL UL) SPEC TE TYPE VERTEX)... ) (V3(CR Xo PNUM P4 VSPEC (RTA DL) SPEC V2 TYPE VERTEX)... ) 0 0 (> 0
DIR IS 00
RAN IS NIL
EXP IS RTA
ATT IS »T
VI IS NIL
ACT (56: VI-SVS.
RULE VI9: EXP » ATT » NO STRAIGHT SIDES FOUMX
•
) I
9.
sH' '.»«lion and tontinu*)ion of 1h» ci,r'»nl (a«l (ird ob|»ci hypol"»-.») b, stjlemenl
[tUl
Fi|ur« IV.21 prsscntt tqu w>tnl Ktivity M (*• IrKt 0* V1PS »ult "Oti (Of AA
SVS) tires du« to Ir» CON (C0M»'n«di v»iu» 0» EXP »"d th« LM VP« O« the iconic
im»g« ot VI, The 'ule tpiilt tne trjge o< VI .nto two ci''i. verte« V48 »nd he .3?
Th« vartti i"-»ge ■« entered mto 5TM. fh.s s .ndicjted e/ S*v ■ it.ng ";4,0" »"rt
illustrated by ri|ure Iv ^2 Imajt Body eie-ent» IJi (o» 010) ano AS: M VAgl be.n|
linked by the ">A equxie":/ properly 'ne -e -j;e iL37) t chanfed mto a SIDE
type image chunk and ent'eJ nlo STM 'See "1A,0" and Figure IV 23) Tne tND
elements £38 and £4' ft ■ n»ed to INT£RNAt e*me-iis 116 and 133 oi 010
respectively Position type et»ent P49 n ncorporated nto O10, assoc i'ed « tn me
"co'-ier" of 133, A34, and IJ6 Fmiii/, the rule upases C» ot GOL to -e'erence 13%
and oads the Vsjai Peg'Ste' acco'dng to 1 -e object -age conte.t ce'ore activating
vi-srs
; igure !V 24 s'-ows tne asl protocO' segment cons'de-ed he'e Tie subject
ndcates co^peton o* tne . sj« contir^at on ot t^e prcrosea '-ange ot),e;T »"ape
oy statement« [Si?' and [SIS" In I'ame ViO ne «-o^e^ to the r ght to cegm another
•t the comple» «erte« (nun.Be' 3 «hich ne »no«s s tne-e 'VEPTEK chi.n, v?4i
'Tor-espondingi,, rule VH 'o' VI-S^S) sets CP? to V£B1, constructs me 'con,c
verttfi -"aje V*i7 m VI, »nd'.el ' «i1 to VE$ bet0r, cjeaiiwjting nee Mgure IV ?5) As
a hypothesi/ed ob<ect 'ir-age '. he ng visua1,/ foni,rm#d, AA-SV5 accordingly marks
Image Body element., ■,, MAP« p'operty is set lo VES) Thus, rule KOi7 lot AASVS)
tires «nth th« completion ot 010 co-1 rmaton, as £X^ is V£S and I'. 3. be^ng (UX ot (CR
ot CJOL'I, has oeen previously -i ••] 'e rule changes the active goal to 120
I -
' >
'
^.
MH
IM
»«»
Figur« IV 22
v^e i*fy
Tijur« IV 23
^A
I
•Ik
Fl|ur« IV.24
^
vio
Q Ü ftT
«^ gixl
^w* \» «.^«vftNiAi *\*^ thi]
Fifur» IV 25
AT VERTEX VEB1
DW !S DO
RAM IS LO
tXP IS VES
ATT IS »T
VI IS (V57 P^g Xb9 A«2 X61 A60)
ALT «1: AA-SYS.
RUE *027: COAL COMPLETED
GOAL-IS I?0 16,0 STM (GOL OI0(NAWE TRIANGLE DIM TWO TYPE OBJECTXP« 111 •
Al? 113 114 A16 II6P7S I33A34I3SP49I ) (V4WCR X6? PfAJM P49 VSPEC (UO DW SPEC TE TYPE VERTexXP4t XS»
0 Atb X64 A53K52 A5I) ) (I 37(CR »2 VSPEC DIAGONAL TYPE SIOEHP49 P?5 P42 P49 ESS 140 -
Ml 043 144 146 E47) ) (V24<CR X?6 PNUM P25 VSPEC (RL Ul) SPEC TE TYPE VERTEX) . ) (V3(CR K6 PNUM P4 VSPEC (RTA OL) SPEC V2 TYPE VERTEX). ) 0 0 0 0
'
-•
I Hv
92
(Incorporat* 2 • Omantional ebjKl) md Ktivdat 1NC-SVS Th« conttnU ot VI •'•
not Inntfarrtd to STM. Th« YES v«lu* 9l EXP it (ufficitnl input in this CM«.
Rul« 121 01 INC-SYS «irat to >n<aroorit« th« ob^oct 010 ot th« GOL-tpp«nd«d
chjnii «nd <tt >mffl«di«t« vi«u«l conttit Tigur« IV 26 indicttm th« b«IOr« «nd ■tt«r
ttilet of 1TM md Fifur« IV 27 pclO'iu/ illuttratot tn« n«w 1TM contonl« Th«
mcorporjton it KCOmpliih«d by rei<o^n| GOL (ram tn« 010 chunk and copyinf th«
Chun« mto ITM. Th« imag« body ot th« chunk K tnan tfav«ri«d, incorporiting any
chunk containing an |ma(« Body «lamant «n.cn it mkad Dy «quivalanc« to on« m th«
mcorporalad ob.ect imaf« Ounng this travartal, a ne« (tart location it alto chot«n
Thit it on« ot th« contoat chunkt, which hat an unknown X1T »itmanl (typ* UCX) It it
markad m STM by «pp«ndin| th« Spacial «lam»nt LAST to notify AA-SYS If no chunk
with an unknown hnk it found, th« |oal b«<om«t N0M0 (NO Mor« 0b|«ctt) In th«
curr«nt cat« V24 it markad with an app«nd«d LAST, «nd th« |oal b«com«t SNO (Start
N«w Obj«ct) at thown by Fi|ur« IV 2«
Thit protocol - pro|ram trK« companton it contingpd in Chaptar 11.2 «a MctiOn
API
*
THEORETICAL IMPLICATIONS
Th« «>ampl« protocoi-profram trac« («iiMnt illuttratat motl of th« th«or«tical
implication« iwb«ddpd in VIPS. Th« int«|rativ« «nd |«n«r*tiv« procatt Of vwud imat*
ccntlruction batad upon «y« tantory input (p«rc«ptien) it illuttratad Th« uM of
c jrrant imafa contantt to |uid« hoi« («ya) iiwv«n«nt bahtvior and input int«rpr«tatiOn
t iliuttratad Th« batic activity el attinwlation-accommodation n itluttratad. Th«
propotod ima|a ropratantation it thown to b« both adaouata tor and lurtharmar«,
-.uit«d to ita rol« a« a |uid« tor p«rc«ptual activity
/,» i .—«.
-. I
Fi|ur« IV 26
ACT .63: INC SVS
Hu : U . ■..:■■• 1ATE FIRST . ij rCT
16,0 UM
16,(i ITM . .; ■■ -: ..■; A; _ '. ■• ' ■■•.'. : • ■■< ECT) ... ■■ • ■ pr, ■.' PJ5 . ... it ryff vtPii «i , ■ ;Ri •. .• . , ■:■■•., ■.;. rvPl .::• < \ . , ■> .'. j -. . / P-O VSPtC (UO C-1. SPtC TE TVPi VtRIi xi
MS
ASS"
**> l«l
Fifur» IV 27
ACT .1: AA-SY1:,
PULL SNOO: START r.iW 03JCCT AT IMJNKCO POSITION.
WILL START NEW 03JECT AT RSH 0*M
DIRECTION IS RT
AT VEWTEX WO
Fifur« IV 28
/ I ...
G0&. HtlATf 0 EmooEt
'h* p'O«.««« ot Vl^S teicept v;-SySi J".« the ij-e ot ■■< ■ o*. *■ '
pr war, condition 'o' (Oetf" ",'-t O'» 'u*e ♦''■ng Tni ,11 p.,o' *n -(.;■. il ,i'- o? * e
P'OMtO' (pe'Cfptji') DfM. a' as com.it.rj o' a i»'.ei ot goa -o .>"■ I ip ou»'.
^gj-e iV ?9 j'«pn.ra > austrat»'. Itis nterpfeia! o" 0' IX« eumpe p-Cü 3. •.<?t;rr»"t
n |h| <0f"v c' i 'p.ca1 rpisoit» thvl'
Th« chart «nd-cates tHo-e p'OtCKQ. t-arres a»n.cn corrf.por') 10 iare concurrent
«thi th« interred goa. trjns.iio- po.nt» o' tne oe^a- 0< t\/i. V3, VJ and Vll ot tn«
tigur*). Th« vertical i.rvs .na.^a'p a ^«-(jjente o! one O' "Ore no.e le>ei rro.enents
'o t.ie !ett ot e*cn I ne HI t"e "-ame ot tn» current go*, «mch s «cti.e dur ng that no e
(•/ei mo;enent scduence Mid a',sOc ated ben»<iOr ep'Ode To the r.gnt o' »acn
included Irame nur.oe' loraocteui n ..sted an* cur'fl goa1'- «h.ch art active at tnal
protocol pomt, rut mhcn peton-e n»ct .* past) pnor to comwencement ot tn»
subsequent hoi« t .e mo.e'nenl sequence
trfner*»/ rev.e».nj t"e eu'oe, goa s S",3 ano S"<02 «r» «ssocattd wth th«
mM HtC-SVS activation u, AA SYS Upon ret^rr to A*.SYS t-e goa. s cnanjeo to
KO? and tiol»-mo*emenl act ..t,' Begn-,
At tram« V3 conl.ict.ng npu' causes AA-SvS to read <ate R£C SYS « Ih goal B*;
in oidrr to accorrmiodate Hie object .n.age Cioa |K08 results, «hth is changed t,
AA-'jYS to KOi and no'e n.o.cwen| agan beg.n»
Ths goal remains acti.i* until protocol trame V9, «hen tr.e hypotnesi/cd object hat
been tun.p.etc , conlirmed. lt<C SYS s Ktuatea w th goal 120. Upon deactivat.on ot
•
>
Ko2
KOI
5H0
>/l (
VI«
«HO
«Ä
V^ {X2tt
Fi|ur»IV.2»
RMO - Hceogniza Hsw Object SK02 - start Known Ob.ject 3-41iiienslons
K02 - Known Object ^-dimensions RKI - Htrecogniz«, Known Interrupted I2D - Incorporate 2-01atnslonal
INC-SYS lh« tyilM M«VM to th* new lecdien with |0«l SKX Al Uam VI1, RCC-SVS
i« •clivttad to «Ittrnpt rtcogmtien UuftMtion) e< • ntm ebjKl (ged PNO).
Th« goal •pxod* chart« «r« • cembinalion of protof mlormation {Um» nutnbart)
•nd tract inlermttien (interred current |0*l*>. That« chtrlt IIMtrtt« lh« interred
»»ctonntion (ptrtitioninf) el the observed behevior «nd, t* »uch, in impertrnt
Iremeworli lor the evtluelien et prolocel-trtce correspondence. These charts are
used throughout the thesis *s a condensed representation el subject «nd system
behaviors «nd their correspondence. The «valuation section of Chapter 112 uses this
epvJdai nt«rpr»t«lion «t a basis lor ludgmg the enplanalory ability ot VIPS
' I
Cr.opter 1.5 . .. V'.PS E*t**lWW
VIPS >*, Urr- ied m scope oue to the specrf't, t«K - rttaM beha/ior ! r«prtMffttl
and enplans Sever»' n-emory e.v- ■"', and general.batons are necessary to
complete the tneoreticai definition o* t^e visual (cOfrutivt) processor Arotner
component o* long Ter"! Metnory '5 defned and »he conlenl and lünct'On ot ..TM ot
rflPS «»'e genera^ycci and eitennpd The i""aee 'eprp-jenlation and processes -nvO'-ed
n th'ee dimensional vi&wri torn- percept-on must he aeocr-bed A represent at on
genfa'i^ation s necessary to de'ihe a fnore universal v sual irnage'y ability Finally,
thfl processes 0* VIPS must be jene'* zed to e<pia'n the e^e-movemert and
per.p^cra' <ivon factors ot visual percept on
I, K/e^Ofy r»tensions
TCL'M '.Te^pca. - COTpiUa1 Long T»rv Ml wry |
'errporal - Conte«*uai io^^ Te"Ti Me^o-y (TCkTM> is the co^pone^t ot 'Ong le"n
mennory whicn scr ,es as a pe'r^anent repository *or tne ep'.oaa' and cünre^t^ai
■ ntorn>ahon 'epr*>spnt^' on-, I - agft) wh-cn are mti^ly con'.t'ucted a*, the contents o*
|TM (see ( gure VP Tneretc^ the e'e^ents o* TCLTM »re image-, or othe'
mtef.ratfd (tnterrelated» '.»ructur«»'. o* seeded 'mean ngfuO past chunks pi S^M
f ach elemental ^age ot TCl TM nas en 4',soc-ated lane' e'e^e^t ** s laoei a'tords
I
• -1 Figure V.l
Zi:\
the two basic nwins Oi accsss to the inemory image's content. For one, the label
element hat associated properties which specify information as to the time and place
associated with the initial realization of the mafe m ITU These temporal-contextual
information features (Shiffnn and Geisler, 1972) may correspond to properties of a
later, current situation specification. This correspondence affords access to the label
element. Each label element also has properties which reference content element»
withm the associated mage structure. The^e references afford access to the memory
image's content after access to the label element by temporai-conteituel
corre-ipondence has been accomplished. The content -eferencmg properties provide
the other means of accessing the contents of the memory images of TCLTM Just as
tbe features of the temporal-conte<tu*l information may bear correspondence to
cur-jnt STM contents, content elements of the image struc.ure may also be equivalent
to elements of current STM and facililete that image's retrieval.
In the eitension of VIPS, the *inal image representations (perceptions) of ITM could
become TCi-TM elements. Prior to ViPS deaclivation, by a final activation of INC-SYS, a
label element can be created. The final values of the FIPST-ITM, LAST-ITM, FIRST 08
und LAST-OB reference properties of ITM could then be transferred to the label
element as content reference properties. Situational properties (temporal-contextual
information) could then be specified for the label element, also Upon VIPS
deactivation and the accompanying disengagement of the cognitive processor from
percepluel ectivity, the perceptioi. (mage) can become an element (the most recent) of
TCLTM.
Retrieval of TCLTM mage dements is accomplished by an active, searching process
(Shi'fnn end Ceisler, 1973). Ths search attempts to locate an image with temporal-
L I
97
contsiituil or content tdtures iquivdeM '.o tho',» provided to th« process from the
current contents of STM (* search-set). Thau|h en element it entered mto TCLTM
pe-menently, forgetting may occur as a result of the failure of this retrieval (search;
process.
Accessibility of an image element of TCLTM decreases as a function of element age
(Shiffrm, 1970> Tulvmg, 1970). With the equaling of image accessibility to trace
strength, WicKelgren (1972) provides further support. With the passage of time,
features of current temporal-conteitual information change. Thus, the longer an
element it a member of TCLTM, the lest similar is <ts temporel-contentuai information
to that of a current search-set (Shiffrm, 1968i 1970) With regards to retrieval by
content correspondence, the probability of a TCLTM element with similar (equivalent
features) content being m TCLTM increases with elapsed time. The existence of such
an element(t) decreases the accessibility of the initial by being a 'ource of retrieval
competition, confusion, and interference.
Recent episodal and contentual information (memory images) play an important role
>n Many (most) eiperimenlal tests of memory. Due to the capacity limitations of STM
(Miller, 1966), moil typical tests, such as the recognition of c currei.t stimulus at an
element of a prev.outly presented set, necessarily use a recalled element of TCLTM.
This image is readily retrievable at it n usually a recent or th« moil recent entry of
TCLTM, Or may ttill reside in 1TM
When an element of TCLTM is retrieved, it becomet th« current innge of ITM
From ITM, the structure is recallale into STM in part or n a whole (cluing by chunk)
for comparison with new current STM contents. Such comperiton is template-iiKc in
nature being en etlempt to directly match possibly equivalent image structure schema
y i
Su£> equivalency would depend upon correspondence of ''«age element prouerres
which specify wsual features and spat>al inferre'al'Onships During perception if a
n.atch to partul inpul -.ucceedi. the retrieved image it used to guide t'-.e perceptua
behavior as are newly created m/pothewent images
Statement [til] of F'gu'e V2 macates One of tne rare instances of th s Dehavior
wifhn the protocols This scarcity n due to the oscrete 'discontinuous) natu'e of tne
e»periment»i visuel field wh-ch consisted of a series of distmcl (only generally reiafeot
Imt drjw.ngs. In more usua^ continuous contt«t s.tjations, R£C-S>S retrieves images
from TCLTM (»nd ITM) wiln greater frequency. TO.TM was not implemented in VIPS
du« to the rare use of its v.suai image elements <n tne protocols.
The use of retrieved TCLTM images to guide the perceptual activity can account
for Ih» results of Noton md Siarn (19^0). Their results indicated that subjects use
similar eye-movement sequences during th« recognition of a previously presented
drawing. This indicates use of the visual image result (perception) of pr.or behavior in
a subsequent perceptual situation. Furthermore, Noten and Stark propose that a
perceptual (visual) image's content strictly reflect (mc ude) its generating eye-
movement behavior. This is not proposed here. It K proposed Only tnat the sequence
of input views influences image ccntents, as do perceptual goals. In later perceptual
use. th»»t influenced image content« inversely affect th« eye movement behavior
SLTM (Semantic Long Term Memory)
Semantic long Term Memory (SLTM; is an eitension of the LTM implementeu in
VIPS It is thus not a new memory component, but replaces LTM in the final memory
systjm proposal (see Hgure V.l), SLTM IS a semantic net (Quillian, 1968) of a
■« r
III
)
mm I—*• ■ iwMiM ■ w yr '
■n
conceptjal-reist'On^l nature IKintith, 19.'?; Bo*e' a"d Ander'.on. 19731 SvTM hod'.
the Zysten-"* symbolic reo'esppiiton et aö^trac*. (;f?ner^!i/eü, tactuai Knowledge As
such, it contains (as acttvslaWi suo-structures) associat.-e, heterarcn.ca-
rep'esentatiors o' visual informal.on iW^.ton, 1970*
Similar recesentations ol visual intcmation ha^e proven adequate to realize ana
exp'.nn behavior on vsually related, cognitive IMM i3aylor, 197?; Woran, 1973).
Those tasks are o* a more ab'.tr^_t nature t'lar the perceptual activity represented D,
VIPS Ser.'ients o< the iore aostract contents o' SL'W became part.tioned and
activated as chunks of STM (Moran, J973I As chunks ot S'M, tnese segments of
abstract "la.ls" determne (ämde) tne subsequent visuaii/ related cogn,twe acl.vily.
The contents ol SUM ana P.TM are aite-ed b/ learning process Dased upon
(accnmodatmg tol current experience (STM contents) EPAM investigations suggest
RLTM altr ahon means, Winston (1970) investigates a means tor the updating
(learning) ot the visualiy-meamngtui contents 0* SlTM.
2. Three-Dimensional Picture Percept on
Picture perception ditters from other v.suai perception activity as the visual
environment is two dimensional A presented line «wing is known to be ol two
dimensions as an object itsell Thal tome straight line drawings are perceived in
Ihrea-dimensiona; terms i*ilh depth) is • prime enampie ol what E. K Gombnch refers
to «•. the "beholder's snare" ol visual picture per ption in his most interesting book,
Art and Illusion (Gombricn,1960) The th'ee-dimensionai perception ol pictures occurs
m the absence ot the posit.e etlprent indications ol accomodation and convergence.
What are the basic aspects ot the processes and memor/ representations which
I • -
-
100
bacom« involved in th« d»v»lepi—nt Of • thr»»-dim»ntiOn»l p«rc*ption ot t P'«$»nl«d
tlraight line drawinf T What charactanstits ot a irna drawing Itad to its inttrpratalion
and raproaantation in thrM-dmamional tar mi ?
RELEVANT PROPOSALS
A prim« targat for allampti «I quantifying Gattait organnational lawi hat baan to
««plain tha parcaivad thraa-Oiman»ionatity of certain lino drawing«. Thoir belief i« that
th« batic organnatienai lawt of perception will attempt to realize a detcnption of
minimum complomty for a preaented »limuli ("Pragnanx"). At tuch, a 'timpla* three-
direntional perception of a line drawing result« et favored over an otherwise
necessarily 'eomplei* Iwo-dimentional perception. Several studies by Hochberg
(Hochberg end BrooM. 1960; Hechborg and McAllitter, 1963) resulted in the
development of a compleaity meature for ttraight line drawing stimuli This complemty
measure demonstrated significant positive correlation with tha relative perceived
thre«-dimensionality of various presented stimuli tett. Atlneave and Frost (1969)
carried the investigation of "minimum principle1* implications further. Their
e<perimentation produced results which indicated that the perceived slant m depth of
a tridimentional perception was highly predictable from basic simplicity criteria.
These studies all considered the "minimum principle' lo apply to the presented line
drawing as a whole. This was necettary at Getlalt theory offers no enplanation for
the integration of successive 'partial wholes" ot a stimulus to realm its perception. If
such a "minimum principle* were the only source Of three-dimensional hypotheses and
the resulting perceptions, it is predicted that mention of three-dimensionality in the
hole-moving U-.K protocols will o:cur only after the whole line '-iwmg has been
/
'
101
IrtvarMd »t l*Mt one«. V*l, »ubjact« d*tinit«ly mention IhrM-dimantiond idan with
only partial picturt information tvailaol*. Thu it claarly toon in th« Ihr*« op«nin|
protocol MfmonU protontad M F furoi V.2,V.3,ana V.4.
From lh«M thro« initial protocol Mfawntt it it tpparait that local pictura
information (avan ona varta«) it «officiant to illicit altamplt to raalita a thraa-
dimantienal lina-4r»wing parcaption. Simon (1N7) notad tha ability of an attantion
thift to Hip tha parcawad onantatien of a pratantad Nackar CUM tlimulut. Hochbarg
(1961) notad tha ability of local dapth cuts to |anarata propetad thraa-dimantional
intarpratalient. Tha arlitlt MC Eschar and Hoiarth (Saa Gra|ory, 1970) wara both
adapt at craalmf "mpottibla" picturat threu|h a combination of incontittant lecaiitad
dapth cuat (Saa Figura V.5 for an anampi*). Grafory (1970) invatti(atat tavarai local
dapth cuat and propotat that thair parcaptuai af'act ratultt from the mamory of patt
enpariencat involving tactual - visual ceordmalion.
A THEORY
Sinca a Una drawing it itsaif a Iwo-dimensionti obiact, tha initial perceptual set it
naturally toward the realization of a planar or Iwo-dimentional perception (visual
mage representation) Thit perceptual attumption remamt m effect until a to-called
"trigger* vertaa (or feature configuration, in general) it encountered. A "trigger*
vert«« it ona having three e>it direction!, no two being m oppositely oriented
directions (in other wordt, *T* vertices are not included). No trigger* vertices are
encountered by tubjectt >n the tour protocols ditcutted <n Chapter 7. No mantion of
any possible three-dimentionai mterpralationt occurs m those protocols either In all
three initial protocol togmantt of Figures V7, V 3, and V.4, a 'trigger* varta«
,.
MV
v»a
Ml
vi
V«
VW
(D
!
Ml
XJO
^
0 0.
UP
0 (y)
KT
DR
IM«
oiiy [Si]
I IM • corner [S2]
Fi|ur* V2
V-n |ein| le |0 ceund th» •<<(• [S3]
•nd SM wh*th»r I c«n [S4]
il loot»« Ilk» «n uppor cornof of • Mock [SS]
•nd |0 up [M]
• .. «round hör* (S7]
•nd • iMek cornor ef ■ block [St]
_ _ ><
V-
I bot you thi« i« • Mock [SI]
JOWMm ^^ ^^ ^K^m ^M^ ^B^M ^^M
bKk hör« [S10]
th«« worktou»[Sll]
IM flnl drnrtna Ihit I IM [S12]
•nd (S13) • trtpoxoidd bleck [SM] okiy, roTimg down hört ooking for [SI5]
y»th .[Sl«]
(horo't tho bKk ornor el it [S17]
I i - ^
vV
VI
_ ^
- v»\
v<
01
®
OL
— vU
— ^I
v5
1 DOI
10th Fi|ur«V.:
wall, it leoKt Ilk* th* cernar of »omalhmg m partpacliva [SI]
and a iina meva« up '.3 my lalt [S2]
latt [S3]
and I hit ■ ternar whara [S4J •our hnai inlartact [S5]
and I coma back down [Si]
RT
m Lt
1 varlical Una [S7]
than acroaa a ho» «aotai [H]
«0, t raalita that lhara it *
tfLnil. [S9]
with a right [Sio]
with »rijM ingla [Sll]
• 1
M
»X
**>
-A
sS
iW
MH
N«
0 (2) 0
0
0
UL
10lc
MM IM« look* Mw «MI - (S2] lh« bH-nntxt* of • *eM objMt [S3] ceuMbotcuk« u»... ($4) W» «M, which way »houM 1 go [S81
PH try goin« t« hör* [M]
•h. . ($7]
•h» .. [S«I
it leak» lit» ■ tub* »t.M [St]
Fifur«V.4
[tlO]
d»fiflit»ly tw» th» tMUmt* el • cub» (SII]
I 1
■
10M FI|ur*V.B
. '
i 102
cnnviJenlly (kcttl 'mmed *te tn-ee-aimensiOij: ccsde'al'Ons. The perceptuJi .-tfect
of a "trtgäer* ("onf.fJu'.'t on is consistent *iln tne e*per ence-based theory (Gregory,
1970) and wi!n the local application ol the Goctalt "mmimuti principle"
In the u'.ual case, t*o ^erte« eiiit'j of tne trigger .-ertei are oound to an object
face, the "prime face", *h.cn .s perce^ea to De paraiei lo tne picture plane The
third e«'t a-reclion !'. perceived to oe e<tena ng forward or backwai-d m space tdeptni
and oemg the ed^e bet*een f*o "secondar/" 'aces. Tng phrase "m the usual case"
was included in tne descr.pron ol "trigger" verle« perceptions above. Note that when
the perceived deptn direct On .s down, tne usual interpretation is rejected and the
other two vert«« emt directions (St II ol the prime lace) are assigned depth meaning.
Thi.s m»y be »n nnerent result ol tne "support hypotnesis", an assumption resulting
from the norm»! inability ol an object to hang n space. Support is usually Irom below,
denying down as a viab'e deoth direction in pnysical space with gravitation. Figure V.6
shows a "solid octagon" w.th ail eight seconoary face «»tension directions illustrated.
The starred ("•") drawing shows the laces e>tend ng down. In this case these laces
are not percieved lo e<tend m oeptn as uSja. The octagon (prime) lace is percitved
•s the ob,ect top and ent^nds In depth itself.
Tne decision to consider a presented picture in Ihrec-dimensional terms is 1
primary perceptual decision This decision retuits m the apoiication of a set ot
perceptual goals and associated object hypotheses ol currently active goals and
associated object n^polheses and dillenng Irom that realised in conjunction with two
diitensional considerations. Aubrey Beardsiey, m his ornate art-nouveau drawings,
contraposet comple« border patterns and comple« pictorial scenes, both olten sharing
equivalent components (See Figure V7). These illustrations afford introspective
.
.. '
1112» Figur« V.S
/ I
Fifur* V7 >02b
MnlinTakcih the Clnld Anhur into Hit Knping.
..
103
apprKiation el th« «(ftct of th* p»tt»rn or thrM-dim«nsional intorproUlion decmon
upon Ih« VKud «iporwnc*. Thou|h (imlar vituti •l«m«ntt occur in both bordor «nd
picturt, th»y «r« t>p«r,tncad di»*r«ntly duo 10 Ih« dilftrtnct in usumod
dimoniiontlily.
Now m» imitl contidar Ih« «ctivity ol 11« v.sutl processor »ft»' encountering a
"Iriggar* varta«. Al Ih« >tral«|ic avel. Ih« goal K03 Becomes active, which wi,.
attampl lo recogm/e a IhrM-dimantional pnim-type Object Such objeclt are
rtcognmd m terms ol a prim* laco, which lerves lo ntm* the object, and tovoral
associated ucondary 'aces, which usually »re pe'ceved a» entendmg in depth
At with Ih« two-dimensional casa, an iir.üge -epresenlal.on ol the objocl is
constructed m STM EKh fece it represented in a dillerent chjnk. Cnapter 13
d'.cusses the VIPS image representation ol Ihrae-dimensional prism-typ« 0B,ec!s in
conjunction with Ih« dalmition ol the FACE typ« chunk. That« image rhunks s«rv« as
th« source ol tactical mlormal on to g«n«ral« vitja> 'ealur« eipectat.ons and hoi«
(eye) movement specilicalions An assimiUt.on-accomodaliOn process equivalent to
that of Ih« imp'emenleo system is used 10 ether conl.rm ««pectatons Or ailer and
abort Ih« object images (as conliictmg information s encountered)
PftOTOCCk. INOICATIOMS
Tn« action of assimilation-accommodation is well iHuslratad by Ih« initial protocol
segments ol Figures V.2, V 3, and V.4. In Figur« V.2, a block (cub«) image it
h/poltwtmd at a result of Atm V3 (Stal«m«nt ;S5]). That image it accomooaled to «
Irapetoidal block image at V7 (Stal«m«nl [S14]), du« to Ih« cenllicting «■l«rnal vitual
input ol that view.
v *—.——•
10«
In the protoco! seftrrient Of r"<güre V.3, comrnenc.ng a! a afferent ve'te» vocation,
th» tmtial three-dimension^1 interpretation is dropped due to conflicting .rputs
encountered m subsequent vcrte)« views. This o a mo^t severe accommodatton due to
the primacy of the dimf "-..onal dec^.on as notej
In Figure V.4, the subject scans the p'<Me "dee of the proposcu cubic imeg*, so
far acceptrng (assif 'at^g) tne e«t'a verte» extt encountered at V7 into the thrue-
Jimensional perceptc"
SPATIAL GONUfteNCV
fhtrt « one complete-y ne* perc-ptuai factor wnich enter«, mto the 'ealizal^on of
a th-ee-oimensionai ir^age represe^tat'On and perception. This new factor n tnat of
s^at^a' consistency. T "e delerrn>nation ot spat a< consistency involve* tne
consideration of two tacto's One »s the constancy of aepth direction, *ithtn the 'r»age
M a who-e and more importantly for any given ne secn^nt withm the image. The
other is thi» consistency of thr n-depth locaton^i i'Verreiationsh.p^ between tr>i
various feature p/Oupmp.s uert»cns) of the image Chapt« r 13 dscusses tne inherent
arnbigU'ty of an/ I'iree-dtmen-tpnjl interpretation of a pianar surface fht perceplu^1
•.yste'" must construct (by cno'te) a non-amhi.juous consistent vis iai 'Tige
TiRurc V8 illustrates the two poss'bie mconsstency ^artors m «»ample line
dr^w-ngs, Alt of the example^ p'e'.rii ted there a-e incon^stent when perce'/ed as two
• ntprracting cubes. T^amp'e ti .nvOives oniy the ^consistency of perceived deptn
direction for fhe picture a« a whoie riamoe i mvOves both MMNMltncy of dept^"
direction for the who'e picture and ^conM^tenty of perceived verte« locations. This
involves the added irregularity in the perception of pfHW projections when the fac.^i
1
/
-.'-^ *
,'
Fi|ur«V8 i .na
u
III
.- 1
106
•aUntion dirtttion K down. Thu«, wh*n contidarinf lha to» cub«, b it tbev* a, «Mt
whan contid«rin( lha bottom cuba, b i> bahind a. Not« tha inlretpactiva 'laalinc* of
band el tha iquara prima lac« n tha dillannt m-dapth diractions act t« warp that
In aiampia« i and iv, * ftca i« tharad which i« net tha object'« pnma lace. In
!>|ure MI, the »pecial ci«e with down i« «gain illuttnt i. A« with eiampla i, ju«l
d.tcut«ad, the edge« a, b, c, d ol tha «harad tic« >r« incomittenlly perceived to be
«»tending in-depth m one (tha top) ob|«ct related perception, j -d to be parallel to the
picture plan with regard« to tha other cube perception. Again incenfittenciat o)
«patial location« re«ult. Enampla iv involve« the incon«i«tencie« ol perceived depth
direction« lor lire «egmentt « «nd b and the a««Ociitad ravertible depth relatie ship«
perceived between the vertica« «t their and«.
FURTHFR PBOTOCOt INDICATIONS
To illuslr*ta the ellactt ol incomittancy upon tha vitual precast, three protocols
are presented which «how subject hota-movement behavior upon Eiampla iv (see
Figure V.9). Each appandm include« a luliy tran«cribad protocol, an active-goal
api'Ode chart, and a pictorial representation ol tha Imal ITU contents a« interred. The
ac've goal episode charts are presented at ligurat here and indicate the possible
course ol VIPS implementation to account lor these protocols The co.npiete
appendices are net included in this report but are available Iron the author il thit
detail i« detired. Dot« occurring in tha coal epiaeda chart indicate epiaode« ol activity
net straight-lorwardly aiplained.
Con«ider protocol A.P9 whose goal episode chart i« Figure V.10. The «ubject
I
II». FlpjraVJ
i I
002
*»(a
VI
KOJ
wn
Kos?
vis
IW5F
VW ^«0
^HO
«IH
10^b
^3^
Fi|ur. V.10 VT\
KD3
VWV
VH1
^55 ^x«o
SK%
K^C
\fc^
ttCI
vn
Ml^
K3CF
vn
isc
iKf
VM
S«.5
V^ \X10C
¥0
virt
/■
1D">c Fi9iraV.il
/
^«N. '.I
;06
«ttampU to rttogmtt « twO-dimcntion«! < ga't, with goal J02 (nolh^ rt iu((tfl*d ny
th« p»rti»l intermslion) until V9, tMmg vtrlti S. Thu "I'.gger" ve'lr- general« I'*
lhfie-dim«ntion». goal K03 This go*l and tn« accompanying cube "<>4p.p p.Liide'.
behavior until V33 This results tn the full eiternai visual scan Antl cont>r^-ed
perception of the proposed cube At V39, by ttetements [S44] 'i 'Ough [Sie,], tt<e
subject mc cates the realized perception ot the cube and staten-pnt , -• •, nri'fates
attention it now to be directed to recognnmg what N beo« that cube
Al V41, the subject sues ve'le« «, another "trigger" uertei aid '.littetrient [Sbi]
indicates that another cubic goal has been gene'ated to' rons>deraton and
confirmation This guides behavior at the strategic level until V%6, where statements
[566] and [S6o] indicate that tne incorporation process it nav.rg d'ticulty due to tne
inconsistencies of depth direction ana spatial locations of the two cube mages The
behavior from this point on is an mterractiOn between the incorporation (INC-SYS)
process end the AA-SYS P'Oce-.s n an attempt to resolve inconsistencies
Reconfirmalions of the two separate cuues are reaii»ed, but the inconsistencies are
never resolved, as shown by the pictorial representation of the fmal ITM contents
(Figure V.ll). The dotted arrows indicate the conliKlmg depln directions perceived
This representation allows the verba ned report ol two cubes, but tails to be
satisfactory for reproductive drawing generation, as shown by the appendm
Considering protocol A.S3 neat (see Figure V 12), the MM goal here is to search
the outside. The "trigger" vertices don't overcome this goal, which is active until VI1
At that point, the subject moves n-s.de, possibly m an attempt to link up with verton 7,
which he has seen. When this fails he nioves to the Outside, linking this inside verte«
with an outside chunk he has kept. From view Vib to V6I, an eaact goal structure is
' I
VI
106i Fifur. V.12
S€0
,4*1 \«i
K«Z
Nw MV) ^xi»
Tfl
Tfl
MM
N\f
«Mo
M *u»
m
iH-^ (n*
MW at
m
..
106b Figur« V 13
•
> .. :
10?
10 möuce The iobject gone'jiV '<1»y» to tue Sutvoe contou', constjnti, nol^g
'U« lbr»«-ait •,• iOn»i ■»M--'D'et»t 015 01 th»t* ve'l'tes Though tfi» «ora cube it
Oned, the'* does not »roei' to Be My specit.c cubic irnj^es generateo tor
'«-»lion U« «ppa'ent ."to^sMiteiciev 0' !•■■ soluble cuoic co'neri i4 noted n
ment tS721 *t V33 Thus, • appta-s In« ."convsttnce» o* deptn direction!
rated b, 'ne trigger vert ces j-e 'Oted without c-nitr^ctirg compete ■ncontut»nt
images, or at least without attempting to 'ir»t con),.™ these cubic images
it V6i, tnt subject hmMy decde» to colder the p.cture in ".oca'" terms
ements [Sill] to [SI 1 Jj' ThiS .s edji alenl to a aeision to perce..e the picture
vo dimensiona' terms, instead ot Ire th'ee-dmeniiona; concepts •men appear to
■^consistent Th.s is an mdicat-on adth.n tn.s protoco', ot ti-e tundamental nature ot
a decisin from V6; on tne suo.ect operates mtt* tne goais to recognije t»o
■nsionai obie'ts and to "".O'oo-ate trem into i'M with the^r «nown pictona
• onments T<W| mterpretaton s ndcated by tre acln« goal epsode -hart ot the
nd'i l*".ieed, *ith on / silent mooitcaton, tne c^ri-enT .«rpementaton coua be
• to generate be^a-O' 'epre-eniat .e ot in»: toi 3w «g V6i Tn.s activity resu'l^
nc ereaton ol the lira I'Vt repn cental on rs Osp a^ed b, rg^re V 13. which
»s correspo-lenre win the veroai and aa«n desc pi ons ontaned trom (ne
ect
ime final pcjlj o ••, convdereii, &B3 Isee f tst V 10 Again the .niiia' goal here
; sea'ch the outs de iStOi upon completion ol this, tne subiect recojn,?es the
me as tnat ot a cubic prO;ect on, w-ln eitra intema: nes This image is -ncof pora'ed
1TM Th« subject then a'eels attention to beg n n. ng uB the mside directed
I The trigger vertices encountered now do result m the three-dimensionai ntid»
•
^
M
107.
M\ Figur* V. 14
MW
tolilt
SCO
MO (V toc
<au
L00
L10
V^
m
Mil rno
K031
>IV\
Sl«tl
^w ^tx^
\h«l
^l( «to
WH^
Xo^lf
KMlf
>»H1
MS5 (t
MW
X"M
> i
107b
Fifjra V.15
I
«-
108
Ob|*ct proposals. A Mnts of perceptual ^t-atej c |0*is bxemtt »etive. as shown in
'■•» »p sod» chart, which rtsults m th* scannin| and o*rc«iv<n| ot th* two mtarnal
cubas. A(ain In« final Mtcnption is not fro« of tfflbi|uity or mconsistancy (SOP ~>gur«
V lb). Tha tact that th« ITVi representation contains tn* out'.oe contOk' .mage allows
th* tubjtct to anchor the drawing witnm this cunsiStanl two-dimonsionai framework
and achieve a correct d'awmg The verbalitations dunng drawing end the sequence of
drawing (outside contour firsts favor the inferred 'epresentation.
Consider rf, these three protocols in full, one is afforded a greater appreciation of
the ability of the proposed mp.emenlation (perceptual theory) to assiimlale the
entensions necessary to generally account for the perception ol line drawings in
three-dimensional terms. The fieubnily of the proposed image repretentalon is well
illustrated by the e>amples, also.
'
.-
109
3. Can*r«lmd Visual Imat* and Percaplion Sytlam
What ara Ina ailantieni a.id mo4ilicat«n« naMMary to tramlata ViPS into a
syatam rapraunting, and thut ejpu.n.nj, tha compiala numan vitual mtormation
procaisin| lyslam ? fit%\ of Cbncarn 1% \r.» imaga raprawnlalien ittall, in tarmt el
what altaratiant and additions -utt ba mad* Givan Ihasa base imafldry
(rtpratantation) changa», th« nacataary mediticatiOfl« to Ina propoud visual precassas
to accommodat* and us* tnas* aitaratiens can ba considarad
IMAGE GENERALIZATION
Tha imaga reprasantation must ba a'tarad in two lundamant« ways. First, it must
ba suflicwnti,- ganaralnad to ba capabla ol amüodymg all pessiWa (p'obabia) visual
term parcaptions, net tust the restricted environment et straight line drawing»
Secondly, th* mate reprasantation raowres an alteration or addition to adequately
represent th* incompiet* informational input provided by peripheral vision. Th* hole-
movement teak which hat been modelled by th* implemented system a«eiudes ail
peripheral mtcmat'On by masiung
Th* course tahen to realm th* genaralitation ot reprasantation ; to propose
ganaraliiad image chunk end OX classes. Figure V.l» presents the chunk end
image body element types Ot VPS end their associated g*nerali»ed «lasses Th*
general image chunk classes are not dascrib*d lurther below, aa their neewe indicate
th* concepts represented. Th* mate body —I generalneliens deterean* th* form
ol the mage structure ant are t|—t
110
ELEMENT GENERALIZATIOMS
Th« im«t« body •■•ntvnl CIMIM «r* dtfintd by lhair iiwmbart' function within an
im»|« body «tructur* and «r« r»tu- I throufh • |*n«r»li|ttion el the«« «Itmcnt typM
UM4 in VIPS. InvarMly, «Kh VIP. •l«m*nt typ« it a tpKiiic in«t»nti»lion o» on« of
th« |«n«rilii«d function»! CIMMI to b« d«Mrib«d h«r«. Thi« Mt et ■•nardind
element class*« and th« >nt«rr«l(ting mlerconnection» which ar« allowed ar« »utlici«nt
to produce ail visual form image representations
Th« X|T type «lement 01 the implemented system it an enample ot th« functional
class of elements which inlerconnec' ima|« body »lemenlt of chunks rapresenling
spatially disjoint information. An «lement A of this class normally r«l«r«nc«* another
•lament B el this das» through an interconnecting link of spaca-lrsversing maamng.
Element B relerence* «l«ment A through a hM of accordingly inverse spaca-lraversing
meaning. Element A and element B are in separate mag« chunks. Each «lement
references a Position type element which specifies its location withm the currently
bound locational frame.
Each element of this class will have properties which adequately specify this mter-
location (Spec«) traversal Using th« X1T element as an »«ample, each KIT element
specif.}* the direction (OVX) and range (RVX) of the tpaca within the visual field which
it representationally traverses. These two properties are sufficient to define a
straight line segment, given the perceived location of the nitial KIT element es e
starling location for the line segment. The referanced KIT alamenl (by LVX) embodies
complementary traversal information to allow th« link to be meaningfully traversed
(•massed) in either direction.
/
. •
lit
This tnversal of space or change of iocalion m»y be across figure of ground. The
XiT elementi »s prooosed art consistently ut.Nzed lo tra.erse the figure, emDOdymg
an enisling line segment Elements Of the i^nerai ciaS5 mjy r_,pan "empty" or grour.d
space lo interrelate altering irr ge chur-s of differing petcoived spatiai locations
An element of this functional class also prov.des tne necessar, no' ^pa^e-
traversing links to otner image eements within the same chunK. An XIT element
provides the links named »y the propert-ei DiVl and DIV2 to interrelate it with other
(ANCLE) elements of the verte« or Ulm chunk i ■ which it beongs.
The functional element class representing a genera nation of tne -mp emented
irjItHNAL type ^mage element is similar to that iust described. The elements of this
functional dass are pnmarny used to again span lor<- ions within the visual field
(image), e«ceot tnat this link is now between elements ol the same chunk. The
1NTEP'*AL image elements within OBJECT image chunno epres^nt and allow traversal
of Jbject i ne-segment sides Again, the Imki are between two elen.enls of the same
clat', with complementary spatial information allowing meaningful traversal in either
direct, m. These elements alle v the image representation of visua concepts which
span locations by tieng tcgether spatially dt.ont groups Of visual and spatial
features.
These mtra-chun» space-traveling elements provide local (Same location) links to
other image elements of the chunk which are embodying other feature information at
that perceived location. These local links necessarily maintain attention withm the
chunked concept when traversed ("figu'e - ground" distinction). These elements allow
Iheimage representation of visua concepts which span locations by tiemg together
spatially dis/Oinl groups of visual and spatial features. The INTERNAL type e^menls of
M
112
the implemented system provide one tuen unk, named by 01V1, within «ny line or
Ob,eel chunk.
The tunclionel class wt en Ine -NGLE element ol ViPS »«emp.il.es is Ihiit class
which embodies the se! ot "iterestmg visual features found at some location wilhm the
v.^ual 'ield (mage). What (e»:ures are ot Merest, ana thus embodied «.tr.n such a
feature element, s determined By the act"» vt%utl perception or image D'Ocess.
These feature elements also provide If« necessary means for thtir traversal by
direded attention through ll-e mage representat.on. Tue ANGLt type elements of the
propO'.L-d .mpiementeo ^ysl«?". pro/.ue the i.nks n« .ed by DIVi and DIV2. *hich aliOw
theirconsideration and through-lra^ersal to an .nterre1 ted 1MEBNAL or XIT type
element Traversal of a feature eement within an image rep esentation does never
invo.ve ary change of perceived location. Traversal of tne .nte'relating links which
they provide anows access to elements or elements of the ruage oistmg at the same
localon wlim the same chunk Fe<ture eiemerts of dif ering cn-inks may be linked by
equivalency.
'ine last generalized funcl'onai dass is discussed "-Ow. This n a generalizal'On of
the EM) type image element of the impemented system Elements of this funct.onai
class are u'.ed m .mage chunks *h.ch represent space travers^g image concepts
wh.ch cannot be satisfactorily specified solely by properties of spacc-tr^/ersmg
elements Each sucn chunk has a pair of tnese End-class elements, wh.cli are
eitemally leqjivalenti/l mterre ated to eithe» a pa.r of mtra-chun« or a psir of inlra-
churk spaee-lraversmg elements. Tne EfJO e ements Of the implemented
representation are linked to XIT elements when in UNI chunks, and linked to INTERNAL
dements when utilited >n SIDE chunks Their function is If. link the > implen space
^ I
113
trtvarting concept which it« chunk tmbodits (SIDE or LINE) to the «ppropriett
•Icmim» o* other chun)" «t its ends.
The Petition typo element M 'I het been defined, dxcutted, end implemented it
alreedy sutliciently lonerelized. The epplicetiOn of the futzy plener location reference
frame in cO' junction with a timuariy bound lutzy depth reference provides the ability
to a'.sigi perceived or imagined locations et observed. The Chunk-Header element it
provided as a meant ol gaming reference to an image chunk and to embody general
chunk information, such as the chunk type. As such, with an apprupriele extention of
utefc'e symbois, this element it Sufficiently generalized aito
Thus, an of the image elements (eicept the vJolCKSEE, to soon be discutted) have
been generalized to realize d>si'nct functional classes. It it proposed that these
general element classes may be slraght-forwardly instantiated to realize a visual
mage representation of any probable v.sual fom environment The image
representation of ViPS li an <nstaniis*'On for tne env.ronment of straight-line line
drawings
*>
114
PERCEPTION SYSTEM GENERALIZATION
Th« memories, th« proctitM, *nd th* inl«rrtl»tion»hips e«ithn| Mtween th»m
which art discusstd in Ch«pttr 1.4 form th* bmc system ttructur» 0< th« human visual
processor (FifurM IV.l, tV.2, 1V3) TCLTM «IM play« an important reit, at ducuitri
••rhtr in thii chapter (Fi|ur« V.l).
Th« perctptual theory slated |«n«r«lly it that success.ve ptrlial '•pr«s«nt«'..o-n
of th« ««tarn«! visual environment art mtanin|lully inttgrattd by th« assimilalion-
accommodation process, with appropriate aid from m« recogr lion and incorporation
procets«*, to r«alit« a complete, visual imafe representation. Th« tmal image
i epresentation it capable ot generatinf verbal and drawn descriptive outputs and ot
generally guiding behavior within that given environmental content II resides in ITM
at a structure ol interrelated image chunks. It it necetsary to reca1 nto or maintain
in STM the image chunks ot interest to actively guide or produce such relateo activity.
THE PERCEPTUAL GOAL
Strategic control it maintained by an ever-pretent internal state, the currently
active goal. Tht» currently active goal it fundamental m determining what information
of that which it currently accessible and available it relevant and worthy of attention.
This goal also influences the c'iss of image or other representational structure into
which the currently interesting information it to be integrated. The active goal, m
coniunction with tne currently attended image content, it basic to the determination of
•yemevement and fuation point choices. Thus, the goal influences the structuring and
attending of the perceptual image.
'
115
'he questron «ri^es: What is the source of th«se goai 1ypesT The in<t>al gcal lypt
to become active li pnmeniy a der<v«t ve ot the current overall cognitive goal t/pe
active prior to the mit ation of the v tja> percept.on. An/ sensory stimulation is
interpreted in light of the pre-eostent ana reactivated slate of the system The
subjects of the hoie-movement tis« naa as their pre-sel cognitive goal one reflecting
the desire to achieve a perception c the presented line drawing siftioent to enable
subsequent verpal and draw.ng reproduction. From trvs goal were derived e tner the
goal SEO or me goal "NO, bemg tne first active goals of the two implemented
perceptual strategies
Given an initial goal cer.ved from a pr«-p«rceptiOn condition, the sequent« of
currently active goals is generated through an interaction of the active goal and the
available visual (com and mage (STM) information. Tmt i< the essence of any
»ssimilation-atcommodaton scheme; 'he stncl mterdeoenHjnce between currently
active goal and the currently available information of the image representation.
At any point, the interaction between active goal, active image contents, and tie newly
fiirated visua' .nforn-ation may result in the initiation of a new active goal A network
of uni-ieveMed BO*1 transition'., was inferred from tne observed behavior of the hole-
movmg task. With the avaiiab'lil> Of penphcra. information, some . arkmg of goals,
due to the muliplicity of hypotheses possible w<ln more input information, may occur.
It it proposed that the stacking of hypotheses and goa s withm the v sual proress is
still very shallow, probably of a depth of at most two or three. Tn t is a direct result
of the strong interdependence between the icon and accessed image and the acti/e
goal during as^ mlation - eccommodaton. This interdependence redcces drastically the
value of any long 'ange plan of attack embodied «ithm an elaoorale slacking of future
goals.
11*
Support tor the rolt ot in Ktive goal ((Oil typ«) in the human processing ot vituil
mtormation comes trom several sources eatemal to Ihs th»»is. E/emovement
record'ngs ot reading activity mdcale the goal-onented direction et attention across
hres of presented te«t (Yartjus, 1967). Yarbus reports thet varying the instruct on»
concurring the eventual questions to be aswd about a presented complex picture
grtitly ailers me iubject's eye tuation Ktivity. In more rudit.entary visual search
iMkl involving target location <tNiil ams, 1967;, search patterns wer« «hewn to display
random charactenttics only m tne absence ot nlormaton about tn« search target.
Th«s« studies indicate 'he atlect ot a pre-set cognitive goal upon the subject's
direction of attention withm a presented visual environment Th«ir results indicate the
clot« interdependence between the act ve perceptual goal and the presented visual
environment throughout the Subsequent visual orocessmg activity Area^ e» th« visual
•nvi ^nmunt ar« luated in accordance with their believed relevance to the perceptual
task.
A p »msiing goal liMwis« has bean shown to hav« an «lt«ct upon the
represenUi.on ot th* visual perception. Cnase and Dark (1972) conducted an
e»perimenl mvol inf the comparison ot picture* and sentences tor meaning
equivalency . When the sentence was provided first, the subsequent encoding ot the
picture appears to be contingent upon (influenced by) th« lorm of th« sentence. The
Mnt«nc« provides a pra-emstent goal dnternai state) wtv n guides th« development et
« picture representation suited to the required comparison.
PERIPHERAL VISION
Peripheral vision input, IN prmtary informational ditlerence between the
H-» .
/
117
implemented and |*n*r*lized procttsinf system, appe*. to play two '.igmficanl roles.
First, m conjunction »>lh any currently proposed perceptual hypothesis or Ktiv* goal,
it is instrumental in deleririmng the necessary pre-set range and direction for
performing saccadic eye-movements Hebb (19491 noted tnis role of perpherei vision
input. The use of cutra-foveal information m the selection of a new fmation position
has-been contirmed from data obtained in several visua search tasKs (Williams,
1966:1967). Either the direction and range of a succadic eye-mo/emenl is pre-set by
AA-SYC or « peripheral element of the -jrrent icon (see below) is marked as the area
ot the visual field to neit fmate Vl-SYS, with access to the icon (VI), could then ittelf
generate the direction and range m terms of a f.>ed retina> location relation. VI-SYS
would then deactivate only after proper.y t »at.ng the prior peripheral area, this
posibly involving one or more corrective saccades
Secondly, peripheral vision appears to play a significant role m both generating
and confirming proposed hypotheses concerning the eiternai visual environmunt,
supplementing the more arcurate information Obtained m the fmation point area, in •
visual search tasK involving pattern discrimination (Gould and Dili, 1969), peripheral
vis'^n appeared to supply sufficient information to allow superficial judgements ot
pattern "similarity" and to effect accordingly the probability of toveal fiaation of a
paltorn in a matching task Entemal research indicates support for both processing
roles ot peripheral vision that are proposed above. Directly acquired date ot
E«perimcnt II will be seen to provide data favorable to this interpretation of
peripheral vision's roles m perception.
'
M
118
PERIPHERAL INFORMATION REPRESENTATION
Tha propos»! for the represenl»lion of the panphcnl vision input to th« visual
perception system is to lenerdite upon the QUICKSEE type imige body element. This
type Ol element has been introduced into the proposed representation to realize the
inferred incomplete embodiment of verlea information developed m the case of •
subject moving continuously through an encountered verte« It is this characteristic Of
incomplete representation which is proposed to typify the available information of
peripheral visual input. As such, an appropriate generalization of the QUICKSEE
element is proposed as the entension sufficient to embody peripheral information.
This element, in its generalized form, will be called the Peripheral element.
Elements of this class are proposed to embody a density measure of possible
interesting visual environment character tics at locations of high discontinuity in the
periphery. Which ol the ava.lable peripheral elements ar* considered at any pent is
again a function of the active perceptual goal An element of this class references a
position type e'ement embodying its fuzzy location m relMSr- to the fixation location.
The imagmai space of perceived locations is not known at this («fOmci stage Of
processing These elements fail to provide any interrelating links to otfw image
•laments of the visual input. These two stated characteristics ere the results of a
consideration of eipenment II data to be discussed below.
'hu adequate representation of peripherally available visual information by one
such symbolic element type is admittedly doubtful. This is due to the indistinct
dichotomy eaistmg between foveal and peripheral visions There are not two separate
and distnct levels of visual acuity enisling, as such vision dichotomy appears to imply.
_*..' y—»..
I
Ill
Instead there s a continuous, tnough rapio^ cc ■■■ i ■ ■; level of visual acuity with
input visual ang i eccentncit/ (Mandelbaum and S ojn, ;947). There is not agreement
as lj the actual area ot the visual field consia.red to t5e tOveal vis'O". though
generally the est.Tate s somewnere oelween a i to 3 degree central angie. As such,
thero Tn« distuiSiOn assumes ttiat visual acuity n reialed .0 the amou't ot toaturcs
available tor reoresenta! on and thus to lha type C symbolic elewent which nay be
util.?t'd tor such encoomg. As sucn, tnere may not oe one spent.; eiement t/pe which
is used to represent ^npnerai vision intorrmation.
In tne discussion to toilo* concern.ng tht proposed visual processor, ine
generalizeu QuiCKStE (per.p'ieraO element .s used ihd vonlroversy concerning such
a proposal is simply oemg duly noted r.ere. The basic hypothesis is that peripherdi
v s.on content can De '..'ticient.y represented, oy oscrete symbolic means. The
discussior ot data to loiiow indicates support tor th.s nypothesis.
THE SINGLE (INITIAL) FIXATION
Part 1 ot Enpenment II was designed to give some results relevant to mtemng
what information oecome'. ava labie from an imt.al fmat-on upon a presented line
drawing As such, and as noted previously lOapter 121, each line drawing was
presented for one quarter to une-third of a second duration with the fnation point
beinj pre-set. Immediate', upon removal ot tri» stimulus the subject was to
simultaneous!/ draw and veroame his pa''iai percept on of understanding of the
drawing. Thus, the results not so much reflect the mmediately available ".conic**
memory as they 00 the rttultt of the processing of this input information by the
perceptual system. There is nc attempt to interrupt the processing to get more direct
I«
indicitio^s ot the iconic reo'esenUtiOn (the con(er>ts ol VI in the proposed s/sterp) as
done b/ Sperling (1900). Th» pnmjry .nteresl h»r» s to oetermne whit are the
possini« '«suit» ot th« process"-! ot th» inititl jl»ht». This can yield indications as to
its intluence over the subsequent viiual processing which would tollow
The results mncate that th« mtist glance is rdeed a val.abi« source ol perciptual
hypolhesL-s, in the lorm ot constructed wages »nth hi(|h torrespondenc« to tne
features ot the input mlormation These images serve as tre basis lor the operation ol
the assinniUtion-accommodation procedure, which accordingly directs attention and
develops a tmal consistent representation ol the presen'ed stimuli
The discussion to to o* relerences Appendu A. ■ nation. The appendu conttun
several groupings ot data and associated interpretations Each grouping begins «IWI
the presented stimuli, with a star (•) servir; lo oenote 'he P'e-set li>a!iOn location
The tollc«ing page displays a sub;ecfs .eroa and dra*n response to Ihi presented
stimuli. Following this is a pA^e ol intermed'ate >nltvpreiation ol this re'.ponse in the
lor-n ol pictorial representations ol the mages tonstructed and their reatonship to
Itie proposed icon image
To begin, consider group I ol the appendx As can be seen the ' ..n on pomt was
m the lower tell. Figure (a) ol lh« interpretations page (page 3) « the .nlerred
contents ot the visual mlormation cell (VI) at KM l.iation point There 4 • tun
represenlaliCi) Ol the inmediate, Imated corner ana tne circles indtate per phtral
mlormation elements wh ch embody visual lield oitcontmuitiet as discussed previous
n the chapter. As noted above, no attempt was made to get more direct indications ol
this input representation Through the discussions to follow, 1 hope to snow that this
representation (involving the peripheral elements m coniunction w tn a lull luated
..
121
verluM rapraMnlation) bears some function«! r*l*tionship to th» oblainod rotultt Thit
is still *n uncortam araa, natdmg furtha' aaparimanlation.
As can be seen from tha «afbal and drawn response (p^a 2), the subjact reacts
to tha "trigger* verte« that has been Imated and accordingly proposes a cubic image
for verification. This is seen to lit fairly well with the inferred input information, as
shown in Figure (b) of peg* 3 of the append.« The subject apparently further
notes the amslance of tha peripheral element net accounted for by the regular cubic
projection shown in tha middle of the middle edge of Figure (b). This lead» to
uncertainty in the initial proposed image, and so to the transparent image development
as noted m Figure (c). Tnis response indicates the influence of peripheral vision m the
development of the perceptual image proposals. With no peripheral vision the
proposal would have been only that of Figure ib), as occurs repeatedly in the
protocols of the hole-movement u < W.th the peripheral vision a problem with »hat it
noted, possibly resulting m two rompeting images for possible confirmation This could
serve to direct attention i-Mmediataly to th* trouble spol to determine if that can easily
be assimilated mto the initial sond cudc D'Oject on
Group II is now considered As can be seen the fnation is m the lower left, and
the inferred input is snown M ' s-.-e tal of the ihltrpretations on page 6 of the
■ipprndu Tre subjecl notes that the ealernai outune * that of a square, again noting
the importance of tnat strategy o' . suai perception, as previously embodied by RAAS
for the nole-moving task F.gure lb) indicates how I'M! image proposal could be
related to (drnved from) the interred input representation
'ha "trigger" verte« tnat has been I nated leads to an attempt at three dimensional
interpretation again. Figure (cl indicates a possible attempt at Mtmg this perception
/ :■
m
propotll to th« input r«pr«vtnt*tiOn. Th« sub.ect doct ptuM «pprtotbly |)t*r nodnf
th« thrct-dimtmional pouiDility. Th*rt «ppttrt to h«v* Been too m*ny
>ncen(itt«ncits •■i»tin| ottwetn Ihit im«|t propo»»i and th« input mtormttion. Thus.
th« subject rat irnt to th« im«gt 0) Fi|ur« (bi to gu.d* th« Htimild'On-trcomodotion
procest. Th« need to d«t«rmn« th« interractiOn et th« mwtrd dir«ct«d lin«t *pp«*rs
to be th« jo»! which neit would h«v« oeen utilized, as in RAAS lor th« holo-moving
Again, peripheral vision appears to have a valuable position in the procev.mg It has
provided ■.utticient inlormation to load to an apparently ralh«r certain "sq_.are"
propose lor th« «iternal ed|e w thout lurth«r &cannin| rtou>r«d The imai«
hypot iiiii without penphera vision input wOmd h«/« oeen tne cub<c pro^ction imag«
Group til turtn«r |wes noications Ol both p«riph«r»l vision's power and ts
limitations Two subject respo> ses arc included in this group As seen the I nation is
in th« lower corner ol a Cubic j-o eel or Figur« (a) Ol In« interpret«; Qns (p«g« 101
indicat«s th« inl«rr«d input mlL fnadon
Both sub|«cts report seeing two '.and B-o-• t,pe OD,P Is Figures ID) «nd (c) on
page 10 Ol th« appendm moirate possible "'»"»jt.ons' >■ oelween In« two
proposef object percept O'i and in« mput information There on« 0D|«ct has b««n
COmpl«t«ly bound only to p«r.pn«»al ««■"«nts '.t s not c«ar |h., ,c • , de'i/ed
Irom those «l«m«nts, as th« 'i' ;ge'" v«rt«> ol th« • >al on ar«a has «a to «n attempt
at a thra«-dim«nsiOnal int«rpr«1atiOn n tn« lor«gouno Ths tOu-s« Ol inl«rpr«tatiOn
sur«ly hat som« elt«ct upon tn« d«v«lop'n«nt ol th« proposes cub>c image
interrelating th« oth«r p«riph«ral elements 0* th« visual inlerination Ths ino««d s «n
indication ot th« ability ol p«riph«rai vision to »d m th« proposal ol p«rc«p'uai
imag«s, at on« object proposal mterr» ates toi«ly p«rieh«ral information «latMntt.
/ !
,1
123
^el, botn ^^Djects were wcet' coice'nmi lb» bpat il mte'relationshp ■ ■ sing
Del*een the two ob,ect prcpo^»l4 (See drawn responses) It appears tnat tne
periphera, elements JO not adequately etaoay all Of the mformat.on nertssary' to
propose or rea'^e the eaj ••^ency ana other spatial n'erractiOn re at ons whth »ay
occur betwee" oojects Tyrtner eve tiial.ons are rejy red to tully atveop these
object interract Oh repre'.p^tat ins
In conclusion, the -mt.a ' lat'On -s a source ot perceptual hypotheses Um9$ß
chunHo» These i>ace c^unkl pro..'je a b(M 'o1 sjOsequent assimnalion -
accoroaatio" ^-.-rpnerai "'or-hatiOi P'a,'. a jign.lcant role ■ (orxung t-^ese
proposal. The represental on of perpneral i-pul mat is proposed appears to be
tuncVonally adequate as a bMH 'or th« erp'anat Oh ot the be'a.iO' obse'-eo
EVCMOVEMENT S^OUENCtS
Attenl-on n-w turns to a dsCuss.on ol several ol th« «>e moveh-e-t protocols
obtanea through »art 11 o' E^perirrenl II, ippen:.i AxVEMOVE contains tght sets of
data Each set to-sists o' a page iiiuitratmj the eye^ovement sequence ooserved for
a suhject upon '"e I ne drawing shown An tnit at sect on o* the eyrhove^tnt sequence
has ueen approprate'y mlerconnec'ed by aotled IMIM Two numbers are associated
with each dotted fmat.on po M Tne »at On number (•> tne sequence is given, and then
n parehtnesis the dur. i.on of the fnation m smtieths of a "econd s indicated,
following each »yeirjvent ■.eq„ence it a page presenting the resuming verbal
descriptive resp"ns • obtained and the subject's drawing 'rom memory As mentioned,
there are eight s'.ts, two subjects on 'our line drawing stimul. These ime drtwings
were used previuusly m the hoie-movng task No subject recall ot th« compiet«
pictures occurred. This md cates tnal TCLTM images did not p ay a significant rol«.
/
k ^—.
;.
124
On* Eenerjl data d'^ension to consider a th» di.'aliOn of *y* ImatiOn. The g'apn
o* F gure V.17 ind'Catei that (nation duration varies. The activity o' assimilation -
acco-oaation requires vj'/ng j-rjunts ot processing at oach i.nat on point, a'i
enempiifie'i by V1PS Asso^mg that i.iat an duration s directl/ related to tr.e amount
ol ■.■■■■■.■■■.) done at a f'>at<on, this genera< <evei of data consideration does not
discourage an assimiialion-accomodaton eapianatiOn
More specifically. Figure V 18 presents the imation aurationt (or the first four
tuations of t^e eight sequences. In an out one ca'.e, the first fuat'On is tonsistently
longer than the second (actuany the largest of the first four) and th« difference
be'A en their averages is significant The initial fmation net been described as a
source of perceptual hypotheses The duration comparison indicates W such
entcnsu« processing may be occurring at tnat po.nt The eiceptional case nvolvcs a
line drawing which «eludes two overlam objects (as per« ved). As the equivalent
exampes of V1PS ectivity mdcate, this may cause re-recognition (image accomodatibn)
which results m «ppropr ately longer fmation tmes during the ob.ect scan tor
ci nfirmation
In general a relatively lengthy fuation it followed by several shorter Imation^.
This is favorable to th« behavior interpretation proposed here. Recognition activity is
followed by several (nations for hypothes s condrmation (assimilat on) or reiection
requiring image accomoJ..* on. Tn« variability ol hypothesis success and necessary
•nvironment assimilations during confirmation yield th« irregularities m tn« cycles et
fmation durationt.
To facilitate discussion below, th« livation durations hav« been cass'fied
Durations ol 8 to 16 lirtatN of a second «re short (See th« bottom ol Figur« V.17).
/
Hv M
124«
• • >••••••• rifur«
._.
M
124b
Fifur. V.lt
1 2 3 H %i | is to \f IS 1 f» HO to \a •ss ^2 19 o w n 1
«»qwfiK.1
%* \5 \\ i« |
-il 10 U \\
*4 1 as tt av \% !
H3L 1 %0 HV tb
1 H1 1 XX Ho 1 vi !
«4
^
,. ■
\n
fi*i\iOni from 17 to 27 s;«l'«ln5 of ieco^ t'l "(»mea'ttt Fmlions o' 28 to 4?
5i<tiol1s of a in i t'9 leg a'-o tiose tntt fe tor^- iMI *rt v»ry lor-j Tnu it not
a ci«5sific»liO" based uoon (tttittical iiusief 'g
'40w considering *r,p ftr5t e/e-n'Ove'^^nt .ilustration SI In tfrmt 0* fnatton
••rgths the first 'S rntern ed^ale, 'oitowed b/ two s'ort t'<at.on*. Th« f-rst f.» <• on nas
been noted abo.e as being j provtaer o' propo-.ea pe^-epfual (visual) tmagt". fha
two foiiCwmg QL.C« ' .atics can te t^en interpreted as lunctiOneUy confirn.i'-g feature
group'ngs as proposed The fourth ■-nation is aga-n mterrnt jiate i« length, followed
aga ' by two snort ft»a*ions Thus, as interred with tie hole-moving ta'.h, the subject
aopears to be engaged m t c/c.t*l aopcaton of the -ecogn t on process n
lOoperat'Or with subsequent er«?■'nove»»^^^ g^ded by (he assn iat on - accomoaat cr
process on tn» besis of mo'e "nages p-opose': icorstructed) in STM 3otn f «ations 7
and a a'e nter^efliete n 'e-gf-, 'oiiowea r>/ a long tuaton 9. Tn s coud .-dicate a-
incorpo'a: On pna-.e »or f-ose 0B,ects tnus far sat stactonly confrmed The suD)e:t
t'-en commences to rescan the picture, vewing fu-tner parts jf the pclure p'e'iOus/
seen on:/ Ihro^g- pe-pne'a / I oi- Tn.j could be to fully deveiop "e rep'eser-tation
to b'> suffcie-l for orawing purposes
'urnmi to sequence PI, it 4 noted trat the sta'ting fiiaton po^t offers. This
was no' inlenoed, but did ye'd an nfe-est ng rjsu t Agam the subject engapes in a
long first 'iitation, followed by two short • »atons "he higner 'cat on o' t^e m t a
fi»at>cn has apparent:, »lowed a oe"e' oe'ceptud "i^e b'ODO«..! 'or tne top fifu-e
of tne ine drawing man .n '»q^ence SI 'n s has J'awn tne attention of t-e
perceptual process to that figu'e »a'ner men m SI Ths difference 'S not only
indicated m the ere-morecent sequence, but also is carried through mto me seqjence
of fre verbal description
•
> .. '
kH
XYtn subject (P) ulilifts long t<iat)Ons more treq^entl/ than «»bjec* S This couiO
Oe >'idic»tive of a no'e pece-meai «pp'Oicn 10 ■ncO'POf»lion. Tne top obiecl mty oe
.ncorporattd at fialion 4 ana tne •,..- r»ctan|:t '~ tne rrght may oe recogniea ana
incorporated at t.aion 6. This wouid imp;/ an mi a ly heavy reLance bpon peripheral
intorrr.ation 'or obiecl 'ecojni! on from a genera analyse ol the sequences recorded
and those ii'uslrated • the appendu, it appears that srch miti*l reliance is utilised
This is foi'Oaeo b/ a '»scan o"en ^ sit ng teatjre ocations previous^ not tmatea
Ott»" 'a'er al'ention .s reo'ected to areas ol oS,ect mterract on several t.mes,
apparent!/ to conf.r- the proposed maje nte^actions. The .o«er right corner ot the
ngnlnand saua'e s ne.er I »atea • H, «hie other mit -act on areas near Ine tenter
ot the p'tti^e a'e re-'.ialed t'equently Tne sijD.ec! fas ditticull/ «hen ara«.ng th.s
pcture are». T" s «ojid cceiso-o to ("e naa. ;, o' pe'pn»rai .niorrration to
emcud/ oo.ect image mterract o-s accjratey . rotta trom th« singie 'nat on data
discossed above
3? and PZ involve tn« pertepvon ol an mposoioe 0'a«ing *nen con'.iaered three
OimensOn.'l/ Hoie-mo.eme-1 protocol» nvoivng tn.l stimuli «ere prtviOiMly
n • i.'.sed with regards to tne 'nree-d.menvona. eitenson ol tne orcgram^ed system
One thing ot interest -n the S? sequence ■'- the s^o ect's renance upan per pne'a'
. Mon tpr tne perception ot [he bottom ^ube Ine ''ont face ol tnat c^be s never
t.iated Atten: o' is primari , arected upc'n tne *"-Dg^Ous lace and edges ot t'at
cube n an apparent attempt at d sampig^at on Dsamoguation <% not 'eaied As with
the lO'e-movemeni protocO' ''•'I. tn» .mpiguV caes not nref<»(e w tn |ne .erb« zed
descr.ption, b^t does taose tne j'aaung prpceij** to have prooems
Eye »o.emenl sequence ^2 "as been aspa/ed on two pages, PJia) and P?IDI
■
127
P2(»» thowt the first twtlve ty«-movtin«nt( connected 0/ dotted line«, the fiaetion 12
being a very long daition. This mitiel eyenovement sequence may be interpreted a«
related to the behavior which produces an image which K capable ol living nse to the
initial segment of the verbal'Zed deMnplion, bracketed by "«" Again the front (ace d
the bottom cube has not received any significant fnatien attention. This m.tial
sequence it followed by ten more fnations, these connected by dotted lines m P2(b)
In this sub-sequtn'e the bottom cube <s completely scanned, and then attention is
focussed for two Ic .g fiaations along 1.« middle line of the upper part of the drawing.
These eyemovements appear to bear a correspondence to the second part of the
varbalixed description bracketed by lb). II appears that the subject develops two
distinct picture representations (perceptual images) here, reahung the madequecy of
the ambiguous description for drawing purposes. Again evidence of the pre-set
cognitive goal (the drawing task to be accomplished) upon the perceptual process i«
domonttrated.
Both S3 and P3 snow in« alternation of fnalion durationsd and the frequent re-
fiaat'ng of object interaction areas. An initial scan of the complete picture, which
apprars to rply heavily upon peripheral indications is followed by a rescan to insure
the proposed image's correspondence to tne presented drawing.
Protocols S4 and P4 are important for their similarity in the use Of peripheral
vision to reaiite tnree-dimensionai perceptions In oeth instances only areas of the
front faces are fmated The three-dimfsionai "t- gger* vertices ere fnated and the
n'eraction between the cube and sloped plane receves the eapected consideration.
Peripheral vision he'e is deemed sufficient by the assimnation-accowodation process
as a source of facial confirmation .n)ormat>en
IM
jn1. ff-*» con«..a»-»;o- •»< rw jiv»' »PC« 't HM »y wamimwi .■'•ot»,-fi'<
»••emp»»e *•■'»■ lom» ijf' oes,-j:ont i.-.-o sau Nr " »»■"* c- th» *' v.;!»» o'
furltw »• ■■» o»'» p'H»"'»; •« •»»"> viijs* pa-'i
"•>dt. ',l•0Jg•■ i» ot;oia- o* '** •we »»»»•»a'C»« o' l>B»-'"<»"t :. ott» "v
p-orswo "»o-. o* > 4w* •;>•» Pt'ctpt-O' i»;*»-» •u-'h»- »«e;oa;» or .^♦»•»■■t »
!-Br»'t Ai ^*c»!»a. "^u;•■ -n»»-;- i ■«•are •; |tNw IN Mi o»t* ippMtM '^
•h« r»ti"»m»'»t o' to;' i ••»o-. 0' > f.«» "■*£» ■^p-»4»-•^• o- »>« pe-{»p,^»
P'OCHi "g
/
129
Chtptar 16 Conclusion
This chapter considers sever»! olh»r recent sluQits involving th« memory ot
prifnjnly visual concepts and discusses these proposals m light of this thesis An m-
deptn discussion o' general ct-aractenstics of the numan cognitive representational
system follows, fiitt'y, several suggested directions tor further research will be
ncled as a conclusion lu ne paper presented here
1 Study Comparison
Any choice of studies for comparison must be n.gniy eidutive. At such, three
recent studies have been selected to be contrasted with VIPS AH three involve the
use of a symbolic representation of visuel nfomation m a computer-implomanted
Simulation of cognitive benavar
BAVLOR'S BLOCKS
George Baylor (1971) proposes mat an image representation of a cub« i* en
integral part of the proressrg machinery involved m the solution ot a block
vitualnation task. The subject is given a pamted block description end instructions as
to now this block it then cut mlo pieces The tubiect is required to answer various
questions as to the number of nnultanl pieces w.lh given pamted condition! (i.e. how
/ .
130
many h»vt on« blu* tic«?). At t r«sult ol Ih« «palytn of • verbji protocol, Btylor
propOMt th« «iist«nc« Ot two inl«rractiiig r«pr«unt«tien«l proDltm tpK«( which
bacoma mvolvad in th« problem telvirg Klivity.
"S-Spac«* (symbolic) holds trua |«n«raliMtions (tacts) cencormnf blocke and alto
is us«d to hold an «ncodad (parsed) representetion ol the question lo be answered
concerning th« segmented BlOcK. This encoded question representation is applied to
th« block r«pr«s«nUtion oi 'i-Space* (mage space) by available matching operators
which locate image components lor counting. Fina>iy, an answer is (Mpesilad ir S-
Spece Thus, S-Spece acts as a transiationai butter memory betwdpn th*
v«rbeliiationt and image representation (STM) and as a semantic component ot long
term memory Baylor's proposal K admittadly not a complete cognitive model
Th« block rapresentadon retidmg in l-tpace s hiererchicel m nature. This
structure retlectt the hierarchy ol part containment de block, to taces, to edges, to
vert tes) At the initial block it segmanttd according to the prescribed cutting, other
tpecialixed mterrediate hierarchical groupings become applicable and are used (i.e.
corner, border, center cubesi At tne bottom ;evel, vertices ere interrelated by
spetielly meaningtul unks Although these spatially meaningful links are incorporated
into Beylor's image (I-Spacel representation, this mlormetion appears 10 be irrele ant
to th« taak't tolution and thut alto to the model's operation. The mput question it
parted into a hierarchical semantic structure which then serves as a goal slack. This
hierarchy ot goals directs the altering and accessing ol the hierachical cubic
representelion found in l-Spece Through e matching ol structure schemes, the
relevant information it obtained and placed in S-Space as the answer Thus, though
tpatial intormation it a part ot Baylor's image reprasenlalion, it it net put to sigmticanl
131
UM. Furlharmor«, Ihit imag« it not «cctssed by mtam rtltttd to that of »cce '.mg
e«lfn*l visual mformtlmr TRtK, Baylvr's imagt is not a vitual unaga as dodned in
Chapter 1.1. Baylor's image representation's structure closely resembles the usual
(his) encoding of verbal informat on. I-Space as defined dees net merit the claimed
separation.
NEWELL'S STIMULUS ENCODING
Newell (1972) develops an encoding representation for colored bottles. Ha than
daiines several associated processes which prove sufficient to accomplish a visual
senes entrapolalion task. The salient features for determining the generating
characteristics of the senes, and thus for proposing the nent series element, are the
bottles' orientations and colors Not surprisingly, the representation proposed for the
visual input (and memory) of each bottle is merely a list of (ust these features. For
etample, "(09J BTL VT RED)' represents a vertically oriented , red bottle.
Newell doe» not propose a visual image representation of the visual environment,
even though the information source is spatialiy structured (the series is presented by
a ieft-to-right row of bottles) The spatial structure is representative of the bottle
sequence in this las* A visual image representation which must contain spatial and
form characteristics, would be superfluous to the subject's accomplishment of Ine
given task, and thus is so for the inferred (ystum also. The task can be .nterpreled at
being that of dalermmming the bot' • sequence's generating syntao. A representetion
whiih is processed syntactically has been appropriately inferred. This representation
does not satisfy the visual image definition either.
Two special situation« which are encountered by Ntweli's system during solution
132
0> th« Ink indicil« tht ipplicability el in is«imil»tion-*ccomod»lion procatl. N»wtll
proposes • con$t»ni hierarchy of leitu'e relevancy from en enelyti« ol tubjec»
verbeliteliont on twenty-three tenet entrepotetiont. Thit hwrerchy determnet the
order of feeluret et Kquired on input and et tubtequenlly considered in determnin(
the generatin| tynlan of the tenet Thit constant hierarchy leadt to teveral
erroneous tenet proposals by the implemented system
The implemented system also encounters trouble m achieving the overall senet
organization Newell teyt, 'There mutt be a delay m actually organmni the perceived
sequence, since subsequent objectt have not yet been observed and they may affect
the organization* (p 21). When encountering two l<pe bottles for input (X and V) at d
the first four era at XYXY, the system prematurely orgemm them et ((X Y) (X V) ). If
enolher XV peir it encountered the final tenet structure will be (((X V) (X Y)) (X V) ),
which it inappropriate. NeweM ditcuttet and implements further precettet to perform
the necettary reorganization at ((X Y) (X Y) (X Y)).
These problemt relating to feature relevance and overall sequence organization
are symptoms of the proposed system's failure to use emsting STM contents es the
source of organization and e<pectations The most relevant stimulus feature (or
features) is net chosen on the oasis ol a static hierarchy of relevence. It it (thould
be) chosen on the Lietit Of the current repretentation of the tenet in STM, the current
content. The partial tenet image, at repretented >n an intermediate STM ttale, it «ltd
used to propose eapected overall srnes organizational characteristics. Any current
regularity of the incomplete input serves to suggest a structure! representation of the
complete input. This proposal provide« eipectations end determinet feature relevence
with regard* to tht newly tuated input. An assimilation-accomodation procett can
-
v.
133
than operjt* to not« consisttnc/ ot mm inputs with «apectttionj «nd KCO'dngly
eltect «Ittrttiont, general* new propoult, end determine new >*ture relevancies as
necessary.
For eaampie, fiven XYXY the process constructs an overall series representation ot
( (X V> (X Y) (X Y) ) prior to the input of the lest two elements No *dela," *
necessary, as NeweH proposes. Instead, stimulus encoding (perception) entails early
(hypothetical) structuring which laoiitates subsequent assimilation - accomodation.
MORAN'S PATH IMAGE
In another recent proposal, Moran (19^3) develops a representation to account for
observed suDiecl verbalizations during a path imaging task. The representation
developed there is again hierarchical m nature (as Bt, or) The sequence of line
segment inputs ««ists at the ootlom levei ol the structure, with an organnmg structure
of visual concepts developed over lh,s. The structure is used as the basis (means) for
the "chunking* of mformelion. A smglc symboi of the hierarchy m STM is capable of
representing and activating (recanmg into STM, if necessary) all of the elements which
are below it m the structure
Several task requirements are agin particular y relevant to the design of that
proposal. The sequence of line segments to be maged retains importance throughout
the task. Indeed, the task s staled m terms of "imaging a path*, not a picture (ime-
drawing). The line-segment elements ot the pa;i »re determined randomly. Thus, the
subject has no oupectation thai a coherent, easily recognizable path would be
presented. Actually, the opposite characteristic (of pith randomness) is probably
natu-ally aisumed As such, this appears to have inhibited dependence upon object
/
• -
m
e»pect*lion proposals and forces the Siib|«ct to dovalop « conwrvativ« imige
representelion at all times Partial objects are actually mere to be enpei-ted than
completed ones. This yields a hierarchic repreaentation m term» el realized part*
similar to Baylor. Randomness does not prevent enpectations 'Feldman, 1961), but m
this case it introduces a readiness for partial concept representation as a useful
available continfency.
Some difficulty emsts as to the representation's ability to realize inferences based
primarily upon spatial (locational) interrelationships. This results from not including
localionai symbols m the image representation. The scarcity of protocol evidence of
such inferences allows the inefficient (not straight - forward) implementation of l.iese
inference raalitalions. In the protocols of this thesis, inferences based upon locational
relationships occur frequently. As such, thj visual ima|e it bound to a IramewO'K of
locational (positional) symbols which create an imagmal space
REPRESENTATION COMPARISON
Behavior on three tasks involving the representation of what is pnmaniy
considered to be visual (or visual image) information yields three fundamentally
differing proposals In two tasks (Newell, Moran), the sequence at inputs retains
importance and is carefully imbedded into the memory structures. In two tas^s (Moran,
Baylsr), partial concept represenMrons (due to culling ol a cube or enpected,
frequent incompleteness) are ol importance and a hierarchical structure retlecling
component part subordination is proposed Two proposals attempt to fully represent
the cognitive processor (NeweH, Moran), and their visual representations reflect a
concern for STM research None of the three visual representations satisfy the visual
image definition of Chapter II.
/
.. '
135
In «ach study, tht tMk Mtarmirwt wh«t ttaturct and rtl«t>ont of Ih« visual
information art nacasiary for the succtssful «tcomplishmant of its raquiramanls. Th»
visual modality factor appears to have had much lass affect upon the form of those
thro« proposals than do other task-related considerations. The task of this thosis,
bomg the realization of a porcepton of a given line drawing has likewise resulted in
another differing proposal lor the symbolic (cognitive) -epresentalion of visual
information. In this case the modality factor is the primary task feature. This has
rasulted m a representation satisfying the visual image definition.
2. Flembility of Representation
Behavionsts have long attempted to reelne a parsimonious theory of human
internal information representation They propose that all internal representation is in
the form of mental words Associationitts nave also been in this fight. Recent
proposals state that an memory is -eali/ed M the form of concept - relaton based
hierarchical structures iKmtsch, 1972; ÜOwtr ahd Anderson, 1973)
in contrast, it is proposed here that the representational aspect of human cognition
is a very fienbie aspect The apparent need tor concise representation within our
limited operational Or active memory precludes tne development of a parsimonious
theory of human mformat'On representation consisting of a s<ngie or several satisfying
universals of form "0 content The ability to M f e active information representation
to the goals at hand is proposed as being the primary characteristic of the human
representational system As George Miller has said i
"It seems to me that the ve'y fact Of Our limited capacity for processing ntormation has made it necessary tor us to discover clever ways to abstract the essential features of our universe' (G A Miller, 1967, p49).
!
.M
13t
LANGUAGES OF ART
Tht ditcuttion to follow rtltltt thit propM«! la t mott mltrttlinf trodis« on lh«
raproMntaliont md teuren el ma«nin(. || it « boon by Ntlton Goodmtr (1968) called
Lanfuaget e< Art. In the boon ha aiaclly dadnat a tat of tarmt and precaadt to
exlentivaly compare and interrelate thete into a coherent tyttem of maanin|. Savarai
tuch termt and thair mlarrelationthipt are relevant to thit attempt at describing the
telectivity of repretentatien which n propotad nara. Though Goodman wnlet
primarily to aaplain the rapretentative power of art, tha concepti which ha deveiopt
are utelul to tha undarttandrng of human cof nitiva (mlarnal) repretentatien.
An ob)*ci of the environment 'pottettet* til of thete propertiet for which tha
corretponding predicate applies ano it true. Thut, m Figure Vl.l, objett 0 hat
propertiet A.B.CD. Thete trua pradicatet (« "HAS A*) apply to the object from the
property at a maamnjful reference. An object necettarily eaemplifiet all trua
propertiet which apply at opposite directed referencet. An object symbol (or
repretentatien) pottettet all propertiet of tha object which it repretentt. (See
Figu'e /I.2.) An object tymbol may furthermore eaemphfy any property which it
pottettet. At Goodman putt <t, "Eiemplification n i>ov.cssion plus reference* (p 53)
In Figure VI.3, object tymbol 0 e<emplifiat only prope ' et A and 8 ol those which it
pottetses.
Goodman tayt that "just which propertiet ol a tymbol era eaamplified depends
upon what particular tyttem of syntbolnation it m effect * (P63); and further,
, , ... _*~v A—i » i ■■
.
136«
Rgur. VI. 1
njur»VI.2
I
■ *
(
IHb
Figur« VI.3
Ftfjr.Vl.4
/
* » M r m m*
.
137
"Cdablithmanl of th« i»i»r»n\ »I rtlttiO^s^p il « matttr of smglmg out ctrtam
proparlios tor •ttontion, of s*l|ctin| «soc »I ons * tn ct't»n othtr obitcts" (p88)
Puttinf th«M two st»l»m»nts tOflthtr, ctrtun prep«rl>*s th»t «ft pottcstid by «n
objoct will ba o* >nt*r«(l, which propcrliti I'l •■•mplifitd by th« chostn objtct
symbol (r«pr«t«nt«tiOn) i 1 MJOC'itod, p*rt>cul*r tyttpm o» iyoo ,z»'. o* will b« >n
•ftpct M » rotutt.
In th« Ih'ee comp«rativ« stuo^e», «nd m thit tn«t't itMlt, th« Ink l««dt suB^cts to
dotcnun« which prop«'ti«t Ot In« >nvolv«d vKuli mtormalion «r« n«c«ss«ry for its
successful compl«tion Tn« iMk d«t«rmin«( which prop«rt>«t rt;«iv« «tl«nlion «no «r«
«■«mplifipd by th« nwmory r«pr(t«nt«tient. A syit«n ol tymboliiation '«Jull». For
«■«mpl«, only th« prop«rli«> ol coior «nd er>*ntat.on ar« «i«mpli|i«a by In« botll«
Ob,ecl r«pr«t«nt>lion« ol in« sy>Kbo>iiali«n lytttm propOMd by N«w«il <see Figur«
VI 4)
Goodman defies Ih« uselul concept of *r»pr«t«nt«tion-at* Tht t«rm a t'e's
from just plam *r«pr«t«ntaliOn' Whil« *repr«(«ntaliOn* involv«! Ml«ly an oporatipn
ol (»«notation, "raprpMntation-a»" mvolv»» ooln d«r>otaton ana ciass'lcation.
Classilication it i«l«ctivily o' «>«mpiilical<on Thus, dass'licalon naturally alters th«
term ol r»or«»«ntalron at thown by th« study ««ampi«t. Th« human «b'i<ty to
"rap'«se"t-at", which it w«ll d««onslral«d by artitli' accomplishments M noted by
Goodman, it «»actiy th« llanBil.ty «I reo'tsantttion which it b«in( proposed.
In th« visual image rapresantation prepetad by thit th««it, a block it
"reores«n!eel-as" a tat (tlructur«) el mtcrrtfatad, non-hiararchic, laciai-proieclion
repress ationt (image chunks). Thit form el symbolic representation facilitates visual
recognition and process »g as hat '»een discussed A complt» hierarchy ol Obiact
/■ M
m
tor »»'c •"! ust 0> th» . >u«l oroctiSO'
As Ouu. IB pr»dicts, tf» iyjtltri ot «y«*0< Z»t'On w" ttl htvt M«'' nfe"«0 10
«ctOj^t «0' ^» oos»'.ea s-o^ct Mh<v<er on f»« t»»m o' e«" il*a, a"*'
»'|n.(ic»"tly from »Kh otM' V»t »K^ .n»#»r«d f»p'»i»'M*t'0" MtQwüt , fcooet
tn« n»o"<>Jt'OB wich if »uft'C»"! fO' t»» «CCOmp^jUmer, of !"« g .e« lasts - •ac
O* PJ'S» nj in jrju'»«"t 0' COit-ct h«f« ts 10 w :■< propOS<> s C OS»' '0 I«« COitt"!
»«0 'Or"" 0' » 'ul'vtrs»'" r»prts«nt*t>ei ( w»»»1 6* vi»u* r'O'wjt.O". 1 el*"« Ii*t all pf
t"«s« StuO'M «t'v». fi cone»'t, »s i«it.«. r»Si. ts SuPOO'l nj • |*n«r» I-«Of y 0*
•»B-fS»»:jt'Onj (»■ 6 ' !,
A TMEOSV Of COGNriON
Wh- • SOOOmc's :tf- "»v» >>l#f.t. h» 3C»S ng- .», »"Ojg" H» sots *ot afta'pt
»o desc'>e« !■* rOfK'tvt syst»» »"e" '»«•s poss o» f» us» o' ;-• '»e'»s»-'«tOB*
• n • »s mrtt* h» proposes. ►• uoos -ol 30 t- ? <> -e <s Otn^f g3»s '•'» (OJ 0'
MM tr«s s, on tht otn«r -j-a. s »n;t / lo Msc s« ■s.- y oot'tliv» coint..*
t>»t»"i Th«f»(or», i"« fO'0»'"| ti#o'y » p'^s»»!»« *"• •''»O'y t<"B0*»3 D» VI^S
s « so»: ' C Mt»«ti«l on 0' •- S I»"»'» IntO'y 0* tO|" t on i'O»»«, '"» sp»c • c»' on
0* j ln«0', 0' *ny ciiss 0* .3J-" 0" mud 6» I'O.-oea n in Ok>'< •-eo-»' . • Das s
Of »li cognit on
Th« Das<t o* a. :;;-•'- s •»0'»<»-ra* o-» «nowi»3t» 'fS'fs»-'«! o-a
Kno«l»0(» -, C<nb00'»d Of O't t»"n ~r~C-, .O'J •«'"• •■«-•0'( S a CO>np«>
(•"•nt'C StruClu'» 0' S/fnOOS »no •» at On». A 5r-;o s a "00» m In» -«t.o n-'ikt
lonf tprm -e-^r^ ttnxlu'» A '»lai.On s a a '»dta conn*cton o»;.«- too IwO
'■
i39
Symbol» Bting t Mmantic ttructurt, long tirm m«mor/ s < rtpr«wnltt<on of m««nin|.
Th* mtcnjng ol * svmbol or rilat>on it dafintd by (to M) it« lotjtion witnm tha long
term mcrrory ttructjrn Relations »r» tlwa/t pa>'td A pa<r 0' ralations is said to ba a
properly of the symbol from «hicn both relations ari|inata One relation of the
properly pair references a symoai which labels the Ml between symbols vtadl the
other relation constitutes. A symbol is sT^J y a group of relational properties A
tymool may be COnnecteo oy relations to communicable components of a langjage-
based substructure Of loig term memory which allow its eitemai enpression. A
symbol may a<>0 be connectao *o components of the various modalty-specific
perceptual systems whicn allow it to be used in tne perceptual act vity and to be an
etoment of the resu Unt perception
The Symbols and relations of cog-'lon are physca f emoooied m the ttructjrr
and tne patterns of activat.on o' tne neurons of the brain Bram neuron act.vty can
be ds) effected by the activity of tne compete centra nervous System Human
benavior not invoiv. ^ the use of syrr.Donc represenlat.tn is not cognition For
eiampie, sample relieir act<ons da «nee tern -e'?■ appear to be based solely upon
iower-order ner.e ceil stales Mm (sensory, motor, ana spnai)
The symeols, relations, and structure Of long term memory develop as the product
of In« organism's (person'si continuous attampl to adapt to (represent' ts
environment The p.ocess of representartionai adaplal On s an evolutionary process
At such, ong term memory is a function of an innate MM slate, of mnate potentials,
and of the history of its involv ient m all cog" t on Due to the evolutionary
character of long term memory, If« cmttence and meaning of any symbol s
necessarily temi-permanent
'
•
140
To Ml*pt tc «n •nvironmcnt i> lo 6e c«pat>'* Of •»•ctin( tuccttttul (Ml«qu«t*)
b«h«viOr withm lh»l environment At lh* bMit 0* cognition, long term memorir must
roprosent not Only an •nvironmonl but «iso tht "mint of r|tpondin( to *nd Kt'ng
upon !hjt onvironmcnt Thcrttor«, COfnitivt procesMS •'# thomtolvot ttruclurtt Ol
tymbolt *na rolationt th«t >rt D»'t ot long t»rm moinory To b« op«f»tiv», cognition
ha» on« roquiromonl Mttrnd tc long torn momery Cognition roqui'O« • <ytt«m«t>c
Cycle Ot long torm mtmory KtivitiQn «nd int*rpr«t«tion. It it tnit th«t lit« »no tint«
P'Ovid« (or «ra).
At p ocitttt »'• tmbMiM witnm long torn momory, it it BOtn tn« m*tnt and
product of its Own avolulion Long tarm mamory e.a -et by tha action of ihr»»
procat» typat Tha procattat o* r»-namearing incorporate selected e-viron«n«ntai
tactors, created by other task-related procettes, mto the long term «wmory structure.
Development» processes determma the state o* availability ol innate potential*.
Learning processes altar long lam ■namory m tnrae ways. On« is the alteration et
easting symbol and -e'll o" meanings b^ tne »oa Ion et new r. '«tiens which
restructure o* >ong term memory Two >s by tne creation ot new symbo's and th«
incorporation ot these into long term memory The third s by developing »ctivalaO •
structures as rules and environmental factors suited to tne oipecled tasks
At any point m time (dur ng any cycle of Ktivat.on and interpretation) only a small
traction ol long term memory it active or teiectivei/ attended Th« active memory is a
representation ot currant contot. Active memory tonsstt Ot a set ol »nvironmental
factors and an active rule ol a cognitive process (the active process). The
envi'onnenlal lector is tne un.t of cententual environment representation The rule is
tha unit el cognitive process. At e part ot long tarm memory, th« environmental factor
I
'■
141
and lha procttt ruii art both ttructurn ot tymbel» *nd r«ialiont To dafin« »n Kt>v«
raprtMntttiOn*! ty(t*m (tg vitual imt|*ry) K t« tpKily tht tymbolt, lh« r«l«tiont,
and th« ttructur« typtt which contlilula itt unit« o< Ktivtlion (•nvirenmanltl factor»)
To dahna a cofmtiva process it to do tha tama for its ruMt.
Th« tat el anvirormanlai fKlors whicn ara Kliva «t tny point in tin« conttitutot
tna ar/ironmanlal contaul lor tha activa ruia dunnf lhal cycla of activation and
mtarpraUtion. Each activa anvironmanlal factor play« a precau-ralatad function anu,
at tuch, it taid to ba (ba m) a carlain cowpenant ol Ktiva mamory Tha potubla
functions ara definad by ana cutt with ragards to lha Ktiva procatt rula. Ganaral
charKlaritlict of lha ttructura and conlanl el an active anvironmanlal factor are
datarmined by the function*, 'oa it playt. Thut, a currently Ktiva rule datarminat the
general nature ot it« repretentalional anvironnent. COfnitive procetta« eutt en th«
basis ol a task to be accomplished (adequate behavior). At tuch, general
characteristics ol the current environmental repretentation are indiraclly related lo
the current let».
The llenbilily of the anvronmantal repratentalion to «ml the currant conteil to
the Us« at hand s necestar ly 'ettrided and imperlect At any lime, lleaibilily it
bounded at the eilreme by Ina cunantiy available symbols, relations, and «tructure ol
long term memory. Tne flenbiiity is a>«e limited by the evolutionary «late ol
sophistication ol the active rule« (procettet) «nich become involved m the task,
solution. The tiate ol procatt tophitticalien and spaoa'-iation it ilteii inversely
allecled by the tymbewt and raiationt which are avanabia lor activation at rule Or
environmental factor contents The state e' erganttm development delermmet the
availability ol innate potentials which alto allact the range ol llenbility Selectivity of
activation it the operational äquivalent ol Goodman's teieclivily ol aiampiilicalion
'~
'ww .1
142
Upon th» coinnwnctoont 0* «Kh cycl» el tctivition «nd intcrpnlation, a rula and a
sal ol »nvironmantal '»cto's ara activatad by »alacliva attantion. Thara ara savaral
fanaral cnlana which delarmna this opoction Tha rula % talaclad on tne basis ol
th« currently actva procats (a partition ol tha cognit.va rulas) and on tha basis ol tha
contantt el environmental lactors which have been active durin| the iiwedialaly pnor
cycle (primarily) or during one ol the peat several cycles (recently active) The
environmental lactors which ara activatM initially are determined m conjunction with
the rule selection. They are a selection I'om the recently active environmental lectors
which determine tne rula selection and which are the'elora activated to play functional
roles with regard to tn« selected 'u« Ounnf tne cycle ol activation and
interpretation, further symbols, relations, and even environmental lectors may be
activated. This selection is determined by tne active ruie and by the meanings ol the
already active environmental lactors
An active rule or environmental lacior remains ellectively imeedded m the Overall
long term memory structure, thus lacmtating activation el any closely related
knowledge The recently active environmental lectors and tne long term memory
closely related to the currently active memory constitute a readily activatable Innge
ol consciousness" As the phanemenologitt Huaserl steles, the local it girl about with
• 'zone' ol '.he marginal^' (Hussarl, 1962, pl07)
Perception it the cless ol cognition which it the active mterprelation by the
orgemsm ol the stale el a subset ol its ceils The cent which ara interpreted ere
either a part ol or have a direct, allective im« with the organism's surlace. In an
organism ol sullicient compie>ity, these cells are modalily-tpecilic sensory receptors.
The ttetu* Ol the sensory receptor cells it the one lurther determinant 01 the
143
•.elective Ktivttion of environmental tKtors which occurs during perception An
acliv* rule of i perceptual proce» can activate ne« mvironmenlai tactcs on the
basis of currently active en.ronmental factor moanings and the states of selected
receptor ceils or recepto nl comomations (receptive fields). The result of this
interpretive activity is a Symbole representation which it constructed as an
mterrelateo group Of environmental factors
Conscious experience at an/ point in time is me internal phenomenon which
accompanies (results from) the activation and mterprelütion of the active rule and
environmental factors. Conscious enpenence is not the contents of active «mory. It
is not the active and causal "stuff' of cognitive oehavior but is merely the
epipnenomenal creation o4 that benav.or Tnis is not to der that conscious
eapcrience may itself form a oomam of representational knowledge m long term
memory The activation Of any part of that representation >n the tonte«! of an active
rule and Other environmenUI factors mM necessary result in a conscious enpe'ience
wh.ch differs from the Oftfinal (that represented).
Conscious eipcrence is reialed to tne meanrgs of the symbol structures of
active nemory Differences hefween conscious experience have two sources One is
an actual diffe pnei m the contents of active memory (m terms of activated symbols,
relations, and st'uclure'i T"* otrer is that tne meanings of me activated long term
memory elements have been alle'cd Dy the intervening evolution of long term menOfy
Due to tne changes of symool meanings whicn accompany this evolution, it may not be
possible to recreate (reenpe'ience) a conscious event even though the contents of
active menory arc identical with that of the past experience.
.
144
PSYCHOLOGICAL INDICATIONS
A study by Trabnto <nd Bower (1968) illustntis trie flimbility of «clivt
memary O' the 'eleclivily o( "representation-«'. Ley presented subjects with tirds
showing four letters >n a row. The task given was to sort the cards mio two piic. on
the basis of the second ieter being L or B, for enample In learning trials, letters were
randomly paired with L and B m Ine olner positions In further trials following
learning, tne letter m the fourth position was consistently paired with the second
position de. 0 with L, E with Bi During these trials the subjects were required to
ret te all letters while torlmg the cards on the basis of the second position as before
Following this test, trials were given m which the second position was left btan» (no i
or B). No subject could correctly sort the cards even though the letters m the fourth
position (0 or El were shown md could serve as a basis for sorting Thus, see ng,
recognizing, and verbally repeating the letters did not ensure (cause) sanction of tne
letters in the fourth position as a part of the active environmental factors upon which
the action of the active rules, and thus be-.. was based
Recent research m cognitive r.schology has oegun to provide evidence (and
proposals) for the multiplicity of internal information representation. Tversky (1969)
hat produced results which indicate the ability ot subjects to represent the same
stimulus m visually and verbally detem.ned structures m STM. The mode used reflects
tatk requirements and thus indicates llanibility. Paivio (1971) also presents results
indicating the use of both visual and verbal memory representetions as mediators m
association and recall tasks.
The human ability to produce an internal representation which represents (hingt
/
•s is nece&sar/ or suHtcienl tor the t«* ^, h^na ,T. mo'.t vÄ'uAOie A', wth an/
orgamsmic charartenstit, Nut abnity it only «n mrAte potentiit> tt * predicted that a
person without a "ei'bij representational iystew may not pe'torm as *eii On some
task'.. Such lasKs which do not easily conlorm to the • reguUr mode ot representation
may prove ditticult or insurmountable L.euem-an U9'? Cti'^ed Out a study involving
a task which requires mental imagery (ci a cuuei n coordination win sequent.a' goal-
diret ted behavior to solve a tiiree dimensiona. r, a;e Pre-e-per.-nenlai tasks were
conducted to classify people as beng good spa' a magtrt< good eroai representers,
or both Preliminary results indicate that having ooth ab-iities, thus representational
lleimility, shows postive correlation to the degree ot success realised on the compli»
ma?e t>sK, These Imorngs are not over a statistically significant base and thus are
only preliminary.
Two other recent studies appear to indicate rep'esentalionai lie«ibiiity Trost
(19711 showed subjects line drawings which varied both in spatial orientation and m
semantic category The instructions led the subjects to eipecl either a recall or
recognition test following the mitiai learning per oo Tests were conducted to
dete'ime it the instructions had affected memory organiiation (representation). The
resets indicated that they had LoMus (i9'Ii conducted a similar comparison and had
similar results (or a task involving continuous paired associates
RELATED PflOPOSALS
Morowitt (1970) fits proposed !hre« basic modes Of memory representation. The
"enactive" mode is used to represent actions, enemplifymg features of direction and
force. The 'image* mode it used to represent spatial information. The "lewical" mod*
'■ ,♦1
Hi
CO"S St« a« g-ä-~»'<J whic» Cli 'tprttant »«ntmctt d-g»<|l< «nd sea^n! i,
.nlOfmit^O« •« f»"»'»l Tr«$t "-oa»« *'f d»rmtiv»t 0' th« "»n»cliv«", "cOmc". »nd
"»yoo^c" -oa»i w c '»d D«tn dtscota D, BruW (;964).
94s*d upon a lu'vty 0* r«'»v»-r piytioiog :* »na n«ufOiO|'C»i rt%»trri, John
'iSfc""1 OfOpose» th« e« st«"c« 0' two 'ep'eMnUton* s,»ltm citMM Th« "soec'ic'
iyi'.e-* it tieo to seise/ istimu-i - oojiol »ct.vil/ n «'« PIC »id VI income memo',!
0' VIS'S. Th# gene'J1 sy»t»m 'e' e:t5 'epet t >«, MMMM »ct.vity not a"e:t ^ t ed to
ttnsO'y nput leg RlTM «no LTM 0* VI^Sl A sp«c I'C .,ll«T may mtarr«! with «
|tner»i »yilam du' "g ct't»." sti». o' dt. pt'eept o" o» VIPS)
Witn tn» -»tu'n 0* COwplfi nttrn»; 'eprtt«it»tiOn to C't*0ility t'Oi" ts .0n|
ce- o3 of iot>ng eatt«t » 11 nt^aviort'«, rttaa^n nat producad stva-a Doo«t daai>n|
witn tha «pp. c»o r < o* var Out "t3'-at 0" raprasantat'Ont to tattt s' tn«
anv.'On"i»nt Vnja' Tn.nn'fg C/ A'nna.n (HTli »ttawp!» to OasC'ip« tn» JB I«» 0*
visual imaga'y and ■■ -st-ata» '» »ooa-ent uta 0/ "ta'»$! "g aaampiat l*o»'*<K»i -
Vnuai ~hinkin^ Oy Mc<im i;372i p'etant« fra raada' «nth a tanas o< tai^s to oa
parto'mao us rg -age', rap-esantat ons ana dtcutsas tn» »pparant appicao ty ot
fis moo« 0* rep'asantat on to f-esa Synacttt by Go'don iJH;1 d'Stussat tna
'so cab I, ot "rap'asantal'O' by anaiojy" to tna MMW o* 'at»»f co-npai caativa
(angnaa"n|i ias«s > '"a l^ag» 3' '"a City, ^>ncn liitO) nvastnatas tn« natu'a o'
paooia"s -natrofy rapratantations o* citias ana a.c.utt tt faiavanc» to »utj^a city
aasen Ciauda L«vi-St'autt dtc.tsas ;*• natjra o* culturally basaa tetamc tymboi
ttfuctur«» and th« 'orcat wnc- causa tn«if a:ta'lt'On n "-'S boo» Tna Stvat» Mind
/
1«7
THE TOtE Of REPRESENTATION
This thesis proposes that the symbolic rtprescntat.on or image of any body of
information is ustd to gu>de behavior with regards to tnat mfurmalioa Behavior at a
global O' -'r.-.teg e level H based gpon tnc structural character.sties of the information
rppresentatiCi being employed. The oca (actual) 'values' of the information
structure's elements determ-<e the behavior at the tactical (specific silutional) level.
The structural characteristics of an active representation, the types of relations
dna symbois emp oyed, are fundamental M oetcrminmg the classes of inferences the
cognitive processing system can -ei' re These readily available inferences, proposals,
or rirpectat'Ons are m turn fundamental determinants of behavior The inferred
representational structures o' this thesis (and the others do not only embody
efficiently the information relevant to the tasK given. They also determine what
inferences may be easily made concerning that information and serve to guide (shape)
tne uehavior at the strategic ievei
Computer science research hat investigated and demonsl-ated the important role
of information representation n the «complishn-ent of a given task. Indeed, anyone
who has done any computer progra-nminj at ai soon becomes aware of the important
function of information representatiori Various representations have been formally
studied and shown to have '^po-tant effects upon the efficiency (lime) of p-ogram
operation, upu" the amount o* memory space requ red, and even upon the ability to
successfully comple e a i;<vrn task Tnrse results have appeared m the area Of
artificial intelligence (Amarel, 1968) and m iNi computer science discipline m general
(Knuth, 196S).
) .M
.
148
3. Futur» Rtttirih, Conclusion
All aspects ol visual perception, ima|try, and inlormttion reprtttntation require
further investigation If any progress can D» sad to be mad« by any ctudy now, it is
that the study suggests or begins to dalimit areas lor future eiper.mentation
E«p«rii"entation is morl fruitfully earned tut in light of an enstmg theory. This serves
to generate questions and hypotheses (guides behavior at the slategic level). Though
subsequent eipenmentai result« may eventually lead to the Iheor/! final discredit, the
theory will already have proven its value as the source of investigation, of new
Knowledge, and Of the associated "scientific revoiut.on" (Kuhn, 1962)
This outlook is at odds witn the recent statement by R t Shaw:
"To a theor'St B, mach ne A» is a mode of a psychological phenomerpn A to the e>tint that B can use A» to answe' questions that interest him about A" (Shaw, 1971, p )
This is not my understind<ng of scene». Rather, a machin» - > model to the entent
that it generates nterestiig questions and provides hypothetical answei- agamst
which empiricjl results can be compared ana m light ul wh.ch empirical results may be
interpreted. A machine is also a model to the ettonl 'hat it can be altered (can evol/e)
to account for subsequent confLctng indications wmch do not merit rev': ' cnary
measures.
By providing a needed ana well specified theory of visual form imagery and
perception, this thesis can serve as a significant source of research ideas The theory
/ •
■..
149
h«s 'h« backing of lh« io<*l d«l« t'C wn.cn .1 hn bean mferrad Alto, a< indicated m
earlier cbapler», m« attempt h«s ee«n made to make the interred procetting tyttem
consistent with ealernal, relevant ptycholot'cal retearch and to eirplam the visual
perception and image'/ phem^mena observed therein
In terms of general cognitive t/ttem characteristics, further memory research it
necessary Further STM (active memory) research with visually presented (timuli that
are not jut) letters or woras which transfer eatily to equivalent verbal code» is
neeoed to heip determine the amount of mfgriration retainable and to fain further
ideas concerning its possible reprrsentadon Further research is needed to better
determine tne structure ana operating charactensitict Of recognition long-term
memory To answer such questions as, "What partial information is sufficient to
suggest an object's enstence ('»cognition)'", 'HOW easily can new objects tor
recognition be entered and now is this accomplished»" "Is the operat vt of Ul 'M aerial
(seqoenliai traversal of a dec<s on net, as proposed ne'e) or parallel1" further resu ts
are needed
Active eipermenlation s j>so suggested witn regards to the determination of tne
enstence and characteristics o* an nifmediata te'm memory This memory has been
proposed ne'e as it nta pro.on useful in accounting *o' tne observed behavior There
it st il msuffic ent evdence ot 1(1 enstrnce and seconaar.iy of it» characteristics The
e*.stance of an intermediate 'eini memory w tn the rapaOmtv 0* niaintammg recent
IO-'.'II (actors in a readny access.Df stale appears likely The eotMMM of TC, 'V as
def'eo in Chapter 8 also appears ineiy to me Tn, conteit capability (characteristic)
o' cugmdon is not satisfactorily eip amed by a memory proposal soeiy m.oivmg the
classic snort-term and long-term i^e^nes
'
' ..
;60
At for tha propotils rttovint to th« •■pitnation ot human vituai information
p'ocestmi (imagery, perception), tavtral araa» for rttaarch ara "d cataa Furthor
mvast galion of tha roi* piayad by an Ktiva cognif,.» goal in visual procatting <t
nacattary. Th« «ffact of goa's upon tna fraction of attantion and tha rapraianta! on
0* tna raalnad parcaption tea- ■<;•. turlhar mvattigation and tpacilication
Rataarch with ragariH to th« functional rola of panpharai mfocmation m vsual
perception <% necattary Oa aiparmam coua nvolva tha masking of a pra-set
ti«at<on araa to help detarmna tne type of informal.an contained m peripheral inputs
ana to what use this information can be put by the visual system Indeed, can vis.ai
fO'm perception be 'ri tri when only peripheral input $ allowed * If SO, how is the
process a tared * More neurological studies to determine nerve and nerve-complei
detection abilities of the eye can also yd some needed mput to theory development
Finally, further a>per<mentation is needed to investigate the information
representation capabMies of the human Besponse time eiperiments, operating under
tha assumption thai tha length of time to derive an answer it directly related to the
directness o' the answer's representation, can yield vaiuaole results Etperimentt
which induce one n<ormal>onai goal and then prooa the ability to answer uneipected
quaslons concerning the s*-e body Of information, may yield further interesting
results as to the fieubnty and specificity ot of human memory repreteniationt
Thus, by developing a completely operational visual system bated upon mferencet
made from observed subject behavior, a more fully developed perceptual theory i«
here proposed than >t possible 'rom more restricted eipenments Though much of the
theory it highly questionable, itt value lies m the area* of research which it outline«
(or further inquiry toward unde-sta-amg.
v v^..
' .. '
151
REFERENCES
[Adcrman 6 Smth. 1971] EipMUncy at ■ Mterminanl o* (urKtional ur>t% in pefteplui' recognition. Co|niliv P;ycholO|v. 1971, 2, 117 129
[Amartl. 196B] 5 Am«rel On repre^e^tat oris of problems of reasoning about actions Mjy ninf Intglligerce J, New York: American clsevier, 196i
[Anaerson Ä Bower, 1973] o-n R. Anderson ( Gordon K 9o«er Human as^otntive merwor)/. Washington, DC: Wmston, 1973
[Arnneim, 1966] RudO'Pli Arnheim fax JQ(J v.mal perception Berkeley, Cal.: University ol California Press, 1956
[Arnneim, 1969] Rudolf Arnheim. V.sua: Inrnking Berkeley, C»i: Univernty of California (Vets, 1969
[Attreave, 1 .54] f Attncave Some nformat on atpectt of vitual perception. Psyrholagical Review. 1954, 61, 183-193.
[Attneave, 1957] F Attncave Physical determinants of the judged compienty of shapes Journal of E»Berimenlal Psychology. 1957. 63. ??l-?27
[Attneave A Frest, 1969; "ne aete'^nation of perceived Indimensional orientation by minimum criteria Perceolion gflj PtvihOBh^sict. 1969. 6. 391-400
[Bar;iett, 1917] Fredenc C Bartietl An enperimentai study of tome probiemt of perceiving and imagmg BM.sh jayuji ei Ps^cnology. 1917, 8, 222-266
[Bertielt, 1932] Fredenc C Bartel! Remer.pering. g iU^ a eiaer -nenlai gefl jaiui psychology. Camordge. Cambridge University Press, 1932
(Baylor, 1971] George W Bay or A treatse on the mind's eye M empirical investigation of vtuai mental imagery PhD. Thesis, Camegie-MeMon University, Department of Psycnoogy, 1971 Also issued as tn'ee reports from Ine umversite de Montreal, Institut de Psycholog«, 1969-197J
[Bower, 1972] Gordon H Bower Mental imagery and associative learning In [Gregg, 1972], 51-88
[Brooks, Hit] ce R B'oons Spatial and verbal components ol 'he act of recall Canadian jiitlDii ii Psychology. 1968, 22, 349-368.
>
152
[Bruner, 1964] jcromt S Br ,-e' Tn* iOu'%t 01 cogmtwc groaith Amencjn Psiicno^ogitl. 1964, 19, 1-15
[Btjgeltlu, 1971] 9 R BugeitKi The dstmilion ol th« im«(t In [S*|*i, 19711 49-68
[BU^MCII, 193b] Ilia BiJB-S ICSi ll pictiif^. Chicaio. Univertity ot OitigO Prm, .936
[Chi««, 1973] W'lii*" Gu ChaM, »oto' Acid«»': Pre»», 1973
nlBrmilian or8;ittin|. Nt« yof»
[Ch«»« A DfH, 197?] Wltiim Ü Cha»e t He'Cert H D»fK Mtnlel operation» m me compenson ot »enlence», and pictures in IGreiJ, 1972], 206-232
[Clar* < Cna»e. 1972] nerbtrt K Oe»» S Wiltiem 3 Chase On the process ol companni »ententes agarsi picture» ^Qg^;tive Psvcholn^v. 1972, 3, 472- 517
[Cr*>, 1943] KJW. Crai» Itt mature al eiip,an|i:3n Cambridge- Uni/ersity Pre»», 19743
[tbbirghause, IbSb] MtHSU. ' to-V B-itiOn ^ enpe'imfntal P'j^hP'Jly 'ranslaton- New tor«.: Dover, 1964
[Fagan, 1972] J. F Fajan Intanf» recogntion n-emory tor face» Jßütfl*. fil S«per,^enla; Cr_a P'-^polog^, 1972, 14, 463-472
[farey, 1971] Arthur Taney Toward »n underttano.ng ol vnu»! depth perception: a »urvey, Unpub>i»hea report
(Fe'.dman, 1961] Simulation ol t.ehavior in the bmary chO'ce ejpenment Proc.
Äeilicn Äü Ca=a. Cai. H61,19,133-144
[Fernald, 1912] Mabel f Fernaid ""• diagno»is ol mentel imagery ■>'.jt:'.UiJiik* tAmogrtf^, 1912, 14 ,A' oe No bi)
[Fe%tinger, et al, 1967] tllerence »nd the con'.ciOu» experience ol pe'ieption
iULOii 8l LtfifitJtiatil "•AtLa.vg* MOOUUSIL '• 967, 637
[Fro-il, 1971] Interaction o' visual and semantic codes in long term memory Unpublished PhD the»», Univer»ity 0» Oregon, 1971
[Gib-.on, 1966] Jame» j. Ribson. XUt '-«nse» i,o*: dered JJ p^r^eptual jy^ltm» Boston, Mass Hougriton Milti,n Company, 1966
[Gonbrich, 1960] Ernest H Gombnch C^ |Qg :iii.i,on. Ne« York: Pantheon BOOK»,
1960
[Goidiamond A Hawkins, 1966] Goldiamond, I and Hawkins, WF Venervertuch: Ihe
I
;b3
log relationship Mtwem W0'il-tr»qü«'><y »"0 '•t?,.,iiliOn oblamel m in* »bi^ntt ot shmulji «OrS» .'Qufnil ti E«p«- fitritti PifLiia.aff. 1966, 66, 467-483
[Goodmjn, 1968] Nenon Gooam»n jn^^ej Bl Sri, el dCBIflitÜ tfi i ICSSlt Qi symbols Indnn^po ■*, Inaanj Boot^-Mtrr,.', ;9o8
[Go'don. 19*1] Si>n«tlirt. [rjt o«/«IQp-^f-t Qi er»*:, e miS.lt. N»« *or« i-arpe'. 1961
[Gould A Oil, 1969] Eyt movement parameters jiU pjuef amrKmnjt.on PtrcepliQn
«nd SwtfiflBtUiitS. 1969. 6.311-3?0
[Gregg, 197?] Lee W Gregg, editor Co*BiLfi£l in ItitSlEt «üd Bernau '«■," Vork: Wiiey. 1972
[Grejory, 1966] »itnwd L Grfjo'/ L^t inj kUK 'he psyrho ogy ot leeinj ".e* York McGr«w-Mill. 1966
[Gregory, 1970] Bith»rd L Gre'.or^ Iflg inttiliital tit '•• Y0'»; Mcüfiw-K.l, 1970
[M»o«r, 1968] Pjpn ^^o•">«'> >i<oer, »ator Cfir.'v?C«2UIi 'htBD enfl retf«i;>i ^ Wiu*! eeutBliOl Neur V.rd «oit, Bineh»r| ( Winston, 186">
[Heber, 1969) P«lpn ftoti*** i-ioe'. editO' Irfornulion nrocei^mg jpprg^chet tfl i.-.»f pe.'UPl IP New <or« Holt, Rinemrt X W.niton, 1959
[Mebi"' * üennpn-.on, 1973; B^iph No"n<n Mjoer S Meorice Henhenion Itj p^^tt'P'O^f «1 ■ 11.»! oercepl.on t»» Vor« Moit, Pinehert 8 Wmston. 1973
[Heyek, 1962] Treaerir Ht/ek lüg amflt* Slfle: Cn.cegO: University o» Chicego Preti, 1962
[Hebb, 1949] Donald 0 Hebb Ire orjan^alion of Behav.of. >. York Wiley, 1949
[Hebb, 1968] Donard 0 Hebb Conr«rniBg iwajery Ptycrioieg til Ht^.tM, 1968, 76, 466-477
[Hochberg, 1968] Julian I Hochberg In the mnd't eye. m [Haoer, 1968], 309-331
[Hociberg, 1970] Attention, organ./at.on, and const Outnett In MotloHky led1, Ajtfption: uettMBOUU llitOl* iOi anil|Hn, New rork: Appleton, 1970.
[Hocnberg, 1973] f'rixpntary umtt m the visual perception ot ob/ects In Mehlev <ed i, HetKtea&ft el Cogniliwe Psychology. Engiewood Ditts, New jersey Prentice Hall, 19'3
(Holt, 1964] Pobert R MO I Imager r the return on the ostracized Amencn Psychology. 1964. 19, 264-264
I
K
•" ^«fci r 'i.:: ui -i 1 .■»» K."^* .*»•" -. *^ .< <• ■»
. f . t»' r n. • «*■.* » v r- ..'**fc^. ^ **'' i' ;n V ^i ;\i! Vf -'fc-
•<j%if .9}.] »Ji '«r» •.• » .",- r ••»»» «. »i
JO">- .I'.! t *t. *•»- a-»- ^»;-»">»-> .-• -»«o . - a^,-^--- -■sog. <«• ».• » A.»a»- ; '•»it .5".
• —tc*. .>*».' *»•»" »-».- W» .-■• 'i» »#-*-. >'■.«'.» .•• -♦-.■-.
•••-, .»te; rte^»i i
.» r: c. ;9'21 « V .» »j. .' \»'.a-» tft;»»i •.-^arf. §2 "IraaMtUrt k^ii ^»
[wttt,.«. •• • , ;»69; .tv. «, v*>.'t'i McC^ioc\ »K i Mt« W»>»t t>i# ••og'i •>* t»ii» '.*» "oj» o'«« 2iiuti^ü '-»f *'.pp it*o ;4M. ;*•."»
•«»• ^"PuB 'fPOf?. CSfpot»' Scfnc* P»pt. i"*'"»*» V»»inin U"«»i».l%.
3*6, »971
Uyncn, 1960] «»vm lynch lit .•nig* gl Ulf Ub Cj-xhrirtj», M*v> Mil »Nrv». 1972
[M.chalt *nd Zutn«, 196S] Mtt"ct ot vitu*> to"« EtoUMmm UnuiLa •>.•. pp '< 86. 1965.
/ .
ISS
[Millar, 1956] George A Milltr The magical number seven, plut or minus two: tome limits on our capacity lor processing mtormation. PtychalB|ital Re/.e». 19Ü6, 63, 81-96 Reprinted m several OOOKS
[Millar, 1967] George A Miller. Itu ps^er-.j.agv al cammumcation tmw York: Betic BOOKS, 1967
[Millar, 19/3] Robert J. Miller Cross-cultural research m the perception o' pcto' * materials. Psvc-oo; cai a....e!,n< ;973üO(?i. :3S-I60
[Millar, Galanter, K Pnbram, i960] George A Miller, Eugene Ga>anter, i Karl K Pnbram Plan-, j-.a the slri-ctur« jl bahavior. New Vorn: Molt, Rmenarl S Wmslon, 1960
[Mini»y, 1968] Marvin L Mms»/, editor. Samantic .nforma' on processing Cambridge, Mess : Mi T Press, 1968
[Minsky A Paoerl, 1969] Marvin L MnsKy ( Seymour Papert Perceolrons Cambridge. Mais ; MIT Pre«, 1969
[Moran, 1973] Thomat P Moran Tie s/>xbolic rjtjre of visual imagery Stanford, Cai.: Proceedings of the Tniro Internalonai Jomt Conference on Artificial Intelligence, 1973.
[Munti, 1971] IMR.A. Munti Sensory processes and behavior In Psvchobiologv. Mew YorK: Academic Press, 1971.
[Naissar, 1967] u- c '.eisser Cogn f.ve psfchnlog,! New YprK: ApFeton-Century- Crofts. 1967.
[Neuser, 197?] Unc t^isscr Changing conceptions of imagery In [Sheehan, 1972], 233-251.
[Neweii, 1972] Alien Newell A theoretical eipioration of mechanisms for coding tna stimulus Ueoartment of Computer Science, Camegia-Mailon University, 1972. Reprinted m [Meiton « Martm, 19721 373-434.
[Newell, 1973] Allen Newell Production systamt: models of control structures. In [Chase, 1973], 463-526.
[Neweii A Simon, 1972] Allen Newell « Herbert A Simon. (Uun arflflltc solving. Englewood Cliffs, NLJ.: Prentice Han, 1972.
[Noten A Stark, 1971] David Noton I Lawrence Stark. Scanretnt m eye movements during pattern perception Science. 1971, 171, 308-311
[PaiviO. 1971] Allan Paivio J-najer^ and ^gCAll »racasses New York: Holt, Rmehart A Winston, 1971.
' tM
.'.4
He'«/. 1910] C.W. Pe'Ky An tipcnmentai itudy ot imafination Arrenttn Jo„rra\ Piychology, 1910, 21, «2-45?
Pneet. 1967] Je*n Pugel Sn p^^foiugicil ilufl-ti New Vor«. Rjrdom House, 1967
[Pvf,et, 1970] Jean Pagel tlrM^yr^liym He* »ork BJ-, c Boo»i, 1970
[Pokier, 1^69] M.c"aei I Posne' AB^t'aetO" »nd lie process Ot recogntnon. In Bower and Scence eds), tf^ p'jychQiQgf fli learning %£ moti /^tion. Volume 3 New fork At ade-" t Press, 1969
[Po'.ner, 1973] MchMl I Posne' Coo-inal or o< internal codes In [Chase, 1973], 35-73
[Posner and «eeie, 1968^ 0" tne geness ot aBstract 'üea^ T'9jfnai Ql ^«Pfr menla' Ps/ciholog), 1963, '7, 363-363
[Posne and Mitchell. 1967] Chronomet'.c ana^S'S ot classification Psyc.nq'ogica: ■■',-..,*, 1967, 74, 392 409
[Pnor«m, 1971] (fan PriDra" w*'i»i!4£S ttl l^f BliiT F-g.ewood Clitts, f» j Prentice Han, 1971
[Pyl/shyn, 19'3) Zenon W P/irshr" Wfat the mind's eye tells th« mmds Drj.n: a critique ot mer'ai imagery P^/'.'y c; :a B-.i|el n. 1973, 80, 1 24
[Qui'ien, ;968] M »os-, Ooniia- Semantic emeifo-. In [Mins»y, 1968]
[»ab-o«, 1967) J »abmo« Optca co ncioence deuces üS Patent 2, 795, 705 June ||, IW7
[Peei. 1973] Stepnen K Berd htfMMliU. PlfltSliti in BiUfitC Pfiiatau^C f** ^orn Academic Press, .973
[Beitman. .971] Judith $ Pr tman Mecnar ^m^ of torgettng .n snort term merrorr Cfl»niluS P'-rOpiOgy. 1971, 2, 185-195
[»■rriard-.on, ,969] Alan Pit^arason Mtrii. ■ IV.'J '*• ,'0,* Sprnger .enap,, 1969
ii'oborls, 1960) L G Poberls Pattern >ecogn lion win an adaptive nelwo-» LHi. Con!. PeU 19b0, .n [unr, 1960)
[Segal, i9/ij S/dnr/ Joe'.on Se,',ai, eu lor Ima^er / current cognitive approaches .'«■w yprr Ac .idem.c Pre',s, 19',
[Seltridge 1959] üü Seitr.o^e Panderr.önium. A paradigm tor leam-ng Meprint in [Uhr, 1966)
It?
[Shj«, 197!] Pobert F VIM). Cognition. &-nu «ton, <nd the problem of compltaity. JfiUUUl o; StriiCtufji ^eifnmg, 1971, 2, 31-44.
[Sh»»h»n, 197?1 Pete' W S^een»", ea-lo' Ißft furctior ja Qiluu el lOiSMU N»w York: Acedemc fres». 1972
[Shiltrn, 1970] R M S^.'tr.n Memory 4e»'ch. In 0 A Normen lytoaelt ai humj- memor,. New Vo'»: Acedcmic r're»», 1970,
[S^iltrin <nd Atmnson. 1969] ^ M Shittnn «no H C At» -,oi Storige end ret'eval processes m long-term memory PsKciQiog c», Ret.e». 19Ö9. 56, 1 79-193.
[Sh'Hr^n < Ge s er, 1973] Pc^i-aV Sii'-'n ä W ison U Geiler V'SUJ1 recognition in t tneOry Ot mtorrrjlon prQCeS^ng Jn [SiJISO. 19?3J, 53-101
[Sirr.on, 1967* Hprüe't A Sf"on An ,ntormat Oi-process.ng ewpi^nat O'l ot some per.eptu* pnenon ft ä'ilin ^n'nj ai -""s-c-olai^. 1967. 58, 1-12.
[Simon, 197*?] iieraert A Si'non. Whet is visue! iiragery' an informeton processing ■ nlerpretetion In ;j'e5g. 1972^ 1Ä3-204
[Soiso. 1973] i^ooert I So'-o editor Qoclsz'AäUlx .UuU ifl CSiDlUii Piyt^iOi* the LO/OU • fmpO'. J-I We»'.inglon. OC . Winston, 1973
[Sperling, 1960] GeOrgr Sper ng the .nlormel.on «^«'leoe n Onel vsuel presentjt.ons Psrcio ojice, Mpnograpn. 19D0. 74 >! 1. Who e '^o 498),
[Sie-noerg, :9B7] Sa - Stemuerg Two Opereta-s m character 'etOünrlon see e^.dence t'j-i -eaction f M« measure-en;t 3frcyp: o- tlfl r'sychopnys^s' 1967.2. 45 DJ
[Soaring, 1969' S Ste-nocg Th» ascj e'y o* proce«'-"f, stages £<lenso-s ot Donoer s r-elnod *:li piai"8 •Jiti. i9o9, ?'o 316
[Strcime^er .■ P-.otna. 1970] ':e nota ej !e»t«rr o' e Oftic r-ages ^l^iit, 19'0. 225, 34t
Jitcnener, 1909] iB '•ce'e' »gU^ti 8= tut i-SKtZtSUi iXuLJliSSi. Bl Um L'.v.^ 1 a.. >.I..L. Htm "O"» Ma,^ 'an. 1909
i"'eijasso X Bo»e'. 19oo] " ■•,.,■ .is-o ano 3" 3c»f ilie-van j -earp..-^. I'lgflU. *xia tt;(;gik2 're» »o-». A e>. ISoo
[Tvlivmg, i9""2] tnae 7„ , ■•.; fp sOO C end semant ; memory in [T^A.ng ( Janaidson, 19■.,]. jil -lOS
[TuK ng Ä Donadson, 19".''] f e \, »inp. < Was ne Oonanjson, editor» ^.rjjni^^ljn 0» ^"_ßrj \e» >ü'» A(a*itm,c Pres». 19'^
y I
IM
[Tvirsky, 19(9] Barbar« Tvtrtky. Pictorial and word encoding m a «hört lorm rremory task. Percaption änd Ptythophyiitt. 1969, 6, 225-233.
[Uhr, 1966] Leonard Uhr, «dilor Pallern racogmtion. New York: Wiley. 1966.
[Uhr, 1973] Leonard Uhr. Pattern refo[nilion. Ie«rnin| tau, tnnufM Englewood Clitts, NI: Prentice Hall, 1973.
(Weisstem, 1973] Naomi Waisstem Beyond the yellow-VoKswaien detector and the grandmotncr cell: a Eenaral strategy for the «aploration of operations in human pattern recognition. In [Solse, 1973], 17-51.
[Waltz, 1972] David L. Walti Generating semantic descriptions from drawings of scenes with shadows Pn.O. Thesis, Oaparlment of Electrical Engineering, M.I.T., 1972. Project MAC, Technical Report TS-271.
[Watson, 1913] J.B Watson. Ps/chology as the behavionat views it. fc| :hoiogieai Review. 1913,20, 158-177.
[Waugh t i>torman, 1965] Nancy C Waugh i Donald A. Norman. Primary memory Pt^holagical Revia«. 1965,72,89-104.
[Wickelgren, 1972] WA. Wickelgren. Coding, retrieval and dynamics of multitrace associative memory. In [Gregg, 1972J.
[Willems, 1967] La Williams. The effects of target specification on objects fiiated during visual search. Ada P»vcholo|ica. 1967, 27, 355-360.
[Winston, 1970] Patrick H Winston. Learning structural descriptions from eiamples. PhD. Thesis, Department at Electrical Engineering, MIT. 1970. Project MAC, Technical Report TR-76.
[Yarbua. 1967] AL Yarbus. ixt mavaments and v^ion. New York: Plenum Preis, 1967.
[7utna, 1970] Leenard Zutne. lüiuu aerceatian Q| tOCA New ^ork: Academic Press, 1970.
I-