8/12/2019 Verbal Interference in Content Localization

1/26

Ruiicia jdmn< _DRBMH CI^DRODRDIFD =

_drbmh Citdrodrdifd ci F`itdit H`fmhczmtc`i

Ecfmj J. Odiidr

Fmridacd Edhh`i Ticvdrscty

8/12/2019 Verbal Interference in Content Localization

2/26

_DRBMH CI^DRODRDIFD 2

Mbstrmft

^jcs stuny dxmecidn tjd doodfts `o vdrbmh citdrodrdifd `i wdb f`itdit h`fmhczmtc`i min

rdfmhh. Nmtm or`e 17 pmrtcfcpmits wms f`hhdftdn tjr`uaj m fust`e wdb mpphcfmtc`i tjmt wms bucht

spdfc

fmhhy o`r tjcs dxpdrcedit. ^jd mpphcfmtc`i prdsditdn pmrtcfcpmits wctj m rmin`ehyadidrmtdn wdb pmad min tjdi mskdn tjde t` rdfmhh tjd h`fmtc`i `o tjd f`itdit uindr sdvdrmh

ncoodrdit f`inctc`is. ^jdcr rdsp`isds wdrd tjdi mimhyzdn uscia VWVV wctj spdfcmh mttditc`i acvdi

t` tjd mffurmfy `o tjdcr h`fmhczmtc`is. Ct wms jyp`tjdsczdn tjmt pmrtcfcpmits w`uhn jmvd h`wdr

mffurmfy wjdi rdfmhhcia f`itdit h`fmtc`i co mskdn t` ndsfrcbd tjd h`fmtc`i vdrbmhhy, min w`uhn

jmvd jcajdr mffurmfy co mskdn t` ndsfrcbd tjd h`fmtc`i armpjcfmhhy. @ur incias ncn i`t supp`rt

tjcs jyp`tjdscs, but ct ncn supp`rt prc`r rdsdmrfj suaadstcia tjmt rdmncia spmtcmh tdxts fmi

citdrodrd wctj tjd rdfmhh `o spmtcmh cio`remtc`i.

8/12/2019 Verbal Interference in Content Localization

3/26

_DRBMH CI^DRODRDIFD 6

_drbmh Citdrodrdifd ci F`itdit H`fmhczmtc`i

Citdrimh rdprdsditmtc`is ci w`rkcia ede`ry jmvd h`ia bddi m t`pcf `o stuny wctjci tjd

dhn `o f`aictcvd psyfj`h`ay, ms ct cs smod t` mssued tjmt eufj `o tjd cio`remtc`i tjmt wd pr`fdss

dvdry nmy cs vcsumh. H``kcia mt tjd tjd me`uit `o vcsumh f`itdit tjmt cs f`isuedn `i tjd citdridtf`ires tjcs mssdrtc`i. Eufj `o tjd citdridt rdhcds `i `ur vcsumh pr`fdsscia mbchctcds t` dif`nd

min emcitmci rdprdsditmtc`is `o tjd f`itdit tjmt wd mrd f`isuecia. Tio`rtuimtdhy, tjd cepmft `i

psyfj`h`ay `i tjd dhn `o wdb ndscai cs stchh bunncia, min tjus emiy `o tjdsd rdprdsditmtc`is mrd

dctjdr prdsditdn ci m wmy tjmt cs i`t f`inufcvd t` pr`pdr dif`ncia min rdfmhh, `r tjd rdfmhh

divcr`iedit citdrodrds wctj tjd pr`fdsscia `o tjd rdprdsditmtc`i by w`rkcia ede`ry.

^jd rdfmhh divcr`iedit cs `o pmrtcfuhmr citdrdst bdfmusd ct rdhcds `i mffurmtd ndf`ncia min

citdrprdtmtc`i `o spmtcmh rdhmtc`isjcps. Co wdb f`itdit rdfmhh cs cimffurmtd, ct cs nud t` citdrodrdifd

wctj tjd ndf`ncia `o tjd vcsumh min vdrbmh rdprdsditmtc`is `o f`itdit h`fmtc`i wctjci tjd brmci.

^jus, tjcs rdsdmrfj o`fusds `i wjdtjdr tjd pmrtcfuhmr emiidr `o rdfmhh jms mi cepmft `i

mffurmfy. Vpdfcfmhhy, wd wdrd citdrdstdn ci wjdtjdr mskcia pmrtcfcpmits t` ndsfrcbd wdb f`itdit

h`fmtc`i vdrbmhhy `r armpjcfmhhy w`uhn ycdhn bdttdr pdro`remifd ci m f`itdit h`fmhczmtc`i tmsk.

Rdsdmrfj ci tjcs mrdm sj`ws tjmt i`t `ihy cs editmh cemadry frufcmh t` emcitmcicia

citdrimh rdprdsditmtc`is ci w`rkcia ede`ry, but tjmt tjd pr`p`sctc`imh e`ndh `o citdrimh

rdprdsditmtc`is cs cimndqumtd mt dxphmcicia emiy f`ee`i w`rkcia ede`ry tmsks (K`sshyi &

W`edrmitz, =311). ^jd pr`p`sctc`imh e`ndh stmtds tjmt ki`whdnad rdprdsditmtc`is mrd rdhmtdn

uscia pr`p`sctc`is< strufturds dxprdsscia rdhmtc`is bdtwddi ditctcds (d.a. y`ur [jminU cs mt tjd din

`o y`ur [mreU). ^jd omft tjmt tjcs e`ndh `o cio`remtc`i st`rmad n`ds i`t mndqumtdhy mnnrdss

bdjmvc`r ci emiy w`rkcia ede`ry tmsks cincfmtds tjmt tjd prcemry mhtdrimtcvd, editmh cemads,

emy e`rd mffurmtdhy ndsfrcbd tjd editmh `pdrmtc`is rdqucrdn o`r w`rkcia ede`ry tmsks.

Hmtdr w`rk by W`sthd, NDsp`sct`, min F`rkci (2774) sj`ws tjmt eide`icf

rdprdsditmtc`is `o odmturmh fjmrmftdrcstcfs `o `bldfts ci ede`ry mrd f`ee`ihy vdrbmh wjchd tjd

rdprdsditmtc`is `o m `bldfts h`fmtc i mrd i`t. ^jdy ncsfdridn tjcs by uscia citdrodrdifd tmsks ci

`rndr t` mttdept t` msfdrtmci wjmt mrdms `o tjd brmci wdrd bdcia usdn nurcia m tmsk min j`w

8/12/2019 Verbal Interference in Content Localization

4/26

_DRBMH CI^DRODRDIFD >

vdrbmh min spmtcmh citdrodrdifd w`uhn moodft pdro`remifd `i tjd tmsk. ^jcs cincfmtds tjmt

rdfmhhcia tjd h`fmtc`i `o mi `bldft vdrbmhhy f`uhn bd e`rd ncofuht tjmi rdfmhhcia ct armpjcfmhhy ms

vdrbmh rdfmhh w`uhn rdqucrd mnnctc`imh dif`ncia.

Ci omft, ct mppdmrs tjmt i`t `ihy mrd tjdsd mttrcbutds st`rdn ncoodrdithy ci w`rkcia ede`ry,but fdrtmci typds `o citdrodrdifd fmi ncsrupt tjd pr`fdss `o rdfmhhcia vcsumh rdprdsditmtc`is or`e

w`rkcia ede`ry. Ci `id stuny, pmrtcfcpmits wdrd prdsditdn wctj tw` typds `o tdxts< spmtcmh tdxts

min vcsumh tdxts. Vpmtcmh tdxts f`itmcidn cio`remtc`i mb`ut tjd h`fmtc`is `o `bldft odmturds min

vcsumh tdxts f`itmcidn cio`remtc`i mb`ut vcsumh odmturds `o tjd `bldft (f`h`rs, o`re, dtf). Hdmridrs

wj` wdrd prdsditdn wctj spmtcmh tdxts min mi cemad wdrd f`iscstdithy w`rsd mt rdfmhhcia tjmt

cio`remtc`i tjmi hdmridrs prdsditdn wctj vcsumh tdxts min mi cemad (Vfjhdr, Vfjdctdr, & Adrldts,

27=2). ^jcs cincfmtds tjmt tjd spmtcmh tdxts mrd citdrodrcia wctj tjd w`rkcia ede`ry pr`fdss o`r

cemad rdfmhh.

Mnnctc`imhhy, ct emy bd tjd fmsd tjmt tjdsd tw` typds `o rdprdsditmtc`is mrd vdry eufj

cs`hmtdn or`e dmfj `tjdr min n` i`t citdrmft. Rdsdmrfj by Euiicfj, Hminmu, N`sjdr (277=)

cincfmtds tjmt tj`uaj spmtcmh hmiaumad min spmtcmh ede`ry jmvd scechmr pr`pdrtcds min

o`uinmtc`is, spmtcmh pr`pdrtcds mrd i`t prdsdrvdn mfr`ss hmiaumads `r ede`ry tmsks. Ci hcajt `o

tjd rdsdmrfj editc`idn prdvc`ushy, tjcs w`uhn cincfmtd tjmt tjd rdsuhts or`e tjd citdrodrdifd

dxpdrcedits mb`vd mrd fdrtmcihy dxphmcimbhd by dvdits `ffurrcia nurcia tjd rdfmhh pr`fdss.

Qjmt tjd mb`vd rdsdmrfj omchs t` mnnrdss cs co rdfmhh `o spmtcmh cio`remtc`i ci w`rkcia

ede`ry cs pdro`redn bdttdr ci m vdrbmh `r armpjcfmh f`itdxt. ^ tjcs p`cit, ct cs fhdmr tjmt tjd

ndf`ncia `o w`rkcia ede`ry cs moodftdn by f`itdxt min tjmt tjcs cs pmrtcfuhmrhy rdhdvmit wjdi

ndmhcia wctj spmtcmh rdhmtc`isjcps. Ourtjdre`rd, ct cs adidrmhhy uindrst``n tjmt spmtcmh min vdrbmh

pr`fdsscia `ffurs ci ncoodrdit mrdms `o tjd brmci. ^jus, tjcs dxpdrcedit stmins t` nde`istrmtd

tjmt co spmtcmh rdhmtc`is mrd dif`ndn cit` w`rkcia ede`ry, tjdy mrd e`st doodftcvdhy rdtrcdvdn min

ndf`ndn armpjcfmhhy rmtjdr tjmi vdrbmhhy.

Ms sufj, wd jyp`tjdsczdn tjmt pmrtcfcpmits w`uhn pdro`re bdttdr ci m vcsu`spmtcmh rdfmhh

f`inctc`i, ms `pp`sdn t` m vdrbmh `id bdfmusd tjd rdprdsditmtc`is min spmtcmh rdhmtc`isjcps bdcia

8/12/2019 Verbal Interference in Content Localization

5/26

_DRBMH CI^DRODRDIFD 4

mffdssdn wdrd dif`ndn spmtcmhhy min tj`sd rdhmtc`isjcps fmii`t bd mndqumtdhy ndsfrcbdn

vdrbmhhy. Mnnctc`imhhy, mpphcdn tjcs prcifcphd t` tjd dhn `o wdb ndscai ms tjd f`isueptc`i `o wdb

f`itdit cs juadhy cep`rtmit t` cio`remtc`i citmkd. ^` n` tjcs, prdsditdn spmtcmh cio`remtc`i ci tjd

f`itdxt `o m wdbsctd min mskdn pmrtcfcpmits t` rdfmhh tj`sd rdhmtc`isjcps dctjdr vdrbmhhy `rarmpjcfmhhy. @vdrmhh, wd dxpdftdn t` sdd pmrtcfcpmits pdro`re bdttdr wjdi mskdn t` rdfmhh tjcs

cio`remtc`i armpjcfmhhy. Mnnctc`imhhy, wd dxpdftdn t` sdd mfmndecf eml`r min adindr jmvd s`ed

s`rt `o citdrmftc`i wctj tjd trdmtedit f`inctc`i, ms b`tj `o tj`sd f`vmrcmtds jmvd bddi sj`wi ci

tjd pmst t` moodft spmtcmh f`aictc`i.

Edtj`ns

Wmrtcfcpmits

Qd `bsdrvdn 17 pmrtcfcpmits `o dqumh adindr ncstrcbutc`i bdtwddi tjd mads `o =1 min 2>.

@ur prcemry ar`up `o pmrtcfcpmits wdrd stundits mt Fmridacd Edhh`i Ticvdrscty, wctj mr`uin 27 `o

tj`sd stundits bdcia nrmwi or`e tjd f`ursd :4-6=7 Rdsdmrfj Edtj`ns ci F`aictcvd Wsyfj`h`ay.

Ndscai

Ci tjcs fmsd, tjd cindpdindit vmrcmbhd wms tjd typd `o qucz tjmt tjd pmrtcfcpmit wms

prdsditdn wctj motdr bdcia dxp`sdn t` tjd stceuhus. ^jcs vmrcmbhd wms bdtwddi-subldfts

Wmrtcfcpmits wdrd rmin`ehy msscaidn t` rdfdcvd m qucz rdqucrcia tjde t` nrma-min-nr`p f`itdit t`

tjd h`fmtc`i ct wms `i tjd pmad, `r tjdy wdrd prdsditdn wctj m sdrcds `o vdrbmh ndsfrcptc`is `o

f`itdit h`fmtc`is min wchh bd mskdn t` emtfj tj`sd wctj tjd f`itdit tjmt wms tjdrd. Qd edmsurdn

tjd mffurmfy `o tjdsd rdsp`isds min f`epmrdn tjde bdtwddi tjd tw` ar`ups ci `rndr t` cnditcoy

miy scaicfmit ncoodrdifds. @ur prcemry f`vmrcmtds wdrd adindr min mfmndecf eml`r, ms b`tj `o

tjdsd jmvd bddi sj`wi ci tjd pmst t` cepmft vdrbmh min vcsumh pr`fdsscia.

Emtdrcmhs

^jd dxpdrcedit f`iscstdn `o m Wytj`i wdb mpp ruiicia `i m Jdr`ku wdb sdrvdr. ^jd sctd

jmn tjrdd pmads< m prd-tdst survdy t` f`hhdft nde`armpjcf cio`remtc`i, m rmin`ehy adidrmtdn

wdbpmad f`iscstcia `o sdvdrmh tdxt mrdms min tw` cemads, min tjd rmin`ehy sdhdftdn p`st-tdst

qucz. Tp`i h`mncia tjd wdbsctd min scaicia tjd f`isdit o`re, pmrtcfcpmits wdrd prdsditdn wctj m

8/12/2019 Verbal Interference in Content Localization

6/26

_DRBMH CI^DRODRDIFD ?

sj`rt survdy mskcia o`r wjmt f`hhdad `r uicvdrscty tjdy mttdin, tjdcr mad, adindr, mfmndecf eml`r,

min j`urs spdit `ihcid pdr wddk. Mnnctc`imhhy, mt tjd t`p `o tjd pmad wdrd tjd o`hh`wcia

cistruftc`is< Motdr f`ephdtcia tjcs o`re, y`u wchh jmvd 67 sdf`ins t` dxmecid m rmin`ehy

adidrmtdn wdbpmad. Whdmsd try min rdedebdr ms eufj ms p`sscbhd mb`ut ct's ndscai.Motdr tjd survdy subecssc`i, tjd wdb mpp w`uhn rmin`ehy sdhdft m pmad hmy`ut or`e `id

`o vd p`sscbhd f`iaurmtc`is. Dmfj f`iaurmtc`i jmn o`ur p`sscbhd tdxt h`fmtc`is min tw`

p`sscbhd cemad h`fmtc`is. ^jd cemads wdrd mhwmys phmfdn scnd-by-scnd. ^jd cemads min tdxts t`

hh tjdsd sp`ts wdrd rmin`ehy fj`sdi or`e m sdt `o =7 pmrmarmpj-h`ia tdxts min =6 f`h`r cemads.

^jd p``h `o p`sscbhd stceuhc wms sdhdftdn by tjd dxpdrceditdrs ci mnvmifd. Motdr bdcia sdhdftdn,

tjd stceuhc wdrd cisdrtdn cit` tjd pmad min tjd pmad wms rdindrdn ci tjd pmrtcfcpmits br`wsdr.

Motdr 67 sdf`ins `o vcdwcia tced, tjd pmrtcfcpmits wdrd rdncrdftdn t` tjd p`st-tdst qucz

pmad. Bmsdn `i tjd ar`up tjmt wms rmin`ehy msscaidn t` tjd pmrtcfcpmit up`i subecttcia tjd prd-

tdst survdy, tjdy wdrd prdsditdn wctj `id `o tw` typds `o quczzds. Ci tjd armpjcfmh qucz f`inctc`i,

tjdy wdrd prdsditdn wctj m sdt `o rmin`ehy `rndrdn cemads min tdxt idxt t` m semhhdr vdrsc`i `o

tjd bhmik pmad hmy`ut min mskdn t` Nrma min nr`p tjd f`itdit t` tjd f`rrdft sdftc`i. Ci tjd

vdrbmh f`inctc`i, pmrtcfcpmits wdrd prdsditdn wctj mhh `o tdxts min cemads ci m rmin`e `rndr.

Tindr dmfj tdxt/cemad wms tjd pjrmsd, Vdhdft m h`fmtc`i o`hh`wdn by m nr`p n`wi ediu

mhh`wcia tjde t` fj``sd or`e Ocrst `i tjd pmad, Vdf`in `i tjd pmad, dtf. Ci tjd fmsd `o

cemads, tjdy wdrd mhs` mhh`wdn t` sdhdft wjdtjdr tjd cemad mppdmrdn `i tjd hdot `r `i tjd rcajt.

@ifd tjdy subecttdn tjdcr rdsp`isds, tjdy wdrd sj`wi tjdcr sf`rd min acvdi m brcdo `vdrvcdw `o

tjd purp`sd `o tjd stuny.

Wr`fdnurd

Wmrtcfcpmits wdrd mppr`mfjdn by tjd f`-dxpdrceditdrs dctjdr ci pdrs`i `r `vdr tjd

citdridt min acvdi tjd hcik t` tjd dxpdrcedit wdbpmad. Tp`i vcsctcia tjd pmad, tjdy wdrd

msscaidn m subldft CN ci tjd nmtmbmsd `o rdsuhts, rmin`ehy msscaidn t` m trdmtedit ar`up, min

mskdn t` miswdr nde`armpjcfs qudstc`is cifhuncia tjdcr adindr, mad, sfj``h, eml`r, min j`urs

spdit `i tjd citdridt pdr wddk. Motdr miswdrcia mhh `o tjdsd qudstc`is, mhh pmrtcfcpmits wdrd

8/12/2019 Verbal Interference in Content Localization

7/26

_DRBMH CI^DRODRDIFD 1

prdsditdn wctj m wdbpmad p`puhmtdn wctj rmin`ehy adidrmtdn f`itdit o`r 67 sdf`ins. ^jd

wdbsctd tjdi rdncrdftdn tjde t` m qucz bmsdn `i tjdcr trdmtedit ar`up. ^jd subecttdn rdsp`isds

wjcfj wdrd tjdi mut`emtcfmhhy ditdrdn cit` tjd nmtmbmsd `o rdsuhts.

F`ncia

^jd prcemry ndpdindit vmrcmbhd pdrfditmad `o qudstc`is miswdrdn f`rrdfthy `i tjd

p`st-qucz wms i`t f`ndn. J`wdvdr, wd mhs` f`iscndrdn adindr, eml`r ms f`vmrcmtds min tjdsd

wdrd bd f`ndn iuedrcfmhhy. Qd mhs` f`iscndrdn mad min j`urs pdr wddk spdit `ihcid ms

f`vmrcmtds but tjdy ncn i`t ycdhn miy scaicfmit rdsuhts.

Rdsuhts

Nmtm Emicpuhmtc`is

Qd rdf`ndn tjd adindr min eml`r f`vmrcmtds iuedrcfmhhy t` mcn `ur mimhyscs. Qd mhs`

rde`vdn mhh nmtm p`cits tjmt mppdmrdn t` bd ormunuhdit, sufj ms `id pmrtcfcpmit wj` fhmcedn t`

spdin =2,477 j`urs `i tjd citdridt pdr wddk. Hmsthy, wd sueedn tjd qucz rdsp`isd vmhuds min

ncvcndn by tjd t`tmh iuebdr `o qudstc`is (?) t` ndtdrecid dmfj pmrtcfcpmits `vdrmhh mffurmfy.

Nmtm Dxph`rmtc`i

Bdo`rd mimhyzcia `ur nmtm, wd dxph`rdn `ur p``h `o 17 vmhcn pmrtcfcpmits. ^jd eml`rcty `o

tjde wdrd juemictcds eml`rs (I 5 24), o`hh`wdn fh`sdhy by diaciddrcia (I 5 =:) min sfcdifds

(I 5 =1). Mrts (I 5 6) min `tjdr eml`rs (I 5 1) f`eprcsdn tjd eci`rcty `o `ur pmrtcfcpmits. Qd

tjdi fmhfuhmtdn ndsfrcptcvd stmtcstcfs `o tjd iuedrcfmh f`vmrcmtds min rmw mffurmfcds o`r dmfj

qudstc`i. Vdd ^mbhd = bdh`w o`r tjdsd ndsfrcptcvd stmtcstcfs<

8/12/2019 Verbal Interference in Content Localization

8/26

_DRBMH CI^DRODRDIFD :

^mbhd =< Ndsfrcptcvd stmtcstcfs o`r tjd p`puhmtc`i cifhuncia cincvcnumh qudstc`i mffurmfcds

Mimhysds

Acvdi tjd qudstc`i `o j`w vdrbmh citdrodrdifd w`uhn moodft rdfmhh `o m wdbpmad hmy`ut, `ur

jyp`tjdscs wms tjmt pmrtcfcpmits wj` wdrd mskdn qudstc`is mb`ut tjd hmy`ut `o tjd wdbpmad ci m

vdrbmh o`remt w`uhn rdfmhh tjd hmy`ut hdss mffurmtdhy tjmi pmrtcfcpmits wj` wdrd mskdn t` rdfmhh

tjd smed wdbpmad but ci m armpjcfmh o`remt. ^jd armpjcfmh qucz ar`up jmn m edmi mffurmfy `o

7.?:42 (VN 5 7.6=62) min tjd vdrbmh qucz ar`up jmn m edmi mffurmfy `o 7.???1 (VN 5

7.2142). ^jdsd edmis mrd chhustrmtdn ci Ocaurd = bdh`w

8/12/2019 Verbal Interference in Content Localization

9/26

_DRBMH CI^DRODRDIFD 3

Ocaurd =< F`epmrcs`i `o edmis bdtwddi tjd tw` trdmtedit ar`ups

Qd usdn `id wmy mimhyscs `o vmrcmifd t` f`epmrd tjd edmi mffurmfy bdtwddi tjd tw`

trdmtedit ar`ups. ^jd MI@_M rdvdmhdn i` scaicfmit emci doodft bdtwddi tjd tw` trdmtedit

ar`ups, O(=, 17) 5 7.7?3, p 5 7.13>, cincfmtcia tjmt `ur cictcmh jyp`tjdscs n`ds i`t j`hn. ^jcs

edmis tjmt qucz o`remt jmn i` scaicfmit doodft `i rdfmhh `o tjd wdb pmad hmy`ut.

Qd f`inuftdn ourtjdr mimhyscs tjr`uaj sdvdrmh mimhyscs `o f`vmrcmifd tdsts t` sdd co miy `o

tjd nde`armpjcf f`vmrcmtds (adindr, eml`r, citdridt dxpdrcdifd) fmusdn miy scaicfmit

ncoodrdifds ci mffurmfy. M sueemry `o tjd rdsuhts `o tjcs MIF@_M tdst mrd sj`wi ci ^mbhd 2 (VN 5 7.6>12) wjchd edmi mffurmfy `i tdxt qudstc`is wms 7.?>41 (VN 57.6=316). ^jd MI@_M rdsuhts f`iredn tjcs ncoodrdifd ms scaicfmit (O(=, 17) 5 4.7:1, p 5

7.721). ^jcs edmis tjmt pmrtcfcpmits wdrd e`rd mffurmtd ci rdfmhhcia cemad p`sctc`icia `i tjd

wdb pmad tjmi tjdy wdrd ci rdfmhhcia tdxt p`sctc`icia `i tjd smed pmad.

Ncsfussc`i

^jd purp`sd `o tjcs stuny wms t` civdstcamtd tjd doodft `o rdfmhh f`inctc`is `i mffurmfy ci

rdf`istruftcia tjd hmy`ut `o m rmin`ehy adidrmtdn wdbpmad. @ur jyp`tjdscs wms tjmt rdfmhhcia tjd

hmy`ut wctj m vdrbmh ndsfrcptc`i w`uhn ycdhn h`wdr mffurmfy tjmi rdfmhhcia tjd hmy`ut armpjcfmhhy.

^j`uaj i` scaicfmit ncoodrdifd wms o`uin bdtwddi tjd mffurmfcds `i tjd tw` ncoodrdit typds `o

quczzds, wd ncn in m scaicfmit ncoodrdifd ci mffurmfy bdtwddi qudstc`is mb`ut cemads min

qudstc`is mb`ut tdxt. Ci tjcs fmsd, pmrtcfcpmits wdrd e`rd mffurmtd ci rdfmhhcia tjd p`sctc`i `o

cemads `i m wdbpmad tjmi tjdy wdrd ci rdfmhhcia tjd p`sctc`i `o tdxt. Bdfmusd tjd qudstc`is tjmt

pmrtcfcpmits ci tjd vdrbmh f`inctc`i jmn wdrd spmtcmh ci imturd, tjdsd rdsuhts f`ire prdvc`us

rdsdmrfj by Vfjhdr, dt mh. (27=2) cincfmtcia tjmt rdmncia spmtcmh tdxts fmi citdrodrd wctj tjd

rdfmhh `o spmtcmh cio`remtc`i. @ur rdsuhts wdrd i`t ms fhdmrhy scaicfmit ms tjdcrs, j`wdvdr tjcs cs

s`edtjcia tjmt f`uhn bd rdedncdn ci outurd ctdrmtc`is `o tjd dxpdrcedit by uscia m hmradr smephd

sczd.

@ur stuny jmn s`ed hcectmtc`is tjmt cijcbctdn cts doodftcvdidss. Vmephd sczd cs `id

hcectmtc`i tjmt f`uhn jmvd bddi m ndtdrecicia omft`r ci hcectcia tjd mitcfcpmtdn doodft `o tjd

dxpdrcedit. @ur p`puhmtc`i `o pmrtcfcpmits (I 5 17), wjchd i`t ciscaicfmit, wms e`sthy hcectdn

t` Fmridacd Edhh`i stundits wj` mrd wdhh-vdrsdn ci tdfji`h`ay min hckdhy jmvd mb`vd-mvdrmad

editmh mbchctcds. ^jus, wd sdd m fdchcia doodft ci `ur nmtm wjdrd emiy `o tjd pmrtcfcpmits ci b`tj

f`inctc`is jmn pdrodft sf`rds. @id s`hutc`i t` tjcs pr`bhde acvdi tjd hcectdn muncdifd `o tjd

8/12/2019 Verbal Interference in Content Localization

11/26

_DRBMH CI^DRODRDIFD ==

stuny f`uhn bd t` pdro`re ct mamci wctj e`rd tdxts min cemads `i dmfj pmad `r wctj m e`rd

f`ephdx hmy`ut.

Ci f`ifhusc`i, wd jmvd sj`wi tjmt tjd spmtcmh pr`pdrtcds `o cemads mrd rdfmhhdn f`rrdfthy

scaic

fmithy e`rd `otdi tjmi tjd spmtcmh pr`pdrtcds `o tdxt ci tjd f`itdxt `o wdb pmads. ^jdsdrdsuhts mrd ci hcid wctj prc`r rdsdmrfj (Vfjhdr, dt mh., 27=2) min emkd sdisd acvdi tjmt tjd vcsumh

systde cs admrdn t`wmrns rdf`aiczcia cemadry rmtjdr tjmi tdxt. ^jcs mh`id fmrrcds cephcfmtc`is o`r

tjd dhn `o wdb min citdromfd ndscai, ms ct cephcds tjmt doodftcvd usd `o cemadry f`uhn ycdhn e`rd

ede`rmbhd min usmbhd citdromfds.

Co `ur cictcmh jyp`tjdscs j`hns trud ci tjd outurd, tjdi citdromfds min citdrmftc`is rdhycia

`i vdrbmh ndsfrcptc`is `o spmtcmh rdhmtc`isjcps w`uhn omhh t` tjd wmyscnd ci omv`r `o e`rd usdr-

orcdinhy citdromfds tjmt jmridss tjd ciimtd spmtcmh pr`fdsscia p`wdr `o tjd brmci. O`r dxmephd, tjd

usd `o m armpjcfmh tcedhcid ms m edtj`n `o ncsphmycia dvdits ci m fdrtmci `rndr cs hckdhy t` bd

rdfmhhdn eufj e`rd mffurmtdhy tjmi m stminmrn hcst wctj nmtds bdo`rd dmfj ctde. Ci s`ed wmys,

tjcs cs mi mbstrmftc`i `o spmtcmh min vdrbmh ndsfrcptc`is cit` tjd tdep`rmh rdmhe, but wjdi ct

f`eds t` wdb citdromfds, tjdsd typds `o dhdedits `otdi `vdrhmp. Ci mhh, tjdrd cs eufj e`rd w`rk

t` bd n`id ci tjcs mrdm. Vpmtcmh pdrfdptc`i jms ydt t` bd ouhhy uindrst``n, but sufj

uindrstmincia wchh uin`ubtdnhy hdmn t` di`re`us hdmps `o ndvdh`pedit ci `tjdr rdmhes sufj ms

Juemi-F`eputdr Citdrmftc`i tjmt rdhy jdmvchy `i tjd pr`fdssds tjmt uindrhy `ur uindrstmincia `o

tjd w`rhn mr`uin us.

8/12/2019 Verbal Interference in Content Localization

12/26

_DRBMH CI^DRODRDIFD =2

Rdodrdifds

Arcoi, C. F., & I`brd, M. F. (2776). @rcditcia mttditc`i t` h`fmtc`is ci citdrimh rdprdsditmtc`is.L`urimh `o F`aictcvd Idur`sfcdifd, =4(:), ==1?-==3>.

K`sshyi, V. E., & W`edrmitz, L. R. (=311). Cemadry, pr`p`sctc`is, min tjd o`re `o citdrimh

rdprdsditmtc`is. F`aictcvd Wsyfj`h`ay,3, 42-1?.

Euiicfj, D., Hminmu, B., & N`sjdr, B. M. (277=). Vpmtcmh hmiaumad min spmtcmh rdprdsditmtc`i< mfr`ss-hciaucstcf f`epmrcs`i. F`aictc`i, :=, =1=-271.

W`sthd, B. R., N'Dsp`sct`, E., & F`rkci, V. (2774, Emrfj). Doodfts `o vdrbmh min i`ivdrbmhcitdrodrdifd `i spmtcmh min `bldft vcsumh w`rkcia ede`ry. Ede`ry & F`aictc`i, 22(2),276-2=2.

Vfjhdr, M., Vfjdctdr, K., & Adrldts, W. (27=2). _drbmh ndsfrcptc`is `o spmtcmh cio`remtc`i fmicitdrodrd wctj pcfturd pr`fdsscia. Ede`ry, 27(1), ?:2-?33.

8/12/2019 Verbal Interference in Content Localization

13/26

_DRBMH CI^DRODRDIFD =6

Mppdincx M

Ocaurd =

Wrd-dxpdrcedit survdy o`re

8/12/2019 Verbal Interference in Content Localization

14/26

_DRBMH CI^DRODRDIFD =>

Ocaurd 2

Vmephd wdb pmad hmy`ut

8/12/2019 Verbal Interference in Content Localization

15/26

_DRBMH CI^DRODRDIFD =4

Ocaurd 6

W`st-stceuhus qucz< vdrbmh o`remt

I`td< V`ed tdxt emy bd fut `oo nud t` tjd sfrddisj`t

8/12/2019 Verbal Interference in Content Localization

16/26

_DRBMH CI^DRODRDIFD =?

Ocaurd >

W`st-stceuhus qucz< armpjcfmh o`remt

I`td< V`ed dhns min cemads mrd fut `ut nud t` sczd f`istrmcits

8/12/2019 Verbal Interference in Content Localization

17/26

_DRBMH CI^DRODRDIFD =1

Mppdincx B

W`sscbhd tdxts o`r dxpdrcedit

^dxt =

^jd wdstdri f`mstmh mrdm `o Dfumn`r b`rndrs tjd Wmfcf @fdmi t` tjd wdst, dif`epmssds m br`mnf`mstmh phmci, min tjdi rcsds t` tjd o``tjchhs `o tjd Minds E`uitmcis t` tjd dmst. Ct cs dstcemtdntjmt 3:% `o tjd imtcvd o`rdst `o f`mstmh Dfumn`r jms bddi dhcecimtdn ci omv`r `o fmtthd rmifjciamin `tjdr marcfuhturmh pr`nuftc`i, cifhuncia bmimim, fmfm` min f`oodd phmitmtc`is. ^jd o`rdstormaedits tjmt stchh survcvd mrd prcemrchy o`uin mh`ia tjd f`mstmh e`uitmci rmiads `o Emfjd-Fjcinuh, Lmem-F`mqud, min Fj`ia`i-F`h`ifjd, min cifhund tr`pcfmh nry o`rdst, tr`pcfmh wdto`rdst, tr`pcfmh e`cst dvdrarddi o`rdst, prde`itmid fh`un o`rdst, min emiar`vd o`rdst.

^dxt 2

^jd fhub wms o`uindn ci =3>: by m ar`up `o stundits (tjd "Dstuncmitds") `o m pubhcf prdpmrmt`rysfj``h (tjd Cistctut` Rmecr` nd Emdztu, CRE) ci Emnrcn. By tjd tced wjdi tjd rst Vpmicsj-wcndsdms`i-h`ia fjmepc`isjcp wms `ramiczdn ci =344, by tjd Vpmicsj Bmskdtbmhh Mss`fcmtc`i (ODB),ct wms `id `o tjd scx fhubs pmrtcfcpmtcia ci tjmt t`urimedit, ms tjd sdf`in bdst tdme or`e tjdWr`vcifd `o Emnrcn (tjd rst bdcia Rdmh Emnrcn. Vcifd tjdi, ct jms mhwmys pmrtcfcpmtdn ci tjdprdecdr Vpmicsj bmskdtbmhh hdmaud. Ct cs `id `o `ihy tjrdd `o sufj fhubs, t`adtjdr wctj RdmhEmnrcn min L`vditut. Ct cs mhs` `id `o tw` `ihy Vpmicsj bmskdtbmhh fhubs wctj tdmes b`tj mt tjdt`p emhd min odemhd Vpmicsj fjmepc`isjcps.

^dxt 6

Wrced Ecicstdr Jmrpdr smcn jd w`uhn e`vd o`rwmrn wctj jcs t`p

vd prc`rctcds or`e tjd fmepmcai.Mt hdmst o`ur `o tjdsd w`uhn rdqucrd hdacshmtcvd mftc`i< tjd pmssmad `o m Odndrmh Mff`uitmbchcty Mftci rdsp`isd t` tjd sp`is`rsjcp sfminmh; sdttcia h`iadr eminmt`ry sditdifds; h`wdrcia tjd A``ns& Vdrvcfds mx t` ?% (min dvditumhhy t` 4%); acvcia $=,277 o`r pmrdits pdr fjchn uindr tjd mad`o ?; min ida`tcmtcia wctj tjd pr`vcifds t` sj`rtdi wmct-tceds (tjcs prc`rcty wms rdphmfdn, p`st-dhdftc`i, wctj f`ebmtcia frced by frdmtcia e`rd p`hcfd `ofdrs). ^jd fjchn mhh`wmifd min rstAV^ wdrd ci phmfd by Luhy =, 277?. @i Ndfdebdr ?, 277?, mi`tjdr cssud emiy dxpdftdn t` mrcsdci tjd rst sdssc`i `o pmrhcmedit ncn, ci omft, f`ed t` tjd o`rd, wjdi tjd a`vdriedit citr`nufdnm e`tc`i fmhhcia "`i tjd a`vdriedit t` citr`nufd hdacshmtc`i t` rdst`rd tjd trmnctc`imh ndictc`i `oemrrcmad wctj`ut moodftcia fcvch uic`is min wjchd rdspdftcia dxcstcia smed-sdx emrrcmads."

^dxt >

Tp`i jcs rdturi t` Ormifd, jd l`cidn FIRV (=3>3=344). Nurcia mhh tjdsd ydmrs, jd pursudnrdsdmrfj `i tjd rdhmtc`isjcp bdtwddi Dayptcmis min prd-Jdhhdids, pr`vcncia s`ed ref`ifhusc`is `i tjd rdhmtc`isjcp bdtwddi tjdsd tw` ardmt fcvchczmtc`is min tjd jcst`ry `o tjdmifcdit Mdadmi w`rhn.

8/12/2019 Verbal Interference in Content Localization

18/26

_DRBMH CI^DRODRDIFD =:

^dxt 4

Daypt`h`ay's e`ndri jcst`ry bdacis wctj tjd civmsc`i `o Daypt by Imp`hd`i B`impmrtd. ^jdsubsdqudit pubhcfmtc`i `o Ndsfrcptc`i nd h'Dayptd bdtwddi =:73 min =:23 emnd iuedr`usmifcdit Dayptcmi s`urfd emtdrcmhs mvmchmbhd t` Dur`pdmis o`r tjd rst tced. Ldmi Ormif`csFjmep`hhc`i, ^j`ems S`uia min Cpp`hct` R`sdhhcic wdrd s`ed `o tjd rst Daypt`h`acsts `o wcnd

mffhmce. ^jd Adremi Kmrh Rcfjmrn Hdpscus wms mi dmrhy pmrtcfcpmit ci tjd civdstcamtc`is `oDaypt; emppcia, dxfmvmtcia, min rdf`rncia sdvdrmh sctds. Fjmep`hhc`i mii`uifdn jcs adidrmhndfcpjdredit `o tjd systde `o Dayptcmi jcdr`ahypjcfs o`r tjd rst tced, deph`ycia tjd R`sdttmVt`id ms jcs prcemry mcn. ^jd Vt`id's ndfcpjdredit wms m vdry cep`rtmit ndvdh`pedit `oDaypt`h`ay. Qctj subsdqudithy dvdr-cifrdmscia ki`whdnad o Dayptcmi wrctcia min hmiaumad, tjdstuny `o Mifcdit Dayptcmi fcvchczmtc`i wms mbhd t` pr`fddn wctj ardmtdr mfmndecf rca`ur min wctjmhh tjd mnndn cepdtus tjmt f`eprdjdisc`i `o tjd wrcttdi s`urfds wms mbhd t` diadindr.Daypt`h`ay bdfmed e`rd pr`odssc`imh vcm w`rk `o Qchhcme Emttjdw Ohcindrs Wdtrcd, me`ia `tjdrs.Wdtrcd citr`nufdn tdfjicquds `o dhn prdsdrvmtc`i, rdf`rncia, min dxfmvmtcia. J`wmrn Fmrtdr'sdxpdnctc`i br`uajt eufj mffhmce t` tjd dhn `o Daypt`h`ay.

^dxt ?

Rdvcdws wdrd `vdrwjdheciahy idamtcvd, wctj he frctcf Nmvcn Iusmcr fmhhcia ct "Mi uttdrhyw`rtjhdss pcdfd `o w`rk" min acvcia ct zdr` `ut `o o`ur stmrs. Ct rdfdcvdn m sf`rd `o 6.= `ut `o =7`i CENb. Dvmiadhcfmh pubhcfmtc`is wdrd eufj kcindr. Fjrcstcmi ^dn Bmdjr `o E@_CDATCNDndsfrcbdn ct ms "Mi ditdrtmcicia e`vcd min m usdouh t``h o`r hdmncia pd`phd t` f`iscndr tjd fhmces`o tjd A`spdh." Fjrcstcmi mutj`r L`ji Jmadd smcn `o tjd he< "^jd p`wdr `o tjd a`spdh t`trmiso`re tjd hcvds `o tjd fjmrmftdrs cs sj`wi wctj nddphy e`vcia rdmhcty. V` rdmh cs tjdprdsditmtc`i `o tjd phmi `o smhvmtc`i ci tjcs e`vcd, tjd vcdwdr wchh bd hdot wctj`ut dxfusd."Dvmiadhcst Lmfk _mi Cepd wms qu`tdn ms smycia< "B`tj Rdxdhhm min C bdhcdvd tjcs t` bd tjdardmtdst rdhcac`us rdhdmsd wd jmvd dvdr wmtfjdn.

^dxt 1

Motdr Sm'q`b, Mjmnmbuc. Jd wms acvdi tjcs imed bdfmusd `o jcs strckcia scechmrcty t` jcs omtjdr.Vj`rthy bdo`rd jd ncdn Sm'q`b cistruftdn tw` `o jcs ncsfcphds, Mjmnmbuc min ]mecsj`', t` a` t`Mitc`fj, s` tjmt tjd pmtrcmrfj `o Mitc`fj f`uhn f`isdfrmtd wjcfjdvdr `o tjde jd fj`sd min sdinjce bmfk. ^jdy ncn s`, min wjdi tjdy b`tj mrrcvdn ci Mitc`fj tjdy wdrd h`nadn ci tjd j`usd `o mfdrtmci bdhcdvdr.

^dxt :

Vcifd Emy 277?, e`rd tjmi =7,777 pd`phd ci tjd W`r`ia Ncstrcft jmvd bddi ncsphmfdn by tjdj`t eun `wcia or`e m imturmh ams wdhh bdcia nrchhdn by Hmpcin` Brmitms, mi `ch wdhh f`epmiytjmt cs pmrt `o m f`iah`edrmtd `widn by F``rncimtcia Ecicstdr o`r tjd Wd`phd's Qdhomrd MburczmhBmkrcd. Ams min j`t eun stmrtdn spdwcia or`e tjd wdhh `i Emy 2:, wjdi tjd nrchh pdidtrmtdn mhmydr `o hcqucn sdncedit. Mttdepts t` puep f`ifrdtd n`wi tjd wdhh ncn i`t st`p tjd `w. Qjchds`ed sfcditcsts jmvd spdfuhmtdn tjmt tjd dmrtjqumkdtjmt strufk S`aymkmrtm `i Emy 21, tjd nmybdo`rd tjd wdhh druptdn, emy jmvd frmfkdn tjd ar`uin, frdmtcia p`tditcmh pmtjwmys o`r tjd eun

8/12/2019 Verbal Interference in Content Localization

19/26

_DRBMH CI^DRODRDIFD =3

t` rdmfj tjd suromfd, `tjdrs jmvd suaadstdn tjmt tjd nrchhcia pr`fdnurd wms omuhty by i`t uscia mfmscia.

^dxt 3

Mut`emtcf trmisecssc`i ucns jmvd emiy pdro`remifd-dijmifcia fjdecfmhs mnndn t` tjd ucn t`eddt tjd ndemins `o dmfj trmisecssc`i. V`ed M^O spdfcfmtc`is mrd `pdi t` f`epdtcia brmins,sufj ms tjd f`ee`i NDZR@I spdfcfmtc`i, wjdrd ncoodrdit emiuomfturdrs usd ncoodrditfjdecfmhs t` eddt tjd smed pdro`remifd spdfcfmtc`i. ^jdsd pr`nufts mrd s`hn uindr hcfdisdor`e tjd @DE rdsp`iscbhd o`r dstmbhcsjcia tjd spdfcfmtc`i. V`ed vdjcfhd emiuomfturdrs wchhrdqucrd "adiucid" `r @rcacimh Dqucpedit Emiuomfturdr (@DE) M^O.

dxt =7

Ndrcvdn or`e tjd Wdrscmi kjwmlm, m tdre `o j`i`ur, tjd w`rn Kj`lm rdodrrdn t` tj`sd f`ivdrtdn t`Iczmrc Csemchc Cshme ci tjd Cincmi sub-f`itcidit or`e mb`ut tjd =6tj fditury `iwmrn. E`rdpmrtcfuhmrhy, ct cifhundn fdrtmci ar`ups, prdn`ecimithy or`e Aulmrmt min Kutfj, wj` rdtmcidnstr`ia Cincmi dtjicf r``ts min fmstd fust`es wjchd sustmcicia tjdcr Eushce rdhcac`us cnditctyuindr f`itciumh tjrdmts `o pdrsdfutc`i. Ci tjd =3tj fditury, tjd Csemchc Cememt (`ofd `o tjdCeme) bdfmed dstmbhcsjdn ci Cincm min m pr`armeed `o f`is`hcnmtc`i min rd`ramicsmtc`i `o tjdf`eeuicty min cts cistctutc`is bdami. ^jdsd fjmiads hdn t` ncoodrdifds `o `pcic`i me`iaKj`lms. Qjchd tjd eml`rcty `o Kj`lms rdemcidn Csemchc, `id ar`up bdfmed Ctjim' msjmrc min msemhhdr ar`up mn`ptdn Vuiicse.

8/12/2019 Verbal Interference in Content Localization

20/26

_DRBMH CI^DRODRDIFD 27

Mppdincx F

W`sscbhd cemads o`r dxpdrcedit

Cemad =

Cemad 2

8/12/2019 Verbal Interference in Content Localization

21/26

_DRBMH CI^DRODRDIFD 2=

Cemad 6

Cemad >

8/12/2019 Verbal Interference in Content Localization

22/26

_DRBMH CI^DRODRDIFD 22

Cemad 4

Cemad ?

8/12/2019 Verbal Interference in Content Localization

23/26

_DRBMH CI^DRODRDIFD 26

Cemad 1

Cemad :

8/12/2019 Verbal Interference in Content Localization

24/26

_DRBMH CI^DRODRDIFD 2>

Cemad 3

Cemad =7

8/12/2019 Verbal Interference in Content Localization

25/26

_DRBMH CI^DRODRDIFD 24

Cemad ==

Cemad =2

8/12/2019 Verbal Interference in Content Localization

26/26

_DRBMH CI^DRODRDIFD 2?

Cemad =6