Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and...

38
Early morphology Eye tracking and meaning–based tasks Morphology in sentence reading Morphology in the parafovea? Is There Morphology in the Parafovea? (Visual Word Identification Models faced with Sentence Reading) Davide Crepaldi International School for Advanced Studies, Trieste Milan Center for Neuroscience Italy IMM17, Vienna, 18–21 February 2016 Davide Crepaldi Morphology in the Parafovea?

Transcript of Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and...

Page 1: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Is There Morphology in the Parafovea?(Visual Word Identification Models faced with Sentence

Reading)

Davide Crepaldi

International School for Advanced Studies, TriesteMilan Center for Neuroscience

Italy

IMM17, Vienna, 18–21 February 2016

Davide Crepaldi Morphology in the Parafovea?

Page 2: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Some disclaimers

I Processing, not description

I Models are metaphors

I Hold on about morphology in the parafovea

Davide Crepaldi Morphology in the Parafovea?

Page 3: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

A break into arbitrariness

form

meaning

morphology

Davide Crepaldi Morphology in the Parafovea?

Page 4: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Outline

Early morphologyNonword processingMasked primingERP/MEG

Eye tracking and meaning–based tasks

Morphology in sentence reading

Morphology in the parafovea?

Davide Crepaldi Morphology in the Parafovea?

Page 5: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Nonword processingMasked primingERP/MEG

Early morphology

Davide Crepaldi Morphology in the Parafovea?

Page 6: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Nonword processingMasked primingERP/MEG

Pseudowords

I JUVENATE (from REJUVENATE) takes longer to be rejectedthan PERTOIRE (from REPERTOIRE)

I DEJUVENATE takes longer to be rejected thanDEPERTOIRE

[Taft & Forster, JVLVB 1975]

(Replicated several times, e.g., Burani et al., 1999; Caramazza etal., 1988; Crepaldi et al., 2010)

Davide Crepaldi Morphology in the Parafovea?

Page 7: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Nonword processingMasked primingERP/MEG

Masked priming

prime

#######

TARGET

press button

~500 ms

35-50 ms

~2000 ms

Davide Crepaldi Morphology in the Parafovea?

Page 8: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Nonword processingMasked primingERP/MEG

Nonword priming

I RAPIDIFIER primes RAPID

I RAPIDUIT doesn’t prime RAPID

I SPORTATION primes RAPID

[Longtin & Meunier, JML 2005]

Davide Crepaldi Morphology in the Parafovea?

Page 9: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Nonword processingMasked primingERP/MEG

Word priming

I DEALER primes DEAL

I CORNER primes CORN

I BROTHEL doesn’t prime BROTH

[e.g., Longtin et al., LCP 2003; Rastle et al., PRB 2004]

Davide Crepaldi Morphology in the Parafovea?

Page 10: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Nonword processingMasked primingERP/MEG

The temporal microscope

DEALER vs. CORNER vs. DIALOG

[Lavric et al., JEP:HPP 2012]

Davide Crepaldi Morphology in the Parafovea?

Page 11: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Nonword processingMasked primingERP/MEG

The temporal microscope

[Rastle et al., JEP:HPP 2015]

[Fruchter et al., FHN 2012]

Davide Crepaldi Morphology in the Parafovea?

Page 12: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Nonword processingMasked primingERP/MEG

The early morphology manifesto

I Morphology is addressed early

I Morphology is addressed outside of awareness

I In many cases, meaning isn’t so important

Davide Crepaldi Morphology in the Parafovea?

Page 13: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Nonword processingMasked primingERP/MEG

The early morphology manifesto

form

meaning

morphology

Davide Crepaldi Morphology in the Parafovea?

Page 14: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Nonword processingMasked primingERP/MEG

Why?

Davide Crepaldi Morphology in the Parafovea?

Page 15: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Nonword processingMasked primingERP/MEG

Wait a minute. . .

I Isolated words

I Non–semantic tasks (e.g., lexical decision)

Davide Crepaldi Morphology in the Parafovea?

Page 16: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Eye tracking and meaning–based tasks

Davide Crepaldi Morphology in the Parafovea?

Page 17: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

A new paradigm

dealer-DEAL vs. corner-CORN vs. dialog-DIAL

Davide Crepaldi Morphology in the Parafovea?

Page 18: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Looking times, gaze duration

dealer-DEAL corner-CORN dialog-DIAL

GD (ms)

control

related

control

related

control

related

310

320

330

340

350

Davide Crepaldi Morphology in the Parafovea?

Page 19: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Where to find out more about this work

Marelli, M., Amenta, S., Morone, E.A., and Crepaldi, D. (2013).Meaning is in the beholders eye: Morpho-semantic effects inmasked priming. Psychonomic Bulletin and Review, 20, 534541.

Davide Crepaldi Morphology in the Parafovea?

Page 20: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Morphology in sentence reading

Davide Crepaldi Morphology in the Parafovea?

Page 21: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Same words, different contexts

Era una fredda serata invernale, cos̀ı Gloria accese il camino, presela sua copertina e accese il televisore

(It was a cold winter night, so Gloria lighted up her fireplace, covered herself

with a small blanket, and turned on the TV)

Dopo aver letto la copertina, cap̀ı di aver trovato una preziosaprima edizione

(After reading the cover, she realised that was a rare first edition)

Davide Crepaldi Morphology in the Parafovea?

Page 22: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Stem frequency effect

Form Frequency

copertura 3842coperta 1778coperto 1663coperte 1060

. . . . . .

10143

Davide Crepaldi Morphology in the Parafovea?

Page 23: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Predictions

I Morph analysis independent of the context (as in maskedpriming): same SFE in trasparent and opaque

I Morph analysis informed by the context (contrary to maskedpriming): SFE in transparent, not in opaque

I Morph analysis independent of the context (as in maskedpriming), but meaning matters: opposite SFE in trasparentand opaque

Davide Crepaldi Morphology in the Parafovea?

Page 24: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

First fixations

Davide Crepaldi Morphology in the Parafovea?

Page 25: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Where to find out more about this work

Amenta, S., Marelli, M., and Crepaldi, D. (2015). The fruitlesseffort of growing a fruitless tree: Early morphoorthographic andmorphosemantic effects in sentence reading. Journal ofExperimental Psychology: Learning, Memory and Cognition, 41,1587-1596.

Davide Crepaldi Morphology in the Parafovea?

Page 26: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Morphology in the parafovea?

Davide Crepaldi Morphology in the Parafovea?

Page 27: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Models of eye movements in reading

I Serial: lexical processing is limited to one word at a time

I Parallel: lexical processing is distributed over multiple words

Davide Crepaldi Morphology in the Parafovea?

Page 28: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Parafoveal processing is critical

(( ( (foveaparafovea

Davide Crepaldi Morphology in the Parafovea?

Page 29: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Parafoveal processing is critical

Everyone think that language nerds are sexy

foveaparafovea

Davide Crepaldi Morphology in the Parafovea?

Page 30: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Parafoveal processing is critical

Everyone think that language nerds are sexy

foveaparafovea

Davide Crepaldi Morphology in the Parafovea?

Page 31: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Parafoveal effects

(...) THAT LANGUAGE NERDS ARE (...)

(...) THAT LANGUAGE NESOZ ARE (...) Target wordPre-target word

Invisible boundary

(a) Readers fixate the pre-target word

(b) Readers fixate the target word

Target wordPre-target word

Davide Crepaldi Morphology in the Parafovea?

Page 32: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Does this go beyond word form?

A “corner–corn” design

I Genuine derivations: ortaggio, vegetable, based on orto,garden

I Pseudoderivations: formaggio, cheese, pseudo–based onforma, form

I Nonderivations: corteccia, bark, including the word corte,court, with no suffix

Davide Crepaldi Morphology in the Parafovea?

Page 33: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

The answer is: nope!

Davide Crepaldi Morphology in the Parafovea?

Page 34: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Where to find out more about this work

www.davidecrepaldi.net

Davide Crepaldi Morphology in the Parafovea?

Page 35: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Wrap up

Morphology:

I isn’t lexically coded in the brain

I affects (visual) word processing very early on

I affects (visual) word processing differently depending on taskdemands

I doesn’t affect eye movements in reading from the parafovea

Davide Crepaldi Morphology in the Parafovea?

Page 36: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Come to SISSA!

http://indico.sissa.it/e/tex2016

Davide Crepaldi Morphology in the Parafovea?

Page 37: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Come to SISSA!

MoProc 2017

Davide Crepaldi Morphology in the Parafovea?

Page 38: Is There Morphology in the Parafovea? - Davide Crepaldi · Early morphology Eye tracking and meaning{based tasks Morphology in sentence reading Morphology in the parafovea? Is There

Early morphologyEye tracking and meaning–based tasks

Morphology in sentence readingMorphology in the parafovea?

Acknowledgments

I The Ministry of Education, University and Research in Italy;the ESRC, the British Academy and the Leverhulm Trust inthe UK.

I Marco Marelli and Simona Amenta (Milano Bicocca, now atGent); Federica Degno (Milano Bicocca, now atSouthampton); Kathy Rastle (Royal Holloway, UK); andAureliu Lavric and Heike Elchlepp (Exeter, UK).

[email protected]

www.davidecrepaldi.net

Davide Crepaldi Morphology in the Parafovea?