Lign170 Lecture 1

download Lign170 Lecture 1

of 54

Transcript of Lign170 Lecture 1

  • 8/8/2019 Lign170 Lecture 1

    1/54

    A Brief and Friendly Introduction to

    Psycholinguistics

    Roger Levy

    UC San DiegoDepartment of Linguistics

    31 March 2009

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    2/54

    What is psycholinguistics?

    Inherently, linguistic communication involves the resolution

    of uncertainty over a potentially unbounded set of possible

    signals and meanings.

    How can a fixed set of knowledge and resources be

    deployed to manage this uncertainty?

    This is the study of language processing.

    And how can

    such knowledge and resources be learned from finite input?

    This is the study of language acquisition.

    Psycholinguistics studies these problems, through

    observational studies, experiments, and computational

    modeling.

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    3/54

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    4/54

    What is psycholinguistics?

    Inherently, linguistic communication involves the resolution

    of uncertainty over a potentially unbounded set of possible

    signals and meanings.

    How can a fixed set of knowledge and resources be

    deployed to manage this uncertainty?

    This is the study of language processing.

    And how can

    such knowledge and resources be learned from finite input?

    This is the study of language acquisition.

    Psycholinguistics studies these problems, through

    observational studies, experiments, and computational

    modeling.

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    5/54

    What is psycholinguistics?

    Inherently, linguistic communication involves the resolution

    of uncertainty over a potentially unbounded set of possible

    signals and meanings.

    How can a fixed set of knowledge and resources be

    deployed to manage this uncertainty?

    This is the study of language processing.

    And how can

    such knowledge and resources be learned from finite input?

    This is the study of language acquisition.

    Psycholinguistics studies these problems, through

    observational studies, experiments, and computational

    modeling.

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    6/54

    What is psycholinguistics?

    Inherently, linguistic communication involves the resolution

    of uncertainty over a potentially unbounded set of possible

    signals and meanings.

    How can a fixed set of knowledge and resources be

    deployed to manage this uncertainty?

    This is the study of language processing.

    And how can

    such knowledge and resources be learned from finite input?

    This is the study of language acquisition.

    Psycholinguistics studies these problems, through

    observational studies, experiments, and computational

    modeling.

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    7/54

    What is psycholinguistics?

    Inherently, linguistic communication involves the resolution

    of uncertainty over a potentially unbounded set of possible

    signals and meanings.

    How can a fixed set of knowledge and resources be

    deployed to manage this uncertainty?

    This is the study of language processing.

    And how can

    such knowledge and resources be learned from finite input?

    This is the study of language acquisition.

    Psycholinguistics studies these problems, through

    observational studies, experiments, and computational

    modeling.

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    8/54

    What is language processing?

    Language processingis the study of how humans

    comprehend and produce language (sentences, words

    within sentences, and sequences of sentences, etc.) in

    real time. We can divide this into language comprehension

    (understanding what is spoken and what is written) and

    language production(choosing what to say or write based

    on what you want to mean)

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    9/54

    What is language processing?

    Language processingis the study of how humans

    comprehend and produce language (sentences, words

    within sentences, and sequences of sentences, etc.) in

    real time. We can divide this into language comprehension

    (understanding what is spoken and what is written) and

    language production(choosing what to say or write based

    on what you want to mean)

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    10/54

    What is language acquisition?

    Language acquisitionis the study of how humans acquire

    knowledge of their native language (as infants and aschildren)

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    11/54

    Today

    In this talk Ill focus on language comprehension, and then

    discuss a bit about language production.

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    12/54

    Theoretical Desiderata

    Realistic models of human sentence comprehension must

    account for:

    Language has structure

    Robustness to arbitrary input

    Accurate disambiguation

    Inference on basis of incomplete input (Tanenhaus et al.,

    1995; Altmann and Kamide, 1999; Kaiser and Trueswell,

    2004)

    Processing difficulty is differentialand localized

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    13/54

    Language has structure

    The colored word sequences all have something in common:

    The girl gave the dog a big sloppy kiss.

    I gave the dog a big sloppy kiss.

    Every boy on the left side of the room gave the dog a big

    sloppy kiss. The teacher of this class gave the dog a big sloppy kiss.

    In linguistics, this commonality is that the colored word

    sequences are all of the same phrase type.

    In this case, the phrase type is called a noun phrase.Languages have many different phrase types, and we can

    describe the grammar of a languages in how its phrase types

    come together.

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    14/54

    Language has structure

    The colored word sequences all have something in common:

    The girl gave the dog a big sloppy kiss.

    I gave the dog a big sloppy kiss.

    Every boy on the left side of the room gave the dog a big

    sloppy kiss. The teacher of this class gave the dog a big sloppy kiss.

    In linguistics, this commonality is that the colored word

    sequences are all of the same phrase type.

    In this case, the phrase type is called a noun phrase.Languages have many different phrase types, and we can

    describe the grammar of a languages in how its phrase types

    come together.

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    15/54

    Language has structure

    The colored word sequences all have something in common:

    The girl gave the dog a big sloppy kiss.

    I gave the dog a big sloppy kiss.

    Every boy on the left side of the room gave the dog a big

    sloppy kiss. The teacher of this class gave the dog a big sloppy kiss.

    In linguistics, this commonality is that the colored word

    sequences are all of the same phrase type.

    In this case, the phrase type is called a noun phrase.Languages have many different phrase types, and we can

    describe the grammar of a languages in how its phrase types

    come together.

    L h

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    16/54

    Language has structure

    The colored word sequences all have something in common:

    The girl gave the dog a big sloppy kiss.

    I gave the dog a big sloppy kiss.

    Every boy on the left side of the room gave the dog a big

    sloppy kiss. The teacher of this class gave the dog a big sloppy kiss.

    In linguistics, this commonality is that the colored word

    sequences are all of the same phrase type.

    In this case, the phrase type is called a noun phrase.Languages have many different phrase types, and we can

    describe the grammar of a languages in how its phrase types

    come together.

    L h t t

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    17/54

    Language has structure

    The colored word sequences all have something in common:

    The girl gave the dog a big sloppy kiss.

    I gave the dog a big sloppy kiss.

    Every boy on the left side of the room gave the dog a big

    sloppy kiss. The teacher of this class gave the dog a big sloppy kiss.

    In linguistics, this commonality is that the colored word

    sequences are all of the same phrase type.

    In this case, the phrase type is called a noun phrase.

    Languages have many different phrase types, and we can

    describe the grammar of a languages in how its phrase types

    come together.

    L h t t

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    18/54

    Language has structure

    The colored word sequences all have something in common:

    The girl gave the dog a big sloppy kiss.

    I gave the dog a big sloppy kiss.

    Every boy on the left side of the room gave the dog a big

    sloppy kiss. The teacher of this class gave the dog a big sloppy kiss.

    In linguistics, this commonality is that the colored word

    sequences are all of the same phrase type.

    In this case, the phrase type is called a noun phrase.

    Languages have many different phrase types, and we can

    describe the grammar of a languages in how its phrase types

    come together.

    L h t t

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    19/54

    Language has structure

    The colored word sequences all have something in common:

    The girl gave the dog a big sloppy kiss.

    I gave the dog a big sloppy kiss.

    Every boy on the left side of the room gave the dog a big

    sloppy kiss. The teacher of this class gave the dog a big sloppy kiss.

    In linguistics, this commonality is that the colored word

    sequences are all of the same phrase type.

    In this case, the phrase type is called a noun phrase.

    Languages have many different phrase types, and we can

    describe the grammar of a languages in how its phrase types

    come together.

    Language has structure

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    20/54

    Language has structure

    The colored word sequences all have something in common:

    The girl gave the dog a big sloppy kiss.

    I gave the dog a big sloppy kiss.

    Every boy on the left side of the room gave the dog a big

    sloppy kiss. The teacher of this class gave the dog a big sloppy kiss.

    In linguistics, this commonality is that the colored word

    sequences are all of the same phrase type.

    In this case, the phrase type is called a noun phrase.

    Languages have many different phrase types, and we can

    describe the grammar of a languages in how its phrase types

    come together.

    Robustness

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    21/54

    Robustness

    Real linguistic input is not always totally well-formed. . .I think when she finally came to the realization that,

    you know, no, I can not, I can not take care of myself.

    . . .

    I mean, for somebody who is, you know, for most of

    their life has, has, uh, not just merely had a farm buthad ten children had a farm, ran everything because

    her husband was away in the coal mines.

    And, you know, facing that situation, its, its quite a

    dilemma.

    . . . but usually we come to understand it pretty well anyway.

    Robustness

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    22/54

    Robustness

    Real linguistic input is not always totally well-formed. . .I think when she finally came to the realization that,

    you know, no, I can not, I can not take care of myself.

    . . .

    I mean, for somebody who is, you know, for most of

    their life has, has, uh, not just merely had a farm buthad ten children had a farm, ran everything because

    her husband was away in the coal mines.

    And, you know, facing that situation, its, its quite a

    dilemma.(The woman is facing being put in a resting home.)

    . . . but usually we come to understand it pretty well anyway.

    Robustness

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    23/54

    Robustness

    Real linguistic input is not always totally well-formed. . .I think when she finally came to the realization that,

    you know, no, I can not, I can not take care of myself.

    . . .

    I mean, for somebody who is, you know, for most of

    their life has, has, uh, not just merely had a farm buthad ten children had a farm, ran everything because

    her husband was away in the coal mines.

    And, you know, facing that situation, its, its quite a

    dilemma.(The woman is facing being put in a resting home.)

    . . . but usually we come to understand it pretty well anyway.

    Accurate disambiguation

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    24/54

    Accurate disambiguation

    Most sentences are ambiguous in ways we do not even notice:Mary forgot the pitcher. . .

    Accurate disambiguation

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    25/54

    Accurate disambiguation

    Most sentences are ambiguous in ways we do not even notice:Mary forgot the pitcher. . .

    Accurate disambiguation

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    26/54

    Accurate disambiguation

    Most sentences are ambiguous in ways we do not even notice:Mary forgot the pitcher of water sitting near the stove.

    Accurate disambiguation

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    27/54

    Accurate disambiguation

    Most sentences are ambiguous in ways we do not even notice:Mary forgot the pitcher of water sitting near the stove.

    Accurate disambiguation

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    28/54

    Accurate disambiguation

    Most sentences are ambiguous in ways we do not even notice:Mary forgot the pitcher of water sitting near the stove.

    Thats probably not what you were thinking of...

    Inference on the basis of incomplete input

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    29/54

    Inference on the basis of incomplete input

    Comprehenders do not wait until the whole sentence has been

    heard to make inferences about what it means or will wind up

    meaning:

    (Altmann and Kamide, 1999)

    Inference on the basis of incomplete input

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    30/54

    Inference on the basis of incomplete input

    Comprehenders do not wait until the whole sentence has been

    heard to make inferences about what it means or will wind up

    meaning:

    (Altmann and Kamide, 1999)

    Inference on the basis of incomplete input

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    31/54

    Inference on the basis of incomplete input

    Comprehenders do not wait until the whole sentence has been

    heard to make inferences about what it means or will wind up

    meaning:

    The boy will eat/movethe cake. . .

    (Altmann and Kamide, 1999)

    Inference on the basis of incomplete input

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    32/54

    p p

    Comprehenders do not wait until the whole sentence has been

    heard to make inferences about what it means or will wind up

    meaning:

    The boy will eat/movethe cake. . .

    (Altmann and Kamide, 1999)

    Inference on the basis of incomplete input

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    33/54

    p p

    Comprehenders do not wait until the whole sentence has been

    heard to make inferences about what it means or will wind up

    meaning:

    The boy will eat/movethe cake. . .

    That is, comprehension is incremental

    (Altmann and Kamide, 1999)

    Processing difficulty is differential

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    34/54

    g y

    Using multiple relative clauses in a sentence can make

    processing difficult:

    This is the malt that the rat that the cat that the dog

    worried killed ate.

    Its not the meaning of the sentence, or the use of relative

    clauses, that makes it hard:

    This is the malt that was eaten by the rat that was

    killed by the cat that was worried by the dog.

    Processing difficulty is differential

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    35/54

    g y

    Using multiple relative clauses in a sentence can make

    processing difficult:

    This is the malt that the rat that the cat that the dog

    worried killed ate.

    Its not the meaning of the sentence, or the use of relative

    clauses, that makes it hard:

    This is the malt that was eaten by the rat that was

    killed by the cat that was worried by the dog.

    Processing difficulty is differential

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    36/54

    Using multiple relative clauses in a sentence can make

    processing difficult:

    This is the malt that the rat that the cat that the dog

    worried killed ate.

    Its not the meaning of the sentence, or the use of relative

    clauses, that makes it hard:

    This is the malt that was eaten by the rat that was

    killed by the cat that was worried by the dog.

    Processing difficulty is differential

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    37/54

    Did you believe that this sentence was English?

    This is the malt that the rat that the cat that the dogworried killed ate.

    Consider this simple example:

    This is the cat that the dog worried.

    And this one:

    This is the rat that the cat killed.

    Which cat did the killing? Suppose it was the cat that the

    dog worried.

    This is the rat thatthe cat that the dog worried

    killed.

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    38/54

    Processing difficulty is differential

  • 8/8/2019 Lign170 Lecture 1

    39/54

    Did you believe that this sentence was English?

    This is the malt that the rat that the cat that the dogworried killed ate.

    Consider this simple example:

    This is the cat that the dog worried.

    And this one:

    This is the rat that the cat killed.

    Which cat did the killing? Suppose it was the cat that the

    dog worried.This is the rat thatthe cat that the dog worried

    killed.

    Processing difficulty is differential

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    40/54

    Did you believe that this sentence was English?

    This is the malt that the rat that the cat that the dogworried killed ate.

    Consider this simple example:

    This is the cat that the dog worried.

    And this one:

    This is the rat that the cat killed.

    Which cat did the killing? Suppose it was the cat that the

    dog worried.This is the rat thatthe cat that the dog worried

    killed.

    Processing difficulty is differential

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    41/54

    Did you believe that this sentence was English?

    This is the malt that the rat that the cat that the dogworried killed ate.

    Consider this simple example:

    This is the cat that the dog worried.

    And this one:

    This is the rat that the cat killed.

    Which cat did the killing? Suppose it was the cat that the

    dog worried.This is the rat thatthe cat that the dog worried

    killed.

    Processing difficulty is differential

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    42/54

    Did you believe that this sentence was English?

    This is the malt that the rat that the cat that the dogworried killed ate.

    Consider this simple example:

    This is the cat that the dog worried.

    And this one:

    This is the rat that the cat killed.

    Which cat did the killing? Suppose it was the cat that the

    dog worried.This is the rat thatthe cat that the dog worried

    killed.

    Processing difficulty is differential

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    43/54

    Did you believe that this sentence was English?

    This is the malt that the rat that the cat that the dogworried killed ate.

    Consider this simple example:

    This is the cat that the dog worried.

    And this one:

    This is the rat that the cat killed.

    Which cat did the killing? Suppose it was the cat that the

    dog worried.This is the rat thatthe cat that the dog worried

    killed.

    Processing difficulty is differential

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    44/54

    Did you believe that this sentence was English?

    This is the malt that the rat that the cat that the dogworried killed ate.

    Consider this simple example:

    This is the cat that the dog worried.

    And this one:

    This is the rat that the cat killed.

    Which cat did the killing? Suppose it was the cat that the

    dog worried.This is the rat thatthe cat that the dog worried

    killed.

    Processing difficulty is localized

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    45/54

    [self-paced reading demo, Example1]

    (Grodner and Gibson, 2005)

    Processing difficulty is localized

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    46/54

    [self-paced reading demo, Example1]

    (Grodner and Gibson, 2005)

    Try to guess the next word in the sentence

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    47/54

    Empirically, its been shown that more highly predictablewords are read more quickly (Ehrlich and Rayner, 1981)

    Why would this be the case?

    Try to guess the next word in the sentence

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    48/54

    My brother came inside to. . .

    Empirically, its been shown that more highly predictablewords are read more quickly (Ehrlich and Rayner, 1981)

    Why would this be the case?

    Try to guess the next word in the sentence

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    49/54

    My brother came inside to. . . chat? get warm? talk? eat? rest?

    Empirically, its been shown that more highly predictablewords are read more quickly (Ehrlich and Rayner, 1981)

    Why would this be the case?

    Try to guess the next word in the sentence

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    50/54

    My brother came inside to. . . chat? get warm? talk? eat? rest?

    The children went outside to. . .

    Empirically, its been shown that more highly predictablewords are read more quickly (Ehrlich and Rayner, 1981)

    Why would this be the case?

    Try to guess the next word in the sentence

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    51/54

    My brother came inside to. . . chat? get warm? talk? eat? rest?

    The children went outside to. . . play

    Empirically, its been shown that more highly predictablewords are read more quickly (Ehrlich and Rayner, 1981)

    Why would this be the case?

    Try to guess the next word in the sentence

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    52/54

    My brother came inside to. . . chat? get warm? talk? eat? rest?

    The children went outside to. . . play

    Empirically, its been shown that more highly predictablewords are read more quickly (Ehrlich and Rayner, 1981)

    Why would this be the case?

    Try to guess the next word in the sentence

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    53/54

    My brother came inside to. . . chat? get warm? talk? eat? rest?

    The children went outside to. . . play

    Empirically, its been shown that more highly predictablewords are read more quickly (Ehrlich and Rayner, 1981)

    Why would this be the case?

    References I

    http://goforward/http://find/http://goback/
  • 8/8/2019 Lign170 Lecture 1

    54/54

    Altmann, G. T. and Kamide, Y. (1999). Incremental interpretation at

    verbs: restricting the domain of subsequent reference. Cognition,73(3):247264.

    Ehrlich, S. F. and Rayner, K. (1981). Contextual effects on wordperception and eye movements during reading. Journal of VerbalLearning and Verbal Behavior, 20:641655.

    Grodner, D. and Gibson, E. (2005). Some consequences of the serialnature of linguistic input. Cognitive Science, 29(2):261290.

    Kaiser, E. and Trueswell, J. C. (2004). The role of discourse contextin the processing of a flexible word-order language. Cognition,94:113147.

    Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K., and Sedivy,J. C. (1995). Integration of visual and linguistic information inspoken language comprehension. Science, 268:16321634.

    http://goforward/http://find/http://goback/