Pragmatics I: Reference resolution
description
Transcript of Pragmatics I: Reference resolution
![Page 1: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/1.jpg)
Pragmatics I: Reference resolution
Ling 571
Fei Xia
Week 7: 11/8/05
![Page 2: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/2.jpg)
Outline
• Discourse: a related group of sentences– Ex: articles, dialogue, ….
• Pragmatics: the study of the relation between language and context-of-use– Reference resolution– Discourse structure
![Page 3: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/3.jpg)
Reference resolution
![Page 4: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/4.jpg)
Reference resolution
• Some terms: referents, referring expression• Discourse model• Types of referring expression• Types of referents• Constraints and preference for reference
resolution• Some algorithms for reference resolution
![Page 5: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/5.jpg)
Some terms
• Ex: John bought a book yesterday. He thought it was cheap.
• Referring expression: the expression used to refer to an entity:– Ex: John, a book, he, it
• Referent: an entity that is referred to.
![Page 6: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/6.jpg)
Some Terms (cont)
• Co-reference: two or more referring expressions refer to the same entity: e.g., “John” and “he”.
– Antecedents: a referring expression that licenses the use of others. Ex. John
– Anaphora: reference to an entity that has been previous introduced. Ex: he
![Page 7: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/7.jpg)
Discourse Model
• A discourse model stores the representations of entities that have been referred to in the discourse and the relationships in which they participate.
• Two operations:– Evoke: first mention– Access: subsequence mention
![Page 8: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/8.jpg)
John He
Refer (evoke) Refer (access)
Corefer
![Page 9: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/9.jpg)
Five types of referring expressions
• Indefinite NPs: a car
• Definite NPs: the car
• Pronouns: it
• Demonstratives: this, that
• One-anaphora: one
![Page 10: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/10.jpg)
Indefinite NPs
• Introduce entities that are new to the hearer
• The entity may or may not be identifiable to the speaker:– I saw an Acura today. (Specific reading)– I am going to the dealership to buy an Acura today.
(specific or non-specific)• I hope that they still have it. (Specific)• I hope that they have a car I like. (non-specific)
![Page 11: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/11.jpg)
Definite NPs
• Identifiable to the hearer– I saw an Acura today. The Acura … (explicitly mentioned before in the context)
– The Eagles …. (the hearer’s knowledge about the world)
– The largest company in Seattle announced … (inherently unique)
![Page 12: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/12.jpg)
Pronouns
• Pronouns refer to something that is identifiable to the hearer.
• The referent must have a high degree of salience in the discourse model.
• Pronouns can participate in cataphora, in which they appear before their referents.– Ex: Before he bought it, John checked over the
Acura very carefully.
![Page 13: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/13.jpg)
Demonstratives
• Demonstratives refer to something that is identifiable to the hearer.
• They are used alone or as a determiner:– Ex: I want this. I want this car.
• “this” indicating closeness, “that” signaling distance: spatial/temporal distance.
![Page 14: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/14.jpg)
One-anaphora
• “One” “One of them”• It selects a member from a set that is identifiable
to the hearer. • Ex:
– He had a BMW before, now he got another one.– Is he the one?– You like this one, or that one?– John has two BMWs, but I have only one.– One should not pay more than 20K for a Camry.
![Page 15: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/15.jpg)
Five types of referring expressions
• Indefinite NPs: a car• Definite NPs: the car• Pronouns: it• Demonstratives: this, that• One-anaphora: one
Next question: what do a referring expression refers to?
![Page 16: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/16.jpg)
Types of referents
• Ex: According to John, Bob bought Sue a BMW, and Sue bought Bob a Honda.– But that turned out to be a lie. (speech act)– But that was false. (proposition)– That caused Bob to become rather poor.
(event)– That caused them both to become rather
poor. (combination of events)
![Page 17: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/17.jpg)
Inferrables
• Explicitly evoked in the text: John bought a car.
• Inferrables: inferrentially related to an evoked entity.– Whole-part: I almost bought a BMW today,
but a door had a dent and the engine seemed noisy.
– The results of action: Mix the flour and water, kneed the dough until smooth.
– …
![Page 18: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/18.jpg)
Discontinuous sets
• Plural references may refer to entities that have been evoked separately.
• Ex:– John has an Acura, and Mary has a Mazda.
They drive them all the time. (pairwise reading)
![Page 19: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/19.jpg)
Generics
• Generic references: individual generic
• Ex: I saw six BMWs today. They are the coolest cars.
![Page 20: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/20.jpg)
John He
Refer (evoke) Refer (access)
Corefer
![Page 21: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/21.jpg)
Constraints and preferences for reference resolution
• Constraints (filters):– Agreement: number, person, gender– Syntax: reflexives– Semantics: selectional restrictions
• Preferences:– Salience– Parallelism– Verb semantics
![Page 22: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/22.jpg)
Agreement
• Number: – (1) John bought a BMW. – (2a) It is great.– (2b) They are great.– (2c) ??They are red.
• Person:– (1) John and I have BMWs.– (2a) We love them. – (2b) They love them.
![Page 23: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/23.jpg)
Agreement (cont)
• Gender: she, he, it.– (1) John looked at the new ship.– (2) She was beautiful.
– (1’) Mary looked at the new ship.– (2) She was beautiful.
![Page 24: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/24.jpg)
Syntactic constraints
• Reflexives and personal pronouns.– John bought himself a car.– John bought him a car.
– John wrapped a blanket around himself.– John wrapped a blanket around him.
![Page 25: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/25.jpg)
Semantic constraints
• Selectional restrictions– (1) John parked his car in the garage.– (2a) He had driven it around for hours.– (2b) It is very messy, with old bike and car
parts lying around everywhere.
– (1) John parked his Acura in downtown Beverly Hills.
– (2) It is very messy, with old bikes and car parts lying around everywhere.
![Page 26: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/26.jpg)
Preferences in pronoun interpretation
• Saliency:– Recency– Grammatical role– Repeated Mention
• Parallelism
• Verb semantics
![Page 27: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/27.jpg)
Saliency
• Recency: – John has an Integra. …Bill has a BMW. Mary likes to
drive it.
• Grammatical role:– John went the dealership with Bill. He bought a car.
• Repeated mention:– John needed a car. He decided to get a BMW. Bill
went to the dealership with him. He bought one.
![Page 28: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/28.jpg)
Parallelism
• Mary went with Sue to the Acura dealership. Sally went with her to the Mazda dealership.
![Page 29: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/29.jpg)
Verb semantics
• John telephoned Bill. He lost the pamphlet on BMWs.
• John seized the pamphlet to Bill. He loves reading about cars.
• The car dealer admired John. He knows Acuras inside and out.
Thematic roles or world knowledge?
criticized
impressed
passed
![Page 30: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/30.jpg)
Constraints and preferences for reference resolution
• Hard-and-fast constraints (filters):– Agreement: number, person, case, gender– Syntax: reflexives– Semantics: selectional restrictions
• Preferences:– Saliency: recency, thematic roles, repeated
mention– Parallelism– Verb semantics: thematic roles or world knowledge
![Page 31: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/31.jpg)
Algorithms for pronoun resolution
• Heuristics approaches:– Lappin & Leass (1994)– Hobbs (1978)– Centering Theory (Grosz, Joshi, Weinstein
1995, and various)
• Machine learning approaches
![Page 32: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/32.jpg)
Lappin & Leass 1994
• A heuristic approach.
• Use agreement and syntactic constraints.
• Represent preferences (saliency, parallelism) with weights.
• Not using: selectional restrictions, verb semantics, world knowledge.
![Page 33: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/33.jpg)
Salience factors and weights
• Sentence recency: 100
• Subject: 80• Existential position: 70
– There is a car ….• Direct object: 50• Indirect object: 40
• Non-adv: 50– Inside his car, John …..
• Head noun of max NP: 80– The manual for the car is …
![Page 34: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/34.jpg)
The algorithm
• Start with an empty set of referents.
• Process each sentence– For each referring expression
• Calculate the salience value of the expression.• If it could be merged with existing referents
then choose the referent with the highest saliency value
else add it as a new referent.
• Update the value of the corresponding referent.
– Cut the values of all the referents by half.
![Page 35: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/35.jpg)
An example• John saw a beautiful Acura at the dealership.
Rec Subj Obj Non-adv
Head noun
Total
John 100 80 50 80 310
Acura 100 50 50 80 280
dealership
100 50 80 230
![Page 36: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/36.jpg)
Before moving on to the 2nd sentence
Referent Referring expressions
Value
John {John} 155
Acura {Acura} 140
dealership {dealership} 115
![Page 37: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/37.jpg)
Handling “He”
• He showed it to Bob.• The value of “He” is 310
Referent Referring expressions
Value
John {John} 155
Acura {Acura} 140
dealership {dealership} 115
![Page 38: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/38.jpg)
After adding “he”
• He showed it to Bob.
Referent Referring expressions
Value
John {John, he} 465
Acura {Acura} 140
dealership {dealership} 115
![Page 39: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/39.jpg)
Handling “it”
• He showed it to Bob.• The salience value of “it” is 280.• Two new factors:
– Role parallelism: 35– Cataphora (??): -175
Referent Expressions Value
John {John, he} 465
Acura {Acura} 140
dealership {dealership} 115
![Page 40: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/40.jpg)
After adding “it”
• He showed it to Bob.• The salience value of “it” is 280.• Two new factors:
– Role parallelism: 35– Cataphora (??): -175
Referent Expressions Value
John {John, he} 465
Acura {Acura, it} 140+280+35=455
dealership {dealership} 115
![Page 41: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/41.jpg)
Handling “Bob”
• He showed it to Bob.• The salience value of “Bob” is 270.
Referent Expressions Value
John {John, he} 465
Acura {Acura, it} 455
dealership {dealership} 115
![Page 42: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/42.jpg)
After adding “Bob”
• He showed it to Bob.• The salience value of “Bob” is 270.
Referent Expressions value
John {John, he} 465
Acura {Acura, it} 455
Bob {Bob} 270
dealership {dealership} 115
![Page 43: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/43.jpg)
Moving on to the 3rd sentence
• He bought it.
Referent Expressions value
John {John, he} 232.5
Acura {Acura, it} 227.5
Bob {Bob} 135
dealership {dealership} 57.5
He (John) bought it (Acura).
![Page 44: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/44.jpg)
Core of the algorithm
• For each referring expression– Calculate the saliency value, x.– Collect all the referents that comply with
agreement and syntactic constraints.– If the set is not empty, choose the one with
the highest salience value, and increase the reference value by x.
– If the set is empty, add a new referent to the discourse model, and set its value to x.
![Page 45: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/45.jpg)
Algorithms for reference resolution
• Heuristics approaches:– Lappin & Leass (1994)– Hobbs (1978)– Centering Theory (Grosz, Joshi, Weinstein
1995, and various)
• Machine learning approaches
![Page 46: Pragmatics I: Reference resolution](https://reader036.fdocuments.in/reader036/viewer/2022062315/56815166550346895dbf9357/html5/thumbnails/46.jpg)
Summary of reference resolution
• Some terms: referents, referring expression• Discourse model• Types of referring expression• Types of referents• Constraints and preference for reference
resolution• Some algorithms for reference resolution