NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... ·...
Transcript of NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... ·...
![Page 1: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/1.jpg)
NaturalLI: Natural Logic Inference for CommonSense Reasoning
Gabor Angeli, Chris Manning
Stanford University
October 26, 2014
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 0 / 22
![Page 2: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/2.jpg)
Natural Logic Inference for Common Sense Reasoning
Kittens play with yarn Kittens play with computers
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 1 / 22
![Page 3: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/3.jpg)
Natural Logic Inference for Common Sense Reasoning
Kittens play with yarn Kittens play with computers
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 1 / 22
![Page 4: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/4.jpg)
Common Sense Reasoning for NLP
The city refused the demonstrators a permit because they fearedviolence.
a city fears violencedemonstrators fear violence
I ate the cake with a cherry vs. I ate the cake with a forkcakes come with cherriescakes are eaten using cherries
Put a sarcastic comment in your talk. That’s a great idea.Sarcasm in your talk is a great idea
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 2 / 22
![Page 5: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/5.jpg)
Common Sense Reasoning for NLP
The city refused the demonstrators a permit because they fearedviolence.
a city fears violencedemonstrators fear violence
I ate the cake with a cherry vs. I ate the cake with a forkcakes come with cherriescakes are eaten using cherries
Put a sarcastic comment in your talk. That’s a great idea.Sarcasm in your talk is a great idea
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 2 / 22
![Page 6: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/6.jpg)
Common Sense Reasoning for NLP
The city refused the demonstrators a permit because they fearedviolence.
a city fears violencedemonstrators fear violence
I ate the cake with a cherry vs. I ate the cake with a forkcakes come with cherriescakes are eaten using cherries
Put a sarcastic comment in your talk. That’s a great idea.Sarcasm in your talk is a great idea
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 2 / 22
![Page 7: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/7.jpg)
Common Sense Reasoning for NLP
The city refused the demonstrators a permit because they fearedviolence.
a city fears violencedemonstrators fear violence
I ate the cake with a cherry vs. I ate the cake with a forkcakes come with cherriescakes are eaten using cherries
Put a sarcastic comment in your talk. That’s a great idea.Sarcasm in your talk is a great idea
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 2 / 22
![Page 8: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/8.jpg)
Common Sense Reasoning for VisionDogs drive cars People drive cars
Baseball is played underwater Baseball is played on grass
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 3 / 22
![Page 9: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/9.jpg)
Common Sense Reasoning for VisionDogs drive cars People drive cars
Baseball is played underwater Baseball is played on grass
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 3 / 22
![Page 10: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/10.jpg)
Prior Work on Common Sense Reasoning
Old School AI: Nuanced reasoning; tiny coverage.Default reasoning (Reiter 1980; McCarthy 1980).Theorem proving (e.g., Datalog).
Textual Entailment: Rich inference; small data.RTE Challenges.Episodic Logic (Schubert, 2002).
Information Extraction: Shallow inference, large data.OpenIE (Yates et al., 2007), NELL (Carlson et al., 2010).Extraction of facts from a large corpus; fuzzy lookup.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 4 / 22
![Page 11: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/11.jpg)
Prior Work on Common Sense Reasoning
Old School AI: Nuanced reasoning; tiny coverage.Default reasoning (Reiter 1980; McCarthy 1980).Theorem proving (e.g., Datalog).
Textual Entailment: Rich inference; small data.RTE Challenges.Episodic Logic (Schubert, 2002).
Information Extraction: Shallow inference, large data.OpenIE (Yates et al., 2007), NELL (Carlson et al., 2010).Extraction of facts from a large corpus; fuzzy lookup.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 4 / 22
![Page 12: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/12.jpg)
Prior Work on Common Sense Reasoning
Old School AI: Nuanced reasoning; tiny coverage.Default reasoning (Reiter 1980; McCarthy 1980).Theorem proving (e.g., Datalog).
Textual Entailment: Rich inference; small data.RTE Challenges.Episodic Logic (Schubert, 2002).
Information Extraction: Shallow inference, large data.OpenIE (Yates et al., 2007), NELL (Carlson et al., 2010).Extraction of facts from a large corpus; fuzzy lookup.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 4 / 22
![Page 13: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/13.jpg)
Start with a large knowledge base
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 5 / 22
![Page 14: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/14.jpg)
Start with a large knowledge base
The cat atea mouse
All catshave tails
All kittensare cute
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 5 / 22
![Page 15: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/15.jpg)
Infer new facts...
The cat atea mouse
. . .
. . .
All catshave tails
All kittensare cute
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 5 / 22
![Page 16: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/16.jpg)
Infer new facts...
The cat atea mouse
. . .
. . .
No carnivoreseat animals
All catshave tails
All kittensare cute
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 5 / 22
↑ Don’t want to run inferenceover every fact!
← Don’t want to store all of these!
![Page 17: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/17.jpg)
Infer new facts...
The cat atea mouse
. . .
. . .
No carnivoreseat animals
All catshave tails
All kittensare cute
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 5 / 22
↑ Don’t want to run inferenceover every fact!
← Don’t want to store all of these!
![Page 18: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/18.jpg)
Infer new facts...
The cat atea mouse
. . .
. . .
No carnivoreseat animals
All catshave tails
All kittensare cute
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 5 / 22
↑ Don’t want to run inferenceover every fact!
← Don’t want to store all of these!
![Page 19: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/19.jpg)
Infer new facts...on demand from a query...
No carnivoreseat animals?
. . .
. . .
The catate a mouse
All catshave tails
All kittensare cute
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 5 / 22
![Page 20: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/20.jpg)
...Using text as the meaning representation...
No carnivoreseat animals?
The carnivoreseat animals
The cateats animals
The catate an animal
The catate a mouse
All catshave tails
All kittensare cute
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 5 / 22
![Page 21: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/21.jpg)
...Without aligning to any particular premise.
No carnivoreseat animals?
The carnivoreseat animals
The cateats animals
The catate an animal
The catate a mouse
. . .
. . . . . .
. . .
All catshave tails
All kittensare cute
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 5 / 22
![Page 22: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/22.jpg)
A Better Knowledge Base Lookup
Lookup in 270 million entry KB...
...by lemmas 12% recall
...with NaturalLI 49% recall (91% precision)
Formal logical entailment: Not just fuzzy lookup.
Maintain good properties of fuzzy lookup.Fast.Minimal pre-processing of query.Minimal pre-processing of knowledge base.
Natural Logic
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 6 / 22
![Page 23: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/23.jpg)
A Better Knowledge Base Lookup
Lookup in 270 million entry KB...
...by lemmas 12% recall
...with NaturalLI 49% recall (91% precision)
Formal logical entailment: Not just fuzzy lookup.
Maintain good properties of fuzzy lookup.Fast.Minimal pre-processing of query.Minimal pre-processing of knowledge base.
Natural Logic
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 6 / 22
![Page 24: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/24.jpg)
A Better Knowledge Base Lookup
Lookup in 270 million entry KB...
...by lemmas 12% recall
...with NaturalLI 49% recall (91% precision)
Formal logical entailment: Not just fuzzy lookup.
Maintain good properties of fuzzy lookup.Fast.Minimal pre-processing of query.Minimal pre-processing of knowledge base.
Natural Logic
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 6 / 22
![Page 25: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/25.jpg)
A Better Knowledge Base Lookup
Lookup in 270 million entry KB...
...by lemmas 12% recall
...with NaturalLI 49% recall (91% precision)
Formal logical entailment: Not just fuzzy lookup.
Maintain good properties of fuzzy lookup.Fast.Minimal pre-processing of query.Minimal pre-processing of knowledge base.
Natural Logic
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 6 / 22
![Page 26: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/26.jpg)
Natural Logic as Syllogisms
s/Natural Logic/Syllogistic Reasoning/g
Some cat ate a mouse(all mice are rodents)
∴ Some cat ate a rodent
Cognitively easy inferences are easy:
Most cats eat mice∴ Most cats eat rodents
“All students who know a foreign language learned it at university.”∴ “They learned it at school.”
Facts are text; inference is lexical mutation
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 7 / 22
![Page 27: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/27.jpg)
Natural Logic as Syllogisms
s/Natural Logic/Syllogistic Reasoning/g
Some cat ate a mouse(all mice are rodents)
∴ Some cat ate a rodent
Cognitively easy inferences are easy:
Most cats eat mice∴ Most cats eat rodents
“All students who know a foreign language learned it at university.”∴ “They learned it at school.”
Facts are text; inference is lexical mutation
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 7 / 22
![Page 28: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/28.jpg)
Natural Logic as Syllogisms
s/Natural Logic/Syllogistic Reasoning/g
Some cat ate a mouse(all mice are rodents)
∴ Some cat ate a rodent
Cognitively easy inferences are easy:
Most cats eat mice∴ Most cats eat rodents
“All students who know a foreign language learned it at university.”
∴ “They learned it at school.”
Facts are text; inference is lexical mutation
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 7 / 22
![Page 29: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/29.jpg)
Natural Logic as Syllogisms
s/Natural Logic/Syllogistic Reasoning/g
Some cat ate a mouse(all mice are rodents)
∴ Some cat ate a rodent
Cognitively easy inferences are easy:
Most cats eat mice∴ Most cats eat rodents
“All students who know a foreign language learned it at university.”∴ “They learned it at school.”
Facts are text; inference is lexical mutation
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 7 / 22
![Page 30: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/30.jpg)
Natural Logic as Syllogisms
s/Natural Logic/Syllogistic Reasoning/g
Some cat ate a mouse(all mice are rodents)
∴ Some cat ate a rodent
Cognitively easy inferences are easy:
Most cats eat mice∴ Most cats eat rodents
“All students who know a foreign language learned it at university.”∴ “They learned it at school.”
Facts are text; inference is lexical mutation
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 7 / 22
![Page 31: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/31.jpg)
Natural Logic and Polarity
Treat hypernymy as a partial order.>
animal
feline
cat
dog
⊥
Polarity is the direction a lexical item can move in the ordering.
animal
feline
cat
house cat
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 8 / 22
![Page 32: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/32.jpg)
Natural Logic and Polarity
Treat hypernymy as a partial order.>
animal
feline
cat
dog
⊥
Polarity is the direction a lexical item can move in the ordering.
animal
feline
cat
house cat
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 8 / 22
![Page 33: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/33.jpg)
Natural Logic and Polarity
Treat hypernymy as a partial order.>
animal
feline
cat
dog
⊥
Polarity is the direction a lexical item can move in the ordering.
animal
feline
↑ cat
house cat
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 8 / 22
![Page 34: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/34.jpg)
Natural Logic and Polarity
Treat hypernymy as a partial order.>
animal
feline
cat
dog
⊥
Polarity is the direction a lexical item can move in the ordering.
living thing
animal
↑ feline
cat
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 8 / 22
![Page 35: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/35.jpg)
Natural Logic and Polarity
Treat hypernymy as a partial order.>
animal
feline
cat
dog
⊥
Polarity is the direction a lexical item can move in the ordering.
thing
living thing
↑ animal
feline
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 8 / 22
![Page 36: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/36.jpg)
Natural Logic and Polarity
Treat hypernymy as a partial order.>
animal
feline
cat
dog
⊥
Polarity is the direction a lexical item can move in the ordering.
thing
living thing
↓ animal
feline
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 8 / 22
![Page 37: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/37.jpg)
Natural Logic and Polarity
Treat hypernymy as a partial order.>
animal
feline
cat
dog
⊥
Polarity is the direction a lexical item can move in the ordering.
living thing
animal
↓ feline
cat
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 8 / 22
![Page 38: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/38.jpg)
Natural Logic and Polarity
Treat hypernymy as a partial order.>
animal
feline
cat
dog
⊥
Polarity is the direction a lexical item can move in the ordering.
animal
feline
↓ cat
house cat
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 8 / 22
![Page 39: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/39.jpg)
An Example Inference
Quantifiers determines the polarity (↑ or ↓) of words.
Polarity
Inference is reversible.
↑ All↓↑
carnivores
felines
↓ cats
house cats
consume
↑ eat
slurp
placentals
rodents
↑ mice
fieldmice
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 9 / 22
![Page 40: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/40.jpg)
An Example Inference
Quantifiers determines the polarity (↑ or ↓) of words.
Mutations must respect polarity.
Inference is reversible.
↑ All↓↑
felines
cats
↓ house cats
kitties
consume
↑ eat
slurp
placentals
rodents
↑ mice
fieldmice
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 9 / 22
![Page 41: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/41.jpg)
An Example Inference
Quantifiers determines the polarity (↑ or ↓) of words.
Mutations must respect polarity.
Inference is reversible.
↑ All↓↑
felines
cats
↓ house cats
kitties
↑ consume
eat
placentals
rodents
↑ mice
fieldmice
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 9 / 22
![Page 42: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/42.jpg)
An Example Inference
Quantifiers determines the polarity (↑ or ↓) of words.
Mutations must respect polarity.
Inference is reversible.
↑ All↓↑
felines
cats
↓ house cats
kitties
↑ consume
eat
rodents
mice
↑ fieldmice
pine vole
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 9 / 22
![Page 43: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/43.jpg)
An Example Inference
Quantifiers determines the polarity (↑ or ↓) of words.
Mutations must respect polarity.
Inference is reversible.
↑ All↓↑
felines
cats
↓ house cats
kitties
↑ consume
eat
placentals
rodents
↑ mice
fieldmice
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 9 / 22
![Page 44: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/44.jpg)
An Example Inference
Quantifiers determines the polarity (↑ or ↓) of words.
Mutations must respect polarity.
Inference is reversible.
↑ All↓↑
felines
cats
↓ house cats
kitties
↑ consume
eat
mammals
placentals
↑ rodents
mice
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 9 / 22
![Page 45: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/45.jpg)
An Example Inference
Quantifiers determines the polarity (↑ or ↓) of words.
Mutations must respect polarity.
Inference is reversible.
↑ All↓↑
felines
cats
↓ house cats
kitties
↑ consume
eat
mammals
placentals
↑ rodents
mice
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 9 / 22
![Page 46: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/46.jpg)
Properties of Natural Logic
Computationally fast during inference.“Semantic” parse of query is just syntactic parse.Inference is lexical mutations / insertions / deletions.
Computationally fast during pre-processing.Plain text!
Still captures common inferences.We make these types of inferences regularly and instantly.We expect readers to make these inferences instantly.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 10 / 22
![Page 47: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/47.jpg)
Properties of Natural Logic
Computationally fast during inference.“Semantic” parse of query is just syntactic parse.Inference is lexical mutations / insertions / deletions.
Computationally fast during pre-processing.Plain text!
Still captures common inferences.We make these types of inferences regularly and instantly.We expect readers to make these inferences instantly.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 10 / 22
![Page 48: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/48.jpg)
Properties of Natural Logic
Computationally fast during inference.“Semantic” parse of query is just syntactic parse.Inference is lexical mutations / insertions / deletions.
Computationally fast during pre-processing.Plain text!
Still captures common inferences.We make these types of inferences regularly and instantly.
We expect readers to make these inferences instantly.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 10 / 22
![Page 49: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/49.jpg)
Properties of Natural Logic
Computationally fast during inference.“Semantic” parse of query is just syntactic parse.Inference is lexical mutations / insertions / deletions.
Computationally fast during pre-processing.Plain text!
Still captures common inferences.We make these types of inferences regularly and instantly.We expect readers to make these inferences instantly.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 10 / 22
![Page 50: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/50.jpg)
Natural Logic Inference is Search
The cat atea mouse
. . .
. . .
No carnivoreseat animals
All catshave tails
All kittensare cute
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 11 / 22
![Page 51: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/51.jpg)
Natural Logic Inference is Search
No carnivoreseat animals?
The carnivoreseat animals
The cateats animals
The catate an animal
The catate a mouse
All catshave tails
All kittensare cute
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 11 / 22
![Page 52: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/52.jpg)
Natural Logic Inference is Search
No carnivoreseat animals?
The carnivoreseat animals
The cateats animals
The catate an animal
The catate a mouse
. . .
. . . . . .
. . .
All catshave tails
All kittensare cute
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 11 / 22
![Page 53: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/53.jpg)
Natural Logic Inference is Search
Nodes ( fact, truth maintained ∈ {true, false})
Start Node ( query fact, true )End Nodes any known fact
Edges Mutations of the current factEdge Costs How “wrong” an inference step is (learned)
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 11 / 22
![Page 54: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/54.jpg)
Natural Logic Inference is Search
Nodes ( fact, truth maintained ∈ {true, false})
Start Node ( query fact, true )End Nodes any known fact
Edges Mutations of the current factEdge Costs How “wrong” an inference step is (learned)
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 11 / 22
![Page 55: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/55.jpg)
Natural Logic Inference is Search
Nodes ( fact, truth maintained ∈ {true, false})
Start Node ( query fact, true )End Nodes any known fact
Edges Mutations of the current fact
Edge Costs How “wrong” an inference step is (learned)
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 11 / 22
![Page 56: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/56.jpg)
Natural Logic Inference is Search
Nodes ( fact, truth maintained ∈ {true, false})
Start Node ( query fact, true )End Nodes any known fact
Edges Mutations of the current factEdge Costs How “wrong” an inference step is (learned)
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 11 / 22
![Page 57: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/57.jpg)
An Example Search (as reverse inference)
Search mutates opposite to polarity
organism
animal
↓ carnivores
felines
organism
animal
↓ carnivores
felines
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 12 / 22
![Page 58: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/58.jpg)
An Example Search (as reverse inference)
Truthmaintained: true
CurrentNode:
↑ No↓↓
organism
animal
↓ carnivores
felines
consume
↓ eat
slurp
living thing
organism
↓ animals
chordate
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 12 / 22
![Page 59: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/59.jpg)
An Example Search (as reverse inference)
Truthmaintained: false
CurrentNode:
↑ The↑↑
All↓↑
organism
animal
↑ carnivores
felines
consume
↑ eat
slurp
living thing
organism
↑ animals
chordate
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 12 / 22
![Page 60: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/60.jpg)
An Example Search (as reverse inference)
Truthmaintained: false
CurrentNode:
↑ The↑↑
All↓↑
animals
carnivores
↑ felines
cats
consume
↑ eat
slurp
living thing
organism
↑ animals
chordate
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 12 / 22
![Page 61: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/61.jpg)
An Example Search (as reverse inference)
Truthmaintained: false
CurrentNode:
↑ The↑↑
All↓↑
carnivores
felines
↑ cats
kitties
consume
↑ eat
slurp
living thing
organism
↑ animals
chordate
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 12 / 22
![Page 62: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/62.jpg)
An Example Search (as reverse inference)
Truthmaintained: false
CurrentNode:
↑ The↑↑
All↓↑
carnivores
felines
↑ cats
kitties
consume
↑ eat
slurp
organisms
animals
↑ chordates
mice
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 12 / 22
![Page 63: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/63.jpg)
An Example Search (as reverse inference)
Truthmaintained: false
CurrentNode:
↑ The↑↑
All↓↑
carnivores
felines
↑ cats
kitties
consume
↑ eat
slurp
animals
chordates
↑ mice
fieldmice
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 12 / 22
![Page 64: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/64.jpg)
An Example Search (as reverse inference)
Truthmaintained: false
CurrentNode: ↑ The↑↑
All↓↑
carnivore
feline
↑ cat
kitty
consumed
↑ ate
slurped
↑ a↑↑
All↓↑
animal
chordate
↑ mouse
fieldmouse
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 12 / 22
![Page 65: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/65.jpg)
An Example Search (as graph search)
Shorthand for a node:
↑ No↓↓
organism
animal
↑ carnivores
felines
consume
↓ eat
slurp
living thing
organism
↑ animals
chordate
No carnivoreseat animals?
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 13 / 22
![Page 66: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/66.jpg)
An Example Search (as graph search)
ROOT
No carnivoreseat animals?
The carnivoreseat animals
No catseat animals
. . .
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 13 / 22
![Page 67: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/67.jpg)
An Example Search (as graph search)
No carnivoreseat animals
The carnivoreseat animals?
The felineeats animals
All carnivoreseat animals
. . .
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 13 / 22
![Page 68: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/68.jpg)
An Example Search (as graph search)
The carnivoreseat animals
The felineeats animals?
The cateats animals
The cat eatschordate
. . .
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 13 / 22
![Page 69: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/69.jpg)
An Example Search (as graph search)
The felineeats animals
The cat eatsanimals?
The cat eatschordates
The kittyeats animals
. . .
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 13 / 22
![Page 70: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/70.jpg)
An Example Search (as graph search)
The cat eatsanimals
The cat eatschordates?
The cateats mice
The cateats dogs
. . .
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 13 / 22
![Page 71: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/71.jpg)
An Example Search (as graph search)
The cat eatschordates
The cateats mice?
The cat atea mouse
The kittyeats mice
. . .
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 13 / 22
![Page 72: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/72.jpg)
An Example Search (with edges)
ROOT
No carnivoreseat animals?
The carnivoreseat animals
No catseat animals
. . .
Template Instance Edge
Operator Negate NOOPNOOPNOOP
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 14 / 22
![Page 73: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/73.jpg)
An Example Search (with edges)
ROOT
No carnivoreseat animals?
The carnivoreseat animals
No catseat animals
. . .
Template Instance Edge
Operator Negate No → TheNOOPNOOP
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 14 / 22
![Page 74: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/74.jpg)
An Example Search (with edges)
ROOT
No carnivoreseat animals?
The carnivoreseat animals
No catseat animals
. . .
Template Instance Edge
Operator Negate No → TheNo carnivores eat animals →The carnivores eat animals
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 14 / 22
![Page 75: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/75.jpg)
Edge Templates
Template InstanceHypernym animal → catHyponym cat → animalAntonym good → badSynonym cat → true cat
Add Word cat → ·Delete Word · → cat
Operator Weaken some→ allOperator Strengthen all → someOperator Negate all → noOperator Synonym all → every
Nearest Neighbor cat → dog
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 15 / 22
![Page 76: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/76.jpg)
“Soft” Natural Logic
Want to make likely (but not certain) inferences.Same motivation as Markov Logic, Probabilistic Soft Logic, etc.
Each edge template has a cost θ ≥ 0.
Detail: Variation among edge instances of a template.WordNet: cat → feline vs. cup → container.Nearest neighbors distance.Each edge instance has a distance f .
Cost of an edge is θi · fi .Cost of a path is θ · f.Can learn parameters θ .
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 16 / 22
![Page 77: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/77.jpg)
“Soft” Natural Logic
Want to make likely (but not certain) inferences.Same motivation as Markov Logic, Probabilistic Soft Logic, etc.Each edge template has a cost θ ≥ 0.
Detail: Variation among edge instances of a template.WordNet: cat → feline vs. cup → container.Nearest neighbors distance.Each edge instance has a distance f .
Cost of an edge is θi · fi .Cost of a path is θ · f.Can learn parameters θ .
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 16 / 22
![Page 78: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/78.jpg)
“Soft” Natural Logic
Want to make likely (but not certain) inferences.Same motivation as Markov Logic, Probabilistic Soft Logic, etc.Each edge template has a cost θ ≥ 0.
Detail: Variation among edge instances of a template.WordNet: cat → feline vs. cup → container.Nearest neighbors distance.Each edge instance has a distance f .
Cost of an edge is θi · fi .Cost of a path is θ · f.Can learn parameters θ .
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 16 / 22
![Page 79: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/79.jpg)
“Soft” Natural Logic
Want to make likely (but not certain) inferences.Same motivation as Markov Logic, Probabilistic Soft Logic, etc.Each edge template has a cost θ ≥ 0.
Detail: Variation among edge instances of a template.WordNet: cat → feline vs. cup → container.Nearest neighbors distance.Each edge instance has a distance f .
Cost of an edge is θi · fi .
Cost of a path is θ · f.Can learn parameters θ .
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 16 / 22
![Page 80: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/80.jpg)
“Soft” Natural Logic
Want to make likely (but not certain) inferences.Same motivation as Markov Logic, Probabilistic Soft Logic, etc.Each edge template has a cost θ ≥ 0.
Detail: Variation among edge instances of a template.WordNet: cat → feline vs. cup → container.Nearest neighbors distance.Each edge instance has a distance f .
Cost of an edge is θi · fi .Cost of a path is θ · f.
Can learn parameters θ .
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 16 / 22
![Page 81: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/81.jpg)
“Soft” Natural Logic
Want to make likely (but not certain) inferences.Same motivation as Markov Logic, Probabilistic Soft Logic, etc.Each edge template has a cost θ ≥ 0.
Detail: Variation among edge instances of a template.WordNet: cat → feline vs. cup → container.Nearest neighbors distance.Each edge instance has a distance f .
Cost of an edge is θi · fi .Cost of a path is θ · f.Can learn parameters θ .
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 16 / 22
![Page 82: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/82.jpg)
Contribution: Simple Transitivity
Taken for granted: A⇒ B and B⇒ C then A⇒ C.
More complicated in (prior work on) Natural Logic:
nocturnal��−→ diurnal, all f−→ not all
∴ all bats are nocturnal ?−→ not all bats are diurnal
./ ≡ v w f �� ` #
≡ ≡ v w f �� ` #v v v # �� �� # #w w # w ` # ` #f f ` �� ≡ w v #�� �� # �� v # v #` ` ` # w w # ## # # # # # # #
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 17 / 22
![Page 83: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/83.jpg)
Contribution: Simple Transitivity
Taken for granted: A⇒ B and B⇒ C then A⇒ C.
More complicated in (prior work on) Natural Logic:
nocturnal��−→ diurnal, all f−→ not all
∴ all bats are nocturnal ?−→ not all bats are diurnal
./ ≡ v w f �� ` #
≡ ≡ v w f �� ` #v v v # �� �� # #w w # w ` # ` #f f ` �� ≡ w v #�� �� # �� v # v #` ` ` # w w # ## # # # # # # #
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 17 / 22
![Page 84: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/84.jpg)
Contribution: Simple Transitivity
Taken for granted: A⇒ B and B⇒ C then A⇒ C.
More complicated in (prior work on) Natural Logic:
nocturnal��−→ diurnal, all f−→ not all
∴ all bats are nocturnal ?−→ not all bats are diurnal
./ ≡ v w f �� ` #
≡ ≡ v w f �� ` #v v v # �� �� # #w w # w ` # ` #f f ` �� ≡ w v #�� �� # �� v # v #` ` ` # w w # ## # # # # # # #
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 17 / 22
![Page 85: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/85.jpg)
Contribution: Simple Transitivity
Taken for granted: A⇒ B and B⇒ C then A⇒ C.
More complicated in (prior work on) Natural Logic:
nocturnal��−→ diurnal, all f−→ not all
∴ all bats are nocturnal ?−→ not all bats are diurnal
./ ≡ v w f �� ` #
≡ ≡ v w f �� ` #v v v # �� �� # #w w # w ` # ` #f f ` �� ≡ w v #�� �� # �� v # v #` ` ` # w w # ## # # # # # # #
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 17 / 22
![Page 86: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/86.jpg)
Contribution: Simple Transitivity
Taken for granted: A⇒ B and B⇒ C then A⇒ C.
More complicated in (prior work on) Natural Logic:
nocturnal��−→ diurnal, all f−→ not all
∴ all bats are nocturnal ?−→ not all bats are diurnal
./ ≡ v w f �� ` #
≡ ≡ v w f �� ` #v v v # �� �� # #w w # w ` # ` #f f ` �� ≡ w v #�� �� # �� v # v #` ` ` # w w # ## # # # # # # #
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 17 / 22
7
![Page 87: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/87.jpg)
Contribution: Simple Transitivity
Natural Logic Analog of Transitivity:
State Fact Mutation
⇒ all bats are nocturnal,
(nocturnal��−→ diurnal)
⇒¬ all bats are diurnal, (all f−→ not all)⇒ not all bats are diurnal
Complex join table can be reduced to tracking a simple binarydistinction.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 17 / 22
![Page 88: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/88.jpg)
Contribution: Simple Transitivity
Natural Logic Analog of Transitivity:
State Fact Mutation
⇒ all bats are nocturnal, (nocturnal��−→ diurnal)
⇒¬ all bats are diurnal, (all f−→ not all)⇒ not all bats are diurnal
Complex join table can be reduced to tracking a simple binarydistinction.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 17 / 22
![Page 89: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/89.jpg)
Contribution: Simple Transitivity
Natural Logic Analog of Transitivity:
State Fact Mutation
⇒ all bats are nocturnal, (nocturnal��−→ diurnal)
⇒¬ all bats are diurnal,
(all f−→ not all)⇒ not all bats are diurnal
Complex join table can be reduced to tracking a simple binarydistinction.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 17 / 22
![Page 90: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/90.jpg)
Contribution: Simple Transitivity
Natural Logic Analog of Transitivity:
State Fact Mutation
⇒ all bats are nocturnal, (nocturnal��−→ diurnal)
⇒¬ all bats are diurnal, (all f−→ not all)
⇒ not all bats are diurnal
Complex join table can be reduced to tracking a simple binarydistinction.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 17 / 22
![Page 91: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/91.jpg)
Contribution: Simple Transitivity
Natural Logic Analog of Transitivity:
State Fact Mutation
⇒ all bats are nocturnal, (nocturnal��−→ diurnal)
⇒¬ all bats are diurnal, (all f−→ not all)⇒ not all bats are diurnal
Complex join table can be reduced to tracking a simple binarydistinction.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 17 / 22
![Page 92: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/92.jpg)
Contribution: Simple Transitivity
Natural Logic Analog of Transitivity:
State Fact Mutation
⇒ all bats are nocturnal, (nocturnal��−→ diurnal)
⇒¬ all bats are diurnal, (all f−→ not all)⇒ not all bats are diurnal
Complex join table can be reduced to tracking a simple binarydistinction.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 17 / 22
![Page 93: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/93.jpg)
Experiments
FraCaS Textual Entailment Suite:Used in MacCartney and Manning (2007; 2008).RTE-style problems: is the hypothesis entailed from the premise?P: At least three commissioners spend a lot of time at home.H: At least three commissioners spend time at home.P: At most ten commissioners spend a lot of time at home.H: At most ten commissioners spend time at home.
9 focused sections; 3 in scope for this work.
Not a blind test set!“Can we make deep inferences without knowing the premise apriori?”
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 18 / 22
![Page 94: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/94.jpg)
Experiments
FraCaS Textual Entailment Suite:Used in MacCartney and Manning (2007; 2008).RTE-style problems: is the hypothesis entailed from the premise?P: At least three commissioners spend a lot of time at home.H: At least three commissioners spend time at home.P: At most ten commissioners spend a lot of time at home.H: At most ten commissioners spend time at home.
9 focused sections; 3 in scope for this work.
Not a blind test set!“Can we make deep inferences without knowing the premise apriori?”
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 18 / 22
![Page 95: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/95.jpg)
FraCaS Results
SystemsM07: MacCartney and Manning (2007)M08: MacCartney and Manning (2008)
Classify entailment after aligning premise and hypothesis.N: NaturalLI (this work)
Search blindly from hypothesis for the premise.
§ Category AccuracyM07 M08 N
1 Quantifiers 84 97 955 Adjectives 60 80 736 Comparatives 69 81 87Applicable (1,5,6) 76 90 89
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 19 / 22
![Page 96: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/96.jpg)
FraCaS Results
SystemsM07: MacCartney and Manning (2007)M08: MacCartney and Manning (2008)
Classify entailment after aligning premise and hypothesis.N: NaturalLI (this work)
Search blindly from hypothesis for the premise.
§ Category AccuracyM07 M08 N
1 Quantifiers 84 97 955 Adjectives 60 80 736 Comparatives 69 81 87
Applicable (1,5,6) 76 90 89
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 19 / 22
![Page 97: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/97.jpg)
FraCaS Results
SystemsM07: MacCartney and Manning (2007)M08: MacCartney and Manning (2008)
Classify entailment after aligning premise and hypothesis.N: NaturalLI (this work)
Search blindly from hypothesis for the premise.
§ Category AccuracyM07 M08 N
1 Quantifiers 84 97 955 Adjectives 60 80 736 Comparatives 69 81 87Applicable (1,5,6) 76 90 89
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 19 / 22
![Page 98: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/98.jpg)
Experiments
ConceptNet:A semi-curated collection of common-sense facts.not all birds can flynoses are used to smellnobody wants to diemusic is used for pleasure
Negatives: ReVerb extractions marked false by Turkers.Small (1378 train / 1080 test), but fairly broad coverage.
Our Knowledge Base:270 million lemmatized Ollie extractions.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 20 / 22
![Page 99: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/99.jpg)
Experiments
ConceptNet:A semi-curated collection of common-sense facts.not all birds can flynoses are used to smellnobody wants to diemusic is used for pleasure
Negatives: ReVerb extractions marked false by Turkers.Small (1378 train / 1080 test), but fairly broad coverage.
Our Knowledge Base:270 million lemmatized Ollie extractions.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 20 / 22
![Page 100: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/100.jpg)
ConceptNet Results
SystemsDirect Lookup: Lookup by lemmas.NaturalLI: Our system.
NaturalLI Only: Use only inference (prohibit exact matches).
System P RDirect Lookup 100.0 12.1NaturalLI Only 88.8 40.1NaturalLI 90.6 49.1
4x improvement in recall.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 21 / 22
![Page 101: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/101.jpg)
ConceptNet Results
SystemsDirect Lookup: Lookup by lemmas.NaturalLI: Our system.NaturalLI Only: Use only inference (prohibit exact matches).
System P RDirect Lookup 100.0 12.1NaturalLI Only 88.8 40.1NaturalLI 90.6 49.1
4x improvement in recall.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 21 / 22
![Page 102: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/102.jpg)
ConceptNet Results
SystemsDirect Lookup: Lookup by lemmas.NaturalLI: Our system.NaturalLI Only: Use only inference (prohibit exact matches).
System P RDirect Lookup 100.0 12.1
NaturalLI Only 88.8 40.1NaturalLI 90.6 49.1
4x improvement in recall.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 21 / 22
![Page 103: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/103.jpg)
ConceptNet Results
SystemsDirect Lookup: Lookup by lemmas.NaturalLI: Our system.NaturalLI Only: Use only inference (prohibit exact matches).
System P RDirect Lookup 100.0 12.1NaturalLI Only 88.8 40.1NaturalLI 90.6 49.1
4x improvement in recall.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 21 / 22
![Page 104: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/104.jpg)
ConceptNet Results
SystemsDirect Lookup: Lookup by lemmas.NaturalLI: Our system.NaturalLI Only: Use only inference (prohibit exact matches).
System P RDirect Lookup 100.0 12.1NaturalLI Only 88.8 40.1NaturalLI 90.6 49.1
4x improvement in recall.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 21 / 22
![Page 105: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/105.jpg)
Conclusions
TakeawaysDeep inferences from a large knowledge base.Leverage arbitrarily large plain-text knowledge bases.“Soft” logic with probability of truth.
Strictly better than querying a knowledge base.12% recall→ 49% recall @ 91% precision.Checks logical entailment (not just fuzzy query).
Complexity doesn’t grow with knowledge base size.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 22 / 22
![Page 106: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/106.jpg)
Conclusions
TakeawaysDeep inferences from a large knowledge base.Leverage arbitrarily large plain-text knowledge bases.“Soft” logic with probability of truth.
Strictly better than querying a knowledge base.12% recall→ 49% recall @ 91% precision.Checks logical entailment (not just fuzzy query).
Complexity doesn’t grow with knowledge base size.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 22 / 22
![Page 107: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/107.jpg)
Conclusions
TakeawaysDeep inferences from a large knowledge base.Leverage arbitrarily large plain-text knowledge bases.“Soft” logic with probability of truth.
Strictly better than querying a knowledge base.12% recall→ 49% recall @ 91% precision.Checks logical entailment (not just fuzzy query).
Complexity doesn’t grow with knowledge base size.
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 22 / 22
![Page 108: NaturalLI: Natural Logic Inference for Common Sense Reasoningangeli/talks/2014-emnlp-natural... · 2016-08-24 · NaturalLI: Natural Logic Inference for Common Sense Reasoning Gabor](https://reader034.fdocuments.in/reader034/viewer/2022050604/5fab473580cb74592304dc9d/html5/thumbnails/108.jpg)
Thanks!
Gabor Angeli, Chris Manning (Stanford) NaturalLI: Natural Logic Inference for Common Sense ReasoningOctober 26, 2014 22 / 22