Do Neural Language Representations Learn Physical …ELMo human GloVe BERT ELMo human GloVe BERT???...
1
Do Neural Language Representations Learn Physical Commonsense? Maxwell Forbes Ari Holtzman Yejin Choi Project webpage mbforbes.github.io/physical-commonsense Humans Can Reason about Objects, Properties, and Affordances The is broken again! blender requires_electricity( blender ) = True ¬ plugged_in( blender ) ⇒ ¬ functions( blender ) Yep, I checke d everything. It’s broken. Are you sure it’s ? broken has_battery( blender ) = False connected_to_power_source( blender ) = True turned_on( blender ) = True blown_a_fuse( outlet_connected( blender )) = False broken( blender ) = True broken plug (in) break turn (on) fuse blender smoothie objects broken electrical properties inferred affordances (has) battery ⟺ checked p ⇒ p p a p a p p ⇒ p plugged in Neural Language Representations Struggle to Reason between Affordances and Properties cat object property property affordance Are cats usually fluffy? If something is fluffy, can you usually pet it? ELMo human GloVe BERT object affordance Can you pet cats? ELMo human GloVe BERT ELMo human GloVe BERT ? ? ? MODELS DATASETS QUANTITATIVE RESULTS Property and Affordance F1 Scores by Class Property Accuracy by Category (a) (b) (c) (d) ANALYSIS Aron: Now! This is it! Now is the time to choose! Die and be free of pain or live and fight your sorrow! Now is the time to shape your stories! Your fate is in your hands! Kimahri: Yuna needs Kimahri. Kimahri protect Yuna. Rikku: Well, I’m fighting! Wakka: I can’t believe we’re gonna fight Lady Yunalesca! Gimme a break! Lulu: You can always run. Wakka: Hah! I’d never forgive myself–no way! Not if I ran away now. Even in death, ya! Lulu: My thoughts exactly. Tidus: Yuna! This is our story! Now let’s see this thing through together. Yuna: (Nods and smiles) [They beat the stuffing out of Yunalesca] Yunalesca: If I die, so does the Final Aeon. And with it, Spira’s only hope. Tidus: Then we’ll find Spira a new hope! Yunalesca: NEURAL LANGUAGE REPS. 0.74, -0.32, 0.4, … natural language text real vector ELMo GloVe BERT
Transcript of Do Neural Language Representations Learn Physical …ELMo human GloVe BERT ELMo human GloVe BERT???...
Do Neural Language Representations Learn Physical Commonsense?
Maxwell Forbes Ari Holtzman Yejin Choi
Project webpagembforbes.github.io/physical-commonsense
Humans Can Reason about Objects, Properties, and Affordances
The is is broken again!blender
requires_electricity( blender ) = True
¬ plugged_in( blender ) ⇒ ¬ functions( blender )
Yep, I checke d everything. It’s broken.
Are you sure it’s ?
broken
has_battery( blender ) = False
connected_to_power_source( blender ) = True
turned_on( blender ) = True
blown_a_fuse( outlet_connected( blender )) = False
broken( blender ) = True
broken
plug (in)break
turn (on)
fuseblender
smoothie
objects
brokenelectrical
properties
inferred
affordances
(has) battery⟺
checked
p
⇒
p
p a
p
a
p p
⇒ p
plugged in
Neural Language Representations Struggle to Reason between Affordances and Properties
cat
object
property
property
affordance
Are cats usually fluffy? If something is fluffy, can you usually pet it?
ELMo
human
GloVe
BERT
object
affordance
Can you pet cats?
ELMo
human
GloVe
BERT
ELMo
human
GloVe
BERT
???
MODELS
DATASETS
QUANTITATIVE RESULTS
Property and Affordance F1 Scores by Class Property Accuracy by Category
(a) (b)
(c)
(d)
ANALYSIS
Aron: Now! This is it! Now is the time to choose! Die and be free of pain or live and fight your sorrow! Now is the time to shape your stories! Your fate is in your hands! Kimahri: Yuna needs Kimahri. Kimahri protect Yuna. Rikku: Well, I’m fighting! Wakka: I can’t believe we’re gonna fight Lady Yunalesca! Gimme a break! Lulu: You can always run. Wakka: Hah! I’d never forgive myself–no way! Not if I ran away now. Even in death, ya! Lulu: My thoughts exactly. Tidus: Yuna! This is our story! Now let’s see this thing through together. Yuna: (Nods and smiles) [They beat the stuffing out of Yunalesca] Yunalesca: If I die, so does the Final Aeon. And with it, Spira’s only hope. Tidus: Then we’ll find Spira a new hope! Yunalesca:
NEURAL LANGUAGE REPS.
0.74, -0.32, 0.4, …natural language text
real vectorELMoGloVe BERT
![arXiv:2007.04298v1 [cs.CL] 29 Jun 2020 · for various tasks, including the BERT [7], ELMo [25], LSTM [12], CNN [16] and Transformer [39]. Experimental results have demonstrated the](https://static.fdocuments.in/doc/165x107/5f7ecc55063c120188257f24/arxiv200704298v1-cscl-29-jun-2020-for-various-tasks-including-the-bert-7.jpg)
