Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and...
Transcript of Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and...
![Page 1: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/1.jpg)
LexicalSemantics,Distributions,Predicate-ArgumentStructure,and
FrameSemanticParsing
11-711AlgorithmsforNLP
5 December2017
(WiththankstoNoahSmith
andLoriLevin)
![Page 2: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/2.jpg)
11-711CourseContext
• Previoussemanticslecturesdiscussedcomposingmeaningsofpartstoproducethecorrectglobalsentencemeaning– Themailmanbitmydog.
• The“atomicunits”ofmeaninghavecomefromthelexicalentriesforwords
• Themeaningsofwordshavebeenoverlysimplified(asinFOL):atomicobjectsinaset-theoreticmodel
![Page 3: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/3.jpg)
WordSense
• Instead,abank canholdtheinvestmentsinacustodialaccountintheclient’sname.
• Butasagricultureburgeonsontheeastbank,theriverwillshrinkevenmore.
• Whilesomebanks furnishspermonlytomarriedwomen,othersaremuchlessrestrictive.
• Thebank isnearthecornerofForbesandMurray.
![Page 4: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/4.jpg)
FourMeaningsof“Bank”
• Synonyms:• bank1 =“financialinstitution”
• bank2 =“slopingmound”
• bank3 =“biologicalrepository”
• bank4 =“buildingwhereabank1 doesitsbusiness”
• Theconnectionsbetweenthesedifferentsenses varyfrompracticallynone(homonymy)torelated(polysemy).– Therelationshipbetweenthesensesbank4 andbank1 iscalledmetonymy.
![Page 5: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/5.jpg)
Antonyms
• White/black,tall/short,skinny/American,…
• Butdifferentdimensionspossible:–White/Blackvs.White/Colorful
– Oftenculturallydetermined
• Partlyinterestingbecauseautomaticmethodshavetroubleseparatingthesefromsynonyms– Samesemanticfield
![Page 6: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/6.jpg)
HowManySenses?
• Thisisahardquestion,duetovagueness.
![Page 7: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/7.jpg)
Ambiguityvs.Vagueness
• Lexicalambiguity:Mywifehastwokids(childrenorgoats?)
• vs.Vagueness:1sense,butindefinite:horse(mare,colt,filly,stallion,…)vs.kid:– IhavetwohorsesandGeorgehasthree– IhavetwokidsandGeorgehasthree
• Verbstoo:IranlastyearandGeorgedidtoo• vs.Reference:I,here,thedognotconsideredambiguousinthesameway
![Page 8: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/8.jpg)
HowManySenses?
• Thisisahardquestion,duetovagueness.
• Considerations:– Truthconditions(servemeat/servetime)– Syntacticbehavior(servemeat/serveassenator)– Zeugmatest:• #DoesUnitedservebreakfastandPittsburgh?• ??Shepoacheselephantsandpears.
![Page 9: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/9.jpg)
RelatedPhenomena
• Homophones(would/wood,two/too/to)–Mary,merry,marryinsomedialects,notothers
• Homographs(bass/bass)
![Page 10: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/10.jpg)
WordSensesandDictionaries
![Page 11: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/11.jpg)
WordSensesandDictionaries
![Page 12: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/12.jpg)
Ontologies
• ForNLP,databasesofwordsensesaretypicallyorganizedbylexicalrelationssuchashypernym (IS-A)intoaDAG
• Thishasbeenworkedonforquiteawhile
• Aristotle’sclasses(about330BC)– substance(physicalobjects)– quantity(e.g.,numbers)
– quality(e.g.,beingred)– Others:relation,place,time,position,state,action,affection
![Page 13: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/13.jpg)
WordsensesinWordNet3.0
![Page 14: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/14.jpg)
Synsets
• (bass6,bass-voice1,basso2)
• (bass1,deep6)(Adjective)
• (chump1,fool2,gull1,mark9,patsy1,
fallguy1,sucker1,softtouch1,mug2)
![Page 15: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/15.jpg)
“Rough”Synonymy
• JonathanSafranFoer’s EverythingisIlluminated
![Page 16: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/16.jpg)
NounrelationsinWordNet3.0
![Page 17: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/17.jpg)
![Page 18: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/18.jpg)
Isahamburgerfood?
![Page 19: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/19.jpg)
VerbrelationsinWordNet3.0
• Notnearlyasmuchinformationasnouns
![Page 20: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/20.jpg)
FramebasedKnowledgeRep.
• Organizerelationsaroundconcepts
• Equivalentto(orweakerthan)FOPC– Imagefromfuturehumanevolution.com
![Page 21: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/21.jpg)
Stillno“real”semantics?
• Semanticprimitives:Kill(x,y)=CAUSE(x,BECOME(NOT(ALIVE(y))))Open(x,y)=CAUSE(x,BECOME(OPEN(y)))
• ConceptualDependency:PTRANS,ATRANS,…ThewaiterbroughtMarythecheckPTRANS(x)�ACTOR(x,Waiter)�(OBJECT(x,Check)
�TO(x,Mary)�ATRANS(y)�ACTOR(y,Waiter)�(OBJECT(y,Check)
�TO(y,Mary)
![Page 22: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/22.jpg)
Wordsimilarity
• Humanlanguagewordsseemtohavereal-valuedsemanticdistance(vs.logicalobjects)
• Twomainapproaches:– Thesaurus-basedmethods• E.g.,WordNet-based
– Distributionalmethods• Distributional“semantics”,vector“semantics”
• Moreempirical,butaffectedbymorethansemanticsimilarity(“wordrelatedness”)
![Page 23: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/23.jpg)
Human-subjectWordAssociations
Stimulus:wall
Numberofdifferentanswers:39
Totalcountofallanswers:98
BRICK160.16STONE90.09PAPER70.07GAME50.05BLANK40.04BRICKS40.04FENCE40.04FLOWER40.04BERLIN30.03CEILING30.03HIGH30.03STREET30.03...
Stimulus:giraffe
Numberofdifferentanswers:26
Totalcountofallanswers:98
NECK330.34
ANIMAL90.09
ZOO90.09
LONG70.07
TALL70.07
SPOTS50.05
LONGNECK40.04
AFRICA30.03
ELEPHANT20.02
HIPPOPOTAMUS20.02
LEGS20.02
...
FromEdinburghWordAssociationThesaurus,http://www.eat.rl.ac.uk/
![Page 24: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/24.jpg)
Thesaurus-basedWordSimilarity
• Simplestapproach:pathlength
![Page 25: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/25.jpg)
Betterapproach:weightedlinks• Usecorpusstatstogetprobabilitiesofnodes
• Refinement:useinfocontentofLCS:2*logP(g.f.)/(logP(hill)+logP(coast))=0.59
![Page 26: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/26.jpg)
DistributionalWordSimilarity
• Determinesimilarityofwordsbytheirdistribution inacorpus– “Youshallknowawordbythecompanyitkeeps!”(Firth1957)
• E.g.:100kdimension vector,“1”ifwordoccurswithin“2lines”:
• “Whoismyneighbor?”Whichfunctions?
![Page 27: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/27.jpg)
Whoismyneighbor?• Linearwindow?1-500wordswide.Orwholedocument.Removestopwords?
• Usedependency-parserelations?Moreexpensive,butmaybebetterrelatedness.
![Page 28: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/28.jpg)
Weightsvs.justcounting
• Weightthecountsbytheapriorichanceofco-occurrence
• Pointwise MutualInformation(PMI)
• Objectsofdrink:
![Page 29: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/29.jpg)
Distancebetweenvectors
• Comparesparsehigh-dimensionalvectors– Normalizeforvectorlength
• Justusevectorcosine?
• SeveralotherfunctionscomefromIRcommunity
![Page 30: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/30.jpg)
Lotsoffunctionstochoosefrom
![Page 31: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/31.jpg)
Distributionally SimilarWords
31
Rumvodkacognacbrandywhiskyliquordetergentcolaginlemonadecocoachocolatescotchnoodletequilajuice
Writereadspeakpresentreceivecallreleasesignofferknowacceptdecideissueprepareconsiderpublish
Ancientoldmoderntraditionalmedievalhistoricfamousoriginalentiremainindianvarioussingleafricanjapanesegiant
Mathematicsphysicsbiologygeologysociologypsychologyanthropologyastronomyarithmeticgeographytheologyhebreweconomicschemistryscripturebiotechnology
(fromanimplementationofthemethoddescribedinLin.1998.AutomaticRetrievalandClusteringofSimilarWords.COLING-ACL.Trainedonnewswiretext.)
![Page 32: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/32.jpg)
Human-subjectWordAssociations
Stimulus:wall
Numberofdifferentanswers:39
Totalcountofallanswers:98
BRICK160.16STONE90.09PAPER70.07GAME50.05BLANK40.04BRICKS40.04FENCE40.04FLOWER40.04BERLIN30.03CEILING30.03HIGH30.03STREET30.03...
Stimulus:giraffe
Numberofdifferentanswers:26
Totalcountofallanswers:98
NECK330.34
ANIMAL90.09
ZOO90.09
LONG70.07
TALL70.07
SPOTS50.05
LONGNECK40.04
AFRICA30.03
ELEPHANT20.02
HIPPOPOTAMUS20.02
LEGS20.02
...
FromEdinburghWordAssociationThesaurus,http://www.eat.rl.ac.uk/
![Page 33: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/33.jpg)
Recentevents(2013-now)
• RNNs(RecurrentNeuralNetworks)asanotherwaytogetfeaturevectors– Hiddenweightsaccumulatefuzzyinfoonwordsintheneighborhood
– Thesetofhiddenweightsisusedasthevector!
![Page 34: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/34.jpg)
RNNs
Fromopeni.nlm.nih.gov
![Page 35: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/35.jpg)
Recentevents(2013-now)
• RNNs(RecurrentNeuralNetworks)asanotherwaytogetfeaturevectors– Hiddenweightsaccumulatefuzzyinfoonwordsintheneighborhood
– Thesetofhiddenweightsisusedasthevector!• Compositionbymultiplying(etc.)–Mikolov etal(2103):“king– man+woman=queen”(!?)
– CCGwithvectorsasNPsemantics,matricesasverbsemantics(!?)
![Page 36: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/36.jpg)
36 SemanticProcessing[2]
SemanticCases/ThematicRoles
• Developedinlate1960’sand1970’s
• Postulatealimitedsetofabstractsemanticrelationshipsbetweenaverb&itsarguments:thematicroles orcaseroles
• Insomesense,partoftheverb’ssemantics
![Page 37: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/37.jpg)
37 SemanticProcessing[2]
ThematicRoleexample
• Johnbrokethewindowwiththehammer• John:AGENTrolewindow:THEMErolehammer:INSTRUMENTrole
• ExtendLFnotationtousesemanticroles
![Page 38: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/38.jpg)
38 SemanticProcessing[2]
ThematicRoles
• IsthereaprecisewaytodefinemeaningofAGENT,THEME,etc.?
• Bydefinition:– “TheAGENTisaninstigatoroftheactiondescribedbythesentence.”
• Testingviasentencerewrite:– Johnintentionally brokethewindow– *Thehammerintentionally brokethewindow
![Page 39: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/39.jpg)
39 SemanticProcessing[2]
ThematicRoles[2]
• THEME– Describestheprimaryobjectundergoingsomechangeorbeingactedupon
– FortransitiveverbX,“whatwasXed?”– Thegrayeaglesawthemouse“Whatwasseen?”(A:themouse)
![Page 40: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/40.jpg)
Breaking,Eating,Opening
• Johnbrokethewindow.• Thewindowbroke.• Johnisalwaysbreakingthings.
• Weatedinner.• Wealreadyate.• Thepieswereeatenupquickly.
• Openup!• Someoneleftthedooropen.• Johnopensthewindowatnight.
![Page 41: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/41.jpg)
Breaking,Eating,Opening
• Johnbrokethewindow.• Thewindowbroke.• Johnisalwaysbreakingthings.
• Weatedinner.• Wealreadyate.• Thepieswereeatenupquickly.
• Openup!• Someoneleftthedooropen.• Johnopensthewindowatnight.
breaker,brokenthing,breakingfrequency?
eater,eatenthing,eatingspeed?
opener,openedthing,openingtime?
![Page 42: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/42.jpg)
CanWeGeneralize?
• Thematicroles describegeneralpatternsofparticipantsingenericevents.
• Thisgivesusakindofshallow,partialsemanticrepresentation.
• FirstproposedbyPanini,before400BC!
![Page 43: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/43.jpg)
ThematicRoles
Role Definition ExampleAgent Volitional causer of the event The waiter spilled the soup.
Force Non-volitional causer of the event The wind blew the leaves around.
Experiencer Mary has a headache.Theme Most directly affected participant Mary swallowed the pill.Result End-product of an event We constructed a new building.Content Proposition of a propositional event Mary knows you hate her.Instrument You shot her with a pistol.Beneficiary I made you a reservation.Source Origin of a transferred thing I flew in from Pittsburgh.Goal Destination of a transferred thing Go to hell!
![Page 44: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/44.jpg)
ThematicGridorCaseFrame
• Example:break– Thechildbrokethevase.<agenttheme>
subjobj
– Thechildbrokethevasewithahammer.<agentthemeinstr >
subjobj PP
– Thehammerbrokethevase.< themeinstr >obj subj
– Thevasebroke.<theme>subj
![Page 45: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/45.jpg)
ThematicGridorCaseFrame
• Example:break– Thechildbrokethevase.<agenttheme>
subjobj
– Thechildbrokethevasewithahammer.<agentthemeinstr >
subjobj PP
– Thehammerbrokethevase.< themeinstr >obj subj
– Thevasebroke.<theme>subjTheThematicGridorCaseFrameshows
• Howmanyargumentstheverbhas• Whatrolestheargumentshave• Wheretofindeachargument
• Forexample,youcanfindtheagentinthesubjectposition
![Page 46: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/46.jpg)
DiathesisAlternation:achangeinthenumberofargumentsorthegrammaticalrelationsassociatedwith
eachargument
• Chris gaveabooktoDana. <agentthemegoal>subjobj PP
• AbookwasgiventoDana byChris. <agentthemegoal>PPsubjPP
• ChrisgaveDanaabook. <agentthemegoal>subjobj2obj
• Dana wasgivenabookbyChris. <agentthemegoal>PPobj subj
![Page 47: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/47.jpg)
TheTroubleWithThematicRoles
• Theyarenotformallydefined.
• Theyareoverlygeneral.
• “agent verb theme withinstrument”and“instrumentverbtheme”...– Thecookopenedthejarwiththenewgadget.
→ Thenewgadgetopenedthejar.
– Susanatetheslicedbananawithafork.→ #Theforkatetheslicedbanana.
![Page 48: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/48.jpg)
TwoDatasets
• PropositionBank(PropBank):verb-specificthematicroles
• FrameNet:“frame”-specificthematicroles
• Thesearelexiconscontainingcaseframes/thematicgridsforeachverb.
![Page 49: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/49.jpg)
PropositionBank(PropBank)
• Asetofverb-sense-specific “frames”withinformalEnglishglossesdescribingtheroles
• Conventionsforlabelingoptionalmodifierroles
• PennTreebankislabeledwiththoseverb-sense-specificsemanticroles.
![Page 50: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/50.jpg)
“Agree”inPropBank
• arg0:agreer
• arg1:proposition
• arg2:otherentityagreeing
• Thegroupagreeditwouldn’tmakeanoffer.
• UsuallyJohn agreeswithMary oneverything.
![Page 51: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/51.jpg)
“Fall(movedownward)”inPropBank
• arg1:logicalsubject,patient,thingfalling• arg2:extent,amountfallen• arg3:startingpoint• arg4:endingpoint• argM-loc:medium• Sales fellto$251.2million from$278.8million.• Theaveragejunkbondfellby4.2%.• Themeteorfellthroughtheatmosphere,crashingintoCambridge.
![Page 52: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/52.jpg)
FrameNet
• FrameNetissimilar,butabstractsfromspecificverbs,sothatsemanticframes arefirst-classcitizens.
• Forexample,thereisasingleframecalledchange_position_on_a_scale.
![Page 53: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/53.jpg)
change_position_on_a_scale
Oil rose in price by 2%It has increased to having them 1 day a month.Microsoft shares fell to 7 5/8.Colon cancer incidence fell by 50% among men.
Manywords,notjustverbs,sharethesameframe:
Verbs:advance,climb,decline,decrease,diminish,dip,double,drop,dwindle,edge,explode,fall,fluctuate,gain,grow,increase,jump,move,mushroom,plummet,reach,rise,rocket,shift,skyrocket,slide,soar,swell,swing,triple,tumbleNouns:decline,decrease,escalation,explosion,fall,fluctuation,gain,growth,hike,increase,rise,shift,tumbleAdverb:increasingly
![Page 54: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/54.jpg)
Conversely,onewordhasmanyframesExample:rise
• Change-position-on-a-scale:OilROSEinpricebytwopercent.• Change-posture:aprotagonist changestheoverallpositionorpostureofabody.
– Source:startingpointofthechangeofposture.
– Charles ROSEfromhisarmchair.
• Get-up:A Protagonist leavestheplacewheretheyhaveslept,their Bed,tobeginorresumedomestic,professional,orotheractivities.GettingupisdistinctfromWakingup,whichisconcernedonlywiththetransitionfromthesleepingstatetoawakefulstate.
– I ROSE frombed,threwonapairofcamouflageshortsanddrovemylittleToyotaCorollatoaconstructionclearingafewmilesaway.
• Motion-directional:Inthisframea Theme movesinacertain Direction whichisoftendeterminedbygravityorothernatural,physicalforces.The Theme isnotnecessarilyaself-mover.
– TheballoonROSEupward.
• Sidereal-appearance: An Astronomical_entity comesintoviewabovethehorizonaspartofaregular,periodicprocessof(apparent)motionoftheAstronomical_entity acrossthesky.Inthecaseofthesun,theappearancebeginstheday.
– Atthetimeofthenewmoon, themoon RISES ataboutthesametimethesunrises,anditsetsataboutthesametimethesunsets.
Eachday thesun's RISE offersusanewday.
![Page 55: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/55.jpg)
FrameNet
• Framesarenotjustforverbs!• Verbs:advance,climb,decline,decrease,diminish,dip,double,drop,dwindle,edge,explode,fall,fluctuate,gain,grow,increase,jump,move,mushroom,plummet,reach,rise,rocket,shift,skyrocket,slide,soar,swell,swing,triple,tumble
• Nouns:decline,decrease,escalation,explosion,fall,fluctuation,gain,growth,hike,increase,rise,shift,tumble
• Adverb:increasingly
![Page 56: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/56.jpg)
FrameNet
• Includesinheritanceandcausationrelationshipsamongframes.
• Examplesincluded,butlittlefully-annotatedcorpusdata.
![Page 57: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/57.jpg)
SemLink
• Itwouldbereallyusefulifthesedifferentresourceswereinterconnectedinausefulway.
• SemLink projectis(was?)tryingtodothat
• UnifiedVerbIndex(UVI)connects– PropBank– VerbNet– FrameNet
–WordNet/OntoNotes
![Page 58: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/58.jpg)
SemanticRoleLabeling
• Input:sentence• Output:foreachpredicate*,labeledspansidentifyingeachofitsarguments.
• Example:[agentThebatter]hit[patient theball][time yesterday]
• Somewherebetweensyntacticparsingandfull-fledgedcompositionalsemantics.
*Predicatesaresometimesidentifiedintheinput,sometimesnot.
![Page 59: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/59.jpg)
Butwait.Howisthisdifferentfromdependencyparsing?
• Semanticrolelabeling– [agentThebatter]hit[patient theball][time yesterday]
• Dependencyparsing– [subjThebatter]hit[obj theball][mod yesterday]
![Page 60: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/60.jpg)
Butwait.Howisthisdifferentfromdependencyparsing?
• Semanticrolelabeling– [agentThebatter]hit[patient theball][time yesterday]
• Dependencyparsing– [subjThebatter]hit[obj theball][mod yesterday]
1. Thesearenotthesametask.
2. Semanticrolelabelingismuchharder.
![Page 61: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/61.jpg)
Subjectvsagent
• Subjectisagrammaticalrelation• Agentisasemanticrole
• InEnglish,asubjecthastheseproperties– Itcomesbeforetheverb– Ifitisapronoun,itisinnominativecase(inafiniteclause)
• I/he/she/we/theyhittheball.• *Me/him/her/us/themhittheball.
– Iftheverbisinpresenttense,itagreeswiththesubject• She/he/ithitstheball.• I/we/theyhittheball.• *She/he/ithittheball.• *I/we/theyhitstheball.• Ihittheball.• Ihittheballs.
![Page 62: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/62.jpg)
Subjectvsagent
• Inthemosttypicalsentences(forsomedefinitionof“typical”),theagentisthesubject:– Thebatterhittheball.– Chrisopenedthedoor.– Theteachergavebookstothestudents.
• Sometimestheagentisnotthesubject:– Theballwashitbythebatter.– Theballswerehitbythebatter.
• Sometimesthesubjectisnottheagent:– Thedooropened.– Thekeyopenedthedoor.– Thestudentsweregivenbooks.– Booksweregiventothestudents.
![Page 63: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/63.jpg)
SemanticRoleLabeling
• Input:sentence
• Output:segmentationintoroles,withlabels
• Examplefrombook:• [arg0 TheExaminer]issued[arg1 aspecialedition][argM-tmp yesterday]
![Page 64: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/64.jpg)
SemanticRoleLabeling:HowItWorks
• First,parse.
• Foreachpredicatewordintheparse:– Foreachnodeintheparse:• Classify thenodewithrespecttothepredicate.
![Page 65: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/65.jpg)
YetAnotherClassificationProblem!
• Asbefore,therearemanytechniques(e.g.,NaïveBayes)
• Key:whatfeatures?
![Page 66: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/66.jpg)
FeaturesforSemanticRoleLabeling
• Whatisthepredicate?• Phrasetypeoftheconstituent• Headwordoftheconstituent,itsPOS• Pathintheparsetreefromtheconstituenttothepredicate
• Activeorpassive• Isthephrasebeforeorafterthepredicate?• Subcategorization(≈grammarrule)ofthepredicate
![Page 67: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/67.jpg)
Featureexample
• Examplesentence:[arg0 TheExaminer]issued[arg1 aspecialedition][argM-tmp
yesterday]
• Arg0features:issued,NP,Examiner,NNP,path,active,before,VP->VBDNPPP
![Page 68: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/68.jpg)
Example
Figure20.16:ParsetreeforaPropBank sentence,showingthePropBank argumentlabels.Thedottedlineshowsthepath featureNP ↑ S ↓ VP ↓ VBD forARG0,theNP-SBJconstituentTheSanFranciscoExaminer.
![Page 69: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/69.jpg)
AdditionalIssues
• Initialfilteringofnon-arguments
• Usingchunkingorpartialparsinginsteadoffullparsing
• Enforcingconsistency(e.g.,non-overlap,onlyonearg0)
• Phrasalverbs,supportverbs/lightverbs– takeanap:verbtakeissyntacticheadofVP,butpredicateisnapping,nottaking
![Page 70: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/70.jpg)
Twodatasets,twosystems
• ExamplefrombookusesPropBank
• Locally-developedsystemSEMAFORworksonSemEval problem,basedonFrameNet
![Page 71: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/71.jpg)
PropBank vsFrameNet
![Page 72: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/72.jpg)
Shallowapproachestodeepproblems
• Formanyproblems:– Shallowapproachesmucheasiertodevelop• Asin,possibleatall forunlimitedvocabularies
– Notwonderfulperformanceyet• Sometimesclaimedtohelpaparticularsystem,butoftendoesn’tseemtohelp
– Definitionsarenotcrisp• Thereclearlyissomething there,butthegranularityofthedistinctionsveryproblematic
• DeepLearningwillfixeverything?
![Page 73: Lexical Semantics, Distributions, Predicate-Argument ...tbergkir/11711fa17/Lexical Semantics and FSP.pdffall guy1, sucker1, soft touch1, mug2) “Rough” Synonymy •Jonathan Safran](https://reader035.fdocuments.in/reader035/viewer/2022071216/6047e3cf3cf2b6606c446479/html5/thumbnails/73.jpg)
Questions?