Building(an(Arabic(Mul/word( Expressions((MWE)(Repository(kfirbar/personal/Publications... ·...
Transcript of Building(an(Arabic(Mul/word( Expressions((MWE)(Repository(kfirbar/personal/Publications... ·...
![Page 1: Building(an(Arabic(Mul/word( Expressions((MWE)(Repository(kfirbar/personal/Publications... · Mul/word(Expression(! !!kick!the!bucket! !!!!! !spill!the!beans!! !!make!a!decision!!](https://reader036.fdocuments.in/reader036/viewer/2022080506/5f78988c26633356080f8d0e/html5/thumbnails/1.jpg)
Building an Arabic Mul/word Expressions (MWE) Repository
Abdela/ Hawwari, Kfir Bar, Mona Diab
![Page 2: Building(an(Arabic(Mul/word( Expressions((MWE)(Repository(kfirbar/personal/Publications... · Mul/word(Expression(! !!kick!the!bucket! !!!!! !spill!the!beans!! !!make!a!decision!!](https://reader036.fdocuments.in/reader036/viewer/2022080506/5f78988c26633356080f8d0e/html5/thumbnails/2.jpg)
Mul/word Expression kick the bucket spill the beans make a decision New York rain check daddy soda going screensaver… wall street
![Page 3: Building(an(Arabic(Mul/word( Expressions((MWE)(Repository(kfirbar/personal/Publications... · Mul/word(Expression(! !!kick!the!bucket! !!!!! !spill!the!beans!! !!make!a!decision!!](https://reader036.fdocuments.in/reader036/viewer/2022080506/5f78988c26633356080f8d0e/html5/thumbnails/3.jpg)
Composi/onality
Composi'onal Non composi'onal
Transparent Idioma'c
. . .
![Page 4: Building(an(Arabic(Mul/word( Expressions((MWE)(Repository(kfirbar/personal/Publications... · Mul/word(Expression(! !!kick!the!bucket! !!!!! !spill!the!beans!! !!make!a!decision!!](https://reader036.fdocuments.in/reader036/viewer/2022080506/5f78988c26633356080f8d0e/html5/thumbnails/4.jpg)
Goal
• To create a repository of Arabic MWEs, annotated with some morphological features
• To enable addi/onal research in the field of Arabic processing involving MWEs
![Page 5: Building(an(Arabic(Mul/word( Expressions((MWE)(Repository(kfirbar/personal/Publications... · Mul/word(Expression(! !!kick!the!bucket! !!!!! !spill!the!beans!! !!make!a!decision!!](https://reader036.fdocuments.in/reader036/viewer/2022080506/5f78988c26633356080f8d0e/html5/thumbnails/5.jpg)
Arabic العربية
• Highly inflected (Semi/c language) • Words are based on root and paLern and inflected for person, number and gender
• Nouns use suffixes to reflect possessive forms • Verbs use suffixes to reflect direct objects • Agreement
>gmDt EynyhA���she closed her eyes”
![Page 6: Building(an(Arabic(Mul/word( Expressions((MWE)(Repository(kfirbar/personal/Publications... · Mul/word(Expression(! !!kick!the!bucket! !!!!! !spill!the!beans!! !!make!a!decision!!](https://reader036.fdocuments.in/reader036/viewer/2022080506/5f78988c26633356080f8d0e/html5/thumbnails/6.jpg)
MWE Classes
• Based on syntac/c features – Verb Noun Construc/on (VNC)
• make a decision • md aljswr (someone build bridges… as in extending the arms for peace…)
– Noun Noun Construc/on (NNC) • traffic light • Enq {lzjAjp (boLleneck)
– Verb Par/cle Construc/on (VPC) • take over • mDY fy (con/nues working on…)
– Adjec/ve Noun Construc/on (ANC) • the white house • >xZ w>ETY (give and take)
![Page 7: Building(an(Arabic(Mul/word( Expressions((MWE)(Repository(kfirbar/personal/Publications... · Mul/word(Expression(! !!kick!the!bucket! !!!!! !spill!the!beans!! !!make!a!decision!!](https://reader036.fdocuments.in/reader036/viewer/2022080506/5f78988c26633356080f8d0e/html5/thumbnails/7.jpg)
Arabic MWE Repository
• Manually collected from dic/onaries
A Dic'onary of Arabic Contemporary Idioms Fayed, Wafaa Kamel
A contextual Dic'onary of Idioms Sieny, Mahmoud Esmail, Mokhtar A. Hussein and Sayyed A. Al-‐Doush
A Dic'onary of Arabic Contemporary Idioms Dawood, Mohammed
A Dic'onary of Arabic Idioma'c Expressions Abou Saad, Ahmed
![Page 8: Building(an(Arabic(Mul/word( Expressions((MWE)(Repository(kfirbar/personal/Publications... · Mul/word(Expression(! !!kick!the!bucket! !!!!! !spill!the!beans!! !!make!a!decision!!](https://reader036.fdocuments.in/reader036/viewer/2022080506/5f78988c26633356080f8d0e/html5/thumbnails/8.jpg)
Arabic MWE Repository
• Each MWE was manually augmented with the following informa/on: – The correct SAMA [Maamouri, 2010]morphological analysis for every word, since MADA [Roth et al., 2008] didn’t perform well due to short contexts
– MWE class
![Page 9: Building(an(Arabic(Mul/word( Expressions((MWE)(Repository(kfirbar/personal/Publications... · Mul/word(Expression(! !!kick!the!bucket! !!!!! !spill!the!beans!! !!make!a!decision!!](https://reader036.fdocuments.in/reader036/viewer/2022080506/5f78988c26633356080f8d0e/html5/thumbnails/9.jpg)
MWE Class
• Manually assigned
MWE Class Number VNC 1974 VPC 670 NNC 1239 ANC 285 VVC 41
4,209
![Page 10: Building(an(Arabic(Mul/word( Expressions((MWE)(Repository(kfirbar/personal/Publications... · Mul/word(Expression(! !!kick!the!bucket! !!!!! !spill!the!beans!! !!make!a!decision!!](https://reader036.fdocuments.in/reader036/viewer/2022080506/5f78988c26633356080f8d0e/html5/thumbnails/10.jpg)
Generic Words
• Placeholders for seman/cally-‐related words – flAn – “so and so” – a person qr [flAn] EynA – “pleased someone”
– k*A – “something” – an object ElY HsAb [k*A] – “at the expense of that”
– <mr – “something” – an issue���[<mr] Abn ywmh -‐ “something very new“
• Generic words are provided with their context-‐sensi/ve morphological analysis
![Page 11: Building(an(Arabic(Mul/word( Expressions((MWE)(Repository(kfirbar/personal/Publications... · Mul/word(Expression(! !!kick!the!bucket! !!!!! !spill!the!beans!! !!make!a!decision!!](https://reader036.fdocuments.in/reader036/viewer/2022080506/5f78988c26633356080f8d0e/html5/thumbnails/11.jpg)
Corpus Annota/on • Preprocessing:
AMIRAN [Diab et al. – to appear] is a tool for finding context-‐sensi/ve morpho-‐syntac/c informa/on – Results contain for each word:
• Cli/cs / Segmenta/on • Diacri/zed lemma • Stem • Full part-‐of-‐speech tag • Base-‐phrase tag • Named-‐en/ty-‐recogni/on (NER) tag
![Page 12: Building(an(Arabic(Mul/word( Expressions((MWE)(Repository(kfirbar/personal/Publications... · Mul/word(Expression(! !!kick!the!bucket! !!!!! !spill!the!beans!! !!make!a!decision!!](https://reader036.fdocuments.in/reader036/viewer/2022080506/5f78988c26633356080f8d0e/html5/thumbnails/12.jpg)
PaLern Matching
• Determinis/cally iden/fying MWE instances in a running text – Considering morphological varia'ons of words – matching on the lemma level
– Matching with generic words • [k*A] is currently matched with noun-‐phrases • [flAn] is matched with noun-‐phrases and person en//es
![Page 13: Building(an(Arabic(Mul/word( Expressions((MWE)(Repository(kfirbar/personal/Publications... · Mul/word(Expression(! !!kick!the!bucket! !!!!! !spill!the!beans!! !!make!a!decision!!](https://reader036.fdocuments.in/reader036/viewer/2022080506/5f78988c26633356080f8d0e/html5/thumbnails/13.jpg)
Gaps
• Addi/onal words, such as modifiers, that are not part of the original MWE words are considered as a gap
wDEt AlHrb <wzArhA “the war is over” wDEt AlHrb AlEAlmyp AlvAnyp <wzArhA ”the second world war is over”
MWE
Corpus
![Page 14: Building(an(Arabic(Mul/word( Expressions((MWE)(Repository(kfirbar/personal/Publications... · Mul/word(Expression(! !!kick!the!bucket! !!!!! !spill!the!beans!! !!make!a!decision!!](https://reader036.fdocuments.in/reader036/viewer/2022080506/5f78988c26633356080f8d0e/html5/thumbnails/14.jpg)
Gaps
• Allowing NP chunks to be considered as gaps
Noun ADJ ADJ
wDEt AlHrb <wzArhA “the war is over” wDEt AlHrb AlEAlmyp AlvAnyp <wzArhA ”the second world war is over”
MWE
Corpus
![Page 15: Building(an(Arabic(Mul/word( Expressions((MWE)(Repository(kfirbar/personal/Publications... · Mul/word(Expression(! !!kick!the!bucket! !!!!! !spill!the!beans!! !!make!a!decision!!](https://reader036.fdocuments.in/reader036/viewer/2022080506/5f78988c26633356080f8d0e/html5/thumbnails/15.jpg)
Corpus
• Arabic Gigaword 4.0 • 250M tokens were processed • Found ~480K MWE instances of 2031 MWEs
MWE Class Number VNC 64,504 VPC 75,844 NNC 316,393 ANC 23,814
![Page 16: Building(an(Arabic(Mul/word( Expressions((MWE)(Repository(kfirbar/personal/Publications... · Mul/word(Expression(! !!kick!the!bucket! !!!!! !spill!the!beans!! !!make!a!decision!!](https://reader036.fdocuments.in/reader036/viewer/2022080506/5f78988c26633356080f8d0e/html5/thumbnails/16.jpg)
Corpus Evalua/on
• We sampled the corpus and evaluated the results
• We checked whether an instance represents the MWE in that context For example – <TlAq AlnAr (“opening fire” and not just “ligh/ng a fire”)
![Page 17: Building(an(Arabic(Mul/word( Expressions((MWE)(Repository(kfirbar/personal/Publications... · Mul/word(Expression(! !!kick!the!bucket! !!!!! !spill!the!beans!! !!make!a!decision!!](https://reader036.fdocuments.in/reader036/viewer/2022080506/5f78988c26633356080f8d0e/html5/thumbnails/17.jpg)
Evalua/on Results
• Evalua/on results
MWE Class Number Correct VNC 157 (34 MWEs) 154 VPC 161 (32 MWEs) 125 NNC 155 (26 MWEs) 154
![Page 18: Building(an(Arabic(Mul/word( Expressions((MWE)(Repository(kfirbar/personal/Publications... · Mul/word(Expression(! !!kick!the!bucket! !!!!! !spill!the!beans!! !!make!a!decision!!](https://reader036.fdocuments.in/reader036/viewer/2022080506/5f78988c26633356080f8d0e/html5/thumbnails/18.jpg)
Summary
• Arabic MWE Repository is introduced • It has 4,209 MWEs from 4 different classes • The Arabic Gigaword 4.0 was determinis/cally annotated with the MWEs and the results were manually evaluated
• We believe this resource will enable new direc/ons for researches on Arabic processing
![Page 19: Building(an(Arabic(Mul/word( Expressions((MWE)(Repository(kfirbar/personal/Publications... · Mul/word(Expression(! !!kick!the!bucket! !!!!! !spill!the!beans!! !!make!a!decision!!](https://reader036.fdocuments.in/reader036/viewer/2022080506/5f78988c26633356080f8d0e/html5/thumbnails/19.jpg)
Thank you
The repository is available for download– please contact us to get a copy [email protected]!