Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture...
Transcript of Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture...
![Page 1: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/1.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
Introduction to Grammar Engineering withHPSG
Project Seminar 2008Lecture 1: General Introduction
Yi Zhang
Department of Computational Linguistics & PhoneticsSaarland University
Language Technology LabGerman Research Center for Artificial Intelligence
21st April, 2008
Yi Zhang Grammar Engineering
![Page 2: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/2.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
Introduction to Grammar Engineering with HPSG
Course InfoType: Project SeminarTime: Monday 10:15 – 11:45Location: Conference Room 2.11, Building C 72Homepage: http://www.coli.uni-saarland.de/∼yzhang/ge
Yi Zhang Grammar Engineering
![Page 3: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/3.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
Outline
1 Grammar engineeringWhat?Why?Who?How?Where? When?
2 HPSG and DELPH-IN
3 Structure of the course
Yi Zhang Grammar Engineering
![Page 4: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/4.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
What?Why?Who?How?Where? When?
Outline
1 Grammar engineeringWhat?Why?Who?How?Where? When?
2 HPSG and DELPH-IN
3 Structure of the course
Yi Zhang Grammar Engineering
![Page 5: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/5.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
What?Why?Who?How?Where? When?
What Is Grammar Engineering?
GoalTo build
re-usable computational
grammar resources
Yi Zhang Grammar Engineering
![Page 6: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/6.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
What?Why?Who?How?Where? When?
What Is Grammar Engineering?
GoalTo build
re-usable
computational grammar resources
Yi Zhang Grammar Engineering
![Page 7: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/7.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
What?Why?Who?How?Where? When?
What Is Grammar Engineering?
GoalTo build
re-
usable computational grammar resources
Yi Zhang Grammar Engineering
![Page 8: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/8.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
What?Why?Who?How?Where? When?
What Is Grammar Engineering?
GoalTo build re-usable computational grammar resources
Yi Zhang Grammar Engineering
![Page 9: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/9.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
What?Why?Who?How?Where? When?
Motivation
Linguistically motivated grammars are variable resourcesRelevant to most of the NLP tasksCan be used to test linguistic hypotheses
Yi Zhang Grammar Engineering
![Page 10: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/10.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
What?Why?Who?How?Where? When?
Application Scenario
Basic tasksParsingGeneration
Real-world applicationsMachine TranslationGrammar CheckingInformation ExtractionQuestion Answering
Yi Zhang Grammar Engineering
![Page 11: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/11.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
What?Why?Who?How?Where? When?
Application Scenario
Basic tasksParsingGeneration
Real-world applicationsMachine TranslationGrammar CheckingInformation ExtractionQuestion Answering
Yi Zhang Grammar Engineering
![Page 12: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/12.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
What?Why?Who?How?Where? When?
Linguists and Computer Scientists
Yi Zhang Grammar Engineering
![Page 13: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/13.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
What?Why?Who?How?Where? When?
Necessary Components
Linguistic TheoryGrammar Engineering PlatformLinguistic ResourcesMethodology
Yi Zhang Grammar Engineering
![Page 14: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/14.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
What?Why?Who?How?Where? When?
Linguistic Theories
A Solid Linguistic TheoryRigid mathematical foundationTractable computational modelUniversal to different languages
Yi Zhang Grammar Engineering
![Page 15: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/15.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
What?Why?Who?How?Where? When?
Linguistic Theories of Choice
Tree-adjoining grammar (TAG)Combinatory Categorial Grammar (CCG)Lexical Functional Grammar (LFG)Head-driven Phrase Structure Grammar (HPSG)
Yi Zhang Grammar Engineering
![Page 16: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/16.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
What?Why?Who?How?Where? When?
Grammar Engineering Platform
Implementation of the formalism (description language)Grammar editorProcessor: parser, generator, etc.Graphical UIOther tools:
Profiling systemTreebanking tools. . .
Yi Zhang Grammar Engineering
![Page 17: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/17.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
What?Why?Who?How?Where? When?
Linguistic Resources
Corpora / Treebanks / Testsuites / LexicaReference Grammars
Existing grammars for other languages on the sameplatformExisting grammars for the same language on otherplatformsUniversal reusable grammar components
Yi Zhang Grammar Engineering
![Page 18: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/18.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
What?Why?Who?How?Where? When?
Hand-Crafted Grammars v.s. Treebank-InducedGrammars
Hand-crafted grammarsLong development circleHigh linguistic precision can be achievedGrammar maintenance is difficult(Potentially) suitable for different tasks
Treebank-induced grammarsLarge annotated treebank is requiredSemi-automatic grammar adaptation and extensionMore suitable for parsing than generation
Yi Zhang Grammar Engineering
![Page 19: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/19.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
What?Why?Who?How?Where? When?
Where? When?
Here! Now!
Yi Zhang Grammar Engineering
![Page 20: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/20.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
Outline
1 Grammar engineeringWhat?Why?Who?How?Where? When?
2 HPSG and DELPH-IN
3 Structure of the course
Yi Zhang Grammar Engineering
![Page 21: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/21.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
HPSG as a linguistic theory
Highly consistent and powerful formalism (TFS)Monostratal, declarative, non-derivational, lexicalist,constraint-basedHas been studied for many different languagesPsycholinguistic evidence
Yi Zhang Grammar Engineering
![Page 22: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/22.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
Mathematical foundation
Typed Feature Structure[Carpenter, 1992]High expressive powerParsing complexity: exponential (to the input length)
Tractable with efficient parsing algorithmsEfficiency can be improved with a well designed grammar
Yi Zhang Grammar Engineering
![Page 23: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/23.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
Mathematical foundation
Typed Feature Structure[Carpenter, 1992]High expressive powerParsing complexity: exponential (to the input length)
Tractable with efficient parsing algorithmsEfficiency can be improved with a well designed grammar
Yi Zhang Grammar Engineering
![Page 24: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/24.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
Mathematical foundation
Typed Feature Structure[Carpenter, 1992]High expressive powerParsing complexity: exponential (to the input length)
Tractable with efficient parsing algorithmsEfficiency can be improved with a well designed grammar
Yi Zhang Grammar Engineering
![Page 25: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/25.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
Mathematical foundation
Typed Feature Structure[Carpenter, 1992]High expressive powerParsing complexity: exponential (to the input length)
Tractable with efficient parsing algorithmsEfficiency can be improved with a well designed grammar
Yi Zhang Grammar Engineering
![Page 26: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/26.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
Implementations
Mismatch exists between theory and realityTrade-off has to be made for various practical reasonsWhat makes a good implementation?
Faithfulness to the linguistic theoryReliability of the software toolchainExtensibility
Yi Zhang Grammar Engineering
![Page 27: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/27.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
DELPH-INDeep Linguistic Processing with HPSG – Initiative
LKB
Grammar
Generator Parser
TDL
[incr tsdb()]
Heart-of-Gold
Matrix
PET
MRSHPSG
ERG JaCY GG
Yi Zhang Grammar Engineering
![Page 28: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/28.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
A glance over existing grammar engineering platforms
TAGXTAG
LFGXLE
HPSGEnju (English)Alpino/HDRUG (Dutch)TRALE
Yi Zhang Grammar Engineering
![Page 29: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/29.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
Outline
1 Grammar engineeringWhat?Why?Who?How?Where? When?
2 HPSG and DELPH-IN
3 Structure of the course
Yi Zhang Grammar Engineering
![Page 30: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/30.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
Things to master
HPSG
MRS
LKB
[incr tsdb()]
Yi Zhang Grammar Engineering
![Page 31: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/31.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
Part I: LKB, TFS and TDL
Hands-on introduction to LKB [Copestake, 2002]Type description language
Yi Zhang Grammar Engineering
![Page 32: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/32.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
Part II: Minimal Recursion Semantics (MRS)
[Copestake et al., 2005]Semantically informed grammar engineeringCompositional semantics
Yi Zhang Grammar Engineering
![Page 33: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/33.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
Part III: Matrix
[Bender et al., 2002]Shared components of a HPSG across different languagesImplemented language phenomena groups as libraries andplug-ins
Yi Zhang Grammar Engineering
![Page 34: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/34.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
Part IV: Implementations of various languagephenomena
SubcategorizationModification and agreementsLong distance dependenciesMore
Yi Zhang Grammar Engineering
![Page 35: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/35.jpg)
Grammar engineeringHPSG and DELPH-IN
Structure of the course
Questions?
Yi Zhang Grammar Engineering
![Page 36: Introduction to Grammar Engineering with HPSG Project ...yzhang/ge-ss08/lecture-01.pdf · Lecture 1: General Introduction Yi Zhang Department of Computational Linguistics & Phonetics](https://reader035.fdocuments.in/reader035/viewer/2022071218/60515a43783d1209ce23a436/html5/thumbnails/36.jpg)
References
References I
Bender, E., Flickinger, D., and Oepen, S. (2002).The Grammar Matrix: an open-source starter-kit for the rapid development of cross-linguistically consistentbroad-coverage precision grammars.In Proceedings of the Workshop on Grammar Engineering and Evaluation at the 19th InternationalConference on Computational Linguistics, pages 8–14, Taipei, Taiwan.
Carpenter, B. (1992).The Logic of Typed Feature Structures.Cambridge University Press, Cambridge, UK.
Copestake, A. (2002).Implementing Typed Feature Structure Grammars.CSLI, Stanford, USA.
Copestake, A., Flickinger, D., Pollard, C. J., and Sag, I. A. (2005).Minimal recursion semantics: an introduction.Research on Language and Computation, 3(4):281–332.
Yi Zhang Grammar Engineering