Prague Dependency Treebank 1.0

CD-ROM PRESENTATIONDec 18, 2000

Functional Generative Description

Prague Dependency Treebank

Functional Generative Description

theoretical framework based on the findings of European structural linguistics, esp. of the classical Prague School

methodological requirements of a formal description levels:

tectogrammatical (underlying) representations (TRs) with dependency based syntax

morphemics phonemics and phonetics

TRs (see Sgall, Hajičová and Panevová 1986, formally specified by Petkevič, also in a declarative way)

Dependency tree

My younger brother arrived there yesterday.

Linearized form, one-to-one relation:((I)Appurt (younger)Rstr brother)Act arrive.Pret.Indic (Dir there) (Temp yesterday)

Dependency Tree labels - lexical meanings (abstract symbols) with indices

functors subscripts at parentheses oriented towards head

grammatemes - values of morphological categories Tense, Modality, Number, Definiteness, etc.

projectivity valency

arguments (inner participants) and adjuncts (circumstantials or 'free modifications')

obligatory and optional with a given head, deletable or not

Dependency Treeparticipants

(arguments) of verbs Actor/Bearer

(underlying subject) Objective (Patient,

underlying direct object) Addressee

(underlying indirect object)

Effect ('second' object: to choose so. as sth.)

Origin (to make sth. out of sth.)

adjuncts Locative, several

Directional and Temporal modifications

Condition, Means, Manner, etc.

Dependency Tree

inner participants Material (Partitive)

two baskets of sth. Identity

the river Danube; the notion of operator

free modifications Possession

(Appurtenance) my table; Jim's brother

Restrictive rich man

Descriptive the Swedes, who are a Scandinavian nation

Complementations dependent mainly on nouns

Dependency Tree

syntactic grammatemes Loc, Dir - in, on, under, between... Regard - with, without

operational (testable) criteria for distinguishing

arguments from adjuncts,from each other

deletability (dialogue test)

Simplified valency frames

read V Act Addr Obj

change V Act Obj Orig Eff

give V Act Addr Obj

brother N Appurt

glass N Material

full A Materialobligatory complementations in blue

Topic-focus articulation

contextual boundness main verb CB/NB (T/F) dependents to the left/right

communicative dynamism left-right (mother, sisters,

transitive)

partial ordering underlying word order

left-right

linear ordering

left-to-right order of nodes together with the index T or (prototypically) F indicates the TFA of the sentence (of the TR)

Topic-focus articulation

TFA - one of the basic aspects of underlying structures

yesterday

Complex sentence

a subordinated (dependent) clause (i.e. its main verb) depends on a word contained in its governing clause

My brother, whom you know, arrived there yesterday.

Complex sentence

function words (synsemantic) are viewed as function morphemes, syntactically fixed to certain lexical (autosemantic) words - prepositions and articles to nouns, conjunctions and auxiliaries to verbs

Martin came there late, since he had to accompany his sick mother.

Complex sentence

Martin arrived late to the session, since he had to accompany his sick mother.

schematically (morphemes):

Martin arrive.ed late to the session since he have.ed to accompany he.s sick mother.

dot - close connection of morphemes ('semes')

deleted items restored order of items - difference between 'underlying' and surface

(morphemic) word order transductive components - Panevová, Oliva, Borota

coordination (multidimensional) Jim and Mary, who have two children, went to Boston. the linearized notation is adequate: ((Jim Mary)Conj ((who)Act have (Pat (two)Rstr

children)))Act went (Dir Boston)

structures close to Boolean, i.e. no complex 'innate properties' specific for natural language are needed.

Prague Dependency Treebank - corpus annotation

an intermediate level - 'analytical' representations dependency trees, not always projective nodes for all word tokens, even for

punctuation markstectogrammmatical tree:

coordinating conjunction as the head

Morphological Layer

ACKNOWLEDGEMENTS

ANNOTATED CORPORA

PDT version 1.0, 2000

(1996 - 2000)

Penn Treebank, release 3, 1999

(1989 - 1999)

TAG SETs

Czech - ambiguous inflective language nový, nového, novému, novém, novým, nová, nové, novou, nových, novým, novými, … novější, novejšího, novějšímu, novějším, …., nejnovější, nejnovějšího, nejnovějšímu, nejnovějším….. nejnovějších, nejnovějším, …

English - language with poor inflectionwork, works, worked, working

TEXT SOURCES

Lidové noviny

Mladá Fronta Dnes

Vesmír

Českomoravský

Profit

...taken from Czech

National Corpus

´88, ´89 WSJ articles

Air Travel Information

System transcripts

Brown Corpus

Switchboard transcripts

ANNOTATION STRATEGY - Penn Treebank

Ken Church‘s stochastic tagger,Eric Brill‘s transformation tagger

corrections by annotator (GNU Emacs Lisp based package)

ANNOTATION STRATEGY - PDT

Automatic Morphological Analyzer (AMA)

two independent annotators; Linux, Win tools

differences resolved by third annotator

comparison with the current AMA; manual resolution; Win tools

INTERNAL FORMAT

SGML coding, csts dtd word/tag(|tag)*

<s id=“ln95040:020-p1s1“><f>Pokus<l>pokus<t>NNIS1-----A----<f>o<l>o<t>RR--4----------<f>zázrak<l>zázrak<t>NNIS4-----A----<d>.<l>.<t>Z:-------------

The/DT envelope/NN arrives/VBZ in/IN the/DT mail/NN ./.

SAMPLES

SGML coding

word/tag

word/lemma/tag

CONVERSION

pdt2wsj.pl

pdt2wsjFLT.pl

DATA SIZE

# wordtokens

# sentences

PDT 1.0 1 730K 112K

Penn Treebank

release 3

4 600K 350K

DATA SETs of MORPHOLOGICALLY ANNOTATED

for tagging only #tokens/sentences

training data 1 470K/95K

development test data 130K/8K

evaluation test data 127K/8K

for parsing (preprocessing step)

training data 475K/29K

development test data 130K/8K

evaluation test data 127K/8K

Automatic Morphological Analyser/Generator of Czech HMAnalyze.pl,

HMGenerate.pl Dictionary: CZE_a Remote Acces

Czech Taggers

Exponential

Analytical Layer in PDT

Introduction

Input: morphologically tagged sentences

Graph Editor: “user-friendly” software

Output: ATS structure „surface“ syntax tree structure nodes labelled by the analytical functions

Two stages (chronologically)

(A) manual „analytic“ annotation (ATS) training data for (B)(a)

(B) (a) semiautomatic procedure (Collin‘s

parser) (b) manual correcting of (B)(a)

Constraints and limitations

any string has a node of its own word-form, punctuation mark, etc. AuxV, AuxP, AuxC, AuxX, AuxG…

reflecting the coordination and apposition relations so called third dimension of the graph in the

plain tree (X_Co, X_Ap, X_Pa, where X is one of analytic functions, such as Sb, Obj, Adv, etc.)

Constraints and limitations

no missing nodes (on the surface) can be added analytic funtion Ex_D is used

relations between semi-automatic and manual procedure 80% edges are established correctly

automatically

Project organization

team consisting of 5-6 annotatorshandbook for ATS structure

annotation1999: 100000 sentences on ATStectogrammatical annotation follows

První restituční zákon českého parlamentu se do sněmovních lavic může vrátit jako bumerang.

From the Analyticaltowards

the Tectogrammatical layer

Introduction

ATS annotation nodes:

word formspunctuationgraphical symbols

TGTS annotationautosemantic

wordsdeletions

edges:surface relations

deep layer functions

Input Czech

sentence

Morphological tagging and lexical

disambiguation

TokenizationSyntactic parsing and analytic function

assignment

Tree structure pruning

Attribute assignments TGTS

ATS PDT1.0

Annotation process

Transition procedure

deterministic procedure operating on treesmacro language for Graph Editor (C++ like)automatic changes & tools for annotators

Requirements new attributes for tectogrammatical layer ATS is recoverable from TGTS automatized to a maximally high degree

New attributestrlemma - lemma of the original node or lemma

composed of joined nodes

morphological grammatemes gender, number, degree of comparison, tense,gender, number, degree of comparison, tense, aspect, iterativeness, verbal modality, deontic aspect, iterativeness, verbal modality, deontic

modality, sentence modalitymodality, sentence modality

positionposition of the nodeof the node functor, topic-focus articulation, syntactic functor, topic-focus articulation, syntactic

grammateme,grammateme, type of relation (dependency, coordination, apposition), type of relation (dependency, coordination, apposition), phraseme, deletion, quoted word, direct speech, phraseme, deletion, quoted word, direct speech, coreference, antecedentcoreference, antecedent

Tree Structure Pruning

U toho, kdo začíná opravdu od nuly, není daňový výnos pro stát podstatný.

For those, who start actually at zero, the tax outcome for the state is not substantial.

Tree Structure Pruning U toho, kdo začíná opravdu od nuly, není daňový

výnos pro stát podstatný. For those, who start actually at zero, the tax outcome

for the state is not substantial.

Verbal Nodes

•… enterpreneurs should have (their) taxes …

•… podnikatelé by měli mít daně …

verbmod=CDNdeontmod=HRT

Attribute Assignments

prepositions stored as fw attributequoted words

clause in quotes -> DSP one pair of quotes in the sentence -> DSPP string in quotes -> QUOT

gender, number, tense, degcmp, aspectdefault values

Macros for Annotators

keyboard shortcuts (in Graph editor) structure changes

hide/recover nodesmerge nodes

add new nodes functor assignments

Manual annotation

structure checkingfunctorsdeletions of obligatory modifications

feedback for formulating the handbook for annotators

Tectogrammatical Layer

Jirka se včera opil do němoty a Honza dneska. George himself yesterday drank to silence and Honza today.

Attributes of Coreferrential relations

only in MC attribute valuescoref the lemma of the antecedentcorsnt NIL - in the same sentence

PREV1 ... PREVi - position of the sentence which includes the antecedent

grammatical coreferenceantec the functor of the antecedent

Example

Honza slíbil přijít včas.Honza promised to come in time.

coref: Honzacorsnt: NILcornum: 1antec: ACT

Prague Dependency Treebank 1.0

Documents

Transcript of Prague Dependency Treebank 1.0

1 Dependency structure and cognition Richard Hudson Depling2013, Prague.

Prague Dependency Treebank(s) Workshop at LSA2011, Part I

Detecting Grammatical Errors in Machine Translation Output ... · detecting grammatical errors in Dutch machine-translated text, using dependency parsing and treebank querying. We

Using a Chinese treebank to measure dependency distancedickhudson.com/wp-content/uploads/2013/07/dd.pdf · Using a Chinese treebank to measure dependency distance HAITAO LIU, RICHARD

Prague Dependency Treebank : Morphological Annotation

Intra-Chunk Dependency Annotation : Expanding Hindi Inter-Chunk Annotated Treebank

Prague Dependency Treebank - ÚFALufal.mff.cuni.cz/~lopatkova/2017/docs/1-intro-trees-cor.pdf · Prague Dependency Treebank: ... Outline of the lecture ... constructions like topicalization,

Valency in the Prague Dependency Treebank: …ufal.mff.cuni.cz/DEV/pbml/79-80/lopatkova.pdfValency in the Prague Dependency Treebank: Building the Valency Lexicon1 Markéta Lopatková

Hindi Dependency Parsing and Treebank Validationweb2py.iiit.ac.in/research_centres/publications/download/masters... · Thanks to Phani Gadde, Meher, Pujitha, GSK, Aswarth and other

Valency in the Prague Dependency Treebank: Building …ufal.mff.cuni.cz/publications/year2003/lopatkova_pbml-valence.pdf · The win caused the tree to sway. Communication ... For

Manual for Morphological AnnotationManual for Morphological Annotation Revision for the Prague Dependency Treebank 2.0 ÚFAL Technical Report No. 2005-27 Jií Hana Daniel Zeman Jan

Complex Corpus Annotation: The Prague Dependency Treebank · The Prague Dependency Treebank (Haji č et al., 2001) is approaching the publication of its second version in which the

Intra-Chunk Dependency Annotation : Expanding Hindi Inter-Chunk Annotated Treebank Prudhvi Kosaraju, Bharat Ram Ambati, Samar Husain Dipti Misra Sharma,

Prague Dependency Treebank(s) Workshop at LSA2011, Part II Jan Hajič, Zdeňka Urešová Institute of Formal and Applied Linguistics School of Computer Science.

The Prague Dependency Treebank and Valency Annotation

Prague Dependency Treebank: Annotation of Surface Syntax (Part II.)

Prague Dependency Treebank: Introduction

Issue s of Valency in Prague Dependency Treebank: C reating Valency Lexicon of Verbs

Http://ufal.mff.cuni.cz/pdt2.0 PDT 2.0 Prague Dependency Treebank 2.0 Zdeněk Žabokrtský Dept. of Formal and Applied Linguistics Charles University, Prague.

Systematic Parameterized Description of Pro-forms in the Prague Dependency Treebank 2.0