Kornai, András

Rebrus, Péter

Vajda, Péter

Repository of the Academy's Library

The annotation system of HunMorphREBRUS PÉTER, KORNAI ANDRÁS, VAJDA PÉTER 11 IntroductionThe annotation system for Hungarian morphology was designed to satisfy at least three, sometimescontradictory, conditions. The annotation has to be– informative: it has to reflect the morphological information of a given word-form,– adequate: it should use linguistically adequate categories, and– simple: easily processable by machines and humans as well.These conditions are difficult to fulfill simultaneously. Being simple is opposed to both beingadequate and informative, on the other hand the conditions mostly depend on the users’ aim, whetherthey use the annotation system for spell-checking, stemming, syntactic analysis or statistical research.2 Representing inflectional information as treesThe morphological description of a word has to include every inflectional feature of a given word-form. Most inflectional features play a role in syntactic analysis. Such morphosyntactic features areusually represented in an attribute-value-structure (AVS) [3]. An AVS is independent of both the thesurface form of the word and the formal features of the morphosyntactic properties.In attempting to align the above conditions we chose not to make a decision in the question ofmorphological segmentation. Whether we treat a morph as a whole or segment it into as many parts asthe number of the morphemes it represents is a question of the chosen morphological framework. E.g.the morph ’-jaim’, though corresponds to more than one morphological property (1st person, singularpossessor and plural possessed), these properties cannot be unambiguously associated with separateparts of the morph. Therefore, our annotation system does not employ the notion of segmentation inthe case of suffixes. This way the annotation could be both theory neutral and modular, furthermore,it remains independent of the surface form of the word.The morphological features of a word-form have two important properties with regard to theannotation system. The features are– hierarchical, i.e. certain features require the presence of other features,– asymmetrical, i.e. certain values of a feature are considered marked, while others unmarked.1Documentation of LDC LCTL project291292 MOKK 2002-2006These properties are best expressed by labelled trees. The roots of the trees represent the equiva-lence classes of lexical entries with regard to inflection (these correspond to part-of-speech categories)and the vertices are the inflectional features. The vertices in the graph define a path with the positivevalues of the features. This means that the graph is capable of encoding a binary attribute-value-structure where a vertex can have a daughter only if it has positive value [2]2. The labelled treesatisfies all three conditions. It is– informative, as it represents morphological information in an AVS,– adequate, as it captures morphological markedness and the hierarchical nature of inflectionalinformation, and– simple, as it can be automatically transformed into an AVS, furthermore, it can easily be lin-earized.3 POS categories of HunMorphThe valid POS categories ar listed in Table 1. Inflectable categories are: ADJ, NOUN, NUM andVERB. The following categories cannot be inflected: ADV, DET, ART, UTT-INT, CONJ, PREV,ONO, PUNCT and PREP. For postpositions see Section 7.2.Tag POS categoryADJ adjectiveADV adverbART articleCONJ conjunctionDET determinerNOUN nounNUM numeralONO onomatopoeicPOSTP postpositionPREP prepositionPREV preverbPUNCT punctuationUTT-INT utterance/interjectionVERB verbTable 1: POS categories of HunMorph4 Encoding inflectional information of nouns and nominal cate-goriesAn actual feature set was designed following the above considerations for the morphological analysisof Hungarian.2This is a special interpretation of markedness.THE ANNOTATION SYSTEM OF HUNMORPH 293NOUNPLURFAMPOSS1 2 PLURANPPLURCASACC DAT INS ...Figure 1: The signature of the graphs originating from the root node NOUNIn the case of a noun four binary features have to be specified. They are ±PLUR (number),±POSS (possessor), ±ANP (possessed) and ±CASE3. All of these can be continued as specified inFigure 1. and in Table 4. Adjectives and numerals can take the same set of inflections as nouns.The following restrictions apply to the combination of the features:– the ±CASE feature has to be continued by one of 16 cases,– the ±PLUR, ±POSS and ±ANP features can be contitued or can appear on their own,– the features ±1 and ±2 exclude each other,– if the ±PLUR feature of ±POSS is positive, then the ±FAM feature cannot be positive,– if the ±PLUR and the ±POSS feature are positive simultaneously, then the ±FAM featurecannot be positive.The morphosyntactic annotation of an inflected word-form is represented by a sub-tree of theabove tree. The paths originate from the root and they encode the positive values of the attribute-valuematrix. The negative values of the signature are not present in the tree. The tree is thus equivalentto an AVS encoding the inflectional properties of a word-form, however, it is free of redundancy andcan be easily linearized by bracketing the nodes of the tree.We present some examples with their full inflectional specification as an AVS and the linearizationof their (sub)tree as it appears in the analysis where the outermost brackets and the + signs are omittedand the POS category is preceded by a slash and the lemma of the word-form.kutya ’dog’<NOUN<-PLUR><-POSS><-ANP><-CAS>>kutya/NOUNkutyának ’for/to the dog’<NOUN<-PLUR><-POSS><-ANP><+CAS<+DAT>>>kutya/NOUN<CAS<DAT>>kutyáink ’our dogs’<NOUN<+PLUR<-FAM>><+POSS<+1><-2><+PLUR>><-ANP><-CAS>>kutya/NOUN<PLUR><POSS<1><PLUR>>kutyáéi ’those things of the dog’<NOUN<-PLUR><-POSS><+ANP<+PLUR>><-CAS>>kutya/NOUN<ANP<PLUR>>3There are two more morphosyntactic features that are in fact part of this tree. These are±PERS and±POSTP, whichare discussed in sections 7.1 and 7.2 respectively.294 MOKK 2002-2006kutyáikéit ’those things of their dogs.ACC’<NOUN<+PLUR<-FAM>><+POSS<-1><-2><+PLUR>><+ANP<+PLUR>><+CAS<+ACC>>>kutya/NOUN<PLUR><POSS<PLUR>><ANP<PLUR>><CAS<ACC>>5 Encoding inflectional information for verbsA maximal verbal word-form has to have several properties specified. The properties are specified inFigure 2.4 and in Table 5. The following restrictions apply to the combination of the features:– only one of ±SUBJUNC and ±COND can be positive simultaneously,– the feature ±PAST can only be positive if both ±SUBJUNC and ±COND are negative,– if the feature ±OBJ is positive than its daughter feature has to positive as well,– the feature ±INF can only combine with the feature ±PERSON ±PLUR and ±MODAL.VERBMODAL SUBJUNC COND PAST INFVERBPLUR PERS1OBJ22DEFFigure 2: The signature of the graphs originating from the root node VERBThe annotation of verbs with inflectional suffixes is similar to that of nouns. Examples are:lát ’he sees’<VERB<-INF><-MODAL><-PAST><-COND><-SUBJ-IMP><-PERS><-PLUR><-DEF>>lát/VERBláttál ’you saw’<VERB<-INF><-MODAL><+PAST><-COND><-SUBJ-IMP><+PERS<+2>><-PLUR><-DEF>>lát/VERB<PAST><PERS<2>>láthassátok ’that you may see it’<VERB<-INF><+MODAL><-PAST><-COND><+SUBJ-IMP><+PERS<+2>><+PLUR><+DEF>>lát/VERB<MODAL><SUBJUNC><PERS<2>><PLUR><DEF>4The tree has been cut into two parts for reasons of clarity.THE ANNOTATION SYSTEM OF HUNMORPH 2956 Derivation and compunding6.1 Representing derivational informationThe above tree structure is not directly suited to decribe derivation. However, a derivational suffixcan be treated as a relation between two lexical entries. This way we can extend the tree structureby representing derivation as a directed edge between nodes of inflectional categories (roots of trees).Derivation can change or leave intact the POS category of a word. The POS category of the resultingword is the output category of the last derivational suffix, and the derivated word can undergo furtherinflectional suffixing. Inflected forms, however, cannot be subjected to derivation. Consider thefollowing examples:fax fax/NOUN ’fax’faxol fax/NOUN[ACT]/VERB ’to send a fax’faxolás fax/NOUN[ACT]VERB[GERUND]/NOUN ’faxing’6.2 Annotation of compoundsCompounding is encoded in the annotation by use of a + sign. A preverb followed by a verb is treatedas a compound in this respect, as well as a NOUN+NOUN or an ADJ+NOUN compound. Com-pounding is similar to derivation in that only the last part of the word can be subjected to inflectionalsuffixing and that the output category of the compound is determined by the last component. E.g.:rákkoktél ’shrimp coctail’rák/NOUN+koktél/NOUNkeresztüllövi ’he shoots it through’keresztül/PREV+lo˝/VERB<DEF>7 Pronouns and postpositions7.1 PronounsIn Hungarian a pronoun can substitute for any noun, adjective or numeral, as well as for adverbs.The inflection of pronouns, where applicable, conforms to the restrictions imposed by the inflectionalfeatures and the tree-structure discussed above. This enables us to avoid the use of ’pronoun’ as aPOS category, and use instead the category which the pronouns stand for.Personal pronouns are nouns, but they are subject to the following restrictions: their POSS featuremust be negative and their PERS feature has to be specified. Otherwise, the PERS feature can combinewith any other features (PLUR, ANP, CAS). E.g.:ti ’you.PL’ti/NOUN<PERS<2>><PLUR>titeket ’you.PL.ACC’ti/NOUN<PERS<2>><PLUR><CAS<ACC>>Possessive pronouns are personal pronouns with a possessed feature, thus they carry the ANPfeature as well. Examples include:296 MOKK 2002-2006tiétek ’yours’ti/NOUN<PERS<2>><PLUR><ANP>tieteknek ’to/for yours’ti/NOUN<PERS<2>><PLUR><ANP><CAS<DAT>>The anaphoric possessive can be repeated as shown in the next example:enyémé ’that of my something’én/NOUN<PERS<1>><ANP<ANP>>The above properties are shared by other pronouns including demonstrative, reflexive, relative, in-terrogative pronouns. The inflection of adjectival and numeral pronouns resemble to that of adjectivesand numerals respectively, i.e. they are tagged as ADJ and NUM and take the usual inflections.7.2 PostpositionsThe function of postpositions is the same as that of case-suffixes, although some differences have tobe noted. One major difference is that postpositions are separate words and, as such, have their ownannotation. Furthermore, a number of postpositions can take the PERS feature and as their syntacticdistribution (function) is the same as that of personal pronouns, these inflected postpositons will beannotated as nouns. In this case the POSTP feature of the tree also takes the positive value and thename of the relevant postposition has to be specified in the annotation as well6:mellettetek ’next to you.PL’ti/NOUN<POSTP<MELLETT>><PERS<2>><PLUR>If the POSTP feature is positive, theCAS, ANP and FAM features have to be negative. Uninflectedpostpositions have the characteristics of a main POS category in that they can, for example, undergoderivation. Examples are:mellett ’next to’mellett/POSTPmellettetek next to you.PLti/NOUN<POSTP<MELLETT>><PERS<2>><PLUR>mellettiekben ’in those that are next to’mellett/POSTP[ATTRIB]/ADJ<PLUR><CAS<INE>>8 Derivational morphemesThe full list of derivational morphemes can be seen in Table 5. The output tag is followed by an(approximate) English name of the suffix and an allomorph. The input and output categories of thesuffix are also indicated.6The full list of tags that can be dominated by a POSTP tag can be seen in Table 7.2.THE ANNOTATION SYSTEM OF HUNMORPH 2979 Comparison with other systemsThe annotation system described in this document is independent of the implementation and thetechnical details of the morphological analysis. As such it is especially suitable to act as a commonground when comparing different formalisms.While designng our system we examined the MSD coding system[1], which is positional, i.e. ithas fixed positions for each morphosyntactic property and these positions can be either filled in or leftempty. An MSD code is not suited to describe derivations, it deals only with inflectional suffixing.The mapping between the two systems is ambiguous, but we designed our annotation system in a waythat it should contain at least as much information as the MSD system.Bibliography[1] T. Erjavec and M. Monachini. Specifications and notation for lexicon encoding. Technical report,Copernicus Project 106 MULTEXT-East, December 1997.[2] András Kornai. A fo˝névi csoport egyeztetése. In Telegdi and Kiefer, editors, Általános NyelvészetiTanulmányok, XVII. Akadémiai Kiadó, Budapest, 1989.[3] Viktor Trón. Attribútum-érték struktúrák. In László Kálmán, Viktor Trón, and Károly Varasdi,editors, Lexikalista elméletek a nyelvészetben. Tinta Könyvkiadó, Budapest, 2002.298 MOKK 2002-2006number: singular (sógor) <-PLUR>plural„simple" (sógor-ok) <+PLUR<-FAM>>familiáris birtokos (sógor-ék) <+PLUR<+FAM>>possessor: none <-POSS>overt possessorperson:1st (sógor-om) <+POSS<+1><-2>>2nd (sógor-od) <+POSS<-1><+2>>3rd (sógor-a) <+POSS<-1><-2>>number:singular (sógor-ai) <+POSS<-PLUR>>plural (sógor-uk) <+POSS<+PLUR>>possessed: none <-ANP>overt possessed numbersingular (sógor-é) <+ANP<-PLUR>>plural (sógor-éi) <+ANP<+PLUR>>case: „none” NOM ( sógor) <-CAS>overt, one of 16 cases: ACC ( sógort) <+CAS<+ACC>>DAT (sógor-nak) <+CAS<+DAT>>INS (sógor-ral) <+CAS<+INS>>CAU (sógor-ért) <+CAS<+CAU>>TRA (sógor-rá) <+CAS<+TRA>>SUE (sógor-on) <+CAS<+SUE>>SBL (sógor-ra) <+CAS<+SBL>>DEL (sógor-ról) <+CAS<+DEL>>INE (sógor-ban) <+CAS<+INE>>ELA (sógor-ból) <+CAS<+EAL>>ILL (sógor-ba) <+CAS<+ILL>>ADE (sógor-nál) <+CAS<+ADE>>ALL (sógor-hoz) <+CAS<+ALL>>ABL (sógor-tól) <+CAS<+ABL>>TER (sógor-ig) <+CAS<+TER>>FOR (sógor-ként) <+CAS<+FOR>>Table 2: Inflectional features of nounsTHE ANNOTATION SYSTEM OF HUNMORPH 299modality: none < -MODAL>modal (futhat) < +MODAL>mood: conjunctive <-SUBJUNC><-COND>subjunctive/imperative(no tense) < +SUBJUNC>conditional <+COND>tense: present <-PAST><-FUT>past 5 <+PAST>future(only for the copula ’van’) <+FUT>number/person: subject person1st (futok) <+PERS<+1><-2>>1st (várlak)with 2nd person object <+PERS<+1<+OBJ<+2><-2>>2nd (futsz) <+PERS<-1><+2>>3rd (fut) <+PERS<-1><-2>>subject numbersingular (fut) <-PLUR>plural (futnak) <+PLUR>definiteness indefinite ( lát) <-DEF>definite ( látja) <+DEF>Table 3: Inflectional features of verbs300 MOKK 2002-2006ALÁ (to) under XALATT under XALÓL from under XÁLTAL by X, by way of XELÉ before X, in front of XELÉB before X, in front of X (archaic)ELLEN against XELLEN contrary to XELO˝L from (in front of) XELO˝TT before X, in front of XFELÉ towards XFELETT above X, over XFELO˝L from (the direction of) X, as for XFELÜL from (above/over) XFÖLÉ above X, over XFÖLIBE above X, over X (archaic)FÖLÖTT above X, over XFÖLÜL from (above/over) XHELYETT instead of XIRÁNT person marking with infixingKÖRÉ (to) around XKÖRÖTT around XKÖRÜL around XKÖRÜLÖTT around XKÖZÉ to (between many, among many) XKÖZIBÉ to (between many, among many) (archaic)KÖZÖTT between X, among XKÖZT between X, among XKÖZÜL out of X, from among XLÉT these can have inflected demostrative formsMELLÉ to somewhere near XMELLETT beside X, by X, (somewhere) near XMELLO˝L from somewhere near XMIATT because of XMÖGÉ (to) behind XMÖGÖTT behind XMÖGÜL from (behind) XNÉLKÜL without XRÉSZ as concerns XRÉSZ for XSZÁM for X (recipient)SZERINT according to XUTÁN after XTable 4: List of features that can combine with the feature PERSTHE ANNOTATION SYSTEM OF HUNMORPH 301Table 5: Derivational morphemesTag explanation example POSFREQ frequentative gat VERB→ VERBMEDIAL medial ódik VERB→ VERBCAUS causative tat VERB→ VERBPART adverbial participle va VERB→ ADVPERF_PART perfect adverbial participle ván VERB→ ADVIMPERF_PART imperfect adjectival participle ó VERB→ ADJFUT_PART future adjectival participle andó VERB→ ADJPERF_PART perfect adjectival participle ott VERB→ ADJNEG_PERF_PART negative perfect adjectival participle atlan VERB→ ADJGERUND gerund ás VERB→ NOUNNEG_MODAL_PART negative modal adjectival participle hatatlan VERB→ ADJMODAL_PART modal adjectival participle ható VERB→ ADJREG_ACT regular activity kodik NOUN→ VERBABSTRACT abstract ság NOUN→ NOUNMRS mrs né NOUN→ NOUNDIMIN diminutive ka NOUN→ NOUNATTRIB attributive s NOUN→ ADJMET_ATTRIB metonymical attributive i NOUN→ ADJINAL_ATTRIB inalienable attributive jú NOUN→ ADJNEG_ATTRIB negative attributive talan NOUN→ ADJTYPE1 type1 szeru NOUN→ ADJTYPE2 type2 féle NOUN→ ADJTYPE3 type3 nemu NOUN→ ADJTYPE_RANK type rank rangú NOUN→ ADJNEG_ATTRIB2 negative attributive2 mentes NOUN→ ADJTYPE4 type4 fajta NOUN→ ADJLOC_INE locative inessive beli NOUN→ ADJQUANTITY quantity nyi NOUN→ NUMESS_FOR essivus formalis képpen NOUN→ ADVCOM comitative stul NOUN→ ADVPERIOD1 period1 anként NOUN→ ADVPERIOD2 period2 onta NOUN→ ADVACT activity oz NOUN→ VERBACT2 activity2 ol NOUN→ VERBCOMPAR comparative bb ADJ→ ADJSUPERLAT superlative leg-bb ADJ→ ADJSUPERSUPERLAT supersuperlative legesleg-bb ADJ→ ADJCOMPAR_DESIGN comparative designative bbik ADJ→ ADJSUPERLAT_DESIGN superlative designative leg-bbik ADJ→ ADJSUPERSUPERLAT_DESIGN supersuperlative designative legesleg-bbik ADJ→ ADJMANNER manner lag ADJ→ ADVMANNER manner an ADJ→ ADVINTRANS_RESULT intransitive resultative odik/ul ADJ→ VERBTRANS_RESULT transitive resultative ít ADJ→ VERBMULTIPL-ITER multiplicative iterative szor NUM→ ADVMULTIPL-ITER multiplicative iterative szoroz NUM→ VERBITER_ATTRIB iterative attributive szori NUM→ ADJMULTIPL_ATTRIB multiplicative attributive szoros NUM→ ADJMULTIPL multiplicative szorta NUM→ ADVAGGREG aggregative an NUM→ ADVFRACT fractional ad NUM→ NUMORD ordinal odik NUM→ NUMDATE date odika NUM→ NOUNATTRIB attributive i POSTP→ ADJ

The Annotation system of HunMorph

Abstract

Similar works

Full text

Available Versions

Repository of the Academy's Library