5 research outputs found
English Morphological Analysis with Machine-learned Rules
PACLIC 20 / Wuhan, China / 1-3 November, 200
Szösszenet az elveszett morfémákért : az alaki analógiák haszna
A jelenlegi morfolĂłgiai elemzĹ‘k gyakorlati okok miatt elĂ©g pragmatikus mĂłdon kĂ©szĂĽltek. A cĂ©ljuk, aránylag kis munkával fedjĂ©k le a magyar nyelvű szövegeinek szĂłalakjait minĂ©l kevesebb hibával. Ha a cĂ©lt elĂ©rtĂ©k, a szabályszerű eseteket jĂłl leĂrták, a deviáns, kisebb gyakorisággal elĹ‘fordulĂł eseteket kivĂ©telkĂ©nt, egyedileg kezelik. A vizsgálataim szerint sokkal kevesebb kivĂ©tel van. A szavak vĂ©gzĹ‘dĂ©se szerinti csoportosĂtással felderĂthetĹ‘k azok a szavak közötti összefĂĽggĂ©sek, melyek a korábbi adatbázisokbĂłl hiányoznak. A mĂłdszer segĂtsĂ©gĂ©vel elfeledett vagy csak leĂrĂł nyelvĂ©szek által emlĂtett szĂłgyökök, toldalĂ©kok kerĂĽlnek napvilágra. SĹ‘t a feltárás eredmĂ©nyekĂ©nt pontosĂthatĂłak a praktikus cĂ©lra kĂ©szĂĽlt nyelvĂ©szeti, nyelvi tárak. The current morphological analyzers have been designed pragmatically for practical purposes. Their goal is to cover the word forms in Hungarian texts with relatively little effort and with as few mistakes as possible. Once the goal has been achieved, regular case affixes, marks, and verbal conjugation endings are well described in a formal way, but most derivative affixes and rare case suffixes are treated individually as exceptions. In my research, I found that there are far fewer exceptional word forms in Hungarian. By clustering word forms by their endings, new relationships, new roots, new morphemes can be discovered that are missing from earlier databases. By clustering word forms by their endings, new relationships among roots, morphemes can be discovered that are missing from earlier databases. One can simplify morphological descriptions without limiting their power. Even a complete morphological description of an unknown language can be generated based on a large corpus solely. Moreover, if not only similarities of endings, but clusters of ending patterns are used to group word forms, then many hidden word roots and suffixes can be discovered that have been forgotten altogether, or mentioned only by descriptive linguists. As a result of the method, semantic dependences might be discovered, and linguistic collections, databases made for practical purposes can be corrected, improved as well