Statistical Augmentation of a Chinese Machine-Readable Dictionary

We describe a method of using statistically-collected Chinese character groups from a corpus to augment a Chinese dictionary. The method is particularly useful for extracting domain-specific and regional words not readily available in machine-readable dictionaries. Output was evaluated both using human evaluators and against a previously available dictionary. We also evaluated performance improvement in automatic Chinese tokenization. Results show that our method outputs legitimate words, acronymic constructions, idioms, names and titles, as well as technical compounds, many of which were lacking from the original dictionary.Comment: 17 pages, uuencoded compressed PostScrip

A Transliteration of CRF based Manipuri POS Tagging

AbstractTransliteration is common to all those language which have multiple scripts. Manipuri, which is one of the Schedule Indian Languages, is one of them. This language has two scripts: a borrowed Bengali Script and the original Meitei Mayek (Script). Part of Speech (POS) tagging of the Bengali Script Manipuri text is performed using Conditional Random Field (CRF) which is then followed by the transliteration to Meitei Mayek