Location of Repository

Comparative evaluation of Arabic language morphological analysers and stemmers

By M. Sawalha and E.S. Atwell

Abstract

Arabic morphological analysers and stemming algorithms have become a popular area of research. Many computational linguists have designed and developed algorithms to solve the problem of morphology and stemming. Each researcher proposed his own gold standard, testing methodology and accuracy measurements to test and compute the accuracy of his algorithm. Therefore, we cannot make comparisons between these algorithms. In this paper we have accomplished two tasks. First, we proposed four different fair and precise accuracy measurements and two 1000-word gold standards taken from the Holy Qur’an and from the Corpus of Contemporary Arabic. Second, we combined the results from the morphological analysers and stemming algorithms by voting after running them on the sample documents. The evaluation of the algorithms shows that Arabic morphology is still a challenge

Publisher: Coling 2008 Organizing Committee
Year: 2008
OAI identifier: oai:eprints.whiterose.ac.uk:42635

Suggested articles

Preview


To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.