Building and verifying parallel corpora between Arabic and English
- Publication date
- Publisher
Abstract
Arabic and English are acknowledged as two major natural languages used by
many countries and regions. Reviews of previous literature conclude that machine
translation (MT) between these languages is disappointing and unsatisfactory due
to its poor quality.
This research aims to improve the translation quality of MT between Arabic and
English by developing higher quality parallel corpora. The thesis developed a
higher quality parallel test corpus, based on corpora from Al Hayat articles and
the OPUS open-source online corpora database.
A new Prediction by Partial Matching (PPM)-based metric for sentence alignment
has been applied to verify quality in translation between the sentence pairs
in the test corpus. This metric combines two techniques; the traditional approach
is based on sentence length and the other is based on compression code length.
A higher quality parallel corpus has been constructed from the existing resources.
Obtaining sentences and words from two online sources, Al Hayat and OPUS, the
new corpus offers 27,775,663 words in Arabic and 30,808,480 in English. Experimental
results on sample data indicate that the PPM-based and sentence length
technique for sentence alignment on this corpus improves accuracy of alignment
compared to sentence length alone