Skip to main content
Article thumbnail
Location of Repository

Evaluating algorithms for the generation of referring expressions using a balanced corpus

By Ielka Van Der Sluis, Albert Gatt and Kees Van Deemter

Abstract

We describe a corpus-based evaluation methodology, applied to a number of classic algorithms in the generation of referring expressions. Following up on earlier work involving very simple domains, this paper deals with the issues associated with domains that contain ‘real-life ’ objects of some complexity. Results indicate that state of the art algorithms perform very differently when applied to a complex domain. Moreover, if a version of the Incremental Algorithm is used then it becomes of huge importance to select a good preference order. These results should contribute to a growing debate on the evaluation of nlg systems, arguing in favour of carefully constructed balanced and semantically transparent corpora

Topics: algorithms, Natural Language Generation
Year: 2007
OAI identifier: oai:CiteSeerX.psu:10.1.1.135.3331
Provided by: CiteSeerX
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://citeseerx.ist.psu.edu/v... (external link)
  • http://www.csd.abdn.ac.uk/~aga... (external link)
  • Suggested articles


    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.