Skip to main content
Article thumbnail
Location of Repository

A corpus based approach to generalise a chatbot system

By Bayan Aref Abu Shawar


Chatbot tools are computer programs which interact with users using natural languages. Most developers built their systems aiming to fool users that they are talking with real humans. Up to now most chatbots serve as a tool to amuse users through chatting with a robot. However, the knowledge bases of almost all chatbots are edited manually which restricts users to specific languages and domains.\ud \ud This thesis shows that chatbot technology could be used in many different ways in addition to being a tool for fun. A chatbot could be used as a tool to learn or study a new language, a tool to access an information system, a tool to visualise the contents of a corpus and a tool to give answers to questions in a specific domain. Instead of being restricted to a specific domain or written language, a chatbot could be trained with any text in any language. Some of the differences between real human conversations and human-chatbot dialogues are presented.\ud \ud A Java program has been developed to read a text from a machine readaatbble text (corpus) and convert it to ALICE chatbot format language (AIML). The program was built to be general, the generality in this respect implies no restrictions on specific language, domain or structure. Different languages were tested: English, Arabic, Afrikaans, French and Spanish. At the same time different corpora structures were used: dialogue, monologue and structured text

Publisher: School of Computing (Leeds)
Year: 2005
OAI identifier:

Suggested articles


  1. (2004). A Multilingual Parallel Parsed Corpus as Gold Standard for Grammatical Inference Evaluation.
  2. (1993). Automatic Content Analysis of Spoken Discourse: a report on work in progress.
  3. (1999). Data Mining: Practical Machine Learning tools and Techniques with Java Implementations.
  4. (2000). Information extraction by text classification: corpus mining for features.
  5. (2000). Natural language dialogue for personalized interaction.
  6. (2001). Passing Loebner’s Turing test: a case of conflicting discourse functions.
  7. (1972). Understanding Natural Language.

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.