Using dialogue corpora to extend information extraction patterns for natural language understanding of dialogue

This work was funded by the Companions project (www.companions-project.org) sponsored by the European Commission as part of the Information Society Technologies (IST) programme under EC grant number IST-FP6-034434.This paper examines how Natural Language Process (NLP) resources and online dialogue corpora can be used to extend coverage of Information Extraction (IE) templates in a Spoken Dialogue system. IE templates are used as part of a Natural Language Understanding module for identifying meaning in a user utterance. The use of NLP tools in Dialogue systems is a difficult task given spoken dialogue is often not well-formed and 2) there is a serious lack of dialogue data. In spite of that, we have devised a method for extending IE patterns using standard NLP tools and available dialogue corpora found on the web. In this paper, we explain our method which includes using a set of NLP modules developed using GATE (a General Architecture for Text Engineering), as well as a general purpose editing tool that we built to facilitate the IE rule creation process. Lastly, we present directions for future work in this area.peer-reviewe

Dialogue-Based Relation Extraction

We present the first human-annotated dialogue-based relation extraction (RE) dataset DialogRE, aiming to support the prediction of relation(s) between two arguments that appear in a dialogue. We further offer DialogRE as a platform for studying cross-sentence RE as most facts span multiple sentences. We argue that speaker-related information plays a critical role in the proposed task, based on an analysis of similarities and differences between dialogue-based and traditional RE tasks. Considering the timeliness of communication in a dialogue, we design a new metric to evaluate the performance of RE methods in a conversational setting and investigate the performance of several representative RE methods on DialogRE. Experimental results demonstrate that a speaker-aware extension on the best-performing model leads to gains in both the standard and conversational evaluation settings. DialogRE is available at https://dataset.org/dialogre/.Comment: To appear in ACL 202

Arabic conversational agent for modern Islamic education

This thesis presents research that combines the benefits of intelligent tutoring systems (ITS), Arabic conversational agents (CA) and learning theories by constructing a novel Arabic conversational intelligent tutoring system (CITS) called Abdullah. Abdullah CITS is a software program intended to deliver a tutorial to students aged between 10 and 12 years old, that covers the essential topics in Islam using natural language. The CITS aims to mimic a human Arabic tutor by engaging the students in dialogue using Modern standard Arabic language (MSA), whilst also allowing conversation and discussion in classical Arabic language (CAL). Developing a CITS for the Arabic language faces many challenges due to the complexity of the morphological system, non-standardization of the written text, ambiguity, and lack of resources. However, the main challenge for the developed Arabic CITS is how the user utterances are recognized and responded to by the CA, as well as how the domain is scripted and maintained. This research presents a novel Arabic CA and accompanying a scripting language that use a form of pattern matching, to handle users’ conversations when the user converse in MSA. A short text similarity measure is used within Abdullah CITS to extract the responses from CAL resources such as the Quran, Hadith, and Tafsir if there are no matching patterns with the Arabic conversation agent’s scripts. Abdullah CITS is able to capture the user’s level of knowledge and adapt the tutoring session and tutoring style to suit that particular learner’s level of knowledge. This is achieved through the inclusion of several learning theories and methods such as Gagne’s learning theory, Piaget learning theory, and storytelling method. These learning theories and methods implemented within Abdullah’s CITS architecture, are applied to personalise a tutorial to an individual learner. This research presents the first Arabic CITS, which utilises established learning typically employed in a classroom environment. The system was evaluated through end user testing with the target age group in schools both in Jordan and in the UK. Empirical experimentation has produced some positive results, indicating that Abdullah CITS is gauging the individual learner’s knowledge level and adapting the tutoring session to ensure learning gain is achieved