The Impact of Interpretation Problems on Tutorial Dialogue

Supporting natural language input may improve learning in intelligent tutoring systems. However, interpretation errors are unavoidable and require an effective recovery policy. We describe an evaluation of an error recovery policy in the BEE-TLE II tutorial dialogue system and discuss how different types of interpretation problems affect learning gain and user satisfaction. In particular, the problems arising from student use of non-standard terminology appear to have negative consequences. We argue that existing strategies for dealing with terminology problems are insufficient and that improving such strategies is important in future ITS research.

Beetle II: an adaptable tutorial dialogue system

We present BEETLE II, a tutorial dialogue system which accepts unrestricted language input and supports experimentation with different dialogue strategies. Our first system evaluation compared two dialogue policies. The resulting corpus was used to study the impact of different tutoring and error recovery strategies on user satisfaction and student interaction style. It can also be used in the future to study a wide range of research issues in dialogue systems.

Exploring User Satisfaction in a Tutorial Dialogue System

Abstract User satisfaction is a common evaluation metric in task-oriented dialogue systems, whereas tutorial dialogue systems are often evaluated in terms of student learning gain. However, user satisfaction is also important for such systems, since it may predict technology acceptance. We present a detailed satisfaction questionnaire used in evaluating the BEETLE II system (REVU-NL), and explore the underlying components of user satisfaction using factor analysis. We demonstrate interesting patterns of interaction between interpretation quality, satisfaction and the dialogue policy, highlighting the importance of more finegrained evaluation of user satisfaction

Towards Effective Tutorial Feedback for Explanation Questions: A Dataset and Baselines

This paper proposes a new shared task on grading student answers with the goal of enabling well-targeted and flexible feedback in a tutorial dialogue setting

From Interactive Open Learner Modelling to Intelligent Mentoring: STyLE-OLM and Beyond

STyLE-OLM (Dimitrova 2003 International Journal of Artificial Intelligence in Education, 13, 35–78) presented a framework for interactive open learner modelling which entails the development of the means by which learners can inspect, discuss and alter the learner model that has been jointly constructed by themselves and the system. This paper outlines the STyLE-OLM framework and reflects on the key challenges it addressed: (a) the design of an appropriate communication medium; this was addressed by proposing a structured language using diagrammatic presentations of conceptual graphs; (b) the management of the interaction with the learner; this was addressed by designing a framework for interactive open learner modelling dialogue utilising dialogue games; (c) the accommodation of different beliefs about the learner’s domain model; this was addressed with a mechanism for maintaining different views about the learner beliefs which adapted belief modal logic operators; and (d) the assessment of any resulting improvements in learner model accuracy and learner reflection; this was addressed in a user study with an instantiation of STyLE-OLM for diagnosing a learner’s knowledge of finance concept, as part of a larger project that developed an intelligent system to assist with learning domain terminology in a foreign language. Reviewing follow on work, we refer to projects by the authors’ students and colleagues leading to further extension and adoption of STyLE-OLM, as well as relevant approaches in open learner modelling which have cited the STyLE-OLM framework. The paper points at outstanding research challenges and outlines future a research direction to extend interactive open learner modelling towards mentor-like intelligent learning systems

Intelligent Tutoring Systems for Generation Z's Addiction

As generation Z's big data is flooding the Internet through social nets, neural network based data processing is turning an important cornerstone, showing significant potential for fast extraction of data patterns. Online course delivery and associated tutoring are transforming into customizable, on-demand services driven by the learner. Besides automated grading, strong potential exists for the development and deployment of next generation intelligent tutoring software agents. Self-adaptive, online tutoring agents exhibiting "intelligent-like" behavior, being capable "to learn" from the learner, will become the next educational superstars. Over the past decade, computer-based tutoring agents were deployed in a variety of extended reality environments, from patient rehabilitation to psychological trauma healing. Most of these agents are driven by a set of conditional control statements and a large answers/questions pairs dataset. This article provides a brief introduction on Generation Z's addiction to digital information, highlights important efforts for the development of intelligent dialogue systems, and explains the main components and important design decisions for Intelligent Tutoring System.Comment: 4 page