Generating socially appropriate tutorial dialog

Analysis of student-tutor coaching dialogs suggest that good human tutors attend to and attempt to influence the motivational state of learners. Moreover, they are sensitive to the social face of the learner, and seek to mitigate the potential face threat of their comments. This paper describes a dialog generator for pedagogical agents that takes motivation and face threat factors into account. This enables the agent to interact with learners in a socially appropriate fashion, and foster intrinsic motivation on the part of the learner, which in turn may lead to more positive learner affective states

The effectiveness of using intelligent tutoring systems to increase student achievement

Intelligent Tutoring Systems could be used to provide differentiated instruction. This review examines qualities of Intelligent Tutoring Systems and their impact on student achievement. Thirty peer-reviewed research studies published from 1997 to 2019 were selected for analysis. This review considers how intelligent tutoring systems compare with other methods of instruction, and how an intelligent tutoring system’s on-screen tutor impacts student achievement. Finally, this review considers methods of ITS personalization and how those methods impact student achievement. The reviewed research studies indicated that ITS was more effective than all forms of instruction except small group and individualized instruction. Additionally, on-screen agents in and personalization of Intelligent Tutoring Systems often have a positive impact on student learning. Recommendations for classroom implementation of intelligent tutoring systems and suggestions for future research are discusse

Mitigating User Frustration through Adaptive Feedback based on Human-Automation Etiquette Strategies

The objective of this study is to investigate the effects of feedback and user frustration in human-computer interaction (HCI) and examine how to mitigate user frustration through feedback based on human-automation etiquette strategies. User frustration in HCI indicates a negative feeling that occurs when efforts to achieve a goal are impeded. User frustration impacts not only the communication with the computer itself, but also productivity, learning, and cognitive workload. Affect-aware systems have been studied to recognize user emotions and respond in different ways. Affect-aware systems need to be adaptive systems that change their behavior depending on users’ emotions. Adaptive systems have four categories of adaptations. Previous research has focused on primarily function allocation and to a lesser extent information content and task scheduling. However, the fourth approach, changing the interaction styles is the least explored because of the interplay of human factors considerations. Three interlinked studies were conducted to investigate the consequences of user frustration and explore mitigation techniques. Study 1 showed that delayed feedback from the system led to higher user frustration, anger, cognitive workload, and physiological arousal. In addition, delayed feedback decreased task performance and system usability in a human-robot interaction (HRI) context. Study 2 evaluated a possible approach of mitigating user frustration by applying human-human etiquette strategies in a tutoring context. The results of Study 2 showed that changing etiquette strategies led to changes in performance, motivation, confidence, and satisfaction. The most effective etiquette strategies changed when users were frustrated. Based on these results, an adaptive tutoring system prototype was developed and evaluated in Study 3. By utilizing a rule set derived from Study 2, the tutor was able to use different automation etiquette strategies to target and improve motivation, confidence, satisfaction, and performance using different strategies, under different levels of user frustration. This work establishes that changing the interaction style alone of a computer tutor can affect a user’s motivation, confidence, satisfaction, and performance. Furthermore, the beneficial effect of changing etiquette strategies is greater when users are frustrated. This work provides a basis for future work to develop affect-aware adaptive systems to mitigate user frustration

Agents, Believability and Embodiment in Advanced Learning Environments

On the World Wide Web we see a growing number of general HCI interfaces, interfaces to educational or entertainment systems, interfaces to professional environments, etc., where an animated face, a cartoon character or a human-like virtual agent has the task to assist the user, to engage the user into a conversation or to educate the user. What can be said say about the effects a human-like agent has on a student's performance? We discuss agents, their intelligence, embodiment and interaction modalities. In particular, we introduce viewpoints and questions about roles embodied agents can play in educational environment

An Online Tutor for Astronomy: The GEAS Self-Review Library

We introduce an interactive online resource for use by students and college instructors in introductory astronomy courses. The General Education Astronomy Source (GEAS) online tutor guides students developing mastery of core astronomical concepts and mathematical applications of general astronomy material. It contains over 12,000 questions, with linked hints and solutions. Students who master the material quickly can advance through the topics, while under-prepared or hesitant students can focus on questions on a certain topic for as long as needed, with minimal repetition. Students receive individual accounts for study and course instructors are provided with overview tracking information, by time and by topic, for entire cohorts of students. Diagnostic tools support self-evaluation and close collaboration between instructor and student, even for distance learners. An initial usage study shows clear trends in performance which increase with study time, and indicates that distance learners using these materials perform as well as or better than a comparison cohort of on-campus astronomy students. We are actively seeking new collaborators to use this resource in astronomy courses and other educational venues.Comment: 15 pages, 9 figures; Vogt, N. P., and A. S. Muise. 2015. An online tutor for general astronomy: The GEAS self-review library. Cogent Education, 2 (1

Politeness and face in digitally reconfigured e-learning spaces

This paper has two starting points. The first is a theorization about the way in which “rhetorical space” is reshaped in asynchronous, online, learning environments. In particular, an asynchronous bulletin- board (ABB) discussion offers both opportunities and constraints for teaching and learning. The learning that occurs will be affected by the affordances implicit in the design of the conversational space itself and the communicative practices engaged in by both teachers and students. The second starting point is a small case study, utilizing action research and discourse analytical strategies, whose research participants were the author and students involved in “delivering” and “receiving” an online education course at post-graduate level using asynchronous discussion. The course, taught in English, had a mix of Chinese students (for whom English was an additional language) and native English speakers. The paper will report on students’ perceptions of what worked for them and what didn’t in respect of this elearning environment. It will also use concepts such as politeness, face and positioning to analyse aspects of the participants’ communicative practices and will draw conclusions from these in respect of how successful learning can occur in elearning environments with multicultural and multilingual students. It will make connections between the findings of this case study and other research on asynchronous, web-based learning and will makes some suggestions about what is needed in respect of the future research agenda

Producing Acoustic-Prosodic Entrainment in a Robotic Learning Companion to Build Learner Rapport

abstract: With advances in automatic speech recognition, spoken dialogue systems are assuming increasingly social roles. There is a growing need for these systems to be socially responsive, capable of building rapport with users. In human-human interactions, rapport is critical to patient-doctor communication, conflict resolution, educational interactions, and social engagement. Rapport between people promotes successful collaboration, motivation, and task success. Dialogue systems which can build rapport with their user may produce similar effects, personalizing interactions to create better outcomes. This dissertation focuses on how dialogue systems can build rapport utilizing acoustic-prosodic entrainment. Acoustic-prosodic entrainment occurs when individuals adapt their acoustic-prosodic features of speech, such as tone of voice or loudness, to one another over the course of a conversation. Correlated with liking and task success, a dialogue system which entrains may enhance rapport. Entrainment, however, is very challenging to model. People entrain on different features in many ways and how to design entrainment to build rapport is unclear. The first goal of this dissertation is to explore how acoustic-prosodic entrainment can be modeled to build rapport. Towards this goal, this work presents a series of studies comparing, evaluating, and iterating on the design of entrainment, motivated and informed by human-human dialogue. These models of entrainment are implemented in the dialogue system of a robotic learning companion. Learning companions are educational agents that engage students socially to increase motivation and facilitate learning. As a learning companion’s ability to be socially responsive increases, so do vital learning outcomes. A second goal of this dissertation is to explore the effects of entrainment on concrete outcomes such as learning in interactions with robotic learning companions. This dissertation results in contributions both technical and theoretical. Technical contributions include a robust and modular dialogue system capable of producing prosodic entrainment and other socially-responsive behavior. One of the first systems of its kind, the results demonstrate that an entraining, social learning companion can positively build rapport and increase learning. This dissertation provides support for exploring phenomena like entrainment to enhance factors such as rapport and learning and provides a platform with which to explore these phenomena in future work.Dissertation/ThesisDoctoral Dissertation Computer Science 201

Effective Tutoring with Empathic Embodied Conversational Agents

This thesis examines the prospect of using empathy in an Embodied Tutoring System (ETS) that guides students through an online quiz (by providing feedback on student answers and responding to self-reported student emotion). The ETS seeks to imitate human behaviours successfully used in one-to-one human tutorial interactions. The main hypothesis is that the interaction with an empathic ETS results in greater learning gains than a neutral ETS, primarily by encouraging positive and reducing negative student emotions using empathic feedback. In a preparatory study we investigated different strategies for expressing emotion by the ETS. We established that a multimodal strategy achieves the best results regarding how accurately human participants can recognise the emotions. This approach was used in developing the feedback strategy for our empathic ETS. The preparatory study was followed by two studies in which we compared a neutral with an empathic ETS. The ETS in the second of these studies was developed using results from the first of these studies. In both studies, we found no statistically significant difference in learning gains between the neutral and empathic ETS. However, we did discover a number of interactions between the ETS system, learning gains and, in particular 1) student scores on an empathic tendency test and 2) student ability. We also analysed the subjective responses and the relation between self-reported emotions during the quiz and student learning gains. Based on our studies in a formal class room setting, we assess the prospects of using empathic agents in a classroom setting and describe a number of requirements for their effective use