Affect and Inference in Bayesian Knowledge Tracing with a Robot Tutor

In this paper, we present work to construct a robotic tutoring system that can assess student knowledge in real time during an educational interaction. Like a good human teacher, the robot draws on multimodal data sources to infer whether students have mastered language skills. Specifically, the model extends the standard Bayesian Knowledge Tracing algorithm to incorporate an estimate of the student's affective state (whether he/she is confused, bored, engaged, smiling, etc.) in order to predict future educational performance. We propose research to answer two questions: First, does augmenting the model with affective information improve the computational quality of inference? Second, do humans display more prominent affective signals in an interaction with a robot, compared to a screen-based agent? By answering these questions, this work has the potential to provide both algorithmic and human-centered motivations for further development of robotic systems that tightly integrate affect understanding and complex models of inference with interactive, educational robots.National Science Foundation (U.S.) (Grant CCF-1138986)National Science Foundation (U.S.). Graduate Research Fellowship Program (Grant No. 1122374

Robot tutors:Welcome or ethically questionable?

Robot tutors provide new opportunities for education. However, they also introduce moral challenges. This study reports a systematic literature re-view (N = 256) aimed at identifying the moral considerations related to ro-bots in education. While our findings suggest that robot tutors hold great potential for improving education, there are multiple values of both (special needs) children and teachers that are impacted (positively and negatively) by its introduction. Positive values related to robot tutors are: psychological welfare and happiness, efficiency, freedom from bias and usability. However, there are also concerns that robot tutors may negatively impact these same values. Other concerns relate to the values of friendship and attachment, human contact, deception and trust, privacy, security, safety and accountability. All these values relate to children and teachers. The moral values of other stakeholder groups, such as parents, are overlooked in the existing literature. The results suggest that, while there is a potential for ap-plying robot tutors in a morally justified way, there are imported stake-holder groups that need to be consulted to also take their moral values into consideration by implementing tutor robots in an educational setting. (from Narcis.nl

Assessment of Engagement for Intelligent Educational Agents: A Pilot Study with Middle School Students

©American Society for Engineering Education, 2014Adaptive learning is an educational method that utilizes computers as an interactive teaching device. Intelligent tutoring systems, or educational agents, use adaptive learning techniques to adapt to each student’s needs and learning styles in order to individualize learning. Effective educational agents should accomplish two essential goals during the learning process – 1) monitor engagement of the student during the interaction and 2) apply behavioral strategies to maintain the student’s attention when engagement decreases. In this paper, we focus on the first objective of monitoring student engagement. Most educational agents do not monitor engagement explicitly, but rather assume engagement and adapt their interaction based on the student’s responses to questions and tasks. A few advanced methods have begun to incorporate models of engagement through vision-based algorithms that assess behavioral cues such as eye gaze, head pose, gestures, and facial expressions. Unfortunately, these methods typically require a heavy computation load, memory/storage constraints, and high power consumption. In addition, these behavioral cues do not correlate well with achievement of highlevel cognitive tasks. As an alternative, our proposed model of engagement uses physical events, such as keyboard and mouse events. This approach requires fewer resources and lower power consumption, which is also ideally suited for mobile educational agents such as handheld tablets and robotic platforms. In this paper, we discuss our engagement model which uses techniques that determine behavioral user state and correlate these findings to mouse and keyboard events. In particular, we observe three event processes: total time required to answer a question; accuracy of responses; and proper function executions. We evaluate the correctness of our model based on an investigation involving a middle-school after-school program in which a 15-question math exam that varies in cognitive difficulty is used for assessment. Eye gaze and head pose techniques are referenced for the baseline metric of engagement. We conclude the investigation with a survey to gather the subject’s perspective of their mental state after the exam. We found that our model of engagement is comparable to the eye gaze and head pose techniques for low-level cognitive tasks. When high-level cognitive thinking is required, our model is more accurate than the eye gaze and head pose techniques due to the students’ nonfocused gazes during questions requiring deep thought or use of outside variables for assistance such as their fingers to count. The large time delay associated with the lack of eye contact between the student and the computer screen causes the aforementioned algorithms to incorrectly declare the subjects as being disengaged. Furthermore, speed and validity of responses can help to determine how well the student understands the material, and this is confirmed through the survey responses and video observations. This information will be used later to integrate instructional scaffolding and adaptation with the educational agent

Applying behavioral strategies for student engagement using a robotic educational agent

©2013 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.To be published in the 2013 IEEE International Conference on Systems, Man, and Cybernetics (SMC) Manchester, UK, October 2013.Adaptive learning is an educational method that utilizes computers as an interactive teaching device. Intelligent tutoring systems, or educational agents, use adaptive learning techniques to adapt to each student’s needs and learning styles in order to individualize learning. Effective educational agents should accomplish two essential goals during the learning process – 1) monitor engagement of the student during the interaction and 2) apply behavioral strategies to maintain the student’s attention when engagement decreases. This paper focuses on the second objective of reengaging students using various behavioral strategies through the utilization of a robotic educational agent. Details are provided on the overall system approach and the forms of verbal and nonverbal cues used by the robotic agent. Results derived from 24 students engaging with the robot during a computer-based math test show that, while various forms of behavioral strategies increase test performance, combinations of verbal cues result in a slightly better outcome

An emotion and memory model for social robots : a long-term interaction

In this thesis, we investigate the role of emotions and memory in social robotic companions. In particular, our aim is to study the effect of an emotion and memory model towards sustaining engagement and promoting learning in a long-term interaction. Our Emotion and Memory model was based on how humans create memory under various emotional events/states. The model enabled the robot to create a memory account of user's emotional events during a long-term child-robot interaction. The robot later adapted its behaviour through employing the developed memory in the following interactions with the users. The model also had an autonomous decision-making mechanism based on reinforcement learning to select behaviour according to the user preference measured through user's engagement and learning during the task. The model was implemented on the NAO robot in two different educational setups. Firstly, to promote user's vocabulary learning and secondly, to inform how to calculate area and perimeter of regular and irregular shapes. We also conducted multiple long-term evaluations of our model with children at the primary schools to verify its impact on their social engagement and learning. Our results showed that the behaviour generated based on our model was able to sustain social engagement. Additionally, it also helped children to improve their learning. Overall, the results highlighted the benefits of incorporating memory during child-Robot Interaction for extended periods of time. It promoted personalisation and reflected towards creating a child-robot social relationship in a long-term interaction

Arabic conversational agent for modern Islamic education

This thesis presents research that combines the benefits of intelligent tutoring systems (ITS), Arabic conversational agents (CA) and learning theories by constructing a novel Arabic conversational intelligent tutoring system (CITS) called Abdullah. Abdullah CITS is a software program intended to deliver a tutorial to students aged between 10 and 12 years old, that covers the essential topics in Islam using natural language. The CITS aims to mimic a human Arabic tutor by engaging the students in dialogue using Modern standard Arabic language (MSA), whilst also allowing conversation and discussion in classical Arabic language (CAL). Developing a CITS for the Arabic language faces many challenges due to the complexity of the morphological system, non-standardization of the written text, ambiguity, and lack of resources. However, the main challenge for the developed Arabic CITS is how the user utterances are recognized and responded to by the CA, as well as how the domain is scripted and maintained. This research presents a novel Arabic CA and accompanying a scripting language that use a form of pattern matching, to handle users’ conversations when the user converse in MSA. A short text similarity measure is used within Abdullah CITS to extract the responses from CAL resources such as the Quran, Hadith, and Tafsir if there are no matching patterns with the Arabic conversation agent’s scripts. Abdullah CITS is able to capture the user’s level of knowledge and adapt the tutoring session and tutoring style to suit that particular learner’s level of knowledge. This is achieved through the inclusion of several learning theories and methods such as Gagne’s learning theory, Piaget learning theory, and storytelling method. These learning theories and methods implemented within Abdullah’s CITS architecture, are applied to personalise a tutorial to an individual learner. This research presents the first Arabic CITS, which utilises established learning typically employed in a classroom environment. The system was evaluated through end user testing with the target age group in schools both in Jordan and in the UK. Empirical experimentation has produced some positive results, indicating that Abdullah CITS is gauging the individual learner’s knowledge level and adapting the tutoring session to ensure learning gain is achieved