Inside Out: Detecting Learners' Confusion to Improve Interactive Digital Learning Environments

Confusion is an emotion that is likely to occur while learning complex information. This emotion can be beneficial to learners in that it can foster engagement, leading to deeper understanding. However, if learners fail to resolve confusion, its effect can be detrimental to learning. Such detrimental learning experiences are particularly concerning within digital learning environments (DLEs), where a teacher is not physically present to monitor learner engagement and adapt the learning experience accordingly. However, with better information about a learner's emotion and behavior, it is possible to improve the design of interactive DLEs (IDLEs) not only in promoting productive confusion but also in preventing overwhelming confusion. This article reviews different methodological approaches for detecting confusion, such as self-report and behavioral and physiological measures, and discusses their implications within the theoretical framework of a zone of optimal confusion. The specificities of several methodologies and their potential application in IDLEs are discussed

Machine Learning Approach for an Advanced Agent-based Intelligent Tutoring System

Machine Learning Approach for an Advanced Agent-based Intelligent Tutoring System Roya Aminikia Learning Management Systems (LMSs) are digital frameworks that provide curriculum, training materials, and corresponding assessments to guarantee an effective learning process. Although these systems are capable of distributing the learning content, they do not support dynamic learning processes and do not have the capability to communicate with human learners who are required to interact in a dynamic environment during the learning process. To create this process and support the interaction feature, LMSs are equipped with Intelligent Tutoring Systems (ITSs). The main objective of an ITS is to facilitate students’ movement towards their learning goals through virtual tutoring. When equipped with ITSs, LMSs operate as dynamic systems to provide students with access to a tutor who is available anytime during the learning session. The crucial issues we address in this thesis are how to set up a dynamic LMS, and how to design the logical structure behind an ITS. Artificial intelligence, multi-agent technology and machine learning provide powerful theories and foundations that we leverage to tackle these issues. We designed and implemented the new concept of Pedagogical Agent (PA) as the main part of our ITS. This agent uses an evaluation procedure to compare each particular student, in terms of performance, with their peers to develop a worthwhile guidance. The agent captures global knowledge of students’ feature measurements during students’ guiding process. Therefore, the PA retains an updated status, called image, of each specific student at any moment. The agent uses this image for the purpose of diagnosing students’ skills to implement a specific correct instruction. To develop the infrastructure of the agent decision making algorithm, we laid out a protocol (decision tree) to select the best individual direction. The significant capability of the agent is the ability to update its functionality by looking at a student’s image at run time. We also applied two supervised machine learning methods to improve the decision making protocol performance in order to maximize the effect of the collaborating mechanism between students and the ITS. Through these methods, we made the necessary modifications to the decision making structure to promote students’ performance by offering prompts during the learning sessions. The conducted experiments showed that the proposed system is able to efficiently classify students into learners with high versus low performance. Deployment of such a model enabled the PA to use different decision trees while interacting with students of different learning skills. The performance of the system has been shown by ROC curves and details regarding combination of different attributes used in the two machine learning algorithms are discussed, along with the correlation of key attributes that contribute to the accuracy and performance of the decision maker components

Promoting Learning by Inducing and Scaffolding Cognitive Disequilibrium and Confusion through System Feedback

Learners frequently experience uncertainty about how to proceed during learning. These experiences cause learners to enter a state of cognitive disequilibrium and its affiliated affective state of confusion. Cognitive disequilibrium and confusion have been found to frequently occur during complex learning and provide opportunities for deeper learning. In the current thesis, a learning environment that induces confusion was investigated. In the environment, learners engaged in a dialogue on scientific reasoning with an animated pedagogical agent. Confusion was induced through false feedback provided by the tutor agent (e.g., when learners responded correctly and were told their response was incorrect). Self-reports of confusion during the training session indicated that false feedback was an effective method for inducing confusion. False feedback was also found to increase learners’ ability to apply this knowledge to new and novel situations, under certain conditions. Implications for the design of learning environments are also discussed

Managing Learner’s Affective States in Intelligent Tutoring Systems

Abstract. Recent works in Computer Science, Neurosciences, Education, and Psychology have shown that emotions play an important role in learning. Learner’s cognitive ability depends on his emotions. We will point out the role of emotions in learning, distinguishing the different types and models of emotions which have been considered until now. We will address an important issue con-cerning the different means to detect emotions and introduce recent approaches to measure brain activity using Electroencephalograms (EEG). Knowing the influ-ence of emotional events on learning it becomes important to induce specific emo-tions so that the learner can be in a more adequate state for better learning or memorization. To this end, we will introduce the main components of an emotion-ally intelligent tutoring system able to recognize, interpret and influence learner’s emotions. We will talk about specific virtual agents that can influence learner’s emotions to motivate and encourage him and involve a more cooperative work, particularly in narrative learning environments. Pushing further this paradigm, we will present the advantages and perspectives of subliminal learning which inter

Psychological Aspects in lifelike synthetic agents: Towards to the Personality Markup Language (A Brief Survey)

This paper describes how human psychological aspects have been used in lifelike synthetic agents in order to provide believability during the human-computer interaction. We describe a brief survey of applications where Affective Computing Scientists have applied psychological aspects, like Emotion and Personality. Based on those aspects we describe the effort done by Affective Computing scientists in order to create a Markup Language to express and standardize Emotions. Because they have not yet concentrated their effort on Personality, here, we propose a starting point to create a Markup Language to express Personality

Predicting the confusion level of text excerpts with syntactic, lexical and n-gram features

Distance learning, offline presentations (presentations that are not being carried in a live fashion but were instead pre-recorded) and such activities whose main goal is to convey information are getting increasingly relevant with digital media such as Virtual Reality (VR) and Massive Online Open Courses (MOOCs). While MOOCs are a well-established reality in the learning environment, VR is also being used to promote learning in virtual rooms, be it in the academia or in the industry. Oftentimes these methods are based on written scripts that take the learner through the content, making them critical components to these tools. With such an important role, it is important to ensure the efficiency of these scripts. Confusion is a non-basic emotion associated with learning. This process often leads to a cognitive disequilibrium either caused by the content itself or due to the way it is conveyed when it comes to its syntactic and lexical features. We hereby propose a supervised model that can predict the likelihood of confusion an input text excerpt can cause on the learner. To achieve this, we performed syntactic and lexical analyses over 300 text excerpts and collected 5 confusion level classifications (0 – 6) per excerpt from 51 annotators to use their respective means as labels. These examples that compose the dataset were collected from random presentations transcripts across various fields of knowledge. The learning model was trained with this data with the results being included in the body of the paper. This model allows the design of clearer scripts of offline presentations and similar approaches and we expect that it improves the efficiency of these speeches. While this model is applied to this specific case, we hope to pave the way to generalize this approach to other contexts where clearness of text is critical, such as the scripts of MOOCs or academic abstracts.info:eu-repo/semantics/acceptedVersio

Trait Arousability And Its Impact On Adaptive Multimedia Training

Today\u27s best intelligent, adaptive, multimedia trainers have shown excellent performance; however, their results still fall far-short of what good human tutors can achieve. The overarching thesis of this paper is that future intelligent, adaptive systems will be improved by taking into account relevant, consistent, and meaningful individual differences. Specifically, responding to individual differences among trainees will (a) form more accurate individual baselines within a training system, and (b) better inform system responses (so that they interpret and respond to observable data more appropriately). One variable to consider is trait arousability, which describes individual differences in sensitivity to stimuli. Individuals\u27 arousability interacts with the arousal inherent to a task/environment to create a person\u27s arousal state. An individual\u27s arousal state affects his/her attentional capacity, working memory function, and depth of processing. In this paper, two studies are presented. The purpose of the first study was to evaluate existing subjective measures of trait arousability and then develop a new measure by factor analyzing existing apparatus. From this well-populated (N = 622) study, a new reliable ([alpha] = .91) 35-item scale was developed. This scale includes two factors, negative emotionality and orienting sensitivity, which have been previously theorized but not yet so reliably measured. The purposes of the second study were to (a) validate the measure developed in the first investigation and (b) demonstrate the applied value of the arousability construct in the context of training. Results from the second study (N=45) demonstrated significant main effects, but the interaction effects were inconclusive. They neither clearly confirm nor invalidate the hypotheses, but they do raise further questions