Affective e-learning approaches, technology and implementation model: a systematic review

A systematic literature study including articles from 2016 to 2022 was done to evaluate the various approaches, technologies, and implementation models involved in measuring student engagement during learning. The review’s objective was to compile and analyze all studies that investigated how instructors can gauge students’ mental states while teaching and assess the most effective teaching methods. Additionally, it aims to extract and assess expanded methodologies from chosen research publications to offer suggestions and answers to researchers and practitioners. Planning, carrying out the analysis, and publishing the results have all received significant attention in the research approach. The study’s findings indicate that more needs to be done to evaluate student participation objectively and follow their development for improved academic performance. Physiological approaches should be given more support among the alternatives. While deep learning implementation models and contactless technology should interest more researchers. And, the recommender system should be integrated into e-learning system. Other approaches, technologies, and methodology articles, on the other hand, lacked authenticity in conveying student feeling

Overcoming foreign language anxiety in an emotionally intelligent tutoring system

Learning a foreign language entails cognitive and emotional obstacles. It involves complicated mental processes that affect learning and emotions. Positive emotions such as motivation, encouragement, and satisfaction increase learning achievement, while negative emotions like anxiety, frustration, and confusion may reduce performance. Foreign Language Anxiety (FLA) is a specific type of anxiety accompanying learning a foreign language. It is considered a main impediment that hinders learning, reduces achievements, and diminishes interest in learning. Detecting FLA is the first step toward reducing and eventually overcoming it. Previously, researchers have been detecting FLA using physical measurements and self-reports. Using physical measures is direct and less regulated by the learner, but it is uncomfortable and requires the learner to be in the lab. Employing self-reports is scalable because it is easy to administer in the lab and online. However, it interrupts the learning flow, and people sometimes respond inaccurately. Using sensor-free human behavioral metrics is a scalable and practical measurement because it is feasible online or in class with minimum adjustments. To overcome FLA, researchers have studied the use of robots, games, or intelligent tutoring systems (ITS). Within these technologies, they applied soothing music, difficulty reduction, or storytelling. These methods lessened FLA but had limitations such as distracting the learner, not improving performance, and producing cognitive overload. Using an animated agent that provides motivational supportive feedback could reduce FLA and increase learning. It is necessary to measure FLA effectively with minimal interruption and then successfully reduce it. In the context of an e-learning system, I investigated ways to detect FLA using sensor-free human behavioral metrics. This scalable and practical method allows us to recognize FLA without being obtrusive. To reduce FLA, I studied applying emotionally adaptive feedback that offers motivational supportive feedback by an animated agent

Deep learning framework for subject-independent emotion detection using wireless signals.

Emotion states recognition using wireless signals is an emerging area of research that has an impact on neuroscientific studies of human behaviour and well-being monitoring. Currently, standoff emotion detection is mostly reliant on the analysis of facial expressions and/or eye movements acquired from optical or video cameras. Meanwhile, although they have been widely accepted for recognizing human emotions from the multimodal data, machine learning approaches have been mostly restricted to subject dependent analyses which lack of generality. In this paper, we report an experimental study which collects heartbeat and breathing signals of 15 participants from radio frequency (RF) reflections off the body followed by novel noise filtering techniques. We propose a novel deep neural network (DNN) architecture based on the fusion of raw RF data and the processed RF signal for classifying and visualising various emotion states. The proposed model achieves high classification accuracy of 71.67% for independent subjects with 0.71, 0.72 and 0.71 precision, recall and F1-score values respectively. We have compared our results with those obtained from five different classical ML algorithms and it is established that deep learning offers a superior performance even with limited amount of raw RF and post processed time-sequence data. The deep learning model has also been validated by comparing our results with those from ECG signals. Our results indicate that using wireless signals for stand-by emotion state detection is a better alternative to other technologies with high accuracy and have much wider applications in future studies of behavioural sciences

Student Modeling and Analysis in Adaptive Instructional Systems

There is a growing interest in developing and implementing adaptive instructional systems to improve, automate, and personalize student education. A necessary part of any such adaptive instructional system is a student model used to predict or analyze learner behavior and inform adaptation. To help inform researchers in this area, this paper presents a state-of-the-art review of 11 years of research (2010-2021) in student modeling, focusing on learner characteristics, learning indicators, and foundational aspects of dissimilar models. We mainly emphasize increased prediction accuracy when using multidimensional learner data to create multimodal models in real-world adaptive instructional systems. In addition, we discuss challenges inherent in real-world multimodal modeling, such as uncontrolled data collection environments leading to noisy data and data sync issues. Finally, we reinforce our findings and conclusions through an industry case study of an adaptive instructional system. In our study, we verify that adding multiple data modalities increases our model prediction accuracy from 53.3% to 69%. At the same time, the challenges encountered with our real-world case study, including uncontrolled data collection environment with inevitably noisy data, calls for synchronization and noise control strategies for data quality and usability

Affective educational games and the evolving teaching experience

Teaching methods must adapt to learners’ expectations. Computer game-based learning environments enable learning through experimentation and are inherently motivational. However, for identifying when learners achieve learning goals and providing suitable feedback, Intelligent Tutoring Systems must be used. Recognizing the learner’s affective state enables educational games to improve the learner’s experience or to distinguish relevant emotions. This chapter discusses the creation of an affective student model that infers the learner’s emotions from cognitive and motivational variables through observable behavior. The control-value theory of ‘achievement emotions’ provides a basis for this work. A Probabilistic Relational Models (PRMs) approach for affective student modeling, which is based on Dynamic Bayesian Networks, is discussed. The approach is tested through a prototyping study based on Wizard-of-Oz experiments and preliminary results are presented. The affective student model will be incorporated into PlayPhysics, an emotional game-based learning environment for teaching Physics. PRMs facilitate the design of student models with Bayesian Networks. The effectiveness of PlayPhysics will be evaluated by comparing the students’ learning gains and learning efficiencies.</jats:p

Instruments for visualization of self, co, and socially shared regulation of learning using multimodal analytics:a systematic review

Abstract. This thesis presents a systematic literature review in the intersection of multimodal learning analytics, regulation theories of learning, and visual analytics literature of the last decade (2011- 2021). This review is to collect existing research-based instruments designed to visualize Self-Regulation of Learning (SRL), Co-Regulation of learning (CoRL), and Socially Shared Regulation of learning (SSRL) using dashboards and multimodal data. The inclusion and exclusion criteria used in this review addressed two main aims. First, to distil settings, instruments, constructs, and audiences. Second, to identify visualization used for targets (i.e., cognition, motivation, and emotion), phases (i.e., forethought, performance, and reflection), and types of regulation (i.e., SRL, CoRL, and SSRL). By following the Preferred Reporting Items for Systematic Reviews and MetaAnalyses (PRISMA) guidelines, this thesis included 23 peer-reviewed articles out of 383 articles retrieved from 5 different databases searched in April 2021. The main findings from this literature review are (a) the included articles used theoretical grounding of SRL in all articles while CoRL is used only in 3 articles and SSRL only in 2 articles; (b) most articles used both teachers and students as the audience for visual feedback and operated in online learning settings; (c) selected articles focused mainly on visualizing cognition and motivation (17 articles each) as targets of regulation, while emotion as the target was applied only in 6 articles; (d) The performance phase was common to most of the articles and used various visualizations followed by reflection and forethought phases respectively. Simple visualizations, i.e., progress bar chart, line chart, color coding, are used more frequently than bubble chart, stacked column chart, funnel chart, heat maps, and Sankey diagram. Most of the dashboard instruments identified in the review are still improving their designs. Therefore, the results of this review should be put into the context of future studies to be utilized by researchers and teachers in recognizing the missing targets and phases of SRL, CoRL, and SSRL in visualized feedback. Addressing these could also assist them in giving timely feedback on students’ learning strategies to improve their regulatory skills