Associating Facial Expressions and Upper-Body Gestures with Learning Tasks for Enhancing Intelligent Tutoring Systems

Learning involves a substantial amount of cognitive, social and emotional states. Therefore, recognizing and understanding these states in the context of learning is key in designing informed interventions and addressing the needs of the individual student to provide personalized education. In this paper, we explore the automatic detection of learner’s nonverbal behaviors involving hand-over-face gestures, head and eye movements and emotions via facial expressions during learning. The proposed computer vision-based behavior monitoring method uses a low-cost webcam and can easily be integrated with modern tutoring technologies. We investigate these behaviors in-depth over time in a classroom session of 40 minutes involving reading and problem-solving exercises. The exercises in the sessions are divided into three categories: an easy, medium and difficult topic within the context of undergraduate computer science. We found that there is a significant increase in head and eye movements as time progresses, as well as with the increase of difficulty level. We demonstrated that there is a considerable occurrence of hand-over-face gestures (on average 21.35%) during the 40 minutes session and is unexplored in the education domain. We propose a novel deep learning approach for automatic detection of hand-over-face gestures in images with a classification accuracy of 86.87%. There is a prominent increase in hand-over-face gestures when the difficulty level of the given exercise increases. The hand-over-face gestures occur more frequently during problem-solving (easy 23.79%, medium 19.84% and difficult 30.46%) exercises in comparison to reading (easy 16.20%, medium 20.06% and difficult 20.18%)

A multi-disciplinary program for opioid sparse arthroplasty results in reduced long-term opioid consumption: a four year prospective study

Published online: 29 March 2023Introduction: The current opioid epidemic poses patient safety and economic burdens to healthcare systems worldwide. Postoperative prescriptions of opioids contribute, with reported opioid prescription rates following arthroplasty as high as 89%. In this multi-centre prospective study, an opioid sparing protocol was implemented for patients undergoing knee or hip arthroplasty. The primary outcome is to report our patient outcomes in the context of this protocol, and to examine the rate of opioid prescription on discharge from our hospitals following joint arthroplasty surgery. This is possibly associated with the efficacy of the newly implemented Arthroplasty Patient Care Protocol. Methods: Over three years, patients underwent perioperative education with the expectation to be opioid-free after surgery. Intraoperative regional analgesia, early postoperative mobilisation and multimodal analgesia were mandatory. Long-term opioid medication use was monitored and PROMs (Oxford Knee/Hip Score (OKS/OHS), EQ-5D-5 L) were evaluated pre-operatively, and at 6 weeks, 6 months and 1 year postoperatively. Primary and secondary outcomes were opiate use and PROMs at different time points. Results: A total of 1,444 patients participated. Two (0.2%) knee patients used opioids to one year. Zero hip patients used opioids postoperatively at any time point after six weeks (p < 0.0001). The OKS and EQ-5D-5 L both improved for knee patients from 16 (12–22) pre-operatively to 35 (27–43) at 1 year postoperatively, and 70 (60–80) preoperatively to 80 (70–90) at 1 year postoperatively (p < 0.0001). The OHS and EQ-5D-5 L both improved for hip patients from 12 (8–19) preoperatively to 44 (36–47) at 1 year postoperatively, and 65 (50–75) preoperatively to 85 (75–90) at 1 year postoperatively (p < 0.0001). Satisfaction improved between all pre- and postoperative time points for both knee and hip patients (p < 0.0001). Conclusions: Knee and hip arthroplasty patients receiving a peri-operative education program can effectively and satisfactorily be managed without long-term opioids when coupled with multimodal perioperative management, making this a valuable approach to reduce chronic opioid use.D-Yin Lin, Anthony J. Samson, Freeda D, Mello, Brigid Brown, Matthew G. Cehic, Christopher Wilson, Hidde M. Kroon and Ruurd L. Jaarsm

Investigating the Information Systems Heterarchy

This article assesses how one IS organization is changing in response to the increased globalization of software development and posits the emergence of a new form of multi-national enterprise (MNE)—the heterarchy. Data from two projects create new insights into the structures and behaviors of ISMNEs as they adapt to global systems development. The article identifies four primary dimensions of impact—cultural, economic, operational, and organizational—and suggests how such organizations are evolvin

Five Lenses on Team Tutor Challenges: A Multidisciplinary Approach

This chapter describes five disciplinary domains of research or lenses that contribute to the design of a team tutor. We focus on four significant challenges in developing Intelligent Team Tutoring Systems (ITTSs), and explore how the five lenses can offer guidance for these challenges. The four challenges arise in the design of team member interactions, performance metrics and skill development, feedback, and tutor authoring. The five lenses or research domains that we apply to these four challenges are Tutor Engineering, Learning Sciences, Science of Teams, Data Analyst, and Human–Computer Interaction. This matrix of applications from each perspective offers a framework to guide designers in creating ITTSs

Sit still and pay attention: Using the Wii Balance-Board to detect lapses in concentration in children during psychophysical testing.

During psychophysical testing, a loss of concentration can cause observers to answer incorrectly, even when the stimulus is clearly perceptible. Such lapses limit the accuracy and speed of many psychophysical measurements. This study evaluates an automated technique for detecting lapses based on body movement (postural instability). Thirty-five children (8-11 years of age) and 34 adults performed a typical psychophysical task (orientation discrimination) while seated on a Wii Fit Balance Board: a gaming device that measures center of pressure (CoP). Incorrect responses on suprathreshold catch trials provided the "reference standard" measure of when lapses in concentration occurred. Children exhibited significantly greater variability in CoP on lapse trials, indicating that postural instability provides a feasible, real-time index of concentration. Limitations and potential applications of this method are discussed

A large-scale study on the effects of sex on gray matter asymmetry

Research on sex-related brain asymmetries has not yielded consistent results. Despite its importance to further understanding of normal brain development and mental disorders, the field remains relatively unexplored. Here we employ a recently developed asymmetry measure, based on the Dice coefficient, to detect sex-related gray matter asymmetries in a sample of 457 healthy participants (266 men and 191 women) obtained from 5 independent databases. Results show that women’s brains are more globally symmetric than men’s (p < 0.001). Although the new measure accounts for asymmetries distributed all over the brain, several specific structures were identified as systematically more symmetric in women, such as the thalamus and the cerebellum, among other structures, some of which are typically involved in language production. These sex-related asymmetry differences may be defined at the neurodevelopmental stage and could be associated with functional and cognitive sex differences, as well as with proneness to develop a mental disorder

Determination of the LOQ in real-time PCR by receiver operating characteristic curve analysis: application to qPCR assays for Fusarium verticillioides and F. proliferatum

Real-time PCR (qPCR) is the principal technique for the quantification of pathogen biomass in host tissue, yet no generic methods exist for the determination of the limit of quantification (LOQ) and the limit of detection (LOD) in qPCR. We suggest using the Youden index in the context of the receiver operating characteristic (ROC) curve analysis for this purpose. The LOQ was defined as the amount of target DNA that maximizes the sum of sensitivity and specificity. The LOD was defined as the lowest amount of target DNA that was amplified with a false-negative rate below a given threshold. We applied this concept to qPCR assays for Fusarium verticillioides and Fusarium proliferatum DNA in maize kernels. Spiked matrix and field samples characterized by melting curve analysis of PCR products were used as the source of true positives and true negatives. On the basis of the analysis of sensitivity and specificity of the assays, we estimated the LOQ values as 0.11 pg of DNA for spiked matrix and 0.62 pg of DNA for field samples for F. verticillioides. The LOQ values for F. proliferatum were 0.03 pg for spiked matrix and 0.24 pg for field samples. The mean LOQ values correspond to approximately eight genomes for F. verticillioides and three genomes for F. proliferatum. We demonstrated that the ROC analysis concept, developed for qualitative diagnostics, can be used for the determination of performance parameters of quantitative PCR

Biosignals reflect pair-dynamics in collaborative work : EDA and ECG study of pair-programming in a classroom environment

Collaboration is a complex phenomenon, where intersubjective dynamics can greatly affect the productive outcome. Evaluation of collaboration is thus of great interest, and can potentially help achieve better outcomes and performance. However, quantitative measurement of collaboration is difficult, because much of the interaction occurs in the intersubjective space between collaborators. Manual observation and/or self-reports are subjective, laborious, and have a poor temporal resolution. The problem is compounded in natural settings where task-activity and response-compliance cannot be controlled. Physiological signals provide an objective mean to quantify intersubjective rapport (as synchrony), but require novel methods to support broad deployment outside the lab. We studied 28 student dyads during a self-directed classroom pair-programming exercise. Sympathetic and parasympathetic nervous system activation was measured during task performance using electrodermal activity and electrocardiography. Results suggest that (a) we can isolate cognitive processes (mental workload) from confounding environmental effects, and (b) electrodermal signals show role-specific but correlated affective response profiles. We demonstrate the potential for social physiological compliance to quantify pair-work in natural settings, with no experimental manipulation of participants required. Our objective approach has a high temporal resolution, is scalable, non-intrusive, and robust.Peer reviewe