Automated Gaze-Based Mind Wandering Detection during Computerized Learning in Classrooms

We investigate the use of commercial off-the-shelf (COTS) eye-trackers to automatically detect mind wandering—a phenomenon involving a shift in attention from task-related to task-unrelated thoughts—during computerized learning. Study 1 (N = 135 high-school students) tested the feasibility of COTS eye tracking while students learn biology with an intelligent tutoring system called GuruTutor in their classroom. We could successfully track eye gaze in 75% (both eyes tracked) and 95% (one eye tracked) of the cases for 85% of the sessions where gaze was successfully recorded. In Study 2, we used this data to build automated student-independent detectors of mind wandering, obtaining accuracies (mind wandering F1 = 0.59) substantially better than chance (F1 = 0.24). Study 3 investigated context-generalizability of mind wandering detectors, finding that models trained on data collected in a controlled laboratory more successfully generalized to the classroom than the reverse. Study 4 investigated gaze- and video- based mind wandering detection, finding that gaze-based detection was superior and multimodal detection yielded an improvement in limited circumstances. We tested live mind wandering detection on a new sample of 39 students in Study 5 and found that detection accuracy (mind wandering F1 = 0.40) was considerably above chance (F1 = 0.24), albeit lower than offline detection accuracy from Study 1 (F1 = 0.59), a finding attributable to handling of missing data. We discuss our next steps towards developing gaze-based attention-aware learning technologies to increase engagement and learning by combating mind wandering in classroom contexts

iFocus: A Framework for Non-intrusive Assessment of Student Attention Level in Classrooms

The process of learning is not merely determined by what the instructor teaches, but also by how the student receives that information. An attentive student will naturally be more open to obtaining knowledge than a bored or frustrated student. In recent years, tools such as skin temperature measurements and body posture calculations have been developed for the purpose of determining a student\u27s affect, or emotional state of mind. However, measuring eye-gaze data is particularly noteworthy in that it can collect measurements non-intrusively, while also being relatively simple to set up and use. This paper details how data obtained from such an eye-tracker can be used to predict a student\u27s attention as a measure of affect over the course of a class. From this research, an accuracy of 77% was achieved using the Extreme Gradient Boosting technique of machine learning. The outcome indicates that eye-gaze can be indeed used as a basis for constructing a predictive model

The relationship between mind wandering and reading comprehension: A meta-analysis

Mind wandering (MW), a shift of attention away from external tasks toward internally generated thoughts, has been frequently associated with costs in reading comprehension (RC), although with some contrasting results and many reported potential intervening factors. The aim of the meta-analysis was to evaluate the relationship between MW and RC, considering the role of participants’ and text’s characteristics, as well as methodological issues in the measurement of the two constructs. From a set of 25 selected full texts (73 correlation coefficients), pooled correlation (r = −0.21) revealed a negative significant relationship. Using trait-based questionnaires to assess MW compared with online probes resulted in an average significant change of 0.30 in the correlation between MW and RC, leading to a null correlation. A significant effect of age was also found, with more negative correlations with increasing age. None of the other moderating variables considered (i.e., language, text type, text length, RC assessment, text difficulty, text interest, and working memory) resulted in a significant effect. From the present meta-analysis, we might suggest that MW and RC are partially overlapping and vary, within a swing effect, in relation to a set of shared factors, such as working memory, interest, and text length. There might also be side-specific factors that drive the movement of primarily one side of the swing, and future research should further consider the role of individual differences in RC. Implications for research and educational settings are discussed

The scientific study of passive thinking: Methods of mind wandering research

The science of mind wandering has rapidly expanded over the past 20 years. During this boom, mind wandering researchers have relied on self-report methods, where participants rate whether their minds were wandering. This is not an historical quirk. Rather, we argue that self-report is indispensable for researchers who study passive phenomena like mind wandering. We consider purportedly “objective” methods that measure mind wandering with eye tracking and machine learning. These measures are validated in terms of how well they predict self-reports, which means that purportedly objective measures of mind wandering retain a subjective core. Mind wandering science cannot break from the cycle of self-report. Skeptics about self-report might conclude that mind wandering science has methodological foundations of sand. We take a rather more optimistic view. We present empirical and philosophical reasons to be confident in self-reports about mind wandering. Empirically, these self-reports are remarkably consistent in their contents and behavioral and neural correlates. Philosophically, self-reports are consistent with our best theories about the function of mind wandering. We argue that this triangulation gives us reason to trust both theory and method

Using Gaze for Behavioural Biometrics

A principled approach to the analysis of eye movements for behavioural biometrics is laid down. The approach grounds in foraging theory, which provides a sound basis to capture the unique- ness of individual eye movement behaviour. We propose a composite Ornstein-Uhlenbeck process for quantifying the exploration/exploitation signature characterising the foraging eye behaviour. The rel- evant parameters of the composite model, inferred from eye-tracking data via Bayesian analysis, are shown to yield a suitable feature set for biometric identification; the latter is eventually accomplished via a classical classification technique. A proof of concept of the method is provided by measuring its identification performance on a publicly available dataset. Data and code for reproducing the analyses are made available. Overall, we argue that the approach offers a fresh view on either the analyses of eye-tracking data and prospective applications in this field