Towards a human eye behavior model by applying Data Mining Techniques on Gaze Information from IEC

In this paper, we firstly present what is Interactive Evolutionary Computation (IEC) and rapidly how we have combined this artificial intelligence technique with an eye-tracker for visual optimization. Next, in order to correctly parameterize our application, we present results from applying data mining techniques on gaze information coming from experiments conducted on about 80 human individuals

Cross-modal music integration in expert memory: Evidence from eye movements

The study investigated the cross-modal integration hypothesis for expert musicians using eye tracking. Twenty randomized excerpts of classical music were presented in two modes (auditory and visual), at the same time (simultaneously) or successively (sequentially). Musicians (N = 53, 26 experts and 27 non-experts) were asked to detect a note modified between the auditory and visual versions, either in the same major/minor key or violating the key. Experts carried out the task faster and with greater accuracy than non-experts. Sequential presentation was more difficult than simultaneous (longer fixations and higher error rates) and the modified notes were more easily detected when violating the key (fewer errors), but with longer fixations (speed/accuracy trade-off strategy). Experts detected the modified note faster, especially in the simultaneous condition in which cross-modal integration may be applied. These results support the hypothesis that the main difference between experts and non-experts derives from the difference in knowledge structures in memory built over time with practice. They also suggest that these high-level knowledge structures in memory contain harmony and tonal rules, arguing in favour of cross-modal integration capacities for experts, which are related to and can be explained by the long-term working memory (LTWM) model of expert memory (e.g. Drai-Zerbib & Baccino, 2014; Ericsson & Kintsch, 1995)

Discriminating cognitive processes with eye movements in a decision-making driving task.

An experiment was conducted in a driving simulator to test how eye-movements patterns evolve over time according to the decision-making processes involved in a driving task. Participants had to drive up to crossroads and decide to stop or not. The decision-making task was considered as the succession of two phases associated with cognitive processes: Differentiation (leading to a prior decision) and Consolidation (leading to a final decision). Road signs (Stop, Priority and GiveWay) varied across situations, and the stopping behavior (Go and NoGo) was recorded. Saccade amplitudes and fixation durations were analyzed. Specific patterns were found for each condition in accordance with the associated processes: high visual exploration (larger saccade amplitudes and shorter fixation durations) for the Differentiation phase, and lower visual exploration (smaller saccades and longer fixations) for the Consolidation phase. These results support that eye-movements can provide good indexes of underlying processes occurring during a decision-making task in an everyday context

Modeling visual attention on scenes

International audienceLa modélisation computationelle de l'attention visuelle connaît actuellement un essor considérable. Les premières modèles, purement basés sur l'attention dite exogène, permettent de calculer une carte de saillance indiquant les zones d'intérêt visuel d'une image. Cependant, afin d'améliorer cette prédiction, il s'avère nécessaire de prendre en compte des informations de plus haut niveaux relatives à l'attention endogène, c'est à dire des informations liées aux processus cognitifs. Afin de rendre compte de cette problématique, le présent article décrit un certain nombre de modèles exogènes ainsi que des modèles intégrant de la connaissance a priori. Les méthodes d'évaluation des performances sont également décrites. Afin d'aller plus loin dans la modélisation et dans la compréhension des processus cognitifs, de nouvelles perspectives et direction d'études sont exposées

Review on eye-hand span in sight-reading of music

In a sight-reading task, the position of the eyes on the score is generally further ahead than the note being produced by the instrument. This anticipation allows musicians to identify the upcoming notes and possible difficulties and to plan their gestures accordingly. The eye-hand span (EHS) corresponds to this offset between the eye and the hand and measures the distance or latency between an eye fixation on the score and the production of the note on the instrument. While EHS is mostly quite short, the variation in its size can depend on multiple factors. EHS increases in line with the musician's expertise level, diminishes as a function of the complexity of the score and can vary depending on the context in which it is played. By summarizing the main factors that affect EHS and the methodologies used in this field of study, the present review of the literature highlights the fact that a) to ensure effective sight reading, the EHS must be adaptable and optimized in size (neither too long not too short), with the best sight readers exhibiting a high level of perceptual flexibility in adapting their span to the complexity of the score; b) it is important to interpret EHS in the light of the specificities of the score, given that it varies so much both within and between scores; and c) the flexibility of EHS can be a good indicator of the perceptual and cognitive capacities of musicians, showing that a musician's gaze can be attracted early by a complexity in a still distant part of the score. These various points are discussed in the light of the literature on music-reading expertise. Promising avenues of research using the eye tracking method are proposed in order to further our knowledge of the construction of an expertise that requires multisensory integration

A meta-analysis on the effect of expertise on eye movements during music reading

The current meta-analysis was conducted on 12 studies comparing the eye movements of expert versus non-expert musicians and attempted to determine which eye movement measures are expertise dependent during music reading. The total dataset of 61 comparisons was divided into four subsets, each concerning one eye-movement variable (i.e., fixation duration, number of fixations, saccade amplitude, and gaze duration). We used a variance estimation method to aggregate the effect sizes. The results support the robust finding of reduced fixation duration in expert musicians (Subset 1, g = -0.72). Due to low statistical power because of limited effect sizes, the results on the number of fixations, saccade amplitude, and gaze duration were not reliable. We conducted meta-regression analyses to determine potential moderators of the effect of expertise on eye movements (i.e., definition of experimental groups, type of musical task performed, type of musical material used or tempo control). Moderator analyses did not yield any reliable results. The need for consistency in the experimental methodology is discussed. *The first two authors equally contributed to the first authorshi

Decision-making in information seeking on texts: an eye-fixation-related potentials investigation

Reading on a web page is known to be not linear and people need to make fast decisions about whether they have to stop or not reading. In such context, reading, and decision-making processes are intertwined and this experiment attempts to separate them through electrophysiological patterns provided by the Eye-Fixation-Related Potentials technique (EFRPs). We conducted an experiment in which EFRPs were recorded while participants read blocks of text that were semantically highly related, moderately related, and unrelated to a given goal. Participants had to decide as fast as possible whether the text was related or not to the semantic goal given at a prior stage. Decision making (stopping information search) may occur when the paragraph is highly related to the goal (positive decision) or when it is unrelated to the goal (negative decision). EFRPs were analyzed on and around typical eye fixations: either on words belonging to the goal (target), subjected to a high rate of positive decisions, or on low frequency unrelated words (incongruent), subjected to a high rate of negative decisions. In both cases, we found EFRPs specific patterns (amplitude peaking between 51 to 120 ms after fixation onset) spreading out on the next words following the goal word and the second fixation after an incongruent word, in parietal and occipital areas. We interpreted these results as delayed late components (P3b and N400), reflecting the decision to stop information searching. Indeed, we show a clear spill-over effect showing that the effect on word N spread out on word N + 1 and N + 2

Effects of Valence and Emotional Intensity on the Comprehension and Memorization of Texts

In the present study, we independently manipulated valence (positive, negative, or neutral) and emotional intensity (low, medium, or high), asking what impact they have on text comprehension (via surface, paraphrase, and inference questions) and memorization (via Remember/Know test) in adults. Results show that emotional contents, including valence and intensity affects comprehension. Emotional valence had a significant effect on text comprehension, with higher scores for positive and neutral texts than for negative ones. Participants scored higher on the surface questions for positive texts and on the inference questions for negative texts, with equivalent scores for paraphrase questions. Regarding emotional intensity, medium intensity generally fostered better comprehension of both positive and negative texts. High emotional intensity is beneficial for positively valenced texts, but hinders the understanding of negatively valenced ones. Regarding memorization, participants recalled more emotional words than neutral ones, and more words for positive texts than for either negative or neutral ones. In conclusion, our results show that emotions play an important role and improve the processing of information

What breaks the flow of reading? A study on characteristics of attentional disruption during digital reading

Reading is increasingly taking place on digital media, which are vectors of attentional disruption. This manuscript aims to characterize attentional disruption during reading on a computer screen in an ecological environment. To this end, we collected information relating to reader interruptions (number, type, duration, position, mental effort, and valence) and self-caught mind wandering (occurrence, position) throughout the reading session for high and low media multitaskers in their own specific ecological environment, at home. Comprehension of the narrative text was assessed both with surface and inferential questions. In total, 74 participants (M = 22.16, SD = 2.35) took part in the experiment. They reported attentional disruptions on average every 4 mins during reading. Moreover, there were more attentional disruptions during the first half of the text. Most interruptions were short and little mental effort was required to process them. We made a distinction between media-related and media-unrelated related interruptions. Multiple linear regression analyses showed that media-unrelated interruptions were actually related to better performance for both inferential and surface level questions. Furthermore, media-related interruptions were more frequent for high than low media multitaskers. Pleasure experienced when reading the text was also a significant predictor of comprehension. The results are discussed with regard to Long-Term Working Memory and strategies that the readers could have implemented to recover the thread of their reading