Influence of Workload on Auditory Evoked Potentials in a Single-stimulus Paradigm

Mental workload can be assessed via neurophysiological markers. Temporal features such as event related potentials (ERPs) are one of those which are very often described in the literature. However, most of the studies that evaluate their sensitivity to workload use secondary tasks. Yet potentials elicited by ignored stimuli could provide mental state monitoring systems with less intrusive probing methods. For instance, auditory probing systems could be used in adaptive driving or e-learning applications. This study evaluates how workload influences auditory evoked potentials (AEPs) elicited by a single-stimulus paradigm when probes are to be ignored. Ten participants performed a Sternberg memory task on a touchpad with three levels of difficulty plus a view-only condition. In addition, they performed two ecological tasks of their choice, one deemed easy (e.g. reading novels), and the other difficult (e.g. programming). AEPs were elicited thanks to pure tones presented during the memory task retention period, and during the whole extent of the external tasks. Performance and AEPs were recorded and analyzed. Participants’ accuracy decreased linearly with increasing workload, whereas the difference in amplitude between the P3 and its adjacent components, N2 and SW, increased. This reveals the relevance of this triphasic sequence for mental workload assessment

Tracking team mental workload by multimodal measurements in the operating room

Mental workload and its effects on surgical performance are underexplored topics, despite their importance for operating room (OR) efficiency and patient safety. We developed a multimodal platform that can simultaneously collect data from EEG, heart rate and breathing rate, tool handle pressure, and eye tracker from mobile subjects. We performed experiments using the Fundamentals of Laparoscopic Surgery model, with 22 subjects of varying skill levels ranging from nonsurgeon to expert. The results indicated significant modulations of the measurements depending on pupil size, heart rate variability, P300 response, tool pressure, task difficulty, time-on-task, and skill level. These provide evidence that physiology based metrics can be used in automated classification of fine gradations of skill, the assessment and certification of surgery trainees, developing real-time flags and warnings for the OR, and validating new OR technology

Étude de corrélats électrophysiologiques pour la discrimination d'états de fatigue et de charge mentale : apports pour les interfaces cerveau-machine passives

Mental state estimation on the basis of cerebral activity and its resulting physiological activities has become a challenge for passive Brain-Computer Interfaces (BCI), in particular to address a need in neuroergonomics. This thesis work focuses on mental fatigue and workload estimation. Its purpose is to provide efficient and realistic processing chains. Thus, one issue was the modulation of workload markers as well as classification performance robustness depending on time-on-task (TOT). The impact of workload and TOT on attentional state markers was also assessed. For those purposes, an experimental protocol was implemented to collect the electroencephalographic (EEG), cardiac (ECG) and ocular (EOG) signals from healthy volunteers as they performed for a prolonged period of time a task that mixes working memory load and selective attention. Efficient signal processing chains that include spatial filtering and classification steps were designed in order to better estimate these mental states. The relevance of several electrophysiological markers was compared, among which spontaneous EEG activity and event-related potentials (ERPs), as well as various preprocessing steps such as spatial filtering methods for ERPs. Interaction effects between mental states were brought to light. In particular, TOT negatively impacted mental workload estimation when using power features. However, the chain based on ERPs was robust to this effect. A comparison of the type of stimuli that can be used to elicit the ERPs revealed that task-independent probes still allow very high performance, which shows their relevance for real-life implementation. Lastly, ongoing work that aims at assessing task-robust workload markers, as well as the usefulness of auditory ERPs in a single-stimulus paradigm will be presented as prospects.L'estimation de l'état mental d'un individu sur la base de son activité cérébrale et de ses activités physiologiques résultantes est devenue l'un des challenges des interfaces cerveau-machine (ICM) dites passives, dans le but notamment de répondre à un besoin en neuroergonomie. Ce travail de thèse se focalise sur l'estimation des états de fatigue et de charge mentale. Son objectif est de proposer des chaines de traitement efficaces et réalistes dans leur mise en œuvre. Ainsi, un des points à l'étude a été la modulation des indicateurs de charge ainsi que la robustesse des performances de classification en fonction du temps passé sur une tâche (TPT). L'impact de la charge et du TPT sur les marqueurs d'état attentionnel a aussi été évalué. Pour ce faire, un protocole expérimental a été mis en œuvre afin de recueillir les signaux électro-encéphalographiques (EEG), cardiaques (ECG) et oculaires (EOG) de participants volontaires sains lors de la réalisation prolongée d'une tâche combinant charge en mémoire de travail et attention sélective. Des chaînes de traitement performantes incluant une étape de filtrage spatial et une classification supervisée ont été mises en place afin de classer au mieux ces états. La pertinence de plusieurs marqueurs électrophysiologiques a été comparée, notamment l'activité EEG spontanée et les potentiels évoqués (PEs), ainsi que différentes étapes de prétraitement dont les méthodes de filtrage spatial pour PEs. Des effets d'interactions ont été mis au jour entre les différents états mentaux, dont un effet négatif du TPT sur les performances en classification de la charge mentale lorsque l'on utilise des marqueurs mesurant la puissance moyenne de l'EEG dans des bandes de fréquence d'intérêt. La chaîne basée sur les PEs est en revanche robuste à cet effet. Une comparaison du type de stimuli utilisables pour éliciter les PEs a révélé que des stimuli tâche-indépendants permettent tout de même d'obtenir des performances très élevées, ce qui montre leur pertinence pour une implémentation en situation réelle. En perspective seront présentés des travaux en cours visant à mettre en évidence des marqueurs de charge mentale robustes à la tâche, ainsi que l'utilité des potentiels évoqués auditifs en paradigme de simple stimulus