Monitoring Cognitive and Emotional Processes Through Pupil and Cardiac Response During Dynamic Versus Logical Task

The paper deals with the links between physiological measurements and cognitive and emotional functioning. As long as the operator is a key agent in charge of complex systems, the definition of metrics able to predict his performance is a great challenge. The measurement of the physiological state is a very promising way but a very acute comprehension is required; in particular few studies compare autonomous nervous system reactivity according to specific cognitive processes during task performance and task related psychological stress is often ignored. We compared physiological parameters recorded on 24 healthy subjects facing two neuropsychological tasks: a dynamic task that require problem solving in a world that continually evolves over time and a logical task representative of cognitive processes performed by operators facing everyday problem solving. Results showed that the mean pupil diameter change was higher during the dynamic task; conversely, the heart rate was more elevated during the logical task. Finally, the systolic blood pressure seemed to be strongly sensitive to psychological stress. A better taking into account of the precise influence of a given cognitive activity and both workload and related task-induced psychological stress during task performance is a promising way to better monitor operators in complex working situations to detect mental overload or pejorative stress factor of error

Noninvasive Physiological Measures And Workload Transitions:an Investigation Of Thresholds Using Multiple Synchronized Sensors

The purpose of this study is to determine under what conditions multiple minimally intrusive physiological sensors can be used together and validly applied for use in areas which rely on adaptive systems including adaptive automation and augmented cognition. Specifically, this dissertation investigated the physiological transitions of operator state caused by changes in the level of taskload. Three questions were evaluated including (1) Do differences exist between physiological indicators when examined between levels of difficulty? (2) Are differences of physiological indicators (which may exist) between difficulty levels affected by spatial ability? (3) Which physiological indicators (if any) account for variation in performance on a spatial task with varying difficulty levels? The Modular Cognitive State Gauge model was presented and used to determine which basic physiological sensors (EEG, ECG, EDR and eye-tracking) could validly assess changes in the utilization of two-dimensional spatial resources required to perform a spatial ability dependent task. Thirty-six volunteers (20 female, 16 male) wore minimally invasive physiological sensing devices while executing a challenging computer based puzzle task. Specifically, participants were tested with two measures of spatial ability, received training, a practice session, an experimental trial and completed a subjective workload survey. The results of this experiment confirmed that participants with low spatial ability reported higher subjective workload and performed poorer when compared to those with high spatial ability. Additionally, there were significant changes for a majority of the physiological indicators between two difficulty levels and most importantly three measures (EEG, ECG and eye-tracking) were shown to account for variability in performance on the spatial task

A taxonomy of fatigue concepts and their relation to hearing loss

Fatigue is common in individuals with a variety of chronic health conditions and can have significant negative effects on quality of life. Although limited in scope, recent work suggests persons with hearing loss may be at increased risk for fatigue, in part due to effortful listening that is exacerbated by their hearing impairment. However, the mechanisms responsible for hearing loss-related fatigue, and the efficacy of audiologic interventions for reducing fatigue, remain unclear. To improve our understanding of hearing loss-related fatigue, as a field it is important to develop a common conceptual understanding of this construct. In this article, the broader fatigue literature is reviewed to identify and describe core constructs, consequences, and methods for assessing fatigue and related constructs. Finally, the current knowledge linking hearing loss and fatigue is described and may be summarized as follows: Hearing impairment may increase the risk of subjective fatigue and vigor deficits; adults with hearing loss require more time to recover from fatigue after work and have more work absences; sustained, effortful, listening can be fatiguing; optimal methods for eliciting and measuring fatigue in persons with hearing loss remain unclear and may vary with listening condition; and amplification may minimize decrements in cognitive processing speed during sustained effortful listening. Future research is needed to develop reliable measurement methods to quantify hearing loss-related fatigue, explore factors responsible for modulating fatigue in people with hearing loss, and identify and evaluate potential interventions for reducing hearing loss-related fatigue

Defining, measuring, and modeling passenger's in-vehicle experience and acceptance of automated vehicles

Automated vehicle acceptance (AVA) has been measured mostly subjectively by questionnaires and interviews, with a main focus on drivers inside automated vehicles (AVs). To ensure that AVs are widely accepted by the public, ensuring the acceptance by both drivers and passengers is key. The in-vehicle experience of passengers will determine the extent to which AVs will be accepted by passengers. A comprehensive understanding of potential assessment methods to measure the passenger experience in AVs is needed to improve the in-vehicle experience of passengers and thereby the acceptance. The present work provides an overview of assessment methods that were used to measure a driver's behavior, and cognitive and emotional states during (automated) driving. The results of the review have shown that these assessment methods can be classified by type of data-collection method (e.g., questionnaires, interviews, direct input devices, sensors), object of their measurement (i.e., perception, behavior, state), time of measurement, and degree of objectivity of the data collected. A conceptual model synthesizes the results of the literature review, formulating relationships between the factors constituting the in-vehicle experience and AVA acceptance. It is theorized that the in-vehicle experience influences the intention to use, with intention to use serving as predictor of actual use. The model also formulates relationships between actual use and well-being. A combined approach of using both subjective and objective assessment methods is needed to provide more accurate estimates for AVA, and advance the uptake and use of AVs.Comment: 22 pages, 1 figur

Physiological Measurements for Real-time Fatigue Monitoring in Train Drivers: Review of the State of the Art and Reframing the Problem

The impact of fatigue on train drivers is one of the most important safety-critical issues in rail. It affects drivers’ performance, significantly contributing to railway incidents and accidents. To address the issue of real-time fatigue detection in drivers, most reliable and applicable psychophysiological indicators of fatigue need to be identified. Hence, this paper aims to examine and present the current state of the art in physiological measures for real-time fatigue monitoring that could be applied in the train driving context. Three groups of such measures are identified: EEG, eye-tracking and heart-rate measures. This is the first paper to provide the analysis and review of these measures together on a granular level, focusing on specific variables. Their potential application to monitoring train driver fatigue is discussed in respective sections. A summary of all variables, key findings and issues across these measures is provided. An alternative reconceptualization of the problem is proposed, shifting the focus from the concept of fatigue to that of attention. Several arguments are put forward in support of attention as a better-defined construct, more predictive of performance decrements than fatigue, with serious ramifications on human safety. Proposed reframing of the problem coupled with the detailed presentation of findings for specific relevant variables can serve as a guideline for future empirical research, which is needed in this field

Effects of cognitive tasks on car drivers’ behaviors and physiological responses

The effects of drivers’ engagement in cognitive tasks (i.e., non-visual, cognitively loading activities unrelated to the task of driving) are debated and unclear. Numerous experiments show impaired driver behaviors, yet naturalistic studies typically do not find an increased crash risk. In the future, autonomous driving (AD) is expected to improve traffic safety while allowing safe engagement in cognitive (and other) tasks. Having the opportunity to perform non-driving related tasks while traveling may then motivate drivers to use AD, provided they can actually engage in the tasks. Unfortunately, research on drivers’ engagement in cognitive tasks suffers severe methodological limitations since reliable and unintrusive measures of cognitive load are lacking.The aim of this thesis is therefore to advance the understanding of task-induced cognitive load in the context of traffic safety. This aim is split into two objectives: A) to better understand how drivers’ involvement in cognitive tasks can affect safety-relevant driver behaviors and decisions and B) to provide methodological guidance about assessing cognitive load in drivers using physiological measures.To accomplish Objective A, effects of cognitive tasks on driver behaviors were studied during routine driving and in a safety-critical event in a driving simulator. Also, drivers’ ability to engage in a non-driving related task while using AD in real traffic was explored. In line with the cognitive control hypothesis (Engstr\uf6m et al., 2017), it was found that cognitive tasks negatively affected driver behaviors in situations where cognitive control was needed, for example in intersections—but not in a lead vehicle braking scenario where responses were triggered automatically by visual looming. It was also found that although the number of off-path glances decreased during cognitive load, the timing of the remaining glances was unaffected. Clearly, cognitive load has different effects on different mechanisms. When using AD, drivers were indeed capable of engaging in a non-driving related task—suggesting that AD will be able to fulfill drivers’ desire to perform such tasks while traveling, which may motivate AD usage and thus improve traffic safety (given that AD is truly safer than manual driving). Finally, a simulator study addressing Objective B showed that the measurability of cognitive load was greatly improved by recognizing that multiple coexisting mental responses give rise to different physiological responses. This approach can provide less context-dependent measurements and allows for a better, more detailed understanding of the effects of cognitive tasks.These findings can help improve traffic safety—both by being used in system development, and as part of the systems themselves

Inconsistencies between mental fatigue measures under compensatory control theories

Mental fatigue has traditionally been defined as a condition of reduced cognitive efficiency and performance, accompanied by a subjective feeling of fatigue. Even though we could expect to find associations between the three defining characteristic of mental fatigue (performance impairment, physiological deactivation and subjective fatigue), research has shown that the emergence of inconsistencies between measures is more frequent than one might expect: people proved capable of maintaining adequate performance levels even after having declared themselves fatigued. This could be explained under the compensatory control mechanism models, which state that humans are able to provide additional resources under demanding conditions, but only at the expense of psychophysiological cost and subjective fatigue. We tested this explanation by manipulating task complexity and time performing a simulated air-traffic control task. We collected psychophysiological, performance and subjective data. A decrease in pupil size was seen in the low-aircraft-density condition, while pupil size remained constant in the high-aircraft-density condition. Participants’ task performance was optimal in both conditions, though they showed an increase in subjective feelings of fatigue, especially in the high-complexity task condition. Thus, complexity seemed to trigger compensatory mechanisms, which reallocated extra resources that physiologically activated participants in order to deal with a higher complexity task, whereas subjective fatigue could be acting as a signal to the organism of impending resource depletion. Our findings support compensatory control theories and offer an explanation of inconsistencies between fatigue measures. Further research on compensatory mechanisms is needed to enable better management of fatigue effects to prevent work-related accidents.Spanish Ministry of Industry PI-1461/201