Measuring working memory load effects on electrophysiological markers of attention orienting during a simulated drive

Intersection accidents result in a significant proportion of road fatalities, and attention allocation likely plays a role. Attention allocation may depend on (limited) working memory (WM) capacity. Driving is often combined with tasks increasing WM load, consequently impairing attention orienting. This study (n = 22) investigated WM load effects on event-related potentials (ERPs) related to attention orienting. A simulated driving environment allowed continuous lane-keeping measurement. Participants were asked to orient attention covertly towards the side indicated by an arrow, and to respond only to moving cars appearing on the attended side by pressing a button. WM load was manipulated using a concurrent memory task. ERPs showed typical attentional modulation (cue: contralateral negativity, LDAP; car: N1, P1, SN and P3) under low and high load conditions. With increased WM load, lane-keeping performance improved, while dual task performance degraded (memory task: increased error rate; orienting task: increased false alarms, smaller P3). Practitioner Summary: Intersection driver-support systems aim to improve traffic safety and flow. However, in-vehicle systems induce WM load, increasing the tendency to yield. Traffic flow reduces if drivers stop at inappropriate times, reducing the effectiveness of systems. Consequently, driver-support systems could include WM load measurement during driving in the development phase

SAFECAR: A Brain–Computer Interface and intelligent framework to detect drivers’ distractions

As recently reported by the World Health Organization (WHO), the high use of intelligent devices such as smartphones, multimedia systems, or billboards causes an increase in distraction and, consequently, fatal accidents while driving. The use of EEG-based Brain–Computer Interfaces (BCIs) has been proposed as a promising way to detect distractions. However, existing solutions are not well suited for driving scenarios. They do not consider complementary data sources, such as contextual data, nor guarantee realistic scenarios with real-time communications between components. This work proposes an automatic framework for detecting distractions using BCIs and a realistic driving simulator. The framework employs different supervised Machine Learning (ML)-based models on classifying the different types of distractions using Electroencephalography (EEG) and contextual driving data collected by car sensors, such as line crossings or objects detection. This framework has been evaluated using a driving scenario without distractions and a similar one where visual and cognitive distractions are generated for ten subjects. The proposed framework achieved 83.9% -score with a binary model and 73% with a multiclass model using EEG, improving 7% in binary classification and 8% in multi-class classification by incorporating contextual driving into the training dataset. Finally, the results were confirmed by a neurophysiological study, which revealed significantly higher voltage in selective attention and multitasking

Influence of Task Combination on EEG Spectrum Modulation for Driver Workload Estimation

Dieser Beitrag ist mit Zustimmung des Rechteinhabers aufgrund einer (DFG geförderten) Allianz- bzw. Nationallizenz frei zugänglich.This publication is with permission of the rights owner freely accessible due to an Alliance licence and a national licence (funded by the DFG, German Research Foundation) respectively.Objective: This study investigates the feasibility of using a method based on electroencephalography (EEG) for deriving a driver’s mental workload index. Background: The psychophysiological signals provide sensitive information for human functional states assessment in both laboratory and real-world settings and for building a new communication channel between driver and vehicle that allows for driver workload monitoring. Methods: An experiment combining a lane-change task and n-back task was conducted. The task load levels were manipulated in two dimensions, driving task load and working memory load, with each containing three task load conditions. Results: The frontal theta activity showed significant increases in the working memory load dimension, but differences were not found with the driving task load dimension. However, significant decreases in parietal alpha activity were found when the task load was increased in both dimensions. Task-related differences were also found. The driving task load contributed more to the changes in alpha power, whereas the working memory load contributed more to the changes in theta power. Additionally, these two task load dimensions caused significant interactive effects on both theta and alpha power. Conclusion: These results indicate that EEG technology can provide sensitive information for driver workload detection even if the sensitivities of different EEG parameters tend to be task dependent. Application: One potential future application of this study is to establish a general driver workload estimator that uses EEG signals

Examination of Driver Visual and Cognitive Responses to Billboard Elicited Passive Distraction Using Eye-Fixation Related Potential

Distractions external to a vehicle contribute to visual attention diversion that may cause traffic accidents. As a low-cost and efficient advertising solution, billboards are widely installed on side of the road, especially the motorway. However, the effect of billboards on driver distraction, eye gaze, and cognition has not been fully investigated. This study utilises a customised driving simulator and synchronised electroencephalography (EEG) and eye tracking system to investigate the cognitive processes relating to the processing of driver visual information. A distinction is made between eye gaze fixations relating to stimuli that assist driving and others that may be a source of distraction. The study compares the driver’s cognitive responses to fixations on billboards with fixations on the vehicle dashboard. The measured eye-fixation related potential (EFRP) shows that the P1 components are similar; however, the subsequent N1 and P2 components differ. In addition, an EEG motor response is observed when the driver makes an adjustment of driving speed when prompted by speed limit signs. The experimental results demonstrate that the proposed measurement system is a valid tool in assessing driver cognition and suggests the cognitive level of engagement to the billboard is likely to be a precursor to driver distraction. The experimental results are compared with the human information processing model found in the literature

The Relationship between Real-Time EEG Engagement, Distraction and Workload Estimates and Simulator-Based Driving Performance

Identifying potentially impaired drivers is often dependent upon using cognitive testing from a controlled environment (clinic, laboratory) to predict behavior in a dynamic and unpredictable real world driving environment. The goal of this study was to determine the feasibility, and validity, of using a wireless EEG system to ultimately differentiate between impaired and unimpaired drivers. We utilized the B-Alert X10 portable wireless EEG/ECG system and applied previously validated EEG algorithms estimating engagement, workload, and distraction within a sample of normal control (n = 10) and HIV seropositive individuals (n = 14). Participants underwent a 30-minute fully interactive driving simulation. Overall, the HIV+ group evidenced significantly higher distraction during the simulation. When grouped according to poor and good performers on the simulation (regardless of HIV serostatus), those performing worse on the simulation had higher distraction, with a trend for lower workload, levels. We then examined EEG profiles immediately preceding a crash. Prior to a crash, participants evidenced a significant increase in distraction ~ 10-14 seconds leading up to the crash; the greatest increase was seen in the HIV+ group. These preliminary data support the potential utility of using EEG data in patient populations to identify individuals who might be at risk for impaired drivin

Multimodal attention in a simulated driving environment - Novel approaches to the quantification of attention based on brain activity

The concept of attention is an established focus of study in neurosciences. The quantification of attention during driving can help identify situations in which the driver is not completely aware of the situation. This work deals with the implementation of a setup to simulate a driving environment that enables audiovisual tasks to be embedded into the driving task while acquiring biosignals such as electroencephalography. The main goal of this dissertation was to find a correlation between attention and brain activity as seen on the electroencephalographic activity while driving. By using the principle of phase-amplitude coupling in electroencephalographic signals, it was hypothesized that Theta-Gamma phase-amplitude coupling might correlate to multimodal attention and thus might be eligible as a biomarker of attention in tasks such as driving. Surface electroencephalography was measured simultaneously in drivers and copilots while participating in simulated driving scenarios with varying multimodal attentional demands. The phase-amplitude coupling between Theta-band phase and Gamma-band amplitude from the electroencephalograpic signal was obtained and evaluated. Results showed significant phase-amplitude coupling differences between drivers and copilots in areas related to multimodal attention (prefrontal cortex, frontal eye fields, primary motor cortex, and visual cortex). The results were confirmed by behavioral data acquired during the test (detection task). We conclude that phase-amplitude coupling does function as a biomarker for attentional demand by detecting cortical areas being activated through specific multimodal (in this case, driving) tasks. Additionally, the data acquired in the main work of this thesis was used to test an auditory stimulus reconstruction algorithm previously tested by our work group. The stimulus reconstruction allowed to obtain post-hoc additional information regarding attentional effort during driving (success of the stimulus reconstruction was significantly correlated to auditory effort) and serves as a compliment to the main results. This dissertation thus offers an insight on attentional systems in multimodal situations and the neurophysiological systems underlying attention. It develops methods to measure attention in a driving environment, both as seen using phase-amplitude coupling and by being able to single out auditory effort by reconstructing the auditory stimuli. Finally, these methods can be translated to other activities since they are both based on non-invasive electroencephalography

Physiological-based Driver Monitoring Systems: A Scoping Review

A physiological-based driver monitoring system (DMS) has attracted research interest and has great potential for providing more accurate and reliable monitoring of the driver’s state during a driving experience. Many driving monitoring systems are driver behavior-based or vehicle-based. When these non-physiological based DMS are coupled with physiological-based data analysis from electroencephalography (EEG), electrooculography (EOG), electrocardiography (ECG), and electromyography (EMG), the physical and emotional state of the driver may also be assessed. Drivers’ wellness can also be monitored, and hence, traffic collisions can be avoided. This paper highlights work that has been published in the past five years related to physiological-based DMS. Specifically, we focused on the physiological indicators applied in DMS design and development. Work utilizing key physiological indicators related to driver identification, driver alertness, driver drowsiness, driver fatigue, and drunk driver is identified and described based on the PRISMA Extension for Scoping Reviews (PRISMA-Sc) Framework. The relationship between selected papers is visualized using keyword co-occurrence. Findings were presented using a narrative review approach based on classifications of DMS. Finally, the challenges of physiological-based DMS are highlighted in the conclusion. Doi: 10.28991/CEJ-2022-08-12-020 Full Text: PD

Systems engineering approaches to safety in transport systems

openDuring driving, driver behavior monitoring may provide useful information to prevent road traffic accidents caused by driver distraction. It has been shown that 90% of road traffic accidents are due to human error and in 75% of these cases human error is the only cause. Car manufacturers have been interested in driver monitoring research for several years, aiming to enhance the general knowledge of driver behavior and to evaluate the functional state as it may drastically influence driving safety by distraction, fatigue, mental workload and attention. Fatigue and sleepiness at the wheel are well known risk factors for traffic accidents. The Human Factor (HF) plays a fundamental role in modern transport systems. Drivers and transport operators control a vehicle towards its destination in according to their own sense, physical condition, experience and ability, and safety strongly relies on the HF which has to take the right decisions. On the other hand, we are experiencing a gradual shift towards increasingly autonomous vehicles where HF still constitutes an important component, but may in fact become the "weakest link of the chain", requiring strong and effective training feedback. The studies that investigate the possibility to use biometrical or biophysical signals as data sources to evaluate the interaction between human brain activity and an electronic machine relate to the Human Machine Interface (HMI) framework. The HMI can acquire human signals to analyse the specific embedded structures and recognize the behavior of the subject during his/her interaction with the machine or with virtual interfaces as PCs or other communication systems. Based on my previous experience related to planning and monitoring of hazardous material transport, this work aims to create control models focused on driver behavior and changes of his/her physiological parameters. Three case studies have been considered using the interaction between an EEG system and external device, such as driving simulators or electronical components. A case study relates to the detection of the driver's behavior during a test driver. Another case study relates to the detection of driver's arm movements according to the data from the EEG during a driver test. The third case is the setting up of a Brain Computer Interface (BCI) model able to detect head movements in human participants by EEG signal and to control an electronic component according to the electrical brain activity due to head turning movements. Some videos showing the experimental results are available at https://www.youtube.com/channel/UCj55jjBwMTptBd2wcQMT2tg.openXXXIV CICLO - INFORMATICA E INGEGNERIA DEI SISTEMI/ COMPUTER SCIENCE AND SYSTEMS ENGINEERING - Ingegneria dei sistemiZero, Enric