Driving Fatigue Recognition with Functional Connectivity Based on Phase Synchronization

Accumulating evidences showed that the optimal brain network topology was altered with the progression of fatigue during car driving. However, the extent of discriminative power of functional connectivity that contribute to the driving fatigue detection is still unclear. In this study, we extracted two types of features (network properties and critical connections) to explore their usefulness in driving fatigue detection. EEG data were recorded twice from twenty healthy subjects during a simulated driving experiment. Multi-band functional connectivity matrices were established using phase lag index, which serve as input for the following graph theoretical analysis and critical connections determination between the most vigilant and fatigued states. We found a reorganisation of brain network towards less efficient architecture in fatigue state across all frequency bands. Further interrogations showed that the discriminative connections were mainly connected to frontal areas, i.e., most of the increased connections are from frontal pole to parietal or occipital regions. Moreover, we achieved a satisfactory classification accuracy (96.76%) using the discriminative connection features in β band. Our study demonstrated that graph theoretical properties and critical connections are of discriminative power for manifesting fatigue alterations and the critical connection is an efficient feature for driving fatigue detection

A complex network perspective on clinical science

Contemporary classification systems for mental disorders assume that abnormal behaviors are expressions of latent disease entities. An alternative to the latent disease model is the complex network approach. Instead of assuming that symptoms arise from an underlying disease entity, the complex network approach holds that disorders exist as systems of interrelated elements of a network. This approach also provides a framework for the understanding of therapeutic change. Depending on the structure of the network, change can occur abruptly once the network reaches a critical threshold (the tipping point). Homogeneous and highly connected networks often recover more slowly from local perturbations when the network approaches the tipping point, potentially making it possible to predict treatment change, relapse, and recovery. In this article, we discuss the complex network approach as an alternative to the latent disease model and its implications for classification, therapy, relapse, and recovery.R34 MH086668 - NIMH NIH HHS; R01 AT007257 - NCCIH NIH HHS; R21 MH101567 - NIMH NIH HHS; R34 MH099311 - NIMH NIH HHS; R21 MH102646 - NIMH NIH HHS; K23 MH100259 - NIMH NIH HHS; R01 MH099021 - NIMH NIH HH

Multiplex Limited Penetrable Horizontal Visibility Graph from EEG Signals for Driver Fatigue Detection

This work was supported by National Natural Science Foundation of China under Grant Nos. 61473203, 61873181 and the Natural Science Foundation of Tianjin, China under Grant No. 16JCYBJC18200.Peer reviewedPostprin

Phase Fluctuation Analysis in Functional Brain Networks of Scaling EEG for Driver Fatigue Detection

The characterization of complex patterns arising from electroencephalogram (EEG) is an important problem with significant applications in identifying different mental states. Based on the operational EEG of drivers, a method is proposed to characterize and distinguish different EEG patterns. The EEG measurements from seven professional taxi drivers were collected under different states. The phase characterization method was used to calculate the instantaneous phase from the EEG measurements. Then, the optimization of drivers’ EEG was realized through performing common spatial pattern analysis. The structures and scaling components of the brain networks from optimized EEG measurements are sensitive to the EEG patterns. The effectiveness of the method is demonstrated, and its applicability is articulated.</p

Sensors and Systems for Monitoring Mental Fatigue: A systematic review

Mental fatigue is a leading cause of motor vehicle accidents, medical errors, loss of workplace productivity, and student disengagements in e-learning environment. Development of sensors and systems that can reliably track mental fatigue can prevent accidents, reduce errors, and help increase workplace productivity. This review provides a critical summary of theoretical models of mental fatigue, a description of key enabling sensor technologies, and a systematic review of recent studies using biosensor-based systems for tracking mental fatigue in humans. We conducted a systematic search and review of recent literature which focused on detection and tracking of mental fatigue in humans. The search yielded 57 studies (N=1082), majority of which used electroencephalography (EEG) based sensors for tracking mental fatigue. We found that EEG-based sensors can provide a moderate to good sensitivity for fatigue detection. Notably, we found no incremental benefit of using high-density EEG sensors for application in mental fatigue detection. Given the findings, we provide a critical discussion on the integration of wearable EEG and ambient sensors in the context of achieving real-world monitoring. Future work required to advance and adapt the technologies toward widespread deployment of wearable sensors and systems for fatigue monitoring in semi-autonomous and autonomous industries is examined.Comment: 19 Pages, 3 Figure

Systematic Review of Experimental Paradigms and Deep Neural Networks for Electroencephalography-Based Cognitive Workload Detection

This article summarizes a systematic review of the electroencephalography (EEG)-based cognitive workload (CWL) estimation. The focus of the article is twofold: identify the disparate experimental paradigms used for reliably eliciting discreet and quantifiable levels of cognitive load and the specific nature and representational structure of the commonly used input formulations in deep neural networks (DNNs) used for signal classification. The analysis revealed a number of studies using EEG signals in its native representation of a two-dimensional matrix for offline classification of CWL. However, only a few studies adopted an online or pseudo-online classification strategy for real-time CWL estimation. Further, only a couple of interpretable DNNs and a single generative model were employed for cognitive load detection till date during this review. More often than not, researchers were using DNNs as black-box type models. In conclusion, DNNs prove to be valuable tools for classifying EEG signals, primarily due to the substantial modeling power provided by the depth of their network architecture. It is further suggested that interpretable and explainable DNN models must be employed for cognitive workload estimation since existing methods are limited in the face of the non-stationary nature of the signal.Comment: 10 Pages, 4 figure

Applications of brain imaging methods in driving behaviour research

Applications of neuroimaging methods have substantially contributed to the scientific understanding of human factors during driving by providing a deeper insight into the neuro-cognitive aspects of driver brain. This has been achieved by conducting simulated (and occasionally, field) driving experiments while collecting driver brain signals of certain types. Here, this sector of studies is comprehensively reviewed at both macro and micro scales. Different themes of neuroimaging driving behaviour research are identified and the findings within each theme are synthesised. The surveyed literature has reported on applications of four major brain imaging methods. These include Functional Magnetic Resonance Imaging (fMRI), Electroencephalography (EEG), Functional Near-Infrared Spectroscopy (fNIRS) and Magnetoencephalography (MEG), with the first two being the most common methods in this domain. While collecting driver fMRI signal has been particularly instrumental in studying neural correlates of intoxicated driving (e.g. alcohol or cannabis) or distracted driving, the EEG method has been predominantly utilised in relation to the efforts aiming at development of automatic fatigue/drowsiness detection systems, a topic to which the literature on neuro-ergonomics of driving particularly has shown a spike of interest within the last few years. The survey also reveals that topics such as driver brain activity in semi-automated settings or the brain activity of drivers with brain injuries or chronic neurological conditions have by contrast been investigated to a very limited extent. Further, potential topics in relation to driving behaviour are identified that could benefit from the adoption of neuroimaging methods in future studies

Passive BCI in operational environments: insights, recent advances and future trends

this mini-review aims to highlight recent important aspects to consider and evaluate when passive Brain-Computer Interface (pBCI) systems would be developed and used in operational environments, and remarks future directions of their applications