Physiological-based Driver Monitoring Systems: A Scoping Review

A physiological-based driver monitoring system (DMS) has attracted research interest and has great potential for providing more accurate and reliable monitoring of the driver’s state during a driving experience. Many driving monitoring systems are driver behavior-based or vehicle-based. When these non-physiological based DMS are coupled with physiological-based data analysis from electroencephalography (EEG), electrooculography (EOG), electrocardiography (ECG), and electromyography (EMG), the physical and emotional state of the driver may also be assessed. Drivers’ wellness can also be monitored, and hence, traffic collisions can be avoided. This paper highlights work that has been published in the past five years related to physiological-based DMS. Specifically, we focused on the physiological indicators applied in DMS design and development. Work utilizing key physiological indicators related to driver identification, driver alertness, driver drowsiness, driver fatigue, and drunk driver is identified and described based on the PRISMA Extension for Scoping Reviews (PRISMA-Sc) Framework. The relationship between selected papers is visualized using keyword co-occurrence. Findings were presented using a narrative review approach based on classifications of DMS. Finally, the challenges of physiological-based DMS are highlighted in the conclusion. Doi: 10.28991/CEJ-2022-08-12-020 Full Text: PD

Optimal Feature Search for Vigilance Estimation Using Deep Reinforcement Learning

A low level of vigilance is one of the main reasons for traffic and industrial accidents. We conducted experiments to evoke the low level of vigilance and record physiological data through single-channel electroencephalogram (EEG) and electrocardiogram (ECG) measurements. In this study, a deep Q-network (DQN) algorithm was designed, using conventional feature engineering and deep convolutional neural network (CNN) methods, to extract the optimal features. The DQN yielded the optimal features: two CNN features from ECG and two conventional features from EEG. The ECG features were more significant for tracking the transitions within the alertness continuum with the DQN. The classification was performed with a small number of features, and the results were similar to those from using all of the features. This suggests that the DQN could be applied to investigating biomarkers for physiological responses and optimizing the classification system to reduce the input resources

Physiological Approach To Characterize Drowsiness In Simulated Flight Operations During Window Of Circadian Low

Drowsiness is a psycho-physiological transition from awake towards falling sleep and its detection is crucial in aviation industries. It is a common cause for pilot’s error due to unpredictable work hours, longer flight periods, circadian disruption, and insufficient sleep. The pilots’ are prone towards higher level of drowsiness during window of circadian low (2:00 am- 6:00 am). Airplanes require complex operations and lack of alertness increases accidents. Aviation accidents are much disastrous and early drowsiness detection helps to reduce such accidents. This thesis studied physiological signals during drowsiness from 18 commercially-rated pilots in flight simulator. The major aim of the study was to observe the feasibility of physiological signals to predict drowsiness. In chapter 3, the spectral behavior of electroencephalogram (EEG) was studied via power spectral density and coherence. The delta power reduced and alpha power increased significantly (

A LightGBM-Based EEG Analysis Method for Driver Mental States Classification

Fatigue driving can easily lead to road traffic accidents and bring great harm to individuals and families. Recently, electroencephalography- (EEG-) based physiological and brain activities for fatigue detection have been increasingly investigated. However, how to find an effective method or model to timely and efficiently detect the mental states of drivers still remains a challenge. In this paper, we combine common spatial pattern (CSP) and propose a light-weighted classifier, LightFD, which is based on gradient boosting framework for EEG mental states identification. ,e comparable results with traditional classifiers, such as support vector machine (SVM), convolutional neural network (CNN), gated recurrent unit (GRU), and large margin nearest neighbor (LMNN), show that the proposed model could achieve better classification performance, as well as the decision efficiency. Furthermore, we also test and validate that LightFD has better transfer learning performance in EEG classification of driver mental states. In summary, our proposed LightFD classifier has better performance in real-time EEG mental state prediction, and it is expected to have broad application prospects in practical brain-computer interaction (BCI)

Obstructive Sleep Apnea Detection based on ECG Signal using Statistical Features of Wavelet Subband

One of the respiratory disorders is obstructive sleep apnea (OSA). OSA occurs when a person sleeps. OSA causes breathing to stop momentarily due to obstruction in the airways. In this condition, people with OSA will be deprived of oxygen, sleep awake and short of breath. Diagnosis of OSA by a doctor can be done by confirming the patient\u27s complaints during sleep, sleep patterns, and other symptoms that point to OSA. Another way of diagnosing OSA is a polysomnography (PSG) examination in the laboratory to analyze apnea and hypopnea. However, this examination tends to be high cost and time consuming. An alternative diagnostic tool is an electrocardiogram (ECG) examination referring to changes in the mechanism of ECG-derived respiration (EDR). So digital ECG signal analysis is a potential tool for OSA detection. Therefore, in this study, it is proposed to classify OSA based on ECG signals using wavelets and statistical parameters. Statistical parameters include mean, variance, skewness kurtosis entropy calculated on the signal decomposition results. The validation performance of the proposed method is carried out using a support vector machine, k-nearest neighbor (k-NN), and ensemble classifier. The proposed method produces the highest accuracy of 89.2% using a bagged tree where all features are used as predictors. From this study, it is hoped that ECG signal analysis can be used to complete clinical diagnosis in detecting OSA

Detecting driver fatigue using heart rate variability: A systematic review

Driver fatigue detection systems have potential to improve road safety by preventing crashes and saving lives. Conventional driver monitoring systems based on driving performance and facial features may be challenged by the application of automated driving systems. This limitation could potentially be overcome by monitoring systems based on physiological measurements. Heart rate variability (HRV) is a physiological marker of interest for detecting driver fatigue that can be measured during real life driving. This systematic review investigates the relationship between HRV measures and driver fatigue, as well as the performance of HRV based fatigue detection systems. With the applied eligibility criteria, 18 articles were identified in this review. Inconsistent results can be found within the studies that investigated differences of HRV measures between alert and fatigued drivers. For studies that developed HRV based fatigue detection systems, the detection performance showed a large variation, where the detection accuracy ranged from 44% to 100%. The inconsistency and variation of the results can be caused by differences in several key aspects in the study designs. Progress in this field is needed to determine the relationship between HRV and different fatigue causal factors and its connection to driver performance. To be deployed, HRV-based fatigue detection systems need to be thoroughly tested in real life conditions with good coverage of relevant driving scenarios and a sufficient number of participants

Deep learning for healthcare applications based on physiological signals: A review

Background and objective: We have cast the net into the ocean of knowledge to retrieve the latest scientific research on deep learning methods for physiological signals. We found 53 research papers on this topic, published from 01.01.2008 to 31.12.2017. Methods: An initial bibliometric analysis shows that the reviewed papers focused on Electromyogram(EMG), Electroencephalogram(EEG), Electrocardiogram(ECG), and Electrooculogram(EOG). These four categories were used to structure the subsequent content review. Results: During the content review, we understood that deep learning performs better for big and varied datasets than classic analysis and machine classification methods. Deep learning algorithms try to develop the model by using all the available input. Conclusions: This review paper depicts the application of various deep learning algorithms used till recently, but in future it will be used for more healthcare areas to improve the quality of diagnosi

Integration of Simultaneous Resting-State EEG, fMRI, and Eye Tracker Methods to Determine and Verify EEG Vigilance Measure

Resting-state functional magnetic resonance imaging (rsfMRI) has been widely used for studying the (presumably) awake and alert human brain. Although rsfMRI scans are typically collected while individuals are instructed to focus their eyes on a fixation cross, objective and verified experimental measures to quantify degree of alertness (e.g., vigilance) are not readily available. Concurrent electroencephalography and fMRI (EEG-fMRI) measurements are also widely used to study human brain with high spatial/temporal resolution. EEG is the modality extensively used for estimating vigilance during eyes-closed resting state. On the other hand, pupil size measured using an eye-tracker device could provide an indirect index of vigilance. In this study, we investigated whether simultaneous multimodal EEG-fMRI combined with eye-tracker measurements can be used to determine EEG signal feature associated with pupil size changes (e.g., vigilance measure) in healthy human subjects (n=10) during brain rest with eyes open. We found that EEG frontal and occipital beta power (FOBP) correlates with pupil size changes, an indirect index for locus coeruleus activity implicated in vigilance regulation (r=0.306, p<0.001). Moreover, FOBP also correlated with heart rate (r=0.255, p<0.001), as well as several brain regions in the anti-correlated network, including the bilateral insula and inferior parietal lobule. These results support the conclusion that FOBP is an objective measure of vigilance in healthy human subjects

Drowsiness detection in drivers with a smartwatch

The main objective of this work is to detect early if a driver shows symptoms of sleepiness that indicate that he/she is falling asleep and, in that case, generate an alert to wake him/her up. To solve this problem, an application has been designed that collects various parameters, through a smartwatch while driving. First, the application detects the driving action. Then, it collects information about the most significant physiological variables of a person while driving. On the other hand, given the high level of sensitivity of the data managed in the designed application, in this work special attention has been paid to the security of the implementation. The proposed solution improves road safety, reducing the number of accidents caused by drowsiness while driving