Automated drowsiness detection for improved driving safety

Several approaches were proposed for the detection and prediction of drowsiness. The approaches can be categorized as estimating the fitness of duty, modeling the sleep-wake rhythms, measuring the vehicle based performance and online operator monitoring. Computer vision based online operator monitoring approach has become prominent due to its predictive ability of detecting drowsiness. Previous studies with this approach detect driver drowsiness primarily by making preassumptions about the relevant behavior, focusing on blink rate, eye closure, and yawning. Here we employ machine learning to datamine actual human behavior during drowsiness episodes. Automatic classifiers for 30 facial actions from the Facial Action Coding system were developed using machine learning on a separate database of spontaneous expressions. These facial actions include blinking and yawn motions, as well as a number of other facial movements. In addition, head motion was collected through automatic eye tracking and an accelerometer. These measures were passed to learning-based classifiers such as Adaboost and multinomial ridge regression. The system was able to predict sleep and crash episodes during a driving computer game with 96% accuracy within subjects and above 90% accuracy across subjects. This is the highest prediction rate reported to date for detecting real drowsiness. Moreover, the analysis revealed new information about human behavior during drowsy drivin

A Hybrid Approach to Detect Driver Drowsiness Utilizing Physiological Signals to Improve System Performance and Wearability

Driver drowsiness is a major cause of fatal accidents, injury, and property damage, and has become an area of substantial research attention in recent years. The present study proposes a method to detect drowsiness in drivers which integrates features of electrocardiography (ECG) and electroencephalography (EEG) to improve detection performance. The study measures differences between the alert and drowsy states from physiological data collected from 22 healthy subjects in a driving simulator-based study. A monotonous driving environment is used to induce drowsiness in the participants. Various time and frequency domain feature were extracted from EEG including time domain statistical descriptors, complexity measures and power spectral measures. Features extracted from the ECG signal included heart rate (HR) and heart rate variability (HRV), including low frequency (LF), high frequency (HF) and LF/HF ratio. Furthermore, subjective sleepiness scale is also assessed to study its relationship with drowsiness. We used paired t-tests to select only statistically significant features (p < 0.05), that can differentiate between the alert and drowsy states effectively. Significant features of both modalities (EEG and ECG) are then combined to investigate the improvement in performance using support vector machine (SVM) classifier. The other main contribution of this paper is the study on channel reduction and its impact to the performance of detection. The proposed method demonstrated that combining EEG and ECG has improved the system’s performance in discriminating between alert and drowsy states, instead of using them alone. Our channel reduction analysis revealed that an acceptable level of accuracy (80%) could be achieved by combining just two electrodes (one EEG and one ECG), indicating the feasibility of a system with improved wearability compared with existing systems involving many electrodes. Overall, our results demonstrate that the proposed method can be a viable solution for a practical driver drowsiness system that is both accurate and comfortable to wear

Learning to Estimate Driver Drowsiness from Car Acceleration Sensors using Weakly Labeled Data

This paper addresses the learning task of estimating driver drowsiness from the signals of car acceleration sensors. Since even drivers themselves cannot perceive their own drowsiness in a timely manner unless they use burdensome invasive sensors, obtaining labeled training data for each timestamp is not a realistic goal. To deal with this difficulty, we formulate the task as a weakly supervised learning. We only need to add labels for each complete trip, not for every timestamp independently. By assuming that some aspects of driver drowsiness increase over time due to tiredness, we formulate an algorithm that can learn from such weakly labeled data. We derive a scalable stochastic optimization method as a way of implementing the algorithm. Numerical experiments on real driving datasets demonstrate the advantages of our algorithm against baseline methods.Comment: Accepted by ICASSP202

An EEG-based perceptual function integration network for application to drowsy driving

© 2015 Elsevier B.V. All rights reserved. Drowsy driving is among the most critical causes of fatal crashes. Thus, the development of an effective algorithm for detecting a driver's cognitive state demands immediate attention. For decades, studies have observed clear evidence using electroencephalography that the brain's rhythmic activities fluctuate from alertness to drowsiness. Recognition of this physiological signal is the major consideration of neural engineering for designing a feasible countermeasure. This study proposed a perceptual function integration system which used spectral features from multiple independent brain sources for application to recognize the driver's vigilance state. The analysis of brain spectral dynamics demonstrated physiological evidenced that the activities of the multiple cortical sources were highly related to the changes of the vigilance state. The system performances showed a robust and improved accuracy as much as 88% higher than any of results performed by a single-source approach

Driver Drowsiness Detection with Commercial EEG Headsets

Driver Drowsiness is one of the leading causes of road accidents. Electroencephalography (EEG) is highly affected by drowsiness; hence, EEG-based methods detect drowsiness with the highest accuracy. Developments in manufacturing dry electrodes and headsets have made recording EEG more convenient. Vehicle-based features used for detecting drowsiness are easy to capture but do not have the best performance. In this paper, we investigated the performance of EEG signals recorded in 4 channels with commercial headsets against the vehicle-based technique in drowsiness detection. We recorded EEG signals of 50 volunteers driving a simulator in drowsy and alert states by commercial devices. The observer rating of the drowsiness method was used to determine the drowsiness level of the subjects. The meaningful separation of vehicle-based features, recorded by the simulator, and EEG-based features of the two states of drowsiness and alertness have been investigated. The comparison results indicated that the EEG-based features are separated with lower p-values than the vehicle-based ones in the two states. It is concluded that EEG headsets can be feasible alternatives with better performance compared to vehicle-based methods for detecting drowsiness.Comment: 546 Preprint version of the manuscript published in the proceedings of the 10th RSI International Conference on Robotics and Mechatronics (ICRoM 2022), Nov. 15-18, 2022, Tehran, Ira

Real-time drowsiness detection using wearable, lightweight EEG sensors

Driver drowsiness has always been a major concern for researchers and road use administrators. It has led to countless deaths accounting to significant percentile of deaths world over. Researchers have attempted to determine driver drowsiness using the following measures: (1) subjective measures (2) vehicle-based measures; (3) behavioral measures and (4) physiological measures.;Studies carried out to assess the efficacy of all the four measures, have brought out significant weaknesses in each of these measures. However detailed and comprehensive review has indicated that Physiological Measure namely EEG signal analysis provides most reliable and accurate information on driver drowsiness. In this paper a brief review of systems, and issues associated with them has been discussed with a view to evolve a novel system based on EEG signals especially for use in mine vehicles.;The feasibility of real-time drowsiness detection using commercially available, off-the-shelf, lightweight, wearable EEG sensors is explored. While EEG signals are known to be reliable indicators of fatigue and drowsiness, they have not been used widely due to their size and form factor. But the use of light-weight wearable EEGs alleviates this concern. Spectral analysis of EEG signals from these sensors using support vector machines is shown to classify drowsy states with high accuracy.;The system is validated using data collected on 23 subjects in fresh and drowsy states. The EEG signals are also used to characterize the blink duration and frequency of subjects. However, classification of drowsy states using blink analysis is shown to have lower accuracy than that using spectral analysis

Drivers’ drowsiness detection based on an optimized random forest classification and single-channel electroencephalogram

The state of functioning (posture) of a driver at the wheel of a car involves a complex set of psychological, physiological, and physical parameters. This combination induces fatigue, which manifests itself in repeated yawning, stinging eyes, a frozen gaze, a stiff and painful neck, back pain, and other signs. The driver may fight fatigue for a few moments, but it inevitably leads to drowsiness, periods of micro-sleep, and then falling asleep. At the first signs of drowsiness, the risk of an accident becomes immense. In Morocco, drowsiness at the wheel is the cause of 1/3 of fatal accidents on the freeways. Thus, in this paper, a new hybrid data analysis and an efficient machine learning algorithm are designed to detect the drowsiness of drivers who spend most of their time behind the wheel over long distances (older than 35 years). This analysis is based on a single channel of electroencephalogram (EEG) recordings using time, frequency fast Fourier transform (FFT), and power spectral density (PSD) analysis. To distinguish between the two states of alertness and drowsiness, several features were extracted from each domain (time, FFT, and PSD), and subjected to different classifier architectures to conduct a general comparison and achieve the highest detection accuracy (98.5%) and best time consumption (13 milliseconds)