Driver fatigue monitoring system using support vector machines

Driver fatigue is one of the leading causes of traffic accidents. This paper presents a real-time non-intrusive fatigue monitoring system which exploits the driver's facial expression to detect and alert fatigued drivers. The presented approach adopts the Viola-Jones classifier to detect the driver's facial features. The correlation coefficient template matching method is then applied to derive the state of each feature on a frame by frame basis. A Support Vector Machine (SVM) is finally integrated within the system to classify the facial appearance as either fatigued or otherwise. Using this simple and cheap implementation, the overall system achieved an accuracy of 95.2%, outperforming other developed systems employing expensive hardware to reach the same objective.peer-reviewe

Computing driver tiredness and fatigue in automobile via eye tracking and body movements

The aim of this paper is to classify the driver tiredness and fatigue in automobile via eye tracking and body movements using deep learning based Convolutional Neural Network (CNN) algorithm. Vehicle driver face localization serves as one of the most widely used real-world applications in fields like toll control, traffic accident scene analysis, and suspected vehicle tracking. The research proposed a CNN classifier for simultaneously localizing the region of human face and eye positioning. The classifier, rather than bounding rectangles, gives bounding quadrilaterals, which gives a more precise indication for vehicle driver face localization. The adjusted regions are preprocessed to remove noise and passed to the CNN classifier for real time processing. The preprocessing of the face features extracts connected components, filters them by size, and groups them into face expressions. The employed CNN is the well-known technology for human face recognition. One we aim to extract the facial landmarks from the frames, we will then leverage classification models and deep learning based convolutional neural networks that predict the state of the driver as 'Alert' or 'Drowsy' for each of the frames extracted. The CNN model could predict the output state labels (Alert/Drowsy) for each frame, but we wanted to take care of sequential image frames as that is extremely important while predicting the state of an individual. The process completes, if all regions have a sufficiently high score or a fixed number of retries are exhausted. The output consists of the detected human face type, the list of regions including the extracted mouth and eyes with recognition reliability through CNN with an accuracy of 98.57% with 100 epochs of training and testing

Driver Fatigue Detection using Mean Intensity, SVM, and SIFT

Driver fatigue is one of the major causes of accidents. This has increased the need for driver fatigue detection mechanism in the vehicles to reduce human and vehicle loss during accidents. In the proposed scheme, we capture videos from a camera mounted inside the vehicle. From the captured video, we localize the eyes using Viola-Jones algorithm. Once the eyes have been localized, they are classified as open or closed using three different techniques namely mean intensity, SVM, and SIFT. If eyes are found closed for a considerable amount of time, it indicates fatigue and consequently an alarm is generated to alert the driver. Our experiments show that SIFT outperforms both mean intensity and SVM, achieving an average accuracy of 97.45% on a dataset of five videos, each having a length of two minutes

A Study of Psychophysical Factor for Driver Fatigue Using Mathematical Model / Mohammad Firdaus Ani...[et al.]

The purpose behind the study is to develop the mathematical modeling of a psychophysical factors for drivers’ fatigue, which can predict the relationship between the process input parameters and output response. Ten subjects participated in this study. The electromyography (EMG) responses were taken and evaluated using an Electromyography (EMG) device. The psychophysical factor such as muscle fatigue is one of the contributors to the drivers’ fatigue problem, which led to road accidents among Malaysian. To efficiently formulate and develop the mathematical modeling of a psychophysical factors, the process modeling using Response Surface Methodology (RSM) was proposed. Design Expert 8.0.6 software was used in the RSM analysis. The mathematical model was successfully developed and validated. The modeling validation runs were within the 90% prediction interval of the developed model, and the residual errors compared to the predicted values were less than 10%. The significant parameters that influenced the muscle fatigue were also identified. Muscle fatigue was influenced by the time exposure, type of road, gender, interaction between time exposure and type of road, and interaction between type of road and gender. Throughout this study, the authors believe there is a new contribution to the body of knowledge

Electroencephalogram (EEG)-based systems to monitor driver fatigue: a review

An efficient system that is capable to detect driver fatigue is urgently needed to help avoid road crashes. Recently, there has been an increase of interest in the application of electroencephalogram (EEG) to detect driver fatigue. Feature extraction and signal classification are the most critical steps in the EEG signal analysis. A reliable method for feature extraction is important to obtain robust signal classification. Meanwhile, a robust algorithm for signal classification will accurately classify the feature to a particular class. This paper concisely reviews the pros and cons of the existing techniques for feature extraction and signal classification and its fatigue detection accuracy performance. The integration of combined entropy (feature extraction) with support vector machine (SVM) and random forest (classifier) gives the best fatigue detection accuracy of 98.7% and 97.5% respectively. The outcomes from this study will guide future researchers in choosing a suitable technique for feature extraction and signal classification for EEG data processing and shed light on directions for future research and development of driver fatigue countermeasures

Detection of Driver Drowsiness and Distraction Using Computer Vision and Machine Learning Approaches

Drowsiness and distracted driving are leading factor in most car crashes and near-crashes. This research study explores and investigates the applications of both conventional computer vision and deep learning approaches for the detection of drowsiness and distraction in drivers. In the first part of this MPhil research study conventional computer vision approaches was studied to develop a robust drowsiness and distraction system based on yawning detection, head pose detection and eye blinking detection. These algorithms were implemented by using existing human crafted features. Experiments were performed for the detection and classification with small image datasets to evaluate and measure the performance of system. It was observed that the use of human crafted features together with a robust classifier such as SVM gives better performance in comparison to previous approaches. Though, the results were satisfactorily, there are many drawbacks and challenges associated with conventional computer vision approaches, such as definition and extraction of human crafted features, thus making these conventional algorithms to be subjective in nature and less adaptive in practice. In contrast, deep learning approaches automates the feature selection process and can be trained to learn the most discriminative features without any input from human. In the second half of this research study, the use of deep learning approaches for the detection of distracted driving was investigated. It was observed that one of the advantages of the applied methodology and technique for distraction detection includes and illustrates the contribution of CNN enhancement to a better pattern recognition accuracy and its ability to learn features from various regions of a human body simultaneously. The comparison of the performance of four convolutional deep net architectures (AlexNet, ResNet, MobileNet and NASNet) was carried out, investigated triplet training and explored the impact of combining a support vector classifier (SVC) with a trained deep net. The images used in our experiments with the deep nets are from the State Farm Distracted Driver Detection dataset hosted on Kaggle, each of which captures the entire body of a driver. The best results were obtained with the NASNet trained using triplet loss and combined with an SVC. It was observed that one of the advantages of deep learning approaches are their ability to learn discriminative features from various regions of a human body simultaneously. The ability has enabled deep learning approaches to reach accuracy at human level.