Classification of driver fatigue in an electroencephalography-based countermeasure system with source separation module

© 2015 IEEE. An electroencephalography (EEG)-based counter measure device could be used for fatigue detection during driving. This paper explores the classification of fatigue and alert states using power spectral density (PSD) as a feature extractor and fuzzy swarm based-artificial neural network (ANN) as a classifier. An independent component analysis of entropy rate bound minimization (ICA-ERBM) is investigated as a novel source separation technique for fatigue classification using EEG analysis. A comparison of the classification accuracy of source separator versus no source separator is presented. Classification performance based on 43 participants without the inclusion of the source separator resulted in an overall sensitivity of 71.67%, a specificity of 75.63% and an accuracy of 73.65%. However, these results were improved after the inclusion of a source separator module, resulting in an overall sensitivity of 78.16%, a specificity of 79.60% and an accuracy of 78.88% (p < 0.05)

Channels selection using independent component analysis and scalp map projection for EEG-based driver fatigue classification

© 2017 IEEE. This paper presents a classification of driver fatigue with electroencephalography (EEG) channels selection analysis. The system employs independent component analysis (ICA) with scalp map back projection to select the dominant of EEG channels. After channel selection, the features of the selected EEG channels were extracted based on power spectral density (PSD), and then classified using a Bayesian neural network. The results of the ICA decomposition with the back-projected scalp map and a threshold showed that the EEG channels can be reduced from 32 channels into 16 dominants channels involved in fatigue assessment as chosen channels, which included AF3, F3, FC1, FC5, T7, CP5, P3, O1, P4, P8, CP6, T8, FC2, F8, AF4, FP2. The result of fatigue vs. alert classification of the selected 16 channels yielded a sensitivity of 76.8%, specificity of 74.3% and an accuracy of 75.5%. Also, the classification results of the selected 16 channels are comparable to those using the original 32 channels. So, the selected 16 channels is preferable for ergonomics improvement of EEG-based fatigue classification system

Detection of gait initiation Failure in Parkinson's disease based on wavelet transform and Support Vector Machine

© 2017 IEEE. Gait initiation Failure (GIF) is the situation in which patients with Parkinson's disease (PD) feel as if their feet get 'stuck' to the floor when initiating their first steps. GIF is a subtype of Freezing of Gait (FOG) and often leads to falls and related injuries. Understanding of neurobiological mechanisms underlying GIF has been limited by difficulties in eliciting and objectively characterizing such gait phenomena in the clinical setting. Studies investigating the effects of GIF on brain activity using EEG offer the potential to study such behavior. In this preliminary study, we present a novel methodology where wavelet transform was used for feature extraction and Support Vector Machine for classifying GIF events in five patients with PD and FOG. To deal with the large amount of EEG data, a Principal Component Analysis (PCA) was applied to reduce the data dimension from 15 EEG channels into 6 principal components (PCs), retaining 93% of the information. Independent Component Analysis using Entropy Bound Minimization (ICA-EBM) was applied to 6 PCs for source separation with the aim of improving detection ability of GIF events as compared to the normal initiation of gait (Good Starts). The results of this analysis demonstrated the correct identification of GIF episodes with an 83.1% sensitivity, 89.5% specificity and 86.3% accuracy. These results suggest that our proposed methodology is a promising non-invasive approach to improve GIF detection in PD and FOG

Detection of turning freeze in Parkinson's disease based on S-transform decomposition of EEG signals

© 2017 IEEE. Freezing of Gait (FOG) is a highly debilitating and poorly understood symptom of Parkinson's disease (PD), causing severe immobility and decreased quality of life. Turning Freezing (TF) is known as the most common sub-type of FOG, also causing the highest rate of falls in PD patients. During a TF, the feet of PD patients appear to become stuck whilst making a turn. This paper presents an electroencephalography (EEG) based classification method for detecting turning freezing episodes in six PD patients during Timed Up and Go Task experiments. Since EEG signals have a time-variant nature, time-frequency Stockwell Transform (S-Transform) techniques were used for feature extraction. The EEG sources were separated by means of independent component analysis using entropy bound minimization (ICA-EBM). The distinctive frequency-based features of selected independent components of EEG were extracted and classified using Bayesian Neural Networks. The classification demonstrated a high sensitivity of 84.2%, a specificity of 88.0% and an accuracy of 86.2% for detecting TF. These promising results pave the way for the development of a real-time device for detecting different sub-types of FOG during ambulation

Computing driver tiredness and fatigue in automobile via eye tracking and body movements

The aim of this paper is to classify the driver tiredness and fatigue in automobile via eye tracking and body movements using deep learning based Convolutional Neural Network (CNN) algorithm. Vehicle driver face localization serves as one of the most widely used real-world applications in fields like toll control, traffic accident scene analysis, and suspected vehicle tracking. The research proposed a CNN classifier for simultaneously localizing the region of human face and eye positioning. The classifier, rather than bounding rectangles, gives bounding quadrilaterals, which gives a more precise indication for vehicle driver face localization. The adjusted regions are preprocessed to remove noise and passed to the CNN classifier for real time processing. The preprocessing of the face features extracts connected components, filters them by size, and groups them into face expressions. The employed CNN is the well-known technology for human face recognition. One we aim to extract the facial landmarks from the frames, we will then leverage classification models and deep learning based convolutional neural networks that predict the state of the driver as 'Alert' or 'Drowsy' for each of the frames extracted. The CNN model could predict the output state labels (Alert/Drowsy) for each frame, but we wanted to take care of sequential image frames as that is extremely important while predicting the state of an individual. The process completes, if all regions have a sufficiently high score or a fixed number of retries are exhausted. The output consists of the detected human face type, the list of regions including the extracted mouth and eyes with recognition reliability through CNN with an accuracy of 98.57% with 100 epochs of training and testing

Comparison of Different Features and Classifiers for Driver Fatigue Detection Based on a Single EEG Channel

Driver fatigue has become an important factor to traffic accidents worldwide, and effective detection of driver fatigue has major significance for public health. The purpose method employs entropy measures for feature extraction from a single electroencephalogram (EEG) channel. Four types of entropies measures, sample entropy (SE), fuzzy entropy (FE), approximate entropy (AE), and spectral entropy (PE), were deployed for the analysis of original EEG signal and compared by ten state-of-theart classifiers. Results indicate that optimal performance of single channel is achieved using a combination of channel CP4, feature FE, and classifier Random Forest (RF). The highest accuracy can be up to 96.6%, which has been able to meet the needs of real applications. The best combination of channel + features + classifier is subject-specific. In this work, the accuracy of FE as the feature is far greater than the Acc of other features. The accuracy using classifier RF is the best, while that of classifier SVM with linear kernel is the worst. The impact of channel selection on the Acc is larger. The performance of various channels is very different

Multiplex Limited Penetrable Horizontal Visibility Graph from EEG Signals for Driver Fatigue Detection

This work was supported by National Natural Science Foundation of China under Grant Nos. 61473203, 61873181 and the Natural Science Foundation of Tianjin, China under Grant No. 16JCYBJC18200.Peer reviewedPostprin

Electroencephalogram (EEG)-based systems to monitor driver fatigue: a review

An efficient system that is capable to detect driver fatigue is urgently needed to help avoid road crashes. Recently, there has been an increase of interest in the application of electroencephalogram (EEG) to detect driver fatigue. Feature extraction and signal classification are the most critical steps in the EEG signal analysis. A reliable method for feature extraction is important to obtain robust signal classification. Meanwhile, a robust algorithm for signal classification will accurately classify the feature to a particular class. This paper concisely reviews the pros and cons of the existing techniques for feature extraction and signal classification and its fatigue detection accuracy performance. The integration of combined entropy (feature extraction) with support vector machine (SVM) and random forest (classifier) gives the best fatigue detection accuracy of 98.7% and 97.5% respectively. The outcomes from this study will guide future researchers in choosing a suitable technique for feature extraction and signal classification for EEG data processing and shed light on directions for future research and development of driver fatigue countermeasures

Improving EEG-based driver fatigue classification using sparse-deep belief networks

© 2017 Chai, Ling, San, Naik, Nguyen, Tran, Craig and Nguyen. This paper presents an improvement of classification performance for electroencephalography (EEG)-based driver fatigue classification between fatigue and alert states with the data collected from 43 participants. The system employs autoregressive (AR) modeling as the features extraction algorithm, and sparse-deep belief networks (sparse-DBN) as the classification algorithm. Compared to other classifiers, sparse-DBN is a semi supervised learning method which combines unsupervised learning for modeling features in the pre-training layer and supervised learning for classification in the following layer. The sparsity in sparse-DBN is achieved with a regularization term that penalizes a deviation of the expected activation of hidden units from a fixed low-level prevents the network from overfitting and is able to learn low-level structures as well as high-level structures. For comparison, the artificial neural networks (ANN), Bayesian neural networks (BNN), and original deep belief networks (DBN) classifiers are used. The classification results show that using AR feature extractor and DBN classifiers, the classification performance achieves an improved classification performance with a of sensitivity of 90.8%, a specificity of 90.4%, an accuracy of 90.6%, and an area under the receiver operating curve (AUROC) of 0.94 compared to ANN (sensitivity at 80.8%, specificity at 77.8%, accuracy at 79.3% with AUC-ROC of 0.83) and BNN classifiers (sensitivity at 84.3%, specificity at 83%, accuracy at 83.6% with AUROC of 0.87). Using the sparse-DBN classifier, the classification performance improved further with sensitivity of 93.9%, a specificity of 92.3%, and an accuracy of 93.1% with AUROC of 0.96. Overall, the sparse-DBN classifier improved accuracy by 13.8, 9.5, and 2.5% over ANN, BNN, and DBN classifiers, respectively

Combining ICA Clustering and Power Spectral Density for Feature Extraction of Mental Fatigue of Spinal Cord Injury Patients

© 2019 IEEE. This paper presents the combination of clustering-based independent component analysis (ICASSO) and power spectral density (PSD) as a features extractor of mental fatigue from spinal cord injury (SCI) patients. Initially, the results show that SCI and abled-bodied groups have no differences in EEG for alert and mental fatigue states. Further, the coefficient determination (R2) is calculated for testing the variation of data alert vs. fatigue on the SCI group, resulting in a lower R2 for proposed combination of ICASSO and PSD method compared to the PSD method only. With the lower R2 values, this shows that the proposed method ICASSO and PSD is able to provide superior distinction for separating fatigue vs. alert data variation. The statistical significance is found across four EEG bands and EEG channels