Fuzzy rule-based alertness state classification based on the optimization of EEG rhythm/channel combinations

This paper presents a method for automatically selecting the optimal EEG rhythm/channel combination capable of classifying the different human alertness states. We considered four alertness states, namely 'engaged', 'calm', 'drowsy', and 'asleep'. Energies associated with the conventional EEG rhythms, δ, θ, α, ß and γ, extracted from overlapping segments of the different EEG channels were used as features. The proposed method is a two-stage process. In the first stage, the optimal brain regions, represented by a set of EEG channels, are identified. In the second stage, a fuzzy rule-based alertness classification system (FRBACS) is developed to select the optimal EEG rhythms extracted from the previously selected EEG channels. The IF-THEN rules used in FRBACS are constructed using a novel bi-level differential evolution (DE) based search algorithm. Unlike most of the existing classification methods, the proposed classification approach reveals easy to interpret rules that describe each of the alertness states

Physiological-based Driver Monitoring Systems: A Scoping Review

A physiological-based driver monitoring system (DMS) has attracted research interest and has great potential for providing more accurate and reliable monitoring of the driver’s state during a driving experience. Many driving monitoring systems are driver behavior-based or vehicle-based. When these non-physiological based DMS are coupled with physiological-based data analysis from electroencephalography (EEG), electrooculography (EOG), electrocardiography (ECG), and electromyography (EMG), the physical and emotional state of the driver may also be assessed. Drivers’ wellness can also be monitored, and hence, traffic collisions can be avoided. This paper highlights work that has been published in the past five years related to physiological-based DMS. Specifically, we focused on the physiological indicators applied in DMS design and development. Work utilizing key physiological indicators related to driver identification, driver alertness, driver drowsiness, driver fatigue, and drunk driver is identified and described based on the PRISMA Extension for Scoping Reviews (PRISMA-Sc) Framework. The relationship between selected papers is visualized using keyword co-occurrence. Findings were presented using a narrative review approach based on classifications of DMS. Finally, the challenges of physiological-based DMS are highlighted in the conclusion. Doi: 10.28991/CEJ-2022-08-12-020 Full Text: PD

Drivers’ drowsiness detection based on an optimized random forest classification and single-channel electroencephalogram

The state of functioning (posture) of a driver at the wheel of a car involves a complex set of psychological, physiological, and physical parameters. This combination induces fatigue, which manifests itself in repeated yawning, stinging eyes, a frozen gaze, a stiff and painful neck, back pain, and other signs. The driver may fight fatigue for a few moments, but it inevitably leads to drowsiness, periods of micro-sleep, and then falling asleep. At the first signs of drowsiness, the risk of an accident becomes immense. In Morocco, drowsiness at the wheel is the cause of 1/3 of fatal accidents on the freeways. Thus, in this paper, a new hybrid data analysis and an efficient machine learning algorithm are designed to detect the drowsiness of drivers who spend most of their time behind the wheel over long distances (older than 35 years). This analysis is based on a single channel of electroencephalogram (EEG) recordings using time, frequency fast Fourier transform (FFT), and power spectral density (PSD) analysis. To distinguish between the two states of alertness and drowsiness, several features were extracted from each domain (time, FFT, and PSD), and subjected to different classifier architectures to conduct a general comparison and achieve the highest detection accuracy (98.5%) and best time consumption (13 milliseconds)

Seizure detection using EEG and ECG signals for computer-based monitoring, analysis and management of epileptic patients

This is the accepted manuscript version of the following article: Iosif Mporas, “Seizure detection using EEG and ECG signals for computer-based monitoring, analysis and management of epileptic patients”, Expert Systems with Applications, Vol. 42(6), December 2014. The final published version is available at: http://www.sciencedirect.com/science/article/pii/S0957417414007763?via%3Dihub © 2014 Elsevier Ltd. All rights reserved.In this paper a seizure detector using EEG and ECG signals, as a module of a healthcare system, is presented. Specifically, the module is based on short-time analysis with time-domain and frequency-domain features and classification using support vector machines. The seizure detection module was evaluated on three subjects with diagnosed idiopathic generalized epilepsy manifested with absences. The achieved seizure detection accuracy was approximately 90% for all evaluated subjects. Feature ranking investigation and evaluation of the seizure detection module using subsets of features showed that the feature vector composed of approximately the 65%-best ranked parameters provides a good trade-off between computational demands and accuracy. This configurable architecture allows the seizure detection module to operate as part of a healthcare system in offline mode as well as in online mode, where real-time performance is needed.Peer reviewe

Multimodality Inferring of Human Cognitive States Based on Integration of Neuro-Fuzzy Network and Information Fusion Techniques

To achieve an effective and safe operation on the machine system where the human interacts with the machine mutually, there is a need for the machine to understand the human state, especially cognitive state, when the human's operation task demands an intensive cognitive activity. Due to a well-known fact with the human being, a highly uncertain cognitive state and behavior as well as expressions or cues, the recent trend to infer the human state is to consider multimodality features of the human operator. In this paper, we present a method for multimodality inferring of human cognitive states by integrating neuro-fuzzy network and information fusion techniques. To demonstrate the effectiveness of this method, we take the driver fatigue detection as an example. The proposed method has, in particular, the following new features. First, human expressions are classified into four categories: (i) casual or contextual feature, (ii) contact feature, (iii) contactless feature, and (iv) performance feature. Second, the fuzzy neural network technique, in particular Takagi-Sugeno-Kang (TSK) model, is employed to cope with uncertain behaviors. Third, the sensor fusion technique, in particular ordered weighted aggregation (OWA), is integrated with the TSK model in such a way that cues are taken as inputs to the TSK model, and then the outputs of the TSK are fused by the OWA which gives outputs corresponding to particular cognitive states under interest (e.g., fatigue). We call this method TSK-OWA. Validation of the TSK-OWA, performed in the Northeastern University vehicle drive simulator, has shown that the proposed method is promising to be a general tool for human cognitive state inferring and a special tool for the driver fatigue detection

Data mining an EEG dataset with an emphasis on dimensionality reduction

The human brain is obviously a complex system, and exhibits rich spatiotemporal dynamics. Among the non-invasive techniques for probing human brain dynamics, electroencephalography (EEG) provides a direct measure of cortical activity with millisecond temporal resolution. Early attempts to analyse EEG data relied on visual inspection of EEG records. Since the introduction of EEG recordings, the volume of data generated from a study involving a single patient has increased exponentially. Therefore, automation based on pattern classification techniques have been applied with considerable success. In this study, a multi-step approach for the classification of EEG signal has been adopted. We have analysed sets of EEG time series recording from healthy volunteers with open eyes and intracranial EEG recordings from patients with epilepsy during ictal (seizure) periods. In the present work, we have employed a discrete wavelet transform to the EEG data in order to extract temporal information in the form of changes in the frequency domain over time - that is they are able to extract non-stationary signals embedded in the noisy background of the human brain. Principal components analysis (PCA) and rough sets have been used to reduce the data dimensionality. A multi-classifier scheme consists of LVQ2.1 neural networks have been developed for the classification task. The experimental results validated the proposed methodology

Interpretable and Robust AI in EEG Systems: A Survey

The close coupling of artificial intelligence (AI) and electroencephalography (EEG) has substantially advanced human-computer interaction (HCI) technologies in the AI era. Different from traditional EEG systems, the interpretability and robustness of AI-based EEG systems are becoming particularly crucial. The interpretability clarifies the inner working mechanisms of AI models and thus can gain the trust of users. The robustness reflects the AI's reliability against attacks and perturbations, which is essential for sensitive and fragile EEG signals. Thus the interpretability and robustness of AI in EEG systems have attracted increasing attention, and their research has achieved great progress recently. However, there is still no survey covering recent advances in this field. In this paper, we present the first comprehensive survey and summarize the interpretable and robust AI techniques for EEG systems. Specifically, we first propose a taxonomy of interpretability by characterizing it into three types: backpropagation, perturbation, and inherently interpretable methods. Then we classify the robustness mechanisms into four classes: noise and artifacts, human variability, data acquisition instability, and adversarial attacks. Finally, we identify several critical and unresolved challenges for interpretable and robust AI in EEG systems and further discuss their future directions