EEG-Analysis for Cognitive Failure Detection in Driving Using Type-2 Fuzzy Classifiers

The paper aims at detecting on-line cognitive failures in driving by decoding the EEG signals acquired during visual alertness, motor-planning and motor-execution phases of the driver. Visual alertness of the driver is detected by classifying the pre-processed EEG signals obtained from his pre-frontal and frontal lobes into two classes: alert and non-alert. Motor-planning performed by the driver using the pre-processed parietal signals is classified into four classes: braking, acceleration, steering control and no operation. Cognitive failures in motor-planning are determined by comparing the classified motor-planning class of the driver with the ground truth class obtained from the co-pilot through a hand-held rotary switch. Lastly, failure in motor execution is detected, when the time-delay between the onset of motor imagination and the EMG response exceeds a predefined duration. The most important aspect of the present research lies in cognitive failure classification during the planning phase. The complexity in subjective plan classification arises due to possible overlap of signal features involved in braking, acceleration and steering control. A specialized interval/general type-2 fuzzy set induced neural classifier is employed to eliminate the uncertainty in classification of motor-planning. Experiments undertaken reveal that the proposed neuro-fuzzy classifier outperforms traditional techniques in presence of external disturbances to the driver. Decoding of visual alertness and motor-execution are performed with kernelized support vector machine classifiers. An analysis reveals that at a driving speed of 64 km/hr, the lead-time is over 600 milliseconds, which offer a safe distance of 10.66 meters

Bypassing the Natural Visual-Motor Pathway to Execute Complex Movement Related Tasks Using Interval Type-2 Fuzzy Sets

In visual-motor coordination, the human brain processes visual stimuli representative of complex motion-related tasks at the occipital lobe to generate the necessary neuronal signals for the parietal and pre-frontal lobes, which in turn generates movement related plans to excite the motor cortex to execute the actual tasks. The paper introduces a novel approach to provide rehabilitative support to patients suffering from neurological damage in their pre-frontal, parietal and/or motor cortex regions. An attempt to bypass the natural visual-motor pathway is undertaken using interval type-2 fuzzy sets to generate the approximate EEG response of the damaged pre-frontal/parietal/motor cortex from the occipital EEG signals. The approximate EEG response is used to trigger a pre-trained joint coordinate generator to obtain desired joint coordinates of the link end-points of a robot imitating the human subject. The robot arm is here employed as a rehabilitative aid in order to move each link end-points to the desired locations in the reference coordinate system by appropriately activating its links using the well-known inverse kinematics approach. The mean-square positional errors obtained for each link end-points is found within acceptable limits for all experimental subjects including subjects with partial parietal damage, indicating a possible impact of the proposed approach in rehabilitative robotics. Subjective variation in EEG features over different sessions of experimental trials is modelled here using interval type-2 fuzzy sets for its inherent power to handle uncertainty. Experiments undertaken confirm that interval type-2 fuzzy realization outperforms its classical type-1 counterpart and back-propagation neural approaches in all experimental cases, considering link positional error as a metric. The proposed research offers a new opening for the development of possible rehabilitative aids for people with partial impairment in visual-motor coordination

EEG-based Brain-Computer Interfaces (BCIs): A Survey of Recent Studies on Signal Sensing Technologies and Computational Intelligence Approaches and Their Applications.

Brain-Computer interfaces (BCIs) enhance the capability of human brain activities to interact with the environment. Recent advancements in technology and machine learning algorithms have increased interest in electroencephalographic (EEG)-based BCI applications. EEG-based intelligent BCI systems can facilitate continuous monitoring of fluctuations in human cognitive states under monotonous tasks, which is both beneficial for people in need of healthcare support and general researchers in different domain areas. In this review, we survey the recent literature on EEG signal sensing technologies and computational intelligence approaches in BCI applications, compensating for the gaps in the systematic summary of the past five years. Specifically, we first review the current status of BCI and signal sensing technologies for collecting reliable EEG signals. Then, we demonstrate state-of-the-art computational intelligence techniques, including fuzzy models and transfer learning in machine learning and deep learning algorithms, to detect, monitor, and maintain human cognitive states and task performance in prevalent applications. Finally, we present a couple of innovative BCI-inspired healthcare applications and discuss future research directions in EEG-based BCI research

EEG-based brain-computer interfaces using motor-imagery: techniques and challenges.

Electroencephalography (EEG)-based brain-computer interfaces (BCIs), particularly those using motor-imagery (MI) data, have the potential to become groundbreaking technologies in both clinical and entertainment settings. MI data is generated when a subject imagines the movement of a limb. This paper reviews state-of-the-art signal processing techniques for MI EEG-based BCIs, with a particular focus on the feature extraction, feature selection and classification techniques used. It also summarizes the main applications of EEG-based BCIs, particularly those based on MI data, and finally presents a detailed discussion of the most prevalent challenges impeding the development and commercialization of EEG-based BCIs

Hemodynamic Analysis for Cognitive Load Assessment and Classification in Motor Learning Tasks Using Type-2 Fuzzy Sets

The paper addresses a novel approach to assess and classify the cognitive load of subjects from their hemodynamic response while engaged in motor learning tasks, such as vehicle-driving. A set of complex motor-activity-learning stimuli for braking, steering-control and acceleration is prepared to experimentally measure and classify the cognitive load of the car-drivers in three distinct classes: High, Medium and Low. New models of General and Interval Type-2 Fuzzy classifiers are proposed to reduce the scope of uncertainty in cognitive load classification due to the fluctuation of the hemodynamic features within and across sessions. The proposed classifiers offer high classification accuracy over 96%, leaving behind the traditional type-1/type-2 fuzzy and other standard classifiers. Experiments undertaken also offer a deep biological insight concerning the shift of brain-activations from the orbito-frontal to the ventro-lateral prefrontal cortex during high-to-low transition in cognitive load. Further, the activation of the dorsolateral prefrontal cortex is also reduced during low cognitive load of subjects. The proposed research outcome may directly be utilized to identify driving learners with low cognitive load for difficult motor learning tasks, such as taking a U-turn in a narrow space and motion control on the top of a bridge to avoid possible collision with the car ahead

Support matrix machine: A review

Support vector machine (SVM) is one of the most studied paradigms in the realm of machine learning for classification and regression problems. It relies on vectorized input data. However, a significant portion of the real-world data exists in matrix format, which is given as input to SVM by reshaping the matrices into vectors. The process of reshaping disrupts the spatial correlations inherent in the matrix data. Also, converting matrices into vectors results in input data with a high dimensionality, which introduces significant computational complexity. To overcome these issues in classifying matrix input data, support matrix machine (SMM) is proposed. It represents one of the emerging methodologies tailored for handling matrix input data. The SMM method preserves the structural information of the matrix data by using the spectral elastic net property which is a combination of the nuclear norm and Frobenius norm. This article provides the first in-depth analysis of the development of the SMM model, which can be used as a thorough summary by both novices and experts. We discuss numerous SMM variants, such as robust, sparse, class imbalance, and multi-class classification models. We also analyze the applications of the SMM model and conclude the article by outlining potential future research avenues and possibilities that may motivate academics to advance the SMM algorithm

A BCI challenge for the signal processing community: considering the user in the loop

Chapter 8International audienc