Support vector machines to detect physiological patterns for EEG and EMG-based human-computer interaction:a review

Support vector machines (SVMs) are widely used classifiers for detecting physiological patterns in human-computer interaction (HCI). Their success is due to their versatility, robustness and large availability of free dedicated toolboxes. Frequently in the literature, insufficient details about the SVM implementation and/or parameters selection are reported, making it impossible to reproduce study analysis and results. In order to perform an optimized classification and report a proper description of the results, it is necessary to have a comprehensive critical overview of the applications of SVM. The aim of this paper is to provide a review of the usage of SVM in the determination of brain and muscle patterns for HCI, by focusing on electroencephalography (EEG) and electromyography (EMG) techniques. In particular, an overview of the basic principles of SVM theory is outlined, together with a description of several relevant literature implementations. Furthermore, details concerning reviewed papers are listed in tables and statistics of SVM use in the literature are presented. Suitability of SVM for HCI is discussed and critical comparisons with other classifiers are reported

BCI controlled robotic arm as assistance to the rehabilitation of neurologically disabled patients

Purpose: Brain–computer interface (BCI)-controlled assistive robotic systems have been developed with increasing success with the aim to rehabilitation of patients after brain injury to increase independence and quality of life. While such systems may use surgically implanted invasive sensors, non-invasive alternatives can be better suited due to the ease of use, reduced cost, improvements in accuracy and reliability with the advancement of the technology and practicality of use. The consumer-grade BCI devices are often capable of integrating multiple types of signals, including Electroencephalogram (EEG) and Electromyogram (EMG) signals. Materials and Methods: This paper summarizes the development of a portable and cost-efficient BCI-controlled assistive technology using a non-invasive BCI headset “OpenBCI” and an open source robotic arm, U-Arm, to accomplish tasks related to rehabilitation, such as access to resources, adaptability or home use. The resulting system used a combination of EEG and EMG sensor readings to control the arm. To avoid risks of injury while the device is being used in clinical settings, appropriate measures were incorporated into the software control of the arm. A short survey was used following the system usability scale (SUS), to measure the usability of the technology to be trialed in clinical settings. Results: From the experimental results, it was found that EMG is a very reliable method for assistive technology control, provided that the user specific EMG calibration is done. With the EEG, even though the results were promising, due to insufficient detection of the signal, the controller was not adequate to be used within a neurorehabilitation environment. The survey indicated that the usability of the system is not a barrier for moving the system into clinical trials. Implication on rehabilitation For the rehabilitation of patients suffering from neurological disabilities (particularly those suffering from varying degrees of paralysis), it is necessary to develop technology that bypasses the limitations of their condition. For example, if a patient is unable to walk due to the unresponsiveness in their motor neurons, technology can be developed that used an alternate input to move an exoskeleton, which enables the patient to walk again with the assistance of the exoskeleton. This research focuses on neuro-rehabilitation within the framework of the NHS at the Kent and Canterbury Hospital in UK. The hospital currently does not have any system in place for self-driven rehabilitation and instead relies on traditional rehabilitation methods through assistance from physicians and exercise regimens to maintain muscle movement. This paper summarises the development of a portable and cost-efficient BCI controlled assistive technology using a non-invasive BCI headset “OpenBCI” and an open source robotic arm, U-Arm, to accomplish tasks related to rehabilitation, such as access to resources, adaptability or home use. The resulting system used a combination of EEG and EMG sensor readings to control the arm, which could perform a number of different tasks such as picking/placing objects or assist users in eating

Meta Heuristics based Machine Learning and Neural Mass Modelling Allied to Brain Machine Interface

New understanding of the brain function and increasing availability of low-cost-non-invasive electroencephalograms (EEGs) recording devices have made brain-computer-interface (BCI) as an alternative option to augmentation of human capabilities by providing a new non-muscular channel for sending commands, which could be used to activate electronic or mechanical devices based on modulation of thoughts. In this project, our emphasis will be on how to develop such a BCI using fuzzy rule-based systems (FRBSs), metaheuristics and Neural Mass Models (NMMs). In particular, we treat the BCI system as an integrated problem consisting of mathematical modelling, machine learning and classification. Four main steps are involved in designing a BCI system: 1) data acquisition, 2) feature extraction, 3) classification and 4) transferring the classification outcome into control commands for extended peripheral capability. Our focus has been placed on the first three steps. This research project aims to investigate and develop a novel BCI framework encompassing classification based on machine learning, optimisation and neural mass modelling. The primary aim in this project is to bridge the gap of these three different areas in a bid to design a more reliable and accurate communication path between the brain and external world. To achieve this goal, the following objectives have been investigated: 1) Steady-State Visual Evoked Potential (SSVEP) EEG data are collected from human subjects and pre-processed; 2) Feature extraction procedure is implemented to detect and quantify the characteristics of brain activities which indicates the intention of the subject.; 3) a classification mechanism called an Immune Inspired Multi-Objective Fuzzy Modelling Classification algorithm (IMOFM-C), is adapted as a binary classification approach for classifying binary EEG data. Then, the DDAG-Distance aggregation approach is proposed to aggregate the outcomes of IMOFM-C based binary classifiers for multi-class classification; 4) building on IMOFM-C, a preference-based ensemble classification framework known as IMOFM-CP is proposed to enhance the convergence performance and diversity of each individual component classifier, leading to an improved overall classification accuracy of multi-class EEG data; and 5) finally a robust parameterising approach which combines a single-objective GA and a clustering algorithm with a set of newly devised objective and penalty functions is proposed to obtain robust sets of synaptic connectivity parameters of a thalamic neural mass model (NMM). The parametrisation approach aims to cope with nonlinearity nature normally involved in describing multifarious features of brain signals

Electroencephalography (EEG)-based brain computer interfaces for rehabilitation

Objective: Brain-computer interface (BCI) technologies have been the subject of study for the past decades to help restore functions for people with severe motor disabilities and to improve their quality of life. BCI research can be generally categorized by control signals (invasive/non-invasive) or applications (e.g. neuroprosthetics/brain-actuated wheelchairs), and efforts have been devoted to better understand the characteristics and possible uses of brain signals. The purpose of this research is to explore the feasibility of a non-invasive BCI system with the combination of unique sensorimotor-rhythm (SMR) features. Specifically, a 2D virtual wheelchair control BCI is implemented to extend the application of previously designed 2D cursor control BCI, and the feasibility of the prototype is tested in electroencephalography (EEG) experiments; guidance on enhancing system performance is provided by a simulation incorporating intelligent control approaches under different EEG decoding accuracies; pattern recognition methods are explored to provide optimized classification results; and a hybrid BCI system is built to enhance the usability of the wheelchair BCI system. Methods: In the virtual wheelchair control study, a creative and user friendly control strategy was proposed, and a paradigm was designed in Matlab, providing a virtual environment for control experiments; five subjects performed physical/imagined left/right hand movements or non-control tasks to control the virtual wheelchair to move forward, turn left/right or stop; 2-step classification methods were employed and the performance was evaluated by hit rate and control time. Feature analysis and time-frequency analysis were conducted to examine the spatial, temporal and frequency properties of the utilized SMR features, i.e. event-related desynchronization (ERD) and post-movement event-related synchronization (ERS). The simulation incorporated intelligent control methods, and evaluated navigation and positioning performance with/without obstacles under different EEG decoding accuracies, to better guide optimization. Classification methods were explored considering different feature sets, tuned classifier parameters and the simulation results, and a recommendation was provided to the proposed system. In the steady state visual evoked potential (SSVEP) system for hybrid BCI study, a paradigm was designed, and an electric circuit system was built to provide visual stimulus, involving SSVEP as another type of signal being used to drive the EEG BCI system. Experiments were conducted and classification methods were explored to evaluate the system performance. Results: ERD was observed on both hemispheres during hand\u27s movement or motor imagery; ERS was observed on the contralateral hemisphere after movement or motor imagery stopped; five subjects participated in the continuous 2D virtual wheelchair control study and 4 of them hit the target with 100% hit rate in their best set with motor imagery. The simulation results indicated that the average hit rate with 10 obstacles can get above 95% for pass-door tests and above 70% for positioning tests, with EEG decoding accuracies of 70% for Non-Idle signals and 80% for idle signals. Classification methods showed that with properly tuned parameters, an average of about 70%-80% decoding accuracy for all the classifiers could be reached, which reached the requirements set by the simulation test. Initial test on the SSVEP BCI system exhibited high classification accuracy, which may extend the usability of the wheelchair system to a larger population when finally combined with ERD/ERS BCI system. Conclusion: This research investigated the feasibility of using both ERD and ERS associated with natural hand\u27s motor imagery, aiming to implement practical BCI systems for the end users in the rehabilitation stage. The simulation with intelligent controls provided guides and requirements for EEG decoding accuracies, based on which pattern recognition methods were explored; properly selected features and adjusted parameters enabled the classifiers to exhibit optimal performance, suitable for the proposed system. Finally, to enlarge the population for which the wheelchair BCI system could benefit for, a SSVEP system for hybrid BCI was designed and tested. These systems provide a non-invasive, practical approach for BCI users in controlling assistive devices such as a virtual wheelchair, in terms of ease of use, adequate speed, and sufficient control accuracy

Signal Processing Using Non-invasive Physiological Sensors

Non-invasive biomedical sensors for monitoring physiological parameters from the human body for potential future therapies and healthcare solutions. Today, a critical factor in providing a cost-effective healthcare system is improving patients' quality of life and mobility, which can be achieved by developing non-invasive sensor systems, which can then be deployed in point of care, used at home or integrated into wearable devices for long-term data collection. Another factor that plays an integral part in a cost-effective healthcare system is the signal processing of the data recorded with non-invasive biomedical sensors. In this book, we aimed to attract researchers who are interested in the application of signal processing methods to different biomedical signals, such as an electroencephalogram (EEG), electromyogram (EMG), functional near-infrared spectroscopy (fNIRS), electrocardiogram (ECG), galvanic skin response, pulse oximetry, photoplethysmogram (PPG), etc. We encouraged new signal processing methods or the use of existing signal processing methods for its novel application in physiological signals to help healthcare providers make better decisions

Bayesian machine learning applied in a brain-computer interface for disabled users

A brain-computer interface (BCI) is a system that enables control of devices or communication with other persons, only through cerebral activity, without using muscles. The main application for BCIs is assistive technology for disabled persons. Examples for devices that can be controlled by BCIs are artificial limbs, spelling devices, or environment control systems. BCI research has seen renewed interest in recent years, and it has been convincingly shown that communication via a BCI is in principle feasible. However, present day systems still have shortcomings that prevent their widespread application. In part, these shortcomings are caused by limitations in the functionality of the pattern recognition algorithms used for discriminating brain signals in BCIs. Moreover, BCIs are often tested exclusively with able-bodied persons instead of conducting tests with the target user group, namely disabled persons. The goal of this thesis is to extend the functionality of pattern recognition algorithms for BCI systems and to move towards systems that are helpful for disabled users. We discuss extensions of linear discriminant analysis (LDA), which is a simple but efficient method for pattern recognition. In particular, a framework from Bayesian machine learning, the so-called evidence framework, is applied to LDA. An algorithm is obtained that learns classifiers quickly, robustly, and fully automatically. An extension of this algorithm allows to automatically reduce the number of sensors needed for acquisition of brain signals. More specifically, the algorithm allows to perform electrode selection. The algorithm for electrode selection is based on a concept known as automatic relevance determination (ARD) in Bayesian machine learning. The last part of the algorithmic development in this thesis concerns methods for computing accurate estimates of class probabilities in LDA-like classifiers. These probabilities are used to build a BCI that dynamically adapts the amount of acquired data, so that a preset, approximate bound on the probability of misclassifications is not exceeded. To test the algorithms described in this thesis, a BCI specifically tailored for disabled persons is introduced. The system uses electroencephalogram (EEG) signals and is based on the P300 evoked potential. Datasets recorded from five disabled and four able-bodied subjects are used to show that the Bayesian version of LDA outperforms plain LDA in terms of classification accuracy. Also, the impact of different static electrode configurations on classification accuracy is tested. In addition, experiments with the same datasets demonstrate that the algorithm for electrode selection is computationally efficient, yields physiologically plausible results, and improves classification accuracy over static electrode configurations. The classification accuracy is further improved by dynamically adapting the amount of acquired data. Besides the datasets recorded from disabled and able-bodied subjects, benchmark datasets from BCI competitions are used to show that the algorithms discussed in this thesis are competitive with state-of-the-art electroencephalogram (EEG) classification algorithms. While the experiments in this thesis are uniquely performed with P300 datasets, the presented algorithms might also be useful for other types of BCI systems based on the EEG. This is the case because functionalities such as robust and automatic computation of classifiers, electrode selection, and estimation of class probabilities are useful in many BCI systems. Seen from a more general point of view, many applications that rely on the classification of cerebral activity could possibly benefit from the methods developed in this thesis. Among the potential applications are interrogative polygraphy ("lie detection") and clinical applications, for example coma outcome prognosis and depth of anesthesia monitoring

Optimizing Common Spatial Pattern for a Motor Imagerybased BCI by Eigenvector Filteration

One of the fundamental criterion for the successful application of a brain-computer interface (BCI) system is to extract significant features that confine invariant characteristics specific to each brain state. Distinct features play an important role in enabling a computer to associate different electroencephalogram (EEG) signals to different brain states. To ease the workload on the feature extractor and enhance separability between different brain states, the data is often transformed or filtered to maximize separability before feature extraction. The common spatial patterns (CSP) approach can achieve this by linearly projecting the multichannel EEG data into a surrogate data space by the weighted summation of the appropriate channels. However, choosing the optimal spatial filters is very significant in the projection of the data and this has a direct impact on classification. This paper presents an optimized pattern selection method from the CSP filter for improved classification accuracy. Based on the hypothesis that values closer to zero in the CSP filter introduce noise rather than useful information, the CSP filter is modified by analyzing the CSP filter and removing/filtering the degradative or insignificant values from the filter. This hypothesis is tested by comparing the BCI results of eight subjects using the conventional CSP filters and the optimized CSP filter. In majority of the cases the latter produces better performance in terms of the overall classification accuracy