Hybrid Brain-Computer Interface Systems: Approaches, Features, and Trends

Brain-computer interface (BCI) is an emerging field, and an increasing number of BCI research projects are being carried globally to interface computer with human using EEG for useful operations in both healthy and locked persons. Although several methods have been used to enhance the BCI performance in terms of signal processing, noise reduction, accuracy, information transfer rate, and user acceptability, the effective BCI system is still in the verge of development. So far, various modifications on single BCI systems as well as hybrid are done and the hybrid BCIs have shown increased but insufficient performance. Therefore, more efficient hybrid BCI models are still under the investigation by different research groups. In this review chapter, single BCI systems are briefly discussed and more detail discussions on hybrid BCIs, their modifications, operations, and performances with comparisons in terms of signal processing approaches, applications, limitations, and future scopes are presented

Brain Computer Interface for Gesture Control of a Social Robot: an Offline Study

Brain computer interface (BCI) provides promising applications in neuroprosthesis and neurorehabilitation by controlling computers and robotic devices based on the patient's intentions. Here, we have developed a novel BCI platform that controls a personalized social robot using noninvasively acquired brain signals. Scalp electroencephalogram (EEG) signals are collected from a user in real-time during tasks of imaginary movements. The imagined body kinematics are decoded using a regression model to calculate the user-intended velocity. Then, the decoded kinematic information is mapped to control the gestures of a social robot. The platform here may be utilized as a human-robot-interaction framework by combining with neurofeedback mechanisms to enhance the cognitive capability of persons with dementia.Comment: Presented in: 25th Iranian Conference on Electrical Engineering (ICEE

Cross-Platform Implementation of an SSVEP-Based BCI for the Control of a 6-DOF Robotic Arm

[EN] Robotics has been successfully applied in the design of collaborative robots for assistance to people with motor disabilities. However, man-machine interaction is difficult for those who suffer severe motor disabilities. The aim of this study was to test the feasibility of a low-cost robotic arm control system with an EEG-based brain-computer interface (BCI). The BCI system relays on the Steady State Visually Evoked Potentials (SSVEP) paradigm. A cross-platform application was obtained in C++. This C++ platform, together with the open-source software Openvibe was used to control a Staubli robot arm model TX60. Communication between Openvibe and the robot was carried out through the Virtual Reality Peripheral Network (VRPN) protocol. EEG signals were acquired with the 8-channel Enobio amplifier from Neuroelectrics. For the processing of the EEG signals, Common Spatial Pattern (CSP) filters and a Linear Discriminant Analysis classifier (LDA) were used. Five healthy subjects tried the BCI. This work allowed the communication and integration of a well-known BCI development platform such as Openvibe with the specific control software of a robot arm such as Staubli TX60 using the VRPN protocol. It can be concluded from this study that it is possible to control the robotic arm with an SSVEP-based BCI with a reduced number of dry electrodes to facilitate the use of the system.Funding for open access charge: Universitat Politecnica de Valencia.Quiles Cucarella, E.; Dadone, J.; Chio, N.; García Moreno, E. (2022). Cross-Platform Implementation of an SSVEP-Based BCI for the Control of a 6-DOF Robotic Arm. Sensors. 22(13):1-26. https://doi.org/10.3390/s22135000126221

From spinal central pattern generators to cortical network: integrated BCI for walking rehabilitation

Success in locomotor rehabilitation programs can be improved with the use of brain-computer interfaces (BCIs). Although a wealth of research has demonstrated that locomotion is largely controlled by spinal mechanisms, the brain is of utmost importance in monitoring locomotor patterns and therefore contains information regarding central pattern generation functioning. In addition, there is also a tight coordination between the upper and lower limbs, which can also be useful in controlling locomotion. The current paper critically investigates different approaches that are applicable to this field: the use of electroencephalogram (EEG), upper limb electromyogram (EMG), or a hybrid of the two neurophysiological signals to control assistive exoskeletons used in locomotion based on programmable central pattern generators (PCPGs) or dynamic recurrent neural networks (DRNNs). Plantar surface tactile stimulation devices combined with virtual reality may provide the sensation of walking while in a supine position for use of training brain signals generated during locomotion. These methods may exploit mechanisms of brain plasticity and assist in the neurorehabilitation of gait in a variety of clinical conditions, including stroke, spinal trauma, multiple sclerosis, and cerebral palsy

Brain-Switches for Asynchronous Brain−Computer Interfaces: A Systematic Review

A brain–computer interface (BCI) has been extensively studied to develop a novel communication system for disabled people using their brain activities. An asynchronous BCI system is more realistic and practical than a synchronous BCI system, in that, BCI commands can be generated whenever the user wants. However, the relatively low performance of an asynchronous BCI system is problematic because redundant BCI commands are required to correct false-positive operations. To significantly reduce the number of false-positive operations of an asynchronous BCI system, a two-step approach has been proposed using a brain-switch that first determines whether the user wants to use an asynchronous BCI system before the operation of the asynchronous BCI system. This study presents a systematic review of the state-of-the-art brain-switch techniques and future research directions. To this end, we reviewed brain-switch research articles published from 2000 to 2019 in terms of their (a) neuroimaging modality, (b) paradigm, (c) operation algorithm, and (d) performance

EEG and ECoG features for Brain Computer Interface in Stroke Rehabilitation

The ability of non-invasive Brain-Computer Interface (BCI) to control an exoskeleton was used for motor rehabilitation in stroke patients or as an assistive device for the paralyzed. However, there is still a need to create a more reliable BCI that could be used to control several degrees of Freedom (DoFs) that could improve rehabilitation results. Decoding different movements from the same limb, high accuracy and reliability are some of the main difficulties when using conventional EEG-based BCIs and the challenges we tackled in this thesis. In this PhD thesis, we investigated that the classification of several functional hand reaching movements from the same limb using EEG is possible with acceptable accuracy. Moreover, we investigated how the recalibration could affect the classification results. For this reason, we tested the recalibration in each multi-class decoding for within session, recalibrated between-sessions, and between sessions. It was shown the great influence of recalibrating the generated classifier with data from the current session to improve stability and reliability of the decoding. Moreover, we used a multiclass extension of the Filter Bank Common Spatial Patterns (FBCSP) to improve the decoding accuracy based on features and compared it to our previous study using CSP. Sensorimotor-rhythm-based BCI systems have been used within the same frequency ranges as a way to influence brain plasticity or controlling external devices. However, neural oscillations have shown to synchronize activity according to motor and cognitive functions. For this reason, the existence of cross-frequency interactions produces oscillations with different frequencies in neural networks. In this PhD, we investigated for the first time the existence of cross-frequency coupling during rest and movement using ECoG in chronic stroke patients. We found that there is an exaggerated phase-amplitude coupling between the phase of alpha frequency and the amplitude of gamma frequency, which can be used as feature or target for neurofeedback interventions using BCIs. This coupling has been also reported in another neurological disorder affecting motor function (Parkinson and dystonia) but, to date, it has not been investigated in stroke patients. This finding might change the future design of assistive or therapeuthic BCI systems for motor restoration in stroke patients

Development of Brain Machine Interface Systems and its Applications to Prosthetic Hand Control

東京電機大学201

Past, Present, and Future of EEG-Based BCI Applications

An electroencephalography (EEG)-based brain–computer interface (BCI) is a system that provides a pathway between the brain and external devices by interpreting EEG. EEG-based BCI applications have initially been developed for medical purposes, with the aim of facilitating the return of patients to normal life. In addition to the initial aim, EEG-based BCI applications have also gained increasing significance in the non-medical domain, improving the life of healthy people, for instance, by making it more efficient, collaborative and helping develop themselves. The objective of this review is to give a systematic overview of the literature on EEG-based BCI applications from the period of 2009 until 2019. The systematic literature review has been prepared based on three databases PubMed, Web of Science and Scopus. This review was conducted following the PRISMA model. In this review, 202 publications were selected based on specific eligibility criteria. The distribution of the research between the medical and non-medical domain has been analyzed and further categorized into fields of research within the reviewed domains. In this review, the equipment used for gathering EEG data and signal processing methods have also been reviewed. Additionally, current challenges in the field and possibilities for the future have been analyzed

A Feasibility Study of SSVEP-Based Passive Training on an Ankle Rehabilitation Robot

Objective: This study aims to establish a steady-state visual evoked potential- (SSVEP-) based passive training protocol on an ankle rehabilitation robot and validate its feasibility. Method: This paper combines SSVEP signals and the virtual reality circumstance through constructing information transmission loops between brains and ankle robots. The robot can judge motion intentions of subjects and trigger the training when subjects pay their attention on one of the four flickering circles. The virtual reality training circumstance provides real-time visual feedback of ankle rotation. Result: All five subjects succeeded in conducting ankle training based on the SSVEP-triggered training strategy following their motion intentions. The lowest success rate is 80%, and the highest one is 100%. The lowest information transfer rate (ITR) is 11.5 bits/min when the biggest one of the robots for this proposed training is set as 24 bits/min. Conclusion: The proposed training strategy is feasible and promising to be combined with a robot for ankle rehabilitation. Future work will focus on adopting more advanced data process techniques to improve the reliability of intention detection and investigating how patients respond to such a training strategy

Inverse reinforcement learning to control a robotic arm using a Brain-Computer Interface

The goal of this project is to use inverse reinforce- ment learning to better control a JACO robotic arm developed by Kinova in a Brain-Computer Interface (BCI). A self-paced BCI such as a motor imagery based-BCI allows the subject to give orders at any time to freely control a device. But using this paradigm, even after a long training, the accuracy of the classifier used to recognize the order is not 100%. While a lot of studies try to improve the accuracy using a preprocessing stage that improves the feature extraction, we work on a post- processing solution. The classifier used to recognize the mental commands will provide as outputs a value for each command such as the posterior probability. But the executed action will not only depend on this information. A decision process will also take into account the position of the robotic arm and previous trajectories. More precisely, the decision process will be obtained applying an inverse reinforcement learning (IRL) on a subset of trajectories specified by an expert. At the end of the workshop, the convergence of the inverse reinforcement algorithm has not been achieved. Nevertheless, we developed a whole processing chain based on OpenViBE for controlling 2D- movements and we present how to deal with this high dimensional time series problem with a lot of noise which is unusual for the IRL community