Brain–Machine Interface and Visual Compressive Sensing-Based Teleoperation Control of an Exoskeleton Robot

This paper presents a teleoperation control for an exoskeleton robotic system based on the brain-machine interface and vision feedback. Vision compressive sensing, brain-machine reference commands, and adaptive fuzzy controllers in joint-space have been effectively integrated to enable the robot performing manipulation tasks guided by human operator's mind. First, a visual-feedback link is implemented by a video captured by a camera, allowing him/her to visualize the manipulator's workspace and movements being executed. Then, the compressed images are used as feedback errors in a nonvector space for producing steady-state visual evoked potentials electroencephalography (EEG) signals, and it requires no prior information on features in contrast to the traditional visual servoing. The proposed EEG decoding algorithm generates control signals for the exoskeleton robot using features extracted from neural activity. Considering coupled dynamics and actuator input constraints during the robot manipulation, a local adaptive fuzzy controller has been designed to drive the exoskeleton tracking the intended trajectories in human operator's mind and to provide a convenient way of dynamics compensation with minimal knowledge of the dynamics parameters of the exoskeleton robot. Extensive experiment studies employing three subjects have been performed to verify the validity of the proposed method

A Novel Approach Of Independent Brain-computer Interface Based On SSVEP

Durante os últimos dez anos, as Interfaces Cérebro Computador (ICC) baseadas em Potenciais Evocados Visuais de Regime Permanente (SSVEP) têm chamado a atenção de muitos pesquisadores devido aos resultados promissores e as altas taxas de precisão atingidas. Este tipo de ICC permite que pessoas com dificuldades motoras severas possam se comunicar com o mundo exterior através da modulação da atenção visual a luzes piscantes com frequência determinada. Esta Tese de Doutorado tem o intuito de desenvolver um novo enfoque dentro das chamadas ICC Independentes, nas quais os usuários não necessitam executar tarefas neuromusculares para seleção visual de objetivos específicos, característica que a distingue das tradicionais ICCs-SSVEP. Assim, pessoas com difculdades motoras severas, como pessoas com Esclerose Lateral Amiotrófca (ELA), contam com uma nova alternativa de se comunicar através de sinais cerebrais. Diversas contribuições foram realizadas neste trabalho, como, por exemplo, melhoria do algoritmo extrator de características, denominado Índice de Sincronização Multivariável (ou MSI, do Inglês), para a detecção de potenciais evocados; desenvolvimento de um novo método de detecção de potenciais evocados através da correlação entre modelos multidimensionais (tensores); o desenvolvimento do primeiro estudo sobre a influência de estímulos coloridos na detecção de SSVEPs usando LEDs; a aplicação do conceito de Compressão na detecção de SSVEPs; e, fnalmente, o desenvolvimento de uma nova ICC independente que utiliza o enfoque de Percepção Fundo-Figura (ou FGP, do Inglês)

Hybrid Brain-Computer Interface Systems: Approaches, Features, and Trends

Brain-computer interface (BCI) is an emerging field, and an increasing number of BCI research projects are being carried globally to interface computer with human using EEG for useful operations in both healthy and locked persons. Although several methods have been used to enhance the BCI performance in terms of signal processing, noise reduction, accuracy, information transfer rate, and user acceptability, the effective BCI system is still in the verge of development. So far, various modifications on single BCI systems as well as hybrid are done and the hybrid BCIs have shown increased but insufficient performance. Therefore, more efficient hybrid BCI models are still under the investigation by different research groups. In this review chapter, single BCI systems are briefly discussed and more detail discussions on hybrid BCIs, their modifications, operations, and performances with comparisons in terms of signal processing approaches, applications, limitations, and future scopes are presented

A New Generation of Brain-Computer Interface Based on Riemannian Geometry

Based on the cumulated experience over the past 25 years in the field of Brain-Computer Interface (BCI) we can now envision a new generation of BCI. Such BCIs will not require training; instead they will be smartly initialized using remote massive databases and will adapt to the user fast and effectively in the first minute of use. They will be reliable, robust and will maintain good performances within and across sessions. A general classification framework based on recent advances in Riemannian geometry and possessing these characteristics is presented. It applies equally well to BCI based on event-related potentials (ERP), sensorimotor (mu) rhythms and steady-state evoked potential (SSEP). The framework is very simple, both algorithmically and computationally. Due to its simplicity, its ability to learn rapidly (with little training data) and its good across-subject and across-session generalization, this strategy a very good candidate for building a new generation of BCIs, thus we hereby propose it as a benchmark method for the field.Comment: 33 pages, 9 Figures, 17 equations/algorithm

Electroencephalography (EEG)-based brain computer interfaces for rehabilitation

Objective: Brain-computer interface (BCI) technologies have been the subject of study for the past decades to help restore functions for people with severe motor disabilities and to improve their quality of life. BCI research can be generally categorized by control signals (invasive/non-invasive) or applications (e.g. neuroprosthetics/brain-actuated wheelchairs), and efforts have been devoted to better understand the characteristics and possible uses of brain signals. The purpose of this research is to explore the feasibility of a non-invasive BCI system with the combination of unique sensorimotor-rhythm (SMR) features. Specifically, a 2D virtual wheelchair control BCI is implemented to extend the application of previously designed 2D cursor control BCI, and the feasibility of the prototype is tested in electroencephalography (EEG) experiments; guidance on enhancing system performance is provided by a simulation incorporating intelligent control approaches under different EEG decoding accuracies; pattern recognition methods are explored to provide optimized classification results; and a hybrid BCI system is built to enhance the usability of the wheelchair BCI system. Methods: In the virtual wheelchair control study, a creative and user friendly control strategy was proposed, and a paradigm was designed in Matlab, providing a virtual environment for control experiments; five subjects performed physical/imagined left/right hand movements or non-control tasks to control the virtual wheelchair to move forward, turn left/right or stop; 2-step classification methods were employed and the performance was evaluated by hit rate and control time. Feature analysis and time-frequency analysis were conducted to examine the spatial, temporal and frequency properties of the utilized SMR features, i.e. event-related desynchronization (ERD) and post-movement event-related synchronization (ERS). The simulation incorporated intelligent control methods, and evaluated navigation and positioning performance with/without obstacles under different EEG decoding accuracies, to better guide optimization. Classification methods were explored considering different feature sets, tuned classifier parameters and the simulation results, and a recommendation was provided to the proposed system. In the steady state visual evoked potential (SSVEP) system for hybrid BCI study, a paradigm was designed, and an electric circuit system was built to provide visual stimulus, involving SSVEP as another type of signal being used to drive the EEG BCI system. Experiments were conducted and classification methods were explored to evaluate the system performance. Results: ERD was observed on both hemispheres during hand\u27s movement or motor imagery; ERS was observed on the contralateral hemisphere after movement or motor imagery stopped; five subjects participated in the continuous 2D virtual wheelchair control study and 4 of them hit the target with 100% hit rate in their best set with motor imagery. The simulation results indicated that the average hit rate with 10 obstacles can get above 95% for pass-door tests and above 70% for positioning tests, with EEG decoding accuracies of 70% for Non-Idle signals and 80% for idle signals. Classification methods showed that with properly tuned parameters, an average of about 70%-80% decoding accuracy for all the classifiers could be reached, which reached the requirements set by the simulation test. Initial test on the SSVEP BCI system exhibited high classification accuracy, which may extend the usability of the wheelchair system to a larger population when finally combined with ERD/ERS BCI system. Conclusion: This research investigated the feasibility of using both ERD and ERS associated with natural hand\u27s motor imagery, aiming to implement practical BCI systems for the end users in the rehabilitation stage. The simulation with intelligent controls provided guides and requirements for EEG decoding accuracies, based on which pattern recognition methods were explored; properly selected features and adjusted parameters enabled the classifiers to exhibit optimal performance, suitable for the proposed system. Finally, to enlarge the population for which the wheelchair BCI system could benefit for, a SSVEP system for hybrid BCI was designed and tested. These systems provide a non-invasive, practical approach for BCI users in controlling assistive devices such as a virtual wheelchair, in terms of ease of use, adequate speed, and sufficient control accuracy

Development of a Practical Visual-Evoked Potential-Based Brain-Computer Interface

There are many different neuromuscular disorders that disrupt the normal communication pathways between the brain and the rest of the body. These diseases often leave patients in a `locked-in state, rendering them unable to communicate with their environment despite having cognitively normal brain function. Brain-computer interfaces (BCIs) are augmentative communication devices that establish a direct link between the brain and a computer. Visual evoked potential (VEP)- based BCIs, which are dependent upon the use of salient visual stimuli, are amongst the fastest BCIs available and provide the highest communication rates compared to other BCI modalities. However. the majority of research focuses solely on improving the raw BCI performance; thus, most visual BCIs still suffer from a myriad of practical issues that make them impractical for everyday use. The focus of this dissertation is on the development of novel advancements and solutions that increase the practicality of VEP-based BCIs. The presented work shows the results of several studies that relate to characterizing and optimizing visual stimuli. improving ergonomic design. reducing visual irritation, and implementing a practical VEP-based BCI using an extensible software framework and mobile devices platforms