Detection of intention level in response to task difficulty from EEG signals

We present an approach that enables detecting intention levels of subjects in response to task difficulty utilizing an electroencephalogram (EEG) based brain-computer interface (BCI). In particular, we use linear discriminant analysis (LDA) to classify event-related synchronization (ERS) and desynchronization (ERD) patterns associated with right elbow flexion and extension movements, while lifting different weights. We observe that it is possible to classify tasks of varying difficulty based on EEG signals. Additionally, we also present a correlation analysis between intention levels detected from EEG and surface electromyogram (sEMG) signals. Our experimental results suggest that it is possible to extract the intention level information from EEG signals in response to task difficulty and indicate some level of correlation between EEG and EMG. With a view towards detecting patients' intention levels during rehabilitation therapies, the proposed approach has the potential to ensure active involvement of patients throughout exercise routines and increase the efficacy of robot assisted therapies

Review of real brain-controlled wheelchairs

This paper presents a review of the state of the art regarding wheelchairs driven by a brain-computer interface (BCI). Using a brain-controlled wheelchair (BCW), disabled users could handle a wheelchair through their brain activity, granting autonomy to move through an experimental environment. A classification is established, based on the characteristics of the BCW, such as the type of electroencephalographic (EEG) signal used, the navigation system employed by the wheelchair, the task for the participants, or the metrics used to evaluate the performance. Furthermore, these factors are compared according to the type of signal used, in order to clarify the differences among them. Finally, the trend of current research in this field is discussed, as well as the challenges that should be solved in the future

Brain-machine interfaces for rehabilitation in stroke: A review

BACKGROUND: Motor paralysis after stroke has devastating consequences for the patients, families and caregivers. Although therapies have improved in the recent years, traditional rehabilitation still fails in patients with severe paralysis. Brain-machine interfaces (BMI) have emerged as a promising tool to guide motor rehabilitation interventions as they can be applied to patients with no residual movement. OBJECTIVE: This paper reviews the efficiency of BMI technologies to facilitate neuroplasticity and motor recovery after stroke. METHODS: We provide an overview of the existing rehabilitation therapies for stroke, the rationale behind the use of BMIs for motor rehabilitation, the current state of the art and the results achieved so far with BMI-based interventions, as well as the future perspectives of neural-machine interfaces. RESULTS: Since the first pilot study by Buch and colleagues in 2008, several controlled clinical studies have been conducted, demonstrating the efficacy of BMIs to facilitate functional recovery in completely paralyzed stroke patients with noninvasive technologies such as the electroencephalogram (EEG). CONCLUSIONS: Despite encouraging results, motor rehabilitation based on BMIs is still in a preliminary stage, and further improvements are required to boost its efficacy. Invasive and hybrid approaches are promising and might set the stage for the next generation of stroke rehabilitation therapies.This study was funded by the Bundesministerium für Bildung und Forschung BMBF MOTORBIC (FKZ13GW0053)andAMORSA(FKZ16SV7754), the Deutsche Forschungsgemeinschaft (DFG), the fortüne-Program of the University of Tübingen (2422-0-0 and 2452-0-0), and the Basque GovernmentScienceProgram(EXOTEK:KK2016/00083). NIL was supported by the Basque Government’s scholarship for predoctoral students

A survey on bio-signal analysis for human-robot interaction

The use of bio-signals analysis in human-robot interaction is rapidly increasing. There is an urgent demand for it in various applications, including health care, rehabilitation, research, technology, and manufacturing. Despite several state-of-the-art bio-signals analyses in human-robot interaction (HRI) research, it is unclear which one is the best. In this paper, the following topics will be discussed: robotic systems should be given priority in the rehabilitation and aid of amputees and disabled people; second, domains of feature extraction approaches now in use, which are divided into three main sections (time, frequency, and time-frequency). The various domains will be discussed, then a discussion of each domain's benefits and drawbacks, and finally, a recommendation for a new strategy for robotic systems

Slow Potentials of the Sensorimotor Cortex during Rhythmic Movements of the Ankle

The objective of this dissertation was to more fully understand the role of the human brain in the production of lower extremity rhythmic movements. Throughout the last century, evidence from animal models has demonstrated that spinal reflexes and networks alone are sufficient to propagate ambulation. However, observations after neural trauma, such as a spinal cord injury, demonstrate that humans require supraspinal drive to facilitate locomotion. To investigate the unique nature of lower extremity rhythmic movements, electroencephalography was used to record neural signals from the sensorimotor cortex during three cyclic ankle movement experiments. First, we characterized the differences in slow movement-related cortical potentials during rhythmic and discrete movements. During the experiment, motion analysis and electromyography were used characterize lower leg kinematics and muscle activation patterns. Second, a custom robotic device was built to assist in passive and active ankle movements. These movement conditions were used to examine the sensory and motor cortical contributions to rhythmic ankle movement. Lastly, we explored the differences in sensory and motor contributions to bilateral, rhythmic ankle movements. Experimental results from all three studies suggest that the brain is continuously involved in rhythmic movements of the lower extremities. We observed temporal characteristics of the cortical slow potentials that were time-locked to the movement. The amplitude of these potentials, localized over the sensorimotor cortex, revealed a reduction in neural activity during rhythmic movements when compared to discrete movements. Moreover, unilateral ankle movements produced unique sensory potentials that tracked the position of the movement and motor potentials that were only present during active dorsiflexion. In addition, the spatiotemporal patterns of slow potentials during bilateral ankle movements suggest similar cortical mechanisms for both unilateral and bilateral movement. Lastly, beta frequency modulations were correlated to the movement-related slow potentials within medial sensorimotor cortex, which may indicate they are of similar cortical origin. From these results, we concluded that the brain is continuously involved in the production of lower extremity rhythmic movements, and that the sensory and motor cortices provide unique contributions to both unilateral and bilateral movemen

Effect of lower limb exoskeleton on the modulation of neural activity and gait classification

: Neurorehabilitation with robotic devices requires a paradigm shift to enhance human-robot interaction. The coupling of robot assisted gait training (RAGT) with a brain-machine interface (BMI) represents an important step in this direction but requires better elucidation of the effect of RAGT on the user's neural modulation. Here, we investigated how different exoskeleton walking modes modify brain and muscular activity during exoskeleton assisted gait. We recorded electroencephalographic (EEG) and electromyographic (EMG) activity from ten able-bodied volunteers walking with an exoskeleton with three modes of user assistance (i.e., transparent, adaptive and full assistance) and during free overground gait. Results identified that exoskeleton walking (irrespective of the exoskeleton mode) induces a stronger modulation of central mid-line mu (8-13 Hz) and low-beta (14-20 Hz) rhythms compared to free overground walking. These modifications are accompanied by a significant re-organization of the EMG patterns in exoskeleton walking. On the other hand, we observed no significant differences in neural activity during exoskeleton walking with the different assistance levels. We subsequently implemented four gait classifiers based on deep neural networks trained on the EEG data during the different walking conditions. Our hypothesis was that exoskeleton modes could impact the creation of a BMI-driven RAGT. We demonstrated that all classifiers achieved an average accuracy of 84.13 ± 3.49% in classifying swing and stance phases on their respective datasets. In addition, we demonstrated that the classifier trained on the transparent mode exoskeleton data can classify gait phases during adaptive and full modes with an accuracy of 78.3 ± 4.8%, while the classifier trained on free overground walking data fails to classify the gait during exoskeleton walking (accuracy of 59.4 ± 11.8%). These findings provide important insights into the effect of robotic training on neural activity and contribute to the advancement of BMI technology for improving robotic gait rehabilitation therapy

Biosignal‐based human–machine interfaces for assistance and rehabilitation : a survey

As a definition, Human–Machine Interface (HMI) enables a person to interact with a device. Starting from elementary equipment, the recent development of novel techniques and unobtrusive devices for biosignals monitoring paved the way for a new class of HMIs, which take such biosignals as inputs to control various applications. The current survey aims to review the large literature of the last two decades regarding biosignal‐based HMIs for assistance and rehabilitation to outline state‐of‐the‐art and identify emerging technologies and potential future research trends. PubMed and other databases were surveyed by using specific keywords. The found studies were further screened in three levels (title, abstract, full‐text), and eventually, 144 journal papers and 37 conference papers were included. Four macrocategories were considered to classify the different biosignals used for HMI control: biopotential, muscle mechanical motion, body motion, and their combinations (hybrid systems). The HMIs were also classified according to their target application by considering six categories: prosthetic control, robotic control, virtual reality control, gesture recognition, communication, and smart environment control. An ever‐growing number of publications has been observed over the last years. Most of the studies (about 67%) pertain to the assistive field, while 20% relate to rehabilitation and 13% to assistance and rehabilitation. A moderate increase can be observed in studies focusing on robotic control, prosthetic control, and gesture recognition in the last decade. In contrast, studies on the other targets experienced only a small increase. Biopotentials are no longer the leading control signals, and the use of muscle mechanical motion signals has experienced a considerable rise, especially in prosthetic control. Hybrid technologies are promising, as they could lead to higher performances. However, they also increase HMIs’ complex-ity, so their usefulness should be carefully evaluated for the specific application

NON INVASIVE INVESTIGATION OF SENSORIMOTOR CONTROL FOR FUTURE DEVELOPMENT OF BRAIN-MACHINE-INTERFACE (BMI)

My thesis focuses on describing novel functional connectivity properties of the sensorimotor system that are of potential interest in the field of brain-machine interface. In particular, I have investigated how the connectivity changes as a consequence of either pathologic conditions or spontaneous fluctuations of the brain's internal state. An ad-hoc electronic device has been developed to implement the appropriate experimental settings. First, the functional communication among sensorimotor primary nodes was investigated in multiple sclerosis patients afflicted by persistent fatigue. I selected this condition, for which there is no effective pharmacological treatment, since existing literature links this type of fatigue to the motor control system. In this study, electroencephalographic (EEG) and electromyographic (EMG) traces were acquired together with the pressure exerted on a bulb during an isometric hand grip. The results showed a higher frequency connection between central and peripheral nervous systems (CMC) and an overcorrection of the exerted movement in fatigued multiple sclerosis patients. In fact, even though any fatigue-dependent brain and muscular oscillatory activity alterations were absent, their connectivity worked at higher frequencies as fatigue increased, explaining 67% of the fatigue scale (MFIS) variance (p=.002). In other terms, the functional communication within the central-peripheral nervous systems, namely involving primary sensorimotor areas, was sensitive to tiny alterations in neural connectivity leading to fatigue, well before the appearance of impairments in single nodes of the network. The second study was about connectivity intended as propagation of information and studied in dependence on spontaneous fluctuations of the sensorimotor system triggered by an external stimulus. Knowledge of the propagation mechanisms and of their changes is essential to extract significant information from single trials. The EEG traces were acquired during transcranial magnetic stimulation (TMS) to yield to a deeper knowledge about the response to an external stimulation while the cortico-spinal system passes through different states. The results showed that spontaneous increases of the excitation of the node originating the transmission within the hand control network gave rise to dynamic recruitment patterns with opposite behaviors, weaker in homotopic and parietal circuits, stronger in frontal ones. As probed by TMS, this behavior indicates that the effective connectivity within bilateral circuits orchestrating hand control are dynamically modulated in time even in resting state. The third investigation assessed the plastic changes in the sensorimotor system after stroke induced by 3 months of robotic rehabilitation in chronic phase. A functional source extraction procedure was applied on the acquired EEG data, enabling the investigation of the functional connectivity between homologous areas in the resting state. The most significant result was that the clinical ameliorations were associated to a ‘normalization’ of the functional connectivity between homologous areas. In fact, the brain connectivity did not necessarily increase or decrease, but it settled within a ‘physiological’ range of connectivity. These studies strengthen our knowledge about the behavioral role of the functional connectivity among neuronal networks’ nodes, which will be essential in future developments of enhanced rehabilitative interventions, including brain-machine interfaces. The presented research also moves the definition of new indices of clinical state evaluation relevant for compensating interventions, a step forward

Multimodal adaptive interfaces for 3D robot-mediated upper limb neuro-rehabilitation: An overview of bio-cooperative systems

n/