Improving motor imagery classification during induced motor perturbations

Objective.Motor imagery is the mental simulation of movements. It is a common paradigm to design brain-computer interfaces (BCIs) that elicits the modulation of brain oscillatory activity similar to real, passive and induced movements. In this study, we used peripheral stimulation to provoke movements of one limb during the performance of motor imagery tasks. Unlike other works, in which induced movements are used to support the BCI operation, our goal was to test and improve the robustness of motor imagery based BCI systems to perturbations caused by artificially generated movements.Approach.We performed a BCI session with ten participants who carried out motor imagery of three limbs. In some of the trials, one of the arms was moved by neuromuscular stimulation. We analysed 2-class motor imagery classifications with and without movement perturbations. We investigated the performance decrease produced by these disturbances and designed different computational strategies to attenuate the observed classification accuracy drop.Main results.When the movement was induced in a limb not coincident with the motor imagery classes, extracting oscillatory sources of the movement imagination tasks resulted in BCI performance being similar to the control (undisturbed) condition; when the movement was induced in a limb also involved in the motor imagery tasks, the performance drop was significantly alleviated by spatially filtering out the neural noise caused by the stimulation. We also show that the loss of BCI accuracy was accompanied by weaker power of the sensorimotor rhythm. Importantly, this residual power could be used to predict whether a BCI user will perform with sufficient accuracy under the movement disturbances.Significance.We provide methods to ameliorate and even eliminate motor related afferent disturbances during the performance of motor imagery tasks. This can help improving the reliability of current motor imagery based BCI systems

Transition from the locked in to the completely locked-in state: A physiological analysis

h i g h l i g h t s This represents the first documentation of transition of a patient with ALS from the Locked In State the to Completely Locked In State, and the first EMG documentation of loss of all muscle activities, including sphincter function, but with retained cognition as measured with ERPs. In this patient, any stimulation, communication or learning using visual and tactile stimuli was lost. Visual BCI was useless. The findings suggest ALS as a multisystem disorder, even affecting afferent sensory pathways. a b s t r a c t Objective: To clarify the physiological and behavioral boundaries between locked-in (LIS) and the completely locked-in state (CLIS) (no voluntary eye movements, no communication possible) through electrophysiological data and to secure brain-computer-interface (BCI) communication. Methods: Electromyography from facial muscles, external anal sphincter (EAS), electrooculography and electrocorticographic data during different psychophysiological tests were acquired to define electrophysiological differences in an amyotrophic lateral sclerosis (ALS) patient with an intracranially implanted grid of 112 electrodes for nine months while the patient passed from the LIS to the CLIS. Results: At the very end of the LIS there was no facial muscle activity, nor external anal sphincter but eye control. Eye movements were slow and lasted for short periods only. During CLIS event related brain potentials (ERP) to passive limb movements and auditory stimuli were recorded, vibrotactile stimulation of different body parts resulted in no ERP response. Conclusions: The results presented contradict the commonly accepted assumption that the EAS is the last remaining muscle under voluntary control and demonstrate complete loss of eye movements in CLIS. The eye muscle was shown to be the last muscle group under voluntary control. The findings suggest ALS as a multisystem disorder, even affecting afferent sensory pathways. Significance: Auditory and proprioceptive brain-computer-interface (BCI) systems are the only remaining communication channels in CLIS

Challenges of neural interfaces for stroke motor rehabilitation

More than 85% of stroke survivors suffer from different degrees of disability for the rest of their lives. They will require support that can vary from occasional to full time assistance. These conditions are also associated to an enormous economic impact for their families and health care systems. Current rehabilitation treatments have limited efficacy and their long-term effect is controversial. Here we review different challenges related to the design and development of neural interfaces for rehabilitative purposes. We analyze current bibliographic evidence of the effect of neuro-feedback in functional motor rehabilitation of stroke patients. We highlight the potential of these systems to reconnect brain and muscles. We also describe all aspects that should be taken into account to restore motor control. Our aim with this work is to help researchers designing interfaces that demonstrate and validate neuromodulation strategies to enforce a contingent and functional neural linkage between the central and the peripheral nervous system. We thus give clues to design systems that can improve or/and re-activate neuroplastic mechanisms and open a new recovery window for stroke patients

A hybrid brain-muscle-machine interface for stroke rehabilitation: Usability and functionality validation in a 2-week intensive intervention

Introduction: The primary constraint of non-invasive brain-machine interfaces (BMIs) in stroke rehabilitation lies in the poor spatial resolution of motor intention related neural activity capture. To address this limitation, hybrid brain-muscle-machine interfaces (hBMIs) have been suggested as superior alternatives. These hybrid interfaces incorporate supplementary input data from muscle signals to enhance the accuracy, smoothness and dexterity of rehabilitation device control. Nevertheless, determining the distribution of control between the brain and muscles is a complex task, particularly when applied to exoskeletons with multiple degrees of freedom (DoFs). Here we present a feasibility, usability and functionality study of a bio-inspired hybrid brain-muscle machine interface to continuously control an upper limb exoskeleton with 7 DoFs.Methods: The system implements a hierarchical control strategy that follows the biologically natural motor command pathway from the brain to the muscles. Additionally, it employs an innovative mirror myoelectric decoder, offering patients a reference model to assist them in relearning healthy muscle activation patterns during training. Furthermore, the multi-DoF exoskeleton enables the practice of coordinated arm and hand movements, which may facilitate the early use of the affected arm in daily life activities. In this pilot trial six chronic and severely paralyzed patients controlled the multi-DoF exoskeleton using their brain and muscle activity. The intervention consisted of 2 weeks of hBMI training of functional tasks with the system followed by physiotherapy. Patients’ feedback was collected during and after the trial by means of several feedback questionnaires. Assessment sessions comprised clinical scales and neurophysiological measurements, conducted prior to, immediately following the intervention, and at a 2-week follow-up.Results: Patients’ feedback indicates a great adoption of the technology and their confidence in its rehabilitation potential. Half of the patients showed improvements in their arm function and 83% improved their hand function. Furthermore, we found improved patterns of muscle activation as well as increased motor evoked potentials after the intervention.Discussion: This underscores the significant potential of bio-inspired interfaces that engage the entire nervous system, spanning from the brain to the muscles, for the rehabilitation of stroke patients, even those who are severely paralyzed and in the chronic phase

Predicting mental imagery based BCI performance from personality, cognitive profile and neurophysiological patterns

Mental-Imagery based Brain-Computer Interfaces (MI-BCIs) allow their users to send commands to a computer using their brain-activity alone (typically measured by ElectroEncephaloGraphy— EEG), which is processed while they perform specific mental tasks. While very promising, MI-BCIs remain barely used outside laboratories because of the difficulty encountered by users to control them. Indeed, although some users obtain good control performances after training, a substantial proportion remains unable to reliably control an MI-BCI. This huge variability in user-performance led the community to look for predictors of MI-BCI control ability. However, these predictors were only explored for motor-imagery based BCIs, and mostly for a single training session per subject. In this study, 18 participants were instructed to learn to control an EEG-based MI-BCI by performing 3 MI-tasks, 2 of which were non-motor tasks, across 6 training sessions, on 6 different days. Relationships between the participants’ BCI control performances and their personality, cognitive profile and neurophysiological markers were explored. While no relevant relationships with neurophysiological markers were found, strong correlations between MI-BCI performances and mental-rotation scores (reflecting spatial abilities) were revealed. Also, a predictive model of MI-BCI performance based on psychometric questionnaire scores was proposed. A leave-one-subject-out cross validation process revealed the stability and reliability of this model: it enabled to predict participants’ performance with a mean error of less than 3 points. This study determined how users’ profiles impact their MI-BCI control ability and thus clears the way for designing novel MI-BCI training protocols, adapted to the profile of each user

The ENIGMA Stroke Recovery Working Group: Big data neuroimaging to study brain–behavior relationships after stroke

The goal of the Enhancing Neuroimaging Genetics through Meta‐Analysis (ENIGMA) Stroke Recovery working group is to understand brain and behavior relationships using well‐powered meta‐ and mega‐analytic approaches. ENIGMA Stroke Recovery has data from over 2,100 stroke patients collected across 39 research studies and 10 countries around the world, comprising the largest multisite retrospective stroke data collaboration to date. This article outlines the efforts taken by the ENIGMA Stroke Recovery working group to develop neuroinformatics protocols and methods to manage multisite stroke brain magnetic resonance imaging, behavioral and demographics data. Specifically, the processes for scalable data intake and preprocessing, multisite data harmonization, and large‐scale stroke lesion analysis are described, and challenges unique to this type of big data collaboration in stroke research are discussed. Finally, future directions and limitations, as well as recommendations for improved data harmonization through prospective data collection and data management, are provided

The ENIGMA Stroke Recovery Working Group: Big data neuroimaging to study brain-behavior relationships after stroke

The goal of the Enhancing Neuroimaging Genetics through Meta-Analysis (ENIGMA) Stroke Recovery working group is to understand brain and behavior relationships using well-powered meta- and mega-analytic approaches. ENIGMA Stroke Recovery has data from over 2,100 stroke patients collected across 39 research studies and 10 countries around the world, comprising the largest multisite retrospective stroke data collaboration to date. This article outlines the efforts taken by the ENIGMA Stroke Recovery working group to develop neuroinformatics protocols and methods to manage multisite stroke brain magnetic resonance imaging, behavioral and demographics data. Specifically, the processes for scalable data intake and preprocessing, multisite data harmonization, and large-scale stroke lesion analysis are described, and challenges unique to this type of big data collaboration in stroke research are discussed. Finally, future directions and limitations, as well as recommendations for improved data harmonization through prospective data collection and data management, are provided

Chronic Stroke Sensorimotor Impairment Is Related to Smaller Hippocampal Volumes: An ENIGMA Analysis

Background. Persistent sensorimotor impairments after stroke can negatively impact quality of life. The hippocampus is vulnerable to poststroke secondary degeneration and is involved in sensorimotor behavior but has not been widely studied within the context of poststroke upper‐limb sensorimotor impairment. We investigated associations between non‐lesioned hippocampal volume and upper limb sensorimotor impairment in people with chronic stroke, hypothesizing that smaller ipsilesional hippocampal volumes would be associated with greater sensorimotor impairment. Methods and Results. Cross‐sectional T1‐weighted magnetic resonance images of the brain were pooled from 357 participants with chronic stroke from 18 research cohorts of the ENIGMA (Enhancing NeuoImaging Genetics through Meta‐Analysis) Stroke Recovery Working Group. Sensorimotor impairment was estimated from the FMA‐UE (Fugl‐Meyer Assessment of Upper Extremity). Robust mixed‐effects linear models were used to test associations between poststroke sensorimotor impairment and hippocampal volumes (ipsilesional and contralesional separately; Bonferroni‐corrected, P<0.025), controlling for age, sex, lesion volume, and lesioned hemisphere. In exploratory analyses, we tested for a sensorimotor impairment and sex interaction and relationships between lesion volume, sensorimotor damage, and hippocampal volume. Greater sensorimotor impairment was significantly associated with ipsilesional (P=0.005; β=0.16) but not contralesional (P=0.96; β=0.003) hippocampal volume, independent of lesion volume and other covariates (P=0.001; β=0.26). Women showed progressively worsening sensorimotor impairment with smaller ipsilesional (P=0.008; β=−0.26) and contralesional (P=0.006; β=−0.27) hippocampal volumes compared with men. Hippocampal volume was associated with lesion size (P<0.001; β=−0.21) and extent of sensorimotor damage (P=0.003; β=−0.15). Conclusions. The present study identifies novel associations between chronic poststroke sensorimotor impairment and ipsilesional hippocampal volume that are not caused by lesion size and may be stronger in women.S.-L.L. is supported by NIH K01 HD091283; NIH R01 NS115845. A.B. and M.S.K. are supported by National Health and Medical Research Council (NHMRC) GNT1020526, GNT1045617 (A.B.), GNT1094974, and Heart Foundation Future Leader Fellowship 100784 (A.B.). P.M.T. is supported by NIH U54 EB020403. L.A.B. is supported by the Canadian Institutes of Health Research (CIHR). C.M.B. is supported by NIH R21 HD067906. W.D.B. is supported by the Heath Research Council of New Zealand. J.M.C. is supported by NIH R00HD091375. A.B.C. is supported by NIH R01NS076348-01, Hospital Israelita Albert Einstein 2250-14, CNPq/305568/2016-7. A.N.D. is supported by funding provided by the Texas Legislature to the Lone Star Stroke Clinical Trial Network. Its contents are solely the responsibility of the authors and do not necessarily represent the of ficial views of the Government of the United States or the State of Texas. N.E.-B. is supported by Australian Research Council NIH DE180100893. W.F. is sup ported by NIH P20 GM109040. F.G. is supported by Wellcome Trust (093957). B.H. is funded by and NHMRC fellowship (1125054). S.A.K is supported by NIH P20 HD109040. F.B. is supported by Italian Ministry of Health, RC 20, 21. N.S. is supported by NIH R21NS120274. N.J.S. is supported by NIH/National Institute of General Medical Sciences (NIGMS) 2P20GM109040-06, U54-GM104941. S.R.S. is supported by European Research Council (ERC) (NGBMI, 759370). G.S. is supported by Italian Ministry of Health RC 18-19-20-21A. M.T. is sup ported by National Institute of Neurological Disorders and Stroke (NINDS) R01 NS110696. G.T.T. is supported by Temple University sub-award of NIH R24 –NHLBI (Dr Mickey Selzer) Center for Experimental Neurorehabilitation Training. N.J.S. is funded by NIH/National Institute of Child Health and Human Development (NICHD) 1R01HD094731-01A1

Smaller spared subcortical nuclei are associated with worse post-stroke sensorimotor outcomes in 28 cohorts worldwide

Up to two-thirds of stroke survivors experience persistent sensorimotor impairments. Recovery relies on the integrity of spared brain areas to compensate for damaged tissue. Deep grey matter structures play a critical role in the control and regulation of sensorimotor circuits. The goal of this work is to identify associations between volumes of spared subcortical nuclei and sensorimotor behaviour at different timepoints after stroke. We pooled high-resolution T1-weighted MRI brain scans and behavioural data in 828 individuals with unilateral stroke from 28 cohorts worldwide. Cross-sectional analyses using linear mixed-effects models related post-stroke sensorimotor behaviour to non-lesioned subcortical volumes (Bonferroni-corrected, P < 0.004). We tested subacute (≤90 days) and chronic (≥180 days) stroke subgroups separately, with exploratory analyses in early stroke (≤21 days) and across all time. Sub-analyses in chronic stroke were also performed based on class of sensorimotor deficits (impairment, activity limitations) and side of lesioned hemisphere. Worse sensorimotor behaviour was associated with a smaller ipsilesional thalamic volume in both early (n = 179; d = 0.68) and subacute (n = 274, d = 0.46) stroke. In chronic stroke (n = 404), worse sensorimotor behaviour was associated with smaller ipsilesional putamen (d = 0.52) and nucleus accumbens (d = 0.39) volumes, and a larger ipsilesional lateral ventricle (d = -0.42). Worse chronic sensorimotor impairment specifically (measured by the Fugl-Meyer Assessment; n = 256) was associated with smaller ipsilesional putamen (d = 0.72) and larger lateral ventricle (d = -0.41) volumes, while several measures of activity limitations (n = 116) showed no significant relationships. In the full cohort across all time (n = 828), sensorimotor behaviour was associated with the volumes of the ipsilesional nucleus accumbens (d = 0.23), putamen (d = 0.33), thalamus (d = 0.33) and lateral ventricle (d = -0.23). We demonstrate significant relationships between post-stroke sensorimotor behaviour and reduced volumes of deep grey matter structures that were spared by stroke, which differ by time and class of sensorimotor measure. These findings provide additional insight into how different cortico-thalamo-striatal circuits support post-stroke sensorimotor outcomes

Subject - specific - frequency - band for motor imagery EEG signal recognition based on common spatial spectral pattern

Over the last decade, processing of biomedical signals using machine learning algorithms has gained widespread attention. Amongst these, one of the most important signals is electroencephalography (EEG) signal that is used to monitor the brain activities. Brain-computer-interface (BCI) has also become a hot topic of research where EEG signals are usually acquired using non-invasive sensors. In this work, we propose a scheme based on common spatial spectral pattern (CSSP) and optimization of temporal filters for improved motor imagery (MI) EEG signal recognition. CSSP is proposed as it improves the spatial resolution while the temporal filter is optimized for each subject as the frequency band which contains most significant information varies amongst different subjects. The proposed scheme is evaluated using two publicly available datasets: BCI competition III dataset IVa and BCI competition IV dataset 1. The proposed scheme obtained promising results and outperformed other state-of-the-art methods. The findings of this work will be beneficial for developing improved BCI systems