Noninvasive Neuroprosthetic Control of Grasping by Amputees

Smooth coordination and fine temporal control of muscles by the brain allows us to effortlessly pre-shape our hand to grasp different objects. Correlates of motor control for grasping have been found across wide-spread cortical areas, with diverse signal features. These signals have been harnessed by implanting intracortical electrodes and used to control the motion of robotic hands by tetraplegics, using algorithms called brain-machine interfaces (BMIs). Signatures of motor control signal encoding mechanisms of the brain in macro-scale signals such as electroencephalography (EEG) are unknown, and could potentially be used to develop noninvasive brain-machine interfaces. Here we show that a) low frequency (0.1 – 1 Hz) time domain EEG contains information about grasp pre-shaping in able-bodies individuals, and b) This information can be used to control pre-shaping motion of a robotic hand by amputees. In the first study, we recorded simultaneous EEG and hand kinematics as 5 able-bodies individuals grasped various objects. Linear decoders using low delta band EEG amplitudes accurately predicted hand pre-shaping kinematics during grasping. Correlation coefficient between predicted and actual kinematics was r = 0.59 ± 0.04, 0.47 ± 0.06 and 0.32 ± 0.05 for the first 3 synergies. In the second study, two transradial amputees (A1 and A2) controlled a prosthetic hand to grasp two objects using a closed-loop BMI with low delta band EEG. This study was conducted longitudinally in 12 sessions spread over 38 days. A1 achieved a 63% success rate, with 11 sessions significantly above chance. A2 achieved a 32% success rate, with 2 sessions significantly above chance. Previous methods of EEG-based BMIs used frequency domain features, and were thought to have a low signal-to-noise ratio making them unsuitable for control of dexterous tasks like grasping. Our results demonstrate that time-domain EEG contains information about grasp pre-shaping, which can be harnessed for neuroprosthetic control.Electrical and Computer Engineering, Department o

Brain-machine interfaces for rehabilitation in stroke: A review

BACKGROUND: Motor paralysis after stroke has devastating consequences for the patients, families and caregivers. Although therapies have improved in the recent years, traditional rehabilitation still fails in patients with severe paralysis. Brain-machine interfaces (BMI) have emerged as a promising tool to guide motor rehabilitation interventions as they can be applied to patients with no residual movement. OBJECTIVE: This paper reviews the efficiency of BMI technologies to facilitate neuroplasticity and motor recovery after stroke. METHODS: We provide an overview of the existing rehabilitation therapies for stroke, the rationale behind the use of BMIs for motor rehabilitation, the current state of the art and the results achieved so far with BMI-based interventions, as well as the future perspectives of neural-machine interfaces. RESULTS: Since the first pilot study by Buch and colleagues in 2008, several controlled clinical studies have been conducted, demonstrating the efficacy of BMIs to facilitate functional recovery in completely paralyzed stroke patients with noninvasive technologies such as the electroencephalogram (EEG). CONCLUSIONS: Despite encouraging results, motor rehabilitation based on BMIs is still in a preliminary stage, and further improvements are required to boost its efficacy. Invasive and hybrid approaches are promising and might set the stage for the next generation of stroke rehabilitation therapies.This study was funded by the Bundesministerium für Bildung und Forschung BMBF MOTORBIC (FKZ13GW0053)andAMORSA(FKZ16SV7754), the Deutsche Forschungsgemeinschaft (DFG), the fortüne-Program of the University of Tübingen (2422-0-0 and 2452-0-0), and the Basque GovernmentScienceProgram(EXOTEK:KK2016/00083). NIL was supported by the Basque Government’s scholarship for predoctoral students

Low-frequency cortical activity is a neuromodulatory target that tracks recovery after stroke.

Recent work has highlighted the importance of transient low-frequency oscillatory (LFO; <4 Hz) activity in the healthy primary motor cortex during skilled upper-limb tasks. These brief bouts of oscillatory activity may establish the timing or sequencing of motor actions. Here, we show that LFOs track motor recovery post-stroke and can be a physiological target for neuromodulation. In rodents, we found that reach-related LFOs, as measured in both the local field potential and the related spiking activity, were diminished after stroke and that spontaneous recovery was closely correlated with their restoration in the perilesional cortex. Sensorimotor LFOs were also diminished in a human subject with chronic disability after stroke in contrast to two non-stroke subjects who demonstrated robust LFOs. Therapeutic delivery of electrical stimulation time-locked to the expected onset of LFOs was found to significantly improve skilled reaching in stroke animals. Together, our results suggest that restoration or modulation of cortical oscillatory dynamics is important for the recovery of upper-limb function and that they may serve as a novel target for clinical neuromodulation

Low-frequency local field potentials in primate motor cortex and their application to neural interfaces

PhD ThesisFor patients with spinal cord injury and paralysis, there are currently very limited options for clinical therapy. Brain-machine interfaces (BMIs) are neuroprosthetic devices that are being developed to record from the motor cortex in such patients, bypass the spinal lesion, and use decoded signals to control an effector, such as a prosthetic limb. The ideal BMI would be durable, reliable, totally predictable, fully-implantable, and have generous battery life. Current, state-of-the-art BMIs are limited in all of these domains; partly because the typical signals used—neuronal action potentials, or ‘spikes’—are very susceptible to micro-movement of recording electrodes. Recording spikes from the same neurons over many months is therefore difficult, and decoder behaviour may be unpredictable from day-today. Spikes also need to be digitized at high frequencies (~104 Hz) and heavily processed. As a result, devices are energy-hungry and difficult to miniaturise. Low-frequency local field potentials (lf-LFPs; < 5 Hz) are an alternative cortical signal. They are more stable and can be captured and processed at much lower frequencies (~101 Hz). Here we investigate rhythmical lf-LFP activity, related to the firing of local cortical neurons, during isometric wrist movements in Rhesus macaques. Multichannel spike-related slow potentials (SRSPs) can be used to accurately decode the firing rates of individual motor cortical neurons, and subjects can control a BMI task using this synthetic signal, as if they were controlling the actual firing rate. Lf-LFP–based firing rate estimates are stable over time – even once actual spike recordings have been lost. Furthermore, the dynamics of lf-LFPs are distinctive enough, that an unsupervised approach can be used to train a decoder to extract movement-related features for use in biofeedback BMIs. Novel electrode designs may help us optimise the recording of these signals, and facilitate progress towards a new generation of robust, implantable BMIs for patients.Research Studentship from the MRC, and Andy Jackson’s laboratory (hence this work) is supported by the Wellcome Trust

Closed-Loop Deep Brain Stimulation for Essential Tremor Based on Thalamic Local Field Potentials.

BACKGROUND: High-frequency thalamic stimulation is an effective therapy for essential tremor, which mainly affects voluntary movements and/or sustained postures. However, continuous stimulation may deliver unnecessary current to the brain due to the intermittent nature of the tremor. OBJECTIVE: We proposed to close the loop of thalamic stimulation by detecting tremor-provoking movement states using local field potentials recorded from the same electrodes implanted for stimulation, so that the stimulation is only delivered when necessary. METHODS: Eight patients with essential tremor participated in this study. Patient-specific support vector machine classifiers were first trained using data recorded while the patient performed tremor-provoking movements. Then, the trained models were applied in real-time to detect these movements and triggered the delivery of stimulation. RESULTS: Using the proposed method, stimulation was switched on for 80.37 ± 7.06% of the time when tremor-evoking movements were present. In comparison, the stimulation was switched on for 12.71 ± 7.06% of the time when the patients were at rest and tremor-free. Compared with continuous stimulation, a similar amount of tremor suppression was achieved while only delivering 36.62 ± 13.49% of the energy used in continuous stimulation. CONCLUSIONS: The results suggest that responsive thalamic stimulation for essential tremor based on tremor-provoking movement detection can be achieved without any requirement for external sensors or additional electrocorticography strips. Further research is required to investigate whether the decoding model is stable across time and generalizable to the variety of activities patients may engage with in everyday life. © 2021 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society

Data Augmentation for Deep-Learning-Based Electroencephalography

Background: Data augmentation (DA) has recently been demonstrated to achieve considerable performance gains for deep learning (DL)—increased accuracy and stability and reduced overfitting. Some electroencephalography (EEG) tasks suffer from low samples-to-features ratio, severely reducing DL effectiveness. DA with DL thus holds transformative promise for EEG processing, possibly like DL revolutionized computer vision, etc. New method: We review trends and approaches to DA for DL in EEG to address: Which DA approaches exist and are common for which EEG tasks? What input features are used? And, what kind of accuracy gain can be expected? Results: DA for DL on EEG begun 5 years ago and is steadily used more. We grouped DA techniques (noise addition, generative adversarial networks, sliding windows, sampling, Fourier transform, recombination of segmentation, and others) and EEG tasks (into seizure detection, sleep stages, motor imagery, mental workload, emotion recognition, motor tasks, and visual tasks). DA efficacy across techniques varied considerably. Noise addition and sliding windows provided the highest accuracy boost; mental workload most benefitted from DA. Sliding window, noise addition, and sampling methods most common for seizure detection, mental workload, and sleep stages, respectively. Comparing with existing methods: Percent of decoding accuracy explained by DA beyond unaugmented accuracy varied between 8% for recombination of segmentation and 36% for noise addition and from 14% for motor imagery to 56% for mental workload—29% on average. Conclusions: DA increasingly used and considerably improved DL decoding accuracy on EEG. Additional publications—if adhering to our reporting guidelines—will facilitate more detailed analysis

Data Augmentation for Deep-Learning-Based Electroencephalography

Background: Data augmentation (DA) has recently been demonstrated to achieve considerable performance gains for deep learning (DL)—increased accuracy and stability and reduced overfitting. Some electroencephalography (EEG) tasks suffer from low samples-to-features ratio, severely reducing DL effectiveness. DA with DL thus holds transformative promise for EEG processing, possibly like DL revolutionized computer vision, etc. New method: We review trends and approaches to DA for DL in EEG to address: Which DA approaches exist and are common for which EEG tasks? What input features are used? And, what kind of accuracy gain can be expected? Results: DA for DL on EEG begun 5 years ago and is steadily used more. We grouped DA techniques (noise addition, generative adversarial networks, sliding windows, sampling, Fourier transform, recombination of segmentation, and others) and EEG tasks (into seizure detection, sleep stages, motor imagery, mental workload, emotion recognition, motor tasks, and visual tasks). DA efficacy across techniques varied considerably. Noise addition and sliding windows provided the highest accuracy boost; mental workload most benefitted from DA. Sliding window, noise addition, and sampling methods most common for seizure detection, mental workload, and sleep stages, respectively. Comparing with existing methods: Percent of decoding accuracy explained by DA beyond unaugmented accuracy varied between 8% for recombination of segmentation and 36% for noise addition and from 14% for motor imagery to 56% for mental workload—29% on average. Conclusions: DA increasingly used and considerably improved DL decoding accuracy on EEG. Additional publications—if adhering to our reporting guidelines—will facilitate more detailed analysis

Machine learning based brain signal decoding for intelligent adaptive deep brain stimulation

Sensing enabled implantable devices and next-generation neurotechnology allow real-time adjustments of invasive neuromodulation. The identification of symptom and disease-specific biomarkers in invasive brain signal recordings has inspired the idea of demand dependent adaptive deep brain stimulation (aDBS). Expanding the clinical utility of aDBS with machine learning may hold the potential for the next breakthrough in the therapeutic success of clinical brain computer interfaces. To this end, sophisticated machine learning algorithms optimized for decoding of brain states from neural time-series must be developed. To support this venture, this review summarizes the current state of machine learning studies for invasive neurophysiology. After a brief introduction to the machine learning terminology, the transformation of brain recordings into meaningful features for decoding of symptoms and behavior is described. Commonly used machine learning models are explained and analyzed from the perspective of utility for aDBS. This is followed by a critical review on good practices for training and testing to ensure conceptual and practical generalizability for real-time adaptation in clinical settings. Finally, first studies combining machine learning with aDBS are highlighted. This review takes a glimpse into the promising future of intelligent adaptive DBS (iDBS) and concludes by identifying four key ingredients on the road for successful clinical adoption: i) multidisciplinary research teams, ii) publicly available datasets, iii) open-source algorithmic solutions and iv) strong world-wide research collaborations.Fil: Merk, Timon. Charité – Universitätsmedizin Berlin; AlemaniaFil: Peterson, Victoria. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Santa Fe. Instituto de Matemática Aplicada del Litoral. Universidad Nacional del Litoral. Instituto de Matemática Aplicada del Litoral; Argentina. Harvard Medical School; Estados UnidosFil: Köhler, Richard. Charité – Universitätsmedizin Berlin; AlemaniaFil: Haufe, Stefan. Charité – Universitätsmedizin Berlin; AlemaniaFil: Richardson, R. Mark. Harvard Medical School; Estados UnidosFil: Neumann, Wolf Julian. Charité – Universitätsmedizin Berlin; Alemani