Implications of the Dependence of Neuronal Activity on Neural Network States for the Design of Brain-Machine Interfaces.

Brain-machine interfaces (BMIs) can improve the quality of life of patients with sensory and motor disabilities by both decoding motor intentions expressed by neural activity, and by encoding artificially sensed information into patterns of neural activity elicited by causal interventions on the neural tissue. Yet, current BMIs can exchange relatively small amounts of information with the brain. This problem has proved difficult to overcome by simply increasing the number of recording or stimulating electrodes, because trial-to-trial variability of neural activity partly arises from intrinsic factors (collectively known as the network state) that include ongoing spontaneous activity and neuromodulation, and so is shared among neurons. Here we review recent progress in characterizing the state dependence of neural responses, and in particular of how neural responses depend on endogenous slow fluctuations of network excitability. We then elaborate on how this knowledge may be used to increase the amount of information that BMIs exchange with brain. Knowledge of network state can be used to fine-tune the stimulation pattern that should reliably elicit a target neural response used to encode information in the brain, and to discount part of the trial-by-trial variability of neural responses, so that they can be decoded more accurately

A programmable closed-loop recording and stimulating wireless system for behaving small laboratory animals

A portable 16-channels microcontroller-based wireless system for a bi-directional interaction with the central nervous system is presented in this work. The device is designed to be used with freely behaving small laboratory animals and allows recording of spontaneous and evoked neural activity wirelessly transmitted and stored on a personal computer. Biphasic current stimuli with programmable duration, frequency and amplitude may be triggered in real-time on the basis of the recorded neural activity as well as by the animal behavior within a specifically designed experimental setup. An intuitive graphical user interface was developed to configure and to monitor the whole system. The system was successfully tested through bench tests and in vivo measurements on behaving rats chronically implanted with multi-channels microwire arrays

New Perspectives on the Dialogue between Brains and Machines

Brain-machine interfaces (BMIs) are mostly investigated as a means to provide paralyzed people with new communication channels with the external world. However, the communication between brain and artificial devices also offers a unique opportunity to study the dynamical properties of neural systems. This review focuses on bidirectional interfaces, which operate in two ways by translating neural signals into input commands for the device and the output of the device into neural stimuli. We discuss how bidirectional BMIs help investigating neural information processing and how neural dynamics may participate in the control of external devices. In this respect, a bidirectional BMI can be regarded as a fancy combination of neural recording and stimulation apparatus, connected via an artificial body. The artificial body can be designed in virtually infinite ways in order to observe different aspects of neural dynamics and to approximate desired control policies

Neural oscillations during motor imagery of complex gait: an HdEEG study

The aim of this study was to investigate differences between usual and complex gait motor imagery (MI) task in healthy subjects using high-density electroencephalography (hdEEG) with a MI protocol. We characterized the spatial distribution of alpha- and beta-bands oscillations extracted from hdEEG signals recorded during MI of usual walking (UW) and walking by avoiding an obstacle (Dual-Task, DT). We applied a source localization algorithm to brain regions selected from a large cortical-subcortical network, and then we analyzed alpha and beta bands Event-Related Desynchronizations (ERDs). Nineteen healthy subjects visually imagined walking on a path with (DT) and without (UW) obstacles. Results showed in both gait MI tasks, alpha- and beta-band ERDs in a large cortical-subcortical network encompassing mostly frontal and parietal regions. In most of the regions, we found alpha- and beta-band ERDs in the DT compared with the UW condition. Finally, in the beta band, significant correlations emerged between ERDs and scores in imagery ability tests. Overall we detected MI gait-related alpha- and beta-band oscillations in cortical and subcortical areas and significant differences between UW and DT MI conditions. A better understanding of gait neural correlates may lead to a better knowledge of pathophysiology of gait disturbances in neurological diseases

State-Dependent Decoding Algorithms Improve the Performance of a Bidirectional BMI in Anesthetized Rats.

Brain-machine interfaces (BMIs) promise to improve the quality of life of patients suffering from sensory and motor disabilities by creating a direct communication channel between the brain and the external world. Yet, their performance is currently limited by the relatively small amount of information that can be decoded from neural activity recorded form the brain. We have recently proposed that such decoding performance may be improved when using state-dependent decoding algorithms that predict and discount the large component of the trial-to-trial variability of neural activity which is due to the dependence of neural responses on the network's current internal state. Here we tested this idea by using a bidirectional BMI to investigate the gain in performance arising from using a state-dependent decoding algorithm. This BMI, implemented in anesthetized rats, controlled the movement of a dynamical system using neural activity decoded from motor cortex and fed back to the brain the dynamical system's position by electrically microstimulating somatosensory cortex. We found that using state-dependent algorithms that tracked the dynamics of ongoing activity led to an increase in the amount of information extracted form neural activity by 22%, with a consequently increase in all of the indices measuring the BMI's performance in controlling the dynamical system. This suggests that state-dependent decoding algorithms may be used to enhance BMIs at moderate computational cost

A Bidirectional Brain-Machine Interface Featuring a Neuromorphic Hardware Decoder.

Bidirectional brain-machine interfaces (BMIs) establish a two-way direct communication link between the brain and the external world. A decoder translates recorded neural activity into motor commands and an encoder delivers sensory information collected from the environment directly to the brain creating a closed-loop system. These two modules are typically integrated in bulky external devices. However, the clinical support of patients with severe motor and sensory deficits requires compact, low-power, and fully implantable systems that can decode neural signals to control external devices. As a first step toward this goal, we developed a modular bidirectional BMI setup that uses a compact neuromorphic processor as a decoder. On this chip we implemented a network of spiking neurons built using its ultra-low-power mixed-signal analog/digital circuits. On-chip on-line spike-timing-dependent plasticity synapse circuits enabled the network to learn to decode neural signals recorded from the brain into motor outputs controlling the movements of an external device. The modularity of the BMI allowed us to tune the individual components of the setup without modifying the whole system. In this paper, we present the features of this modular BMI and describe how we configured the network of spiking neuron circuits to implement the decoder and to coordinate it with the encoder in an experimental BMI paradigm that connects bidirectionally the brain of an anesthetized rat with an external object. We show that the chip learned the decoding task correctly, allowing the interfaced brain to control the object's trajectories robustly. Based on our demonstration, we propose that neuromorphic technology is mature enough for the development of BMI modules that are sufficiently low-power and compact, while being highly computationally powerful and adaptive

A bidirectional brain-machine interface algorithm that approximates arbitrary force-fields

We examine bidirectional brain-machine interfaces that control external devices in a closed loop by decoding motor cortical activity to command the device and by encoding the state of the device by delivering electrical stimuli to sensory areas. Although it is possible to design this artificial sensory-motor interaction while maintaining two independent channels of communication, here we propose a rule that closes the loop between flows of sensory and motor information in a way that approximates a desired dynamical policy expressed as a field of forces acting upon the controlled external device. We previously developed a first implementation of this approach based on linear decoding of neural activity recorded from the motor cortex into a set of forces (a force field) applied to a point mass, and on encoding of position of the point mass into patterns of electrical stimuli delivered to somatosensory areas. However, this previous algorithm had the limitation that it only worked in situations when the position-to-force map to be implemented is invertible. Here we overcome this limitation by developing a new non-linear form of the bidirectional interface that can approximate a virtually unlimited family of continuous fields. The new algorithm bases both the encoding of position information and the decoding of motor cortical activity on an explicit map between spike trains and the state space of the device computed with Multi-Dimensional-Scaling. We present a detailed computational analysis of the performance of the interface and a validation of its robustness by using synthetic neural responses in a simulated sensory-motor loop

Motor imagery ability scores are related to cortical activation during gait imagery

Abstract Motor imagery (MI) is the mental execution of actions without overt movements that depends on the ability to imagine. We explored whether this ability could be related to the cortical activity of the brain areas involved in the MI network. To this goal, brain activity was recorded using high-density electroencephalography in nineteen healthy adults while visually imagining walking on a straight path. We extracted Event-Related Desynchronizations (ERDs) in the θ, α, and β band, and we measured MI ability via (i) the Kinesthetic and Visual Imagery Questionnaire (KVIQ), (ii) the Vividness of Movement Imagery Questionnaire-2 (VMIQ), and (iii) the Imagery Ability (IA) score. We then used Pearson’s and Spearman’s coefficients to correlate MI ability scores and average ERD power (avgERD). Positive correlations were identified between VMIQ and avgERD of the middle cingulum in the β band and with avgERD of the left insula, right precentral area, and right middle occipital region in the θ band. Stronger activation of the MI network was related to better scores of MI ability evaluations, supporting the importance of testing MI ability during MI protocols. This result will help to understand MI mechanisms and develop personalized MI treatments for patients with neurological dysfunctions