Operant EEG-based BMI: Learning and consolidating device control with brain activity

"Whether you are reading this thesis on paper or screen, it is easy to take for granted all the highly specialized movements you are doing at this very moment just to go through each page. Just to turn a page, you have to reach for and grasp it, turn it and let go at the precise moment not to rip it.(...)

Cortical Decoding of Individual Finger Group Motions Using ReFIT Kalman Filter

Objective: To date, many brain-machine interface (BMI) studies have developed decoding algorithms for neuroprostheses that provide users with precise control of upper arm reaches with some limited grasping capabilities. However, comparatively few have focused on quantifying the performance of precise finger control. Here we expand upon this work by investigating online control of individual finger groups.Approach: We have developed a novel training manipulandum for non-human primate (NHP) studies to isolate the movements of two specific finger groups: index and middle-ring-pinkie (MRP) fingers. We use this device in combination with the ReFIT (Recalibrated Feedback Intention-Trained) Kalman filter to decode the position of each finger group during a single degree of freedom task in two rhesus macaques with Utah arrays in motor cortex. The ReFIT Kalman filter uses a two-stage training approach that improves online control of upper arm tasks with substantial reductions in orbiting time, thus making it a logical first choice for precise finger control.Results: Both animals were able to reliably acquire fingertip targets with both index and MRP fingers, which they did in blocks of finger group specific trials. Decoding from motor signals online, the ReFIT Kalman filter reliably outperformed the standard Kalman filter, measured by bit rate, across all tested finger groups and movements by 31.0 and 35.2%. These decoders were robust when the manipulandum was removed during online control. While index finger movements and middle-ring-pinkie finger movements could be differentiated from each other with 81.7% accuracy across both subjects, the linear Kalman filter was not sufficient for decoding both finger groups together due to significant unwanted movement in the stationary finger, potentially due to co-contraction.Significance: To our knowledge, this is the first systematic and biomimetic separation of digits for continuous online decoding in a NHP as well as the first demonstration of the ReFIT Kalman filter improving the performance of precise finger decoding. These results suggest that novel nonlinear approaches, apparently not necessary for center out reaches or gross hand motions, may be necessary to achieve independent and precise control of individual fingers

Algorithms for Neural Prosthetic Applications

abstract: In the last 15 years, there has been a significant increase in the number of motor neural prostheses used for restoring limb function lost due to neurological disorders or accidents. The aim of this technology is to enable patients to control a motor prosthesis using their residual neural pathways (central or peripheral). Recent studies in non-human primates and humans have shown the possibility of controlling a prosthesis for accomplishing varied tasks such as self-feeding, typing, reaching, grasping, and performing fine dexterous movements. A neural decoding system comprises mainly of three components: (i) sensors to record neural signals, (ii) an algorithm to map neural recordings to upper limb kinematics and (iii) a prosthetic arm actuated by control signals generated by the algorithm. Machine learning algorithms that map input neural activity to the output kinematics (like finger trajectory) form the core of the neural decoding system. The choice of the algorithm is thus, mainly imposed by the neural signal of interest and the output parameter being decoded. The various parts of a neural decoding system are neural data, feature extraction, feature selection, and machine learning algorithm. There have been significant advances in the field of neural prosthetic applications. But there are challenges for translating a neural prosthesis from a laboratory setting to a clinical environment. To achieve a fully functional prosthetic device with maximum user compliance and acceptance, these factors need to be addressed and taken into consideration. Three challenges in developing robust neural decoding systems were addressed by exploring neural variability in the peripheral nervous system for dexterous finger movements, feature selection methods based on clinically relevant metrics and a novel method for decoding dexterous finger movements based on ensemble methods.Dissertation/ThesisDoctoral Dissertation Bioengineering 201

A brain machine interface control algorithm designed from a feedback control perspective

Abstract-We present a novel brain machine interface (BMI) control algorithm, the recalibrated feedback intention-trained Kalman filter (ReFIT-KF). The design of ReFIT-KF is motivated from a feedback control perspective applied to existing BMI control algorithms. The result is two design innovations that alter the modeling assumptions made by these algorithms and the methods by which these algorithms are trained. In online neural control experiments recording from a 96-electrode array implanted in M1 of a macaque monkey, the ReFIT-KF control algorithm demonstrates large performance improvements over the current state of the art velocity Kalman filter, reducing target acquisition time by a factor of two, while maintaining a 500 ms hold period, thereby increasing the clinical viability of BMI systems

Stochastic modeling and control of neural and small length scale dynamical systems

Recent advancements in experimental and computational techniques have created tremendous opportunities in the study of fundamental questions of science and engineering by taking the approach of stochastic modeling and control of dynamical systems. Examples include but are not limited to neural coding and emergence of behaviors in biological networks. Integrating optimal control strategies with stochastic dynamical models has ignited the development of new technologies in many emerging applications. In this direction, particular examples are brain-machine interfaces (BMIs), and systems to manipulate submicroscopic objects. The focus of this dissertation is to advance these technologies by developing optimal control strategies under various feedback scenarios and system uncertainties. Brain-machine interfaces (BMIs) establish direct communications between living brain tissue and external devices such as an artificial arm. By sensing and interpreting neuronal activity to actuate an external device, BMI-based neuroprostheses hold great promise in rehabilitating motor disabled subjects such as amputees. However, lack of the incorporation of sensory feedback, such as proprioception and tactile information, from the artificial arm back to the brain has greatly limited the widespread clinical deployment of these neuroprosthetic systems in rehabilitation. In the first part of the dissertation, we develop a systematic control-theoretic approach for a system-level rigorous analysis of BMIs under various feedback scenarios. The approach involves quantitative and qualitative analysis of single neuron and network models to the design of missing sensory feedback pathways in BMIs using optimal feedback control theory. As a part of our results, we show that the recovery of the natural performance of motor tasks in BMIs can be achieved by designing artificial sensory feedbacks in the proposed optimal control framework. The second part of the dissertation deals with developing stochastic optimal control strategies using limited feedback information for applications in neural and small length scale dynamical systems. The stochastic nature of these systems coupled with the limited feedback information has greatly restricted the direct applicability of existing control strategies in stabilizing these systems. Moreover, it has recently been recognized that the development of advanced control algorithms is essential to facilitate applications in these systems. We propose a novel broadcast stochastic optimal control strategy in a receding horizon framework to overcome existing limitations of traditional control designs. We apply this strategy to stabilize multi-agent systems and Brownian ensembles. As a part of our results, we show the optimal trapping of an ensemble of particles driven by Brownian motion in a minimum trapping region using the proposed framework

Implantable Neural Interfaces for Direct Control of Hand Prostheses

State-of-the art robotic hands can mimic many functions of the human hand. These devices are capable of actuating individual finger and multi-joint movements while providing adequate gripping force for daily activities. However, for patients with spinal cord injuries or amputations, there are few options to control these functions seamlessly or intuitively. A common barrier to restoring hand function to both populations is a lack of high-fidelity control signals. Non-invasive electrophysiological techniques record global summations of activity and lack the spatial or temporal resolution to extract or “decode” precise movement commands. The ability to decode finger movements from the motor system would allow patients to directly control hand functions and provide intuitive and scalable prosthetic solutions. This thesis investigates the capabilities of implantable devices to provide finger-specific commands for prosthetic hands. We adapt existing reasoning algorithms to two different sensing technologies. The first is intracortical electrode arrays implanted into primary motor cortex of two non-human primates. Both subjects controlled a virtual hand with a regression algorithm that decoded brain activity into finger kinematics. Performance was evaluated with single degree of freedom target matching tasks. Bit rate is a throughput metric that accounts for task difficulty and movement precision. A state-of-the-art re-calibration approach improved throughputs by an average of 33.1%. Notably, decoding performance was not dependent on subjects moving their intact hands. In future research, this approach can improve grasp precision for patients with spinal cord injuries. The second sensing technology is intramuscular electrodes implanted into residual muscles and Regenerative Peripheral Nerve Interfaces of two patients with transradial amputations. Both participants used a high-speed pattern recognition system to switch between 10 individual finger and wrist postures in a virtual environment with an average completion rate of 96.3% and a movement delay of 0.26 seconds. When the set was reduced to five grasp postures, average metrics improved to 100% completion and a 0.14 second delay. These results are a significant improvement over previous studies which report average completion rates ranging from 53.9% to 86.9% and delays of 0.45 to 0.86 seconds. Furthermore, grasp performance remained reliable across arm positions and both participants used this controller to complete a functional assessment with robotic prostheses. For a more dexterous solution, we combined the high-speed pattern recognition system with a regression algorithm that enabled simultaneous position control of both the index finger and middle-ring-small finger group. Both patients used this system to complete a virtual two degree of freedom target matching task with throughputs of 1.79 and 1.15 bits per second each. The controllers in this study used only four and five differentiated inputs, which can likely be processed with portable or implantable hardware. These results demonstrate that implantable sensors can provide patients with fluid and precise control of hand prostheses. However, clinically translatable implantable electronics need to be developed to realize the potential of these sensing and reasoning approaches. Further advancement of this technology will likely increase the utility and demand of robotic prostheses.PHDRoboticsUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/169798/1/akvaskov_1.pd