Real-time neural signal processing and low-power hardware co-design for wireless implantable brain machine interfaces

Intracortical Brain-Machine Interfaces (iBMIs) have advanced significantly over the past two decades, demonstrating their utility in various aspects, including neuroprosthetic control and communication. To increase the information transfer rate and improve the devices’ robustness and longevity, iBMI technology aims to increase channel counts to access more neural data while reducing invasiveness through miniaturisation and avoiding percutaneous connectors (wired implants). However, as the number of channels increases, the raw data bandwidth required for wireless transmission also increases becoming prohibitive, requiring efficient on-implant processing to reduce the amount of data through data compression or feature extraction. The fundamental aim of this research is to develop methods for high-performance neural spike processing co-designed within low-power hardware that is scaleable for real-time wireless BMI applications. The specific original contributions include the following: Firstly, a new method has been developed for hardware-efficient spike detection, which achieves state-of-the-art spike detection performance and significantly reduces the hardware complexity. Secondly, a novel thresholding mechanism for spike detection has been introduced. By incorporating firing rate information as a key determinant in establishing the spike detection threshold, we have improved the adaptiveness of spike detection. This eventually allows the spike detection to overcome the signal degradation that arises due to scar tissue growth around the recording site, thereby ensuring enduringly stable spike detection results. The long-term decoding performance, as a consequence, has also been improved notably. Thirdly, the relationship between spike detection performance and neural decoding accuracy has been investigated to be nonlinear, offering new opportunities for further reducing transmission bandwidth by at least 30% with minor decoding performance degradation. In summary, this thesis presents a journey toward designing ultra-hardware-efficient spike detection algorithms and applying them to reduce the data bandwidth and improve neural decoding performance. The software-hardware co-design approach is essential for the next generation of wireless brain-machine interfaces with increased channel counts and a highly constrained hardware budget. The fundamental aim of this research is to develop methods for high-performance neural spike processing co-designed within low-power hardware that is scaleable for real-time wireless BMI applications. The specific original contributions include the following: Firstly, a new method has been developed for hardware-efficient spike detection, which achieves state-of-the-art spike detection performance and significantly reduces the hardware complexity. Secondly, a novel thresholding mechanism for spike detection has been introduced. By incorporating firing rate information as a key determinant in establishing the spike detection threshold, we have improved the adaptiveness of spike detection. This eventually allows the spike detection to overcome the signal degradation that arises due to scar tissue growth around the recording site, thereby ensuring enduringly stable spike detection results. The long-term decoding performance, as a consequence, has also been improved notably. Thirdly, the relationship between spike detection performance and neural decoding accuracy has been investigated to be nonlinear, offering new opportunities for further reducing transmission bandwidth by at least 30\% with only minor decoding performance degradation. In summary, this thesis presents a journey toward designing ultra-hardware-efficient spike detection algorithms and applying them to reduce the data bandwidth and improve neural decoding performance. The software-hardware co-design approach is essential for the next generation of wireless brain-machine interfaces with increased channel counts and a highly constrained hardware budget.Open Acces

Inhomogeneity Correction in High Field Magnetic Resonance Images

Projecte realitzat en col.laboració amb el centre Swiss Federal Institute of Technology (EPFL)Magnetic Resonance Imaging, MRI, is one of the most powerful and harmless ways to study human inner tissues. It gives the chance of having an accurate insight into the physiological condition of the human body, and specially, the brain. Following this aim, in the last decade MRI has moved to ever higher magnetic field strength that allow us to get advantage of a better signal-to-noise ratio. This improvement of the SNR, which increases almost linearly with the field strength, has several advantages: higher spatial resolution and/or faster imaging, greater spectral dispersion, as well as an enhanced sensitivity to magnetic susceptibility. However, at high magnetic resonance imaging, the interactions between the RF pulse and the high permittivity samples, which causes the so called Intensity Inhomogeneity or B1 inhomogeneity, can no longer be negligible. This inhomogeneity causes undesired efects that afects quantitatively image analysis and avoid the application classical intensity-based segmentation and other medical functions. In this Master thesis, a new method for Intensity Inhomogeneity correction at high ¯eld is presented. At high ¯eld is not possible to achieve the estimation and the correction directly from the corrupted data. Thus, this method attempt the correction by acquiring extra information during the image process, the RF map. The method estimates the inhomogeneity by the comparison of both acquisitions. The results are compared to other methods, the PABIC and the Low-Pass Filter which try to correct the inhomogeneity directly from the corrupted data

Spatiotemporal Analysis of Range Imagery

The present thesis handles the topic of how to determine the three dimensional motion field from a corresponding sequence of range images. We investigate signals given by range cameras that are based on the time-of-flight principle for which they employ the novel optoelectronic photonic-mixer-device (PMD). Its signal comprises information about the range, the mean radiant flux and its modulation amplitude. We discuss how to take advantage of this wealth of information. The estimation of a motion field from image sequences is an ill-posed inverse problem which can not be solved in general. Moreover, the spatiotemporal signal of a PMD-camera is corrupted by several kind of, partially rather specific, errors of systematic and statistical nature depending explicitly on time and space (motion-artifacts). We analyze those errors and develop a method to correct for systematic errors in the range signal. By means of a novel two-state-channel-smoothing we improve range images corrupted by noise and outliers. We use and extend the structure tensor approach to come for the first time to an improved motion estimate that exploits the PMD-signal and provides an inherent measure for its confidence. The presented algorithms were developed under the premise to be of a computational complexity that not forbids their application within an embedded system. They are tested on synthetic and real images and image sequences

Characterizing motor control signals in the spinal cord

The main goal of this project is to develop a rodent model to study the central command signals generated in the brain and spinal cord for the control of motor function in the forearms. The nature of the central command signal has been debated for many decades with only limited progress. This thesis presents a project that investigated this problem using novel techniques. Rats are instrumented to record the control signals in their spinal cord while they are performing lever press task they are trained in. A haptic interface and wireless neural data amplifier system simultaneously collects dynamic and neural data. Isometric force is predicted from force signal using a combination of time-frequency analysis, Principle component analysis and linear filters. Neural-force mapping obtained at one location are subsequently applied to isometric data recorded at other locations. Prediction errors exhibited negative relationship with the isometric position at upper half of movement range. This suggests the presence of restorative forces which are consistent with positional feedback at spinal level. The animal also appears to become unstable in the lower half of their movement ranges, likely caused by a transition from bipedal to quadruped posture. The presence of local feedback and ability for animals to plan postures that are unstable in absence of external forces suggest that descending signal is a reference trajectory planned using internal models. This has important consequences in design of neuroprosthetic actuators: Inverse dynamic models of patient limbs and local positional feedbacks can improve their performance