Controlling a mobile robot with a biological brain

The intelligent controlling mechanism of a typical mobile robot is usually a computer system. Some recent research is ongoing in which biological neurons are being cultured and trained to act as the brain of an interactive real world robot�thereby either completely replacing, or operating in a cooperative fashion with, a computer system. Studying such hybrid systems can provide distinct insights into the operation of biological neural structures, and therefore, such research has immediate medical implications as well as enormous potential in robotics. The main aim of the research is to assess the computational and learning capacity of dissociated cultured neuronal networks. A hybrid system incorporating closed-loop control of a mobile robot by a dissociated culture of neurons has been created. The system is flexible and allows for closed-loop operation, either with hardware robot or its software simulation. The paper provides an overview of the problem area, gives an idea of the breadth of present ongoing research, establises a new system architecture and, as an example, reports on the results of conducted experiments with real-life robots

Closed loop interactions between spiking neural network and robotic simulators based on MUSIC and ROS

In order to properly assess the function and computational properties of simulated neural systems, it is necessary to account for the nature of the stimuli that drive the system. However, providing stimuli that are rich and yet both reproducible and amenable to experimental manipulations is technically challenging, and even more so if a closed-loop scenario is required. In this work, we present a novel approach to solve this problem, connecting robotics and neural network simulators. We implement a middleware solution that bridges the Robotic Operating System (ROS) to the Multi-Simulator Coordinator (MUSIC). This enables any robotic and neural simulators that implement the corresponding interfaces to be efficiently coupled, allowing real-time performance for a wide range of configurations. This work extends the toolset available for researchers in both neurorobotics and computational neuroscience, and creates the opportunity to perform closed-loop experiments of arbitrary complexity to address questions in multiple areas, including embodiment, agency, and reinforcement learning

Investigating computational properties of a neurorobotic closed loop system

This work arises as an attempt to increase and deepen the knowledge of the encoding method of the information by the nervous system. In particular, this study focuses on computational properties of neuronal cultures grown in vitro. Through a neuro-robotic close-loop system composed of either cortical or hippocampal cultures (plated on micro-electrode arrays) on one side and of a robot controlled by the cultures on the other side, it has been possible to analyze experimental dataopenEmbargo per motivi di segretezza e/o di proprietà dei risultati e/o informazioni sensibil

A simulation study on the effects of neuronal ensemble properties on decoding algorithms for intracortical brain-machine interfaces

Background: Intracortical brain-machine interfaces (BMIs) harness movement information by sensing neuronal activities using chronic microelectrode implants to restore lost functions to patients with paralysis. However, neuronal signals often vary over time, even within a day, forcing one to rebuild a BMI every time they operate it. The term "rebuild" means overall procedures for operating a BMI, such as decoder selection, decoder training, and decoder testing. It gives rise to a practical issue of what decoder should be built for a given neuronal ensemble. This study aims to address it by exploring how decoders' performance varies with the neuronal properties. To extensively explore a range of neuronal properties, we conduct a simulation study. Methods: Focusing on movement direction, we examine several basic neuronal properties, including the signal-to-noise ratio of neurons, the proportion of well-tuned neurons, the uniformity of their preferred directions (PDs), and the non-stationarity of PDs. We investigate the performance of three popular BMI decoders: Kalman filter, optimal linear estimator, and population vector algorithm. Results: Our simulation results showed that decoding performance of all the decoders was affected more by the proportion of well-tuned neurons that their uniformity. Conclusions: Our study suggests a simulated scenario of how to choose a decoder for intracortical BMIs in various neuronal conditions