558 research outputs found
Adaptive Robotic Control Driven by a Versatile Spiking Cerebellar Network
The cerebellum is involved in a large number of different neural processes, especially in associative learning and in fine motor control. To develop a comprehensive theory of sensorimotor learning and control, it is crucial to determine the neural basis of coding and plasticity embedded into the cerebellar neural circuit and how they are translated into behavioral outcomes in learning paradigms. Learning has to be inferred from the interaction of an embodied system with its real environment, and the same cerebellar principles derived from cell physiology have to be able to drive a variety of tasks of different nature, calling for complex timing and movement patterns. We have coupled a realistic cerebellar spiking neural network (SNN) with a real robot and challenged it in multiple diverse sensorimotor tasks. Encoding and decoding strategies based on neuronal firing rates were applied. Adaptive motor control protocols with acquisition and extinction phases have been designed and tested, including an associative Pavlovian task (Eye blinking classical conditioning), a vestibulo-ocular task and a perturbed arm reaching task operating in closed-loop. The SNN processed in real-time mossy fiber inputs as arbitrary contextual signals, irrespective of whether they conveyed a tone, a vestibular stimulus or the position of a limb. A bidirectional long-term plasticity rule implemented at parallel fibers-Purkinje cell synapses modulated the output activity in the deep cerebellar nuclei. In all tasks, the neurorobot learned to adjust timing and gain of the motor responses by tuning its output discharge. It succeeded in reproducing how human biological systems acquire, extinguish and express knowledge of a noisy and changing world. By varying stimuli and perturbations patterns, real-time control robustness and generalizability were validated. The implicit spiking dynamics of the cerebellar model fulfill timing, prediction and learning functions.European Union (Human Brain Project)
REALNET FP7-ICT270434
CEREBNET FP7-ITN238686
HBP-60410
The cerebellum could solve the motor error problem through error increase prediction
We present a cerebellar architecture with two main characteristics. The first
one is that complex spikes respond to increases in sensory errors. The second
one is that cerebellar modules associate particular contexts where errors have
increased in the past with corrective commands that stop the increase in error.
We analyze our architecture formally and computationally for the case of
reaching in a 3D environment. In the case of motor control, we show that there
are synergies of this architecture with the Equilibrium-Point hypothesis,
leading to novel ways to solve the motor error problem. In particular, the
presence of desired equilibrium lengths for muscles provides a way to know when
the error is increasing, and which corrections to apply. In the context of
Threshold Control Theory and Perceptual Control Theory we show how to extend
our model so it implements anticipative corrections in cascade control systems
that span from muscle contractions to cognitive operations.Comment: 34 pages (without bibliography), 13 figure
Vision-Based Control for Robots by a Fully Spiking Neural System Relying on Cerebellar Predictive Learning
The cerebellum plays a distinctive role within our motor control system to
achieve fine and coordinated motions. While cerebellar lesions do not lead to a
complete loss of motor functions, both action and perception are severally
impacted. Hence, it is assumed that the cerebellum uses an internal forward
model to provide anticipatory signals by learning from the error in sensory
states. In some studies, it was demonstrated that the learning process relies
on the joint-space error. However, this may not exist. This work proposes a
novel fully spiking neural system that relies on a forward predictive learning
by means of a cellular cerebellar model. The forward model is learnt thanks to
the sensory feedback in task-space and it acts as a Smith predictor. The latter
predicts sensory corrections in input to a differential mapping spiking neural
network during a visual servoing task of a robot arm manipulator. In this
paper, we promote the developed control system to achieve more accurate target
reaching actions and reduce the motion execution time for the robotic reaching
tasks thanks to the cerebellar predictive capabilities.Comment: 7 pages, 8 figures, 1 tabl
A Neurorobotic Embodiment for Exploring the Dynamical Interactions of a Spiking Cerebellar Model and a Robot Arm During Vision-based Manipulation Tasks
While the original goal for developing robots is replacing humans in
dangerous and tedious tasks, the final target shall be completely mimicking the
human cognitive and motor behaviour. Hence, building detailed computational
models for the human brain is one of the reasonable ways to attain this. The
cerebellum is one of the key players in our neural system to guarantee
dexterous manipulation and coordinated movements as concluded from lesions in
that region. Studies suggest that it acts as a forward model providing
anticipatory corrections for the sensory signals based on observed
discrepancies from the reference values. While most studies consider providing
the teaching signal as error in joint-space, few studies consider the error in
task-space and even fewer consider the spiking nature of the cerebellum on the
cellular-level. In this study, a detailed cellular-level forward cerebellar
model is developed, including modeling of Golgi and Basket cells which are
usually neglected in previous studies. To preserve the biological features of
the cerebellum in the developed model, a hyperparameter optimization method
tunes the network accordingly. The efficiency and biological plausibility of
the proposed cerebellar-based controller is then demonstrated under different
robotic manipulation tasks reproducing motor behaviour observed in human
reaching experiments
A Combination of Machine Learning and Cerebellar-like Neural Networks for the Motor Control and Motor Learning of the Fable Modular Robot
We scaled up a bio-inspired control architecture for the motor control and motor learning of a real modular robot. In our approach, the Locally Weighted Projection Regression algorithm (LWPR) and a cerebellar microcircuit coexist, in the form of a Unit Learning Machine. The LWPR algorithm optimizes the input space and learns the internal model of a single robot module to command the robot to follow a desired trajectory with its end-effector. The cerebellar-like microcircuit refines the LWPR output delivering corrective commands. We contrasted distinct cerebellar-like circuits including analytical models and spiking models implemented on the SpiNNaker platform, showing promising performance and robustness results
Cerebellar Model Controller with new Model of Granule Cell-golgi Cell Building Blocks and Two-phase Learning Acquires Multitude of Generalization Capabilities in Controlling Robot Joint without Exponential Growth in Complexity
Processing in the cerebellum is roughly described as feed forward processing of incoming information over three layers of the cerebellar cortex that send intermediate output to deep cerebellar nuclei, the only output from the cerebellum. Beside this main picture there are several feedback routes, mainly not included in models. In this paper we use new model for neuronal circuit of the cerebellar granule cell layer, as collection of idealized granule cell–golgi cell building blocks with capability of generating multi-dimensional receptive fields modulated by separate input coming to lower dendrite tree of Golgi cell. Resulting cerebellar model controller with two-phase learning will acquire multitude of generalization capabilities when used as robot joint controller. This will usually require more than one Purkinje cell per output. Functionality of granule cell-Golgi cell building block was evaluated with simulations using Simulink single compartment spiking neuronal model. Trained averaging cerebellar model controller attains very good tracking results for wide range of unlearned slower and faster trajectories, with additional improvements by relearning at faster trajectories. Inclusion of new dynamical effects to the controller results with linear growth in complexity for inputs targeting lower dendrite tree of Golgi cell, important for control applications in robotics, but not only
- …