Releasing dentate nucleus cells from Purkinje cell inhibition generates output from the cerebrocerebellum

The cerebellum generates its vast amount of output to the cerebral cortex through the dentate nucleus (DN) that is essential for precise limb movements in primates. Nuclear cells in DN generate burst activity prior to limb movement, and inactivation of DN results in cerebellar ataxia. The question is how DN cells become active under intensive inhibitory drive from Purkinje cells (PCs). There are two excitatory inputs to DN, mossy fiber and climbing fiber collaterals, but neither of them appears to have sufficient strength for generation of burst activity in DN. Therefore, we can assume two possible mechanisms: post-inhibitory rebound excitation and disinhibition. If rebound excitation works, phasic excitation of PCs and a concomitant inhibition of DN cells should precede the excitation of DN cells. On the other hand, if disinhibition plays a primary role, phasic suppression of PCs and activation of DN cells should be observed at the same timing. To examine these two hypotheses, we compared the activity patterns of PCs in the cerebrocerebellum and DN cells during step-tracking wrist movements in three Japanese monkeys. As a result, we found that the majority of wrist-movement-related PCs were suppressed prior to movement onset and the majority of wrist-movement-related DN cells showed concurrent burst activity without prior suppression. In a minority of PCs and DN cells, movement-related increases and decreases in activity, respectively, developed later. These activity patterns suggest that the initial burst activity in DN cells is generated by reduced inhibition from PCs, i.e., by disinhibition. Our results indicate that suppression of PCs, which has been considered secondary to facilitation, plays the primary role in generating outputs from DN. Our findings provide a new perspective on the mechanisms used by PCs to influence limb motor control and on the plastic changes that underlie motor learning in the cerebrocerebellum

Adaptive Robotic Control Driven by a Versatile Spiking Cerebellar Network

The cerebellum is involved in a large number of different neural processes, especially in associative learning and in fine motor control. To develop a comprehensive theory of sensorimotor learning and control, it is crucial to determine the neural basis of coding and plasticity embedded into the cerebellar neural circuit and how they are translated into behavioral outcomes in learning paradigms. Learning has to be inferred from the interaction of an embodied system with its real environment, and the same cerebellar principles derived from cell physiology have to be able to drive a variety of tasks of different nature, calling for complex timing and movement patterns. We have coupled a realistic cerebellar spiking neural network (SNN) with a real robot and challenged it in multiple diverse sensorimotor tasks. Encoding and decoding strategies based on neuronal firing rates were applied. Adaptive motor control protocols with acquisition and extinction phases have been designed and tested, including an associative Pavlovian task (Eye blinking classical conditioning), a vestibulo-ocular task and a perturbed arm reaching task operating in closed-loop. The SNN processed in real-time mossy fiber inputs as arbitrary contextual signals, irrespective of whether they conveyed a tone, a vestibular stimulus or the position of a limb. A bidirectional long-term plasticity rule implemented at parallel fibers-Purkinje cell synapses modulated the output activity in the deep cerebellar nuclei. In all tasks, the neurorobot learned to adjust timing and gain of the motor responses by tuning its output discharge. It succeeded in reproducing how human biological systems acquire, extinguish and express knowledge of a noisy and changing world. By varying stimuli and perturbations patterns, real-time control robustness and generalizability were validated. The implicit spiking dynamics of the cerebellar model fulfill timing, prediction and learning functions.European Union (Human Brain Project) REALNET FP7-ICT270434 CEREBNET FP7-ITN238686 HBP-60410

Mécanismes psychophysiques et neuronaux de la compensation dynamique de multiples champs de force : facilitation et anticipation liée à des indices de couleur

Dans cette thèse, nous abordons le contrôle moteur du mouvement du coude à travers deux approches expérimentales : une première étude psychophysique a été effectuée chez les sujets humains, et une seconde implique des enregistrements neurophysiologiques chez le singe. Nous avons recensé plusieurs aspects non résolus jusqu’à présent dans l’apprentissage moteur, particulièrement concernant l’interférence survenant lors de l’adaptation à deux ou plusieurs champs de force anti-corrélés. Nous avons conçu un paradigme où des stimuli de couleur aident les sujets à prédire la nature du champ de force externe actuel avant qu’ils ne l’expérimentent physiquement durant des mouvements d’atteinte. Ces connaissances contextuelles faciliteraient l’adaptation à des champs de forces en diminuant l’interférence. Selon le modèle computationnel de l’apprentissage moteur MOSAIC (MOdular Selection And Identification model for Control), les stimuli de couleur aident les sujets à former « un modèle interne » de chaque champ de forces, à s’en rappeler et à faire la transition entre deux champs de force différents, sans interférence. Dans l’expérience psychophysique, quatre groupes de sujets humains ont exécuté des mouvements de flexion/extension du coude contre deux champs de forces. Chaque force visqueuse était associée à une couleur de l’écran de l’ordinateur et les deux forces étaient anti-corrélées : une force résistante (Vr) a été associée à la couleur rouge de l’écran et l’autre, assistante (Va), à la couleur verte de l’écran. Les deux premiers groupes de sujets étaient des groupes témoins : la couleur de l’écran changeait à chaque bloc de 4 essais, tandis que le champ de force ne changeait pas. Les sujets du groupe témoin Va ne rencontraient que la force assistante Va et les sujets du groupe témoin Vr performaient leurs mouvements uniquement contre une force résistante Vr. Ainsi, dans ces deux groupes témoins, les stimuli de couleur n’étaient pas pertinents pour adapter le mouvement et les sujets ne s’adaptaient qu’à une seule force (Va ou Vr). Dans les deux groupes expérimentaux, cependant, les sujets expérimentaient deux champs de forces différents dans les différents blocs d’essais (4 par bloc), associés à ces couleurs. Dans le premier groupe expérimental (groupe « indice certain », IC), la relation entre le champ de force et le stimulus (couleur de l’écran) était constante. La couleur rouge signalait toujours la force Vr tandis que la force Va était signalée par la couleur verte. L’adaptation aux deux forces anti-corrélées pour le groupe IC s’est avérée significative au cours des 10 jours d’entraînement et leurs mouvements étaient presque aussi bien ajustés que ceux des deux groupes témoins qui n’avaient expérimenté qu’une seule des deux forces. De plus, les sujets du groupe IC ont rapidement démontré des changements adaptatifs prédictifs dans leurs sorties motrices à chaque changement de couleur de l’écran, et ceci même durant leur première journée d’entraînement. Ceci démontre qu’ils pouvaient utiliser les stimuli de couleur afin de se rappeler de la commande motrice adéquate. Dans le deuxième groupe expérimental, la couleur de l’écran changeait régulièrement de vert à rouge à chaque transition de blocs d’essais, mais le changement des champs de forces était randomisé par rapport aux changements de couleur (groupe « indice-incertain », II). Ces sujets ont pris plus de temps à s’adapter aux champs de forces que les 3 autres groupes et ne pouvaient pas utiliser les stimuli de couleurs, qui n’étaient pas fiables puisque non systématiquement reliés aux champs de forces, pour faire des changements prédictifs dans leurs sorties motrices. Toutefois, tous les sujets de ce groupe ont développé une stratégie ingénieuse leur permettant d’émettre une réponse motrice « par défaut » afin de palper ou de sentir le type de la force qu’ils allaient rencontrer dans le premier essai de chaque bloc, à chaque changement de couleur. En effet, ils utilisaient la rétroaction proprioceptive liée à la nature du champ de force afin de prédire la sortie motrice appropriée pour les essais qui suivent, jusqu’au prochain changement de couleur d’écran qui signifiait la possibilité de changement de force. Cette stratégie était efficace puisque la force demeurait la même dans chaque bloc, pendant lequel la couleur de l’écran restait inchangée. Cette étude a démontré que les sujets du groupe II étaient capables d’utiliser les stimuli de couleur pour extraire des informations implicites et explicites nécessaires à la réalisation des mouvements, et qu’ils pouvaient utiliser ces informations pour diminuer l’interférence lors de l’adaptation aux forces anti-corrélées. Les résultats de cette première étude nous ont encouragés à étudier les mécanismes permettant aux sujets de se rappeler d’habiletés motrices multiples jumelées à des stimuli contextuels de couleur. Dans le cadre de notre deuxième étude, nos expériences ont été effectuées au niveau neuronal chez le singe. Notre but était alors d’élucider à quel point les neurones du cortex moteur primaire (M1) peuvent contribuer à la compensation d’un large éventail de différentes forces externes durant un mouvement de flexion/extension du coude. Par cette étude, nous avons testé l’hypothèse liée au modèle MOSAIC, selon laquelle il existe plusieurs modules contrôleurs dans le cervelet qui peuvent prédire chaque contexte et produire un signal de sortie motrice approprié pour un nombre restreint de conditions. Selon ce modèle, les neurones de M1 recevraient des entrées de la part de plusieurs contrôleurs cérébelleux spécialisés et montreraient ensuite une modulation appropriée de la réponse pour une large variété de conditions. Nous avons entraîné deux singes à adapter leurs mouvements de flexion/extension du coude dans le cadre de 5 champs de force différents : un champ nul ne présentant aucune perturbation, deux forces visqueuses anti-corrélées (assistante et résistante) qui dépendaient de la vitesse du mouvement et qui ressemblaient à celles utilisées dans notre étude psychophysique chez l’homme, une force élastique résistante qui dépendait de la position de l’articulation du coude et, finalement, un champ viscoélastique comportant une sommation linéaire de la force élastique et de la force visqueuse. Chaque champ de force était couplé à une couleur d’écran de l’ordinateur, donc nous avions un total de 5 couleurs différentes associées chacune à un champ de force (relation fixe). Les singes étaient bien adaptés aux 5 conditions de champs de forces et utilisaient les stimuli contextuels de couleur pour se rappeler de la sortie motrice appropriée au contexte de forces associé à chaque couleur, prédisant ainsi leur sortie motrice avant de sentir les effets du champ de force. Les enregistrements d’EMG ont permis d’éliminer la possibilité de co-contractions sous-tendant ces adaptations, étant donné que le patron des EMG était approprié pour compenser chaque condition de champ de force. En parallèle, les neurones de M1 ont montré des changements systématiques dans leurs activités, sur le plan unitaire et populationnel, dans chaque condition de champ de force, signalant les changements requis dans la direction, l’amplitude et le décours temporel de la sortie de force musculaire nécessaire pour compenser les 5 conditions de champs de force. Les changements dans le patron de réponse pour chaque champ de force étaient assez cohérents entre les divers neurones de M1, ce qui suggère que la plupart des neurones de M1 contribuent à la compensation de toutes les conditions de champs de force, conformément aux prédictions du modèle MOSAIC. Aussi, cette modulation de l’activité neuronale ne supporte pas l’hypothèse d’une organisation fortement modulaire de M1.In this thesis, we addressed motor control by two experimental approaches: psychophysical studies in human subjects and neurophysiological recordings in non-human primates. We identified unresolved issues concerning interference in motor learning during adaptation of subjects to two or more anti-correlated force fields. We designed paradigms in which arbitrary color stimuli provided contextual cues that allowed subjects to predict the nature of impending external force fields before encountering them physically during arm movements. This contextual knowledge helped to facilitate adaptation to the force fields by reducing this interference. According to one computational model of motor learning (MOdular Selection And Identification model for Control; MOSAIC), the color context cues made it easier for subjects to build “internal models” of each force field, to recall them and to switch between them with minimal interference. In our first experiment, four groups of human subjects performed elbow flexion/extension movements against two anti-correlated viscous force fields. We combined two different colors for the computer monitor background with two forces: resistive (Vr) and assistive (Va). The first two groups were control subjects. In those subjects, the color of the computer monitor changed at regular intervals but the force field remained constant; Vr was presented to the first group while the second group only experienced Va. As a result, the color cues were irrelevant in the two control groups. All control subjects adapted well to the single experienced force field (Vr or Va). In the two experimental groups, in contrast, the anti-correlated force fields and the monitor colors changed repeatedly between short blocks of trials. In the first experimental group (Reliable-cue subjects), there was a consistent relationship between the force and the stimulus (color of the monitor) - the red colour always signalled the resistive force while the green colour always signalled the assistive force. Adaptation to the two anti-correlated forces for the Reliable-cue group was significant during 10 days of training and almost as good as in the Irrelevant-cue groups who only experienced one of the two force fields. Furthermore, the Reliable-cue subjects quickly demonstrated predictive adaptive changes in their motor output whenever the monitor color changed, even during their first day of training, showing that they could use the reliable color context cues to recall the appropriate motor skills. In contrast, the monitor color also changed regularly between red and green in the second experimental group, but the force fields were not consistently associated with the color cue (Unreliable-cue group). These subjects took longer to adapt to the two force fields than the other three groups, and could not use the unreliable color cue change to make predictive changes to their motor output. Nevertheless, all Unreliable-cue subjects developed an ingenious strategy of making a specific “default” arm movement to probe the type of force field they would encounter in the first trial after the monitor color changed and used the proprioceptive feedback about the nature of the field to make appropriate predictive changes to their motor output for the next few trials, until the monitor color changed again, signifying the possibility of a change in force fields. This strategy was effective since the force remained constant in each short block of trials while the monitor color remained unchanged. This showed that the Unreliable-cue subjects were able to extract implicit and explicit information about the structure of the task from the color stimuli and use that knowledge to reduce interference when adapting to anti-correlated forces. The results of this first study encouraged us to advance our understanding of how subjects can recall multiple motor skills coupled to color context stimuli can be recalled, and how this phenomenon can be reflected by the neuronal activity in monkeys. Our aim was to elucidate how neurons of primary motor cortex (M1) can contribute to adaptive compensation for a wide range of different external forces during single-joint elbow flexion/extension movements. At the same time, we aimed to test the hypothesis evoked in the MOSAIC model, whereby multiple controller modules located in the cerebellum may predict each context and produce appropriate adaptive output signals for a small range of task conditions. Also, according to this hypothesis, M1 neurons may receive inputs from many specialized cerebellar controllers and show appropriate response modulations for a wide range of task conditions. We trained two monkeys to adapt their flexion/extension elbow movements against 5 different force-field conditions: null field without any external force disturbance, two anti-correlated viscous forces (assistive and resistive), which depended on movement speed and resembled that used in the human psychophysical study, a resistive elastic force which depended on elbow-joint position and finally, a visco-elastic field that was the linear sum of the elastic and viscous forces field. Each force field was reliably coupled to 5 different computer monitor background colors. The monkeys properly adapted to the 5 different force-field conditions and used the color context cues to recall the corresponding motor skill for the force field associated with each color, so that they could make predictive changes to their motor output before they physically encountered the force fields. EMG recordings eliminated the possibility that a co-contraction strategy was used by the monkeys to adapt to the force fields, since the EMG patterns were appropriate to compensate for each force-field condition. In parallel, M1 neurons showed systematic changes in their activity at the single-neuron and population level in each force-field condition that could signal the required changes in the direction, magnitude and time course of muscle force output required to compensate for the 5 force-field conditions. The patterns of response changes in each force field were consistent enough across M1 neurons to suggest that most M1 neurons contributed to the compensation for all force field conditions, in line with the predictions of the MOSAIC model. Also, these response changes do not support a strongly modular organization for M1

A New Approach for Determining Phase Response Curves Reveals that Purkinje Cells Can Act as Perfect Integrators

Cerebellar Purkinje cells display complex intrinsic dynamics. They fire spontaneously, exhibit bistability, and via mutual network interactions are involved in the generation of high frequency oscillations and travelling waves of activity. To probe the dynamical properties of Purkinje cells we measured their phase response curves (PRCs). PRCs quantify the change in spike phase caused by a stimulus as a function of its temporal position within the interspike interval, and are widely used to predict neuronal responses to more complex stimulus patterns. Significant variability in the interspike interval during spontaneous firing can lead to PRCs with a low signal-to-noise ratio, requiring averaging over thousands of trials. We show using electrophysiological experiments and simulations that the PRC calculated in the traditional way by sampling the interspike interval with brief current pulses is biased. We introduce a corrected approach for calculating PRCs which eliminates this bias. Using our new approach, we show that Purkinje cell PRCs change qualitatively depending on the firing frequency of the cell. At high firing rates, Purkinje cells exhibit single-peaked, or monophasic PRCs. Surprisingly, at low firing rates, Purkinje cell PRCs are largely independent of phase, resembling PRCs of ideal non-leaky integrate-and-fire neurons. These results indicate that Purkinje cells can act as perfect integrators at low firing rates, and that the integration mode of Purkinje cells depends on their firing rate

Seeing motion of controlled object improves grip timing in adults with autism spectrum condition: evidence for use of inverse dynamics in motor control

Previous studies (Haswell et al. in Nat Neurosci 12:970–972, 2009; Marko et al. in Brain J Neurol 138:784–797, 2015) reported that people with autism rely less on vision for learning to reach in a force field. This suggested a possibility that they have difficulties in extracting force information from visual motion signals, a process called inverse dynamics computation. Our recent study (Takamuku et al. in J Int Soc Autism Res 11:1062–1075, 2018) examined the ability of inverse computation with two perceptual tasks and found similar performances in typical and autistic adults. However, this tested the computation only in the context of sensory perception while it was possible that the suspected disability is specific to the motor domain. Here, in order to address the concern, we tested the use of inverse dynamics computation in the context of motor control by measuring changes in grip timing caused by seeing/not seeing a controlled object. The motion of the object was informative of its inertial force and typical participants improved their grip timing based on the visual feedback. Our interest was on whether the autism participants show the same improvement. While some autism participants showed atypical hand slowing when seeing the controlled object, we found no evidence of abnormalities in the inverse computation in our grip timing task or in a replication of the perceptual task. This suggests that the ability of inverse dynamics computation is preserved not only for sensory perception but also for motor control in adults with autism

Multiple Motor Learning Strategies in Visuomotor Rotation

When exposed to a continuous directional discrepancy between movements of a visible hand cursor and the actual hand (visuomotor rotation), subjects adapt their reaching movements so that the cursor is brought to the target. Abrupt removal of the discrepancy after training induces reaching error in the direction opposite to the original discrepancy, which is called an aftereffect. Previous studies have shown that training with gradually increasing visuomotor rotation results in a larger aftereffect than with a suddenly increasing one. Although the aftereffect difference implies a difference in the learning process, it is still unclear whether the learned visuomotor transformations are qualitatively different between the training conditions.We examined the qualitative changes in the visuomotor transformation after the learning of the sudden and gradual visuomotor rotations. The learning of the sudden rotation led to a significant increase of the reaction time for arm movement initiation and then the reaching error decreased, indicating that the learning is associated with an increase of computational load in motor preparation (planning). In contrast, the learning of the gradual rotation did not change the reaction time but resulted in an increase of the gain of feedback control, suggesting that the online adjustment of the reaching contributes to the learning of the gradual rotation. When the online cursor feedback was eliminated during the learning of the gradual rotation, the reaction time increased, indicating that additional computations are involved in the learning of the gradual rotation.The results suggest that the change in the motor planning and online feedback adjustment of the movement are involved in the learning of the visuomotor rotation. The contributions of those computations to the learning are flexibly modulated according to the visual environment. Such multiple learning strategies would be required for reaching adaptation within a short training period

The role of the cerebellum in reinforcement learning

How do we learn to establish associations between arbitrary visual cues (like a red light) and movements (like braking the car)? We investigated the neural correlates of visuomotor association learning in the mid-lateral cerebellum. Although cerebellum has been considered to be a motor control center involved in monitoring and correcting the motor error through supervised learning, in this thesis, we show that its role can also be extended to non-motor learning. Specifically, when primates learned to associate arbitrary visual cues with well-learned stereotypic movements, the simple spikes of the mid-lateral cerebellar Purkinje cells reported the monkey’s most recent decision’s outcome during learning. The magnitude of this reinforcement error signal changed with learning, finally disappearing when the association had been overlearned. We modeled this change in neural activity through a drift diffusion-reinforcement learning based model. The concurrent complex spikes, contrary to traditional theories, did not play the role of teaching signal, but encoded the probability of error as a function of the state of learning. They also encoded features that indicate the beginning of a trial. Inactivating the mid-lateral cerebellum significantly affected the monkey’s learning performance while it did not affect motor performance. This is because the mid-lateral cerebellum is in a loop with other cognitive processing centers of the brain including the prefrontal cortex and the basal ganglia. Finally, we verified that the features we identified in primate experiments can also be extended to humans, by studying the visuomotor association learning in humans through functional magnetic resonance imaging. In summary, through electrophysiological and causal experiments in monkeys, imaging in humans, computational models and an anatomical framework, we delineate mechanisms through which the cerebellum can be involved in reinforcement learning and specifically, learning new visuomotor associations