Decoding the mechanisms of gait generation in salamanders by combining neurobiology, modeling and robotics

Vertebrate animals exhibit impressive locomotor skills. These locomotor skills are due to the complex interactions between the environment, the musculo-skeletal system and the central nervous system, in particular the spinal locomotor circuits. We are interested in decoding these interactions in the salamander, a key animal from an evolutionary point of view. It exhibits both swimming and stepping gaits and is faced with the problem of producing efficient propulsive forces using the same musculo-skeletal system in two environments with significant physical differences in density, viscosity and gravitational load. Yet its nervous system remains comparatively simple. Our approach is based on a combination of neurophysiological experiments, numerical modeling at different levels of abstraction, and robotic validation using an amphibious salamander-like robot. This article reviews the current state of our knowledge on salamander locomotion control, and presents how our approach has allowed us to obtain a first conceptual model of the salamander spinal locomotor networks. The model suggests that the salamander locomotor circuit can be seen as a lamprey-like circuit controlling axial movements of the trunk and tail, extended by specialized oscillatory centers controlling limb movements. The interplay between the two types of circuits determines the mode of locomotion under the influence of sensory feedback and descending drive, with stepping gaits at low drive, and swimming at high driv

A Salamander’s Flexible Spinal Network for Locomotion, Modeled at Two Levels of Abstraction

Animals have to coordinate a large number of muscles in different ways to efficiently move at various speeds and in different and complex environments. This coordination is in large part based on central pattern generators (CPGs). These neural networks are capable of producing complex rhythmic patterns when activated and modulated by relatively simple control signals. Although the generation of particular gaits by CPGs has been successfully modeled at many levels of abstraction, the principles underlying the generation and selection of a diversity of patterns of coordination in a single neural network are still not well understood. The present work specifically addresses the flexibility of the spinal locomotor networks in salamanders. We compare an abstract oscillator model and a CPG network composed of integrate-and-fire neurons, according to their ability to account for different axial patterns of coordination, and in particular the transition in gait between swimming and stepping modes. The topology of the network is inspired by models of the lamprey CPG, complemented by additions based on experimental data from isolated spinal cords of salamanders. Oscillatory centers of the limbs are included in a way that preserves the flexibility of the axial network. Similarly to the selection of forward and backward swimming in lamprey models via different excitation to the first axial segment, we can account for the modification of the axial coordination pattern between swimming and forward stepping on land in the salamander model, via different uncoupled frequencies in limb versus axial oscillators (for the same level of excitation). These results transfer partially to a more realistic model based on formal spiking neurons, and we discuss the difference between the abstract oscillator model and the model built with formal spiking neurons

Design of artificial neural oscillatory circuits for the control of lamprey- and salamander-like locomotion using evolutionary algorithms

This dissertation investigates the evolutionary design of oscillatory artificial neural networks for the control of animal-like locomotion. It is inspired by the neural organ¬ isation of locomotor circuitries in vertebrates, and explores in particular the control of undulatory swimming and walking. The difficulty with designing such controllers is to find mechanisms which can transform commands concerning the direction and the speed of motion into the multiple rhythmic signals sent to the multiple actuators typically involved in animal-like locomotion. In vertebrates, such control mechanisms are provided by central pattern generators which are neural circuits capable of pro¬ ducing the patterns of oscillations necessary for locomotion without oscillatory input from higher control centres or from sensory feedback. This thesis explores the space of possible neural configurations for the control of undulatory locomotion, and addresses the problem of how biologically plausible neural controllers can be automatically generated.Evolutionary algorithms are used to design connectionist models of central pattern generators for the motion of simulated lampreys and salamanders. This work is inspired by Ekeberg's neuronal and mechanical simulation of the lamprey [Ekeberg 93]. The first part of the thesis consists of developing alternative neural controllers for a similar mechanical simulation. Using a genetic algorithm and an incremental approach, a variety of controllers other than the biological configuration are successfully developed which can control swimming with at least the same efficiency. The same method is then used to generate synaptic weights for a controller which has the observed biological connectivity in order to illustrate how the genetic algorithm could be used for developing neurobiological models. Biologically plausible controllers are evolved which better fit physiological observations than Ekeberg's hand-crafted model. Finally, in collaboration with Jerome Kodjabachian, swimming controllers are designed using a developmental encoding scheme, in which developmental programs are evolved which determine how neurons divide and get connected to each other on a two-dimensional substrate.The second part of this dissertation examines the control of salamander-like swimming and trotting. Salamanders swim like lampreys but, on the ground, they switch to a trotting gait in which the trunk performs a standing wave with the nodes at the girdles. Little is known about the locomotion circuitry of the salamander, but neurobiologists have hypothesised that it is based on a lamprey-like organisation. A mechanical sim¬ ulation of a salamander-like animat is developed, and neural controllers capable of exhibiting the two types of gaits are evolved. The controllers are made of two neural oscillators projecting to the limb motoneurons and to lamprey-like trunk circuitry. By modulating the tonic input applied to the networks, the type of gait, the speed and the direction of motion can be varied.By developing neural controllers for lamprey- and salamander-like locomotion, this thesis provides insights into the biological control of undulatory swimming and walking, and shows how evolutionary algorithms can be used for developing neurobiological models and for generating neural controllers for locomotion. Such a method could potentially be used for designing controllers for swimming or walking robots, for instance

From lamprey to salamander: an exploratory modeling study on the architecture of the spinal locomotor networks in the salamander

The evolutionary transition from water to land required new locomotor modes and corresponding adjustments of the spinal "central pattern generators" for locomotion. Salamanders resemble the first terrestrial tetrapods and represent a key animal for the study of these changes. Based on recent physiological data from salamanders, and previous work on the swimming, limbless lamprey, we present a model of the basic oscillatory network in the salamander spinal cord, the spinal segment. Model neurons are of the Hodgkin-Huxley type. Spinal hemisegments contain sparsely connected excitatory and inhibitory neuron populations, and are coupled to a contralateral hemisegment. The model yields a large range of experimental findings, especially the NMDA-induced oscillations observed in isolated axial hemisegments and segments of the salamander Pleurodeles waltlii. The model reproduces most of the effects of the blockade of AMPA synapses, glycinergic synapses, calcium-activated potassium current, persistent sodium current, and -current. Driving segments with a population of brainstem neurons yields fast oscillations in the in vivo swimming frequency range. A minimal modification to the conductances involved in burst-termination yields the slower stepping frequency range. Slow oscillators can impose their frequency on fast oscillators, as is likely the case during gait transitions from swimming to stepping. Our study shows that a lamprey-like network can potentially serve as a building block of axial and limb oscillators for swimming and stepping in salamanders

From lamprey to salamander: an exploratory modeling study on the architecture of the spinal locomotor networks in the salamander

The evolutionary transition from water to land required new locomotor modes and corresponding adjustments of the spinal "central pattern generators” for locomotion. Salamanders resemble the first terrestrial tetrapods and represent a key animal for the study of these changes. Based on recent physiological data from salamanders, and previous work on the swimming, limbless lamprey, we present a model of the basic oscillatory network in the salamander spinal cord, the spinal segment. Model neurons are of the Hodgkin-Huxley type. Spinal hemisegments contain sparsely connected excitatory and inhibitory neuron populations, and are coupled to a contralateral hemisegment. The model yields a large range of experimental findings, especially the NMDA-induced oscillations observed in isolated axial hemisegments and segments of the salamander Pleurodeles waltlii. The model reproduces most of the effects of the blockade of AMPA synapses, glycinergic synapses, calcium-activated potassium current, persistent sodium current, and $$h$$ -current. Driving segments with a population of brainstem neurons yields fast oscillations in the in vivo swimming frequency range. A minimal modification to the conductances involved in burst-termination yields the slower stepping frequency range. Slow oscillators can impose their frequency on fast oscillators, as is likely the case during gait transitions from swimming to stepping. Our study shows that a lamprey-like network can potentially serve as a building block of axial and limb oscillators for swimming and stepping in salamander

Pattern Generation for Rough Terrain Locomotion with Quadrupedal Robots:Morphed Oscillators & Sensory Feedback

Animals are able to locomote on rough terrain without any apparent difficulty, but this does not mean that the locomotor system is simple. The locomotor system is actually a complex multi-input multi-output closed-loop control system. This thesis is dedicated to the design of controllers for rough terrain locomotion, for animal-like quadrupedal robots. We choose the problem of blind rough terrain locomotion as the target of experiments. Blind rough terrain locomotion requires continuous and momentary corrections of leg movements and body posture, and provides a proper testbed to observe the interaction of different mod- ules involved in locomotion control. As for the specific case of this thesis, we have to design rough terrain locomotion controllers that do not depend on the torque-control capability, have limited sensing, and have to be computationally light, all due to the properties of the robotics platform that we use. We propose that a robust locomotion controller, taking into account the aforementioned constraints, is constructed from at least three modules: 1) pattern generators providing the nominal patterns of locomotion; 2) A posture controller continuously adjusting the attitude of the body and keeping the robot upright; and 3) quick reflexes to react to unwanted momentary events like stumbling or an external force impulse. We introduce the framework of morphed oscillators to systematize the design of pattern gen- erators realized as coupled nonlinear oscillators. Morphed oscillators are nonlinear oscillators that can encode arbitrary limit cycle shapes and simultaneously have infinitely large basins of attraction. More importantly, they provide dynamical systems that can assume the role of feedforward locomotion controllers known as Central Pattern Generators (CPGs), and accept discontinuous sensory feedback without the risk of producing discontinuous output. On top of the CPG module, we add a kinematic model-based posture controller inspired by virtual model control (VMC), to control the body attitude. Virtual model control produces forces, and through the application of the Jacobian transpose method, generates torques which are added to the CPG torques. However, because our robots do not have a torque- control capability, we adapt the posture controller by producing task-space velocities instead of forces, thus generating joint-space velocity feedback signals. Since the CPG model used for locomotion generates joint velocities and accepts feedback without the fear of instability or discontinuity, the posture control feedback is easily integrated into the CPG dynamics. More- over, we introduce feedback signals for adjusting the posture by shifting the trunk positions, which directly update the limit cycle shape of the morphed oscillator nodes of the CPG. Reflexes are added, with minimal complexity, to react to momentary events. We implement simple impulse-based feedback mechanisms inspired by animals and successful rough terrain robots to 1) flex the leg if the robot is stumbling (stumbling correction reflex); 2) extend the leg if an expected contact is missing (leg extension reflex); or 3) initiate a lateral stepping sequence in response to a lateral external perturbation. CPG, posture controller, and reflexes are put together in a modular control architecture alongside additional modules that estimate inclination, control speed and direction, maintain timing of feedback signals, etc. [...

An Electrophysiological Study Of Voluntary Movement and Spinal Cord Injury

Voluntary movement is generated from the interaction between neurons in our brain and the neurons in our spinal cord that engage our muscles. A spinal cord injury destroys the connection between these two regions, but parts of their underlying neural circuits survive. A new class of treatment (the brain-machine interface) takes advantage of this fact by either a) recording neural activity from the brain and predicting the intended movement (neural prosthetics) or b) stimulating neural activity in the spinal cord to facilitate muscle activity (spinal stimulation). This thesis covers new research studying the brain-machine interface and its application for spinal injury. First, the electrical properties of the microelectrode (the main tool of the brain-machine interface) are studied during deep brain recording and stimulation. This work shows that the insulation coating the electrode forms a capacitor with the surrounding neural tissue. This capacitance causes large spikes of voltage in the surrounding tissue during deep brain stimulation, which will cause electrical artifacts in neural recordings and may damage the surrounding neurons. This work also shows that a coaxially shielded electrode will block this effect. Second, the activity of neurons in the parietal cortex is studied during hand movements, which has applications for neural prosthetics. Prior work suggests that the parietal cortex encodes a state-estimator [1], which combines sensory feedback with the internal efference copy to predict the state of the hand. To test this idea, we used a visual lag to misalign sensory feedback from the efference copy. The expectation was that a state-estimator would unknowingly combine the delayed visual feedback with the current efference information, resulting in incorrect predictions of the hand. Our results show a drop in correlation between neural activity in the parietal cortex and hand movement during a visual lag, supporting the idea that the parietal cortex encodes a state-estimator. This correlation gradually recovers over time, showing that parietal cortex is adaptive to sensory delays. Third, while the intention of spinal stimulation was to interact locally with neural circuits in the spinal cord, results from the clinic show that electrical stimulation of the lumbosacral enlargement enables paraplegic patients to regain voluntary movement of their legs [2]. This means that spinal stimulation facilitates communication across an injury site. To further study this effect, we developed a new behavioral task in the rodent. Rats were trained to kick their right hindlimb in response to an auditory cue. The animals then received a spinal injury that caused paraplegia. After injury, the animals recovered the behavior (they could kick in response to the cue), but only during spinal stimulation. Their recovered behavior was slower and more stereotyped than their pre-injury response. Administering quipazine to these rodents disrupted their ability to respond to the cue, suggesting that serotonin plays an important role in the recovered pathway. This work proves that the new behavioral task is a successful tool for studying the recovery of voluntary movement. Future work will combine cortical recordings with this behavioral task in the rodent to study plasticity in the nervous system and improve treatment of spinal cord injuries. [1] Mulliken, Grant H., Sam Musallam, and Richard A. Andersen. "Forward estimation of movement state in posterior parietal cortex." Proceedings of the National Academy of Sciences105.24 (2008): 8170-8177. [2] Harkema, Susan, et al. "Effect of epidural stimulation of the lumbosacral spinal cord on voluntary movement, standing, and assisted stepping after motor complete paraplegia: a case study." The Lancet 377.9781 (2011): 1938-1947.</p

Using MapReduce Streaming for Distributed Life Simulation on the Cloud

Distributed software simulations are indispensable in the study of large-scale life models but often require the use of technically complex lower-level distributed computing frameworks, such as MPI. We propose to overcome the complexity challenge by applying the emerging MapReduce (MR) model to distributed life simulations and by running such simulations on the cloud. Technically, we design optimized MR streaming algorithms for discrete and continuous versions of Conway’s life according to a general MR streaming pattern. We chose life because it is simple enough as a testbed for MR’s applicability to a-life simulations and general enough to make our results applicable to various lattice-based a-life models. We implement and empirically evaluate our algorithms’ performance on Amazon’s Elastic MR cloud. Our experiments demonstrate that a single MR optimization technique called strip partitioning can reduce the execution time of continuous life simulations by 64%. To the best of our knowledge, we are the first to propose and evaluate MR streaming algorithms for lattice-based simulations. Our algorithms can serve as prototypes in the development of novel MR simulation algorithms for large-scale lattice-based a-life models.https://digitalcommons.chapman.edu/scs_books/1014/thumbnail.jp