Development of bipedal and quadrupedal locomotion in humans from a dynamical systems perspective

The first phase in the development 0f locomotion, pr,öary variability would occur in normal fetuses and infants, and those with Uner Tan syndrome. The neural networks for quadrupedal locomotion have apparently been transmitted epigenetically through many species since about 400 MYA.\ud The second phase is the neuronal selection process. During infancy, the most effective motor pattern(s) and their associated neuronal group(s) are selected through experience.\ud The third phase, secondary or adaptive variability, starts to bloom at two to three years of age and matures in adolescence. This third phase may last much longer in some patients with Uner Tan syndrome, with a considerably delay in selection of the well-balanced quadrupedal locomotion, which may emerge very late in adolescence in these cases

Using evolutionary artificial neural networks to design hierarchical animat nervous systems.

The research presented in this thesis examines the area of control systems for robots or animats (animal-like robots). Existing systems have problems in that they require a great deal of manual design or are limited to performing jobs of a single type. For these reasons, a better solution is desired. The system studied here is an Artificial Nervous System (ANS) which is biologically inspired; it is arranged as a hierarchy of layers containing modules operating in parallel. The ANS model has been developed to be flexible, scalable, extensible and modular. The ANS can be implemented using any suitable technology, for many different environments. The implementation focused on the two lowest layers (the reflex and action layers) of the ANS, which are concerned with control and rhythmic movement. Both layers were realised as Artificial Neural Networks (ANN) which were created using Evolutionary Algorithms (EAs). The task of the reflex layer was to control the position of an actuator (such as linear actuators or D.C. motors). The action layer performed the task of Central Pattern Generators (CPG), which produce rhythmic patterns of activity. In particular, different biped and quadruped gait patterns were created. An original neural model was specifically developed for assisting in the creation of these time-based patterns. It is shown in the thesis that Artificial Reflexes and CPGs can be configured successfully using this technique. The Artificial Reflexes were better at generalising across different actuators, without changes, than traditional controllers. Gaits such as pace, trot, gallop and pronk were successfully created using the CPGs. Experiments were conducted to determine whether modularity in the networks had an impact. It has been demonstrated that the degree of modularization in the network influences its evolvability, with more modular networks evolving more efficiently

Uner Tan Syndrome: History, Clinical Evaluations, Genetics, and the\ud Dynamics of Human Quadrupedalism

Abstract: This review includes for the first time a dynamical systems analysis of human quadrupedalism in Uner Tan syndrome, which is characterized by habitual quadrupedalism, impaired intelligence, and rudimentary speech. The first family was discovered in a small village near Iskenderun, and families were later found in Adana and two other small villages near Gaziantep and Canakkale. In all the affected individuals dynamic balance was impaired during upright walking,and they habitually preferred walking on all four extremities. MRI scans showed inferior cerebellovermian hypoplasia with slightly simplified cerebral gyri in three of the families, but appeared normal in the fourth. PET scans showed a decreased glucose metabolic activity in the cerebellum, vermis and, to a lesser extent the cerebral cortex, except for one patient,\ud whose MRI scan also appeared to be normal. All four families had consanguineous marriages in their pedigrees,\ud suggesting autosomal recessive transmission. The syndrome was genetically heterogeneous. Since the initial discoveries\ud more cases have been found, and these exhibit facultative quadrupedal locomotion, and in one case, late childhood onset. It has been suggested that the human quadrupedalism may, at least, be a phenotypic example of reverse evolution. From the viewpoint of dynamic systems theory, it was concluded there may not be a single factor that predetermines human quadrupedalism in Uner Tan syndrome, but that it may involve self-organization, brain plasticity, and rewiring, from the many decentralized and local interactions among neuronal, genetic, and environmental subsystems

CPG-RL: Learning Central Pattern Generators for Quadruped Locomotion

In this letter, we present a method for integrating central pattern generators (CPGs), i.e. systems of coupled oscillators, into the deep reinforcement learning (DRL) framework to produce robust and omnidirectional quadruped locomotion. The agent learns to directly modulate the intrinsic oscillator setpoints (amplitude and frequency) and coordinate rhythmic behavior among different oscillators. This approach also allows the use of DRL to explore questions related to neuroscience, namely the role of descending pathways, interoscillator couplings, and sensory feedback in gait generation. We train our policies in simulation and perform a sim-to-real transfer to the Unitree A1 quadruped, where we observe robust behavior to disturbances unseen during training, most notably to a dynamically added 13.75 kg load representing 115% of the nominal quadruped mass. We test several different observation spaces based on proprioceptive sensing and show that our framework is deployable with no domain randomization and very little feedback, where along with the oscillator states, it is possible to provide only contact booleans in the observation space. Video results can be found at https://youtu.be/xqXHLzLsEV4.Comment: Accepted for IEEE Robotics and Automation Letters, September 202

Üner Tan Syndrome: Review and Emergence of Human Quadrupedalism in Self-Organization,\ud Attractors and Evolutionary Perspectives\ud

The first man reported in the world literature exhibiting habitual quadrupedal locomotion was discovered by a British traveler and writer on the famous Baghdat road near Havsa/Samsun on the middle Black-Sea coast of Turkey (Childs, 1917). Interestingly, no single case with human quadrupedalism was reported in the scientific literature after Child's first description in 1917 until the first report on the Uner Tan syndrome (UTS: quadrupedalism, mental retardation, and impaired speech or no speech)in 2005 (Tan, 2005, 2006). Between 2005 and 2010, 10 families exhibiting the syndrome were discovered in Turkey with 33 cases: 14 women (42.4%) and 19 men (57.6%). Including a few cases from other countries, there were 25 men (64.1%)and 14 women (35.9%). The number of men significantly exceeded the number of women (p < .05). Genetics alone did not seem to be informative for the origins of many syndromes, including the Uner Tan syndrome. From the viewpoint of dynamical systems theory, there may not be a single factor including the neural and/or genetic codes that predetermines the emergence of the human quadrupedalism.Rather, it may involve a self-organization process, consisting of many decentralized and local interactions among neuronal, genetic, and environmental subsystems. The most remarkable characteristic of the UTS, the diagonal-sequence quadrupedalism is well developed in primates. The evolutionarily advantage of this gait is not known. However, there seems to be an evolutionarily advantage of this type of locomotion for primate evolution, with regard to the emergence of complex neural circuits with related highly complex structures. Namely, only primates with diagonal-sequence quadrupedal locomotion followed an evolution favoring larger brains, highly developed cognitive abilities with hand skills, and language, with erect posture and bipedal locomotion, creating the unity of human being. It was suggested that UTS may be considered a further example for Darwinian diseases, which may be associated with an evolutionary understanding of the disorders using evolutionary principles, such as the natural selection. On the other hand, the human quadrupedalism was proposed to be a phenotypic example of evolution of reverse, i.e., the reacquisition by derived populations of the same character states as those of ancestor populations. It was also suggested that the emergence of the human quadrupedalism may be related to self-organizing processes occurring in complex systems, which select or attract one preferred behavioral state or locomotor trait out of many possible attractor states. Concerning the locomotor patterns, the dynamical systems in brain and body of the developing child may prefer some kind of locomotion, according to interactions of the internal components and the environmental conditions, without a direct role of any causative factor(s), such as genetic or neural codes, consistent with the concept of self-organization, suggesting no single element may have a causal priority

Neural Control of Interlimb Coordination and Gait Timing in Bipeds and Quadrupeds

1) A large body of behavioral data conceming animal and human gaits and gait transitions is simulated as emergent properties of a central pattern generator (CPG) model. The CPG model incorporates neurons obeying Hodgkin-Huxley type dynamics that interact via an on-center off-surround anatomy whose excitatory signals operate on a faster time scale than their inhibitory signals. A descending cornmand or arousal signal called a GO signal activates the gaits and controL their transitions. The GO signal and the CPG model are compared with neural data from globus pallidus and spinal cord, among other brain structures. 2) Data from human bimanual finger coordination tasks are simulated in which anti-phase oscillations at low frequencies spontaneously switch to in-phase oscillations at high frequencies, in-phase oscillations can be performed both at low and high frequencies, phase fluctuations occur at the anti-phase in-phase transition, and a "seagull effect" of larger errors occurs at intermediate phases. When driven by environmental patterns with intermediate phase relationships, the model's output exhibits a tendency to slip toward purely in-phase and anti-phase relationships as observed in humans subjects. 3) Quadruped vertebrate gaits, including the amble, the walk, all three pairwise gaits (trot, pace, and gallop) and the pronk are simulated. Rapid gait transitions are simulated in the order--walk, trot, pace, and gallop--that occurs in the cat, along with the observed increase in oscillation frequency. 4) Precise control of quadruped gait switching is achieved in the model by using GO-dependent modulation of the model's inhibitory interactions. This generates a different functional connectivity in a single CPG at different arousal levels. Such task-specific modulation of functional connectivity in neural pattern generators has been experimentally reported in invertebrates. Phase-dependent modulation of reflex gain has been observed in cats. A role for state-dependent modulation is herein predicted to occur in vertebrates for precise control of phase transitions from one gait to another. 5) The primary human gaits (the walk and the run) and elephant gaits (the amble and the walk) are sirnulated. Although these two gaits are qualitatively different, they both have the same limb order and may exhibit oscillation frequencies that overlap. The CPG model simulates the walk and the run by generating oscillations which exhibit the same phase relationships. but qualitatively different waveform shapes, at different GO signal levels. The fraction of each cycle that activity is above threshold quantitatively distinguishes the two gaits, much as the duty cycles of the feet are longer in the walk than in the run. 6) A key model properly concerns the ability of a single model CPG, that obeys a fixed set of opponent processing equations to generate both in-phase and anti-phase oscillations at different arousal levels. Phase transitions from either in-phase to anti-phase oscillations, or from anti-phase to in-phase oscillations, can occur in different parameter ranges, as the GO signal increases.Air Force Office of Scientific Research (90-0128, F49620-92-J-0225, 90-0175); National Science Foundation (IRI-90-24877); Office of Naval Research (N00014-92-J-1309); Army Research Office (DAAL03-88-K-0088); Advanced Research Projects Agency (90-0083

Incremental embodied chaotic exploration of self-organized motor behaviors with proprioceptor adaptation

This paper presents a general and fully dynamic embodied artificial neural system, which incrementally explores and learns motor behaviors through an integrated combination of chaotic search and reflex learning. The former uses adaptive bifurcation to exploit the intrinsic chaotic dynamics arising from neuro-body-environment interactions, while the latter is based around proprioceptor adaptation. The overall iterative search process formed from this combination is shown to have a close relationship to evolutionary methods. The architecture developed here allows realtime goal-directed exploration and learning of the possible motor patterns (e.g., for locomotion) of embodied systems of arbitrary morphology. Examples of its successful application to a simple biomechanical model, a simulated swimming robot, and a simulated quadruped robot are given. The tractability of the biomechanical systems allows detailed analysis of the overall dynamics of the search process. This analysis sheds light on the strong parallels with evolutionary search

Stance Control Inspired by Cerebellum Stabilizes Reflex-Based Locomotion on HyQ Robot

Advances in legged robotics are strongly rooted in animal observations. A clear illustration of this claim is the generalization of Central Pattern Generators (CPG), first identified in the cat spinal cord, to generate cyclic motion in robotic locomotion. Despite a global endorsement of this model, physiological and functional experiments in mammals have also indicated the presence of descending signals from the cerebellum, and reflex feedback from the lower limb sensory cells, that closely interact with CPGs. To this day, these interactions are not fully understood. In some studies, it was demonstrated that pure reflex-based locomotion in the absence of oscillatory signals could be achieved in realistic musculoskeletal simulation models or small compliant quadruped robots. At the same time, biological evidence has attested the functional role of the cerebellum for predictive control of balance and stance within mammals. In this paper, we promote both approaches and successfully apply reflex-based dynamic locomotion, coupled with a balance and gravity compensation mechanism, on the state-of-art HyQ robot. We discuss the importance of this stability module to ensure a correct foot lift-off and maintain a reliable gait. The robotic platform is further used to test two different architectural hypotheses inspired by the cerebellum. An analysis of experimental results demonstrates that the most biologically plausible alternative also leads to better results for robust locomotion