Uniqueness of human running coordination: The integration of modern and ancient evolutionary innovations

Running is a pervasive activity across human cultures and a cornerstone of contemporary health, fitness and sporting activities. Yet for the overwhelming predominance of human existence running was an essential prerequisite for survival. A means to hunt, and a means to escape when hunted. In a very real sense humans have evolved to run. Yet curiously, perhaps due to running’s cultural ubiquity and the natural ease with which we learn to run, we rarely consider the uniqueness of human bipedal running within the animal kingdom. Our unique upright, single stance, bouncing running gait imposes a unique set of coordinative difficulties. Challenges demanding we precariously balance our fragile brains in the very position where they are most vulnerable to falling injury while simultaneously retaining stability, steering direction of travel, and powering the upcoming stride: all within the abbreviated time-frames afforded by short, violent ground contacts separated by long flight times. These running coordination challenges are solved through the tightly-integrated blending of primitive evolutionary legacies, conserved from reptilian and vertebrate lineages, and comparatively modern, more exclusively human, innovations. The integrated unification of these top-down and bottom-up control processes bestows humans with an agile control system, enabling us to readily modulate speeds, change direction, negotiate varied terrains and to instantaneously adapt to changing surface conditions. The seamless integration of these evolutionary processes is facilitated by pervasive, neural and biological, activity-dependent adaptive plasticity. Over time, and with progressive exposure, this adaptive plasticity shapes neural and biological structures to best cope with regularly imposed movement challenges. This pervasive plasticity enables the gradual construction of a robust system of distributed coordinated control, comprised of processes that are so deeply collectively entwined that describing their functionality in isolation obscures their true irrevocably entangled nature. Although other species rely on a similar set of coordinated processes to run, the bouncing bipedal nature of human running presents a specific set of coordination challenges, solved using a customized blend of evolved solutions. A deeper appreciation of the foundations of the running coordination phenomenon promotes conceptual clarity, potentially informing future advances in running training and running-injury rehabilitation interventions

Dynamically stepping over large obstacle utilizing PSO optimization in the B4LC system

This paper proposes a control structure to resolve the issue of dynamically stepping over large obstacles in the B4LC control system. We reform the local control units LegSwing, LockHip and KneeF lexion respectively. The optimization module with Particle Swarm Optimization (PSO) method is employed to tune the parameters of those controllers by formulating locomotion stability. The optimization process and further validation are conducted on a 3-dimensional simulated bipedal robot. The simulation results reveal that the suggested approach enables robot to dynamically step over a large obstacle with 20cm height by 15cm width in a short time duration

Respiratory, postural and spatio-kinetic motor stabilization, internal models, top-down timed motor coordination and expanded cerebello-cerebral circuitry: a review

Human dexterity, bipedality, and song/speech vocalization in Homo are reviewed within a motor evolution perspective in regard to 

(i) brain expansion in cerebello-cerebral circuitry, 
(ii) enhanced predictive internal modeling of body kinematics, body kinetics and action organization, 
(iii) motor mastery due to prolonged practice, 
(iv) task-determined top-down, and accurately timed feedforward motor adjustment of multiple-body/artifact elements, and 
(v) reduction in automatic preflex/spinal reflex mechanisms that would otherwise restrict such top-down processes. 

Dual-task interference and developmental neuroimaging research argues that such internal modeling based motor capabilities are concomitant with the evolution of 
(vi) enhanced attentional, executive function and other high-level cognitive processes, and that 
(vii) these provide dexterity, bipedality and vocalization with effector nonspecific neural resources. 

The possibility is also raised that such neural resources could 
(viii) underlie human internal model based nonmotor cognitions. 
&#xa

Streamlined sim-to-real transfer for deep-reinforcement learning in robotics locomotion

Legged robots possess superior mobility compared to other machines, yet designing controllers for them can be challenging. Classic control methods require engineers to distill their knowledge into controllers, which is time-consuming and limiting when approaching dynamic tasks in unknown environments. Conversely, learning- based methods that gather knowledge from data can potentially unlock the versatility of legged systems. In this thesis, we propose a novel approach called CPG-Actor, which incor- porates feedback into a fully differentiable Central Pattern Generator (CPG) formulation using neural networks and Deep-Reinforcement Learning (RL). This approach achieves approximately twenty times better training performance compared to previous methods and provides insights into the impact of training on the distribution of parameters in both the CPGs and MLP feedback network. Adopting Deep-RL to design controllers comes at the expense of gathering extensive data, typically done in simulation to reduce time. However, controllers trained with data collected in simulation often lose performance when deployed in the real world, referred to as the sim-to-real gap. To address this, we propose a new method called Extended Random Force Injection (ERFI), which randomizes only two parameters to allow for sim-to-real transfer of locomotion controllers. ERFI demonstrated high robustness when varying masses of the base, or attaching a manipulator arm to the robot during testing, and achieved competitive performance comparable to standard randomization techniques. Furthermore, we propose a new method called Roll-Drop to enhance the robustness of Deep-RL policies to observation noise. Roll-Drop introduces dropout during rollout, achieving an 80% success rate when tested with up to 25% noise injected in the observations. Finally, we adopted model-free controllers to enable omni-directional bipedal lo- comotion on point feet with a quadruped robot without any hardware modification or external support. Despite the limitations posed by the quadruped’s hardware, the study considers this a perfect benchmark task to assess the shortcomings of sim- to-real techniques and unlock future avenues for the legged robotics community. Overall, this thesis demonstrates the potential of learning-based methods to design dynamic and robust controllers for legged robots while limiting the effort needed for sim-to-real transfer

Simulation Study on Acquisition Process of Locomotion by Using an Infant Robot

Locomotion is one of the basic functions of a mobile robot. Using legs is one of the strategies for accomplishing locomotion. The strategy allows a robot to move over rough terrain. Therefore, a considerable amount of research has been conducted on motion control of legged locomotion robots. This chapter treats the motion generation of an infant robot, wit

Design and development of a hominid robot with local control in its adaptable feet to enhance locomotion capabilities

With increasing mechanization of our daily lives, the expectations and demands in robotic systems increase in the general public and in scientists alike. In recent events such as the Deepwater Horizon''-accident or the nuclear disaster at Fukushima, mobile robotic systems were used, e.g., to support local task forces by gaining visual material to allow an analysis of the situation. Especially the Fukushima example shows that the robotic systems not only have to face a variety of different tasks during operation but also have to deal with different demands regarding the robot's mobility characteristics. To be able to cope with future requirements, it seems necessary to develop kinematically complex systems that feature several different operating modes. That is where this thesis comes in: A robotic system is developed, whose morphology is oriented on chimpanzees and which has the possibility due to its electro-mechanical structure and the degrees of freedom in its arms and legs to walk with different gaits in different postures. For the proposed robot, the chimpanzee was chosen as a model, since these animals show a multitude of different gaits in nature. A quadrupedal gait like crawl allows the robot to traverse safely and stable over rough terrain. A change into the humanoid, bipedal posture enables the robot to move in man-made environments. The structures, which are necessary to ensure an effective and stable locomotion in these two poses, e.g., the feet, are presented in more detail within the thesis. This includes the biological model and an abstraction to allow a technical implementation. In addition, biological spines are analyzed and the development of an active, artificial spine for the robotic system is described. These additional degrees of freedom can increase the robot's locomotion and manipulation capabilities and even allow to show movements, which are not possible without a spine. Unfortunately, the benefits of using an artificial spine in robotic systems are nowadays still neglected, due to the increased complexity of system design and control. To be able to control such a kinematically complex system, a multitude of sensors is installed within the robot's structures. By placing evaluation electronics close by, a local and decentralized preprocessing is realized. Due to this preprocessing is it possible to realize behaviors on the lowest level of robot control: in this thesis it is exemplarily demonstrated by a local controller in the robot's lower leg. In addition to the development and evaluation of robot's structures, the functionality of the overall system is analyzed in different environments. This includes the presentation of detailed data to show the advantages and disadvantages of the local controller. The robot can change its posture independently from a quadrupedal into a bipedal stance and the other way around without external assistance. Once the robot stands upright, it is to investigate to what extent the quadrupedal walking pattern and control structures (like the local controller) have to be modified to contribute to the bipedal walking as well

A Bio-inspired architecture for adaptive quadruped locomotion over irregular terrain

Tese de doutoramento Programa Doutoral em Engenharia Electrónica e de ComputadoresThis thesis presents a tentative advancement on walking control of small quadruped and humanoid position controlled robots, addressing the problem of walk generation by combining dynamical systems approach to motor control, insights from neuroethology research on vertebrate motor control and computational neuroscience. Legged locomotion is a complex dynamical process, despite the seemingly easy and natural behavior of the constantly present proficiency of legged animals. Research on locomotion and motor control in vertebrate animals from the last decades has brought to the attention of roboticists, the potential of the nature’s solutions to robot applications. Recent knowledge on the organization of complex motor generation and on mechanics and dynamics of locomotion has been successfully exploited to pursue agile robot locomotion. The work presented on this manuscript is part of an effort on the pursuit in devising a general, model free solution, for the generation of robust and adaptable walking behaviors. It strives to devise a practical solution applicable to real robots, such as the Sony’s quadruped AIBO and Robotis’ DARwIn- OP humanoid. The discussed solutions are inspired on the functional description of the vertebrate neural systems, especially on the concept of Central Pattern Generators (CPGs), their structure and organization, components and sensorimotor interactions. They use a dynamical systems approach for the implementation of the controller, especially on the use of nonlinear oscillators and exploitation of their properties. The main topics of this thesis are divided into three parts. The first part concerns quadruped locomotion, extending a previous CPG solution using nonlinear oscillators, and discussing an organization on three hierarchical levels of abstraction, sharing the purpose and knowledge of other works. It proposes a CPG solution which generates the walking motion for the whole-leg, which is then organized in a network for the production of quadrupedal gaits. The devised solution is able to produce goal-oriented locomotion and navigation as directed through highlevel commands from local planning methods. In this part, active balance on a standing quadruped is also addressed, proposing a method based on dynamical systems approach, exploring the integration of parallel postural mechanisms from several sensory modalities. The solutions are all successfully tested on the quadruped AIBO robot. In the second part, is addressed bipedal walking for humanoid robots. A CPG solution for biped walking based on the concept of motion primitives is proposed, loosely based on the idea of synergistic organization of vertebrate motor control. A set of motion primitives is shown to produce the basis of simple biped walking, and generalizable to goal-oriented walking. Using the proposed CPG, the inclusion of feedback mechanisms is investigated, for modulation and adaptation of walking, through phase transition control according to foot load information. The proposed solution is validated on the humanoid DARwIn-OP, and its application is evaluated within a whole-body control framework. The third part sidesteps a little from the other two topics. It discusses the CPG as having an alternative role to direct motor generation in locomotion, serving instead as a processor of sensory information for a feedback based motor generation. In this work a reflex based walking controller is devised for the compliant quadruped Oncilla robot, to serve as purely feedback based walking generation. The capabilities of the reflex network are shown in simulations, followed by a brief discussion on its limitations, and how they could be improved by the inclusion of a CPG.Esta tese apresenta uma tentativa de avanço no controlo de locomoção para pequenos robôs quadrúpedes e bipedes controlados por posição, endereçando o problema de geração motora através da combinação da abordagem de sistemas dinâmicos para o controlo motor, e perspectivas de investigação neuroetologia no controlo motor vertebrado e neurociência computacional. Andar é um processo dinâmico e complexo, apesar de parecer um comportamento fácil e natural devido à presença constante de animais proficientes em locomoção terrestre. Investigação na área da locomoção e controlo motor em animais vertebrados nas últimas decadas, trouxe à atenção dos roboticistas o potencial das soluções encontradas pela natureza aplicadas a aplicações robóticas. Conhecimento recente relativo à geração de comportamentos motores complexos e da mecânica da locomoção tem sido explorada com sucesso na procura de locomoção ágil na robótica. O trabalho apresentado neste documento é parte de um esforço no desenho de uma solução geral, e independente de modelos, para a geração robusta e adaptável de comportamentos locomotores. O foco é desenhar uma solução prática, aplicável a robôs reais, tal como o quadrúpede Sony AIBO e o humanóide DARwIn-OP. As soluções discutidas são inspiradas na descrição funcional do sistema nervoso vertebrado, especialmente no conceito de Central Pattern Generators (CPGs), a sua estrutura e organização, componentes e interacção sensorimotora. Estas soluções são implementadas usando uma abordagem em sistemas dinâmicos, focandos o uso de osciladores não lineares e a explorando as suas propriedades. Os tópicos principais desta tese estão divididos em três partes. A primeira parte explora o tema de locomoção quadrúpede, expandindo soluções prévias de CPGs usando osciladores não lineares, e discutindo uma organização em três níveis de abstracção, partilhando as ideias de outros trabalhos. Propõe uma solução de CPG que gera os movimentos locomotores para uma perna, que é depois organizado numa rede, para a produção de marcha quadrúpede. A solução concebida é capaz de produzir locomoção e navegação, comandada através de comandos de alto nível, produzidos por métodos de planeamento local. Nesta parte também endereçado o problema da manutenção do equilíbrio num robô quadrúpede parado, propondo um método baseado na abordagem em sistemas dinâmicos, explorando a integração de mecanismos posturais em paralelo, provenientes de várias modalidades sensoriais. As soluções são todas testadas com sucesso no robô quadrupede AIBO. Na segunda parte é endereçado o problema de locomoção bípede. É proposto um CPG baseado no conceito de motion primitives, baseadas na ideia de uma organização sinergética do controlo motor vertebrado. Um conjunto de motion primitives é usado para produzir a base de uma locomoção bípede simples e generalizável para navegação. Esta proposta de CPG é usada para de seguida se investigar a inclusão de mecanismos de feedback para modulação e adaptação da marcha, através do controlo de transições entre fases, de acordo com a informação de carga dos pés. A solução proposta é validada no robô humanóide DARwIn-OP, e a sua aplicação no contexto do framework de whole-body control é também avaliada. A terceira parte desvia um pouco dos outros dois tópicos. Discute o CPG como tendo um papel alternativo ao controlo motor directo, servindo em vez como um processador de informação sensorial para um mecanismo de locomoção puramente em feedback. Neste trabalho é desenhado um controlador baseado em reflexos para a geração da marcha de um quadrúpede compliant. As suas capacidades são demonstradas em simulação, seguidas por uma breve discussão nas suas limitações, e como estas podem ser ultrapassadas pela inclusão de um CPG.The presented work was possible thanks to the support by the Portuguese Science and Technology Foundation through the PhD grant SFRH/BD/62047/2009

Climbing and Walking Robots

With the advancement of technology, new exciting approaches enable us to render mobile robotic systems more versatile, robust and cost-efficient. Some researchers combine climbing and walking techniques with a modular approach, a reconfigurable approach, or a swarm approach to realize novel prototypes as flexible mobile robotic platforms featuring all necessary locomotion capabilities. The purpose of this book is to provide an overview of the latest wide-range achievements in climbing and walking robotic technology to researchers, scientists, and engineers throughout the world. Different aspects including control simulation, locomotion realization, methodology, and system integration are presented from the scientific and from the technical point of view. This book consists of two main parts, one dealing with walking robots, the second with climbing robots. The content is also grouped by theoretical research and applicative realization. Every chapter offers a considerable amount of interesting and useful information