Learning Robot Gait Stability using Neural Networks as Sensory Feedback Function for Central Pattern Generators

In this paper we present a framework to learn a model-free feedback controller for locomotion and balance control of a compliant quadruped robot walking on rough terrain. Having designed an open-loop gait encoded in a Central Pattern Generator (CPG), we use a neural network to repre- sent sensory feedback inside the CPG dynamics. This neural network accepts sensory inputs from a gyroscope or a camera, and its weights are learned using Particle Swarm Optimization (unsupervised learning). We show with a simulated compliant quadruped robot that our controller can perform significantly better than the open-loop one on slopes and randomized height maps

QUADRUPEDAL WALKING GAIT GENERATION USING GENETIC ALGORITHM.

Ph.DDOCTOR OF PHILOSOPH

Fast Sensing and Adaptive Actuation for Robust Legged Locomotion

Robust legged locomotion in complex terrain demands fast perturbation detection and reaction. In animals, due to the neural transmission delays, the high-level control loop involving the brain is absent from mitigating the initial disturbance. Instead, the low-level compliant behavior embedded in mechanics and the mid-level controllers in the spinal cord are believed to provide quick response during fast locomotion. Still, it remains unclear how these low- and mid-level components facilitate robust locomotion. This thesis aims to identify and characterize the underlining elements responsible for fast sensing and actuation. To test individual elements and their interplay, several robotic systems were implemented. The implementations include active and passive mechanisms as a combination of elasticities and dampers in multi-segment robot legs, central pattern generators inspired by intraspinal controllers, and a synthetic robotic version of an intraspinal sensor. The first contribution establishes the notion of effective damping. Effective damping is defined as the total energy dissipation during one step, which allows quantifying how much ground perturbation is mitigated. Using this framework, the optimal damper is identified as viscous and tunable. This study paves the way for integrating effective dampers to legged designs for robust locomotion. The second contribution introduces a novel series elastic actuation system. The proposed system tackles the issue of power transmission over multiple joints, while featuring intrinsic series elasticity. The design is tested on a hopper with two more elastic elements, demonstrating energy recuperation and enhanced dynamic performance. The third contribution proposes a novel tunable damper and reveals its influence on legged hopping. A bio-inspired slack tendon mechanism is implemented in parallel with a spring. The tunable damping is rigorously quantified on a central-pattern-generator-driven hopping robot, which reveals the trade-off between locomotion robustness and efficiency. The last contribution explores the intraspinal sensing hypothesis of birds. We speculate that the observed intraspinal structure functions as an accelerometer. This accelerometer could provide fast state feedback directly to the adjacent central pattern generator circuits, contributing to birds’ running robustness. A biophysical simulation framework is established, which provides new perspectives on the sensing mechanics of the system, including the influence of morphologies and material properties. Giving an overview of the hierarchical control architecture, this thesis investigates the fast sensing and actuation mechanisms in several control layers, including the low-level mechanical response and the mid-level intraspinal controllers. The contributions of this work provide new insight into animal loco-motion robustness and lays the foundation for future legged robot design

Climbing and Walking Robots

With the advancement of technology, new exciting approaches enable us to render mobile robotic systems more versatile, robust and cost-efficient. Some researchers combine climbing and walking techniques with a modular approach, a reconfigurable approach, or a swarm approach to realize novel prototypes as flexible mobile robotic platforms featuring all necessary locomotion capabilities. The purpose of this book is to provide an overview of the latest wide-range achievements in climbing and walking robotic technology to researchers, scientists, and engineers throughout the world. Different aspects including control simulation, locomotion realization, methodology, and system integration are presented from the scientific and from the technical point of view. This book consists of two main parts, one dealing with walking robots, the second with climbing robots. The content is also grouped by theoretical research and applicative realization. Every chapter offers a considerable amount of interesting and useful information

Energetics and Passive Dynamics of Quadruped Robot Planar Running Gaits

Quadruped robots find application in military for load carrying over uneven terrain, humanitarian de-mining, and search and rescue missions. The energy required for quadruped robot locomotion needs to be supplied from on-board energy source which can be either electrical batteries or fuels such as gasolene/diesel. The range and duration of missions very much depend on the amount of energy carried, which is highly limited. Hence, energy efficiency is of paramount importance in building quadruped robots. Study of energy efficiency in quadruped robots not only helps in efficient design of quadruped robots, but also helps understand the biomechanics of quadrupedal animals. This thesis focuses on the energy efficiency of planar running gaits and presents: (a) derivation of cost of transport expressions for trot and bounding gaits, (b) advantages of articulated torso over rigid torso for quadruped robot, (c) symmetry based control laws for passive dynamic bounding and design for inherent stability, and (d) effect of asymmetry in zero-energy bounding gaits

Towards Agility: Definition, Benchmark and Design Considerations for Small, Quadrupedal Robots

Agile quadrupedal locomotion in animals and robots is yet to be fully understood, quantified or achieved. An intuitive notion of agility exists, but neither a concise definition nor a common benchmark can be found. Further, it is unclear, what minimal level of mechatronic complexity is needed for this particular aspect of locomotion. In this thesis we address and partially answer two primary questions: (Q1) What is agile legged locomotion (agility) and how can wemeasure it? (Q2) How can wemake agile legged locomotion with a robot a reality? To answer our first question, we define agility for robot and animal alike, building a common ground for this particular component of locomotion and introduce quantitative measures to enhance robot evaluation and comparison. The definition is based on and inspired by features of agility observed in nature, sports, and suggested in robotics related publications. Using the results of this observational and literature review, we build a novel and extendable benchmark of thirteen different tasks that implement our vision of quantitatively classifying agility. All scores are calculated from simple measures, such as time, distance, angles and characteristic geometric values for robot scaling. We normalize all unit-less scores to reach comparability between different systems. An initial implementation with available robots and real agility-dogs as baseline finalize our effort of answering the first question. Bio-inspired designs introducing and benefiting from morphological aspects present in nature allowed the generation of fast, robust and energy efficient locomotion. We use engineering tools and interdisciplinary knowledge transferred from biology to build low-cost robots able to achieve a certain level of agility and as a result of this addressing our second question. This iterative process led to a series of robots from Lynx over Cheetah-Cub-S, Cheetah-Cub-AL, and Oncilla to Serval, a compliant robot with actuated spine, high range of motion in all joints. Serval presents a high level of mobility at medium speeds. With many successfully implemented skills, using a basic kinematics-duplication from dogs (copying the foot-trajectories of real animals and replaying themotion on the robot using a mathematical interpretation), we found strengths to emphasize, weaknesses to correct and made Serval ready for future attempts to achieve even more agile locomotion. We calculated Servalâs agility scores with the result of it performing better than any of its predecessors. Our small, safe and low-cost robot is able to execute up to 6 agility tasks out of 13 with the potential to reachmore after extended development. Concluding, we like to mention that Serval is able to cope with step-downs, smooth, bumpy terrain and falling orthogonally to the ground

From locomotion to cognition: Bridging the gap between reactive and cognitive behavior in a quadruped robot

The cognitivistic paradigm, which states that cognition is a result of computation with symbols that represent the world, has been challenged by many. The opponents have primarily criticized the detachment from direct interaction with the world and pointed to some fundamental problems (for instance the symbol grounding problem). Instead, they emphasized the constitutive role of embodied interaction with the environment. This has motivated the advancement of synthetic methodologies: the phenomenon of interest (cognition) can be studied by building and investigating whole brain-body-environment systems. Our work is centered around a compliant quadruped robot equipped with a multimodal sensory set. In a series of case studies, we investigate the structure of the sensorimotor space that the application of different actions in different environments by the robot brings about. Then, we study how the agent can autonomously abstract the regularities that are induced by the different conditions and use them to improve its behavior. The agent is engaged in path integration, terrain discrimination and gait adaptation, and moving target following tasks. The nature of the tasks forces the robot to leave the ``here-and-now'' time scale of simple reactive stimulus-response behaviors and to learn from its experience, thus creating a ``minimally cognitive'' setting. Solutions to these problems are developed by the agent in a bottom-up fashion. The complete scenarios are then used to illuminate the concepts that are believed to lie at the basis of cognition: sensorimotor contingencies, body schema, and forward internal models. Finally, we discuss how the presented solutions are relevant for applications in robotics, in particular in the area of autonomous model acquisition and adaptation, and, in mobile robots, in dead reckoning and traversability detection