Design Issues for Hexapod Walking Robots

Hexapod walking robots have attracted considerable attention for several decades. Many studies have been carried out in research centers, universities and industries. However, only in the recent past have efficient walking machines been conceived, designed and built with performances that can be suitable for practical applications. This paper gives an overview of the state of the art on hexapod walking robots by referring both to the early design solutions and the most recent achievements. Careful attention is given to the main design issues and constraints that influence the technical feasibility and operation performance. A design procedure is outlined in order to systematically design a hexapod walking robot. In particular, the proposed design procedure takes into account the main features, such as mechanical structure and leg configuration, actuating and driving systems, payload, motion conditions, and walking gait. A case study is described in order to show the effectiveness and feasibility of the proposed design procedure

Fast Damage Recovery in Robotics with the T-Resilience Algorithm

Damage recovery is critical for autonomous robots that need to operate for a long time without assistance. Most current methods are complex and costly because they require anticipating each potential damage in order to have a contingency plan ready. As an alternative, we introduce the T-resilience algorithm, a new algorithm that allows robots to quickly and autonomously discover compensatory behaviors in unanticipated situations. This algorithm equips the robot with a self-model and discovers new behaviors by learning to avoid those that perform differently in the self-model and in reality. Our algorithm thus does not identify the damaged parts but it implicitly searches for efficient behaviors that do not use them. We evaluate the T-Resilience algorithm on a hexapod robot that needs to adapt to leg removal, broken legs and motor failures; we compare it to stochastic local search, policy gradient and the self-modeling algorithm proposed by Bongard et al. The behavior of the robot is assessed on-board thanks to a RGB-D sensor and a SLAM algorithm. Using only 25 tests on the robot and an overall running time of 20 minutes, T-Resilience consistently leads to substantially better results than the other approaches

Genetically evolved dynamic control for quadruped walking

The aim of this dissertation is to show that dynamic control of quadruped locomotion is achievable through the use of genetically evolved central pattern generators. This strategy is tested both in simulation and on a walking robot. The design of the walker has been chosen to be statically unstable, so that during motion less than three supporting feet may be in contact with the ground. The control strategy adopted is capable of propelling the artificial walker at a forward locomotion speed of ~1.5 Km/h on rugged terrain and provides for stability of motion. The learning of walking, based on simulated genetic evolution, is carried out in simulation to speed up the process and reduce the amount of damage to the hardware of the walking robot. For this reason a general-purpose fast dynamic simulator has been developed, able to efficiently compute the forward dynamics of tree-like robotic mechanisms. An optimization process to select stable walking patterns is implemented through a purposely designed genetic algorithm, which implements stochastic mutation and cross-over operators. The algorithm has been tailored to address the high cost of evaluation of the optimization function, as well as the characteristics of the parameter space chosen to represent controllers. Experiments carried out on different conditions give clear indications on the potential of the approach adopted. A proof of concept is achieved, that stable dynamic walking can be obtained through a search process which identifies attractors in the dynamics of the motor-control system of an artificial walker

Performance of QCT-Derived scapula finite element models in predicting local displacements using digital volume correlation

Subject-specific finite element models (FEMs) of the shoulder complex are commonly used to predict differences in internal load distribution due to injury, treatment or disease. However, these models rely on various underlying assumptions, and although experimental validation is warranted, it is difficult to obtain and often not performed. The goal of the current study was to quantify the accuracy of local displacements predicted by subject-specific QCT-based FEMs of the scapula, compared to experimental measurements obtained by combining digital volume correlation (DVC) and mechanical loading of cadaveric specimens within a microCT scanner. Four cadaveric specimens were loaded within a microCT scanner using a custom-designed six degree-of-freedom hexapod robot augmented with carbon fiber struts for radiolucency. BoneDVC software was used to quantify full-field experimental displacements between pre- and post-loaded scans. Corresponding scapula QCT-FEMs were generated and three types of boundary conditions (BC) (idealized-displacement, idealized-force, and DVC-derived) were simulated for each specimen. DVC-derived BCs resulted in the closest match to the experimental results for all specimens (best agreement: slope ranging from 0.87 to 1.09; highest correlation: r2 ranging from 0.79 to 1.00). In addition, a two orders of magnitude decrease was observed in root-mean-square error when using QCT-FEMs with simulated DVC-derived BCs compared to idealized-displacement and idealized-force BCs. The results of this study demonstrate that scapula QCT-FEMs can accurately predict local experimental full-field displacements if the BCs are derived from DVC measurements

Morphological properties of mass-spring networks for optimal locomotion learning

Robots have proven very useful in automating industrial processes. Their rigid components and powerful actuators, however, render them unsafe or unfit to work in normal human environments such as schools or hospitals. Robots made of compliant, softer materials may offer a valid alternative. Yet, the dynamics of these compliant robots are much more complicated compared to normal rigid robots of which all components can be accurately controlled. It is often claimed that, by using the concept of morphological computation, the dynamical complexity can become a strength. On the one hand, the use of flexible materials can lead to higher power efficiency and more fluent and robust motions. On the other hand, using embodiment in a closed-loop controller, part of the control task itself can be outsourced to the body dynamics. This can significantly simplify the additional resources required for locomotion control. To this goal, a first step consists in an exploration of the trade-offs between morphology, efficiency of locomotion, and the ability of a mechanical body to serve as a computational resource. In this work, we use a detailed dynamical model of a Mass–Spring–Damper (MSD) network to study these trade-offs. We first investigate the influence of the network size and compliance on locomotion quality and energy efficiency by optimizing an external open-loop controller using evolutionary algorithms. We find that larger networks can lead to more stable gaits and that the system’s optimal compliance to maximize the traveled distance is directly linked to the desired frequency of locomotion. In the last set of experiments, the suitability of MSD bodies for being used in a closed loop is also investigated. Since maximally efficient actuator signals are clearly related to the natural body dynamics, in a sense, the body is tailored for the task of contributing to its own control. Using the same simulation platform, we therefore study how the network states can be successfully used to create a feedback signal and how its accuracy is linked to the body size

Technical Report on: Tripedal Dynamic Gaits for a Quadruped Robot

A vast number of applications for legged robots entail tasks in complex, dynamic environments. But these environments put legged robots at high risk for limb damage. This paper presents an empirical study of fault tolerant dynamic gaits designed for a quadrupedal robot suffering from a single, known ``missing'' limb. Preliminary data suggests that the featured gait controller successfully anchors a previously developed planar monopedal hopping template in the three-legged spatial machine. This compositional approach offers a useful and generalizable guide to the development of a wider range of tripedal recovery gaits for damaged quadrupedal machines.Comment: Updated *increased font size on figures 2-6 *added a legend, replaced text with colors in figure 5a and 6a *made variables representing vectors boldface in equations 8-10 *expanded on calculations in equations 8-10 by adding additional lines *added a missing "2" to equation 8 (typo) *added mass of the robot to tables II and III *increased the width of figures 1 and

Sample-Efficient Reinforcement Learning of Robot Control Policies in the Real World

abstract: The goal of reinforcement learning is to enable systems to autonomously solve tasks in the real world, even in the absence of prior data. To succeed in such situations, reinforcement learning algorithms collect new experience through interactions with the environment to further the learning process. The behaviour is optimized by maximizing a reward function, which assigns high numerical values to desired behaviours. Especially in robotics, such interactions with the environment are expensive in terms of the required execution time, human involvement, and mechanical degradation of the system itself. Therefore, this thesis aims to introduce sample-efficient reinforcement learning methods which are applicable to real-world settings and control tasks such as bimanual manipulation and locomotion. Sample efficiency is achieved through directed exploration, either by using dimensionality reduction or trajectory optimization methods. Finally, it is demonstrated how data-efficient reinforcement learning methods can be used to optimize the behaviour and morphology of robots at the same time.Dissertation/ThesisDoctoral Dissertation Computer Science 201