Legged locomotion over irregular terrains: State of the art of human and robot performance

Legged robotic technologies have moved out of the lab to operate in real environments, characterized by a wide variety of unpredictable irregularities and disturbances, all this in close proximity with humans. Demonstrating the ability of current robots to move robustly and reliably in these conditions is becoming essential to prove their safe operation. Here, we report an in-depth literature review aimed at verifying the existence of common or agreed protocols and metrics to test the performance of legged system in realistic environments. We primarily focused on three types of robotic technologies, i.e., hexapods, quadrupeds and bipeds. We also included a comprehensive overview on human locomotion studies, being it often considered the gold standard for performance, and one of the most important sources of bioinspiration for legged machines. We discovered that very few papers have rigorously studied robotic locomotion under irregular terrain conditions. On the contrary, numerous studies have addressed this problem on human gait, being nonetheless of highly heterogeneous nature in terms of experimental design. This lack of agreed methodology makes it challenging for the community to properly assess, compare and predict the performance of existing legged systems in real environments. On the one hand, this work provides a library of methods, metrics and experimental protocols, with a critical analysis on the limitations of the current approaches and future promising directions. On the other hand, it demonstrates the existence of an important lack of benchmarks in the literature, and the possibility of bridging different disciplines, e.g., the human and robotic, towards the definition of standardized procedure that will boost not only the scientific development of better bioinspired solutions, but also their market uptake

FootTile: a Rugged Foot Sensor for Force and Center of Pressure Sensing in Soft Terrain

In this paper we present FootTile, a foot sensor for reaction force and center of pressure sensing in challenging terrain. We compare our sensor design to standard biomechanical devices, force plates and pressure plates. We show that FootTile can accurately estimate force and pressure distribution during legged locomotion. FootTile weighs 0.9g, has a sampling rate of 330Hz, a footprint of 10 by 10mm and can easily be adapted in sensor range to the required load case. In three experiments we validate: first the performance of the individual sensor, second an array of FootTiles for center of pressure sensing and third the ground reaction force estimation during locomotion in granular substrate. We then go on to show the accurate sensing capabilities of the waterproof sensor in liquid mud, as a showcase for real world rough terrain use

Real-time Digital Double Framework to Predict Collapsible Terrains for Legged Robots

Inspired by the digital twinning systems, a novel real-time digital double framework is developed to enhance robot perception of the terrain conditions. Based on the very same physical model and motion control, this work exploits the use of such simulated digital double synchronized with a real robot to capture and extract discrepancy information between the two systems, which provides high dimensional cues in multiple physical quantities to represent differences between the modelled and the real world. Soft, non-rigid terrains cause common failures in legged locomotion, whereby visual perception solely is insufficient in estimating such physical properties of terrains. We used digital double to develop the estimation of the collapsibility, which addressed this issue through physical interactions during dynamic walking. The discrepancy in sensory measurements between the real robot and its digital double are used as input of a learning-based algorithm for terrain collapsibility analysis. Although trained only in simulation, the learned model can perform collapsibility estimation successfully in both simulation and real world. Our evaluation of results showed the generalization to different scenarios and the advantages of the digital double to reliably detect nuances in ground conditions.Comment: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Preprint version. Accepted June 202

Material Recognition CNNs and Hierarchical Planning for Biped Robot Locomotion on Slippery Terrain

In this paper we tackle the problem of visually predicting surface friction for environments with diverse surfaces, and integrating this knowledge into biped robot locomotion planning. The problem is essential for autonomous robot locomotion since diverse surfaces with varying friction abound in the real world, from wood to ceramic tiles, grass or ice, which may cause difficulties or huge energy costs for robot locomotion if not considered. We propose to estimate friction and its uncertainty from visual estimation of material classes using convolutional neural networks, together with probability distribution functions of friction associated with each material. We then robustly integrate the friction predictions into a hierarchical (footstep and full-body) planning method using chance constraints, and optimize the same trajectory costs at both levels of the planning method for consistency. Our solution achieves fully autonomous perception and locomotion on slippery terrain, which considers not only friction and its uncertainty, but also collision, stability and trajectory cost. We show promising friction prediction results in real pictures of outdoor scenarios, and planning experiments on a real robot facing surfaces with different friction

Quadrupedal Robots with Stiff and Compliant Actuation

In the broader context of quadrupedal locomotion, this overview article introduces and compares two platforms that are similar in structure, size, and morphology, yet differ greatly in their concept of actuation. The first, ALoF, is a classically stiff actuated robot that is controlled kinematically, while the second, StarlETH, uses a soft actuation scheme based on Changedhighly compliant series elastic actuators. We show how this conceptual difference influences design and control of the robots, compare the hardware of the two systems, and show exemplary their advantages in different application

Multi-segmented Adaptive Feet for Versatile Legged Locomotion in Natural Terrain

Most legged robots are built with leg structures from serially mounted links and actuators and are controlled through complex controllers and sensor feedback. In comparison, animals developed multi-segment legs, mechanical coupling between joints, and multi-segmented feet. They run agile over all terrains, arguably with simpler locomotion control. Here we focus on developing foot mechanisms that resist slipping and sinking also in natural terrain. We present first results of multi-segment feet mounted to a bird-inspired robot leg with multi-joint mechanical tendon coupling. Our one- and two-segment, mechanically adaptive feet show increased viable horizontal forces on multiple soft and hard substrates before starting to slip. We also observe that segmented feet reduce sinking on soft substrates compared to ball-feet and cylinder-feet. We report how multi-segmented feet provide a large range of viable centre of pressure points well suited for bipedal robots, but also for quadruped robots on slopes and natural terrain. Our results also offer a functional understanding of segmented feet in animals like ratite birds

Design and development of a hominid robot with local control in its adaptable feet to enhance locomotion capabilities

With increasing mechanization of our daily lives, the expectations and demands in robotic systems increase in the general public and in scientists alike. In recent events such as the Deepwater Horizon''-accident or the nuclear disaster at Fukushima, mobile robotic systems were used, e.g., to support local task forces by gaining visual material to allow an analysis of the situation. Especially the Fukushima example shows that the robotic systems not only have to face a variety of different tasks during operation but also have to deal with different demands regarding the robot's mobility characteristics. To be able to cope with future requirements, it seems necessary to develop kinematically complex systems that feature several different operating modes. That is where this thesis comes in: A robotic system is developed, whose morphology is oriented on chimpanzees and which has the possibility due to its electro-mechanical structure and the degrees of freedom in its arms and legs to walk with different gaits in different postures. For the proposed robot, the chimpanzee was chosen as a model, since these animals show a multitude of different gaits in nature. A quadrupedal gait like crawl allows the robot to traverse safely and stable over rough terrain. A change into the humanoid, bipedal posture enables the robot to move in man-made environments. The structures, which are necessary to ensure an effective and stable locomotion in these two poses, e.g., the feet, are presented in more detail within the thesis. This includes the biological model and an abstraction to allow a technical implementation. In addition, biological spines are analyzed and the development of an active, artificial spine for the robotic system is described. These additional degrees of freedom can increase the robot's locomotion and manipulation capabilities and even allow to show movements, which are not possible without a spine. Unfortunately, the benefits of using an artificial spine in robotic systems are nowadays still neglected, due to the increased complexity of system design and control. To be able to control such a kinematically complex system, a multitude of sensors is installed within the robot's structures. By placing evaluation electronics close by, a local and decentralized preprocessing is realized. Due to this preprocessing is it possible to realize behaviors on the lowest level of robot control: in this thesis it is exemplarily demonstrated by a local controller in the robot's lower leg. In addition to the development and evaluation of robot's structures, the functionality of the overall system is analyzed in different environments. This includes the presentation of detailed data to show the advantages and disadvantages of the local controller. The robot can change its posture independently from a quadrupedal into a bipedal stance and the other way around without external assistance. Once the robot stands upright, it is to investigate to what extent the quadrupedal walking pattern and control structures (like the local controller) have to be modified to contribute to the bipedal walking as well