Legged locomotion over irregular terrains: State of the art of human and robot performance

Legged robotic technologies have moved out of the lab to operate in real environments, characterized by a wide variety of unpredictable irregularities and disturbances, all this in close proximity with humans. Demonstrating the ability of current robots to move robustly and reliably in these conditions is becoming essential to prove their safe operation. Here, we report an in-depth literature review aimed at verifying the existence of common or agreed protocols and metrics to test the performance of legged system in realistic environments. We primarily focused on three types of robotic technologies, i.e., hexapods, quadrupeds and bipeds. We also included a comprehensive overview on human locomotion studies, being it often considered the gold standard for performance, and one of the most important sources of bioinspiration for legged machines. We discovered that very few papers have rigorously studied robotic locomotion under irregular terrain conditions. On the contrary, numerous studies have addressed this problem on human gait, being nonetheless of highly heterogeneous nature in terms of experimental design. This lack of agreed methodology makes it challenging for the community to properly assess, compare and predict the performance of existing legged systems in real environments. On the one hand, this work provides a library of methods, metrics and experimental protocols, with a critical analysis on the limitations of the current approaches and future promising directions. On the other hand, it demonstrates the existence of an important lack of benchmarks in the literature, and the possibility of bridging different disciplines, e.g., the human and robotic, towards the definition of standardized procedure that will boost not only the scientific development of better bioinspired solutions, but also their market uptake

ON CONSTRUCTION OF A RELIABLE GROUND TRUTH FOR EVALUATION OF VISUAL SLAM ALGORITHMS

In this work we are concerning the problem of localization accuracy evaluation of visual-based Simultaneous Localization and Mapping (SLAM) techniques. Quantitative evaluation of the SLAM algorithm performance is usually done using the established metrics of Relative pose error and Absolute trajectory error which require a precise and reliable ground truth. Such a ground truth is usually hard to obtain, while it requires an expensive external localization system. In this work we are proposing to use the SLAM algorithm itself to construct a reliable ground-truth by offline frame-by-frame processing. The generated ground-truth is suitable for evaluation of different SLAM systems, as well as for tuning the parametrization of the on-line SLAM. The presented practical experimental results indicate the feasibility of the proposed approach

Learning physical characteristics like animals for legged robots

Physical characteristics of terrains, such as softness and friction, provide essential information for legged robots to avoid non-geometric obstacles, like mires and slippery stones, in the wild. The perception of such characteristics often relies on tactile perception and vision prediction. Although tactile perception is more accurate, it is limited to close-range use; by contrast, establishing a supervised or self-supervised contactless prediction system using computer vision requires adequate labeled data and lacks the ability to adapt to the dynamic environment. In this paper, we simulate the behavior of animals and propose an unsupervised learning framework for legged robots to learn the physical characteristics of terrains, which is the first report to manage it online, incrementally and with the ability to solve cognitive conflicts. The proposed scheme allows robots to interact with the environment and adjust their cognition in real time, therefore endowing robots with the adaptation ability. Indoor and outdoor experiments on a hexapod robot are carried out to show that the robot can extract tactile and visual features of terrains to create cognitive networks independently; an associative layer between visual and tactile features is created during the robot’s exploration; with the layer, the robot can autonomously generate a physical segmentation model of terrains and solve cognitive conflicts in an ever-changing environment, facilitating its safe navigation

Investigation on the mobile robot navigation in an unknown environment

Mobile robots could be used to search, find, and relocate objects in many types of manufacturing operations and environments. In this scenario, the target objects might reside with equal probability at any location in the environment and, therefore, the robot must navigate and search the whole area autonomously, and be equipped with specific sensors to detect objects. Novel challenges exist in developing a control system, which helps a mobile robot achieve such tasks, including constructing enhanced systems for navigation, and vision-based object recognition. The latter is important for undertaking the exploration task that requires an optimal object recognition technique. In this thesis, these challenges, for an indoor environment, were divided into three sub-problems. In the first, the navigation task involved discovering an appropriate exploration path for the entire environment, with minimal sensing requirements. The Bug algorithm strategies were adapted for modelling the environment and implementing the exploration path. The second was a visual-search process, which consisted of employing appropriate image-processing techniques, and choosing a suitable viewpoint field for the camera. This study placed more emphasis on colour segmentation, template matching and Speeded-Up Robust Features (SURF) for object detection. The third problem was the relocating process, which involved using a robot’s gripper to grasp the detected, desired object and then move it to the assigned, final location. This also included approaching both the target and the delivery site, using a visual tracking technique. All codes were developed using C++ and C programming, and some libraries that included OpenCV and OpenSURF were utilized for image processing. Each control system function was tested both separately, and then in combination as a whole control program. The system performance was evaluated using two types of mobile robots: legged and wheeled. In this study, it was necessary to develop a wheeled search robot with a high performance processor. The experimental results demonstrated that the methodology used for the search robots was highly efficient provided the processor was adequate. It was concluded that it is possible to implement a navigation system within a minimum number of sensors if they are located and used effectively on the robot’s body. The main challenge within a visual-search process is that the environmental conditions are difficult to control, because the search robot executes its tasks in dynamic environments. The additional challenges of scaling these small robots up to useful industrial capabilities were also explored

Coupling Vision and Proprioception for Navigation of Legged Robots

We exploit the complementary strengths of vision and proprioception to develop a point-goal navigation system for legged robots, called VP-Nav. Legged systems are capable of traversing more complex terrain than wheeled robots, but to fully utilize this capability, we need a high-level path planner in the navigation system to be aware of the walking capabilities of the low-level locomotion policy in varying environments. We achieve this by using proprioceptive feedback to ensure the safety of the planned path by sensing unexpected obstacles like glass walls, terrain properties like slipperiness or softness of the ground and robot properties like extra payload that are likely missed by vision. The navigation system uses onboard cameras to generate an occupancy map and a corresponding cost map to reach the goal. A fast marching planner then generates a target path. A velocity command generator takes this as input to generate the desired velocity for the walking policy. A safety advisor module adds sensed unexpected obstacles to the occupancy map and environment-determined speed limits to the velocity command generator. We show superior performance compared to wheeled robot baselines, and ablation studies which have disjoint high-level planning and low-level control. We also show the real-world deployment of VP-Nav on a quadruped robot with onboard sensors and computation. Videos at https://navigation-locomotion.github.ioComment: CVPR 2022 final version. Website at https://navigation-locomotion.github.i

Design of a walking robot

Carnegie Mellon University's Autonomous Planetary Exploration Program (APEX) is currently building the Daedalus robot; a system capable of performing extended autonomous planetary exploration missions. Extended autonomy is an important capability because the continued exploration of the Moon, Mars and other solid bodies within the solar system will probably be carried out by autonomous robotic systems. There are a number of reasons for this - the most important of which are the high cost of placing a man in space, the high risk associated with human exploration and communication delays that make teleoperation infeasible. The Daedalus robot represents an evolutionary approach to robot mechanism design and software system architecture. Daedalus incorporates key features from a number of predecessor systems. Using previously proven technologies, the Apex project endeavors to encompass all of the capabilities necessary for robust planetary exploration. The Ambler, a six-legged walking machine was developed by CMU for demonstration of technologies required for planetary exploration. In its five years of life, the Ambler project brought major breakthroughs in various areas of robotic technology. Significant progress was made in: mechanism and control, by introducing a novel gait pattern (circulating gait) and use of orthogonal legs; perception, by developing sophisticated algorithms for map building; and planning, by developing and implementing the Task Control Architecture to coordinate tasks and control complex system functions. The APEX project is the successor of the Ambler project

Desain dan Implementasi Robot Heksapoda dengan Misi Pemadaman Api

Makalah ini memaparkan tentang desain dan implementasi robot heksapoda yang bergerak dalam suatu ruang dengan misi memadamkan api. Sumber api diletakkan dalam ruang tertentu. Untuk mencapai ruang tersebut, robot harus berjalan menyusuri lorong dengan lebar tertentu dan dibatasi oleh dinding. Robot harus bergerak tanpa menabrak dinding pembatas ruang. Untuk merealisasikan sistem tersebut, robot heksapoda dilengkapi dengan tiga buah sensor, yaitu sensor jarak, sensor garis, dan sensor api. Sensor jarak berupa sensor ultrasonik tipe HCSR04 berfungsi memberikan informasi jarak antara robot dengan dinding sehingga robot terhindar dari tabrakan dengan dinding. Sensor garis berupa sensor LDR digunakan untuk mendeteksi garis penanda ruang sumber api. Sementara itu, sensor api berupa sensor flame 5 channel berfungsi mendeteksi keberadaan api yang harus dipadamkan oleh robot. Hasil eksperimen menunjukkan robot heksapoda yang dirancang dapat berjalan menyusuri ruang tanpa menabrak dinding dan menemukan sumber api, kemudian api tersebut dipadamkan oleh kipas yang berputar setelah diberi tegangan input oleh mikrokontroler

Posture control of a low-cost commercially available hexapod robot for uneven terrain locomotion

Legged robots hold the advantage on uneven and irregular terrain, where they exhibit superior mobility over other terrestrial, mobile robots. One of the fundamental ingredients in achieving this exceptional mobility on uneven terrain is posture control, also referred to as attitude control. Many approaches to posture control for multi-legged robots have been taken in the literature; however, the majority of this research has been conducted on custom designed platforms, with sophisticated hardware and, often, fully custom software. Commercially available robots hardly feature in research on uneven terrain locomotion of legged robots, despite the significant advantages they pose over custom designed robots, including drastically lower costs, reusability of parts, and reduced development time, giving them the serious potential to be employed as low-cost research and development platforms. Hence, the aim of this study was to design and implement a posture control system on a low-cost, commercially available hexapod robot – the PhantomX MK-II – overcoming the limitations presented by the lower cost hardware and open source software, while still achieving performance comparable to that exhibited by custom designed robots. For the initial controller development, only the case of the robot standing on all six legs was considered, without accounting for walking motion. This Standing Posture Controller made use of the Virtual Model Control (VMC) strategy, along with a simple foot force distribution rule and a direct force control method for each of the legs, the joints of which can only be position controlled (i.e. they do not have torque control capabilities). The Standing Posture Controller was experimentally tested on level and uneven terrain, as well as on a dynamic balance board. Ground truth measurements of the posture during testing exhibited satisfactory performance, which compared favourably to results of similar tests performed on custom designed platforms. Thereafter, the control system was modified for the more general case of walking. The Walking Posture Controller still made use of VMC for the high-level posture control, but the foot force distribution was expanded to also account for a tripod of ground contact legs during walking. Additionally, the foot force control structure was modified to achieve compliance control of the legs during the swing phase, while still providing direct force control during the stance phase, using the same overall control structure, with a simple switching strategy, all without the need for torque control or modification of the motion control system of the legs, resulting in a novel foot force control system for low-cost, legged robots. Experimental testing of the Walking Posture Controller, with ground truth measurements, revealed that it improved the robot’s posture response by a small amount when walking on flat terrain, while on an uneven terrain setup the maximum roll and pitch angle deviations were reduced by up to 28.6% and 28.1%, respectively, as compared to the uncompensated case. In addition to reducing the maximum deviations on uneven terrain, the overall posture response was significantly improved, resulting in a response much closer to that observed on flat terrain, throughout much of the uneven terrain locomotion. Comparing these results to those obtained in similar tests performed with more sophisticated, custom designed robots, it is evident that the Walking Posture Controller exhibits favourable performance, thus fulfilling the aim of this study.Dissertation (MEng)--University of Pretoria, 2018.Mechanical and Aeronautical EngineeringMEngUnrestricte

Marine Vessel Inspection as a Novel Field for Service Robotics: A Contribution to Systems, Control Methods and Semantic Perception Algorithms.

This cumulative thesis introduces a novel field for service robotics: the inspection of marine vessels using mobile inspection robots. In this thesis, three scientific contributions are provided and experimentally verified in the field of marine inspection, but are not limited to this type of application. The inspection scenario is merely a golden thread to combine the cumulative scientific results presented in this thesis. The first contribution is an adaptive, proprioceptive control approach for hybrid leg-wheel robots, such as the robot ASGUARD described in this thesis. The robot is able to deal with rough terrain and stairs, due to the control concept introduced in this thesis. The proposed system is a suitable platform to move inside the cargo holds of bulk carriers and to deliver visual data from inside the hold. Additionally, the proposed system also has stair climbing abilities, allowing the system to move between different decks. The robot adapts its gait pattern dynamically based on proprioceptive data received from the joint motors and based on the pitch and tilt angle of the robot's body during locomotion. The second major contribution of the thesis is an independent ship inspection system, consisting of a magnetic wall climbing robot for bulkhead inspection, a particle filter based localization method, and a spatial content management system (SCMS) for spatial inspection data representation and organization. The system described in this work was evaluated in several laboratory experiments and field trials on two different marine vessels in close collaboration with ship surveyors. The third scientific contribution of the thesis is a novel approach to structural classification using semantic perception approaches. By these methods, a structured environment can be semantically annotated, based on the spatial relationships between spatial entities and spatial features. This method was verified in the domain of indoor perception (logistics and household environment), for soil sample classification, and for the classification of the structural parts of a marine vessel. The proposed method allows the description of the structural parts of a cargo hold in order to localize the inspection robot or any detected damage. The algorithms proposed in this thesis are based on unorganized 3D point clouds, generated by a LIDAR within a ship's cargo hold. Two different semantic perception methods are proposed in this thesis. One approach is based on probabilistic constraint networks; the second approach is based on Fuzzy Description Logic and spatial reasoning using a spatial ontology about the environment