Reset-free Trial-and-Error Learning for Robot Damage Recovery

The high probability of hardware failures prevents many advanced robots (e.g., legged robots) from being confidently deployed in real-world situations (e.g., post-disaster rescue). Instead of attempting to diagnose the failures, robots could adapt by trial-and-error in order to be able to complete their tasks. In this situation, damage recovery can be seen as a Reinforcement Learning (RL) problem. However, the best RL algorithms for robotics require the robot and the environment to be reset to an initial state after each episode, that is, the robot is not learning autonomously. In addition, most of the RL methods for robotics do not scale well with complex robots (e.g., walking robots) and either cannot be used at all or take too long to converge to a solution (e.g., hours of learning). In this paper, we introduce a novel learning algorithm called "Reset-free Trial-and-Error" (RTE) that (1) breaks the complexity by pre-generating hundreds of possible behaviors with a dynamics simulator of the intact robot, and (2) allows complex robots to quickly recover from damage while completing their tasks and taking the environment into account. We evaluate our algorithm on a simulated wheeled robot, a simulated six-legged robot, and a real six-legged walking robot that are damaged in several ways (e.g., a missing leg, a shortened leg, faulty motor, etc.) and whose objective is to reach a sequence of targets in an arena. Our experiments show that the robots can recover most of their locomotion abilities in an environment with obstacles, and without any human intervention.Comment: 18 pages, 16 figures, 3 tables, 6 pseudocodes/algorithms, video at https://youtu.be/IqtyHFrb3BU, code at https://github.com/resibots/chatzilygeroudis_2018_rt

Efficient PID Controller based Hexapod Wall Following Robot

This paper presents a design of wall followingbehaviour for hexapod robot based on PID controller. PIDcontroller is proposed here because of its ability to controlmany cases of non-linear systems. In this case, we proposed aPID controller to improve the speed and stability of hexapodrobot movement while following the wall. In this paper, PIDcontroller is used to control the robot legs, by adjusting thevalue of swing angle during forward or backward movement tomaintain the distance between the robot and the wall. Theexperimental result was verified by implementing the proposedcontrol method into actual prototype of hexapod robot

Climbing and Walking Robots

Nowadays robotics is one of the most dynamic fields of scientific researches. The shift of robotics researches from manufacturing to services applications is clear. During the last decades interest in studying climbing and walking robots has been increased. This increasing interest has been in many areas that most important ones of them are: mechanics, electronics, medical engineering, cybernetics, controls, and computers. Today’s climbing and walking robots are a combination of manipulative, perceptive, communicative, and cognitive abilities and they are capable of performing many tasks in industrial and non- industrial environments. Surveillance, planetary exploration, emergence rescue operations, reconnaissance, petrochemical applications, construction, entertainment, personal services, intervention in severe environments, transportation, medical and etc are some applications from a very diverse application fields of climbing and walking robots. By great progress in this area of robotics it is anticipated that next generation climbing and walking robots will enhance lives and will change the way the human works, thinks and makes decisions. This book presents the state of the art achievments, recent developments, applications and future challenges of climbing and walking robots. These are presented in 24 chapters by authors throughtot the world The book serves as a reference especially for the researchers who are interested in mobile robots. It also is useful for industrial engineers and graduate students in advanced study

Kinematics and Robot Design I, KaRD2018

This volume collects the papers published on the Special Issue “Kinematics and Robot Design I, KaRD2018” (https://www.mdpi.com/journal/robotics/special_issues/KARD), which is the first issue of the KaRD Special Issue series, hosted by the open access journal “MDPI Robotics”. The KaRD series aims at creating an open environment where researchers can present their works and discuss all the topics focused on the many aspects that involve kinematics in the design of robotic/automatic systems. Kinematics is so intimately related to the design of robotic/automatic systems that the admitted topics of the KaRD series practically cover all the subjects normally present in well-established international conferences on “mechanisms and robotics”. KaRD2018 received 22 papers and, after the peer-review process, accepted only 14 papers. The accepted papers cover some theoretical and many design/applicative aspects

Dynamic modelling of hexarot parallel mechanisms for design and development

In this research, the kinematics, dynamics, and general closed-form dynamic formulation of the centrifugal high-G hexarot-based manipulators have been developed through the different mathematical modeling techniques. The vibrations of the mechanism have also been investigated