Trends in the control of hexapod robots: a survey

The static stability of hexapods motivates their design for tasks in which stable locomotion is required, such as navigation across complex environments. This task is of high interest due to the possibility of replacing human beings in exploration, surveillance and rescue missions. For this application, the control system must adapt the actuation of the limbs according to their surroundings to ensure that the hexapod does not tumble during locomotion. The most traditional approach considers their limbs as robotic manipulators and relies on mechanical models to actuate them. However, the increasing interest in model-free models for the control of these systems has led to the design of novel solutions. Through a systematic literature review, this paper intends to overview the trends in this field of research and determine in which stage the design of autonomous and adaptable controllers for hexapods is.The first author received funding through a doctoral scholarship from the Portuguese Foundation for Science and Technology (FCT) (Grant No. SFRH/BD/145818/2019), with funds from the Portuguese Ministry of Science, Technology and Higher Education and the European Social Fund through the Programa Operacional Regional Norte. This work has been supported by the FCT national funds, under the national support to R&D units grant, through the reference project UIDB/04436/2020 and UIDP/04436/2020

MOTION CONTROL SIMULATION OF A HEXAPOD ROBOT

This thesis addresses hexapod robot motion control. Insect morphology and locomotion patterns inform the design of a robotic model, and motion control is achieved via trajectory planning and bio-inspired principles. Additionally, deep learning and multi-agent reinforcement learning are employed to train the robot motion control strategy with leg coordination achieves using a multi-agent deep reinforcement learning framework. The thesis makes the following contributions: First, research on legged robots is synthesized, with a focus on hexapod robot motion control. Insect anatomy analysis informs the hexagonal robot body and three-joint single robotic leg design, which is assembled using SolidWorks. Different gaits are studied and compared, and robot leg kinematics are derived and experimentally verified, culminating in a three-legged gait for motion control. Second, an animal-inspired approach employs a central pattern generator (CPG) control unit based on the Hopf oscillator, facilitating robot motion control in complex environments such as stable walking and climbing. The robot\u27s motion process is quantitatively evaluated in terms of displacement change and body pitch angle. Third, a value function decomposition algorithm, QPLEX, is applied to hexapod robot motion control. The QPLEX architecture treats each leg as a separate agent with local control modules, that are trained using reinforcement learning. QPLEX outperforms decentralized approaches, achieving coordinated rhythmic gaits and increased robustness on uneven terrain. The significant of terrain curriculum learning is assessed, with QPLEX demonstrating superior stability and faster consequence. The foot-end trajectory planning method enables robot motion control through inverse kinematic solutions but has limited generalization capabilities for diverse terrains. The animal-inspired CPG-based method offers a versatile control strategy but is constrained to core aspects. In contrast, the multi-agent deep reinforcement learning-based approach affords adaptable motion strategy adjustments, rendering it a superior control policy. These methods can be combined to develop a customized robot motion control policy for specific scenarios

Climbing and Walking Robots

Nowadays robotics is one of the most dynamic fields of scientific researches. The shift of robotics researches from manufacturing to services applications is clear. During the last decades interest in studying climbing and walking robots has been increased. This increasing interest has been in many areas that most important ones of them are: mechanics, electronics, medical engineering, cybernetics, controls, and computers. Today’s climbing and walking robots are a combination of manipulative, perceptive, communicative, and cognitive abilities and they are capable of performing many tasks in industrial and non- industrial environments. Surveillance, planetary exploration, emergence rescue operations, reconnaissance, petrochemical applications, construction, entertainment, personal services, intervention in severe environments, transportation, medical and etc are some applications from a very diverse application fields of climbing and walking robots. By great progress in this area of robotics it is anticipated that next generation climbing and walking robots will enhance lives and will change the way the human works, thinks and makes decisions. This book presents the state of the art achievments, recent developments, applications and future challenges of climbing and walking robots. These are presented in 24 chapters by authors throughtot the world The book serves as a reference especially for the researchers who are interested in mobile robots. It also is useful for industrial engineers and graduate students in advanced study

Evolving a Behavioral Repertoire for a Walking Robot

Numerous algorithms have been proposed to allow legged robots to learn to walk. However, the vast majority of these algorithms is devised to learn to walk in a straight line, which is not sufficient to accomplish any real-world mission. Here we introduce the Transferability-based Behavioral Repertoire Evolution algorithm (TBR-Evolution), a novel evolutionary algorithm that simultaneously discovers several hundreds of simple walking controllers, one for each possible direction. By taking advantage of solutions that are usually discarded by evolutionary processes, TBR-Evolution is substantially faster than independently evolving each controller. Our technique relies on two methods: (1) novelty search with local competition, which searches for both high-performing and diverse solutions, and (2) the transferability approach, which com-bines simulations and real tests to evolve controllers for a physical robot. We evaluate this new technique on a hexapod robot. Results show that with only a few dozen short experiments performed on the robot, the algorithm learns a repertoire of con-trollers that allows the robot to reach every point in its reachable space. Overall, TBR-Evolution opens a new kind of learning algorithm that simultaneously optimizes all the achievable behaviors of a robot.Comment: 33 pages; Evolutionary Computation Journal 201

Multistable Phase Regulation for Robust Steady and Transitional Legged Gaits

We develop robust methods that allow specification, control, and transition of a multi-legged robot’s stepping pattern—its gait—during active locomotion over natural terrain. Resulting gaits emerge through the introduction of controllers that impose appropriately-placed repellors within the space of gaits, the torus of relative leg phases, thereby mitigating against dangerous patterns of leg timing. Moreover, these repellors are organized with respect to a natural cellular decomposition of gait space and result in limit cycles with associated basins that are well characterized by these cells, thus conferring a symbolic character upon the overall behavioral repertoire. These ideas are particularly applicable to four- and six-legged robots, for which a large variety of interesting and useful (and, in many cases, familiar) gaits exist, and whose tradeoffs between speed and reliability motivate the desire for transitioning between them during active locomotion. We provide an empirical instance of this gait regulation scheme by application to a climbing hexapod, whose “physical layer” sensor-feedback control requires adequate grasp of a climbing surface but whose closed loop control perturbs the robot from its desired gait. We document how the regulation scheme secures the desired gait and permits operator selection of different gaits as required during active climbing on challenging surfaces

Design, Manufacturing, and Locomotion Studies of Ambulatory Micro-Robots

Biological research over the past several decades has elucidated some of the mechanisms behind highly mobile, efficient, and robust locomotion in insects such as the cockroach. Roboticists have used this information to create biologically-inspired machines capable of running, jumping, and climbing robustly over a variety of terrains. To date, little work has been done to develop an at-scale insect-inspired robot capable of similar feats, due to limitations in fabrication, actuation, and electronics integration at small scales. This thesis addresses these challenges, focusing on the mechanical design and fabrication of a sub-2g walking robot, the Harvard Ambulatory MicroRobot (HAMR). The development of HAMR includes modeling and parameter selection for a two degree of freedom leg powertrain that enables locomotion. In addition, a design inspired by pop-up books that enables fast and repeatable assembly of the miniature walking robot is presented. Finally, a method to drive HAMR resulting in speeds up to 37cm/s is presented, along with simple control schemes.Engineering and Applied Science

Simplifying robotic locomotion by escaping traps via an active tail

Legged systems offer the ability to negotiate and climb heterogeneous terrains, more so than their wheeled counterparts \cite{freedberg_2012}. However, in certain complex environments, these systems are susceptible to failure conditions. These scenarios are caused by the interplay between the locomotor's kinematic state and the local terrain configuration, thus making them challenging to predict and overcome. These failures can cause catastrophic damage to the system and thus, methods to avoid such scenarios have been developed. These strategies typically take the form of environmental sensing or passive mechanical elements that adapt to the terrain. Such methods come at an increased control and mechanical design complexity for the system, often still being susceptible to imperceptible hazards. In this study, we investigated whether a tail could serve to offload this complexity by acting as a mechanism to generate new terradynamic interactions and mitigate failure via substrate contact. To do so, we developed a quadrupedal C-leg robophysical model (length and width = 27 cm, limb radius = 8 cm) capable of walking over rough terrain with an attachable actuated tail (length = 17 cm). We investigated three distinct tail strategies: static pose, periodic tapping, and load-triggered (power) tapping, while varying the angle of the tail relative to the body. We challenged the system to traverse a terrain (length = 160 cm, width = 80 cm) of randomized blocks (length and width = 10 cm, height = 0 to 12 cm) whose dimensions were scaled to the robot. Over this terrain, the robot exhibited trapping failures independent of gait pattern. Using the tail, the robot could free itself from trapping with a probability of 0 to 0.5, with the load-driven behaviors having comparable performance to low frequency periodic tapping across all tested tail angles. Along with increasing this likelihood of freeing, the robot displayed a longer survival distance over the rough terrain with these tail behaviors. In summary, we present the beginning of a framework that leverages mechanics via tail-ground interactions to offload limb control and design complexity to mitigate failure and improve legged system performance in heterogeneous environments.M.S