Evolvability signatures of generative encodings: beyond standard performance benchmarks

Evolutionary robotics is a promising approach to autonomously synthesize machines with abilities that resemble those of animals, but the field suffers from a lack of strong foundations. In particular, evolutionary systems are currently assessed solely by the fitness score their evolved artifacts can achieve for a specific task, whereas such fitness-based comparisons provide limited insights about how the same system would evaluate on different tasks, and its adaptive capabilities to respond to changes in fitness (e.g., from damages to the machine, or in new situations). To counter these limitations, we introduce the concept of "evolvability signatures", which picture the post-mutation statistical distribution of both behavior diversity (how different are the robot behaviors after a mutation?) and fitness values (how different is the fitness after a mutation?). We tested the relevance of this concept by evolving controllers for hexapod robot locomotion using five different genotype-to-phenotype mappings (direct encoding, generative encoding of open-loop and closed-loop central pattern generators, generative encoding of neural networks, and single-unit pattern generators (SUPG)). We observed a predictive relationship between the evolvability signature of each encoding and the number of generations required by hexapods to adapt from incurred damages. Our study also reveals that, across the five investigated encodings, the SUPG scheme achieved the best evolvability signature, and was always foremost in recovering an effective gait following robot damages. Overall, our evolvability signatures neatly complement existing task-performance benchmarks, and pave the way for stronger foundations for research in evolutionary robotics.Comment: 24 pages with 12 figures in the main text, and 4 supplementary figures. Accepted at Information Sciences journal (in press). Supplemental videos are available online at, see http://goo.gl/uyY1R

Multistable Phase Regulation for Robust Steady and Transitional Legged Gaits

We develop robust methods that allow specification, control, and transition of a multi-legged robot’s stepping pattern—its gait—during active locomotion over natural terrain. Resulting gaits emerge through the introduction of controllers that impose appropriately-placed repellors within the space of gaits, the torus of relative leg phases, thereby mitigating against dangerous patterns of leg timing. Moreover, these repellors are organized with respect to a natural cellular decomposition of gait space and result in limit cycles with associated basins that are well characterized by these cells, thus conferring a symbolic character upon the overall behavioral repertoire. These ideas are particularly applicable to four- and six-legged robots, for which a large variety of interesting and useful (and, in many cases, familiar) gaits exist, and whose tradeoffs between speed and reliability motivate the desire for transitioning between them during active locomotion. We provide an empirical instance of this gait regulation scheme by application to a climbing hexapod, whose “physical layer” sensor-feedback control requires adequate grasp of a climbing surface but whose closed loop control perturbs the robot from its desired gait. We document how the regulation scheme secures the desired gait and permits operator selection of different gaits as required during active climbing on challenging surfaces

Simulation and Framework for the Humanoid Robot TigerBot

Walking humanoid robotics is a developing field. Different humanoid robots allow for different kinds of testing. TigerBot is a new full-scale humanoid robot with seven degrees-of-freedom legs and with its specifications, it can serve as a platform for humanoid robotics research. Currently TigerBot has encoders set up on each joint, allowing for position control, and its sensors and joints connect to Teensy microcontrollers and the ODroid XU4 single-board computer central control unit. The components’ communication system used the Robot Operating System (ROS). This allows the user to control TigerBot with ROS. It’s important to have a simulation setup so a user can test TigerBot’s capabilities on a model before using the real robot. A working walking gait in the simulation serves as a test of the simulator, proves TigerBot’s capability to walk, and opens further development on other walking gaits. A model of TigerBot was set up using the simulator Gazebo, which allowed testing different walking gaits with TigerBot. The gaits were generated by following the linear inverse pendulum model and the basic zero-moment point (ZMP) concept. The gaits consisted of center of mass trajectories converted to joint angles through inverse kinematics. In simulation while the robot follows the predetermined joint angles, a proportional-integral controller keeps the model upright by modifying the flex joint angle of the ankles. The real robot can also run the gaits while suspended in the air. The model has shown the walking gait based off the ZMP concept to be stable, if slow, and the actual robot has been shown to air walk following the gait. The simulation and the framework on the robot can be used to continue work with this walking gait or they can be expanded on for different methods and applications such as navigation, computer vision, and walking on uneven terrain with disturbances

The Design and Realization of a Sensitive Walking Platform

Legged locomotion provides robots with the capability of adapting to different terrain conditions. General complex terrain traversal methodologies solely rely on proprioception which readily leads to instability under dynamical situations. Biological legged locomotion utilizes somatosensory feedback to sense the real-time interaction of the feet with ground to enhance stability. Nevertheless, limited attention has been given to sensing the feet-terrain interaction in robotics. This project introduces a paradigm shift in robotic walking called sensitive walking realized through the development of a compliant bipedal platform. Sensitive walking extends upon the success of sensitive manipulation which utilizes tactile feedback to localize an object to grasp, determine an appropriate manipulation configuration, and constantly adapts to maintain grasp stability. Based on the same concepts of sensitive manipulation, sensitive walking utilizes podotactile feedback to enhance real-time walking stability by effectively adapting to variations in the terrain. Adapting legged robotic platforms to sensitive walking is not as simple as attaching any tactile sensor to the feet of a robot. The sensors and the limbs need to have specific characteristics that support the implementation of the algorithms and allow the biped to safely come in contact with the terrain and detect the interaction forces. The challenges in handling the synergy of hardware and sensor design, and fabrication in a podotactile-based sensitive walking robot are addressed. The bipedal platform provides contact compliance through 12 series elastic actuators and contains 190 highly flexible tactile sensors capable of sensing forces at any incident angle. Sensitive walking algorithms are provided to handle multi-legged locomotion challenges including stairs and irregular terrain

On the Evolutionary Co-Adaptation of Morphology and Distributed Neural Controllers in Adaptive Agents

The attempt to evolve complete embodied and situated artificial creatures in which both morphological and control characteristics are adapted during the evolutionary process has been and still represents a long term goal key for the artificial life and the evolutionary robotics community. Loosely inspired by ancient biological organisms which are not provided with a central nervous system and by simple organisms such as stick insects, this thesis proposes a new genotype encoding which allows development and evolution of mor- phology and neural controller in artificial agents provided with a distributed neural network. In order to understand if this kind of network is appropriate for the evolution of non trivial behaviours in artificial agents, two experiments (description and results will be shown in chapter 3) in which evolution was applied only to the controller’s parameters were performed. The results obtained in the first experiment demonstrated how distributed neural networks can achieve a good level of organization by synchronizing the output of oscillatory elements exploiting acceleration/deceleration mechanisms based on local interactions. In the second experiment few variants on the topology of neural architecture were introduced. Results showed how this new control system was able to coordinate the legs of a simulated hexapod robot on two different gaits on the basis of the external circumstances. After this preliminary and successful investigation, a new genotype encoding able to develop and evolve artificial agents with no fixed morphology and with a distributed neural controller was proposed. A second set of experiments was thus performed and the results obtained confirmed both the effectiveness of genotype encoding and the ability of distributed neural network to perform the given task. The results have also shown the strength of genotype both in generating a wide range of different morphological structures and in favouring a direct co-adaptation between neural controller and morphology during the evolutionary process. Furthermore the simplicity of the proposed model has showed the effective role of specific elements in evolutionary experiments. In particular it has demonstrated the importance of the environment and its complexity in evolving non-trivial behaviours and also how adding an independent component to the fitness function could help the evolutionary process exploring a larger space solutions avoiding a premature convergence towards suboptimal solutions

Fast biped walking with a neuronal controller and physical computation

Biped walking remains a difficult problem and robot models can greatly {facilitate} our understanding of the underlying biomechanical principles as well as their neuronal control. The goal of this study is to specifically demonstrate that stable biped walking can be achieved by combining the physical properties of the walking robot with a small, reflex-based neuronal network, which is governed mainly by local sensor signals. This study shows that human-like gaits emerge without {specific} position or trajectory control and that the walker is able to compensate small disturbances through its own dynamical properties. The reflexive controller used here has the following characteristics, which are different from earlier approaches: (1) Control is mainly local. Hence, it uses only two signals (AEA=Anterior Extreme Angle and GC=Ground Contact) which operate at the inter-joint level. All other signals operate only at single joints. (2) Neither position control nor trajectory tracking control is used. Instead, the approximate nature of the local reflexes on each joint allows the robot mechanics itself (e.g., its passive dynamics) to contribute substantially to the overall gait trajectory computation. (3) The motor control scheme used in the local reflexes of our robot is more straightforward and has more biological plausibility than that of other robots, because the outputs of the motorneurons in our reflexive controller are directly driving the motors of the joints, rather than working as references for position or velocity control. As a consequence, the neural controller and the robot mechanics are closely coupled as a neuro-mechanical system and this study emphasises that dynamically stable biped walking gaits emerge from the coupling between neural computation and physical computation. This is demonstrated by different walking experiments using two real robot as well as by a Poincar\'{e} map analysis applied on a model of the robot in order to assess its stability. In addition, this neuronal control structure allows the use of a policy gradient reinforcement learning algorithm to tune the parameters of the neurons in real-time, during walking. This way the robot can reach a record-breaking walking speed of 3.5 leg-lengths per second after only a few minutes of online learning, which is even comparable to the fastest relative speed of human walking