Evolving a Behavioral Repertoire for a Walking Robot

Numerous algorithms have been proposed to allow legged robots to learn to walk. However, the vast majority of these algorithms is devised to learn to walk in a straight line, which is not sufficient to accomplish any real-world mission. Here we introduce the Transferability-based Behavioral Repertoire Evolution algorithm (TBR-Evolution), a novel evolutionary algorithm that simultaneously discovers several hundreds of simple walking controllers, one for each possible direction. By taking advantage of solutions that are usually discarded by evolutionary processes, TBR-Evolution is substantially faster than independently evolving each controller. Our technique relies on two methods: (1) novelty search with local competition, which searches for both high-performing and diverse solutions, and (2) the transferability approach, which com-bines simulations and real tests to evolve controllers for a physical robot. We evaluate this new technique on a hexapod robot. Results show that with only a few dozen short experiments performed on the robot, the algorithm learns a repertoire of con-trollers that allows the robot to reach every point in its reachable space. Overall, TBR-Evolution opens a new kind of learning algorithm that simultaneously optimizes all the achievable behaviors of a robot.Comment: 33 pages; Evolutionary Computation Journal 201

Evolving soft locomotion in aquatic and terrestrial environments: effects of material properties and environmental transitions

Designing soft robots poses considerable challenges: automated design approaches may be particularly appealing in this field, as they promise to optimize complex multi-material machines with very little or no human intervention. Evolutionary soft robotics is concerned with the application of optimization algorithms inspired by natural evolution in order to let soft robots (both morphologies and controllers) spontaneously evolve within physically-realistic simulated environments, figuring out how to satisfy a set of objectives defined by human designers. In this paper a powerful evolutionary system is put in place in order to perform a broad investigation on the free-form evolution of walking and swimming soft robots in different environments. Three sets of experiments are reported, tackling different aspects of the evolution of soft locomotion. The first two sets explore the effects of different material properties on the evolution of terrestrial and aquatic soft locomotion: particularly, we show how different materials lead to the evolution of different morphologies, behaviors, and energy-performance tradeoffs. It is found that within our simplified physics world stiffer robots evolve more sophisticated and effective gaits and morphologies on land, while softer ones tend to perform better in water. The third set of experiments starts investigating the effect and potential benefits of major environmental transitions (land - water) during evolution. Results provide interesting morphological exaptation phenomena, and point out a potential asymmetry between land-water and water-land transitions: while the first type of transition appears to be detrimental, the second one seems to have some beneficial effects.Comment: 37 pages, 22 figures, currently under review (journal

Innovative Robot Archetypes for In-Space Construction and Maintenance

The space environment presents unique challenges and opportunities in the assembly, inspection and maintenance of orbital and transit spaceflight systems. While conventional Extra-Vehicular Activity (EVA) technology, out of necessity, addresses each of the challenges, relatively few of the opportunities have been exploited due to crew safety and reliability considerations. Extra-Vehicular Robotics (EVR) is one of the least-explored design spaces but offers many exciting innovations transcending the crane-like Space Shuttle and International Space Station Remote Manipulator System (RMS) robots used for berthing, coarse positioning and stabilization. Microgravity environments can support new robotic archetypes with locomotion and manipulation capabilities analogous to undersea creatures. Such diversification could enable the next generation of space science platforms and vehicles that are too large and fragile to launch and deploy as self-contained payloads. Sinuous manipulators for minimally invasive inspection and repair in confined spaces, soft-stepping climbers with expansive leg reach envelopes and free-flying nanosatellite cameras can access EVA worksites generally not accessible to humans in spacesuits. These and other novel robotic archetypes are presented along with functionality concept

Adaptive, fast walking in a biped robot under neuronal control and learning

Human walking is a dynamic, partly self-stabilizing process relying on the interaction of the biomechanical design with its neuronal control. The coordination of this process is a very difficult problem, and it has been suggested that it involves a hierarchy of levels, where the lower ones, e.g., interactions between muscles and the spinal cord, are largely autonomous, and where higher level control (e.g., cortical) arises only pointwise, as needed. This requires an architecture of several nested, sensori–motor loops where the walking process provides feedback signals to the walker's sensory systems, which can be used to coordinate its movements. To complicate the situation, at a maximal walking speed of more than four leg-lengths per second, the cycle period available to coordinate all these loops is rather short. In this study we present a planar biped robot, which uses the design principle of nested loops to combine the self-stabilizing properties of its biomechanical design with several levels of neuronal control. Specifically, we show how to adapt control by including online learning mechanisms based on simulated synaptic plasticity. This robot can walk with a high speed (> 3.0 leg length/s), self-adapting to minor disturbances, and reacting in a robust way to abruptly induced gait changes. At the same time, it can learn walking on different terrains, requiring only few learning experiences. This study shows that the tight coupling of physical with neuronal control, guided by sensory feedback from the walking pattern itself, combined with synaptic learning may be a way forward to better understand and solve coordination problems in other complex motor tasks

A survey on evolutionary-aided design in robotics

The evolutionary-aided design process is a method to find solutions to design and optimisation problems. Evolutionary Algorithms (EAs) are applied to search for optimal solutions from a solution space that evolves over several generations. EAs have found applications in many areas of robotics. This paper covers the efforts to determine body morphology of robots through evolution and body morphology with the controller of robots or similar creatures through co-evolution. The works are reviewed from the perspective of how different algorithms are applied and includes a brief explanation of how they are implemented

Evolutionary Developmental Soft Robotics As a Framework to Study Intelligence and Adaptive Behavior in Animals and Plants

In this paper, a comprehensive methodology and simulation framework will be reviewed, designed in order to study the emergence of adaptive and intelligent behavior in generic soft-bodied creatures. By incorporating artificial evolutionary and developmental processes, the system allows to evolve complete creatures (brain, body, developmental properties, sensory, control system, etc.) for different task environments. Whether the evolved creatures will resemble animals or plants is in general not known a priori, and depends on the specific task environment set up by the experimenter. In this regard, the system may offer a unique opportunity to explore differences and similarities between these two worlds. Different material properties can be simulated and optimized, from a continuum of soft/stiff materials, to the interconnection of heterogeneous structures, both found in animals and plants alike. The adopted genetic encoding and simulation environment are particularly suitable in order to evolve distributed sensory and control systems, which play a particularly important role in plants. After a general description of the system some case studies will be presented, focusing on the emergent properties of the evolved creatures. Particular emphasis will be on some unifying concepts that are thought to play an important role in the emergence of intelligent and adaptive behavior across both the animal and plant kingdoms, such as morphological computation and morphological developmental plasticity. Overall, with this paper, we hope to draw attention on set of tools, methodologies, ideas and results, which may be relevant to researchers interested in plant-inspired robotics and intelligence

Robust walking of a quadraped robot

Master'sMASTER OF ENGINEERIN