Lamarck's Revenge: Inheritance of Learned Traits Can Make Robot Evolution Better

Evolutionary robot systems offer two principal advantages: an advanced way of developing robots through evolutionary optimization and a special research platform to conduct what-if experiments regarding questions about evolution. Our study sits at the intersection of these. We investigate the question ``What if the 18th-century biologist Lamarck was not completely wrong and individual traits learned during a lifetime could be passed on to offspring through inheritance?'' We research this issue through simulations with an evolutionary robot framework where morphologies (bodies) and controllers (brains) of robots are evolvable and robots also can improve their controllers through learning during their lifetime. Within this framework, we compare a Lamarckian system, where learned bits of the brain are inheritable, with a Darwinian system, where they are not. Analyzing simulations based on these systems, we obtain new insights about Lamarckian evolution dynamics and the interaction between evolution and learning. Specifically, we show that Lamarckism amplifies the emergence of `morphological intelligence', the ability of a given robot body to acquire a good brain by learning, and identify the source of this success: `newborn' robots have a higher fitness because their inherited brains match their bodies better than those in a Darwinian system.Comment: preprint-nature scientific report. arXiv admin note: text overlap with arXiv:2303.1259

Lamarckian Evolution of Simulated Modular Robots

We study evolutionary robot systems where not only the robot brains but also the robot bodies are evolvable. Such systems need to include a learning period right after ‘birth' to acquire a controller that fits the newly created body. In this paper we investigate the possibility of bootstrapping infant robot learning through employing Lamarckian inheritance of parental controllers. In our system controllers are encoded by a combination of a morphology dependent component, a Central Pattern Generator (CPG), and a morphology independent part, a Compositional Pattern Producing Network (CPPN). This makes it possible to transfer the CPPN part of controllers between different morphologies and to create a Lamarckian system. We conduct experiments with simulated modular robots whose fitness is determined by the speed of locomotion, establish the benefits of inheriting optimized parental controllers, shed light on the conditions that influence these benefits, and observe that changing the way controllers are evolved also impacts the evolved morphologies

Acquiring moving skills in robots with evolvable morphologies: Recent results and outlook

© 2017 ACM. We construct and investigate a strongly embodied evolutionary system, where not only the controllers but also the morphologies undergo evolution in an on-line fashion. In these studies, we have been using various types of robot morphologies and controller architectures in combination with several learning algorithms, e.g. evolutionary algorithms, reinforcement learning, simulated annealing, and HyperNEAT. This hands-on experience provides insights and helps us elaborate on interesting research directions for future development

A Comparative Analysis of Darwinian Asexual and Sexual Reproduction in Evolutionary Robotics

Evolutionary Robotics systems draw inspiration from natural evolution to solve the problem of robot design. A key moment in the evolutionary process is reproduction, when the genotype of one or more parents is inherited by their offspring. Existent approaches have used both sexual and asexual reproduction but a comparison between the two is still missing. In this work, we study the effects of sexual and asexual reproduction on the controllers of an Evolutionary Robotics system. In our system, both morphologies and controllers are jointly evolved to solve two separate tasks. We adopt the Triangle of Life framework, in which the controllers go through a phase of learning before reproduction. Using extensive simulations we show that sexual reproduction of the robots' brains is preferable over asexual reproduction as it obtains better robots in terms of fitness. Moreover, we show that sexually reproducing robots present different morphologies and behaviors than the asexually reproducing ones, even though the reproduction mechanism only affects their brains. Finally, we study the effects of the reproduction mechanism on the robots' learning capabilities. By measuring the difference between the inherited and the learned brain we find that robots that evolved using sexual reproduction have better inherited brains and are also better learners

The Environment and Body-Brain Complexity

An open question for both natural and artificial evolutionary systems is how, and under what environmental and evolutionary conditions complexity evolves. This study investigates the impact of increasingly complex task environments on the evolution of robot complexity. Specifically, the impact of evolving body-brain couplings on locomotive task performance, where robot evolution was directed by either body-brain exploration (novelty search) or objective-based (fitness function) evolutionary search. Results indicated that novelty search enabled the evolution of increased robot body-brain complexity and efficacy given specific environment conditions. The key contribution is thus the demonstration that body-brain exploration is suitable for evolving robot complexity that enables high fitness robots in specific environments

Morpho-evolution with learning using a controller archive as an inheritance mechanism

Most work in evolutionary robotics centres on evolving a controller for a fixed body-plan. However, previous studiessuggest that simultaneously evolving both controller and body-plan could open up many interesting possibilities. However, thejoint optimisation of body-plan and control via evolutionaryprocesses can be challenging in rich morphological spaces. Thisis because offspring can have body-plans that are very differentfrom either of their parents, leading to a potential mismatchbetween the structure of an inherited neural controller and thenew body. To address this, we propose a framework that combinesan evolutionary algorithm to generate body-plans and a learning algorithm to optimise the parameters of a neural controller. The topology of this controller is created once the body-plan of each offspring has been generated. The key novelty of the approach is to add an external archive for storing learned controllers that map to explicit ‘types’ of robots (where this is defined with respect to the features of the body-plan). By initiating learning froma controller with an appropriate structure inherited from thearchive, rather than from a randomly initialised one, we show that both the speed and magnitude of learning increases over time when compared to an approach that starts from scratch, using two tasks and three environments. The framework also provides new insights into the complex interactions between evolution and learnin

Morpho-evolution with learning using a controller archive as an inheritance mechanism

Most work in evolutionary robotics centres on evolving a controller for a fixed body-plan. However, previous studiessuggest that simultaneously evolving both controller and body-plan could open up many interesting possibilities. However, thejoint optimisation of body-plan and control via evolutionaryprocesses can be challenging in rich morphological spaces. Thisis because offspring can have body-plans that are very differentfrom either of their parents, leading to a potential mismatchbetween the structure of an inherited neural controller and thenew body. To address this, we propose a framework that combinesan evolutionary algorithm to generate body-plans and a learning algorithm to optimise the parameters of a neural controller. The topology of this controller is created once the body-plan of each offspring has been generated. The key novelty of the approach is to add an external archive for storing learned controllers that map to explicit ‘types’ of robots (where this is defined with respect to the features of the body-plan). By initiating learning froma controller with an appropriate structure inherited from thearchive, rather than from a randomly initialised one, we show that both the speed and magnitude of learning increases over time when compared to an approach that starts from scratch, using two tasks and three environments. The framework also provides new insights into the complex interactions between evolution and learnin

Music in Evolution and Evolution in Music

Music in Evolution and Evolution in Music by Steven Jan is a comprehensive account of the relationships between evolutionary theory and music. Examining the ‘evolutionary algorithm’ that drives biological and musical-cultural evolution, the book provides a distinctive commentary on how musicality and music can shed light on our understanding of Darwin’s famous theory, and vice-versa. Comprised of seven chapters, with several musical examples, figures and definitions of terms, this original and accessible book is a valuable resource for anyone interested in the relationships between music and evolutionary thought. Jan guides the reader through key evolutionary ideas and the development of human musicality, before exploring cultural evolution, evolutionary ideas in musical scholarship, animal vocalisations, music generated through technology, and the nature of consciousness as an evolutionary phenomenon. A unique examination of how evolutionary thought intersects with music, Music in Evolution and Evolution in Music is essential to our understanding of how and why music arose in our species and why it is such a significant presence in our lives