48 research outputs found
Scalable Co-Optimization of Morphology and Control in Embodied Machines
Evolution sculpts both the body plans and nervous systems of agents together
over time. In contrast, in AI and robotics, a robot's body plan is usually
designed by hand, and control policies are then optimized for that fixed
design. The task of simultaneously co-optimizing the morphology and controller
of an embodied robot has remained a challenge. In psychology, the theory of
embodied cognition posits that behavior arises from a close coupling between
body plan and sensorimotor control, which suggests why co-optimizing these two
subsystems is so difficult: most evolutionary changes to morphology tend to
adversely impact sensorimotor control, leading to an overall decrease in
behavioral performance. Here, we further examine this hypothesis and
demonstrate a technique for "morphological innovation protection", which
temporarily reduces selection pressure on recently morphologically-changed
individuals, thus enabling evolution some time to "readapt" to the new
morphology with subsequent control policy mutations. We show the potential for
this method to avoid local optima and converge to similar highly fit
morphologies across widely varying initial conditions, while sustaining fitness
improvements further into optimization. While this technique is admittedly only
the first of many steps that must be taken to achieve scalable optimization of
embodied machines, we hope that theoretical insight into the cause of
evolutionary stagnation in current methods will help to enable the automation
of robot design and behavioral training -- while simultaneously providing a
testbed to investigate the theory of embodied cognition
A Minimal Developmental Model Can Increase Evolvability in Soft Robots
Different subsystems of organisms adapt over many time scales, such as rapid
changes in the nervous system (learning), slower morphological and neurological
change over the lifetime of the organism (postnatal development), and change
over many generations (evolution). Much work has focused on instantiating
learning or evolution in robots, but relatively little on development. Although
many theories have been forwarded as to how development can aid evolution, it
is difficult to isolate each such proposed mechanism. Thus, here we introduce a
minimal yet embodied model of development: the body of the robot changes over
its lifetime, yet growth is not influenced by the environment. We show that
even this simple developmental model confers evolvability because it allows
evolution to sweep over a larger range of body plans than an equivalent
non-developmental system, and subsequent heterochronic mutations 'lock in' this
body plan in more morphologically-static descendants. Future work will involve
gradually complexifying the developmental model to determine when and how such
added complexity increases evolvability
Unshackling evolution: evolving soft robots with multiple materials and a powerful generative encoding
In 1994 Karl Sims showed that computational evolution can produce interesting morphologies that resemble natural organisms. Despite nearly two decades of work since, evolved morphologies are not obviously more complex or natural, and the field seems to have hit a complexity ceiling. One hypothesis for the lack of increased complexity is that most work, including Simsā, evolves morphologies composed of rigid elements, such as solid cubes and cylinders, limiting the design space. A second hypothesis is that the encodings of previous work have been overly regular, not allowing complex regularities with variation. Here we test both hypotheses by evolving soft robots with multiple materials and a powerful generative encoding called a compositional pattern-producing network (CPPN). Robots are selected for locomotion speed. We find that CPPNs evolve faster robots than a direct encoding and that the CPPN morphologies appear more natural. We also find that locomotion performance increases as more materials are added, that diversity of form and behavior can be increased with diāµerent cost functions without stifling performance, and that organisms can be evolved at diāµerent levels of resolution. These findings suggest the ability of generative soft-voxel systems to scale towards evolving a large diversity of complex, natural, multi-material creatures. Our results suggest that future work that combines the evolution of CPPNencoded soft, multi-material robots with modern diversityencouraging techniques could finally enable the creation of creatures far more complex and interesting than those produced by Sims nearly twenty years ago
Material properties affect evolution's ability to exploit morphological computation in growing soft-bodied creatures
The concept of morphological computation holds that the
body of an agent can, under certain circumstances, exploit
the interaction with the environment to achieve useful behavior,
potentially reducing the computational burden of
the brain/controller. The conditions under which such phenomenon
arises are, however, unclear. We hypothesize that
morphological computation will be facilitated by body plans
with appropriate geometric, material, and growth properties,
while it will be hindered by other body plans in which one or
more of these three properties is not well suited to the task.
We test this by evolving the geometries and growth processes
of soft robots, with either manually-set softer or stiffer material
properties. Results support our hypothesis: we find that
for the task investigated, evolved softer robots achieve better
performances with simpler growth processes than evolved
stiffer ones. We hold that the softer robots succeed because
they are better able to exploit morphological computation.
This four-way interaction among geometry, growth, material
properties and morphological computation is but one example
phenomenon that can be investigated using the system here
introduced, that could enable future studies on the evolution
and development of generic soft-bodied creatures
Evolutionary Developmental Soft Robotics As a Framework to Study Intelligence and Adaptive Behavior in Animals and Plants
In this paper, a comprehensive methodology and simulation framework will be reviewed, designed in order to study the emergence of adaptive and intelligent behavior in generic soft-bodied creatures. By incorporating artificial evolutionary and developmental processes, the system allows to evolve complete creatures (brain, body, developmental properties, sensory, control system, etc.) for different task environments. Whether the evolved creatures will resemble animals or plants is in general not known a priori, and depends on the specific task environment set up by the experimenter. In this regard, the system may offer a unique opportunity to explore differences and similarities between these two worlds. Different material properties can be simulated and optimized, from a continuum of soft/stiff materials, to the interconnection of heterogeneous structures, both found in animals and plants alike. The adopted genetic encoding and simulation environment are particularly suitable in order to evolve distributed sensory and control systems, which play a particularly important role in plants. After a general description of the system some case studies will be presented, focusing on the emergent properties of the evolved creatures. Particular emphasis will be on some unifying concepts that are thought to play an important role in the emergence of intelligent and adaptive behavior across both the animal and plant kingdoms, such as morphological computation and morphological developmental plasticity. Overall, with this paper, we hope to draw attention on set of tools, methodologies, ideas and results, which may be relevant to researchers interested in plant-inspired robotics and intelligence
Evolving soft locomotion in aquatic and terrestrial environments: effects of material properties and environmental transitions
Designing soft robots poses considerable challenges: automated design
approaches may be particularly appealing in this field, as they promise to
optimize complex multi-material machines with very little or no human
intervention. Evolutionary soft robotics is concerned with the application of
optimization algorithms inspired by natural evolution in order to let soft
robots (both morphologies and controllers) spontaneously evolve within
physically-realistic simulated environments, figuring out how to satisfy a set
of objectives defined by human designers. In this paper a powerful evolutionary
system is put in place in order to perform a broad investigation on the
free-form evolution of walking and swimming soft robots in different
environments. Three sets of experiments are reported, tackling different
aspects of the evolution of soft locomotion. The first two sets explore the
effects of different material properties on the evolution of terrestrial and
aquatic soft locomotion: particularly, we show how different materials lead to
the evolution of different morphologies, behaviors, and energy-performance
tradeoffs. It is found that within our simplified physics world stiffer robots
evolve more sophisticated and effective gaits and morphologies on land, while
softer ones tend to perform better in water. The third set of experiments
starts investigating the effect and potential benefits of major environmental
transitions (land - water) during evolution. Results provide interesting
morphological exaptation phenomena, and point out a potential asymmetry between
land-water and water-land transitions: while the first type of transition
appears to be detrimental, the second one seems to have some beneficial
effects.Comment: 37 pages, 22 figures, currently under review (journal
Connecting livestock disease dynamics to human learning and biosecurity decisions
The acceleration of animal disease spread worldwide due to increased animal, feed, and human movement has driven a growing body of epidemiological research as well as a deeper interest in human behavioral studies aimed at understanding their interconnectedness. Biosecurity measures can reduce the risk of infection, but human risk tolerance can hinder biosecurity investments and compliance. Humans may learn from hardship and become more risk averse, but sometimes they instead become more risk tolerant because they forget negative experiences happened in the past or because they come to believe they are immune. We represent the complexity of the hog production system with disease threats, human decision making, and human risk attitude using an agent-based model. Our objective is to explore the role of risk tolerant behaviors and the consequences of delayed biosecurity investments. We set up experiment with Monte Carlo simulations of scenarios designed with different risk tolerance amongst the swine producers and we derive distributions and trends of biosecurity and porcine epidemic diarrhea virus (PEDv) incidence emerging in the system. The output data allowed us to examine interactions between modes of risk tolerance and timings of biosecurity response discussing consequences for disease protection in the production system. The results show that hasty and delayed biosecurity responses or slow shifts toward a biosecure culture do not guarantee control of contamination when the disease has already spread in the system. In an effort to support effective disease prevention, our model results can inform policy making to move toward more resilient and healthy production systems. The modeled dynamics of risk attitude have also the potential to improve communication strategies for nudging and establishing risk averse behaviors thereby equipping the production system in case of foreign disease incursions