5,864 research outputs found
Sustainable Cooperative Coevolution with a Multi-Armed Bandit
This paper proposes a self-adaptation mechanism to manage the resources
allocated to the different species comprising a cooperative coevolutionary
algorithm. The proposed approach relies on a dynamic extension to the
well-known multi-armed bandit framework. At each iteration, the dynamic
multi-armed bandit makes a decision on which species to evolve for a
generation, using the history of progress made by the different species to
guide the decisions. We show experimentally, on a benchmark and a real-world
problem, that evolving the different populations at different paces allows not
only to identify solutions more rapidly, but also improves the capacity of
cooperative coevolution to solve more complex problems.Comment: Accepted at GECCO 201
Balancing Selection Pressures, Multiple Objectives, and Neural Modularity to Coevolve Cooperative Agent Behavior
Previous research using evolutionary computation in Multi-Agent Systems
indicates that assigning fitness based on team vs.\ individual behavior has a
strong impact on the ability of evolved teams of artificial agents to exhibit
teamwork in challenging tasks. However, such research only made use of
single-objective evolution. In contrast, when a multiobjective evolutionary
algorithm is used, populations can be subject to individual-level objectives,
team-level objectives, or combinations of the two. This paper explores the
performance of cooperatively coevolved teams of agents controlled by artificial
neural networks subject to these types of objectives. Specifically, predator
agents are evolved to capture scripted prey agents in a torus-shaped grid
world. Because of the tension between individual and team behaviors, multiple
modes of behavior can be useful, and thus the effect of modular neural networks
is also explored. Results demonstrate that fitness rewarding individual
behavior is superior to fitness rewarding team behavior, despite being applied
to a cooperative task. However, the use of networks with multiple modules
allows predators to discover intelligent behavior, regardless of which type of
objectives are used
A COEVOLUTIONARY APPROACH TO UNDERSTANDING THE PARADOX OF SOCIAL PRESSURES VERSUS ECONOMIC EFFICIENCY ACROSS THE WORLD'S FOOD CHAINS
Institutional and Behavioral Economics,
Evolution of swarming behavior is shaped by how predators attack
Animal grouping behaviors have been widely studied due to their implications
for understanding social intelligence, collective cognition, and potential
applications in engineering, artificial intelligence, and robotics. An
important biological aspect of these studies is discerning which selection
pressures favor the evolution of grouping behavior. In the past decade,
researchers have begun using evolutionary computation to study the evolutionary
effects of these selection pressures in predator-prey models. The selfish herd
hypothesis states that concentrated groups arise because prey selfishly attempt
to place their conspecifics between themselves and the predator, thus causing
an endless cycle of movement toward the center of the group. Using an
evolutionary model of a predator-prey system, we show that how predators attack
is critical to the evolution of the selfish herd. Following this discovery, we
show that density-dependent predation provides an abstraction of Hamilton's
original formulation of ``domains of danger.'' Finally, we verify that
density-dependent predation provides a sufficient selective advantage for prey
to evolve the selfish herd in response to predation by coevolving predators.
Thus, our work corroborates Hamilton's selfish herd hypothesis in a digital
evolutionary model, refines the assumptions of the selfish herd hypothesis, and
generalizes the domain of danger concept to density-dependent predation.Comment: 25 pages, 11 figures, 5 tables, including 2 Supplementary Figures.
Version to appear in "Artificial Life
Tangled Nature: A model of emergent structure and temporal mode among co-evolving agents
Understanding systems level behaviour of many interacting agents is
challenging in various ways, here we'll focus on the how the interaction
between components can lead to hierarchical structures with different types of
dynamics, or causations, at different levels. We use the Tangled Nature model
to discuss the co-evolutionary aspects connecting the microscopic level of the
individual to the macroscopic systems level. At the microscopic level the
individual agent may undergo evolutionary changes due to mutations of
strategies. The micro-dynamics always run at a constant rate. Nevertheless, the
system's level dynamics exhibit a completely different type of intermittent
abrupt dynamics where major upheavals keep throwing the system between
meta-stable configurations. These dramatic transitions are described by a
log-Poisson time statistics. The long time effect is a collectively adapted of
the ecological network. We discuss the ecological and macroevolutionary
consequences of the adaptive dynamics and briefly describe work using the
Tangled Nature framework to analyse problems in economics, sociology,
innovation and sustainabilityComment: Invited contribution to Focus on Complexity in European Journal of
Physics. 25 page, 1 figur
- …