Measuring collaborative emergent behavior in multi-agent reinforcement learning

Multi-agent reinforcement learning (RL) has important implications for the future of human-agent teaming. We show that improved performance with multi-agent RL is not a guarantee of the collaborative behavior thought to be important for solving multi-agent tasks. To address this, we present a novel approach for quantitatively assessing collaboration in continuous spatial tasks with multi-agent RL. Such a metric is useful for measuring collaboration between computational agents and may serve as a training signal for collaboration in future RL paradigms involving humans.Comment: 1st International Conference on Human Systems Engineering and Design, 6 pages, 2 figures, 1 tabl

Indirect effects of primary prey population dynamics on alternative prey

We develop a theory of generalist predation showing how alternative prey species are affected by changes in both mean abundance and variability (coefficient of variation) of their predator's primary prey. The theory is motivated by the indirect effects of cyclic rodent populations on ground-breeding birds, and developed through progressive analytic simplifications of an empirically-based model. It applies nonetheless to many other systems where primary prey have fast life-histories and can become locally superabundant, which facilitates impact on alternative prey species. In contrast to classic apparent competition theory based on symmetric interactions, our results suggest that predator effects on alternative prey should generally decrease with mean primary prey abundance, and increase with primary prey variability (low to high CV) - unless predators have strong aggregative responses, in which case these results can be reversed. Approximations of models including predator dynamics (general numerical response with possible delays) confirm these results but further suggest that negative temporal correlation between predator and primary prey is harmful to alternative prey. We find in general that predator numerical responses are crucial to predict the response of ecosystems to changes in key prey species exhibiting outbreaks, and extend the apparent competition/mutualism theory to asymmetric interactions

Evolution of predator dispersal in relation to spatio-temporal prey dynamics : how not to get stuck in the wrong place!

Peer reviewedPublisher PD

Population-level consequences of heterospecific density-dependent movements in predator-prey systems

In this paper we elucidate how small-scale movements, such as those associated with searching for food and avoiding predators, affect the stability of predator-prey dynamics. We investigate an individual-based Lotka-Volterra model with density dependent movement, in which the predator and prey populations live in a very large number of coupled patches. The rates at which individuals leave patches depend on the local densities of heterospecifics, giving rise to one reaction norm for each of the two species. Movement rates are assumed to be much faster than demographics rates. A spatial structure of predators and prey emerges which affects the global population dynamics. We derive a criterion which reveals how demograhic stability depends on the relationships between the per capita covariance and densities of predators and prey. Specifically we establish that a positive relationship with prey density and a negative relationship with predator density tend to be stabilizig. On a more mechanistic level we show how these relationships are linked to the movement reaction norms of predators and prey. Numerical results show that these findings hold both for local and global movements, i.e., both when migration is biased towards neighboring patches and when all patches are reached with equal probability

A simple mathematical model of gradual Darwinian evolution: Emergence of a Gaussian trait distribution in adaptation along a fitness gradient

We consider a simple mathematical model of gradual Darwinian evolution in continuous time and continuous trait space, due to intraspecific competition for common resource in an asexually reproducing population in constant environment, while far from evolutionary stable equilibrium. The model admits exact analytical solution. In particular, Gaussian distribution of the trait emerges from generic initial conditions.Comment: 21 pages, 2 figures, as accepted to J Math Biol 2013/03/1