Coupled Replicator Equations for the Dynamics of Learning in Multiagent Systems

Starting with a group of reinforcement-learning agents we derive coupled replicator equations that describe the dynamics of collective learning in multiagent systems. We show that, although agents model their environment in a self-interested way without sharing knowledge, a game dynamics emerges naturally through environment-mediated interactions. An application to rock-scissors-paper game interactions shows that the collective learning dynamics exhibits a diversity of competitive and cooperative behaviors. These include quasiperiodicity, stable limit cycles, intermittency, and deterministic chaos--behaviors that should be expected in heterogeneous multiagent systems described by the general replicator equations we derive.Comment: 4 pages, 3 figures, http://www.santafe.edu/projects/CompMech/papers/credlmas.html; updated references, corrected typos, changed conten

Amplitude envelope synchronization in coupled chaotic oscillators.

A peculiar type of synchronization has been found when two Van der PolDuffing oscillators, evolving in different chaotic attractors, are coupled. As the coupling increases, the frequencies of the two oscillators remain different, while a synchronized modulation of the amplitudes of a signal of each system develops, and a null Lyapunov exponent of the uncoupled systems becomes negative and gradually larger in absolute value. This phenomenon is characterized by an appropriate correlation function between the returns of the signals, and interpreted in terms of the mutual excitation of new frequencies in the oscillators power spectra. This form of synchronization also occurs in other systems, but it shows up mixed with or screened by other forms of synchronization, as illustrated in this paper by means of the examples of the dynamic behavior observed for three other different models of chaotic oscillators