Reinforcement learning account of network reciprocity

Evolutionary game theory predicts that cooperation in social dilemma games is promoted when agents are connected as a network. However, when networks are fixed over time, humans do not necessarily show enhanced mutual cooperation. Here we show that reinforcement learning (specifically, the so-called Bush-Mosteller model) approximately explains the experimentally observed network reciprocity and the lack thereof in a parameter region spanned by the benefit-to-cost ratio and the node's degree. Thus, we significantly extend previously obtained numerical results

An experimental study of network effects on coordination in asymmetric games

Network structure has often proven to be important in understanding the decision behavior of individuals or agents in different interdependent situations. Computational studies predict that network structure has a crucial influence on behavior in iterated 2 by 2 asymmetric ‘battle of the sexes’ games. We test such behavioral predictions in an experiment with 240 human subjects. We found that as expected the less ‘random’ the network structure, the better the experimental results are predictable by the computational models. In particular, there is an effect of network clustering on the heterogeneity of convergence behavior in the network. We also found that degree centrality and having an even degree are important predictors of the decision behavior of the subjects in the experiment. We thus find empirical validation of predictions made by computational models in a computerized experiment with human subjects

Asymmetric games on networks: Towards an Ising-model representation

We here study the Battle of the Sexes game, a textbook case of asymmetric games, on small networks. Due to the conflicting preferences of the players, analytical approaches are scarce and most often update strategies are employed in numerical simulations of repeated games on networks until convergence is reached. As a result, correlations between the choices of the players emerge. Our approach is to study these correlations with a generalized Ising model. First, we show that these correlations emerge in simulations and can have an Ising-like form. Then, using the response strategy framework, we describe how the actions of the players can bring the network into a steady configuration, starting from an out-of-equilibrium one. We obtain these configurations using game-theoretic tools, and describe the results using Ising parameters. We exhaust the two-player case, giving a detailed account of all the equilibrium possibilities. Going to three players, we generalize the Ising model and compare the equilibrium solutions of three representative types of networks. We find that players that are not directly linked retain a degree of correlation that is proportional to their initial correlation. We also find that the local network structure is the most relevant for small values of the magnetic field and the interaction strength of the Ising model. Finally, we conclude that certain parameters of the equilibrium states are network independent, which opens up the possibility of an analytical description of asymmetric games played on networks. (C) 2022 The Author(s). Published by Elsevier B.V

Reinforcement learning account of network reciprocity

Evolutionary game theory predicts that cooperation in social dilemma games is promoted when agents are connected as a network. However, when networks are fixed over time, humans do not necessarily show enhanced mutual cooperation. Here we show that reinforcement learning (specifically, the so-called Bush-Mosteller model) approximately explains the experimentally observed network reciprocity and the lack thereof in a parameter region spanned by the benefit-to-cost ratio and the node's degree. Thus, we significantly extend previously obtained numerical results.Comment: 13 pages, 3 figure