Resistance to learning and the evolution of cooperation

In many evolutionary algorithms, crossover is the main operator used in generating new individuals from old ones. However, the usual mechanism for generating offsprings in spatially structured evolutionary games has to date been clonation. Here we study the effect of incorporating crossover on these models. Our framework is the spatial Continuous Prisoner's Dilemma. For this evolutionary game, it has been reported that occasional errors (mutations) in the clonal process can explain the emergence of cooperation from a non-cooperative initial state. First, we show that this only occurs for particular regimes of low costs of cooperation. Then, we display how crossover gets greater the range of scenarios where cooperative mutants can invade selfish populations. In a social context, where crossover involves a general rule of gradual learning, our results show that the less that is learnt in a single step, the larger the degree of global cooperation finally attained. In general, the effect of step-by-step learning can be more efficient for the evolution of cooperation than a full blast one.Evolutionary games, Continuous prisoner's dilemma, Spatially structured, Crossover, Learning

Cooperation in the Prisoner's Dilemma Game Based on the Second-Best Decision

In the research addressing the prisoner's dilemma game, the effectiveness and accountableness of the method allowing for the emergence of cooperation is generally discussed. The most well-known solutions for this question are memory based iteration, the tag used to distinguish between defector and cooperator, the spatial structure of the game and the either direct or indirect reciprocity. We have also challenged to approach the topic from a different point of view namely that temperate acquisitiveness in decision making could be possible to achieve cooperation. It was already shown in our previous research that the exclusion of the best decision had a remarkable effect on the emergence of an almost cooperative state. In this paper, we advance the decision of our former research to become more explainable by introducing the second-best decision. If that decision is adopted, players also reach an extremely high level cooperative state in the prisoner's dilemma game and also in that of extended strategy expression. The cooperation of this extended game is facilitated only if the product of two parameters is under the criticality. In addition, the applicability of our model to the problem in the real world is discussed.Cooperation, Altruism, Agent-Based Simulation, Evolutionary Game Theory

Analyzing Social Network Structures in the Iterated Prisoner's Dilemma with Choice and Refusal

The Iterated Prisoner's Dilemma with Choice and Refusal (IPD/CR) is an extension of the Iterated Prisoner's Dilemma with evolution that allows players to choose and to refuse their game partners. From individual behaviors, behavioral population structures emerge. In this report, we examine one particular IPD/CR environment and document the social network methods used to identify population behaviors found within this complex adaptive system. In contrast to the standard homogeneous population of nice cooperators, we have also found metastable populations of mixed strategies within this environment. In particular, the social networks of interesting populations and their evolution are examined.Comment: 37 pages, uuencoded gzip'd Postscript (1.1Mb when gunzip'd) also available via WWW at http://www.cs.wisc.edu/~smucker/ipd-cr/ipd-cr.htm

A Trade Network Game with Endogenous Partner Selection

This paper develops an evolutionary trade network game (TNG) that combines evolutionary game play with endogenous partner selection. Successive generations of resource-constrained buyers and sellers choose and refuse trade partners on the basis of continually updated expected payoffs. Trade partner selection takes place in accordance with a modified Gale-Shapley matching mechanism, and trades are implemented using trade strategies evolved via a standardly specified genetic algorithm. The trade partnerships resulting from the matching mechanism are shown to be core stable and Pareto optimal in each successive trade cycle. Nevertheless, computer experiments suggest that these static optimality properties may be inadequate measures of optimality from an evolutionary perspective. Related work can be accessed at: http://www.econ.iastate.edu/tesfatsi/tnghome.htmTrade network formation; evolutionary game; endogenous partner selection; iterated prisoner's dilemma; Gale-Shapley matching

Resistance to learning and the evolution of cooperation

In many evolutionary algorithms, crossover is the main operator used in generating new individuals from old ones. However, the usual mechanism for generating offsprings in spatially structured evolutionary games has to date been clonation. Here we study the effect of incorporating crossover on these models. Our framework is the spatial Continuous Prisoner's Dilemma. For this evolutionary game, it has been reported that occasional errors (mutations) in the clonal process can explain the emergence of cooperation from a non-cooperative initial state. First, we show that this only occurs for particular regimes of low costs of cooperation. Then, we display how crossover gets greater the range of scenarios where cooperative mutants can invade selfish populations. In a social context, where crossover involves a general rule of gradual learning, our results show that the less that is learnt in a single step, the larger the degree of global cooperation finally attained. In general, the effect of step-by-step learning can be more efficient for the evolution of cooperation than a full blast one

The influence of evolutionary selection schemes on the iterated prisoner's dilemma

Many economic and social systems are essentially large multi-agent systems. By means of computational modeling, the complicated behavior of such systems can be investigated. Modeling a multi-agent system as an evolutionary agent system, several important choices have to be made for evolutionary operators. Especially, it is to be expected that evolutionary dynamics substantially depend on the selection scheme. We therefore investigate the influence of evolutionary selection mechanisms on a fundamental problem: the iterated prisoner's dilemma (IPD), an elegant model for the emergence of cooperation in a multi-agent system. We observe various types of behavior, cooperation level, and stability, depending on the selection mechanism and the selection intensity. Hence, our results are important for (1) The proper choice and application of election schemes when modeling real economic situations and (2) assessing the validity of the conclusions drawn from computer experiments with these models. We also conclude that the role of selection in the evolution of multi-agent systems should be investigated further, for instance using more detailed and complex agent interaction models

A Model-To-Model Analysis of Bertrand Competition

This paper studies a version of the classical Bertrand model in which consumers exhibit some strategic behavior when deciding from what seller they will buy. We use two related but different tools. Both consider a probabilistic learning (or evolutionary) mechanism, and in the two of them consumers\' behavior influences the competition between the sellers. The results obtained show that, in general, developing some sort of loyalty is a good strategy for the buyers as it works in their best interest. First, we consider a learning procedure described by a deterministic dynamic system and, using strong simplifying assumptions, we can produce a description of the behavior of the process. Second, we use finite automata to represent the strategies played by the agents and an adaptive process based on genetic algorithms to simulate the stochastic process of learning. By doing so we can relax some of the strong assumptions used in the first approach and still obtain the same basic results. It is suggested that the limitations of the first approach (analytical) provide a good motivation for the second approach (Agent-Based). Indeed, although both approaches address the same problem, the use of Agent-Based computational techniques allows us to relax hypothesis and overcome the limitations of the analytical approach while obtaining the same basic results.Agent-Based Computational Economics, Model-To-Model Analysis,

Computing Nash equilibria and evolutionarily stable states of evolutionary games

Stability analysis is an important research direction in evolutionary game theory. Evolutionarily stable states have a close relationship with Nash equilibria of repeated games, which are characterized by the folk theorem. When applying the folk theorem, one needs to compute the minimax profile of the game in order to find Nash equilibria. Computing the minimax profile is an NP-hard problem. In this paper we investigate a new methodology to compute evolutionary stable states based on the level-k equilibrium, a new refinement of Nash equilibrium in repeated games. A level-k equilibrium is implemented by a group of players who adopt reactive strategies and who have no incentive to deviate from their strategies simultaneously. Computing the level-k equilibria is tractable because the minimax payoffs and strategies are not needed. As an application, this paper develops a tractable algorithm to compute the evolutionarily stable states and the Pareto front of n-player symmetric games. Three games, including the iterated prisoner’s dilemma, are analyzed by means of the proposed methodology

Consumers' Behavior and the Bertrand Paradox: An ACE approach

We analyze the classical Bertrand model when consumers exhibit some strategic behavior in deciding from which seller they will buy. We use two related but different tools. Both consider a probabilistic learning (or evolutionary) mechanism, and in the two of them consumers' behavior in uences the competition between the sellers. The results obtained show that, in general, developing some sort of loyalty is a good strategy for the buyers as it works in their best interest. First, we consider a learning procedure described by a deterministic dynamic system and, using strong simplifying assumptions, we can produce a description of the process behavior. Second, we use nite automata to represent the strategies played by the agents and an adaptive process based on genetic algorithms to simulate the stochastic process of learning. By doing so we can relax some of the strong assumptions used in the rst approach and still obtain the same basic results. It is suggested that the limitations of the rst approach (analytical) provide a good motivation for the second approach (Agent-Based). Indeed, although both approaches address the same problem, the use of Agent-Based computational techniques allows us to relax hypothesis and overcome the limitations of the analytical approach.Agent-Based Computational Economics, Evolutionary Game Theory, Imperfect Competition

Analysis of game playing agents with fingerprints

Evolutionary computation (EC) can create a vast number of strategies for playing simple games in a short time. Analysis of these strategies is typically more time-consuming than their production. As a result, analysis of strategies produced by an EC system is often lacking or restricted to the extraction of superficial summary Statistics and Probability; This thesis presents a technique for extracting a functional signature from evolved agents that play games. This signature can be used as a visualization of agent behavior in games with two moves and also provides a numerical target for clustering and other forms of automatic analysis. The fingerprint can be used to induce a similarity measure on the space of game strategies. This thesis develops fingerprints in the context of the iterated prisoner\u27s dilemma; we note that they can be computed for any two player simultaneous game with a finite set of moves. When using a clustering algorithm, the results are strongly influenced by the choice of the measure used to find the distance between or to compare the similarity of the data being clustered. The Euclidean metric, for example, rates a convex polytope as the most compact type of object and builds clusters that are contained in compact polytopes. Presented here is a general method, called multi-clustering, that compensates for the intrinsic shape of a metric or similarity measure. The method is tested on synthetic data sets that are natural for the Euclidean metric and on data sets designed to defeat k-means clustering with the Euclidean metric. Multi-clustering successfully discovers the designed cluster structure of all the synthetic data sets used with a minimum of parameter tuning. We then use multi-clustering and filtration on fingerprint data. Cellular representation is the practice of evolving a set of instructions for constructing a desired structure. This thesis presents a cellular encoding for finite state machines and specializes it to play the iterated prisoner\u27s dilemma. The impact on the character and behavior of finite state agents of using the cellular representation is investigated. For the cellular representation resented a statistically significant drop in the level of cooperation is found. Other differences in the character of the automaton generated with a direct and cellular representation are reported