Evolutionary Tournament-Based Comparison of Learning and Non-Learning Algorithms for Iterated Games

Evolutionary tournaments have been used effectively as a tool for comparing game-playing algorithms. For instance, in the late 1970's, Axelrod organized tournaments to compare algorithms for playing the iterated prisoner's dilemma (PD) game. These tournaments capture the dynamics in a population of agents that periodically adopt relatively successful algorithms in the environment. While these tournaments have provided us with a better understanding of the relative merits of algorithms for iterated PD, our understanding is less clear about algorithms for playing iterated versions of arbitrary single-stage games in an environment of heterogeneous agents. While the Nash equilibrium solution concept has been used to recommend using Nash equilibrium strategies for rational players playing general-sum games, learning algorithms like fictitious play may be preferred for playing against sub-rational players. In this paper, we study the relative performance of learning and non-learning algorithms in an evolutionary tournament where agents periodically adopt relatively successful algorithms in the population. The tournament is played over a testbed composed of all possible structurally distinct 2×2 conflicted games with ordinal payoffs: a baseline, neutral testbed for comparing algorithms. Before analyzing results from the evolutionary tournament, we discuss the testbed, our choice of representative learning and non-learning algorithms and relative rankings of these algorithms in a round-robin competition. The results from the tournament highlight the advantage of learning algorithms over players using static equilibrium strategies for repeated plays of arbitrary single-stage games. The results are likely to be of more benefit compared to work on static analysis of equilibrium strategies for choosing decision procedures for open, adapting agent society consisting of a variety of competitors.Repeated Games, Evolution, Simulation

Decentralized interaction and co-adaptation in the repeated prisoner's dilemma

The purpose of this paper is to propose a nonparametric interest rate term structure model and investigate its implications on term structure dynamics and prices of interest rate derivative securities. The nonparametric spot interest rate process is estimated from the observed short-term interest rates following a robust estimation procedure and the market price of interest rate risk is estimated as implied from the historical term structure data. That is, instead of imposing a priori restrictions on the model, data are allowed to speak for themselves, and at the same time the model retains a parsimonious structure and the computational tractability. The model is implemented using historical Canadian interest rate term structure data. The parametric models with closed form solutions for bond and bond option prices, namely the Vasicek (1977) and CIR (1985) models, are also estimated for comparison purpose. The empirical results not only provide strong evidence that the traditional spot interest rate models and market prices of interest rate risk are severely misspecified but also suggest that different model specifications have significant impact on term structure dynamics and prices of interest rate derivative securities.

The influence of evolutionary selection schemes on the iterated prisoner's dilemma

Many economic and social systems are essentially large multi-agent systems. By means of computational modeling, the complicated behavior of such systems can be investigated. Modeling a multi-agent system as an evolutionary agent system, several important choices have to be made for evolutionary operators. Especially, it is to be expected that evolutionary dynamics substantially depend on the selection scheme. We therefore investigate the influence of evolutionary selection mechanisms on a fundamental problem: the iterated prisoner's dilemma (IPD), an elegant model for the emergence of cooperation in a multi-agent system. We observe various types of behavior, cooperation level, and stability, depending on the selection mechanism and the selection intensity. Hence, our results are important for (1) The proper choice and application of election schemes when modeling real economic situations and (2) assessing the validity of the conclusions drawn from computer experiments with these models. We also conclude that the role of selection in the evolution of multi-agent systems should be investigated further, for instance using more detailed and complex agent interaction models

Simulating Evolutionary Games: A Python-Based Introduction

This paper is an introduction to agent-based simulation using the Python programming language. The core objective of the paper is to enable students, teachers, and researchers immediately to begin social-science simulation projects in a general purpose programming language. This objective is facilitated by design features of the Python programming language, which we very briefly discuss. The paper has a 'tutorial' component, in that it is enablement-focused and therefore strongly application-oriented. As our illustrative application, we choose a classic agent-based simulation model: the evolutionary iterated prisoner's dilemma. We show how to simulate the iterated prisoner's dilemma with code that is simple and readable yet flexible and easily extensible. Despite the simplicity of the code, it constitutes a useful and easily extended simulation toolkit. We offer three examples of this extensibility: we explore the classic result that topology matters for evolutionary outcomes, we show how player type evolution is affected by payoff cardinality, and we show that strategy evaluation procedures can affect strategy persistence. Social science students and instructors should find that this paper provides adequate background to immediately begin their own simulation projects. Social science researchers will additionally be able to compare the simplicity, readability, and extensibility of the Python code with comparable simulations in other languages.Agent-Based Simulation, Python, Prisoner's Dilemma

The Spatial Agent-based Competition Model (SpAbCoM)

The paper presents a detailed documentation of the underlying concepts and methods of the Spatial Agent-based Competition Model (SpAbCoM). For instance, SpAbCoM is used to study firms' choices of spatial pricing policy (GRAUBNER et al., 2011a) or pricing and location under a framework of multi-firm spatial competition and two-dimensional markets (GRAUBNER et al., 2011b). While the simulation model is briefly introduced by means of relevant examples within the corresponding papers, the present paper serves two objectives. First, it presents a detailed discussion of the computational concepts that are used, particularly with respect to genetic algorithms (GAs). Second, it documents SpAbCoM and provides an overview of the structure of the simulation model and its dynamics. -- Das vorliegende Papier dokumentiert die zugrundeliegenden Konzepte und Methoden des Räumlichen Agenten-basierten Wettbewerbsmodells (Spatial Agent-based Competition Model) SpAbCoM. Anwendungsbeispiele dieses Simulationsmodells untersuchen die Entscheidung bezüglich der räumlichen Preisstrategie von Unternehmen (GRAUBNER et al., 2011a) oder Preissetzung und Standortwahl im Rahmen eines räumlichen Wettbewerbsmodells, welches mehr als einen Wettbewerber und zweidimensionalen Marktgebiete berücksichtigt. Während das Simulationsmodell in den jeweiligen Arbeiten kurz anhand eines Beispiels eingeführt wird, dient das vorliegende Papier zwei Zielen. Zum Einen sollen die verwendeten computergestützten Konzepte, hier speziell Genetische Algorithmen (GA), detailliert vorgestellt werden. Zum Anderen besteht die Absicht dieser Dokumentation darin, einen Überblick über die Struktur von SpAbCoM und die während einer Simulation ablaufenden Prozesse zu gegeben.Agent-based modelling,genetic algorithms,spatial pricing,location model.,Agent-basierte Modellierung,Genetische Algorithmen,räumliche Preissetzung,Standortmodell.

Using a theory of mind to find best responses to memory-one strategies

Memory-one strategies are a set of Iterated Prisoner's Dilemma strategies that have been praised for their mathematical tractability and performance against single opponents. This manuscript investigates best response memory-one strategies with a theory of mind for their opponents. The results add to the literature that has shown that extortionate play is not always optimal by showing that optimal play is often not extortionate. They also provide evidence that memory-one strategies suffer from their limited memory in multi agent interactions and can be out performed by optimised strategies with longer memory. We have developed a theory that has allowed to explore the entire space of memory-one strategies. The framework presented is suitable to study memory-one strategies in the Prisoner's Dilemma, but also in evolutionary processes such as the Moran process, Furthermore, results on the stability of defection in populations of memory-one strategies are also obtained