Making Models Match: Replicating an Agent-Based Model

Scientists have increasingly employed computer models in their work. Recent years have seen a proliferation of agent-based models in the natural and social sciences. But with the exception of a few "classic" models, most of these models have never been replicated by anyone but the original developer. As replication is a critical component of the scientific method and a core practice of scientists, we argue herein for an increased practice of replication in the agent-based modeling community, and for widespread discussion of the issues surrounding replication. We begin by clarifying the concept of replication as it applies to ABM. Furthermore we argue that replication may have even greater benefits when applied to computational models than when applied to physical experiments. Replication of computational models affects model verification and validation and fosters shared understanding about modeling decisions. To facilitate replication, we must create standards for both how to replicate models and how to evaluate the replication. In this paper, we present a case study of our own attempt to replicate a classic agent-based model. We begin by describing an agent-based model from political science that was developed by Axelrod and Hammond. We then detail our effort to replicate that model and the challenges that arose in recreating the model and in determining if the replication was successful. We conclude this paper by discussing issues for (1) researchers attempting to replicate models and (2) researchers developing models in order to facilitate the replication of their results.Replication, Agent-Based Modeling, Verification, Validation, Scientific Method, Ethnocentrism

Design Guidelines for Agent Based Model Visualization

In the field of agent-based modeling (ABM), visualizations play an important role in identifying, communicating and understanding important behavior of the modeled phenomenon. However, many modelers tend to create ineffective visualizations of Agent Based Models (ABM) due to lack of experience with visual design. This paper provides ABM visualization design guidelines in order to improve visual design with ABM toolkits. These guidelines will assist the modeler in creating clear and understandable ABM visualizations. We begin by introducing a non-hierarchical categorization of ABM visualizations. This categorization serves as a starting point in the creation of an ABM visualization. We go on to present well-known design techniques in the context of ABM visualization. These techniques are based on Gestalt psychology, semiology of graphics, and scientific visualization. They improve the visualization design by facilitating specific tasks, and providing a common language to critique visualizations through the use of visual variables. Subsequently, we discuss the application of these design techniques to simplify, emphasize and explain an ABM visualization. Finally, we illustrate these guidelines using a simple redesign of a NetLogo ABM visualization. These guidelines can be used to inform the development of design tools that assist users in the creation of ABM visualizations.Visualization, Design, Graphics, Guidelines, Communication, Agent-Based Modeling

DeltaTick: Applying Calculus to the Real World through Behavioral Modeling

Certainly one of the most powerful and important modeling languages of our time is the Calculus. But research consistently shows that students do not understand how the variables in calculus-based mathematical models relate to aspects of the systems that those models are supposed to represent. Because of this, students never access the true power of calculus: its suitability to model a wide variety of real-world systems across domains. In this paper, we describe the motivation and theoretical foundations for the DeltaTick and HotLink Replay applications, an effort to address these difficulties by a) enabling students to model a wide variety of systems in the world that change over time by defining the behaviors of that system, and b) making explicit how a system\''s behavior relates to the mathematical trends that behavior creates. These applications employ the visualization and codification of behavior rules within the NetLogo agent-based modeling environment (Wilensky, 1999), rather than mathematical symbols, as their primary building blocks. As such, they provide an alternative to traditional mathematical techniques for exploring and solving advanced modeling problems, as well as exploring the major underlying concepts of calculus