An Objective-Based Perspective on Assessment of Model-Supported Policy Processes

Simulation models, being in use for a long time in natural sciences and engineering domains, are diffusing to a wider context including policy analysis studies. The differences between the nature of the domain of application, as well as the increased variety of usage partially induced by this difference naturally imply new challenges to be overcome. One of these challenges is related to the assessment of the simulation-based outcomes in terms of their reliability and relevance in the policy context being studied. The importance of this assessment is twofold. First of all, it is all about conducting a high quality policy study with effective results. However, the quality of the study does not necessarily imply acceptance of the results by the clients and/or colleagues. This problem of policy analysts increases the importance of such an assessment; an effective assessment may induce the acceptance of the conclusions drawn from the study by the clients and/or colleagues. The main objective of this paper is to introduce an objective-based assessment perspective for simulation model-supported policy studies. As a first step towards such a goal, an objective-based classification of models is introduced. Based on that, we will discuss the importance of different aspects of the assessment for each type. In doing so, we aim to provide a structured discussion that may serve as a sort of methodological guideline to be used by policy analysts, and also by clients.Simulation, Validation, Model Assessment, Policy Analysis, Model Typology

The Logic of the Method of Agent-Based Simulation in the Social Sciences: Empirical and Intentional Adequacy of Computer Programs

The classical theory of computation does not represent an adequate model of reality for simulation in the social sciences. The aim of this paper is to construct a methodological perspective that is able to conciliate the formal and empirical logic of program verification in computer science, with the interpretative and multiparadigmatic logic of the social sciences. We attempt to evaluate whether social simulation implies an additional perspective about the way one can understand the concepts of program and computation. We demonstrate that the logic of social simulation implies at least two distinct types of program verifications that reflect an epistemological distinction in the kind of knowledge one can have about programs. Computer programs seem to possess a causal capability (Fetzer, 1999) and an intentional capability that scientific theories seem not to possess. This distinction is associated with two types of program verification, which we call empirical and intentional verification. We demonstrate, by this means, that computational phenomena are also intentional phenomena, and that such is particularly manifest in agent-based social simulation. Ascertaining the credibility of results in social simulation requires a focus on the identification of a new category of knowledge we can have about computer programs. This knowledge should be considered an outcome of an experimental exercise, albeit not empirical, acquired within a context of limited consensus. The perspective of intentional computation seems to be the only one possible to reflect the multiparadigmatic character of social science in terms of agent-based computational social science. We contribute, additionally, to the clarification of several questions that are found in the methodological perspectives of the discipline, such as the computational nature, the logic of program scalability, and the multiparadigmatic character of agent-based simulation in the social sciences.Computer and Social Sciences, Agent-Based Simulation, Intentional Computation, Program Verification, Intentional Verification, Scientific Knowledge

A theory of structural model validity in simulation.

During the last decennia, the practice of simulation has become increasingly popular among many system analysts, model builders and general scientists for the purpose of studying complex systems that surpass the operability of analytical solution techniques. As a consequence of the pragmatic orientation of simulation, a vital stage for a successful application is the issue of validating a constructed simulation model. Employing the model as an effective instrument for assessing the benefit of structural changes or for predicting future observations makes validation an essential part of any productive simulation study. The diversity of the employment field of simulation however brings about that there exists an irrefutable level of ambiguity concerning the principal subject of this validation process. Further, the literature has come up with a plethora of ad hoc validation techniques that have mostly been inherited from standard statistical analysis. It lies within the aim of this paper to reflect on the issue of validation in simulation and to present the reader with a topological parallelism of the classical philosophical polarity of objectivism versus relativism. First, we will position validation in relation to verification and accreditation and elaborate on the prime actors in validation, i.e. a conceptual model, a formal model and behaviour. Next, we will formally derive a topological interpretation of structural validation for both objectivists and relativists. As will be seen, recent advances in the domain of fuzzy topology allow for a valuable metaphor of a relativistic attitude towards modelling and structural validation. Finally, we will discuss several general types of modelling errors that may occur and examine their repercussion on the natural topological spaces of objectivists and relativists. We end this paper with a formal, topological oriented definition of structural model validity for both objectivists and relativists. The paper is concluded with summarising the most important findings and giving a direction for future research.Model; Simulation; Theory; Scientists; Processes; Statistical analysis;

Methodology for Designing Decision Support Systems for Visualising and Mitigating Supply Chain Cyber Risk from IoT Technologies

This paper proposes a methodology for designing decision support systems for visualising and mitigating the Internet of Things cyber risks. Digital technologies present new cyber risk in the supply chain which are often not visible to companies participating in the supply chains. This study investigates how the Internet of Things cyber risks can be visualised and mitigated in the process of designing business and supply chain strategies. The emerging DSS methodology present new findings on how digital technologies affect business and supply chain systems. Through epistemological analysis, the article derives with a decision support system for visualising supply chain cyber risk from Internet of Things digital technologies. Such methods do not exist at present and this represents the first attempt to devise a decision support system that would enable practitioners to develop a step by step process for visualising, assessing and mitigating the emerging cyber risk from IoT technologies on shared infrastructure in legacy supply chain systems

Does Empirical Embeddedness Matter? Methodological Issues on Agent-Based Models for Analytical Social Science

The paper deals with the use of empirical data in social science agent-based models. Agent-based models are too often viewed just as highly abstract thought experiments conducted in artificial worlds, in which the purpose is to generate and not to test theoretical hypotheses in an empirical way. On the contrary, they should be viewed as models that need to be embedded into empirical data both to allow the calibration and the validation of their findings. As a consequence, the search for strategies to find and extract data from reality, and integrate agent-based models with other traditional empirical social science methods, such as qualitative, quantitative, experimental and participatory methods, becomes a fundamental step of the modelling process. The paper argues that the characteristics of the empirical target matter. According to characteristics of the target, ABMs can be differentiated into case-based models, typifications and theoretical abstractions. These differences pose different challenges for empirical data gathering, and imply the use of different validation strategies.Agent-Based Models, Empirical Calibration and Validation, Taxanomy of Models

A Minimalist Epistemology for Agent-Based Simulations in the Artificial Sciences

The epistemology of computer simulations has become a mainstream topic in the philosophy of technology. Within this large area, significant differences hold between the various types of models and simulation technologies. Agent-based and multi-agent systems simulations introduce a specific constraint on the types of agents and systems modelled. We argue that such difference is crucial and that simulation for the artificial sciences requires the formulation of its own specific epistemological principles. We present a minimally committed epistemology which relies on the methodological principles of the Philosophy of Information and requires weak assumptions on the usability of the simulation and the controllability of the model. We use these principles to provide a new definition of simulation for the context of interest

Using agent based simulation to empirically examine complexity in carbon footprint business process

Through the critical analysis of the extant literature, it is observed that Simulation is widely used as a research method in Natural Sciences, Engineering and Social Sciences, in addition to argumentation and formalisation as the third way of carrying out research. Simulation is not so widely used in Business and Management research as it ought to have been, though this is changing for the better with the technological advances in computers and their computational power. These technological advances enhance the capability of theoretical research models, in defining a problem and their use in empirically examining a solution to the problem in simulated reality, like never before. Management journal searches for “Simulation and Complexity Theory” returned nil or zero returns, which explain that this combination is not popular in management research, though they are used individually more often. The major objective of this paper is to analyse some of the conceptual (or theoretical) and methodological (or empirical) contributions that Agent Based Simulation and Complexity Theory can make to the business and management community in their business process related research In view of this, some basic ideas are discussed of using Agent Based Simulation as a method in Business and Management Studies research and how an Agent Based Model can be applied to a business process as complex as Carbon Footprint. It is in this context that the use of Complexity as the base theory to empirically examine a business process is discussed. Throughout this article, our research on complex adaptive systems (e.g., Accounting Information System) in continuously changing organisations managing complex business processes (e.g., Carbon Footprint business process) is considered as the basis for illustrating some of the concepts. Through this article, avenues for further management research using these tools and methodology are suggested

How the Conception of Knowledge Influences Our Educational Practices: Toward a Philosophical Understanding of Epistemology in Education

This paper explores how the conception and valuation of the knowledge within our educational practices determines the planning, writing, and implementation of the curriculum. There is a pressing need for educators to philosophically and systematically understand the relationship between the foundational epistemological beliefs that ground a curriculum and its relationship to forming the notions of competency, pedagogy, and the methods for evaluating and assessing student progress. These issues are not only relevant, but crucial when attempting to justify a particular conception of education, which relates directly to the student\u27s potential for intellectual growth and social development. It may be argued that the comprehensive theory of curriculum planning manifests the intersection of philosophical critique, social inquiry, and psychological theory, and the author believes that bringing philosophy, and a formal methodology, to bear on the problems of education represents an instance where philosophy might contribute in a direct manner to the active and ongoing process of current educational reform