Spatial Validation of Agent-Based Models

This paper adapts an existing techno–social agent-based model (ABM) in order to develop a new framework for spatially validating ABMs. The ABM simulates citizen opposition to locally unwanted land uses, using historical data from an energy infrastructure siting process in Southern California. Spatial theory, as well as the model’s design, suggest that adequate validation requires multiple tests rather than relying solely on a single test-statistic. A pattern-oriented modeling approach was employed that first mapped real and simulated citizen comments across the US Census tract. The suite of spatial tests included Global Moran’s I, complemented with bivariate correlations, as well as the local indicators of spatial association (LISA) test. The global tests showed the model explained up to 65% of the variation in the historical data for US Census tract-level citizen comments on a locally unwanted land use. These global tests were also found helpful to inform the model’s calibration for the current application. The LISA results were even stronger, showing that the model predicted citizen comment clustering correctly in five of six Census tracts. It slightly over predicted comments further away from the land use. The LISA results and pattern-oriented modeling validation techniques identified theoretical factors to improve the modeling specification in future applications. The combined suite of validation techniques helped improve confidence in the model’s predictions

An empirical learning-based validation procedure for simulation workflow

Simulation workflow is a top-level model for the design and control of simulation process. It connects multiple simulation components with time and interaction restrictions to form a complete simulation system. Before the construction and evaluation of the component models, the validation of upper-layer simulation workflow is of the most importance in a simulation system. However, the methods especially for validating simulation workflow is very limit. Many of the existing validation techniques are domain-dependent with cumbersome questionnaire design and expert scoring. Therefore, this paper present an empirical learning-based validation procedure to implement a semi-automated evaluation for simulation workflow. First, representative features of general simulation workflow and their relations with validation indices are proposed. The calculation process of workflow credibility based on Analytic Hierarchy Process (AHP) is then introduced. In order to make full use of the historical data and implement more efficient validation, four learning algorithms, including back propagation neural network (BPNN), extreme learning machine (ELM), evolving new-neuron (eNFN) and fast incremental gaussian mixture model (FIGMN), are introduced for constructing the empirical relation between the workflow credibility and its features. A case study on a landing-process simulation workflow is established to test the feasibility of the proposed procedure. The experimental results also provide some useful overview of the state-of-the-art learning algorithms on the credibility evaluation of simulation models

Validation of agent-based land use model by Markovian model : application to forest-agriculture transitions in Madagascar

The determination of transition rules that farmers adopt to manage crop-fallow after forest clearing, is essential for deciding a sustainable strategy for forest conservation. The effect of the type of farms with respect to these transition rules in forest border may mitigate incentive measures planned by forest conservation policy. Agent-base modeling (ABM) of land use is a relevant approach to manage the dynamics of heterogeneous mosaic landscapes such as the border of the Malagasy Eastern rainforest. Transition rules between six land uses (forest, fallow, crop, grass, plantation and paddy ?eld) are formalized at a plot level. A historical database containing transitions between the ?rst four land use states was used to calibrate transition models for the ecological and farmer land use dynamics. Three land-use models have been built: (1) a Markov chain (stochastic), (2) a timed automaton (deterministic), (3) and an agent-based model, which introduces the farmers. The land use ABM allows to test scenarios of deforestation with both varying initial population and farm spatial organization, size or strategy. The land use ABM is ?rst calibrated via a timed automaton, ?tting time delay parameters, the duration of each land use state (fallow, crop, grass), and the number of cropping cycles since the ?rst forest clearing. It is then validated with the help of a Markovian model, comparing two transition matrices with ?2 metrics. The two transition matrices were respectively created with historical data of plot land use, and with simulated data produced by the land use ABM. We ?nish with a general discussion on the validation of such a complex system with a simple mathematical model. (Résumé d'auteur

Automated post-fault diagnosis of power system disturbances

In order to automate the analysis of SCADA and digital fault recorder (DFR) data for a transmission network operator in the UK, the authors have developed an industrial strength multi-agent system entitled protection engineering diagnostic agents (PEDA). The PEDA system integrates a number of legacy intelligent systems for analyzing power system data as autonomous intelligent agents. The integration achieved through multi-agent systems technology enhances the diagnostic support offered to engineers by focusing the analysis on the most pertinent DFR data based on the results of the analysis of SCADA. Since November 2004 the PEDA system has been operating online at a UK utility. In this paper the authors focus on the underlying intelligent system techniques, i.e. rule-based expert systems, model-based reasoning and state-of-the-art multi-agent system technology, that PEDA employs and the lessons learnt through its deployment and online use

A2-RL: Aesthetics Aware Reinforcement Learning for Image Cropping

Image cropping aims at improving the aesthetic quality of images by adjusting their composition. Most weakly supervised cropping methods (without bounding box supervision) rely on the sliding window mechanism. The sliding window mechanism requires fixed aspect ratios and limits the cropping region with arbitrary size. Moreover, the sliding window method usually produces tens of thousands of windows on the input image which is very time-consuming. Motivated by these challenges, we firstly formulate the aesthetic image cropping as a sequential decision-making process and propose a weakly supervised Aesthetics Aware Reinforcement Learning (A2-RL) framework to address this problem. Particularly, the proposed method develops an aesthetics aware reward function which especially benefits image cropping. Similar to human's decision making, we use a comprehensive state representation including both the current observation and the historical experience. We train the agent using the actor-critic architecture in an end-to-end manner. The agent is evaluated on several popular unseen cropping datasets. Experiment results show that our method achieves the state-of-the-art performance with much fewer candidate windows and much less time compared with previous weakly supervised methods.Comment: Accepted by CVPR 201

Empirical Validation of Agent Based Models: A Critical Survey

This paper addresses the problem of finding the appropriate method for conducting empirical validation in agent-based (AB) models, which is often regarded as the Achilles’ heel of the AB approach to economic modelling. The paper has two objectives. First, to identify key issues facing AB economists engaged in empirical validation. Second, to critically appraise the extent to which alternative approaches deal with these issues. We identify a first set of issues that are common to both AB and neoclassical modellers and a second set of issues which are specific to AB modellers. This second set of issues is captured in a novel taxonomy, which takes into consideration the nature of the object under study, the goal of the analysis, the nature of the modelling assumptions, and the methodology of the analysis. Having identified the nature and causes of heterogeneity in empirical validation, we examine three important approaches to validation that have been developed in AB economics: indirect calibration, the Werker-Brenner approach, and the history-friendly approach. We also discuss a set of open questions within empirical validation. These include the trade-off between empirical support and tractability of findings, the issue of over-parameterisation, unconditional objects, counterfactuals, and the non-neutrality of data.Empirical validation, agent-based models, calibration, history-friendly modelling