Coordination in Networks Formation: Experimental Evidence on Learning and Salience

We present experiments on repeated non-cooperative network formation games, based on Bala and Goyal (2000). We treat the one-way and the two-ways flow models, each for high and low link costs. The models show both multiple equilibria and coordination problems. We conduct experiments under various conditions which control for salient labeling and learning dynamics. Contrary to previous experiments, we find that coordination on non-empty Strict Nash equilibria is not an easy task for subjects to achieve, even in the mono-directional model where the Strict Nash equilibria is a wheel. We find that salience significantly helps coordination, but only when subjects are pre-instructed to think of the wheel network as a reasonable way to play the networking game. Evidence on learning behavior provides support for subjects choosing strategies consistent with various learning rules, which include as the main ones Reinforcement and Fictitious Play.Experiments, Networks, Behavioral game theory, Salience, Learning dynamics

Individual Differences in EWA Learning with Partial Payoff Information

We extend experience-weighted attraction (EWA) learning to games in which only the set of possible foregone payoffs from unchosen strategies are known, and estimate parameters separately for each player to study heterogeneity. We assume players estimate unknown foregone payoffs from a strategy, by substituting the last payoff actually received from that strategy, by clairvoyantly guessing the actual foregone payoff, or by averaging the set of possible foregone payoffs conditional on the actual outcomes. All three assumptions improve predictive accuracy of EWA. Individual parameter estimates suggest that players cluster into two separate subgroups (which differ from traditional reinforcement and belief learning)

UltraSwarm: A Further Step Towards a Flock of Miniature Helicopters

We describe further progress towards the development of a MAV (micro aerial vehicle) designed as an enabling tool to investigate aerial flocking. Our research focuses on the use of low cost off the shelf vehicles and sensors to enable fast prototyping and to reduce development costs. Details on the design of the embedded electronics and the modification of the chosen toy helicopter are presented, and the technique used for state estimation is described. The fusion of inertial data through an unscented Kalman filter is used to estimate the helicopter’s state, and this forms the main input to the control system. Since no detailed dynamic model of the helicopter in use is available, a method is proposed for automated system identification, and for subsequent controller design based on artificial evolution. Preliminary results obtained with a dynamic simulator of a helicopter are reported, along with some encouraging results for tackling the problem of flocking

A Review on the Application of Natural Computing in Environmental Informatics

Natural computing offers new opportunities to understand, model and analyze the complexity of the physical and human-created environment. This paper examines the application of natural computing in environmental informatics, by investigating related work in this research field. Various nature-inspired techniques are presented, which have been employed to solve different relevant problems. Advantages and disadvantages of these techniques are discussed, together with analysis of how natural computing is generally used in environmental research.Comment: Proc. of EnviroInfo 201

The innovation system vs. cluster process: common contributive elements towards regional development

Recent approaches to the study of innovations enhance some similar aspects of the innovation process in knowledge-based economies: (i) the systemic and interrelated nature of innovation and (ii) its geographic and inter-economic activities density of networking. One perspective is linked to the innovation systems approach at the national, regional and local level. What we know so far is that the most specialized forms of knowledge are becoming a short lived resource, in face of the (increasingly) fast changes that are occurring in the global economy; it’s the ability to learn permanently and to adapt to this fast changing scenario that determines the innovative performance of firms, regions and countries. Another approach is to be found in the research on cluster development, where proximity and interrelated technical/technological linkage are the main features to take under consideration. Although these two approaches operate at slightly different spatial scale of analysis, they both allow the identification of a set of key factors that contribute to understand the way in which institutions and actors, considering the innovation system or the cluster process, participate in the innovation atmosphere and in the economic growth. Nevertheless, both approaches show the same limitation: they tend to focalise into the descriptive and analytical level, disregarding the explanatory level. Local and regional authorities are, mainly, interested in the process of cluster intensification in the local and regional economies context. This feature stress out one other controversy level: are the “hard” location factors (the concrete tangible location factors) more important than the “soft” location factors (qualitative, intangible factors) or vice-versa? This paper aims to explore the current knowledge about this process and to open some fields of future research.

Cost Efficient Distributed Load Frequency Control in Power Systems

The introduction of new technologies and increased penetration of renewable resources is altering the power distribution landscape which now includes a larger numbers of micro-generators. The centralized strategies currently employed for performing frequency control in a cost efficient way need to be revisited and decentralized to conform with the increase of distributed generation in the grid. In this paper, the use of Multi-Agent and Multi-Objective Reinforcement Learning techniques to train models to perform cost efficient frequency control through decentralized decision making is proposed. More specifically, we cast the frequency control problem as a Markov Decision Process and propose the use of reward composition and action composition multi-objective techniques and compare the results between the two. Reward composition is achieved by increasing the dimensionality of the reward function, while action composition is achieved through linear combination of actions produced by multiple single objective models. The proposed framework is validated through comparing the observed dynamics with the acceptable limits enforced in the industry and the cost optimal setups

ACE Models of Endogenous Interactions

Various approaches used in Agent-based Computational Economics (ACE) to model endogenously determined interactions between agents are discussed. This concerns models in which agents not only (learn how to) play some (market or other) game, but also (learn to) decide with whom to do that (or not).Endogenous interaction, Agent-based Computational Economics (ACE)