Arena: A General Evaluation Platform and Building Toolkit for Multi-Agent Intelligence

Learning agents that are not only capable of taking tests, but also innovating is becoming a hot topic in AI. One of the most promising paths towards this vision is multi-agent learning, where agents act as the environment for each other, and improving each agent means proposing new problems for others. However, existing evaluation platforms are either not compatible with multi-agent settings, or limited to a specific game. That is, there is not yet a general evaluation platform for research on multi-agent intelligence. To this end, we introduce Arena, a general evaluation platform for multi-agent intelligence with 35 games of diverse logics and representations. Furthermore, multi-agent intelligence is still at the stage where many problems remain unexplored. Therefore, we provide a building toolkit for researchers to easily invent and build novel multi-agent problems from the provided game set based on a GUI-configurable social tree and five basic multi-agent reward schemes. Finally, we provide Python implementations of five state-of-the-art deep multi-agent reinforcement learning baselines. Along with the baseline implementations, we release a set of 100 best agents/teams that we can train with different training schemes for each game, as the base for evaluating agents with population performance. As such, the research community can perform comparisons under a stable and uniform standard. All the implementations and accompanied tutorials have been open-sourced for the community at https://sites.google.com/view/arena-unity/

Mean-Field-Type Games in Engineering

A mean-field-type game is a game in which the instantaneous payoffs and/or the state dynamics functions involve not only the state and the action profile but also the joint distributions of state-action pairs. This article presents some engineering applications of mean-field-type games including road traffic networks, multi-level building evacuation, millimeter wave wireless communications, distributed power networks, virus spread over networks, virtual machine resource management in cloud networks, synchronization of oscillators, energy-efficient buildings, online meeting and mobile crowdsensing.Comment: 84 pages, 24 figures, 183 references. to appear in AIMS 201

Embodied Evolution in Collective Robotics: A Review

This paper provides an overview of evolutionary robotics techniques applied to on-line distributed evolution for robot collectives -- namely, embodied evolution. It provides a definition of embodied evolution as well as a thorough description of the underlying concepts and mechanisms. The paper also presents a comprehensive summary of research published in the field since its inception (1999-2017), providing various perspectives to identify the major trends. In particular, we identify a shift from considering embodied evolution as a parallel search method within small robot collectives (fewer than 10 robots) to embodied evolution as an on-line distributed learning method for designing collective behaviours in swarm-like collectives. The paper concludes with a discussion of applications and open questions, providing a milestone for past and an inspiration for future research.Comment: 23 pages, 1 figure, 1 tabl

Density Game Analysis and Evolutionary Equilibrium of Supply Side Symbiosis Behavior of Green Building Considering the Market Carrying Capacity

The process of green building development involves not only the symbiotic changes on the numbers of green and traditional buildings, but also the game payment of the agents. On the basis of the symbiosis theory and evolutionary game theory, a symbiosis model of green building supply side is established, with the construction market carrying capacity considered. The evolutionary stable points and stability conditions of the symbiotic evolutionary model are analyzed and discussed

The need of standardization and the potential role of voluntary approaches: Issues and trends in Italian GCHP market

Despite the lack of specific incentives, Ground Coupled Heat Pumps (GCHP) installations are booming in Italy both in private and public sectors of the market. Such rapid growth entails an increasing concern for environmental and technical performances since no comprehensive regulation and reliable standards exist yet. By means of an investigation of sectoral opinion leaders and SWOT-based technique for building scenarios, this paper discusses potential schemes for balancing mandatory and voluntary requirements. The analysis suggests that standardization and voluntary schemes are perceived as effective tools to encourage the greening of Italian GCHP-SMEs in short-run while laying the foundations for evolving sustainable policies in the longer run. A potential scheme that has been simulated by reflecting the supply-side orientations of the market and that involves of process and product standards is discussed.

Governance of Environment-Enhancing Technical change - past experiences and suggestions for improvement

There is much talk about environmental policies being faulty. Past policies are being criticisedfor failing to achieve environmental goals (the environmentalist complaint), for being overlyexpensive (the industrialist complaint) and for failing to encourage innovation and dynamicefficiency (the complaint of economists dealing with innovation). This paper looks at theinnovation and technology adoption effects of past environmental policies. It finds indeed fewexamples of environmental policies that stimulated innovation. The common technologyresponse is the use of expensive end-of-pipe solutions and incremental process changesoffering limited environmental gains. This begs the question: why did the policies fail topromote more radical innovation and dynamic efficiency? One explanation—well-recognisedin the economic literature—is the capture of government policies by special interests. Thispaper offers a second explanation—based on innovation and technology adoption studies—which says that in order to have a decisive and socially beneficial influence policy instrumentsmust be fine-tuned to the circumstances in which sociotechnical change processes occur and tipthe balance. Within this alternative view, the starting point of government interventions is thecapabilities, interests, interdependencies and games of social actors around an environmentalproblem instead of the set of environmental policy instruments for achieving an environmentalgoal. The paper sees a need for government authorities to be explicitly concerned with technicalchange (rather than implicitly through a change in the economic frame conditions) and to beconcerned with institutional arrangements beyond the choice of policy instruments, and act as achange agent. This requires different roles for policy makers: that of a sponsor, planner,regulator, matchmaker, alignment actor and ‘creative game regulator’. The paper offers twoperspectives on environmental policy: an instrument one and a modulation one. The latter isespecially important for promoting innovation and bringing about radical change, somethingwhich is very difficult with traditional regulatory instruments. Instruments for promotingenvironment-enhancing technical change are appraised and suggestions are offered for thepurposes for which different policy instruments may be used in differing economic contexts.environmental economics ;

The Interaction between Parents and Children as a Relevant Dimension of Child Well Being. The Case of Italy

This paper aims at measuring the functionings of social interaction, a relevant dimension in the description and conceptualisation of child well being by using the capability approach. In this paper we deal with a special dimension of this capability that involves the capability of interaction between parents and child. We propose a fuzzy expert system to measure this capability. To apply the model we use a data set based on a matched data source of ISTAT (Italian National Statistical Office 1998) multipurpose survey on family and on children condition in Italy to recover information on children’s education, the socio-demographic structure of their families, child care provided by relatives and parents according to the type of activities in which the children are involved and Bank of Italy Survey on household income and wealth year 2000 (SHIW00). This is a first step of a more complex system allowing for a richer set of indicators on capabilities in order to measure child well being.Child Well Being, Fuzzy Expert System, Capabilities

On the Road to a Unified Market for Energy Efficiency: The Contribution of White Certificates Schemes

White certificates schemes mandate competing energy companies to promote energy efficiency with flexibility mechanisms, including the trading of energy savings. So far, stylized facts are lacking and outcomes are mainly country-specific. By comparing results of British, Italian and French experiences, we attempt to identify the core determinants of their performances. We show that (i) white certificates schemes are depicted in theoretical works as mandatory subsidies on energy efficiency goods recovered by an end-use energy tax, whereby white certificates exchanges are not a central feature; (ii) at current stages, existing schemes are cost-effective and economically efficient, with large discrepancies though; (iii) the hybrid subsidy-tax mechanism seems valid but conditional to cost pass through permissions; otherwise, obliged energy companies merely promote information on the “downstream” side (i.e. at the consumer level); (iv) although white certificates exchange between different types of actors involved can be important as in Italy, trade among obliged companies is negligible; instead, flexibility sustains vertical relationships between obliged parties and “upstream” partners (i.e. installers, energy service companies). In this respect, we support the view that white certificates schemes are a policy instrument of multi-functional nature (subsidisation, information, technology diffusion), whose static and dynamic efficiency depends upon the consistency between a proper definition of long-term energy savings, the appropriate cost-recovery permission and a fine coordination with other instruments. We finally propose a four stages deployment pattern, along which fragmented markets for energy efficient technologies get closer to create a unified market delivering energy efficiency as a homogeneous good.White Certificates Schemes, Static Efficiency, Dynamic Efficiency, Vertical Organisation, Policy Coordination