A Review of Platforms for the Development of Agent Systems

Agent-based computing is an active field of research with the goal of building autonomous software of hardware entities. This task is often facilitated by the use of dedicated, specialized frameworks. For almost thirty years, many such agent platforms have been developed. Meanwhile, some of them have been abandoned, others continue their development and new platforms are released. This paper presents a up-to-date review of the existing agent platforms and also a historical perspective of this domain. It aims to serve as a reference point for people interested in developing agent systems. This work details the main characteristics of the included agent platforms, together with links to specific projects where they have been used. It distinguishes between the active platforms and those no longer under development or with unclear status. It also classifies the agent platforms as general purpose ones, free or commercial, and specialized ones, which can be used for particular types of applications.Comment: 40 pages, 2 figures, 9 tables, 83 reference

A self-integration testbed for decentralized socio-technical systems

The Internet of Things (IoT) comes along with new challenges for experimenting, testing, and operating decentralized socio-technical systems at large-scale. In such systems, autonomous agents interact locally with their users, and remotely with other agents to make intelligent collective choices. Via these interactions they self-regulate the consumption and production of distributed (common) resources, e.g., self-management of traffic flows and power demand in Smart Cities. While such complex systems are often deployed and operated using centralized computing infrastructures, the socio-technical nature of these decentralized systems requires new value-sensitive design paradigms; empowering trust, transparency, and alignment with citizens’ social values, such as privacy preservation, autonomy, and fairness among citizens’ choices. Currently, instruments and tools to study such systems and guide the prototyping process from simulation, to live deployment, and ultimately to a robust operation of a high Technology Readiness Level (TRL) are missing, or not practical in this distributed socio-technical context. This paper bridges this gap by introducing a novel testbed architecture for decentralized socio-technical systems running on IoT. This new architecture is designed for a seamless reusability of (i) application-independent decentralized services by an IoT application, and (ii) different IoT applications by the same decentralized service. This dual self-integration promises IoT applications that are simpler to prototype, and can interoperate with decentralized services during runtime to self-integrate more complex functionality, e.g., data analytics, distributed artificial intelligence. Additionally, such integration provides stronger validation of IoT applications, and improves resource utilization, as computational resources are shared, thus cutting down deployment and operational costs. Pressure and crash tests during continuous operations of several weeks, with more than 80K network joining and leaving of agents, 2.4M parameter changes, and 100M communicated messages, confirm the robustness and practicality of the testbed architecture. This work promises new pathways for managing the prototyping and deployment complexity of decentralized socio-technical systems running on IoT, whose complexity has so far hindered the adoption of value-sensitive self-management approaches in Smart Cities

Control Architecture Modeling for Future Power Systems

Uncontrollable power generation, distributed energy resources, controllable demand, etc. are fundamental aspects of energy systems largely based on renewable energy supply. These technologies have in common that they contradict the conventional categories of electric power system operation. As their introduction has proceeded incrementally in the past, operation strategies of the power system could be adapted. For example much more wind power could be integrated than originally anticipated, largely due to the flexibility reserves already present in the power system, and the possibility of interregional electricity exchange. However, at the same time, it seems that the overall system design cannot keep up by simply adapting in response to changes, but that also new strategies have to be designed in anticipation. Changes to the electricity markets have been suggested to adapt to the limited predictability of wind power, and several new control strategies have been proposed, in particular to enable the control of distributed energy resources, including for example, distributed generation or electric vehicles. Market designs addressing the procurement of balancing resources are highly dependent on the operation strategies specifying the resource requirements. How should one decide which control strategy and market configuration is best for a future power system? Most research up to this point has addressed single isolated aspects of this design problem. Those of the ideas that fit with current markets and operation concepts are lucky; they can be evaluated on the present design. But how could they be evaluated on a potential future power system? Approaches are required that support the design and evaluation of power system operation and control in context of future energy scenarios. This work addresses this challenge, not by providing a universal solution, but by providing basic modeling methodology that enables better problem formulation and by suggesting an approach to addressing the general chicken/egg problem of planning and re-design of system operation and control. The dissertation first focuses on the development of models, diagrams, that support the conceptual design of control and operation strategies, where a central theme is the focus on modeling system goals and functions rather than system structure. The perspective is then shifted toward long-term energy scenarios and adaptation of power system operation, considering the integration of energy scenario models with the re-design of operation strategies. The main contributions in the first part are, firstly, by adaptation of an existing functional modeling approach called Multilevel Flow Modeling (MFM) to the power systems domain, identifying the means-ends composition of control levels and development of principles for the consistent modeling of control structures, a formalization of control-as-a-service; secondly, the formal mapping of fluctuating and controllable resources to a multi-scale and multi-stage representation of control and operation structures; and finally the application to some concrete study cases, including a present system balancing, and proposed control structures such as Microgrids and Cells. In the second part, the main contributions are the outline of a formation strategy, integrating the design and model-based evaluation of future power system operation concepts with iterative energy scenario development. Finally, a new modeling framework for development and evaluation of power system operation in context of energy-storage based power system balancing is introduced.<br/

On the interaction between Autonomous Mobility-on-Demand systems and the power network: models and coordination algorithms

We study the interaction between a fleet of electric, self-driving vehicles servicing on-demand transportation requests (referred to as Autonomous Mobility-on-Demand, or AMoD, system) and the electric power network. We propose a model that captures the coupling between the two systems stemming from the vehicles' charging requirements and captures time-varying customer demand and power generation costs, road congestion, battery depreciation, and power transmission and distribution constraints. We then leverage the model to jointly optimize the operation of both systems. We devise an algorithmic procedure to losslessly reduce the problem size by bundling customer requests, allowing it to be efficiently solved by off-the-shelf linear programming solvers. Next, we show that the socially optimal solution to the joint problem can be enforced as a general equilibrium, and we provide a dual decomposition algorithm that allows self-interested agents to compute the market clearing prices without sharing private information. We assess the performance of the mode by studying a hypothetical AMoD system in Dallas-Fort Worth and its impact on the Texas power network. Lack of coordination between the AMoD system and the power network can cause a 4.4% increase in the price of electricity in Dallas-Fort Worth; conversely, coordination between the AMoD system and the power network could reduce electricity expenditure compared to the case where no cars are present (despite the increased demand for electricity) and yield savings of up $147M/year. Finally, we provide a receding-horizon implementation and assess its performance with agent-based simulations. Collectively, the results of this paper provide a first-of-a-kind characterization of the interaction between electric-powered AMoD systems and the power network, and shed additional light on the economic and societal value of AMoD.Comment: Extended version of the paper presented at Robotics: Science and Systems XIV and accepted by TCNS. In Version 4, the body of the paper is largely rewritten for clarity and consistency, and new numerical simulations are presented. All source code is available (MIT) at https://dx.doi.org/10.5281/zenodo.324165

FACILITATING AQUATIC INVASIVE SPECIES MANAGEMENT USING SATELLITE REMOTE SENSING AND MACHINE LEARNING FRAMEWORKS

The urgent decision-making needs of invasive species managers can be better met by the integration of biodiversity big data with large-domain models and environmental data products in the form of new workflows and tools that facilitate data utilization across platforms. Timely risk assessments allow for the spatial prioritization of monitoring that could streamline invasive species management paradigms and invasive species’ ability to prevent irreversible damage, such that decision makers can focus surveillance and intervention efforts where they are likely to be most effective under budgetary and resource constraints. I present a workflow that generates rapid spatial risk assessments on aquatic invasive species by combining occurrence data, spatially explicit environmental data, and an ensemble approach to species distribution modeling using five machine learning algorithms. For proof of concept and validation, I tested this workflow using extensive spatial and temporal occurrence data from Rainbow Trout (RBT; Oncorhynchus mykiss) invasion in the upper Flathead River system in northwestern Montana, USA. Due to this workflow’s high performance against cross-validated datasets (87% accuracy) and congruence with known drivers of RBT invasion, I developed a tool that generates agile risk assessments based on the above workflow and suggest that it can be generalized to broader spatial and taxonomic scales in order to provide data-driven management information for early detection of potential invaders. I then use this tool as technical input for a management framework that provides guidance for users to incorporate and synthesize the component features of the workflow and toolkit to derive actionable insight in an efficient manner