Multi-agent Electricity Markets and Smart Grids Simulation with Connection to Real Physical Resources

The increasing penetration of distributed energy sources, mainly based on renewable generation, calls for an urgent emergence of novel advanced methods to deal with the associated problems. The consensus behind smart grids (SGs) as one of the most promising solutions for the massive integration of renewable energy sources in power systems has led to the development of several prototypes that aim at testing and validating SG methodologies. The urgent need to accommodate such resources require alternative solutions. This chapter presents a multi-agent based SG simulation platform connected to physical resources, so that realistic scenarios can be simulated. The SG simulator is also connected to the Multi-Agent Simulator of Competitive Electricity Markets, which provides a solid framework for the simulation of electricity markets. The cooperation between the two simulation platforms provides huge studying opportunities under different perspectives, resulting in an important contribution to the fields of transactive energy, electricity markets, and SGs. A case study is presented, showing the potentialities for interaction between players of the two ecosystems: a SG operator, which manages the internal resources of a SG, is able to participate in electricity market negotiations to trade the necessary amounts of power to fulfill the needs of SG consumers.This work has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement N. 641794 (project DREAM-GO). It has also received FEDER Funds through the COMPETE program and National Funds through FCT under the project UID/EEA/00760/2013. The authors gratefully acknowledge the valuable contribution of Bruno Canizes, Daniel Paiva, Gabriel Santos and Marco Silva to the work presented in the chapter.info:eu-repo/semantics/publishedVersio

ALBidS: A Decision Support System for Strategic Bidding in Electricity Markets

This work demonstrates a system that provides decision support to players in electricity market negotiations. This contribution is provided by ALBidS (Adaptive Learning strategic Bidding System), a decision support system that includes a large number of distinct market negotiation strategies, and learns which should be used in each context in order to provide the best expected response. The learning process on the best negotiation strategies to use at each moment is developed by means of several integrated reinforcement learning algorithms. ALBidS is integrated with MASCEM (Multi-Agent Simulator of Competitive Electricity Markets), which enables the simulation of realistic market scenarios using real data.This work has been developed under the MAS-SOCIETY project - PTDC/EEI-EEE/28954/2017 and has received funding from UID/EEA/00760/2019, funded by FEDER Funds through COMPETE and by National Funds through FCT.info:eu-repo/semantics/publishedVersio

Agent-based simulation of electricity markets: a literature review

Liberalisation, climate policy and promotion of renewable energy are challenges to players of the electricity sector in many countries. Policy makers have to consider issues like market power, bounded rationality of players and the appearance of fluctuating energy sources in order to provide adequate legislation. Furthermore the interactions between markets and environmental policy instruments become an issue of increasing importance. A promising approach for the scientific analysis of these developments is the field of agent-based simulation. The goal of this article is to provide an overview of the current work applying this methodology to the analysis of electricity markets. --

Comparing policy gradient and value function based reinforcement learning methods in simulated electrical power trade

In electrical power engineering, reinforcement learning algorithms can be used to model the strategies of electricity market participants. However, traditional value function based reinforcement learning algorithms suffer from convergence issues when used with value function approximators. Function approximation is required in this domain to capture the characteristics of the complex and continuous multivariate problem space. The contribution of this paper is the comparison of policy gradient reinforcement learning methods, using artificial neural networks for policy function approximation, with traditional value function based methods in simulations of electricity trade. The methods are compared using an AC optimal power flow based power exchange auction market model and a reference electric power system model

Testing the Reliability of FERC's Wholesale Power Market Platform: An Agent-Based Computational Economics Approach

In April 2003 the U.S. Federal Energy Regulatory Commission (FERC) proposed the Wholesale Power Market Platform (WPMP) for common adoption by U.S. wholesale power markets. The WPMP is a complicated market design that has been adopted in some regions of the U.S. but resisted in others on the grounds that its reliability has not yet been sufficiently tested. This article reports on the development of an agent-based computational framework for exploring the economic reliability of the WPMP. The key issue under study is the extent to which the WPMP is capable of sustaining efficient, orderly, and fair market outcomes over time despite attempts by market participants to gain advantage through strategic pricing, capacity withholding, and/or induced transmission congestion. Related work can be accessed at: http://www.econ.iastate.edu/tesfatsi/AMESMarketHome.htm

Using Hybrid Agent-Based Systems to Model Spatially-Influenced Retail Markets

One emerging area of agent-based modelling is retail markets; however, there are problems with modelling such systems. The vast size of such markets makes individual-level modelling, for example of customers, difficult and this is particularly true where the markets are spatially complex. There is an emerging recognition that the power of agent-based systems is enhanced when integrated with other AI-based and conventional approaches. The resulting hybrid models are powerful tools that combine the flexibility of the agent-based methodology with the strengths of more traditional modelling. Such combinations allow us to consider agent-based modelling of such large-scale and complex retail markets. In particular, this paper examines the application of a hybrid agent-based model to a retail petrol market. An agent model was constructed and experiments were conducted to determine whether the trends and patterns of the retail petrol market could be replicated. Consumer behaviour was incorporated by the inclusion of a spatial interaction (SI) model and a network component. The model is shown to reproduce the spatial patterns seen in the real market, as well as well known behaviours of the market such as the "rocket and feathers" effect. In addition the model was successful at predicting the long term profitability of individual retailers. The results show that agent-based modelling has the ability to improve on existing approaches to modelling retail markets.Agents, Spatial Interaction Model, Retail Markets, Networks

An automatic tool to Extract, Transform and Load data from real electricity markets

The study of Electricity Markets operation has been gaining an increasing importance in the last years, as result of the new challenges that the restructuring produced. Currently, lots of information concerning Electricity Markets is available, as market operators provide, after a period of confidentiality, data regarding market proposals and transactions. These data can be used as source of knowledge, to define realistic scenarios, essential for understanding and forecast Electricity Markets behaviour. The development of tools able to extract, transform, store and dynamically update data, is of great importance to go a step further into the comprehension of Electricity Markets and the behaviour of the involved entities. In this paper we present an adaptable tool capable of downloading, parsing and storing data from market operators’ websites, assuring actualization and reliability of stored data

AiD-EM: Adaptive Decision Support for Electricity Markets Negotiations

This paper presents the Adaptive Decision Support for Electricity Markets Negotiations (AiD-EM) system. AiD-EM is a multi-agent system that provides decision support to market players by incorporating multiple sub-(agent-based) systems, directed to the decision support of specific problems. These sub-systems make use of different artificial intelligence methodologies, such as machine learning and evolutionary computing, to enable players adaptation in the planning phase and in actual negotiations in auction-based markets and bilateral negotiations. AiD-EM demonstration is enabled by its connection to MASCEM (Multi-Agent Simulator of Competitive Electricity Markets).This work has received funding from the European Union's Horizon 2020 research and innovation programme under project DOMINOES (grant agreement No 771066) and from FEDER Funds through COMPETE program and from National Funds through FCT under the project UID/EEA/00760/2019info:eu-repo/semantics/publishedVersio

Demonstration of ALBidS: Adaptive Learning Strategic Bidding System

International Conference on Practical Applications of Agents and Multi-Agent SystemsCurrent worldwide electricity markets are strongly affected by the increasing use of renewable energy sources [1]. This increase has been stimulated by new energy policies that result from the growing concerns regarding the scarcity of fossil fuels and their impact in the environment. This has also led to an unavoidable restructuring of the power and energy sector, which was forced to adapt to the new paradigm [2]. The restructuring process resulted in a deep change in the operation of competitive electricity markets. The restructuring made the market more competitive, but also more complex, placing new challenges to the participants, which increases the difficulty of decision making. This is exacerbated by the increasing number of new market types that are being implemented to deal with the new challenges. Therefore, the intervenient entities are relentlessly forced to rethink their behaviour and market strategies in order to cope with such a constantly changing environment [2].This project has received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No 641794.info:eu-repo/semantics/publishedVersio