AiD-EM: Adaptive Decision Support for Electricity Markets Negotiations

This paper presents the Adaptive Decision Support for Electricity Markets Negotiations (AiD-EM) system. AiD-EM is a multi-agent system that provides decision support to market players by incorporating multiple sub-(agent-based) systems, directed to the decision support of specific problems. These sub-systems make use of different artificial intelligence methodologies, such as machine learning and evolutionary computing, to enable players adaptation in the planning phase and in actual negotiations in auction-based markets and bilateral negotiations. AiD-EM demonstration is enabled by its connection to MASCEM (Multi-Agent Simulator of Competitive Electricity Markets).This work has received funding from the European Union's Horizon 2020 research and innovation programme under project DOMINOES (grant agreement No 771066) and from FEDER Funds through COMPETE program and from National Funds through FCT under the project UID/EEA/00760/2019info:eu-repo/semantics/publishedVersio

ALBidS: A Decision Support System for Strategic Bidding in Electricity Markets

This work demonstrates a system that provides decision support to players in electricity market negotiations. This contribution is provided by ALBidS (Adaptive Learning strategic Bidding System), a decision support system that includes a large number of distinct market negotiation strategies, and learns which should be used in each context in order to provide the best expected response. The learning process on the best negotiation strategies to use at each moment is developed by means of several integrated reinforcement learning algorithms. ALBidS is integrated with MASCEM (Multi-Agent Simulator of Competitive Electricity Markets), which enables the simulation of realistic market scenarios using real data.This work has been developed under the MAS-SOCIETY project - PTDC/EEI-EEE/28954/2017 and has received funding from UID/EEA/00760/2019, funded by FEDER Funds through COMPETE and by National Funds through FCT.info:eu-repo/semantics/publishedVersio

Demonstration of ALBidS: Adaptive Learning Strategic Bidding System

International Conference on Practical Applications of Agents and Multi-Agent SystemsCurrent worldwide electricity markets are strongly affected by the increasing use of renewable energy sources [1]. This increase has been stimulated by new energy policies that result from the growing concerns regarding the scarcity of fossil fuels and their impact in the environment. This has also led to an unavoidable restructuring of the power and energy sector, which was forced to adapt to the new paradigm [2]. The restructuring process resulted in a deep change in the operation of competitive electricity markets. The restructuring made the market more competitive, but also more complex, placing new challenges to the participants, which increases the difficulty of decision making. This is exacerbated by the increasing number of new market types that are being implemented to deal with the new challenges. Therefore, the intervenient entities are relentlessly forced to rethink their behaviour and market strategies in order to cope with such a constantly changing environment [2].This project has received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No 641794.info:eu-repo/semantics/publishedVersio

Multi-agent Electricity Markets and Smart Grids Simulation with Connection to Real Physical Resources

The increasing penetration of distributed energy sources, mainly based on renewable generation, calls for an urgent emergence of novel advanced methods to deal with the associated problems. The consensus behind smart grids (SGs) as one of the most promising solutions for the massive integration of renewable energy sources in power systems has led to the development of several prototypes that aim at testing and validating SG methodologies. The urgent need to accommodate such resources require alternative solutions. This chapter presents a multi-agent based SG simulation platform connected to physical resources, so that realistic scenarios can be simulated. The SG simulator is also connected to the Multi-Agent Simulator of Competitive Electricity Markets, which provides a solid framework for the simulation of electricity markets. The cooperation between the two simulation platforms provides huge studying opportunities under different perspectives, resulting in an important contribution to the fields of transactive energy, electricity markets, and SGs. A case study is presented, showing the potentialities for interaction between players of the two ecosystems: a SG operator, which manages the internal resources of a SG, is able to participate in electricity market negotiations to trade the necessary amounts of power to fulfill the needs of SG consumers.This work has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement N. 641794 (project DREAM-GO). It has also received FEDER Funds through the COMPETE program and National Funds through FCT under the project UID/EEA/00760/2013. The authors gratefully acknowledge the valuable contribution of Bruno Canizes, Daniel Paiva, Gabriel Santos and Marco Silva to the work presented in the chapter.info:eu-repo/semantics/publishedVersio

Applying real-time pricing for wind curtailment scenario using D2RD module of TOOCC

Multi-agent systems are widely used tools to simulate and study the energy sector because of their distributed architecture. There are several simulator tools available in literature, however, much of these prove to be very domain specific. The emergence of the Tools Control Center tool allows these simulators to cooperate in order to solve more comprehensive problems and more complex scenarios. This paper presents a module of this tool known as Demand Response Registration Digital, which allows the study of the model and programs of Demand Response. To understand the operation of this module, an example is given considering a wind curtailment scenario.The present work was done and funded in the scope of the following projects: H2020 DREAM-GO Project (Marie Sklodowska-Curie grant agreement No. 641794); and UID/EEA/00760/2019 and funded by FEDER Funds through COMPETE program and by National Funds through FCT.info:eu-repo/semantics/publishedVersio

MASCEM: Optimizing the performance of a multi-agent system

The electricity market sector has suffered massive changes in the last few decades. The worldwide electricity market restructuring has been conducted to potentiate the increase in competitiveness and thus decrease electricity prices. However, the complexity in this sector has grown significantly as well, with the emergence of several new types of players, interacting in a constantly changing environment. Several electricity market simulators have been introduced in recent years with the purpose of sup-porting operators, regulators, and the involved players in understanding and dealing with this complex environment. This paper presents a new, enhanced version of MASCEM (Multi-Agent System for Competitive Electricity Markets), an electricity market simulator with over ten years of existence, which had to be restructured in order to be able to face the highly demanding requirements that the decision support in this field requires. This restructuring optimizes the performance of MASCEM, both in results and execution time.info:eu-repo/semantics/publishedVersio

Practical Application of a Multi-Agent Systems Society for Energy Management and Control

Power and energy systems lack decision-support systems that enable studying big problems as a whole. The interoperability between multi-agent systems that address specific parts of the global problem is essential. Ontologies ease interoperability between heterogeneous systems providing semantic meaning to the information exchanged between the various parties. This paper presents the practical application of a society of multi-agent systems, which uses ontologies to enable the interoperability between different types of agent-based simulators, directed to the simulation and operation of electricity markets, smart grids and residential energy management. Real data-based demonstration shows the proposed approach advantages in enabling comprehensive, autonomous and intelligent power system simulation studies.This work has been developed under the MAS-SOCIETY project - PTDC/EEI-EEE/28954/2017 and has received funding from UID/EEA/00760/2019, funded by FEDER Funds through COMPETE and by National Funds through FCTinfo:eu-repo/semantics/publishedVersio

Multi-Agent Decision Support Tool to Enable Interoperability among Heterogeneous Energy Systems

Worldwide electricity markets are undergoing a major restructuring process. One of the main reasons for the ongoing changes is to enable the adaptation of current market models to the new paradigm that arises from the large-scale integration of distributed generation sources. In order to deal with the unpredictability caused by the intermittent nature of the distributed generation and the large number of variables that contribute to the energy sector balance, it is extremely important to use simulation systems that are capable of dealing with the required complexity. This paper presents the Tools Control Center (TOOCC), a framework that allows the interoperability between heterogeneous energy and power simulation systems through the use of ontologies, allowing the simulation of scenarios with a high degree of complexity, through the cooperation of the individual capacities of each system. A case study based on real data is presented in order to demonstrate the interoperability capabilities of TOOCC. The simulation considers the energy management of a microgrid of a real university campus, from the perspective of the network manager and also of its consumers/producers, in a projection for a typical day of the winter of 2050.This work has been developed in the scope of the European Union's Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No. 641794 (project DREAM-GO); CONTEST project - SAICT-POL/23575/2016; and has also been supported by FEDER Funds through COMPETE program and from National Funds through FCT under the project UID/EEA/00760/2013.info:eu-repo/semantics/publishedVersio

Generation of realistic scenarios for multi-agent simulation of electricity markets

Most market operators provide daily data on several market processes, including the results of all market transactions. The use of such data by electricity market simulators is essential for simulations quality, enabling the modelling of market behaviour in a much more realistic and efficient way. RealScen (Realistic Scenarios Generator) is a tool that creates realistic scenarios according to the purpose of the simulation: representing reality as it is, or on a smaller scale but still as representative as possible. This paper presents a novel methodology that enables RealScen to collect real electricity markets information and using it to represent market participants, as well as modelling their characteristics and behaviours. This is done using data analysis combined with artificial intelligence. This paper analyses the way players' characteristics are modelled, particularly in their representation in a smaller scale, simplifying the simulation while maintaining the quality of results. A study is also conducted, comparing real electricity market values with the market results achieved using the generated scenarios. The conducted study shows that the scenarios can fully represent the reality, or approximate it through a reduced number of representative software agents. As a result, the proposed methodology enables RealScen to represent markets behaviour, allowing the study and understanding of the interactions between market entities, and the study of new markets by assuring the realism of simulations.info:eu-repo/semantics/publishedVersio

Ontologies for the Interoperability of Heterogeneous Multi-Agent Systems in the scope of Energy and Power Systems

Tesis por compendio de publicaciones[ES]El sector eléctrico, tradicionalmente dirigido por monopolios y poderosas empresas de servicios públicos, ha experimentado cambios significativos en las últimas décadas. Los avances más notables son una mayor penetración de las fuentes de energía renovable (RES por sus siglas en inglés) y la generación distribuida, que han llevado a la adopción del paradigma de las redes inteligentes (SG por sus siglas en inglés) y a la introducción de enfoques competitivos en los mercados de electricidad (EMs por sus siglas en inglés) mayoristas y algunos minoristas. Las SG emergieron rápidamente de un concepto ampliamente aceptado en la realidad. La intermitencia de las fuentes de energía renovable y su integración a gran escala plantea nuevas limitaciones y desafíos que afectan en gran medida las operaciones de los EMs. El desafiante entorno de los sistemas de potencia y energía (PES por sus siglas en inglés) refuerza la necesidad de estudiar, experimentar y validar operaciones e interacciones competitivas, dinámicas y complejas. En este contexto, la simulación, el apoyo a la toma de decisiones, y las herramientas de gestión inteligente, se vuelven imprescindibles para estudiar los diferentes mecanismos del mercado y las relaciones entre los actores involucrados. Para ello, la nueva generación de herramientas debe ser capaz de hacer frente a la rápida evolución de los PES, proporcionando a los participantes los medios adecuados para adaptarse, abordando nuevos modelos y limitaciones, y su compleja relación con los desarrollos tecnológicos y de negocios. Las plataformas basadas en múltiples agentes son particularmente adecuadas para analizar interacciones complejas en sistemas dinámicos, como PES, debido a su naturaleza distribuida e independiente. La descomposición de tareas complejas en asignaciones simples y la fácil inclusión de nuevos datos y modelos de negocio, restricciones, tipos de actores y operadores, y sus interacciones, son algunas de las principales ventajas de los enfoques basados en agentes. En este dominio, han surgido varias herramientas de modelado para simular, estudiar y resolver problemas de subdominios específicos de PES. Sin embargo, existe una limitación generalizada referida a la importante falta de interoperabilidad entre sistemas heterogéneos, que impide abordar el problema de manera global, considerando todas las interrelaciones relevantes existentes. Esto es esencial para que los jugadores puedan aprovechar al máximo las oportunidades en evolución. Por lo tanto, para lograr un marco tan completo aprovechando las herramientas existentes que permiten el estudio de partes específicas del problema global, se requiere la interoperabilidad entre estos sistemas. Las ontologías facilitan la interoperabilidad entre sistemas heterogéneos al dar un significado semántico a la información intercambiada entre las distintas partes. La ventaja radica en el hecho de que todos los involucrados en un dominio particular los conocen, comprenden y están de acuerdo con la conceptualización allí definida. Existen, en la literatura, varias propuestas para el uso de ontologías dentro de PES, fomentando su reutilización y extensión. Sin embargo, la mayoría de las ontologías se centran en un escenario de aplicación específico o en una abstracción de alto nivel de un subdominio de los PES. Además, existe una considerable heterogeneidad entre estos modelos, lo que complica su integración y adopción. Es fundamental desarrollar ontologías que representen distintas fuentes de conocimiento para facilitar las interacciones entre entidades de diferente naturaleza, promoviendo la interoperabilidad entre sistemas heterogéneos basados en agentes que permitan resolver problemas específicos de PES. Estas brechas motivan el desarrollo del trabajo de investigación de este doctorado, que surge para brindar una solución a la interoperabilidad de sistemas heterogéneos dentro de los PES. Las diversas aportaciones de este trabajo dan como resultado una sociedad de sistemas multi-agente (MAS por sus siglas en inglés) para la simulación, estudio, soporte de decisiones, operación y gestión inteligente de PES. Esta sociedad de MAS aborda los PES desde el EM mayorista hasta el SG y la eficiencia energética del consumidor, aprovechando las herramientas de simulación y apoyo a la toma de decisiones existentes, complementadas con las desarrolladas recientemente, asegurando la interoperabilidad entre ellas. Utiliza ontologías para la representación del conocimiento en un vocabulario común, lo que facilita la interoperabilidad entre los distintos sistemas. Además, el uso de ontologías y tecnologías de web semántica permite el desarrollo de herramientas agnósticas de modelos para una adaptación flexible a nuevas reglas y restricciones, promoviendo el razonamiento semántico para sistemas sensibles al contexto