Optimization of Electricity Markets Participation with Simulated Annealing

The electricity markets environment has changed completely with the introduction of renewable energy sources in the energy distribution systems. With such alterations, preventing the system from collapsing required the development of tools to avoid system failure. In this new market environment competitiveness increases, new and different power producers have emerged, each of them with different characteristics, although some are shared for all of them, such as the unpredictability. In order to battle the unpredictability, the power supplies of this nature are supported by techniques of artificial intelligence that enables them crucial information for participation in the energy markets. In electricity markets any player aims to get the best profit, but is necessary have knowledge of the future with a degree of confidence leading to possible build successful actions. With optimization techniques based on artificial intelligence it is possible to achieve results in considerable time so that producers are able to optimize their profits from the sale of Electricity. Nowadays, there are many optimization problems where there are no that cannot be solved with exact methods, or where deterministic methods are computationally too complex to implement. Heuristic optimization methods have, thus, become a promising solution. In this paper, a simulated annealing based approach is used to solve the portfolio optimization problem for multiple electricity markets participation. A case study based on real electricity markets data is presented, and the results using the proposed approach are compared to those achieved by a previous implementation using particle swarm optimization.This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No 641794info:eu-repo/semantics/publishedVersio

Initial Solution Heuristic for Portfolio Optimization of Electricity Markets Participation

Meta-heuristic search methods are used to find near optimal global solutions for difficult optimization problems. These meta-heuristic processes usually require some kind of knowledge to overcome the local optimum locations. One way to achieve diversification is to start the search procedure from a solution already obtained through another method. Since this solution is already validated the algorithm will converge easily to a greater global solution. In this work, several well-known meta-heuristics are used to solve the problem of electricity markets participation portfolio optimization. Their search performance is compared to the performance of a proposed hybrid method (ad-hoc heuristic to generate the initial solution, which is combined with the search method). The addressed problem is the portfolio optimization for energy markets participation, where there are different markets where it is possible to negotiate. In this way the result will be the optimal allocation of electricity in the different markets in order to obtain the maximum return quantified through the objective function.This work has received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No 641794 (project DREAM-GO) and from FEDER Funds through COMPETE program and from National Funds through FCT under the project UID/EEA/00760/2013.info:eu-repo/semantics/publishedVersio

Portfolio Optimization for Electricity Market Participation with NPSO-LRS

Massive changes in electricity markets have occurred during the last years, as a consequence of the massive introduction of renewable energies. These changes have led to a restructuring process that had an impact throughout the electrical industry. The case of the electricity markets is a relevant example, where new forms of trading emerged and new market entities were created. With these changes, the complexity of electricity markets increased as well, which brought out the need from the involved players for adequate support to their decision making process. Artificial intelligence plays an important role in the development of these tools. Multi-agent systems, in particular, have been largely explored by stakeholders in the sector. Artificial intelligence also provides intelligent solutions for optimization, which enable troubleshooting in a short time and with very similar results to those achieved by deterministic techniques, which usually result from very high execution times. The work presented in this paper aims at solving a portfolio optimization problem for electricity markets participation, using an approach based on NPSO-LRS (New Particle Swarm Optimization with Local Random Search). The proposed method is used to assist decisions of electricity market players.This work has received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No 641794 (project DREAM-GO) and from FEDER Funds through COMPETE program and from National Funds through FCT under the project UID/EEA/00760/2013info:eu-repo/semantics/publishedVersio

Hybrid approach based on particle swarm optimization for electricity markets participation

In many large-scale and time-consuming problems, the application of metaheuristics becomes essential, since these methods enable achieving very close solutions to the exact one in a much shorter time. In this work, we address the problem of portfolio optimization applied to electricity markets negotiation. As in a market environment, decision-making is carried out in very short times, the application of the metaheuristics is necessary. This work proposes a Hybrid model, combining a simplified exact resolution of the method, as a means to obtain the initial solution for a Particle Swarm Optimization (PSO) approach. Results show that the presented approach is able to obtain better results in the metaheuristic search process.This work has received funding from the European Union's Horizon 2020 research and innovation programme under project DOMINOES (grant agreement No 771066) and from FEDER Funds through COMPETE program and from National Funds through FCT under the project UID/EEA/00760/2019 and Ricardo Faia is supported by FCT Funds through and SFRH/BD/133086/2017 PhD scholarship.info:eu-repo/semantics/publishedVersio

Hybrid particle swarm optimization of electricity market participation portfolio

This paper proposes a novel hybrid particle swarm optimization methodology to solve the problem of optimal participation in multiple electricity markets. The decision time is usually very important when planning the participation in electricity markets. This environment is characterized by the time available to take action, since different electricity markets have specific rules, which requires participants to be able to adapt and plan their decisions in a short time. Using metaheuristic optimization, participants' time problems can be resolved, because these methods enable problems to be solved in a short time and with good results. This paper proposes a hybrid resolution method, which is based on the particle swarm optimization metaheuristic. An exact mathematical method, which solves a simplified, linearized, version of the problem, is used to generate the initial solution for the metaheuristic approach, with the objective of improving the quality of results without representing a significant increase of the execution time.This work has received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No 703689 (project ADAPT) and No 641794 (project DREAM-GO); NetEfficity Project (P2020 − 18015); and UID/EEA/00760/2013 funded by FEDER Funds through COMPETE pro-gram and by National Funds through FCT.info:eu-repo/semantics/publishedVersio

An Ad-Hoc Initial Solution Heuristic for Metaheuristic Optimization of Energy Market Participation Portfolios

The deregulation of the electricity sector has culminated in the introduction of competitive markets. In addition, the emergence of new forms of electric energy production, namely the production of renewable energy, has brought additional changes in electricity market operation. Renewable energy has significant advantages, but at the cost of an intermittent character. The generation variability adds new challenges for negotiating players, as they have to deal with a new level of uncertainty. In order to assist players in their decisions, decision support tools enabling assisting players in their negotiations are crucial. Artificial intelligence techniques play an important role in this decision support, as they can provide valuable results in rather small execution times, namely regarding the problem of optimizing the electricity markets participation portfolio. This paper proposes a heuristic method that provides an initial solution that allows metaheuristic techniques to improve their results through a good initialization of the optimization process. Results show that by using the proposed heuristic, multiple metaheuristic optimization methods are able to improve their solutions in a faster execution time, thus providing a valuable contribution for players support in energy markets negotiations.info:eu-repo/semantics/publishedVersio

Distributed learning of energy contracts negotiation strategies with collaborative reinforcement learning

The evolution of electricity markets towards local energy trading models, including peer-to-peer transactions, is bringing by multiple challenges for the involved players. In particular, small consumers, prosumers and generators, with no experience on participating in competitive energy markets, are not prepared for facing such an environment. This paper addresses this problem by proposing a decision support solution for small players negotiations in local transactions. The collaborative reinforcement learning concept is applied to combine different learning processes and reached an enhanced final decision for players actions in bilateral negotiations. The reinforcement learning process is based on the application of the Q-Learning algorithm; and the continuous combination of the different learning results applies and compares several collaborative learning algorithms, namely BEST-Q, Average (AVE)-Q; Particle Swarm Optimization (PSO)-Q, and Weighted Strategy Sharing (WSS)-Q and uses a model to aggregate these results. Results show that the collaborative learning process enables players' to correctly identify the negotiation strategy to apply in each moment, context and against each opponent.DOMINOES - Smart Distribution Grid: a Market Driven Approach for the Next Generation of Advanced Operation Models and Services (771066)info:eu-repo/semantics/publishedVersio

Initial Solution Heuristic for Portfolio Optimization of Electricity Markets Participation

Meta-heuristic search methods are used to find near optimal global solutions for difficult optimization problems. These meta-heuristic processes usually require some kind of knowledge to overcome the local optimum locations. One way to achieve diversification is to start the search procedure from a solution already obtained through another method. Since this solution is already validated the algorithm will converge easily to a greater global solution. In this work, several well-known meta-heuristics are used to solve the problem of electricity markets participation portfolio optimization. Their search performance is compared to the performance of a proposed hybrid method (ad-hoc heuristic to generate the initial solution, which is combined with the search method). The addressed problem is the portfolio optimization for energy markets participation, where there are different markets where it is possible to negotiate. In this way the result will be the optimal allocation of electricity in the different markets in order to obtain the maximum return quantified through the objective function.This work has received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No 641794 (project DREAM-GO) and from FEDER Funds through COMPETE program and from National Funds through FCT under the project UID/EEA/00760/2013.info:eu-repo/semantics/publishedVersio

Decision support for participation in electricity markets considering the transaction of services and electricity at the local level

[EN] The growing concerns regarding the lack of fossil fuels, their costs, and their impact on the environment have led governmental institutions to launch energy policies that promote the increasing installation of technologies that use renewable energy sources to generate energy. The increasing penetration of renewable energy sources brings a great fluctuation on the generation side, which strongly affects the power and energy system management. The control of this system is moving from hierarchical and central to a smart and distributed approach. The system operators are nowadays starting to consider the final end users (consumers and prosumers) as a part of the solution in power system operation activities. In this sense, the end-users are changing their behavior from passive to active players. The role of aggregators is essential in order to empower the end-users, also contributing to those behavior changes. Although in several countries aggregators are legally recognized as an entity of the power and energy system, its role being mainly centered on representing end-users in wholesale market participation. This work contributes to the advancement of the state-of-the-art with models that enable the active involvement of the end-users in electricity markets in order to become key participants in the management of power and energy systems. Aggregators are expected to play an essential role in these models, making the connection between the residential end-users, electricity markets, and network operators. Thus, this work focuses on providing solutions to a wide variety of challenges faced by aggregators. The main results of this work include the developed models to enable consumers and prosumers participation in electricity markets and power and energy systems management. The proposed decision support models consider demand-side management applications, local electricity market models, electricity portfolio management, and local ancillary services. The proposed models are validated through case studies based on real data. The used scenarios allow a comprehensive validation of the models from different perspectives, namely end-users, aggregators, and network operators. The considered case studies were carefully selected to demonstrate the characteristics of each model, and to demonstrate how each of them contributes to answering the research questions defined to this work.[ES] La creciente preocupación por la escasez de combustibles fósiles, sus costos y su impacto en el medio ambiente ha llevado a las instituciones gubernamentales a lanzar políticas energéticas que promuevan la creciente instalación de tecnologías que utilizan fuentes de energía renovables para generar energía. La creciente penetración de las fuentes de energía renovable trae consigo una gran fluctuación en el lado de la generación, lo que afecta fuertemente la gestión del sistema de potencia y energía. El control de este sistema está pasando de un enfoque jerárquico y central a un enfoque inteligente y distribuido. Actualmente, los operadores del sistema están comenzando a considerar a los usuarios finales (consumidores y prosumidores) como parte de la solución en las actividades de operación del sistema eléctrico. En este sentido, los usuarios finales están cambiando su comportamiento de jugadores pasivos a jugadores activos. El papel de los agregadores es esencial para empoderar a los usuarios finales, contribuyendo también a esos cambios de comportamiento. Aunque en varios países los agregadores están legalmente reconocidos como una entidad del sistema eléctrico y energético, su papel se centra principalmente en representar a los usuarios finales en la participación del mercado mayorista. Este trabajo contribuye al avance del estado del arte con modelos que permiten la participación activa de los usuarios finales en los mercados eléctricos para convertirse en participantes clave en la gestión de los sistemas de potencia y energía. Se espera que los agregadores desempeñen un papel esencial en estos modelos, haciendo la conexión entre los usuarios finales residenciales, los mercados de electricidad y los operadores de red. Por lo tanto, este trabajo se enfoca en brindar soluciones a una amplia variedad de desafíos que enfrentan los agregadores. Los principales resultados de este trabajo incluyen los modelos desarrollados para permitir la participación de los consumidores y prosumidores en los mercados eléctricos y la gestión de los sistemas de potencia y energía. Los modelos de soporte de decisiones propuestos consideran aplicaciones de gestión del lado de la demanda, modelos de mercado eléctrico local, gestión de cartera de electricidad y servicios auxiliares locales. Los modelos propuestos son validan mediante estudios de casos basados en datos reales. Los escenarios utilizados permiten una validación integral de los modelos desde diferentes perspectivas, a saber, usuarios finales, agregadores y operadores de red. Los casos de estudio considerados fueron cuidadosamente seleccionados para demostrar las características de cada modelo y demostrar cómo cada uno de ellos contribuye a responder las preguntas de investigación definidas para este trabajo

Artificial Intelligence and Machine Learning Approaches to Energy Demand-Side Response: A Systematic Review

Recent years have seen an increasing interest in Demand Response (DR) as a means to provide flexibility, and hence improve the reliability of energy systems in a cost-effective way. Yet, the high complexity of the tasks associated with DR, combined with their use of large-scale data and the frequent need for near real-time de-cisions, means that Artificial Intelligence (AI) and Machine Learning (ML) — a branch of AI — have recently emerged as key technologies for enabling demand-side response. AI methods can be used to tackle various challenges, ranging from selecting the optimal set of consumers to respond, learning their attributes and pref-erences, dynamic pricing, scheduling and control of devices, learning how to incentivise participants in the DR schemes and how to reward them in a fair and economically efficient way. This work provides an overview of AI methods utilised for DR applications, based on a systematic review of over 160 papers, 40 companies and commercial initiatives, and 21 large-scale projects. The papers are classified with regards to both the AI/ML algorithm(s) used and the application area in energy DR. Next, commercial initiatives are presented (including both start-ups and established companies) and large-scale innovation projects, where AI methods have been used for energy DR. The paper concludes with a discussion of advantages and potential limitations of reviewed AI techniques for different DR tasks, and outlines directions for future research in this fast-growing area