Deep Reinforcement Learning for Wind and Energy Storage Coordination in Wholesale Energy and Ancillary Service Markets

Global power systems are increasingly reliant on wind energy as a mitigation strategy for climate change. However, the variability of wind energy causes system reliability to erode, resulting in the wind being curtailed and, ultimately, leading to substantial economic losses for wind farm owners. Wind curtailment can be reduced using battery energy storage systems (BESS) that serve as onsite backup sources. Yet, this auxiliary role may significantly hamper the BESS's capacity to generate revenues from the electricity market, particularly in conducting energy arbitrage in the Spot market and providing frequency control ancillary services (FCAS) in the FCAS markets. Ideal BESS scheduling should effectively balance the BESS's role in absorbing onsite wind curtailment and trading in the electricity market, but it is difficult in practice because of the underlying coordination complexity and the stochastic nature of energy prices and wind generation. In this study, we investigate the bidding strategy of a wind-battery system co-located and participating simultaneously in both the Spot and Regulation FCAS markets. We propose a deep reinforcement learning (DRL)-based approach that decouples the market participation of the wind-battery system into two related Markov decision processes for each facility, enabling the BESS to absorb onsite wind curtailment while simultaneously bidding in the wholesale Spot and FCAS markets to maximize overall operational revenues. Using realistic wind farm data, we validated the coordinated bidding strategy for the wind-battery system and find that our strategy generates significantly higher revenue and responds better to wind curtailment compared to an optimization-based benchmark. Our results show that joint-market bidding can significantly improve the financial performance of wind-battery systems compared to individual market participation

Review of trends and targets of complex systems for power system optimization

Optimization systems (OSs) allow operators of electrical power systems (PS) to optimally operate PSs and to also create optimal PS development plans. The inclusion of OSs in the PS is a big trend nowadays, and the demand for PS optimization tools and PS-OSs experts is growing. The aim of this review is to define the current dynamics and trends in PS optimization research and to present several papers that clearly and comprehensively describe PS OSs with characteristics corresponding to the identified current main trends in this research area. The current dynamics and trends of the research area were defined on the basis of the results of an analysis of the database of 255 PS-OS-presenting papers published from December 2015 to July 2019. Eleven main characteristics of the current PS OSs were identified. The results of the statistical analyses give four characteristics of PS OSs which are currently the most frequently presented in research papers: OSs for minimizing the price of electricity/OSs reducing PS operation costs, OSs for optimizing the operation of renewable energy sources, OSs for regulating the power consumption during the optimization process, and OSs for regulating the energy storage systems operation during the optimization process. Finally, individual identified characteristics of the current PS OSs are briefly described. In the analysis, all PS OSs presented in the observed time period were analyzed regardless of the part of the PS for which the operation was optimized by the PS OS, the voltage level of the optimized PS part, or the optimization goal of the PS OS.Web of Science135art. no. 107

Operational planning and bidding for district heating systems with uncertain renewable energy production

In countries with an extended use of district heating (DH), the integrated operation of DH and power systems can increase the flexibility of the power system achieving a higher integration of renewable energy sources (RES). DH operators can not only provide flexibility to the power system by acting on the electricity market, but also profit from the situation to lower the overall system cost. However, the operational planning and bidding includes several uncertain components at the time of planning: electricity prices as well as heat and power production from RES. In this publication, we propose a planning method that supports DH operators by scheduling the production and creating bids for the day-ahead and balancing electricity markets. The method is based on stochastic programming and extends bidding strategies for virtual power plants to the DH application. The uncertain factors are considered explicitly through scenario generation. We apply our solution approach to a real case study in Denmark and perform an extensive analysis of the production and trading behaviour of the DH system. The analysis provides insights on how DH system can provide regulating power as well as the impact of uncertainties and renewable sources on the planning. Furthermore, the case study shows the benefit in terms of cost reductions from considering a portfolio of units and both markets to adapt to RES production and market states

Power systems with high renewable energy sources: A review of inertia and frequency control strategies over time

Traditionally, inertia in power systems has been determined by considering all the rotating masses directly connected to the grid. During the last decade, the integration of renewable energy sources, mainly photovoltaic installations and wind power plants, has led to a significant dynamic characteristic change in power systems. This change is mainly due to the fact that most renewables have power electronics at the grid interface. The overall impact on stability and reliability analysis of power systems is very significant. The power systems become more dynamic and require a new set of strategies modifying traditional generation control algorithms. Indeed, renewable generation units are decoupled from the grid by electronic converters, decreasing the overall inertia of the grid. ‘Hidden inertia’, ‘synthetic inertia’ or ‘virtual inertia’ are terms currently used to represent artificial inertia created by converter control of the renewable sources. Alternative spinning reserves are then needed in the new power system with high penetration renewables, where the lack of rotating masses directly connected to the grid must be emulated to maintain an acceptable power system reliability. This paper reviews the inertia concept in terms of values and their evolution in the last decades, as well as the damping factor values. A comparison of the rotational grid inertia for traditional and current averaged generation mix scenarios is also carried out. In addition, an extensive discussion on wind and photovoltaic power plants and their contributions to inertia in terms of frequency control strategies is included in the paper.This work was supported by the Spanish Education, Culture and Sports Ministry [FPU16/04282]

Ocean Energy in Belgium - 2019

B

Control and Communication Protocols that Enable Smart Building Microgrids

Recent communication, computation, and technology advances coupled with climate change concerns have transformed the near future prospects of electricity transmission, and, more notably, distribution systems and microgrids. Distributed resources (wind and solar generation, combined heat and power) and flexible loads (storage, computing, EV, HVAC) make it imperative to increase investment and improve operational efficiency. Commercial and residential buildings, being the largest energy consumption group among flexible loads in microgrids, have the largest potential and flexibility to provide demand side management. Recent advances in networked systems and the anticipated breakthroughs of the Internet of Things will enable significant advances in demand response capabilities of intelligent load network of power-consuming devices such as HVAC components, water heaters, and buildings. In this paper, a new operating framework, called packetized direct load control (PDLC), is proposed based on the notion of quantization of energy demand. This control protocol is built on top of two communication protocols that carry either complete or binary information regarding the operation status of the appliances. We discuss the optimal demand side operation for both protocols and analytically derive the performance differences between the protocols. We propose an optimal reservation strategy for traditional and renewable energy for the PDLC in both day-ahead and real time markets. In the end we discuss the fundamental trade-off between achieving controllability and endowing flexibility