Deep Reinforcement Learning for Control of Microgrids: A Review

A microgrid is widely accepted as a prominent solution to enhance resilience and performance in distributed power systems. Microgrids are flexible for adding distributed energy resources in the ecosystem of the electrical networks. Control techniques are used to synchronize distributed energy resources (DERs) due to their turbulent nature. DERs including alternating current, direct current and hybrid load with storage systems have been used in microgrids quite frequently due to which controlling the flow of energy in microgrids have been complex task with traditional control approaches. Distributed as well central approach to apply control algorithms is well-known methods to regulate frequency and voltage in microgrids. Recently techniques based of artificial intelligence are being applied for the problems that arise in operation and control of latest generation microgrids and smart grids. Such techniques are categorized in machine learning and deep learning in broader terms. The objective of this research is to survey the latest strategies of control in microgrids using the deep reinforcement learning approach (DRL). Other techniques of artificial intelligence had already been reviewed extensively but the use of DRL has increased in the past couple of years. To bridge the gap for the researchers, this survey paper is being presented with a focus on only Microgrids control DRL techniques for voltage control and frequency regulation with distributed, cooperative and multi agent approaches are presented in this research

Coordinated Optimal Voltage Control in Distribution Networks with Data-Driven Methods

Voltage control is facing significant challenges with the increasing integration of photovoltaic (PV) systems and electric vehicles (EVs) in active distribution networks. This is leading to major transformations of control schemes that require more sophisticated coordination between different voltage regulation devices in different timescales. Except for conventional Volt/Var control (VVC) devices such on-load tap change (OLTC) and capacitor banks (CBs), inverter-based PVs are encouraged to participate in voltage regulation considering their flexible reactive power regulation capability. With the vehicle to grid (V2G) technology and inverter-based interface at charging stations, the charging power of an EV can be also controlled to support voltages. These emerging technologies facilitate the development of two-stage coordinated optimal voltage control schemes. However, these new control schemes pursue a fast response speed with local control strategies in shorter snapshots, which fails to track the optimal solutions for the distribution system operation. The voltage control methods mainly aim to mitigate voltage violations and reduce network power loss, but they seldom focus on satisfying the various requirements of PV and EV customers. This may discourage customer-owned resources from participating in ancillary services such as voltage regulation. Moreover, model-based voltage control methods highly rely on the accurate knowledge of power system models and parameters, which is sometimes difficult to obtain in real-life distribution networks. The goal of this thesis is to propose a data-driven two-stage voltage control framework to fill the research gaps mentioned above, showing what frameworks, models and solution methods can be used in the optimal voltage control of modern active distribution systems to tackle the security and economic challenges posed by high integration of PVs and EVs