Deep Reinforcement Learning for Control of Microgrids: A Review

A microgrid is widely accepted as a prominent solution to enhance resilience and performance in distributed power systems. Microgrids are flexible for adding distributed energy resources in the ecosystem of the electrical networks. Control techniques are used to synchronize distributed energy resources (DERs) due to their turbulent nature. DERs including alternating current, direct current and hybrid load with storage systems have been used in microgrids quite frequently due to which controlling the flow of energy in microgrids have been complex task with traditional control approaches. Distributed as well central approach to apply control algorithms is well-known methods to regulate frequency and voltage in microgrids. Recently techniques based of artificial intelligence are being applied for the problems that arise in operation and control of latest generation microgrids and smart grids. Such techniques are categorized in machine learning and deep learning in broader terms. The objective of this research is to survey the latest strategies of control in microgrids using the deep reinforcement learning approach (DRL). Other techniques of artificial intelligence had already been reviewed extensively but the use of DRL has increased in the past couple of years. To bridge the gap for the researchers, this survey paper is being presented with a focus on only Microgrids control DRL techniques for voltage control and frequency regulation with distributed, cooperative and multi agent approaches are presented in this research

Advanced Control Architectures for Intelligent MicroGrids, Part I:Decentralized and Hierarchical Control

This paper presents a review of advanced control techniques for microgrids. This paper covers decentralized, distributed, and hierarchical control of grid-connected and islanded microgrids. At first, decentralized control techniques for microgrids are reviewed. Then, the recent developments in the stability analysis of decentralized controlled microgrids are discussed. Finally, hierarchical control for microgrids that mimic the behavior of the mains grid is reviewed

Secondary Frequency and Voltage Control of Islanded Microgrids via Distributed Averaging

In this work we present new distributed controllers for secondary frequency and voltage control in islanded microgrids. Inspired by techniques from cooperative control, the proposed controllers use localized information and nearest-neighbor communication to collectively perform secondary control actions. The frequency controller rapidly regulates the microgrid frequency to its nominal value while maintaining active power sharing among the distributed generators. Tuning of the voltage controller provides a simple and intuitive trade-off between the conflicting goals of voltage regulation and reactive power sharing. Our designs require no knowledge of the microgrid topology, impedances or loads. The distributed architecture allows for flexibility and redundancy, and eliminates the need for a central microgrid controller. We provide a voltage stability analysis and present extensive experimental results validating our designs, verifying robust performance under communication failure and during plug-and-play operation.Comment: Accepted for publication in IEEE Transactions on Industrial Electronic

Experimental test bench for testing DC microgrid control strategies

During the last decades the number of microgrids and their research have increased notably, as they offer a high versatility for the integration of distributed generation (DG) units and renewable energies. Among the different types of microgrids, dc systems are becoming more popular due to their advantages over conventional ac systems. However, their control techniques differ from the ones employed at ac networks, and depending on the device type-either generation, storage systems or loads-alternative control techniques need to be developed. Therefore, in this paper an experimental dc platform is developed with the aim of testing and evaluating these kind of control strategies. This test bench consists of a bidirectional four switch buck-boost converter together with a TMS320F28335 DSP for the implementation of the control strategy on each power converter. The proposed platform is suitable for integrating these systems at a 48 V dc bus and facilitates the evaluation of a wide range of control strategies as they are implemented in the Matlab/Simulink ® environment. In this case, the validation of the experimental platform has been carried out by implementing a virtual-impedance-based control technique. The experimental results included in the paper corroborate the suitability of the platform for the evaluation of control techniques for dc microgrids

A survey on modeling of microgrids - from fundamental physics to phasors and voltage sources

Microgrids have been identified as key components of modern electrical systems to facilitate the integration of renewable distributed generation units. Their analysis and controller design requires the development of advanced (typically model-based) techniques naturally posing an interesting challenge to the control community. Although there are widely accepted reduced order models to describe the dynamic behavior of microgrids, they are typically presented without details about the reduction procedure---hampering the understanding of the physical phenomena behind them. Preceded by an introduction to basic notions and definitions in power systems, the present survey reviews key characteristics and main components of a microgrid. We introduce the reader to the basic functionality of DC/AC inverters, as well as to standard operating modes and control schemes of inverter-interfaced power sources in microgrid applications. Based on this exposition and starting from fundamental physics, we present detailed dynamical models of the main microgrid components. Furthermore, we clearly state the underlying assumptions which lead to the standard reduced model with inverters represented by controllable voltage sources, as well as static network and load representations, hence, providing a complete modular model derivation of a three-phase inverter-based microgrid

Study of Distributed Controlling Techniques in Micro Grids

: Microgrids are moving from laboratory benches and pilot demonstration sites to commercial markets thanks to technological improvements, lower costs, proven track record and growing recognition of their benefits. They are used to improve the reliability and resilience of power grids, manage the addition of distributed clean energy resources such as wind and solar photovoltaic (PV), reduce fossil fuel emissions, and provide power in areas not supported by a centralized electrical system. The infrastructure is provided. This article presents the control techniques for DC micro-network, distributed control, and description of micro-grid systems

Overview of AC microgrid controls with inverter-interfaced generations

Distributed generation (DG) is one of the key components of the emerging microgrid concept that enables renewable energy integration in a distribution network. In DG unit operation, inverters play a vital role in interfacing energy sources with the grid utility. An effective interfacing can successfully be accomplished by operating inverters with effective control techniques. This paper reviews and categorises different control methods (voltage and primary) for improving microgrid power quality, stability and power sharing approaches. In addition, the specific characteristics of microgrids are summarised to distinguish from distribution network control. Moreover, various control approaches including inner-loop controls and primary controls are compared according to their relative advantages and disadvantages. Finally, future research trends for microgrid control are discussed pointing out the research opportunities. This review paper will be a good basis for researchers working in microgrids and for industry to implement the ongoing research improvement in real systems

System configuration, fault detection, location, isolation and restoration: a review on LVDC Microgrid protections

Low voltage direct current (LVDC) distribution has gained the significant interest of research due to the advancements in power conversion technologies. However, the use of converters has given rise to several technical issues regarding their protections and controls of such devices under faulty conditions. Post-fault behaviour of converter-fed LVDC system involves both active converter control and passive circuit transient of similar time scale, which makes the protection for LVDC distribution significantly different and more challenging than low voltage AC. These protection and operational issues have handicapped the practical applications of DC distribution. This paper presents state-of-the-art protection schemes developed for DC Microgrids. With a close look at practical limitations such as the dependency on modelling accuracy, requirement on communications and so forth, a comprehensive evaluation is carried out on those system approaches in terms of system configurations， fault detection, location, isolation and restoration