Review of distributed control and optimization in energy internet: From traditional methods to artificial intelligence-based methods

Abstract: Energy internet (EI) can alleviate the arduous challenges brought about by the energy crisis and global warming and has aroused the concern of many scholars. In the research of EI control systems, the access of distributed energy causes the power system to exhibit complex nonlinearity, high uncertainty and strong coupling. Traditional control and optimization methods often have limited effectiveness in solving these problems. With the widespread application of distributed control technology and the maturity of artificial intelligence (AI) technology, the combination of distributed control and AI has become an effective method to break through current research bottlenecks. This study reviews the research progress of EI distributed control technologies based on AI in recent years. It can be found that AI‐based distributed control methods have many advantages in maintaining EI stability and achieving optimal energy management. This combination of AI and distributed control makes EI control systems more intelligent, safe and efficient, which will be an important direction for future research. The purpose of this study is to provide a reference as well as useful research ideas for the study of EI control systems

Ant lion optimizer for solving optimal reactive power dispatch problem in power systems

Publicatio

A Review on Multi-Agent Technology in Micro-Grid Control

Micro-Grid (MG) integrates renewable generation, storage devices and controllable generations, it provides efficent utilization of clean energy while keeping stable external characteristics. Capability of continuous power supply, high scalability and flexible operation modes can satifiy the current demand of joint operation of renewable generation and Macro-Grid, and will provide a solid foundation for smart grid technology in the future. Thus, MG is an excellent integration of renewable energy utilization with a bright future, Multi-Agent System (MAS) is a new hierarchical control platform and can completely cover all the devices within a MG, its flexible control modes meet the needs of various operations of MG, and the capability of distributed computing supports intelligent functions of MG in the future. Therefore, developing premium functions for MAS in MG control will promote the development of both MG and Smart Grid technologies. This paper reviews the current applications of MAS technology for MG both in basic and advanced control demands. For basic demands concerning safe operations for MG, functions of MAS are available, but a further improvement of performance is essential for future researches to increase penetration of MAS in MG control; For advanced demands, MAS should increase calculation speed to meet the complex need of MG. In the last part, the future focuses are also depicted

Reduction of Real Power Loss and Safeguarding of Voltage Constancy by Artificial Immune System Algorithm

In this paper, Artificial Immune System (AIS) algorithm is used for solving reactive power problem. Artificial Immune System Algorithm, also termed as the machine learning approach to Artificial Intelligence, are powerful stochastic optimization techniques with potential features of random search, hill climbing, statistical sampling and competition. Artificial immune system algorithmic approach to power system optimization these ideas are embedded into proposed algorithm for solving reactive dispatch problem. In order to evaluate the proposed algorithm, it has been tested in standard IEEE 30,118 bus systems and compared to other specified algorithms. Simulation results show better performance of the proposed AIS algorithm in reducing the real power loss and preservation of voltage stability

Lenient multi-agent deep reinforcement learning

Much of the success of single agent deep reinforcement learning (DRL) in recent years can be attributed to the use of experience replay memories (ERM), which allow Deep Q-Networks (DQNs) to be trained efficiently through sampling stored state transitions. However, care is required when using ERMs for multi-agent deep reinforcement learning (MA-DRL), as stored transitions can become outdated because agents update their policies in parallel [11]. In this work we apply leniency [23] to MA-DRL. Lenient agents map state-action pairs to decaying temperature values that control the amount of leniency applied towards negative policy updates that are sampled from the ERM. This introduces optimism in the value-function update, and has been shown to facilitate cooperation in tabular fully-cooperative multi-agent reinforcement learning problems. We evaluate our Lenient-DQN (LDQN) empirically against the related Hysteretic-DQN (HDQN) algorithm [22] as well as a modified version we call scheduled-HDQN, that uses average reward learning near terminal states. Evaluations take place in extended variations of the Coordinated Multi-Agent Object Transportation Problem (CMOTP) [8] which include fully-cooperative sub-tasks and stochastic rewards. We find that LDQN agents are more likely to converge to the optimal policy in a stochastic reward CMOTP compared to standard and scheduled-HDQN agents

A Survey on Deep Learning Role in Distribution Automation System : A New Collaborative Learning-to-Learning (L2L) Concept

This paper focuses on a powerful and comprehensive overview of Deep Learning (DL) techniques on Distribution Automation System (DAS) applications to provide a complete viewpoint of modern power systems. DAS is a crucial approach to increasing the reliability, quality, and management of distribution networks. Due to the importance of development and sustainable security of DAS, the use of DL data-driven technology has grown significantly. DL techniques have blossomed rapidly, and have been widely applied in several fields of distribution systems. DL techniques are suitable for dynamic, decision-making, and uncertain environments such as DAS. This survey has provided a comprehensive review of the existing research into DL techniques on DAS applications, including fault detection and classification, load and energy forecasting, demand response, energy market forecasting, cyber security, network reconfiguration, and voltage control. Comparative results based on evaluation criteria are also addressed in this manuscript. According to the discussion and results of studies, the use and development of hybrid methods of DL with other methods to enhance and optimize the configuration of the techniques are highlighted. In all matters, hybrid structures accomplish better than single methods as hybrid approaches hold the benefit of several methods to construct a precise performance. Due to this, a new smart technique called Learning-to-learning (L2L) based DL is proposed that can enhance and improve the efficiency, reliability, and security of DAS. The proposed model follows several stages that link different DL algorithms to solve modern power system problems. To show the effectiveness and merit of the L2L based on the proposed framework, it has been tested on a modified reconfigurable IEEE 32 test system. This method has been implemented on several DAS applications that the results prove the decline of mean square errors by approximately 12% compared to conventional LSTM and GRU methods in terms of prediction fields.©2022 Authors. Published by IEEE. This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. For more information, see https://creativecommons.org/licenses/by-nc-nd/4.0/fi=vertaisarvioitu|en=peerReviewed