Review of trends and targets of complex systems for power system optimization

Optimization systems (OSs) allow operators of electrical power systems (PS) to optimally operate PSs and to also create optimal PS development plans. The inclusion of OSs in the PS is a big trend nowadays, and the demand for PS optimization tools and PS-OSs experts is growing. The aim of this review is to define the current dynamics and trends in PS optimization research and to present several papers that clearly and comprehensively describe PS OSs with characteristics corresponding to the identified current main trends in this research area. The current dynamics and trends of the research area were defined on the basis of the results of an analysis of the database of 255 PS-OS-presenting papers published from December 2015 to July 2019. Eleven main characteristics of the current PS OSs were identified. The results of the statistical analyses give four characteristics of PS OSs which are currently the most frequently presented in research papers: OSs for minimizing the price of electricity/OSs reducing PS operation costs, OSs for optimizing the operation of renewable energy sources, OSs for regulating the power consumption during the optimization process, and OSs for regulating the energy storage systems operation during the optimization process. Finally, individual identified characteristics of the current PS OSs are briefly described. In the analysis, all PS OSs presented in the observed time period were analyzed regardless of the part of the PS for which the operation was optimized by the PS OS, the voltage level of the optimized PS part, or the optimization goal of the PS OS.Web of Science135art. no. 107

Multi-Microgrid Collaborative Optimization Scheduling Using an Improved Multi-Agent Soft Actor-Critic Algorithm

The implementation of a multi-microgrid (MMG) system with multiple renewable energy sources enables the facilitation of electricity trading. To tackle the energy management problem of a MMG system, which consists of multiple renewable energy microgrids belonging to different operating entities, this paper proposes a MMG collaborative optimization scheduling model based on a multi-agent centralized training distributed execution framework. To enhance the generalization ability of dealing with various uncertainties, we also propose an improved multi-agent soft actor-critic (MASAC) algorithm, which facilitates en-ergy transactions between multi-agents in MMG, and employs automated machine learning (AutoML) to optimize the MASAC hyperparameters to further improve the generalization of deep reinforcement learning (DRL). The test results demonstrate that the proposed method successfully achieves power complementarity between different entities, and reduces the MMG system operating cost. Additionally, the proposal significantly outperforms other state-of-the-art reinforcement learning algorithms with better economy and higher calculation efficiency.Comment: Accepted by Energie

Transforming Energy Networks via Peer to Peer Energy Trading: Potential of Game Theoretic Approaches

Peer-to-peer (P2P) energy trading has emerged as a next-generation energy management mechanism for the smart grid that enables each prosumer of the network to participate in energy trading with one another and the grid. This poses a significant challenge in terms of modeling the decision-making process of each participant with conflicting interest and motivating prosumers to participate in energy trading and to cooperate, if necessary, for achieving different energy management goals. Therefore, such decision-making process needs to be built on solid mathematical and signal processing tools that can ensure an efficient operation of the smart grid. This paper provides an overview of the use of game theoretic approaches for P2P energy trading as a feasible and effective means of energy management. As such, we discuss various games and auction theoretic approaches by following a systematic classification to provide information on the importance of game theory for smart energy research. Then, the paper focuses on the P2P energy trading describing its key features and giving an introduction to an existing P2P testbed. Further, the paper zooms into the detail of some specific game and auction theoretic models that have recently been used in P2P energy trading and discusses some important finding of these schemes.Comment: 38 pages, single column, double spac

Battery Management System for Future Electric Vehicles

The future of electric vehicles relies nearly entirely on the design, monitoring, and control of the vehicle battery and its associated systems. Along with an initial optimal design of the cell/pack-level structure, the runtime performance of the battery needs to be continuously monitored and optimized for a safe and reliable operation and prolonged life. Improved charging techniques need to be developed to protect and preserve the battery. The scope of this Special Issue is to address all the above issues by promoting innovative design concepts, modeling and state estimation techniques, charging/discharging management, and hybridization with other storage components

Optimal charging of electric vehicles in microgrids through discrete event optimization

In this paper, a discrete event approach is proposed for the optimal charging of electrical vehicles in microgrids. In particular, the considered system is characterized by renewable energy sources (RES), non-renewable energy sources, electrical storage, a connection to the external grid and a charging station for electric vehicles (EVs). The decision variables are relevant to the schedule of production plants, storage systems and EVs' charging. The objective function to be minimized is related to the cost of purchasing energy from the external grid, the use of nonrenewable energy sources and tardiness of customer's service. The proposed approach is applied to a real case study and it is shown that it allows to considerably reduce the dimension of the problem (and thus the computational time required) as compared to a discrete-time approach

Reinforcement Learning Based Cooperative P2P Energy Trading between DC Nanogrid Clusters with Wind and PV Energy Resources

In order to replace fossil fuels with the use of renewable energy resources, unbalanced resource production of intermittent wind and photovoltaic (PV) power is a critical issue for peer-to-peer (P2P) power trading. To resolve this problem, a reinforcement learning (RL) technique is introduced in this paper. For RL, graph convolutional network (GCN) and bi-directional long short-term memory (Bi-LSTM) network are jointly applied to P2P power trading between nanogrid clusters based on cooperative game theory. The flexible and reliable DC nanogrid is suitable to integrate renewable energy for distribution system. Each local nanogrid cluster takes the position of prosumer, focusing on power production and consumption simultaneously. For the power management of nanogrid clusters, multi-objective optimization is applied to each local nanogrid cluster with the Internet of Things (IoT) technology. Charging/discharging of electric vehicle (EV) is performed considering the intermittent characteristics of wind and PV power production. RL algorithms, such as deep Q-learning network (DQN), deep recurrent Q-learning network (DRQN), Bi-DRQN, proximal policy optimization (PPO), GCN-DQN, GCN-DRQN, GCN-Bi-DRQN, and GCN-PPO, are used for simulations. Consequently, the cooperative P2P power trading system maximizes the profit utilizing the time of use (ToU) tariff-based electricity cost and system marginal price (SMP), and minimizes the amount of grid power consumption. Power management of nanogrid clusters with P2P power trading is simulated on the distribution test feeder in real-time and proposed GCN-PPO technique reduces the electricity cost of nanogrid clusters by 36.7%.Comment: 22 pages, 8 figures, to be submitted to Applied Energy of Elsevie

Self-organizing Coordination of Multi-Agent Microgrid Networks

abstract: This work introduces self-organizing techniques to reduce the complexity and burden of coordinating distributed energy resources (DERs) and microgrids that are rapidly increasing in scale globally. Technical and financial evaluations completed for power customers and for utilities identify how disruptions are occurring in conventional energy business models. Analyses completed for Chicago, Seattle, and Phoenix demonstrate site-specific and generalizable findings. Results indicate that net metering had a significant effect on the optimal amount of solar photovoltaics (PV) for households to install and how utilities could recover lost revenue through increasing energy rates or monthly fees. System-wide ramp rate requirements also increased as solar PV penetration increased. These issues are resolved using a generalizable, scalable transactive energy framework for microgrids to enable coordination and automation of DERs and microgrids to ensure cost effective use of energy for all stakeholders. This technique is demonstrated on a 3-node and 9-node network of microgrid nodes with various amounts of load, solar, and storage. Results found that enabling trading could achieve cost savings for all individual nodes and for the network up to 5.4%. Trading behaviors are expressed using an exponential valuation curve that quantifies the reputation of trading partners using historical interactions between nodes for compatibility, familiarity, and acceptance of trades. The same 9-node network configuration is used with varying levels of connectivity, resulting in up to 71% cost savings for individual nodes and up to 13% cost savings for the network as a whole. The effect of a trading fee is also explored to understand how electricity utilities may gain revenue from electricity traded directly between customers. If a utility imposed a trading fee to recoup lost revenue then trading is financially infeasible for agents, but could be feasible if only trying to recoup cost of distribution charges. These scientific findings conclude with a brief discussion of physical deployment opportunities.Dissertation/ThesisDoctoral Dissertation Systems Engineering 201

Integration of AC/DC Microgrids into Power Grids

AC/DC Microgrids are a small part of low voltage distribution networks that are located far from power substations, and are interconnected through the point of common coupling to power grids. These systems are important keys for the flexible, techno-economic, and environmental-friendly generation of units for the reliable operation and cost-effective planning of smart electricity grids. Although AC/DC microgrids, with the integration of renewable energy resources and other energy systems, such as power-to-gas, combined heat and power, combined cooling heat and power, power-to-heat, power-to-vehicle, pump and compressed air storage, have several advantages, there are some technical aspects that must be addressed. This Special Issue aims to study the configuration, impacts, and prospects of AC/DC microgrids that enable enhanced solutions for intelligent and optimized electricity systems, energy storage systems, and demand-side management in power grids with an increasing share of distributed energy resources. It includes AC/DC microgrid modeling, simulation, control, operation, protection, dynamics, planning, reliability and security, as well as considering power quality improvement, load forecasting, market operations, energy conversion, cyber/physical security, supervisory and monitoring, diagnostics and prognostics systems