Deep reinforcement learning approach for MPPT control of partially shaded PV systems in Smart Grids

Photovoltaic systems (PV) are having an increased importance in modern smart grids systems. Usually, in order to maximize the energy output of the PV arrays a maximum power point tracking (MPPT) algorithm is used. However, once deployed, weather conditions such as clouds can cause shades in the PV arrays affecting the dynamics of each panel differently. These conditions directly affect the available energy output of the arrays and in turn make the MPPT task extremely difficult. For these reasons, under partial shading conditions, it is necessary to have algorithms that are able to learn and adapt online to the changing state of the system. In this work we propose the use of deep reinforcement learning (DRL) techniques to address the MPPT problem of a PV array under partial shading conditions. We develop a model free RL algorithm to maximize the efficiency in MPPT control. The agent's policy is parameterized by neural networks, which take the sensory information as input and directly output the control signal. Furthermore, a PV environment under shading conditions was developed in the open source OpenAI Gym platform and is made available in an open repository. Several tests are performed, using the developed simulated environment, to test the robustness of the proposed control strategies to different climate conditions. The obtained results show the feasibility of our proposal with a successful performance with fast responses and stable behaviors. The best results for the presented methodology show that the maximum operating power point achieved has a deviation less than 1% compared to the theoretical maximum power point.Fil: Avila, Luis Omar. Universidad Nacional de San Luis. Facultad de Ciencias Físico Matemáticas y Naturales. Departamento de Informática. Laboratorio Investigación y Desarrollo en Inteligencia Computacional; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: de Paula, Mariano. Universidad Nacional del Centro de la Provincia de Buenos Aires. Centro de Investigaciones en Física e Ingeniería del Centro de la Provincia de Buenos Aires. - Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Tandil. Centro de Investigaciones en Física e Ingeniería del Centro de la Provincia de Buenos Aires. - Provincia de Buenos Aires. Gobernación. Comisión de Investigaciones Científicas. Centro de Investigaciones en Física e Ingeniería del Centro de la Provincia de Buenos Aires; ArgentinaFil: Trimboli, Maximiliano Daniel. Universidad Nacional de San Luis. Facultad de Ingeniería y Ciencias Agropecuarias. Laboratorio de Control Automático; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Carlucho, Ignacio. State University of Louisiana; Estados Unidos. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentin

Particle swarm optimised fuzzy controller for charging–discharging and scheduling of battery energy storage system in MG applications

© 2020 The Authors Aiming at reducing the power consumption and costs of grids, this paper deals with the development of particle swarm optimisation (PSO) based fuzzy logic controller (FLC) for charging–discharging and scheduling of the battery energy storage systems (ESSs) in microgrid (MG) applications. Initially, FLC was developed to control the charging–discharging of the storage system to avoid mathematical calculation of the conventional system. However, to improve the charging–discharging control, the membership function of the FLC is optimised using PSO technique considering the available power, load demand, battery temperature and state of charge (SOC). The scheduling controller is the optimal solution to achieve low-cost uninterrupted reliable power according to the loads. To reduce the grid power demand and consumption costs, an optimal binary PSO is also introduced to schedule the ESS, grid and distributed sources under various load conditions at different times of the day. The obtained results proved that the robustness of the developed PSO based fuzzy control can effectively manage the battery charging–discharging with reducing the significant grid power consumption of 42.26% and the costs of the energy usage by 45.11% which also demonstrates the contribution of the research

An overview of AC and DC microgrid energy management systems

In 2022, the global electricity consumption was 4,027 billion kWh, steadily increasing over the previous fifty years. Microgrids are required to integrate distributed energy sources (DES) into the utility power grid. They support renewable and nonrenewable distributed generation technologies and provide alternating current (AC) and direct current (DC) power through separate power connections. This paper presents a unified energy management system (EMS) paradigm with protection and control mechanisms, reactive power compensation, and frequency regulation for AC/DC microgrids. Microgrids link local loads to geographically dispersed power sources, allowing them to operate with or without the utility grid. Between 2021 and 2028, the expansion of the world's leading manufacturers will be driven by their commitment to technological advancements, infrastructure improvements, and a stable and secure global power supply. This article discusses iterative, linear, mixed integer linear, stochastic, and predictive microgrid EMS programming techniques. Iterative algorithms minimize the footprints of standalone systems, whereas linear programming optimizes energy management in freestanding hybrid systems with photovoltaic (PV). Mixed-integers linear programming (MILP) is useful for energy management modeling. Management of microgrid energy employs stochastic and robust optimization. Control and predictive modeling (MPC) generates energy management plans for microgrids. Future microgrids may use several AC/DC voltage standards to reduce power conversion stages and improve efficiency. Research into EMS interaction may be intriguing

The integration of pumped hydro storage systems into PV microgrids in rural areas

Photovoltaic (PV) systems are popular in rural areas because they provide low cost and clean electricity for homes and irrigation systems. The primary challenge of PV systems is their intermittent nature. The typical solution is storing energy in batteries; however, they are expensive and possess a short lifespan. This research proposes a new type of pumped hydro storage (PHS) which can be implemented as an alternative to batteries. The components of the system are modelled to consider losses of the system accurately. The mathematic model developed in this project assists the management system to make more efficient decisions. The proposed storage is integrated into a farmhouse that has a PV pumping system where economic aspects of implementing the proposed storage is investigated. The integration of the proposed PHS into a microgrid needs a management system to make this system efficient and 3 cost-effective. This research proposes a multi-stage management system to schedule and control the microgrid components for optimal integration of the PHS. The designed management system is able to manage the pump, turbine, and irrigation time on real-time taking into account both present and future conditions of the microgrid. This study investigates the technical aspects of the proposed system. The PHS and the management system are tested experimentally in a setup installed at smart energy laboratory at Edith Cowan university. Data used in this project are real data collected in the laboratory in order to have a realistic analysis. Economic analysis is done in different sizes with different conditions. Results indicate that the proposed system has a short payback period and a large lifetime benefit, featuring as a cost-effective and sustainable energy storage system for use in rural areas. Video abstract: https://youtu.be/VuyEvHRY7W

Optimización del flujo de energía en instituciones de asistencia médica utilizando técnicas heurísticas

Las instalaciones de asistencia médica ubicadas en el departamento de La Guajira tienen una fuente de suministro de energía eléctrica principal, que es la red de distribución del Operador de Red (OR). La infraestructura eléctrica del OR funciona de manera deficiente con numerosas interrupciones. Por esta razón, el sistema eléctrico esencial de estas instalaciones utiliza una fuente de energía de respaldo, que generalmente es un generador diésel. Esto significa que no se garantiza el respaldo completo de la demanda de la instalación hospitalaria en un día y se tiene un costoso kWh. Por este motivo, esta investigación se preocupó por encontrar una solución energéticamente viable y amigable con el medio ambiente. La solución consistió en desarrollar un sistema eléctrico esencial hospitalario conformado de manera hibrida con energías renovables (HRES), de la siguiente manera: sistema fotovoltaico, generador diésel y un sistema de baterías. Para la operación de este sistema HRES se desarrolló una metodología que permitió optimizar el flujo de energía mediante el uso de una técnica heurística, que está basada en un algoritmo genético de estrategia evolutiva (Plus (μ+λ). Este permitió calcular y minimizar los costos de generación del sistema HRES que opera sin conexión (Off-Grid) a la red de media tensión. Se destaca, el resultado de simulación de 24 horas, en donde, se logró disminuir los costos energéticos y el uso del generador diésel en un 20% a través de la implementación de un sistema fotovoltaico y de un sistema de baterías en las instalaciones de asistencia médica.MaestríaMagister en Ingeniería Eléctric

Optimization strategies for microgrid energy management systems by genetic algorithms

Grid-connected Microgrids (MGs) have a key role for bottom-up modernization of the electric distribution network forward next generation Smart Grids, allowing the application of Demand Response (DR) services, as well as the active participation of prosumers into the energy market. To this aim, MGs must be equipped with suitable Energy Management Systems (EMSs) in charge to efficiently manage in real time internal energy flows and the connection with the grid. Several decision making EMSs are proposed in literature mainly based on soft computing techniques and stochastic models. The adoption of Fuzzy Inference Systems (FISs) has proved to be very successful due to their ease of implementation, low computational run time cost, and the high level of interpretability with respect to more conventional models. In this work we investigate different strategies for the synthesis of a FIS (i.e. rule based) EMS by means of a hierarchical Genetic Algorithm (GA) with the aim to maximize the profit generated by the energy exchange with the grid, assuming a Time Of Use (TOU) energy price policy, and at the same time to reduce the EMS rule base system complexity. Results show that the performances are just 10% below to the ideal (optimal) reference solution, even when the rule base system is reduced to less than 30 rules

Modelo y desarrollo de un sistema de gestión óptima para una microrred empleando algoritmos bio-inspirados

Tesis por compendio[ES] Las fuentes de energía renovable (ER) permiten una alta disgregación, por lo que hacen posible generar la energía que se utilizará en el mismo sitio de su aprovechamiento. Esto favorece un cambio en la estructura de las redes eléctricas, permitiendo pasar de un esquema de generación centralizado a un esquema distribuido. Sin embargo, las fuentes de ER son altamente dependientes de las condiciones medioambientales como la radiación solar, la nubosidad, el viento, entre otros, por lo que lograr un sistema de generación basado en energías renovables es un reto en la actualidad. Los sistemas de generación que integran fuentes renovables tienen que ser capaces de establecer estrategias de control y gestión de la energía que para hacer un uso eficiente de ella e intentar cubrir la demanda de energía de forma óptima al combinar más de un tipo de fuente y sistema de almacenamiento, siendo posible operar de manera aislada o conectada a la red eléctrica. En la actualidad es de interés el estudio, desarrollo e implementación de sistemas gestores de la energía (SGE) para microrredes eléctricas híbridas, que permitan aumentar su eficiencia, fiabilidad, y disminuir los costes de instalación, operación y mantenimiento. Diversos estudios de investigación han probado múltiples estrategias, desde SGE basados en reglas, algoritmos comparativos, controladores clásicos, y en años recientes, la integración de algoritmos de optimización bio-inspirados e inteligencia artificial. Estos algoritmos han mostrado ser una alternativa interesante a las técnicas clásicas para la solución de problemas de optimización y control en diversos problemas de ingeniería, su aplicación en el ámbito de las microrredes sigue en estudio y en ello se basa este trabajo de investigación. Los algoritmos bio-inspirados se fundamentan en imitar matemáticamente los mecanismos y estrategias que la naturaleza ha implementado a lo largo de millones de años para lograr un equilibrio en su funcionamiento, por ejemplo, imitando el cómo las aves vuelan en parvada buscando alimento, o como las hormigas y los lobos siguen patrones para la búsqueda de su alimento, o como las especies llevan a cabo mecanismos de cruce con el objetivo de mejorar su raza haciéndolas una especie optimizada y mejorando su supervivencia. Por tanto, se puede hacer una analogía con los sistemas artificiales para la mejora de controladores y diseño de sistemas en microrredes eléctricas. En este trabajo de investigación se muestra el modelo y desarrollo de un sistema de gestión óptima para una microrred empleando algoritmos bio-inspirados con el objetivo de mejorar su desempeño, partiendo desde el control primario, con la mejora de los convertidores de potencia, hasta el control terciario con las transacciones energéticas de la microrred. Se exploran diversos algoritmos, evaluando su desempeño. Los resultados para las diferentes etapas de esta investigación se encuentran plasmados en cuatro diferentes publicaciones científicas que se detallan en el Capítulo 2 del presente documento, donde se explica la metodología y los principales resultados y hallazgos para cada una de ellas.[CA] Les fonts d'energia renovables (ER) permeten una alta desagregació, pel que fan possible generar l'energia que s'utilitzarà en el mateix lloc del seu aprofitament. Això afavoreix un canvi en l'estructura de les xarxes elèctriques, permetent passar d'un esquema de generació centralitzat a un esquema distribuït. No obstant, les fonts d'ER són altament dependents de les condicions mediambientals com la radiació solar, la nuvolositat, el vent, entre altres; pel que aconseguir un sistema de generació basat en energies renovables és un repte. Els sistemes de generació que integren energies renovables han de ser capaços de: establir estratègies de control i gestió de l'energia que es genera per fer un ús eficient d'ella i intentar cobrir la demanda d'energia de la millor manera possible al combinar més d'un tipus de font d'energia, i sistemes d'emmagatzemament. Aquest esquema es coneix com a microxarxa elèctrica, la qual és capaç d'operar de manera aïllada de la xarxa elèctrica principal, o de manera interconnectada. Actualment s'està interessant en l'estudi, desenvolupament i implementació de sistemes gestors de l'energia (SGE) per a microxarxes elèctriques híbrides, que permeten augmentar la seua eficiència, fiabilitat i reduir els costos de la seua instal·lació i d'operació i manteniment. S'han provat múltiples estratègies, des de SGE basats en regles, algorismes comparatius, controladors clàssics i, en anys recents, la integració d'algorismes d'optimització bio-inspirats i intel·ligència artificial. Aquests algorismes han demostrat ser una alternativa interessant a les tècniques clàssiques per a la solució de problemes d'optimització i control en diversos problemes d'enginyeria, la seua aplicació en l'àmbit de les microxarxes continua en estudi. Els algorismes bio-inspirats es basen en imitar matemàticament els mecanismes i estratègies que la Natura ha implementat al llarg de milions d'anys per aconseguir equilibri en el seu funcionament, per exemple, imitant com les aus volen en ramat buscant menjar, o com les formigues i els llops segueixen patrons per a la recerca del seu menjar, o com les espècies porten a terme mecanismes de creuament amb mira a millorar la seua raça fent-les una espècie més apta per a la supervivència;, el qual es pot fer una analogia a sistemes artificials per a la millora de controladors i disseny de sistemes en microxarxes elèctriques. En aquest treball de recerca es mostra el model i desenvolupament d'un sistema de gestió òptima per a una microxarxa emprant algorismes bio-inspirats amb l'objectiu de millorar el seu rendiment, partint des del control primari, amb la millora dels convertidors de potència, fins al control terciari amb les transaccions energètiques de la microxarxa. S'exploren diversos algorismes, avaluant el seu rendiment. Els resultats per a les diferents etapes d'aquesta recerca es troben plasmats en quatre diferents publicacions científiques que es detallen al Capítol 2 del present document, on s'explica la metodologia i els principals resultats i troballes per a cada una d'elles.[EN] Renewable energy sources (RES) allow for high disaggregation, making it possible to generate energy at the site of its use. This favors a change in the structure of electrical grids, allowing for a transition from a centralized generation scheme to a distributed scheme. However, RES are highly dependent on environmental conditions such as solar radiation, cloudiness, wind, among others, making the creation of a renewable energy generation system a challenge. Generation systems that integrate renewable energies must be able to establish control and energy management strategies to make efficient use of the energy generated and try to meet the energy demand in the best possible way by combining more than one type of energy source and storage systems. This scheme is known as a microgrid, which is capable of operating independently from the main electrical grid or interconnecting with it. Currently, the study, development, and implementation of energy management systems (EMS) for hybrid microgrids are of interest in order to increase their efficiency, reliability, and reduce installation, operation, and maintenance costs. Multiple strategies have been tested, including rule-based EMS, comparative algorithms, classical controllers, and in recent years, the integration of bio-inspired optimization algorithms and artificial intelligence. These algorithms have shown to be an interesting alternative to classical techniques for solving optimization and control problems in various engineering problems, although their application in the field of microgrids is still under study. Bio-inspired algorithms are based on mathematically imitating the mechanisms and strategies that Nature has implemented over millions of years to achieve balance in its operation, for example, by imitating how birds fly in flocks in search of food, or how ants and wolves follow patterns to search for food, or how species carry out crossing mechanisms in order to improve their breed and make them more suitable for survival; in other words, they are based on how Nature optimizes its resources to prosper. Therefore, an analogy can be made with artificial systems for improving controllers and designing systems in microgrids. In this research work, the model and development of an optimal management system for a microgrid using bio-inspired algorithms is presented with the aim of improving its performance, starting from primary control, with the improvement of power converters, to tertiary control with the energy transactions of the microgrid. Various algorithms are explored, evaluating their performance. The results for the different stages of this research are reflected in four different scientific publications that are detailed in Chapter 2 of this document, where the methodology and main results and findings for each of them are explained.The authors wish to acknowledge the National Council of Science and Technology of Mexico (CONACYT) for funding this work through the Ph.D. scholarship number 486670. The authors would also thank the Institute of Energy Engineering of the Polytechnic University of Valencia, Spain, and the Department of Water and Energy Studies of the University of Guadalajara, Mexico, for all their support and collaboration. This study has also been supported by Food and Agriculture Organization of the United Nations through the project “Design of a Hybrid Renewable Microgrid System”.Águila León, J. (2023). Modelo y desarrollo de un sistema de gestión óptima para una microrred empleando algoritmos bio-inspirados [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/196747Compendi