A novel soft computing approach based on FIR to model and predict energy dynamic systems

Tesi en modalitat compendi de publicacionsWe are facing a global climate crisis that is demanding a change in the status quo of how we produce, distribute and consume energy. In the last decades, this is being redefined through Smart Grids(SG), an intelligent electrical network more observable, controllable, automated, fully integrated with energy services and the end-users. Most of the features and proposed SG scenarios are based on reliable, robust and fast energy predictions. For instance, for proper planning activities, such as generation, purchasing, maintenance and investment; for demand side management, like demand response programs; for energy trading, especially at local level, where productions and consumptions are more stochastics and dynamic; better forecasts also increase grid stability and thus supply security. A large variety of Artificial Intelligence(AI) techniques have been applied in the field of Short-term electricity Load Forecasting(SLF) at consumer level in low-voltage system, showing a better performance than classical techniques. Inaccuracy or failure in the SLF process may be translated not just in a non-optimal (low prediction accuracy) solution but also in frustration of end-users, especially in new services and functionalities that empower citizens. In this regard, some limitations have been observed in energy forecasting models based on AI such as robustness, reliability, accuracy and computation in the edge. This research proposes and develops a new version of Fuzzy Inductive Reasoning(FIR), called Flexible FIR, to model and predict the electricity consumption of an entity in the low-voltage grid with high uncertainties, and information missing, as well as the capacity to be deployed either in the cloud or locally in a new version of Smart Meters(SMs) based on Edge Computing(EC). FIR has been proved to be a powerful approach for model identification and system ’s prediction over dynamic and complex processes in different real world domains but not yet in the energy domain. Thus, the main goal of this thesis is to demonstrate that a new version of FIR, more robust, reliable and accurate can be a referent Soft Computing(SC) methodology to model and predict dynamic systems in the energy domain and that it is scalable to an EC integration. The core developments of Flexible FIR have been an algorithm that can cope with missing information in the input values, as well as learn from instances with Missing Values(MVs) in the knowledge-based, without compromising significantly the accuracy of the predictions. Moreover, Flexible FIR comes with new forecasting strategies that can cope better with loss of causality of a variable and dispersion of output classes than classical k nearest neighbours, making the FIR forecasting process more reliable and robust. Furthermore, Flexible FIR addresses another major challenge modelling with SC techniques, which is to select best model parameters. One of the most important parameters in FIR is the number k of nearest neighbours to be used in the forecast process. The challenge to select the optimal k, dynamically, is addressed through an algorithm, called KOS(K nearest neighbour Optimal Selection), which has been developed and tested also with real world data. It computes a membership aggregation function of all the neighbours with respect their belonging to the output classes.While with KOS the optimal parameter k is found online, with other approaches such as genetic algorithms or reinforcement learning is not, which increases the computational time.Ens trobem davant una crisis climàtica global que exigeix un canvi al status quo de la manera que produïm, distribuïm i consumim energia. En les darreres dècades, està sent redefinit gràcies a les xarxa elèctriques intel·ligents(SG: Smart Grid) amb millor observabilitat, control, automatització, integrades amb nous serveis energètics i usuaris finals. La majoria de les funcionalitats i escenaris de les SG es basen en prediccions de la càrrega elèctrica confiables, robustes i ràpides. Per les prediccions de càrregues elèctriques a curt termini(SLF: Short-term electricity Load Forecasting), a nivell de consumidors al baix voltatge, s’han aplicat una gran varietat de tècniques intel·ligència Artificial(IA) mostrant millor rendiment que tècniques estadístiques tradicionals. Un baix rendiment en SLF, pot traduir-se no només en una solució no-òptima (baixa precisió de predicció) sinó també en la frustració dels usuaris finals, especialment en nous serveis i funcionalitats que empoderarien als ciutadans. En el marc d’aquesta investigació es proposa i desenvolupa una nova versió de la metodologia del Raonament Inductiu Difús(FIR: Fuzzy Inductive Reasoning), anomenat Flexible FIR, capaç de modelar i predir el consum d’electricitat d’una entitat amb un grau d’incertesa molt elevat, inclús amb importants carències d’informació (missing values). A més, Flexible FIR té la capacitat de desplegar-se al núvol, així como localment, en el que podria ser una nova versió de Smart Meters (SM) basada en tecnologia d’Edge Computing (EC). FIR ja ha demostrat ser una metodologia molt potent per la generació de models i prediccions en processos dinàmics en diferents àmbits, però encara no en el de l’energia. Per tant, l’objectiu principal d’aquesta tesis és demostrar que una versió millorada de FIR, més robusta, fiable i precisa pot consolidar-se com una metodologia Soft Computing SC) de referencia per modelar i predir sistemes dinàmics en aplicacions per al sector de l’energia i que és escalable a una integració d’EC. Les principals millores de Flexible FIR han estat, en primer lloc, el desenvolupament i test d’un algorisme capaç de processar els valors d’entrada d’un model FIR tot i que continguin Missing Values (MV). Addicionalment, aquest algorisme també permet aprendre d’instàncies amb MV en la matriu de coneixement d’un model FIR, sense comprometre de manera significativa la precisió de les prediccions. En segon lloc, s’han desenvolupat i testat noves estratègies per a la fase de predicció, comportant-se millor que els clàssics k veïns més propers quan ens trobem amb pèrdua de causalitat d’una variable i dispersió en les classes de sortida, aconseguint un procés d’aprenentatge i predicció més confiable i robust. En tercer lloc, Flexible FIR aborda un repte molt comú en tècniques de SC: l’òptima parametrització del model. En FIR, un dels paràmetres més determinants és el número k de veïns més propers que s’utilitzaran durant la fase de predicció. La selecció del millor valor de k es planteja de manera dinàmica a través de l’algorisme KOS (K nearest neighbour Optimal Selection) que s’ha desenvolupat i testat també amb dades reals. Mentre que amb KOS el paràmetre òptim de k es calcula online, altres enfocaments mitjançant algoritmes genètics o aprenentatge per reforç el càlcul és offline, incrementant significativament el temps de resposta, sent a més a més difícil la implantació en escenaris d’EC. Aquestes millores fan que Flexible FIR es pugui adaptar molt bé en aplicacions d’EC. En aquest sentit es proposa el concepte d’un SM de segona generació basat en EC, que integra Flexible FIR com mòdul de predicció d’electricitat executant-se en el propi dispositiu i un agent EC amb capacitat per el trading d'energia produïda localment. Aquest agent executa un innovador mecanisme basat en incentius, anomenat NRG-X-Change que utilitza una nova moneda digital descentralitzada per l’intercanvi d’energia, que s’anomena NRGcoin.Estamos ante una crisis climática global que exige un cambio del status quo de la manera que producimos, distribuimos y consumimos energía. En las últimas décadas, este status quo está siendo redefinido debido a: la penetración de las energías renovables y la generación distribuida; nuevas tecnologías como baterías y paneles solares con altos rendimientos; y la forma en que se consume la energía, por ejemplo, a través de vehículos eléctricos o con la electrificación de los hogares. Estas palancas requieren una red eléctrica inteligente (SG: Smart Grid) con mayor observabilidad, control, automatización y que esté totalmente integrada con nuevos servicios energéticos, así como con sus usuarios finales. La mayoría de las funcionalidades y escenarios de las redes eléctricas inteligentes se basan en predicciones de la energía confiables, robustas y rápidas. Por ejemplo, para actividades de planificación como la generación, compra, mantenimiento e inversión; para la gestión de la demanda, como los programas de demand response; en el trading de electricidad, especialmente a nivel local, donde las producciones y los consumos son más estocásticos y dinámicos; una mejor predicción eléctrica también aumenta la estabilidad de la red y, por lo tanto, mejora la seguridad. Para las predicciones eléctricas a corto plazo (SLF: Short-term electricity Load Forecasting), a nivel de consumidores en el bajo voltaje, se han aplicado una gran variedad de técnicas de Inteligencia Artificial (IA) mostrando mejor rendimiento que técnicas estadísticas convencionales. Un bajo rendimiento en los modelos predictivos, puede traducirse no solamente en una solución no-óptima (baja precisión de predicción) sino también en frustración de los usuarios finales, especialmente en nuevos servicios y funcionalidades que empoderan a los ciudadanos. En este sentido, se han identificado limitaciones en modelos de predicción de energía basados en IA, como la robustez, fiabilidad, precisión i computación en el borde. En el marco de esta investigación se propone y desarrolla una nueva versión de la metodología de Razonamiento Inductivo Difuso (FIR: Fuzzy Inductive Reasoning), que hemos llamado Flexible FIR, capaz de modelar y predecir el consumo de electricidad de una entidad con altos grados de incertidumbre e incluso con importantes carencias de información (missing values). Además, Flexible FIR tiene la capacidad de desplegarse en la nube, así como localmente, en lo que podría ser una nueva versión de Smart Meters (SM) basada en tecnología de Edge Computing (EC). En el pasado, ya se ha demostrado que FIR es una metodología muy potente para la generación de modelos y predicciones en procesos dinámicos, sin embargo, todavía no ha sido demostrado en el campo de la energía. Por tanto, el objetivo principal de esta tesis es demostrar que una versión mejorada de FIR, más robusta, fiable y precisa puede consolidarse como metodología Soft Computing (SC) de referencia para modelar y predecir sistemas dinámicos en aplicaciones para el sector de la energía y que es escalable hacia una integración de EC. Las principales mejoras en Flexible FIR han sido, en primer lugar, el desarrollo y testeo de un algoritmo capaz de procesar los valores de entrada en un modelo FIR a pesar de que contengan Missing Values (MV). Además, dicho algoritmo también permite aprender de instancias con MV en la matriz de conocimiento de un modelo FIR, sin comprometer de manera significativa la precisión de las predicciones. En segundo lugar, se han desarrollado y testeado nuevas estrategias para la fase de predicción de un modelo FIR, comportándose mejor que los clásicos k vecinos más cercanos ante la pérdida de causalidad de una variable y dispersión de clases de salida, consiguiendo un proceso de aprendizaje y predicción más confiable y robusto. En tercer lugar, Flexible FIR aborda un desafío muy común en técnicas de SC: la óptima parametrización del modelo. En FIR, uno de los parámetros más determinantes es el número k de vecinos más cercanos que se utilizarán en la fase de predicción. La selección del mejor valor de k se plantea de manera dinámica a través del algoritmo KOS (K nearest neighbour Optimal Selection) que se ha desarrollado y probado también con datos reales. Dicho algoritmo calcula una función de membresía agregada, de todos los vecinos, con respecto a su pertenencia a las clases de salida. Mientras que con KOS el parámetro óptimo de k se calcula online, otros enfoques mediante algoritmos genéticos o aprendizaje por refuerzo, el cálculo es offline incrementando significativamente el tiempo de respuesta, siendo además difícil su implantación en escenarios de EC. Estas mejoras hacen que Flexible FIR se adapte muy bien en aplicaciones de EC, en las que la analítica de datos en streaming debe ser fiable, robusta y con un modelo suficientemente ligero para ser ejecutado en un IoT Gateway o dispositivos más pequeños. También, en escenarios con poca conectividad donde el uso de la computación en la nube es limitado y los parámetros del modelo se calculan localmente. Con estas premisas, en esta tesis, se propone el concepto de un SM de segunda generación basado en EC, que integra Flexible FIR como módulo de predicción de electricidad ejecutándose en el dispositivo y un agente EC con capacidad para el trading de energía producida localmente. Dicho agente ejecuta un novedoso mecanismo basado en incentivos, llamado NRG-X-Change que utiliza una nueva moneda digital descentralizada para el intercambio de energía, llamada NRGcoin.Postprint (published version

Energy Management of Prosumer Communities

The penetration of distributed generation, energy storages and smart loads has resulted in the emergence of prosumers: entities capable of adjusting their electricity production and consumption in order to meet environmental goals and to participate profitably in the available electricity markets. Significant untapped potential remains in the exploitation and coordination of small and medium-sized distributed energy resources. However, such resources usually have a primary purpose, which imposes constraints on the exploitation of the resource; for example, the primary purpose of an electric vehicle battery is for driving, so the battery could be used as temporary storage for excess photovoltaic energy only if the vehicle is available for driving when the owner expects it to be. The aggregation of several distributed energy resources is a solution for coping with the unavailability of one resource. Solutions are needed for managing the electricity production and consumption characteristics of diverse distributed energy resources in order to obtain prosumers with more generic capabilities and services for electricity production, storage, and consumption. This collection of articles studies such prosumers and the emergence of prosumer communities. Demand response-capable smart loads, battery storages and photovoltaic generation resources are forecasted and optimized to ensure energy-efficient and, in some cases, profitable operation of the resources

Learning-based short-time prediction of photovoltaic resources for pre-emptive excursion cancellation

There is a growing interest in using renewable energy resources (RES) such as wind, solar, geothermal and biomass in power systems. The main incentives for using renewable energy resources include the growing interest in sustainable and clean generation as well as reduced fuel cost. However, the challenge with using wind and solar resources is their indeterminacy which leads to voltage and frequency excursions. In this dissertation, first, the economic dispatch (ED) problem for a community microgrid is studied which explores a community energy market. As a result of this work, the importance of modeling and predicting renewable resources is understood. Hence, a new algorithm based on dictionary learning for prediction of solar production is introduced. In this method, a dictionary is trained to carry various behaviors of the system. Prediction is performed by reconstructing the tail of the upcoming signal using this dictionary. To improve the accuracy of prediction, a new approach based on a novel clustering-based Markov Switched Autoregressive Model is proposed that is capable of predicting short-term solar production. This method extracts autoregressive features of the training data and partitions them into multiple clusters. Later, it uses the representative feature of each cluster to predict the upcoming solar production level. Additionally, a Markov jump chain is added to improve the robustness of this scheme to noise. Lastly, a method to utilize these prediction mechanisms in a preemptive model predictive control is explored. By incorporating the expected production levels, a model predictive controller is designed to preemptively cancel the upcoming excursions --Abstract, page iv

Control System for Electrical Power Grids with Renewables using Artificial Intelligence Methods

Modern electrical and electronic devices are very sensitive to the power supply and require steady and stable electric power. Factories may also need electric power within a specific standard range of voltage, frequency, and current to avoid defects in the production. For these reasons electric power utilities must produce an electric power of a specific standard of power quality parameters [EN50160]. Nowadays, renewable energy sources, such as wind energy and solar energy are used to generate electric power as free and clean power sources as well to reduce fuel consumption and environmental pollution as much as possible. Renewable energy, e.g. wind speed or solar irradiance, are not stable or not constant energies over the time. Therefore smart control systems (SCSs) are needed for operate the power system in optimal way which help for producing a power with good quality from renewable sources. The forecasting and prediction models play a main role in these issues and contribute as the important part of the smart control system (SCS). The main task of the SCS is to keep the generated power equal to the consumed power as well as to consider standard levels of power quality parameters as much as possible. Some of previous studies have focused on forecasting power quality parameters, power load, wind speed and solar irradiance using machine learning models as neural networks, support vector machines, fuzzy sets, and neuro fuzzy. This thesis proposes designing forecasting systems using machine learning techniques in order to be use in control and operate an electrical power system. In this study, design and tested forecasting systems related to the power and renewable energies. These systems include wind speed forecasting, power load forecasting and power quality parameters forecasting. The main part of this thesis is focus in power quality parameters forecasting in short-term, these parameters are: power frequency, magnitude of the supply voltage, total harmonic distortion of voltage (THDu), total harmonic distortion of current (THDi), and short term flicker severity (Pst) according to the definition in [EN50160]. The output of the forecasting models of power quality parameters can be used in shifting the load to run in switch time which will help for correct and optimize the quality of the power.Modern electrical and electronic devices are very sensitive to the power supply and require steady and stable electric power. Factories may also need electric power within a specific standard range of voltage, frequency, and current to avoid defects in the production. For these reasons electric power utilities must produce an electric power of a specific standard of power quality parameters [EN50160]. Nowadays, renewable energy sources, such as wind energy and solar energy are used to generate electric power as free and clean power sources as well to reduce fuel consumption and environmental pollution as much as possible. Renewable energy, e.g. wind speed or solar irradiance, are not stable or not constant energies over the time. Therefore smart control systems (SCSs) are needed for operate the power system in optimal way which help for producing a power with good quality from renewable sources. The forecasting and prediction models play a main role in these issues and contribute as the important part of the smart control system (SCS). The main task of the SCS is to keep the generated power equal to the consumed power as well as to consider standard levels of power quality parameters as much as possible. Some of previous studies have focused on forecasting power quality parameters, power load, wind speed and solar irradiance using machine learning models as neural networks, support vector machines, fuzzy sets, and neuro fuzzy. This thesis proposes designing forecasting systems using machine learning techniques in order to be use in control and operate an electrical power system. In this study, design and tested forecasting systems related to the power and renewable energies. These systems include wind speed forecasting, power load forecasting and power quality parameters forecasting. The main part of this thesis is focus in power quality parameters forecasting in short-term, these parameters are: power frequency, magnitude of the supply voltage, total harmonic distortion of voltage (THDu), total harmonic distortion of current (THDi), and short term flicker severity (Pst) according to the definition in [EN50160]. The output of the forecasting models of power quality parameters can be used in shifting the load to run in switch time which will help for correct and optimize the quality of the power.410 - Katedra elektroenergetikyvyhově

Machine-learning methods for integrated renewable power generation: A comparative study of artificial neural networks, support vector regression, and Gaussian Process Regression

Renewable energy from wind and solar resources can contribute significantly to the decarbonisation of the conventionally fossil-driven electricity grid. However, their seamless integration with the grid poses significant challenges due to their intermittent generation patterns, which is intensified by the existing uncertainties and fluctuations from the demand side. A resolution is increasing energy storage and standby power generation which results in economic losses. Alternatively, enhancing the predictability of wind and solar energy as well as demand enables replacing such expensive hardware with advanced control and optimization systems. The present research contribution establishes consistent sets of data and develops data-driven models through machine-learning techniques. The aim is to quantify the uncertainties in the electricity grid and examine the predictability of their behaviour. The predictive methods that were selected included conventional artificial neural networks (ANN), support vector regression (SVR) and Gaussian process regression (GPR). For each method, a sensitivity analysis was conducted with the aim of tuning its parameters as optimally as possible. The next step was to train and validate each method with various datasets (wind, solar, demand). Finally, a predictability analysis was performed in order to ascertain how the models would respond when the prediction time horizon increases. All models were found capable of predicting wind and solar power, but only the neural networks were successful for the electricity demand. Considering the dynamics of the electricity grid, it was observed that the prediction process for renewable wind and solar power generation, and electricity demand was fast and accurate enough to effectively replace the alternative electricity storage and standby capacity

Data Mining in Smart Grids

Effective smart grid operation requires rapid decisions in a data-rich, but information-limited, environment. In this context, grid sensor data-streaming cannot provide the system operators with the necessary information to act on in the time frames necessary to minimize the impact of the disturbances. Even if there are fast models that can convert the data into information, the smart grid operator must deal with the challenge of not having a full understanding of the context of the information, and, therefore, the information content cannot be used with any high degree of confidence. To address this issue, data mining has been recognized as the most promising enabling technology for improving decision-making processes, providing the right information at the right moment to the right decision-maker. This Special Issue is focused on emerging methodologies for data mining in smart grids. In this area, it addresses many relevant topics, ranging from methods for uncertainty management, to advanced dispatching. This Special Issue not only focuses on methodological breakthroughs and roadmaps in implementing the methodology, but also presents the much-needed sharing of the best practices. Topics include, but are not limited to, the following: Fuzziness in smart grids computing Emerging techniques for renewable energy forecasting Robust and proactive solution of optimal smart grids operation Fuzzy-based smart grids monitoring and control frameworks Granular computing for uncertainty management in smart grids Self-organizing and decentralized paradigms for information processin