A Temporal Neural Network Model for Probabilistic Multi-Period Forecasting of Distributed Energy Resources

Probabilistic forecasts of electrical loads and photovoltaic generation provide a family of methods able to incorporate uncertainty estimations in predictions. This paper aims to extend the literature on these methods by proposing a novel deep-learning model based on a mixture of convolutional neural networks, transformer models and dynamic Bayesian networks. Further, the paper also illustrates how to utilize Stochastic Variational Inference for training output distributions that allow time series sampling, a possibility not given for most state-of-the-art methods which do not use distributions. On top of this, the model also proposes an encoder-decoder topology that uses matrix transposes in order to both train on the sequential and the feature dimension. The performance of the work is illustrated on both load and generation time series obtained from a site representative of distributed energy resources in Norway and compared to state-of-the-art methods such as long-short-term memory. With a single-minute prediction resolution and a single-second computation time for an update with a batch size of 100 and a horizon of 24 hours, the model promises performance capable of real-time application. In summary, this paper provides a novel model that allows generating future scenarios for time series of distributed energy resources in real-time, which can be used to generate profiles for control problems under uncertainty. INDEX TERMS deep learning, generation forecasting, load forecasting, neural networks, probabilistic methods, renewable powerpublishedVersio

A hybrid LSTM neural network for energy consumption forecasting of individual households

Irregular human behaviors and univariate datasets remain as two main obstacles of data-driven energy consumption predictions for individual households. In this study, a hybrid deep learning model is proposed combining an ensemble long short term memory (LSTM) neural network with the stationary wavelet transform (SWT) technique. The SWT alleviates the volatility and increases the data dimensions, which potentially help improve the LSTM forecasting accuracy. Moreover, the ensemble LSTM neural network further enhances the forecasting performance of the proposed method. Verification experiments were performed based on a real-world household energy consumption dataset collected by the 'UK-DALEat project. The results show that, with a competitive training efficiency, the proposed method outperforms all compared state-of-art methods, including the persistent method, support vector regression (SVR), long short term memory (LSTM) neural network and convolutional neural network combining long short term memory (CNN-LSTM), with different step sizes at 5, 10, 20 and 30 minutes, using three error metrics

Short-term Load Forecasting with Distributed Long Short-Term Memory

With the employment of smart meters, massive data on consumer behaviour can be collected by retailers. From the collected data, the retailers may obtain the household profile information and implement demand response. While retailers prefer to acquire a model as accurate as possible among different customers, there are two major challenges. First, different retailers in the retail market do not share their consumer's electricity consumption data as these data are regarded as their assets, which has led to the problem of data island. Second, the electricity load data are highly heterogeneous since different retailers may serve various consumers. To this end, a fully distributed short-term load forecasting framework based on a consensus algorithm and Long Short-Term Memory (LSTM) is proposed, which may protect the customer's privacy and satisfy the accurate load forecasting requirement. Specifically, a fully distributed learning framework is exploited for distributed training, and a consensus technique is applied to meet confidential privacy. Case studies show that the proposed method has comparable performance with centralised methods regarding the accuracy, but the proposed method shows advantages in training speed and data privacy.Comment: 5 pages, 4 figures, under revie

Deep learning for time series forecasting: The electric load case

Management and efficient operations in critical infrastructures such as smart grids take huge advantage of accurate power load forecasting, which, due to its non-linear nature, remains a challenging task. Recently, deep learning has emerged in the machine learning field achieving impressive performance in a vast range of tasks, from image classification to machine translation. Applications of deep learning models to the electric load forecasting problem are gaining interest among researchers as well as the industry, but a comprehensive and sound comparison among different-also traditional-architectures is not yet available in the literature. This work aims at filling the gap by reviewing and experimentally evaluating four real world datasets on the most recent trends in electric load forecasting, by contrasting deep learning architectures on short-term forecast (one-day-ahead prediction). Specifically, the focus is on feedforward and recurrent neural networks, sequence-to-sequence models and temporal convolutional neural networks along with architectural variants, which are known in the signal processing community but are novel to the load forecasting one

Masked Multi-Step Probabilistic Forecasting for Short-to-Mid-Term Electricity Demand

Predicting the demand for electricity with uncertainty helps in planning and operation of the grid to provide reliable supply of power to the consumers. Machine learning (ML)-based demand forecasting approaches can be categorized into (1) sample-based approaches, where each forecast is made independently, and (2) time series regression approaches, where some historical load and other feature information is used. When making a short-to-mid-term electricity demand forecast, some future information is available, such as the weather forecast and calendar variables. However, in existing forecasting models this future information is not fully incorporated. To overcome this limitation of existing approaches, we propose Masked Multi-Step Multivariate Probabilistic Forecasting (MMMPF), a novel and general framework to train any neural network model capable of generating a sequence of outputs, that combines both the temporal information from the past and the known information about the future to make probabilistic predictions. Experiments are performed on a real-world dataset for short-to-mid-term electricity demand forecasting for multiple regions and compared with various ML methods. They show that the proposed MMMPF framework outperforms not only sample-based methods but also existing time-series forecasting models with the exact same base models. Models trainded with MMMPF can also generate desired quantiles to capture uncertainty and enable probabilistic planning for grid of the future.Comment: Accepted by the 2023 IEEE Power & Energy Society General Meeting (PESGM). arXiv admin note: substantial text overlap with arXiv:2209.1441

PEMODELAN HYBRID CONVOLUTIONAL BACKPROPAGATION NEURAL NETWORK UNTUK PERAMALAN BEBAN JANGKA SANGAT PENDEK BERDASARKAN MINIMALISASI BIAYA LISTRIK

Abstrak Listrik merupakan kebutuhan pokok masyarakat yang sangat penting. Oleh karena itu, kebutuhan listrik di masa mendatang harus disiapkan secara tepat untuk memenuhi kebutuhan listrik. Untuk memprediksi beban listrik, perlunya memprediksi konsumsi daya pelanggan. Peramalan beban jangka sangat pendek adalah peramalan kebutuhan listrik selama beberapa menit sampai beberapa jam. Dapat dilihat bahwa kesalahan peramalan sering terjadi selama peramalan, tetapi setiap keputusan perencanaan belum dibuat dan prakiraan belum dibuat yang akan mempengaruhi langkah-langkah kebijakan di masa depan. Pada penelitian ini melakukan peramalan beban listrik jangka sangat pendek dengan metode yang digunakan yaitu Hybrid Convolutional - Backpropagtion Neural Network (C-BPNN) berdasarkan minimalisasi biaya listrik. Penilitian ini memiliki tujuan untuk dapat mengetahui kebutuhan energi listrik yang digunakan oleh konsumen selama 5 jam kedepan. Kebaruan yang dilakukan dalam penelitian ini yaitu peramalan beban listrik jangka sangat pendek dengan menggunakan metode Hybrid Convolutional - Backpropagtion Neural Network (C-BPNN) dengan penambahan variabel biaya listrik. Hasil dari melakukan peramalan beban listrik konsumen jangka sangat pendek didapatkan nilai MSE dan MAPE sebesar, MSE = 0.000972393 dan MAPE = 0.00082227%. Sehingga dengan menggunakan metode Hybrid Convolutional - Backpropagtion Neural Network (C-BPNN) didapatkan hasil yang maksimal serta peramalan lebih akurat selama 5 jam kedepan kedepan dan hasil peramalan dapat digunakan oleh instansi terkait untuk menyiapkan pasokan listrik yang cukup sehingga terhindar dari gangguan pada jaringan. Kata Kunci: Peramalan, Convolutional, Backpropagtion Neural Network, Mean Squared Error, Mean Absolute Percent Erro

Load forecast on a Micro Grid level through Machine Learning algorithms

As Micro Redes constituem um sector em crescimento da indústria energética, representando uma mudança de paradigma, desde as remotas centrais de geração até à produção mais localizada e distribuída. A capacidade de isolamento das principais redes elétricas e atuar de forma independente tornam as Micro Redes em sistemas resilientes, capazes de conduzir operações flexíveis em paralelo com a prestação de serviços que tornam a rede mais competitiva. Como tal, as Micro Redes fornecem energia limpa eficiente de baixo custo, aprimoram a coordenação dos ativos e melhoram a operação e estabilidade da rede regional de eletricidade, através da capacidade de resposta dinâmica aos recursos energéticos. Para isso, necessitam de uma coordenação de gestão inteligente que equilibre todas as tecnologias ao seu dispor. Daqui surge a necessidade de recorrer a modelos de previsão de carga e de produção robustos e de confiança, que interligam a alocação dos recursos da rede perante as necessidades emergentes. Sendo assim, foi desenvolvida a metodologia HALOFMI, que tem como principal objetivo a criação de um modelo de previsão de carga para 24 horas. A metodologia desenvolvida é constituída, numa primeira fase, por uma abordagem híbrida de multinível para a criação e escolha de atributos, que alimenta uma rede neuronal (Multi-Layer Perceptron) sujeita a um ajuste de híper-parâmetros. Posto isto, numa segunda fase são testados dois modos de aplicação e gestão de dados para a Micro Rede. A metodologia desenvolvida é aplicada em dois casos de estudo: o primeiro é composto por perfis de carga agregados correspondentes a dados de clientes em Baixa Tensão Normal e de Unidades de Produção e Autoconsumo (UPAC). Este caso de estudo apresenta-se como um perfil de carga elétrica regular e com contornos muito suaves. O segundo caso de estudo diz respeito a uma ilha turística e representa um perfil irregular de carga, com variações bruscas e difíceis de prever e apresenta um desafio maior em termos de previsão a 24-horas A partir dos resultados obtidos, é avaliado o impacto da integração de uma seleção recursiva inteligente de atributos, seguido por uma viabilização do processo de redução da dimensão de dados para o operador da Micro Rede, e por fim uma comparação de estimadores usados no modelo de previsão, através de medidores de erros na performance do algoritmo.Micro Grids constitute a growing sector of the energetic industry, representing a paradigm shift from the central power generation plans to a more distributed generation. The capacity to work isolated from the main electric grid make the MG resilient system, capable of conducting flexible operations while providing services that make the network more competitive. Additionally, Micro Grids supply clean and efficient low-cost energy, enhance the flexible assets coordination and improve the operation and stability of the of the local electric grid, through the capability of providing a dynamic response to the energetic resources. For that, it is required an intelligent coordination which balances all the available technologies. With this, rises the need to integrate accurate and robust load and production forecasting models into the MG management platform, thus allowing a more precise coordination of the flexible resource according to the emerging demand needs. For these reasons, the HALOFMI methodology was developed, which focus on the creation of a precise 24-hour load forecast model. This methodology includes firstly, a hybrid multi-level approach for the creation and selection of features. Then, these inputs are fed to a Neural Network (Multi-Layer Perceptron) with hyper-parameters tuning. In a second phase, two ways of data operation are compared and assessed, which results in the viability of the network operating with a reduced number of training days without compromising the model's performance. Such process is attained through a sliding window application. Furthermore, the developed methodology is applied in two case studies, both with 15-minute timesteps: the first one is composed by aggregated load profiles of Standard Low Voltage clients, including production and self-consumption units. This case study presents regular and very smooth load profile curves. The second case study concerns a touristic island and represents an irregular load curve with high granularity with abrupt variations. From the attained results, it is evaluated the impact of integrating a recursive intelligent feature selection routine, followed by an assessment on the sliding window application and at last, a comparison on the errors coming from different estimators for the model, through several well-defined performance metrics

Time series prediction and forecasting using Deep learning Architectures

Nature brings time series data everyday and everywhere, for example, weather data, physiological signals and biomedical signals, financial and business recordings. Predicting the future observations of a collected sequence of historical observations is called time series forecasting. Forecasts are essential, considering the fact that they guide decisions in many areas of scientific, industrial and economic activity such as in meteorology, telecommunication, finance, sales and stock exchange rates. A massive amount of research has already been carried out by researchers over many years for the development of models to improve the time series forecasting accuracy. The major aim of time series modelling is to scrupulously examine the past observation of time series and to develop an appropriate model which elucidate the inherent behaviour and pattern existing in time series. The behaviour and pattern related to various time series may possess different conventions and infact requires specific countermeasures for modelling. Consequently, retaining the neural networks to predict a set of time series of mysterious domain remains particularly challenging. Time series forecasting remains an arduous problem despite the fact that there is substantial improvement in machine learning approaches. This usually happens due to some factors like, different time series may have different flattering behaviour. In real world time series data, the discriminative patterns residing in the time series are often distorted by random noise and affected by high-frequency perturbations. The major aim of this thesis is to contribute to the study and expansion of time series prediction and multistep ahead forecasting method based on deep learning algorithms. Time series forecasting using deep learning models is still in infancy as compared to other research areas for time series forecasting.Variety of time series data has been considered in this research. We explored several deep learning architectures on the sequential data, such as Deep Belief Networks (DBNs), Stacked AutoEncoders (SAEs), Recurrent Neural Networks (RNNs) and Convolutional Neural Networks (CNNs). Moreover, we also proposed two different new methods based on muli-step ahead forecasting for time series data. The comparison with state of the art methods is also exhibited. The research work conducted in this thesis makes theoretical, methodological and empirical contributions to time series prediction and multi-step ahead forecasting by using Deep Learning Architectures