Short-term electricity demand and gas price forecasts using wavelet transforms and adaptive models

This paper presents some forecasting techniques for energy demand and price prediction, one day ahead. These techniques combine wavelet transform (WT) with fixed and adaptive machine learning/time series models (multi-layer perceptron (MLP), radial basis functions, linear regression, or GARCH). To create an adaptive model, we use an extended Kalman filter or particle filter to update the parameters continuously on the test set. The adaptive GARCH model is a new contribution, broadening the applicability of GARCH methods. We empirically compared two approaches of combining the WT with prediction models: multicomponent forecasts and direct forecasts. These techniques are applied to large sets of real data (both stationary and non-stationary) from the UK energy markets, so as to provide comparative results that are statistically stronger than those previously reported. The results showed that the forecasting accuracy is significantly improved by using the WT and adaptive models. The best models on the electricity demand/gas price forecast are the adaptive MLP/GARCH with the multicomponent forecast; their MSEs are 0.02314 and 0.15384 respectively

Dynamic non-linear system modelling using wavelet-based soft computing techniques

The enormous number of complex systems results in the necessity of high-level and cost-efficient modelling structures for the operators and system designers. Model-based approaches offer a very challenging way to integrate a priori knowledge into the procedure. Soft computing based models in particular, can successfully be applied in cases of highly nonlinear problems. A further reason for dealing with so called soft computational model based techniques is that in real-world cases, many times only partial, uncertain and/or inaccurate data is available. Wavelet-Based soft computing techniques are considered, as one of the latest trends in system identification/modelling. This thesis provides a comprehensive synopsis of the main wavelet-based approaches to model the non-linear dynamical systems in real world problems in conjunction with possible twists and novelties aiming for more accurate and less complex modelling structure. Initially, an on-line structure and parameter design has been considered in an adaptive Neuro- Fuzzy (NF) scheme. The problem of redundant membership functions and consequently fuzzy rules is circumvented by applying an adaptive structure. The growth of a special type of Fungus (Monascus ruber van Tieghem) is examined against several other approaches for further justification of the proposed methodology. By extending the line of research, two Morlet Wavelet Neural Network (WNN) structures have been introduced. Increasing the accuracy and decreasing the computational cost are both the primary targets of proposed novelties. Modifying the synoptic weights by replacing them with Linear Combination Weights (LCW) and also imposing a Hybrid Learning Algorithm (HLA) comprising of Gradient Descent (GD) and Recursive Least Square (RLS), are the tools utilised for the above challenges. These two models differ from the point of view of structure while they share the same HLA scheme. The second approach contains an additional Multiplication layer, plus its hidden layer contains several sub-WNNs for each input dimension. The practical superiority of these extensions is demonstrated by simulation and experimental results on real non-linear dynamic system; Listeria Monocytogenes survival curves in Ultra-High Temperature (UHT) whole milk, and consolidated with comprehensive comparison with other suggested schemes. At the next stage, the extended clustering-based fuzzy version of the proposed WNN schemes, is presented as the ultimate structure in this thesis. The proposed Fuzzy Wavelet Neural network (FWNN) benefitted from Gaussian Mixture Models (GMMs) clustering feature, updated by a modified Expectation-Maximization (EM) algorithm. One of the main aims of this thesis is to illustrate how the GMM-EM scheme could be used not only for detecting useful knowledge from the data by building accurate regression, but also for the identification of complex systems. The structure of FWNN is based on the basis of fuzzy rules including wavelet functions in the consequent parts of rules. In order to improve the function approximation accuracy and general capability of the FWNN system, an efficient hybrid learning approach is used to adjust the parameters of dilation, translation, weights, and membership. Extended Kalman Filter (EKF) is employed for wavelet parameters adjustment together with Weighted Least Square (WLS) which is dedicated for the Linear Combination Weights fine-tuning. The results of a real-world application of Short Time Load Forecasting (STLF) further re-enforced the plausibility of the above technique

Development of a smart grid for the proposed 33 KV ring main Distribution System in NIT Rourkela

The non-reliability of fossil fuels has forced the world to use energy efficiently. These days, it is being stressed to use the electrical power smartly so that energy does not go waste. And hence comes the concept of a Smart Grid. So it becomes necessary for reputed places of academics to develop the prototype of the same in their campus. National Institute of Technology (NIT) Rourkela intends to set up a 33KV Ring Main Distribution System including 33/0.433 KV substations in its campus. The present 11KV line will be discarded and replaced by the 33KV system. The main driving force behind this step by the management is to accommodate the stupendously increased power requirement of the institute. The above mentioned plan also includes, set up of Data Acquisition System (DAS) that intends to monitor the electrical equipment in the substations. This is being done not only to increase the accountability and reliability of the distribution system but also to encourage academic research in the distribution automation domain. All in all, an excellent step towards make the Grid, Smart. In this project work the focus is laid on getting load flow solution of the 33KV ring main system. Here the authors use a specialized algorithm for distribution network with high R/X value to obtain the load flow solution. Then using artificial neural networks computation, algorithms are implemented to do the load forecasting and dynamic tariff setting. At the end a Web Portal, the NITR e-Power Monitoring System is developed that will be an excellent interface to the public in general and will help the students of the institute to know their grid well. In short a conscious effort is put to make the grid more interactive

A strategy for short-term load forecasting in Ireland

Electric utilities require short-term forecasts of electricity demand (load) in order to schedule generating plant up to several days ahead on an hourly basis. Errors in the forecasts may lead to generation plant operation that is not required or sub-optimal scheduling of generation plants. In addition, with the introduction of the Electricity Regulation Act 1999, a deregulated market structure has been introduced, adding increased impetus to reducing forecast error and the associated costs. This thesis presents a strategy for reducing costs from electrical demand forecast error using models designed specifically for the Irish system. The differences in short-term load forecasting models are examined under three independent categories: how the data is segmented prior to modelling, the modelling technique and the approach taken to minimise the effect of weather forecast errors present in weather inputs to the load forecasting models. A novel approach is presented to determine whether the data should be segmented by hour of the day prior to modelling. Several segmentation strategies are analysed and the one appropriate for Irish data identified. Furthermore, both linear and nonlinear techniques are compared with a view to evaluating the optimal model type. The effect of weather forecast errors on load forecasting models, though significant, has largely been ignored in the literature. Thus, the underlying issues are examined and a novel method is presented which minimises the effect of weather forecast errors

A CIMB Stock Price Prediction Case Study with Feedforward Neural Network and Recurrent Neural Network

Artificial Neural Network (ANN) is one of the popular techniques used in stock market price prediction. ANN is able to learn from data pattern and continuously improves the result without prior information about the model. The two popular variants of ANN architecture widely used are Feedforward Neural Network (FFNN) and Recurrent Neural Network (RNN). The literature shows that the performance of these two ANN variants is studied dependent. Hence, this paper aims to compare the performance of FFNN and RNN in predicting the closing price of CIMB stock which is traded on the Kuala Lumpur Stock Exchange (KLSE). This paper describes the design of FFNN and RNN and discusses the performances of both ANNs

Techniques to improve forecasting models: applications to energy demand and price

This thesis is a study of three techniques to improve performance of some standard fore-casting models, application to the energy demand and prices. We focus on forecasting demand and price one-day ahead. First, the wavelet transform was used as a pre-processing procedure with two approaches: multicomponent-forecasts and direct-forecasts. We have empirically compared these approaches and found that the former consistently outperformed the latter. Second, adaptive models were introduced to continuously update model parameters in the testing period by combining ?lters with standard forecasting methods. Among these adaptive models, the adaptive LR-GARCH model was proposed for the fi?rst time in the thesis. Third, with regard to noise distributions of the dependent variables in the forecasting models, we used either Gaussian or Student-t distributions. This thesis proposed a novel algorithm to infer parameters of Student-t noise models. The method is an extension of earlier work for models that are linear in parameters to the non-linear multilayer perceptron. Therefore, the proposed method broadens the range of models that can use a Student-t noise distribution. Because these techniques cannot stand alone, they must be combined with prediction models to improve their performance. We combined these techniques with some standard forecasting models: multilayer perceptron, radial basis functions, linear regression, and linear regression with GARCH. These techniques and forecasting models were applied to two datasets from the UK energy markets: daily electricity demand (which is stationary) and gas forward prices (non-stationary). The results showed that these techniques provided good improvement to prediction performance

Optimisation of stand-alone hydrogen-based renewable energy systems using intelligent techniques

Wind and solar irradiance are promising renewable alternatives to fossil fuels due to their availability and topological advantages for local power generation. However, their intermittent and unpredictable nature limits their integration into energy markets. Fortunately, these disadvantages can be partially overcome by using them in combination with energy storage and back-up units. However, the increased complexity of such systems relative to single energy systems makes an optimal sizing method and appropriate Power Management Strategy (PMS) research priorities. This thesis contributes to the design and integration of stand-alone hybrid renewable energy systems by proposing methodologies to optimise the sizing and operation of hydrogen-based systems. These include using intelligent techniques such as Genetic Algorithm (GA), Particle Swarm Optimisation (PSO) and Neural Networks (NNs). Three design aspects: component sizing, renewables forecasting, and operation coordination, have been investigated. The thesis includes a series of four journal articles. The first article introduced a multi-objective sizing methodology to optimise standalone, hydrogen-based systems using GA. The sizing method was developed to calculate the optimum capacities of system components that underpin appropriate compromise between investment, renewables penetration and environmental footprint. The system reliability was assessed using the Loss of Power Supply Probability (LPSP) for which a novel modification was introduced to account for load losses during transient start-up times for the back-ups. The second article investigated the factors that may influence the accuracy of NNs when applied to forecasting short-term renewable energy. That study involved two NNs: Feedforward, and Radial Basis Function in an investigation of the effect of the type, span and resolution of training data, and the length of training pattern, on shortterm wind speed prediction accuracy. The impact of forecasting error on estimating the available wind power was also evaluated for a commercially available wind turbine. The third article experimentally validated the concept of a NN-based (predictive) PMS. A lab-scale (stand-alone) hybrid energy system, which consisted of: an emulated renewable power source, battery bank, and hydrogen fuel cell coupled with metal hydride storage, satisfied the dynamic load demand. The overall power flow of the constructed system was controlled by a NN-based PMS which was implemented using MATLAB and LabVIEW software. The effects of several control parameters, which are either hardware dependent or affect the predictive algorithm, on system performance was investigated under the predictive PMS, this was benchmarked against a rulebased (non-intelligent) strategy. The fourth article investigated the potential impact of NN-based PMS on the economic and operational characteristics of such hybrid systems. That study benchmarked a rule-based PMS to its (predictive) counterpart. In addition, the effect of real-time fuel cell optimisation using PSO, when applied in the context of predictive PMS was also investigated. The comparative analysis was based on deriving the cost of energy, life cycle emissions, renewables penetration, and duty cycles of fuel cell and electrolyser units. The effects of other parameters such the LPSP level, prediction accuracy were also investigated. The developed techniques outperformed traditional approaches by drawing upon complex artificial intelligence models. The research could underpin cost-effective, reliable power supplies to remote communities as well as reducing the dependence on fossil fuels and the associated environmental footprint

Short term load forecasting with Markovian switching distributed deep belief networks

In modern power systems, centralised short term load forecasting (STLF) methods raise concern on high communication requirements and reliability when a central controller undertakes the processing of massive load data solely. As an alternative, distributed methods avoid the problems mentioned above, whilst the possible issues of cyberattacks and uncertain forecasting accuracy still exist. To address the two issues, a novel distributed deep belief networks (DDBN) with Markovian switching topology is proposed for an accurate STLF, based on a completely distributed framework. Without the central governor, the load dataset is separated and the model is trained locally, while obtaining the updates through communication with stochastic neighbours under a designed consensus procedure, and therefore significantly reduced the training time. The overall network reliability against cyberattacks is enhanced by continually switching communication topologies. In the meanwhile, to ensure that the distributed structure is still stable under such a varying topology, the consensus controller gain is delicately designed, and the convergence of the proposed algorithm is theoretically analysed via the Lyapunov function. Besides, restricted Boltzmann machines (RBM) based unsupervised learning is employed for DDBN initialisation and thereby guaranteeing the success rate of STLF model training. GEFCom 2017 competition and ISO New England load datasets are applied to validate the accuracy and effectiveness of the proposed method. Experiment results demonstrate that the proposed DDBN algorithm can enhance around 19% better forecasting accuracy than centralised DBN algorithm.</p

Influence of neural network training parameters on short-term wind forecasting

This paper investigates factors which can affect the accuracy of short-term wind speed prediction when done over long periods spanning different seasons. Two types of neural networks (NNs) are used to forecast power generated via specific horizontal axis wind turbines. Meteorological data used are for a specific Western Australian location. Results reveal that seasonal variations affect the prediction accuracy of the wind resource, but the magnitude of this influence strongly depends on the details of the NN deployed. Factors investigated include the span of the time series needed to initially train the networks, the temporal resolution of these data, the length of training pattern within the overall span which is used to implement the predictions and whether the inclusion of solar irradiance data can appreciably affect wind speed prediction accuracy. There appears to be a relatively complex relationship between these factors and the accuracy of wind speed prediction via NNs. Predicting wind speed based on NNs trained using wind speed and solar irradiance data also increases the prediction accuracy of wind power generated, as can the type of network selected