A Multi Hidden Recurrent Neural Network with a Modified Grey Wolf Optimizer

Identifying university students' weaknesses results in better learning and can function as an early warning system to enable students to improve. However, the satisfaction level of existing systems is not promising. New and dynamic hybrid systems are needed to imitate this mechanism. A hybrid system (a modified Recurrent Neural Network with an adapted Grey Wolf Optimizer) is used to forecast students' outcomes. This proposed system would improve instruction by the faculty and enhance the students' learning experiences. The results show that a modified recurrent neural network with an adapted Grey Wolf Optimizer has the best accuracy when compared with other models.Comment: 34 pages, published in PLoS ON

HOME ENERGY MANAGEMENT SYSTEM FOR DEMAND RESPONSE PURPOSES

The growing demand for electricity has led to increasing efforts to generate and satisfy the rising demand. This led to suppliers attempting to reduce consumption with the help of the users. Requests to shift unnecessary loads off the peak hours, using other sources of generators to supply the grid while offering incentives to the users have made a significant effect. Furthermore, automated solutions were implemented with the help of Home Energy Management Systems (HEMS) where the user can remotely manage household loads to reduce consumption or cost. Demand Response (DR) is the process of reducing power consumption in a response to demand signals generated by the utility based on many factors such as the Time of Use (ToU) prices. Automated HEMS use load scheduling techniques to control house appliances in response to DR signals. Scheduling can be purely user-dependent or fully automated with minimum effort from the user. This thesis presents a HEMS which automatically schedules appliances around the house to reduce the cost to the minimum. The main contributions in this thesis are the house controller model which models a variety of thermal loads in addition to two shiftable loads, and the optimizer which schedules the loads to reduce the cost depending on the DR signals. The controllers focus on the thermal loads since they have the biggest effect on the electricity bill, they also consider many factors ignored in similar models such as the physical properties of the room/medium, the outer temperatures, the comfort levels of the users, and the occupancy of the house during scheduling. The DR signal was the hourly electricity price; normally higher during the peak hours. Another main part of the thesis was studying multiple optimization algorithms and utilizing them to get the optimum scheduling. Results showed a maximum of 44% cost reduction using different metaheuristic optimization algorithms and different price and occupancy schemes

An Improved Bees Algorithm for Training Deep Recurrent Networks for Sentiment Classification

Recurrent neural networks (RNNs) are powerful tools for learning information from temporal sequences. Designing an optimum deep RNN is difficult due to configuration and training issues, such as vanishing and exploding gradients. In this paper, a novel metaheuristic optimisation approach is proposed for training deep RNNs for the sentiment classification task. The approach employs an enhanced Ternary Bees Algorithm (BA-3+), which operates for large dataset classification problems by considering only three individual solutions in each iteration. BA-3+ combines the collaborative search of three bees to find the optimal set of trainable parameters of the proposed deep recurrent learning architecture. Local learning with exploitative search utilises the greedy selection strategy. Stochastic gradient descent (SGD) learning with singular value decomposition (SVD) aims to handle vanishing and exploding gradients of the decision parameters with the stabilisation strategy of SVD. Global learning with explorative search achieves faster convergence without getting trapped at local optima to find the optimal set of trainable parameters of the proposed deep recurrent learning architecture. BA-3+ has been tested on the sentiment classification task to classify symmetric and asymmetric distribution of the datasets from different domains, including Twitter, product reviews, and movie reviews. Comparative results have been obtained for advanced deep language models and Differential Evolution (DE) and Particle Swarm Optimization (PSO) algorithms. BA-3+ converged to the global minimum faster than the DE and PSO algorithms, and it outperformed the SGD, DE, and PSO algorithms for the Turkish and English datasets. The accuracy value and F1 measure have improved at least with a 30–40% improvement than the standard SGD algorithm for all classification datasets. Accuracy rates in the RNN model trained with BA-3+ ranged from 80% to 90%, while the RNN trained with SGD was able to achieve between 50% and 60% for most datasets. The performance of the RNN model with BA-3+ has as good as for Tree-LSTMs and Recursive Neural Tensor Networks (RNTNs) language models, which achieved accuracy results of up to 90% for some datasets. The improved accuracy and convergence results show that BA-3+ is an efficient, stable algorithm for the complex classification task, and it can handle the vanishing and exploding gradients problem of deep RNNs

Salp Swarm Optimized Hybrid Elman Recurrent Neural Network (SSO-ERNN) based MPPT Controller for Solar PV

Renewable energy technologies provide clean and abundant energy that can be self-renewed from natural sources; more support from the public to replace fossil fuels with various renewable energy sources to protect the environment. Although solar energy has less impact on the environment than other renewable sources, the output efficiency is lower due to the different weather conditions. So to overcome that, the MPPT controller is used for tracking peak power and better efficiency. Some conventional methods in MPPT controllers provide less tracking efficiency, and steady-state oscillations occur in maximum power tracking due to the sudden variations in solar irradiance. Thus, in this work salp swarm optimized (SSO) based Elman recurrent neural network (ERNN) controller is proposed to track the maximum power form PV with high efficiency. The weight parameter of ERNN layer is optimized with the help of SSO, which solve the complex problems and give maximum efficiency. The proposed method is performed in MATLAB/Simulink environment, which differs from existing plans and gives a better output efficiency. Using this proposed controller, the system can achieve high tracking efficiency of 99.74% compared to conventional processes

Short-term forecasting and uncertainty analysis of wind turbine power based on long short-term memory network and Gaussian mixture model

Wind power plays a leading role in the development of renewable energy. However, the random nature of wind turbine power and its associated uncertainty create challenges in dispatching this power effectively in the power system, which can result in unnecessary curtailment of the wind turbine power. Improving the accuracy of wind turbine power forecasting is an effective measure for resolving such problems. This study uses a deep learning network to forecast the wind turbine power based on a long short-term memory network (LSTM) algorithm and uses the Gaussian mixture model (GMM) to analyze the error distribution characteristics of short-term wind turbine power forecasting. The LSTM algorithm is used to forecast the power and uncertainties for three wind turbines within a wind farm. According to numerical weather prediction (NWP) data and historical power data for three turbines, the forecasting accuracy of the turbine with the largest number of training samples is the best of the three. For one of the turbines, the LSTM, radial basis function (RBF), wavelet, deep belief network (DBN), back propagation neural networks (BPNN), and Elman neural network (ELMAN) have been used to forecast the wind turbine power. This study compares the results and demonstrates that LSTM can greatly improve the forecasting accuracy. Moreover, this study obtains different confidence intervals for the three units according to the GMM, mixture density neural network (MDN), and relevance vector machine (RVM) model results. The LSTM method is shown to have higher accuracy and faster convergence than the other methods. However, the GMM method has better performance and evaluation than other methods and thus has practical application value for wind turbine power dispatching

An improved data classification framework based on fractional particle swarm optimization

Particle Swarm Optimization (PSO) is a population based stochastic optimization technique which consist of particles that move collectively in iterations to search for the most optimum solutions. However, conventional PSO is prone to lack of convergence and even stagnation in complex high dimensional-search problems with multiple local optima. Therefore, this research proposed an improved Mutually-Optimized Fractional PSO (MOFPSO) algorithm based on fractional derivatives and small step lengths to ensure convergence to global optima by supplying a fine balance between exploration and exploitation. The proposed algorithm is tested and verified for optimization performance comparison on ten benchmark functions against six existing established algorithms in terms of Mean of Error and Standard Deviation values. The proposed MOFPSO algorithm demonstrated lowest Mean of Error values during the optimization on all benchmark functions through all 30 runs (Ackley = 0.2, Rosenbrock = 0.2, Bohachevsky = 9.36E-06, Easom = -0.95, Griewank = 0.01, Rastrigin = 2.5E-03, Schaffer = 1.31E-06, Schwefel 1.2 = 3.2E-05, Sphere = 8.36E-03, Step = 0). Furthermore, the proposed MOFPSO algorithm is hybridized with Back-Propagation (BP), Elman Recurrent Neural Networks (RNN) and Levenberg-Marquardt (LM) Artificial Neural Networks (ANNs) to propose an enhanced data classification framework, especially for data classification applications. The proposed classification framework is then evaluated for classification accuracy, computational time and Mean Squared Error on five benchmark datasets against seven existing techniques. It can be concluded from the simulation results that the proposed MOFPSO-ERNN classification algorithm demonstrated good classification performance in terms of classification accuracy (Breast Cancer = 99.01%, EEG = 99.99%, PIMA Indian Diabetes = 99.37%, Iris = 99.6%, Thyroid = 99.88%) as compared to the existing hybrid classification techniques. Hence, the proposed technique can be employed to improve the overall classification accuracy and reduce the computational time in data classification applications

Water quality indicator interval prediction in wastewater treatment process based on the improved BES-LSSVM algorithm

This paper proposes a novel interval prediction method for effluent water quality indicators (including biochemical oxygen demand (BOD) and ammonia nitrogen (NH3-N)), which are key performance indices in the water quality monitoring and control of a wastewater treatment plant. Firstly, the effluent data regarding BOD/NH3-N and their necessary auxiliary variables are collected. After some basic data pre-processing techniques, the key indicators with high correlation degrees of BOD and NH3-N are analyzed and selected based on a gray correlation analysis algorithm. Next, an improved IBES-LSSVM algorithm is designed to predict the BOD/NH3-N effluent data of a wastewater treatment plant. This algorithm relies on an improved bald eagle search (IBES) optimization algorithm that is used to find the optimal parameters of least squares support vector machine (LSSVM). Then, an interval estimation method is used to analyze the uncertainty of the optimized LSSVM model. Finally, the experimental results demonstrate that the proposed approach can obtain high prediction accuracy, with reduced computational time and an easy calculation process, in predicting effluent water quality parameters compared with other existing algorithms.Peer ReviewedPostprint (published version

Simulation of carbon peaking process of high energy consuming manufacturing industry in Shaanxi Province: A hybrid model based on LMDI and TentSSA-ENN

To achieve the goals of carbon peaking and carbon neutrality in Shaanxi, the high energy consuming manufacturing industry (HMI), as an important contributor, is a key link and important channel for energy conservation. In this paper, the logarithmic mean Divisia index (LMDI) method is applied to determine the driving factors of carbon emissions from the aspects of economy, energy and society, and the contribution of these factors was analyzed. Meanwhile, the improved sparrow search algorithm is used to optimize Elman neural network (ENN) to construct a new hybrid prediction model. Finally, three different development scenarios are designed using scenario analysis method to explore the potential of HMI in Shaanxi Province to achieve carbon peak in the future. The results show that: (1) The biggest promoting factor is industrial structure, and the biggest inhibiting factor is energy intensity among the drivers of carbon emissions, which are analyzed effectively in HMI using the LMDI method. (2) Compared with other neural network models, the proposed hybrid prediction model has higher accuracy and better stability in predicting industrial carbon emissions, it is more suitable for simulating the carbon peaking process of HMI. (3) Only in the coordinated development scenario, the HMI in Shaanxi is likely to achieve the carbon peak in 2030, and the carbon emission curve of the other two scenarios has not reached the peak. Then, according to the results of scenario analysis, specific and evaluable suggestions on carbon emission reduction for HMI in Shaanxi are put forward, such as optimizing energy and industrial structure and making full use of innovative resources of Shaanxi characteristic units

A critical review of online battery remaining useful lifetime prediction methods.

Lithium-ion batteries play an important role in our daily lives. The prediction of the remaining service life of lithium-ion batteries has become an important issue. This article reviews the methods for predicting the remaining service life of lithium-ion batteries from three aspects: machine learning, adaptive filtering, and random processes. The purpose of this study is to review, classify and compare different methods proposed in the literature to predict the remaining service life of lithium-ion batteries. This article first summarizes and classifies various methods for predicting the remaining service life of lithium-ion batteries that have been proposed in recent years. On this basis, by selecting specific criteria to evaluate and compare the accuracy of different models, find the most suitable method. Finally, summarize the development of various methods. According to the research in this article, the average accuracy of machine learning is 32.02% higher than the average of the other two methods, and the prediction cycle is 9.87% shorter than the average of the other two methods