Learning enhancement of radial basis function network with particle swarm optimization

Back propagation (BP) algorithm is the most common technique in Artificial Neural Network (ANN) learning, and this includes Radial Basis Function Network. However, major disadvantages of BP are its convergence rate is relatively slow and always being trapped at the local minima. To overcome this problem, Particle Swarm Optimization (PSO) has been implemented to enhance ANN learning to increase the performance of network in terms of convergence rate and accuracy. In Back Propagation Radial Basis Function Network (BP-RBFN), there are many elements to be considered. These include the number of input nodes, hidden nodes, output nodes, learning rate, bias, minimum error and activation/transfer functions. These elements will affect the speed of RBF Network learning. In this study, Particle Swarm Optimization (PSO) is incorporated into RBF Network to enhance the learning performance of the network. Two algorithms have been developed on error optimization for Back Propagation of Radial Basis Function Network (BP-RBFN) and Particle Swarm Optimization of Radial Basis Function Network (PSO-RBFN) to seek and generate better network performance. The results show that PSO-RBFN give promising outputs with faster convergence rate and better classifications compared to BP-RBFN

Radial basis function classifier construction using particle swarm optimisation aided orthogonal forward regression

We develop a particle swarm optimisation (PSO) aided orthogonal forward regression (OFR) approach for constructing radial basis function (RBF) classifiers with tunable nodes. At each stage of the OFR construction process, the centre vector and diagonal covariance matrix of one RBF node is determined efficiently by minimising the leave-one-out (LOO) misclassification rate (MR) using a PSO algorithm. Compared with the state-of-the-art regularisation assisted orthogonal least square algorithm based on the LOO MR for selecting fixednode RBF classifiers, the proposed PSO aided OFR algorithm for constructing tunable-node RBF classifiers offers significant advantages in terms of better generalisation performance and smaller model size as well as imposes lower computational complexity in classifier construction process. Moreover, the proposed algorithm does not have any hyperparameter that requires costly tuning based on cross validation

Radial Basis Function Neural Networks : A Review

Radial Basis Function neural networks (RBFNNs) represent an attractive alternative to other neural network models. One reason is that they form a unifying link between function approximation, regularization, noisy interpolation, classification and density estimation. It is also the case that training RBF neural networks is faster than training multi-layer perceptron networks. RBFNN learning is usually split into an unsupervised part, where center and widths of the Gaussian basis functions are set, and a linear supervised part for weight computation. This paper reviews various learning methods for determining centers, widths, and synaptic weights of RBFNN. In addition, we will point to some applications of RBFNN in various fields. In the end, we name software that can be used for implementing RBFNNs

A Comprehensive Review on Various Estimation Techniques for Multi Input Multi Output Channel

لقد تطورت مشكلة تقدير القناة اللاسلكية بسبب بعض التأثيرات غير المرغوب فيها للخواص الفيزيائية للقناة على الإشارات المرسلة. في نهاية المستقبل، التشوه، والتأخير، والتوهين، والتداخلات، ونوبات الطور هي أكثر المشكلات التي تواجهها مع الإشارات المستقبلة. من أجل التغلب على تأثيرات القناة وتوفير جودة كاملة تقريبًا لنقل البيانات، يلزم تقدير معلومات القناة. في أنظمة المخرجات متعددة المدخلات والمخرجات (MIMO)، يعتبر تقدير القناة خطوة أكثر تعقيدًا مقارنة بأنظمة المخرجات ذات المدخلات المفردة، SISO، نظرًا لأن عدد القنوات الفرعية التي تحتاج إلى تقدير أكبر بكثير من انظمة SISO. الهدف الأساسي من هذه الورقة البحثية هو مراجعة شاملة لاغلب الخوارزميات الشهيرة والفعالة التي تم ابتكارها لحل مشكلة تقدير قناة MIMO في أنظمة الاتصالات اللاسلكية. في هذه الورقة، تم تصنيف هذه التقنيات إلى ثلاث مجموعات: غير المكفوفين، شبه الأعمى وتقدير أعمى. لكل مجموعة، يتم تقديم توضيح مختصر لخوارزميات التقدير المألوفة. وأخيرًا، نقارن بين هذه التقنيات استنادًا إلى التعقيد الحسابي والكمون ودقة التقدير.The problem of wireless channel estimation has been evolving due to some undesirable effects of channel physical properties on transmitted signals. At the receiver end, distortions, delays, attenuations, interferences, and phase shifts are the most issues encounter together with the received signals. In order to overcome channel effects and provide almost a perfect quality of data transmission, channel parameter estimation is needed. In Multiple Input-Multiple Output systems (MIMO), channel estimation is a more complicated step as compared with the Single Input-Single Output systems, SISO, because of the fact that the number of sub-channels that needs estimate is much greater than SISO systems. The fundamental objective of this research paper is to go over the famous and efficient algorithms that have been innovated to solve the problem of MIMO channel estimation in wireless communication systems. In this paper, these techniques have been classified into three groups: non-blind, semi-blind and blind estimation. For each group, a brief illustration is presented for familiar estimation algorithms. Finally, we compare between these techniques based on computational complexity, latency and estimation accuracy

Encog: Library of Interchangeable Machine Learning Models for Java and C#

This paper introduces the Encog library for Java and C#, a scalable, adaptable, multiplatform machine learning framework that was 1st released in 2008. Encog allows a variety of machine learning models to be applied to datasets using regression, classification, and clustering. Various supported machine learning models can be used interchangeably with minimal recoding. Encog uses efficient multithreaded code to reduce training time by exploiting modern multicore processors. The current version of Encog can be downloaded from http://www.encog.org

A Review on Optimizing Radial Basis Function Neural Network using Nature Inspired Algorithm

Radial Basis Function (RBF) is a type of feed forward neural network .This function can be applied to interpolation, chaotic time-series modeling, control engineering, image restoration, data fusion etc. In RBF network, parameters of basis functions (such as width, the position and number of centers) in the nonlinear hidden layer have great influence on the performance of the network. Common RBF training algorithms cannot possibly find the global optima of nonlinear parameters in the hidden layer, and often have too many hidden units to reach certain approximation abilities, which will lead to too large a scale for the network and decline of generalization ability. Also, RBF neural network has the advantages of adaptive and self-learning ability, but it is difficult to determine the number of hidden layer neurons, and the weights learning ability from hidden layer to the output layer is low; these deficiencies easily lead to decreasing learning ability and recognition precision. Secondly, the Swarm Intelligence Algorithms are (Meta-Heuristic) development Algorithms, which attracted much attention and appeared its ability in the last ten years within many applications such as data mining, scheduling, improve the performance of artificial neural networks (ANN) and classification. So, in this paper the work of Artificial Bee Colony (ABC), Genetic algorithm(GA), Particle swarm optimization(PSO) and Bat algorithm(BA) have been reviewed, which optimized the RBF neural network in their own terms