Lattice dynamical wavelet neural networks implemented using particle swarm optimisation for spatio-temporal system identification

Starting from the basic concept of coupled map lattices, a new family of adaptive wavelet neural networks, called lattice dynamical wavelet neural networks (LDWNN), is introduced for spatiotemporal system identification, by combining an efficient wavelet representation with a coupled map lattice model. A new orthogonal projection pursuit (OPP) method, coupled with a particle swarm optimisation (PSO) algorithm, is proposed for augmenting the proposed network. A novel two-stage hybrid training scheme is developed for constructing a parsimonious network model. In the first stage, by applying the orthogonal projection pursuit algorithm, significant wavelet-neurons are adaptively and successively recruited into the network, where adjustable parameters of the associated waveletneurons are optimised using a particle swarm optimiser. The resultant network model, obtained in the first stage, may however be redundant. In the second stage, an orthogonal least squares (OLS) algorithm is then applied to refine and improve the initially trained network by removing redundant wavelet-neurons from the network. The proposed two-stage hybrid training procedure can generally produce a parsimonious network model, where a ranked list of wavelet-neurons, according to the capability of each neuron to represent the total variance in the system output signal is produced. Two spatio-temporal system identification examples are presented to demonstrate the performance of the proposed new modelling framework

Generalised cellular neural networks (GCNNs) constructed using particle swarm optimisation for spatio-temporal evolutionary pattern identification

Particle swarm optimization (PSO) is introduced to implement a new constructive learning algorithm for training generalized cellular neural networks (GCNNs) for the identification of spatio-temporal evolutionary (STE) systems. The basic idea of the new PSO-based learning algorithm is to successively approximate the desired signal by progressively pursuing relevant orthogonal projections. This new algorithm will thus be referred to as the orthogonal projection pursuit (OPP) algorithm, which is in mechanism similar to the conventional projection pursuit approach. A novel two-stage hybrid training scheme is proposed for constructing a parsimonious GCNN model. In the first stage, the orthogonal projection pursuit algorithm is applied to adaptively and successively augment the network, where adjustable parameters of the associated units are optimized using a particle swarm optimizer. The resultant network model produced at the first stage may be redundant. In the second stage, a forward orthogonal regression (FOR) algorithm, aided by mutual information estimation, is applied to re. ne and improve the initially trained network. The effectiveness and performance of the proposed method is validated by applying the new modeling framework to a spatio-temporal evolutionary system identification problem

Design of neuro-swarming computational solver for the fractional Bagley–Torvik mathematical model

This study is to introduce a novel design and implementation of a neuro-swarming computational numerical procedure for numerical treatment of the fractional Bagley–Torvik mathematical model (FBTMM). The optimization procedures based on the global search with particle swarm optimization (PSO) and local search via active-set approach (ASA), while Mayer wavelet kernel-based activation function used in neural network (MWNNs) modeling, i.e., MWNN-PSOASA, to solve the FBTMM. The efficiency of the proposed stochastic solver MWNN-GAASA is utilized to solve three different variants based on the fractional order of the FBTMM. For the meticulousness of the stochastic solver MWNN-PSOASA, the obtained and exact solutions are compared for each variant of the FBTMM with reasonable accuracy. For the reliability of the stochastic solver MWNN-PSOASA, the statistical investigations are provided based on the stability, robustness, accuracy and convergence metrics.Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This paper has been partially supported by Fundación Séneca de la Región de Murcia grant numbers 20783/PI/18, and Ministerio de Ciencia, Innovación y Universidades grant number PGC2018-0971-B-100