Metaheuristic design of feedforward neural networks: a review of two decades of research

Over the past two decades, the feedforward neural network (FNN) optimization has been a key interest among the researchers and practitioners of multiple disciplines. The FNN optimization is often viewed from the various perspectives: the optimization of weights, network architecture, activation nodes, learning parameters, learning environment, etc. Researchers adopted such different viewpoints mainly to improve the FNN's generalization ability. The gradient-descent algorithm such as backpropagation has been widely applied to optimize the FNNs. Its success is evident from the FNN's application to numerous real-world problems. However, due to the limitations of the gradient-based optimization methods, the metaheuristic algorithms including the evolutionary algorithms, swarm intelligence, etc., are still being widely explored by the researchers aiming to obtain generalized FNN for a given problem. This article attempts to summarize a broad spectrum of FNN optimization methodologies including conventional and metaheuristic approaches. This article also tries to connect various research directions emerged out of the FNN optimization practices, such as evolving neural network (NN), cooperative coevolution NN, complex-valued NN, deep learning, extreme learning machine, quantum NN, etc. Additionally, it provides interesting research challenges for future research to cope-up with the present information processing era

Performance Improvement of Low-Cost Iterative Learning-Based Fuzzy Control Systems for Tower Crane Systems

This paper is dedicated to the memory of Prof. Ioan Dzitac, one of the fathers of this journal and its founding Editor-in-Chief till 2021. The paper addresses the performance improvement of three Single Input-Single Output (SISO) fuzzy control systems that control separately the positions of interest of tower crane systems, namely the cart position, the arm angular position and the payload position. Three separate low-cost SISO fuzzy controllers are employed in terms of first order discrete-time intelligent Proportional-Integral (PI) controllers with Takagi-Sugeno-Kang Proportional-Derivative (PD) fuzzy terms. Iterative Learning Control (ILC) system structures with PD learning functions are involved in the current iteration SISO ILC structures. Optimization problems are defined in order to tune the parameters of the learning functions. The objective functions are defined as the sums of squared control errors, and they are solved in the iteration domain using the recent metaheuristic Slime Mould Algorithm (SMA). The experimental results prove the performance improvement of the SISO control systems after ten iterations of SMA

Robustness analysis of evolutionary controller tuning using real systems

A genetic algorithm (GA) presents an excellent method for controller parameter tuning. In our work, we evolved the heading as well as the altitude controller for a small lightweight helicopter. We use the real flying robot to evaluate the GA's individuals rather than an artificially consistent simulator. By doing so we avoid the ldquoreality gaprdquo, taking the controller from the simulator to the real world. In this paper we analyze the evolutionary aspects of this technique and discuss the issues that need to be considered for it to perform well and result in robust controllers

Q-LEARNING, POLICY ITERATION AND ACTOR-CRITIC REINFORCEMENT LEARNING COMBINED WITH METAHEURISTIC ALGORITHMS IN SERVO SYSTEM CONTROL

This paper carries out the performance analysis of three control system structures and approaches, which combine Reinforcement Learning (RL) and Metaheuristic Algorithms (MAs) as representative optimization algorithms. In the first approach, the Gravitational Search Algorithm (GSA) is employed to initialize the parameters (weights and biases) of the Neural Networks (NNs) involved in Deep Q-Learning by replacing the traditional way of initializing the NNs based on random generated values. In the second approach, the Grey Wolf Optimizer (GWO) algorithm is employed to train the policy NN in Policy Iteration RL-based control. In the third approach, the GWO algorithm is employed as a critic in an Actor-Critic framework, and used to evaluate the performance of the actor NN. The goal of this paper is to analyze all three RL-based control approaches, aiming to determine which one represents the best fit for solving the proposed control optimization problem. The performance analysis is based on non-parametric statistical tests conducted on the data obtained from real-time experimental results specific to nonlinear servo system position control

Grey Wolf Optimizer-Based Approaches to Path Planning and Fuzzy Logic-based Tracking Control for Mobile Robots

This paper proposes two applications of Grey Wolf Optimizer (GWO) algorithms to a path planning (PaPl) problem and a Proportional-Integral (PI)-fuzzy controller tuning problem. Both optimization problems solved by GWO algorithms are explained in detail. An off-line GWO-based PaPl approach for Nonholonomic Wheeled Mobile Robots (NWMRs) in static environments is proposed. Once the PaPl problem is solved resulting in the reference trajectory of the robots, the paper also suggests a GWO-based approach to tune cost-effective PI-fuzzy controllers in tracking control problem for NWMRs. The experimental results are demonstrated through simple multiagent settings conducted on the nRobotic platform developed at the Politehnica University of Timisoara, Romania, and they prove both the effectiveness of the two GWO-based approaches and major performance improvement

A CENTER MANIFOLD THEORY-BASED APPROACH TO THE STABILITY ANALYSIS OF STATE FEEDBACK TAKAGI-SUGENO-KANG FUZZY CONTROL SYSTEMS

The aim of this paper is to propose a stability analysis approach based on the application of the center manifold theory and applied to state feedback Takagi-Sugeno-Kang fuzzy control systems. The approach is built upon a similar approach developed for Mamdani fuzzy controllers. It starts with a linearized mathematical model of the process that is accepted to belong to the family of single input second-order nonlinear systems which are linear with respect to the control signal. In addition, smooth right-hand terms of the state-space equations that model the processes are assumed. The paper includes the validation of the approach by application to stable state feedback Takagi-Sugeno-Kang fuzzy control system for the position control of an electro-hydraulic servo-system

AUTOMOTIVE APPLICATIONS OF EVOLVING TAKAGI-SUGENO-KANG FUZZY MODELS

This paper presents theoretical and application results concerning the development of evolving Takagi-Sugeno-Kang fuzzy models for two dynamic systems, which will be viewed as controlled processes, in the field of automotive applications. The two dynamic systems models are nonlinear dynamics of the longitudinal slip in the Anti-lock Braking Systems (ABS) and the vehicle speed in vehicles with the Continuously Variable Transmission (CVT) systems. The evolving Takagi-Sugeno-Kang fuzzy models are obtained as discrete-time fuzzy models by incremental online identification algorithms. The fuzzy models are validated against experimental results in the case of the ABS and the first principles simulation results in the case of the vehicle with the CVT

Constraints on interacting dark energy models through cosmic chronometers and Gaussian process

Energy flows between dark energy and dark matter may alleviate the Hubble tension and mitigate the coincidence problem. In this paper, after reconstructing the redshift evolution of the Hubble function by adopting Gaussian process techniques, we estimate the best-fit parameters for some flat Friedmann cosmological models based on a Modified Chaplygin Gas interacting with dark matter. In fact, the expansion history of the Universe will be investigated because passively evolving early galaxies constitute cosmic chronometers. An estimate for the present-day values of the deceleration parameter, adiabatic speed of sound within the dark energy fluid, effective dark energy, and dark matter equation of state parameters is provided. By this, we mean that the interaction term between the two dark fluids, which breaks the Bianchi symmetries, will be interpreted as an effective contribution to the dark matter pressure similarly to the framework of the \lq\lq Generalized Dark Matter". Fixing a certain value for the dark matter abundance at the present day as initial condition will allow us to investigate whether the estimate of the Hubble constant is sensitive to the dark matter - dark energy coupling. We will also show that the cosmic chronometers data favor a hot dark matter, and that our findings are in agreement with the Le Ch\^atelier-Braun principle according to which dark energy should decay into dark matter (and not vice versa).Comment: 14 pages, 2 figure