Metaheuristic design of feedforward neural networks: a review of two decades of research

Over the past two decades, the feedforward neural network (FNN) optimization has been a key interest among the researchers and practitioners of multiple disciplines. The FNN optimization is often viewed from the various perspectives: the optimization of weights, network architecture, activation nodes, learning parameters, learning environment, etc. Researchers adopted such different viewpoints mainly to improve the FNN's generalization ability. The gradient-descent algorithm such as backpropagation has been widely applied to optimize the FNNs. Its success is evident from the FNN's application to numerous real-world problems. However, due to the limitations of the gradient-based optimization methods, the metaheuristic algorithms including the evolutionary algorithms, swarm intelligence, etc., are still being widely explored by the researchers aiming to obtain generalized FNN for a given problem. This article attempts to summarize a broad spectrum of FNN optimization methodologies including conventional and metaheuristic approaches. This article also tries to connect various research directions emerged out of the FNN optimization practices, such as evolving neural network (NN), cooperative coevolution NN, complex-valued NN, deep learning, extreme learning machine, quantum NN, etc. Additionally, it provides interesting research challenges for future research to cope-up with the present information processing era

Best-worst northern goshawk optimizer: a new stochastic optimization method

This study introduces a new metaheuristic method: the best-worst northern goshawk optimizer (BW-NGO). This algorithm is an enhanced version of the northern goshawk optimizer (NGO). Every BW-NGO iteration consists of four phases. First, each agent advances toward the best agent and away from the worst agent. Second, each agent moves relatively to the agent selected at random. Third, each agent conducts a local search. Fourth, each agent traces the space at random. The first three phases are mandatory, while the fourth phase is optional. Simulation is performed to assess the performance of BW-NGO. In this simulation, BW-NGO is confronted with four algorithms: particle swarm optimization (PSO), pelican optimization algorithm (POA), golden search optimizer (GSO), and northern goshawk optimizer (NGO). The result exhibits that BW-NGO discovers an acceptable solution for the 23 benchmark functions. BW-NGO is better than PSO, POA, GSO, and NGO in consecutively optimizing 22, 20, 15, and 11 functions. BW-NGO can discover the global optimal solution for three functions

A Review of the Family of Artificial Fish Swarm Algorithms: Recent Advances and Applications

The Artificial Fish Swarm Algorithm (AFSA) is inspired by the ecological behaviors of fish schooling in nature, viz., the preying, swarming, following and random behaviors. Owing to a number of salient properties, which include flexibility, fast convergence, and insensitivity to the initial parameter settings, the family of AFSA has emerged as an effective Swarm Intelligence (SI) methodology that has been widely applied to solve real-world optimization problems. Since its introduction in 2002, many improved and hybrid AFSA models have been developed to tackle continuous, binary, and combinatorial optimization problems. This paper aims to present a concise review of the family of AFSA, encompassing the original ASFA and its improvements, continuous, binary, discrete, and hybrid models, as well as the associated applications. A comprehensive survey on the AFSA from its introduction to 2012 can be found in [1]. As such, we focus on a total of {\color{blue}123} articles published in high-quality journals since 2013. We also discuss possible AFSA enhancements and highlight future research directions for the family of AFSA-based models.Comment: 37 pages, 3 figure

Automated Lung Disease Detection and Classification Using Quantum Glowworm Swarm Optimizer with Quasi Recurrent Neural Network on Chest X-Ray Images

Lung diseases or otherwise called respiratory diseases are airborne diseases that affect the lungs and the other tissues of the lungs. Tuberculosis, Coronavirus Disease 2019 (COVID-19), and Pneumonia are a few instances of lung diseases. If the lung disease is diagnosed and treated in the initial stage, the chances of recovery rate and long-term survival rates can be increased. Usually, lung disease is identified by Chest X-Ray (CXR) image examination, skin test, sputum sample test, Computed Tomography (CT) scan examination, and blood test. Because of its non-invasive and convenient evaluation for overall outcomes of the chest situation, Lung disease can be detected by specialized radiologists on CXR images. In recent times, Deep Learning (DL) applies to medical images for disease detection and has proved an effective technique for detecting disease. The recent advancement of DL supports the detection and classification of lung diseases in medicinal imaging. This article presents an Automated Lung Disease Detection Using Quantum Glowworm Swarm Optimization with Quasi Recurrent Neural Network (QGSO-QRNN) model on CXR imaging. The presented QGSO-QRNN technique focuses on the identification of lung diseases using DL concepts. To accomplish this, the presented QGSO-QRNN technique initially performs image pre-processing by the use of the Gaussian Filtering (GF) technique. Besides, the Faster SqueezeNet approach is exploited for feature vector generation. Finally, the QRNN model is applied for precise classification of lung diseases with the QGSO technique as a hyperparameter optimizer. The investigational assessment of the QGSO-QRNN technique is examined by employing standard medical datasets and the outputs display the promising performance of the QGSO-QRNN technique over other existing techniques by means of diverse measures

Real-coded chemical reaction optimization

Optimization problems can generally be classified as continuous and discrete, based on the nature of the solution space. A recently developed chemical-reaction-inspired metaheuristic, called chemical reaction optimization (CRO), has been shown to perform well in many optimization problems in the discrete domain. This paper is dedicated to proposing a real-coded version of CRO, namely, RCCRO, to solve continuous optimization problems. We compare the performance of RCCRO with a large number of optimization techniques on a large set of standard continuous benchmark functions. We find that RCCRO outperforms all the others on the average. We also propose an adaptive scheme for RCCRO which can improve the performance effectively. This shows that CRO is suitable for solving problems in the continuous domain. © 2012 IEEE.published_or_final_versio

Advanced Methods for Photovoltaic Output Power Forecasting: A Review

Forecasting is a crucial task for successfully integrating photovoltaic (PV) output power into the grid. The design of accurate photovoltaic output forecasters remains a challenging issue, particularly for multistep-ahead prediction. Accurate PV output power forecasting is critical in a number of applications, such as micro-grids (MGs), energy optimization and management, PV integrated in smart buildings, and electrical vehicle chartering. Over the last decade, a vast literature has been produced on this topic, investigating numerical and probabilistic methods, physical models, and artificial intelligence (AI) techniques. This paper aims at providing a complete and critical review on the recent applications of AI techniques; we will focus particularly on machine learning (ML), deep learning (DL), and hybrid methods, as these branches of AI are becoming increasingly attractive. Special attention will be paid to the recent development of the application of DL, as well as to the future trends in this topic