Metaheuristic design of feedforward neural networks: a review of two decades of research

Over the past two decades, the feedforward neural network (FNN) optimization has been a key interest among the researchers and practitioners of multiple disciplines. The FNN optimization is often viewed from the various perspectives: the optimization of weights, network architecture, activation nodes, learning parameters, learning environment, etc. Researchers adopted such different viewpoints mainly to improve the FNN's generalization ability. The gradient-descent algorithm such as backpropagation has been widely applied to optimize the FNNs. Its success is evident from the FNN's application to numerous real-world problems. However, due to the limitations of the gradient-based optimization methods, the metaheuristic algorithms including the evolutionary algorithms, swarm intelligence, etc., are still being widely explored by the researchers aiming to obtain generalized FNN for a given problem. This article attempts to summarize a broad spectrum of FNN optimization methodologies including conventional and metaheuristic approaches. This article also tries to connect various research directions emerged out of the FNN optimization practices, such as evolving neural network (NN), cooperative coevolution NN, complex-valued NN, deep learning, extreme learning machine, quantum NN, etc. Additionally, it provides interesting research challenges for future research to cope-up with the present information processing era

Novel Bacteria Foraging Optimization for Energy-efficient Communication in Wireless Sensor Network

Optimization techniques based on Swarm-intelligence has been reported to have significant benefits towards addressing communication issues in Wireless Sensor Network (WSN). We reviewed the most dominant swarm intelligence technique called as Bacteria Foraging Optimization (BFO) to find that there are very less significant model towards addressing the problems in WSN. Therefore, the proposed paper introduced a novel BFO algorithm which maintains a very good balance between the computational and communication demands of a sensor node unlike the conventional BFO algorithms. The significant contribution of the proposed study is to minimize the iterative steps and inclusion of minimization of both receiving / transmittance power in entire data aggregation process. The study outcome when compared with standard energy-efficient algorithm was found to offer superior network lifetime in terms of higher residual energy as well as data transmission performance

A survey of swarm intelligence for dynamic optimization: algorithms and applications

Swarm intelligence (SI) algorithms, including ant colony optimization, particle swarm optimization, bee-inspired algorithms, bacterial foraging optimization, firefly algorithms, fish swarm optimization and many more, have been proven to be good methods to address difficult optimization problems under stationary environments. Most SI algorithms have been developed to address stationary optimization problems and hence, they can converge on the (near-) optimum solution efficiently. However, many real-world problems have a dynamic environment that changes over time. For such dynamic optimization problems (DOPs), it is difficult for a conventional SI algorithm to track the changing optimum once the algorithm has converged on a solution. In the last two decades, there has been a growing interest of addressing DOPs using SI algorithms due to their adaptation capabilities. This paper presents a broad review on SI dynamic optimization (SIDO) focused on several classes of problems, such as discrete, continuous, constrained, multi-objective and classification problems, and real-world applications. In addition, this paper focuses on the enhancement strategies integrated in SI algorithms to address dynamic changes, the performance measurements and benchmark generators used in SIDO. Finally, some considerations about future directions in the subject are given

Short term complex hydro thermal scheduling using integrated PSO-IBF algorithm

In this article, an integrated evolutionary technique such as particle swarm optimization (PSO) algorithm and improved bacterial foraging algorithm (IBFA) have been developed to provide an optimum solution to the scheduling problem with complex thermal and hydro generating stations. PSO algorithm is framed based on the intelligent behavior of the fish school and a flock of birds and the optimal solution in the multidimensional search region is achieved by assigning a random velocity to each potential solution (called the particle). BFA is designed by following the prey-seeking (chemotactic) nature of E. coli bacteria. This technique is followed in an improved manner to get the convergence rate in dynamic for a hyperspace problem by implementing a chemotactic step in a linearly decreased way instead of the static one. The effectiveness of this integrated algorithm is evaluated by using it in a complex thermal and hydro generating system. In this testing system, multiple numbers of cascaded reservoirs in hydro plants have a time coupling effect and thermal power units have a valve point loading effect. The simulation results indicate its merits by comparing it with other meta-heuristic techniques related to the fuel cost required to generate the thermal power.