Metaheuristic design of feedforward neural networks: a review of two decades of research

Over the past two decades, the feedforward neural network (FNN) optimization has been a key interest among the researchers and practitioners of multiple disciplines. The FNN optimization is often viewed from the various perspectives: the optimization of weights, network architecture, activation nodes, learning parameters, learning environment, etc. Researchers adopted such different viewpoints mainly to improve the FNN's generalization ability. The gradient-descent algorithm such as backpropagation has been widely applied to optimize the FNNs. Its success is evident from the FNN's application to numerous real-world problems. However, due to the limitations of the gradient-based optimization methods, the metaheuristic algorithms including the evolutionary algorithms, swarm intelligence, etc., are still being widely explored by the researchers aiming to obtain generalized FNN for a given problem. This article attempts to summarize a broad spectrum of FNN optimization methodologies including conventional and metaheuristic approaches. This article also tries to connect various research directions emerged out of the FNN optimization practices, such as evolving neural network (NN), cooperative coevolution NN, complex-valued NN, deep learning, extreme learning machine, quantum NN, etc. Additionally, it provides interesting research challenges for future research to cope-up with the present information processing era

Interpreting Housing Prices with a MultidisciplinaryApproach Based on Nature-Inspired Algorithms and Quantum Computing

Current technology still does not allow the use of quantum computers for broader and individual uses; however, it is possible to simulate some of its potentialities through quantum computing. Quantum computing can be integrated with nature-inspired algorithms to innovatively analyze the dynamics of the real estate market or any other economic phenomenon. With this main aim, this study implements a multidisciplinary approach based on the integration of quantum computing and genetic algorithms to interpret housing prices. Starting from the principles of quantum programming, the work applies genetic algorithms for the marginal price determination of relevant real estate characteristics for a particular segment of Naples’ real estate market. These marginal prices constitute the quantum program inputs to provide, as results, the purchase probabilities corresponding to each real estate characteristic considered. The other main outcomes of this study consist of a comparison of the optimal quantities for each real estate characteristic as determined by the quantum program and the average amounts of the same characteristics but relative to the real estate data sampled, as well as the weights of the same characteristics obtained with the implementation of genetic algorithms. With respect to the current state of the art, this study is among the first regarding the application of quantum computing to interpretation of selling prices in local real estate markets

Parameter calibration of a system dynamics model. A comparison of three evolutionary algorithms

This research seeks to improve the parameter calibration process of a System Dynamics model. A movie release strategies" model has been developed in 2012 using a gradient-based optimization algorithm to estimate all the parameters. On this research, three modern optimization algorithms are initially compared using mathematical benchmark functions and then tested with the model to compare results. The tested algorithms are modifications of the Artificial Bee Colony algorithm, the Cuckoo Search and the Genetic Sampler. The results show that by using the Artificial Bee Colony algorithm, better performance is achieved in terms of speed and fitness. It is also shown how the optimization problem definition was improved resulting from a better optimization process.GEO-SD360JMASV-SYS

An Evolutionary Pentagon Support Vector Finder Method

In dealing with big data, we need effective algorithms; effectiveness that depends, among others, on the ability to remove outliers from the data set, especially when dealing with classification problems. To this aim, support vector finder algorithms have been created to save just the most important data in the data pool. Nevertheless, existing classification algorithms, such as Fuzzy C-Means (FCM), suffer from the drawback of setting the initial cluster centers imprecisely. In this paper, we avoid existing shortcomings and aim to find and remove unnecessary data in order to speed up the final classification task without losing vital samples and without harming final accuracy; in this sense, we present a unique approach for finding support vectors, named evolutionary Pentagon Support Vector (PSV) finder method. The originality of the current research lies in using geometrical computations and evolutionary algorithms to make a more effective system, which has the advantage of higher accuracy on some data sets. The proposed method is subsequently tested with seven benchmark data sets and the results are compared to those obtained from performing classification on the original data (classification before and after PSV) under the same conditions. The testing returned promising results

Ensemble of heterogeneous flexible neural trees using multiobjective genetic programming

Machine learning algorithms are inherently multiobjective in nature, where approximation error minimization and model's complexity simplification are two conflicting objectives. We proposed a multiobjective genetic programming (MOGP) for creating a heterogeneous flexible neural tree (HFNT), tree-like flexible feedforward neural network model. The functional heterogeneity in neural tree nodes was introduced to capture a better insight of data during learning because each input in a dataset possess different features. MOGP guided an initial HFNT population towards Pareto-optimal solutions, where the final population was used for making an ensemble system. A diversity index measure along with approximation error and complexity was introduced to maintain diversity among the candidates in the population. Hence, the ensemble was created by using accurate, structurally simple, and diverse candidates from MOGP final population. Differential evolution algorithm was applied to fine-tune the underlying parameters of the selected candidates. A comprehensive test over classification, regression, and time-series datasets proved the efficiency of the proposed algorithm over other available prediction methods. Moreover, the heterogeneous creation of HFNT proved to be efficient in making ensemble system from the final population

Recent tendencies in the use of optimization techniques in geotechnics:a review

The use of optimization methods in geotechnics dates back to the 1950s. They were used in slope stability analysis (Bishop) and evolved to a wide range of applications in ground engineering. We present here a non-exhaustive review of recent publications that relate to the use of different optimization techniques in geotechnical engineering. Metaheuristic methods are present in almost all the problems in geotechnics that deal with optimization. In a number of cases, they are used as single techniques, in others in combination with other approaches, and in a number of situations as hybrids. Different results are discussed showing the advantages and issues of the techniques used. Computational time is one of the issues, as well as the assumptions those methods are based on. The article can be read as an update regarding the recent tendencies in the use of optimization techniques in geotechnics

Bee Hive Monitoring System - Solutions for the automated health monitoring

Cerca de um terço da produção global de alimentos depende da polinização das abelhas, tornando-as vitais para a economia mundial. No entanto, existem diversas ameaças à sobrevivência das espécies de abelhas, tais como incêndios florestais, stress humano induzido, subnutrição, poluição, perda de biodiversidade, agricultura intensiva e predadores como as vespas asiáticas. Destes problemas, pode-se observar um aumento da necessidade de soluções automatizadas que possam auxiliar na monitorização remota de colmeias de abelhas. O objetivo desta tese é desenvolver soluções baseadas em Aprendizagem Automática para problemas que podem ser identificados na apicultura, usando técnicas e conceitos de Deep Learning, Visão Computacional e Processamento de Sinal. Este documento descreve o trabalho da tese de mestrado, motivado pelo problema acima exposto, incluindo a revisão de literatura, análise de valor, design, planeamento de testes e validação e o desenvolvimento e estudo computacional das soluções. Concretamente, o trabalho desta tese de mestrado consistiu no desenvolvimento de soluções para três problemas – classificação da saúde de abelhas a partir de imagens e a partir de áudio, e deteção de abelhas e vespas asiáticas. Os resultados obtidos para a classificação da saúde das abelhas a partir de imagens foram significativamente satisfatórios, excedendo os que foram obtidos pela metodologia definida no trabalho base utilizado para a tarefa, que foi encontrado durante a revisão da literatura. No caso da classificação da saúde das abelhas a partir de áudio e da deteção de abelhas e vespas asiáticas, os resultados obtidos foram modestos e demonstram potencial aplicabilidade das respetivas metodologias desenvolvidas nos problemas-alvo. Pretende-se que as partes interessadas desta tese consigam obter informações, metodologias e perceções adequadas sobre o desenvolvimento de soluções de IA que possam ser integradas num sistema de monitorização da saúde de abelhas, incluindo custos e desafios inerentes à implementação das soluções. O trabalho futuro desta dissertação de mestrado consiste em melhorar os resultados dos modelos de classificação da saúde das abelhas a partir de áudio e de deteção de objetos, incluindo a publicação de artigos para obter validação pela comunidade científica.Up to one third of the global food production depends on the pollination of honey bees, making them vital for the world economy. However, between forest fires, human-induced stress, poor nutrition, pollution, biodiversity loss, intensive agriculture, and predators such as Asian Hornets, there are plenty of threats to the honey bee species’ survival. From these problems, a rise of the need for automated solutions that can aid with remote monitoring of bee hives can be observed. The goal of this thesis is to develop Machine Learning based solutions to problems that can be identified in beekeeping and apiculture, using Deep Learning, Computer Vision and Signal Processing techniques and concepts. The current document describes master thesis’ work, motivated from the above problem statement, including the literature review, value analysis, design, testing and validation planning and the development and computational study of the solutions. Specifically, this master thesis’ work consisted in developing solutions to three problems – bee health classification through images and audio, and bee and Asian wasp detection. Results obtained for the bee health classification through images were significantly satisfactory, exceeding those reported by the baseline work found during literature review. On the case of bee health classification through audio and bee and Asian wasp detection, these obtained results were modest and showcase potential applicability of the respective developed methodologies in the target problems. It is expected that stakeholders of this thesis obtain adequate information, methodologies and insights into the development of AI solutions that can be integrated in a bee health monitoring system, including inherent costs and challenges that arise with the implementation of the solutions. Future work of this master thesis consists in improving the results of the bee health classification through audio and the object detection models, including publishing of papers to seek validation by the scientific community