Fast Neural Network Ensemble Learning via Negative-Correlation Data Correction

This letter proposes a new negative correlation (NC) learning method that is both easy to implement and has the advantages that: 1) it requires much lesser communication overhead than the standard NC method and 2) it is applicable to ensembles of heterogenous networks. © 2005 IEEE

Metaheuristic design of feedforward neural networks: a review of two decades of research

Over the past two decades, the feedforward neural network (FNN) optimization has been a key interest among the researchers and practitioners of multiple disciplines. The FNN optimization is often viewed from the various perspectives: the optimization of weights, network architecture, activation nodes, learning parameters, learning environment, etc. Researchers adopted such different viewpoints mainly to improve the FNN's generalization ability. The gradient-descent algorithm such as backpropagation has been widely applied to optimize the FNNs. Its success is evident from the FNN's application to numerous real-world problems. However, due to the limitations of the gradient-based optimization methods, the metaheuristic algorithms including the evolutionary algorithms, swarm intelligence, etc., are still being widely explored by the researchers aiming to obtain generalized FNN for a given problem. This article attempts to summarize a broad spectrum of FNN optimization methodologies including conventional and metaheuristic approaches. This article also tries to connect various research directions emerged out of the FNN optimization practices, such as evolving neural network (NN), cooperative coevolution NN, complex-valued NN, deep learning, extreme learning machine, quantum NN, etc. Additionally, it provides interesting research challenges for future research to cope-up with the present information processing era

Neural Network Ensembles and Their Application to Traffic Flow Prediction in Telecommunications Networks

This series is dedicated to reporting our recent research in spatial science in general and economic geography & geoinformatics in particular. It contains scientific studies focusing on spatial phenomena, utilizing theoretical frameworks, analytical methods and empirical procedures specifically designed for spatial analysis. The aim is to present the research at the Department to an informed readership in universities, research organizations and policy-making institutions throughout the world. The type of materials considered for publication in the series includes interim reports presenting work in progress and papers which have been submitted for publication elsewhere.Series: Discussion Papers of the Institute for Economic Geography and GIScienc

Cooperative coevolution of artificial neural network ensembles for pattern classification

This paper presents a cooperative coevolutive approach for designing neural network ensembles. Cooperative coevolution is a recent paradigm in evolutionary computation that allows the effective modeling of cooperative environments. Although theoretically, a single neural network with a sufficient number of neurons in the hidden layer would suffice to solve any problem, in practice many real-world problems are too hard to construct the appropriate network that solve them. In such problems, neural network ensembles are a successful alternative. Nevertheless, the design of neural network ensembles is a complex task. In this paper, we propose a general framework for designing neural network ensembles by means of cooperative coevolution. The proposed model has two main objectives: first, the improvement of the combination of the trained individual networks; second, the cooperative evolution of such networks, encouraging collaboration among them, instead of a separate training of each network. In order to favor the cooperation of the networks, each network is evaluated throughout the evolutionary process using a multiobjective method. For each network, different objectives are defined, considering not only its performance in the given problem, but also its cooperation with the rest of the networks. In addition, a population of ensembles is evolved, improving the combination of networks and obtaining subsets of networks to form ensembles that perform better than the combination of all the evolved networks. The proposed model is applied to ten real-world classification problems of a very different nature from the UCI machine learning repository and proben1 benchmark set. In all of them the performance of the model is better than the performance of standard ensembles in terms of generalization error. Moreover, the size of the obtained ensembles is also smaller

Physical and neural entrainment to rhythm: human sensorimotor coordination across tasks and effector systems.

The human sensorimotor system can be readily entrained to environmental rhythms, through multiple sensory modalities. In this review, we provide an overview of theories of timekeeping that make this neuroentrainment possible. First, we present recent evidence that contests the assumptions made in classic timekeeper models. The role of state estimation, sensory feedback and movement parameters on the organization of sensorimotor timing are discussed in the context of recent experiments that examined simultaneous timing and force control. This discussion is extended to the study of coordinated multi-effector movements and how they may be entrained