CIXL2: A Crossover Operator for Evolutionary Algorithms Based on Population Features

In this paper we propose a crossover operator for evolutionary algorithms with real values that is based on the statistical theory of population distributions. The operator is based on the theoretical distribution of the values of the genes of the best individuals in the population. The proposed operator takes into account the localization and dispersion features of the best individuals of the population with the objective that these features would be inherited by the offspring. Our aim is the optimization of the balance between exploration and exploitation in the search process. In order to test the efficiency and robustness of this crossover, we have used a set of functions to be optimized with regard to different criteria, such as, multimodality, separability, regularity and epistasis. With this set of functions we can extract conclusions in function of the problem at hand. We analyze the results using ANOVA and multiple comparison statistical tests. As an example of how our crossover can be used to solve artificial intelligence problems, we have applied the proposed model to the problem of obtaining the weight of each network in a ensemble of neural networks. The results obtained are above the performance of standard methods

Metaheuristic design of feedforward neural networks: a review of two decades of research

Over the past two decades, the feedforward neural network (FNN) optimization has been a key interest among the researchers and practitioners of multiple disciplines. The FNN optimization is often viewed from the various perspectives: the optimization of weights, network architecture, activation nodes, learning parameters, learning environment, etc. Researchers adopted such different viewpoints mainly to improve the FNN's generalization ability. The gradient-descent algorithm such as backpropagation has been widely applied to optimize the FNNs. Its success is evident from the FNN's application to numerous real-world problems. However, due to the limitations of the gradient-based optimization methods, the metaheuristic algorithms including the evolutionary algorithms, swarm intelligence, etc., are still being widely explored by the researchers aiming to obtain generalized FNN for a given problem. This article attempts to summarize a broad spectrum of FNN optimization methodologies including conventional and metaheuristic approaches. This article also tries to connect various research directions emerged out of the FNN optimization practices, such as evolving neural network (NN), cooperative coevolution NN, complex-valued NN, deep learning, extreme learning machine, quantum NN, etc. Additionally, it provides interesting research challenges for future research to cope-up with the present information processing era

Predicting the energy output of wind farms based on weather data: important variables and their correlation

Pre-print available at: http://arxiv.org/abs/1109.1922Wind energy plays an increasing role in the supply of energy world wide. The energy output of a wind farm is highly dependent on the weather conditions present at its site. If the output can be predicted more accurately, energy suppliers can coordinate the collaborative production of different energy sources more efficiently to avoid costly overproduction. In this paper, we take a computer science perspective on energy prediction based on weather data and analyze the important parameters as well as their correlation on the energy output. To deal with the interaction of the different parameters, we use symbolic regression based on the genetic programming tool DataModeler. Our studies are carried out on publicly available weather and energy data for a wind farm in Australia. We report on the correlation of the different variables for the energy output. The model obtained for energy prediction gives a very reliable prediction of the energy output for newly supplied weather data. © 2012 Elsevier Ltd.Ekaterina Vladislavleva, Tobias Friedrich, Frank Neumann, Markus Wagne

Genetic learning as an explanation of stylized facts of foreign exchange markets

This paper revisits the Kareken-Wallace model of exchange rate formation in a two-country overlapping generations world. Following the seminal paper by Arifovic (Journal of Political Economy, 104, 1996, 510 – 541) we investigate a dynamic version of the model in which agents? decision rules are updated using genetic algorithms. Our main interest is in whether the equilibrium dynamics resulting from this learning process helps to explain the main stylized facts of free-floating exchange rates (unit roots in levels together with fat tails in returns and volatility clustering). Our time series analysis of simulated data indicates that for particular parameterizations, the characteristics of the exchange rate dynamics are, in fact, very similar to those of empirical data. The similarity appears to be quite insensitive with respect to some of the ingredients of the GA algorithm (i.e. utility-based versus rank-based or tournament selection, binary or real coding). However, appearance or not of realistic time series characteristics depends crucially on the mutation probability (which should be low) and the number of agents (not more than about 1000). With a larger population, this collective learning dynamics looses its realistic appearance and instead exhibits regular periodic oscillations of the agents? choice variables. --learning , genetic algorithms , exchange rate dynamics

Genetic learning as an explanation of stylized facts of foreign exchange markets

This paper revisits the Kareken-Wallace model of exchange rate formation in a two-country overlapping generations world. Following the seminal paper by Arifovic (Journal of Political Economy, 104, 1996, 510-541) we investigate a dynamic version of the model in which agents' decision rules are updated using genetic algorithms. Our main interest is in whether the equilibrium dynamics resulting from this learning process helps to explain the main stylized facts of free-floating exchange rates (unit roots in levels together with fat tails in returns and volatility clustering). Our time series analysis of simulated data indicates that for particular parameterizations, the characteristics of the exchange rate dynamics are, in fact, very similar to those of empirical data. The similarity appears to be quite insensitive with respect to some of the ingredients of the GA algorithm (i.e. utilitybased versus rank-based or tournament selection, binary or real coding). However, appearance or not of realistic time series characteristics depends crucially on the mutation probability (which should be low) and the number of agents (not more than about 1000). With a larger population, this collective learning dynamics looses its realistic appearance and instead exhibits regular periodic oscillations of the agents' choice variables. -- Dieses Papier betrachtet das Kareken-Wallace-Modell für die Wechselkursbildung in einer Welt mit 2 Ländern und sich überlappenden Generationen. In der Nachfolge des zukunftsweisenden Papiers von Arifovic (1996) untersuchen wir eine dynamische Version des Modells bei dem die Entscheidungsregeln mithilfe genetischer Algorithmen jeweils aktualisiert werden. Unser Hauptinteresse geht dahin, herauszufinden, ob die Gleichgewichtsdynamik, die aus diesem Lernprozess resultiert, dabei helfen kann, die wichtigsten stilisierten Fakten von flexiblen Wechselkursen zu erklären (Einheitswurzeln bei den Niveaus mit dicken Enden der Ertragsverteilung und Klumpenbildung bei den Volatilitäten). Unsere Analyse simulierter Daten weist darauf hin, dass für bestimmte Parametrisierungen der Charakter der Wechselkursdynamik tatsächlich dem von empirischen Daten sehr ähnlich ist. Die Ähnlichkeit scheint sehr wenig von speziellen Eigenschaften des gewählten GA-Algorithmus abzuhängen (z. B. nutzenbasiert versus rangbasiert, binäre oder reale Kodierung). Dagegen ist die Mutationswahrscheinlichkeit (die niedrig sein sollte) und die Anzahl der Agenten (die nicht größer als 1000 sein sollte) wichtig. Mit mehr Teilnehmern verliert die kollektive Lerndynamik ihr realistisches Aussehen und es kommt zu regelmäßigen periodischen Schwankungen bei den Variablen, die die Agenten auswählen.Learning,Genetic algorithms,Exchange rate dynamics