Performance analysis for genetic algorithms.

Genetic algorithms have been shown effective for solving complex optimization problems such as job scheduling, machine learning, pattern recognition, and assembly planning. Due to the random process involved in genetic algorithms, the analysis of performance characteristics of genetic algorithms is a challenging research topic. Studied in this dissertation are methods to analyze convergence of genetic algorithms and to investigate whether modifications made to genetic algorithms, such as varying the operator rates during the iterative process, improve their performance. Both statistical analysis, which is used for investigation of different modifications to the genetic algorithm, and probability analysis, which is used to derive the expectation of convergence, are used in the study. The Wilcoxon signed rank test is used to examine the effects of changing parameters in genetic algorithms during the iterations. A Markov chain is derived to show how the random selection process affects the genetic evolution, including the so called genetic drift and preferential selection. A link distance is introduced as a numerical index for the study of the convergence process of order-based genetic algorithms. Also studied are the effects of random selection, mutation operator, and the combination of both to the expected average link distance. The genetic drift is shown to enforce the convergence exponentially with increase in the number of iterations. The mutation operator, on the other hand, suppresses the convergence. The combined results of these two parameters lead to a general formula for the estimation of the expected number of iterations needed to achieve convergence for the order-based genetic algorithm with selection and mutation and provide important insights about how order-based genetic algorithms converge

An experimental comparison of a genetic algorithm and a hill-climber for term selection

Purpose – The term selection problem for selecting query terms in information filtering and routing has been investigated using hill-climbers of various kinds, largely through the Okapi experiments in the TREC series of conferences. Although these are simple deterministic approaches which examine the effect of changing the weight of one term at a time, they have been shown to improve the retrieval effectiveness of filtering queries in these TREC experiments. Hill-climbers are, however, likely to get trapped in local optima, and the use of more sophisticated local search techniques for this problem that attempt to break out of these optima are worth investigating. To this end, we apply a genetic algorithm (GA) to the same problem. Design/Methodology/Approach – We use a standard TREC test collection from the TREC-8 filtering track, recording mean average precision and recall measures to allow comparison between the hillclimber and GA algorithms. We also vary elements of the GA, such as probability of a word being included, probability of mutation and population size in order to measure the effect of these variables. Different strategies such as Elitist and Non-Elitist methods are used, as well as Roulette Wheel and Rank selection GA algorithms. Findings – The results of tests suggest that both techniques are, on average, better than the baseline, but the implemented GA does not match the overall performance of a hill-climber. The Rank selection algorithm does better on average than the Roulette Wheel algorithm. There is no evidence in this study that varying word inclusion probability, mutation probability or Elitist method make much difference to the overall results. Small population sizes do not appear to be as effective as larger population sizes. Research limitations/implications – The evidence provided here would suggest that being stuck in a local optima for the term selection optimization problem does not appear to be detrimental to the overall success of the hill-climber. The evidence from term rank order would appear to provide extra useful evidence which hill-climbers can use efficiently and effectively to narrow the search space. Originality/Value – The paper represents the first attempt to compare hill-climbers with GAs on a problem of this type

The influence of mutation on population dynamics in multiobjective genetic programming

Using multiobjective genetic programming with a complexity objective to overcome tree bloat is usually very successful but can sometimes lead to undesirable collapse of the population to all single-node trees. In this paper we report a detailed examination of why and when collapse occurs. We have used different types of crossover and mutation operators (depth-fair and sub-tree), different evolutionary approaches (generational and steady-state), and different datasets (6-parity Boolean and a range of benchmark machine learning problems) to strengthen our conclusion. We conclude that mutation has a vital role in preventing population collapse by counterbalancing parsimony pressure and preserving population diversity. Also, mutation controls the size of the generated individuals which tends to dominate the time needed for fitness evaluation and therefore the whole evolutionary process. Further, the average size of the individuals in a GP population depends on the evolutionary approach employed. We also demonstrate that mutation has a wider role than merely culling single-node individuals from the population; even within a diversity-preserving algorithm such as SPEA2 mutation has a role in preserving diversity

Optimizing genetic algorithm strategies for evolving networks

This paper explores the use of genetic algorithms for the design of networks, where the demands on the network fluctuate in time. For varying network constraints, we find the best network using the standard genetic algorithm operators such as inversion, mutation and crossover. We also examine how the choice of genetic algorithm operators affects the quality of the best network found. Such networks typically contain redundancy in servers, where several servers perform the same task and pleiotropy, where servers perform multiple tasks. We explore this trade-off between pleiotropy versus redundancy on the cost versus reliability as a measure of the quality of the network.Comment: 9 pages, 5 figure

A genetic algorithm-assisted semi-adaptive MMSE multi-user detection for MC-CDMA mobile communication systems

In this work, a novel Minimum-Mean Squared-Error (MMSE) multi-user detector is proposed for MC-CDMA transmission systems working over mobile radio channels characterized by time-varying multipath fading. The proposed MUD algorithm is based on a Genetic Algorithm (GA)-assisted per-carrier MMSE criterion. The GA block works in two successive steps: a training-aided step aimed at computing the optimal receiver weights using a very short training sequence, and a decision-directed step aimed at dynamically updating the weights vector during a channel coherence period. Numerical results evidenced BER performances almost coincident with ones yielded by ideal MMSE-MUD based on the perfect knowledge of channel impulse response. The proposed GA-assisted MMSE-MUD clearly outperforms state-of-the-art adaptive MMSE receivers based on deterministic gradient algorithms, especially for high number of transmitting users

A simple model of unbounded evolutionary versatility as a largest-scale trend in organismal evolution

The idea that there are any large-scale trends in the evolution of biological organisms is highly controversial. It is commonly believed, for example, that there is a large-scale trend in evolution towards increasing complexity, but empirical and theoretical arguments undermine this belief. Natural selection results in organisms that are well adapted to their local environments, but it is not clear how local adaptation can produce a global trend. In this paper, I present a simple computational model, in which local adaptation to a randomly changing environment results in a global trend towards increasing evolutionary versatility. In this model, for evolutionary versatility to increase without bound, the environment must be highly dynamic. The model also shows that unbounded evolutionary versatility implies an accelerating evolutionary pace. I believe that unbounded increase in evolutionary versatility is a large-scale trend in evolution. I discuss some of the testable predictions about organismal evolution that are suggested by the model

A Study in function optimization with the breeder genetic algorithm

Optimization is concerned with the finding of global optima (hence the name) of problems that can be cast in the form of a function of several variables and constraints thereof. Among the searching methods, {em Evolutionary Algorithms} have been shown to be adaptable and general tools that have often outperformed traditional {em ad hoc} methods. The {em Breeder Genetic Algorithm} (BGA) combines a direct representation with a nice conceptual simplicity. This work contains a general description of the algorithm and a detailed study on a collection of function optimization tasks. The results show that the BGA is a powerful and reliable searching algorithm. The main discussion concerns the choice of genetic operators and their parameters, among which the family of Extended Intermediate Recombination (EIR) is shown to stand out. In addition, a simple method to dynamically adjust the operator is outlined and found to greatly improve on the already excellent overall performance of the algorithm.Postprint (published version