Skip to main content
Article thumbnail
Location of Repository

Survival of the flexible: explaining the dominance of meta-heuristics within a rapidly evolving world

By Dr James M Whitacre

Abstract

Although researchers often discuss the rising popularity of meta-heuristics (MH), there has been a paucity of data to directly support the notion that MH are growing in prominence compared to deterministic methods (DM). Here we provide the first evidence that MH usage is not only growing, but indeed appears to have surpassed DM as the algorithm framework of choice for solving optimization problems. Motivated by these findings, this paper aims to review and discuss the origins of meta-heuristic dominance.\ud Explanations for meta-heuristic success are varied, however their robustness to variations in fitness landscape properties is often cited as an important advantage. In this paper, we review explanations for MH popularity and discuss why some of these arguments remain unsatisfying. We argue that a more compelling and comprehensive explanation would directly account for the manner in which most MH success has actually been achieved, e.g. through hybridization and customization to a particular problem environment. \ud This paper puts forth the hypothesis that MH derive much of their utility from being flexible. This flexibility is empirically supported by evidence that MH design can adapt to a problem environment and can integrate domain knowledge. We propose what flexibility means from a search algorithm design context and we propose key attributes that should exist in a flexible algorithm framework. Interestingly, a number of these qualities are observed in robust biological systems. In light of these similarities, we consider whether the origins of biological robustness, (e.g. loose coupling, modularity, partial redundancy) could help to inspire the development of more flexible algorithm frameworks. We also discuss current trends in optimization problems and speculate that highly flexible algorithm frameworks will become increasingly popular within our diverse and rapidly changing world

Topics: Complexity Theory, Artificial Intelligence
Year: 2009
OAI identifier: oai:cogprints.org:6582
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://cogprints.org/6582/1/Ma... (external link)
  • http://cogprints.org/6582/ (external link)
  • Suggested articles

    Citations

    1. (1953). A Behavioral Model of Rational Choice.
    2. (1999). A Comparison of Memetic Algorithms, Tabu Search, and Ant Colonies for the Quadratic Assignment Problem," in congress on evolutionary computation,
    3. (1993). A hierarchy of evolution programs: An experimental study,"
    4. (1975). Adaptation in Natural and Artificial System," Ann Arbor:
    5. (2004). Bow ties, metabolism and disease,"
    6. (2009). Degeneracy: a design principle for achieving robustness and evolvability," doi
    7. (2009). Degenerate neutrality creates evolvable fitness landscapes," in WorldComp
    8. (2005). Effect of Numerical Errors on the Performance of Optimization Methods,"
    9. (1999). Emergence of Scaling in Random Networks,"
    10. (2006). Evolutionary Algorithms+ Domain Knowledge= Real-World Evolutionary Computation,"
    11. (1997). Evolutionary computation: comments on the history and current state,"
    12. (2005). Evolutionary optimization in uncertain environments-a survey,"
    13. (1998). Evolvability,"
    14. (1999). Evolving in a changing world," Lecture notes in computer science,
    15. (1989). Genetic algorithms in search, optimization and machine learning:
    16. (1996). Genetic algorithms+ data structures= evolution programs:
    17. (1991). Handbook of Genetic Algorithms:
    18. (1998). Indexed bibliography of genetic algorithms papers of 1996,"
    19. (2007). Innovation and robustness in complex regulatory gene networks,"
    20. (2007). Introduction to evolutionary computation,"
    21. (1997). No free lunch theorems for optimization,"
    22. (1999). Optimizing global-local search hybrids,"
    23. (2005). Organizing and the process of sensemaking,"
    24. Results of the First Survey of Practitioners of Evolutionary Computation."
    25. (2008). Robustness and evolvability: a paradox resolved,"
    26. (2003). The connectivity structure, giant strong component and centrality of metabolic networks,"
    27. (1995). Using Markov chains to analyze GAFOs," Foundations of genetic algorithms,
    28. (2007). Where is evolutionary computation going? A temporal analysis of the EC community,"

    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.