Reinforcement Learning-assisted Evolutionary Algorithm: A Survey and Research Opportunities

Evolutionary algorithms (EA), a class of stochastic search methods based on the principles of natural evolution, have received widespread acclaim for their exceptional performance in various real-world optimization problems. While researchers worldwide have proposed a wide variety of EAs, certain limitations remain, such as slow convergence speed and poor generalization capabilities. Consequently, numerous scholars actively explore improvements to algorithmic structures, operators, search patterns, etc., to enhance their optimization performance. Reinforcement learning (RL) integrated as a component in the EA framework has demonstrated superior performance in recent years. This paper presents a comprehensive survey on integrating reinforcement learning into the evolutionary algorithm, referred to as reinforcement learning-assisted evolutionary algorithm (RL-EA). We begin with the conceptual outlines of reinforcement learning and the evolutionary algorithm. We then provide a taxonomy of RL-EA. Subsequently, we discuss the RL-EA integration method, the RL-assisted strategy adopted by RL-EA, and its applications according to the existing literature. The RL-assisted procedure is divided according to the implemented functions including solution generation, learnable objective function, algorithm/operator/sub-population selection, parameter adaptation, and other strategies. Finally, we analyze potential directions for future research. This survey serves as a rich resource for researchers interested in RL-EA as it overviews the current state-of-the-art and highlights the associated challenges. By leveraging this survey, readers can swiftly gain insights into RL-EA to develop efficient algorithms, thereby fostering further advancements in this emerging field.Comment: 26 pages, 16 figure

A memory-integrated artificial bee algorithm for heuristic optimisation

A thesis submitted to the University of Bedfordshire in partial fulfilment of the requirements for the degree of Master of Science by ResearchAccording to studies about bee swarms, they use special techniques for foraging and they are always able to find notified food sources with exact coordinates. In order to succeed in food source exploration, the information about food sources is transferred between employed bees and onlooker bees via waggle dance. In this study, bee colony behaviours are imitated for further search in one of the common real world problems. Traditional solution techniques from literature may not obtain sufficient results; therefore other techniques have become essential for food source exploration. In this study, artificial bee colony (ABC) algorithm is used as a base to fulfil this purpose. When employed and onlooker bees are searching for better food sources, they just memorize the current sources and if they find better one, they erase the all information about the previous best food source. In this case, worker bees may visit same food source repeatedly and this circumstance causes a hill climbing in search. The purpose of this study is exploring how to embed a memory system in ABC algorithm to avoid mentioned repetition. In order to fulfil this intention, a structure of Tabu Search method -Tabu List- is applied to develop a memory system. In this study, we expect that a memory system embedded ABC algorithm provides a further search in feasible area to obtain global optimum or obtain better results in comparison with classic ABC algorithm. Results show that, memory idea needs to be improved to fulfil the purpose of this study. On the other hand, proposed memory idea can be integrated other algorithms or problem types to observe difference

A Polyhedral Study of Mixed 0-1 Set

We consider a variant of the well-known single node fixed charge network flow set with constant capacities. This set arises from the relaxation of more general mixed integer sets such as lot-sizing problems with multiple suppliers. We provide a complete polyhedral characterization of the convex hull of the given set

Applying Evolutionary Algorithms Successfully: A Guide Gained from Real-world Applications

Metaheuristics (MHs) in general and Evolutionary Algorithms (EAs) in particular are well known tools for successful optimization of difficult problems. But when is their application meaningful and how does one approach such a project as a novice? How do you avoid beginner\u27s mistakes or use the design possibilities of a metaheuristic search as efficiently as possible? This paper tries to give answers to these questions based on 30 years of research and application of the Evolutionary Algorithm GLEAM and its memetic extension HyGLEAM. Most of the experience gathered and discussed here can also be applied to the use of other metaheuristics such as ant algorithms or particle swarm optimization. This paper addresses users with basic knowledge of MHs in general and EAs in particular who want to apply them in an optimization project. For this purpose, a number of questions that arise in the course of such a project are addressed. At the end, some non-technical project management issues are discussed, whose importance for project success is often underestimated

EG-ICE 2021 Workshop on Intelligent Computing in Engineering

The 28th EG-ICE International Workshop 2021 brings together international experts working at the interface between advanced computing and modern engineering challenges. Many engineering tasks require open-world resolutions to support multi-actor collaboration, coping with approximate models, providing effective engineer-computer interaction, search in multi-dimensional solution spaces, accommodating uncertainty, including specialist domain knowledge, performing sensor-data interpretation and dealing with incomplete knowledge. While results from computer science provide much initial support for resolution, adaptation is unavoidable and most importantly, feedback from addressing engineering challenges drives fundamental computer-science research. Competence and knowledge transfer goes both ways

EG-ICE 2021 Workshop on Intelligent Computing in Engineering

The 28th EG-ICE International Workshop 2021 brings together international experts working at the interface between advanced computing and modern engineering challenges. Many engineering tasks require open-world resolutions to support multi-actor collaboration, coping with approximate models, providing effective engineer-computer interaction, search in multi-dimensional solution spaces, accommodating uncertainty, including specialist domain knowledge, performing sensor-data interpretation and dealing with incomplete knowledge. While results from computer science provide much initial support for resolution, adaptation is unavoidable and most importantly, feedback from addressing engineering challenges drives fundamental computer-science research. Competence and knowledge transfer goes both ways