26 research outputs found
A case study of controlling crossover in a selection hyper-heuristic framework using the multidimensional knapsack problem
Hyper-heuristics are high-level methodologies for solving complex problems that operate on a search space of heuristics. In a selection hyper-heuristic framework, a heuristic is chosen from an existing set of low-level heuristics and applied to the current solution to produce a new solution at each point in the search. The use of crossover low-level heuristics is possible in an increasing number of general-purpose hyper-heuristic tools such as HyFlex and Hyperion. However, little work has been undertaken to assess how best to utilise it. Since a single-point search hyper-heuristic operates on a single candidate solution, and two candidate solutions are required for crossover, a mechanism is required to control the choice of the other solution. The frameworks we propose maintain a list of potential solutions for use in crossover. We investigate the use of such lists at two conceptual levels. First, crossover is controlled at the hyper-heuristic level where no problem-specific information is required. Second, it is controlled at the problem domain level where problem-specific information is used to produce good-quality solutions to use in crossover. A number of selection hyper-heuristics are compared using these frameworks over three benchmark libraries with varying properties for an NP-hard optimisation problem: the multidimensional 0-1 knapsack problem. It is shown that allowing crossover to be managed at the domain level outperforms managing crossover at the hyper-heuristic level in this problem domain. © 2016 Massachusetts Institute of Technolog
Grammatical evolution hyper-heuristic for combinatorial optimization problems
Designing generic problem solvers that perform well across a diverse set of problems is a challenging task. In this work, we propose a hyper-heuristic framework to automatically generate an effective and generic solution method by utilizing grammatical evolution. In the proposed framework, grammatical evolution is used as an online solver builder, which takes several heuristic components (e.g., different acceptance criteria and different neighborhood structures) as inputs and evolves templates of perturbation heuristics. The evolved templates are improvement heuristics, which represent a complete search method to solve the problem at hand. To test the generality and the performance of the proposed method, we consider two well-known combinatorial optimization problems: exam timetabling (Carter and ITC 2007 instances) and the capacitated vehicle routing problem (Christofides and Golden instances). We demonstrate that the proposed method is competitive, if not superior, when compared to state-of-the-art hyper-heuristics, as well as bespoke methods for these different problem domains. In order to further improve the performance of the proposed framework we utilize an adaptive memory mechanism, which contains a collection of both high quality and diverse solutions and is updated during the problem solving process. Experimental results show that the grammatical evolution hyper-heuristic, with an adaptive memory, performs better than the grammatical evolution hyper-heuristic without a memory. The improved framework also outperforms some bespoke methodologies, which have reported best known results for some instances in both problem domains
A choice function hyper-heuristic framework for the allocation of maintenance tasks in Danish railways
This work has been partially funded by the DAASE project, EPSRC programme grant EP/J017515/1
Técnicas de optimización paralelas : esquema híbrido basado en hiperheurísticas y computación evolutiva
Optimisation is the process of selecting the best element fr
om a set of available
alternatives. Solutions are termed good or bad depending on
its performance for a
set of objectives. Several algorithms to deal with such kind
of problems have been
defined in the literature. Metaheuristics are one of the most
prominent techniques.
They are a class of modern heuristics whose main goal is to com
bine heuristics in
a problem independent way with the aim of improving their per
formance. Meta-
heuristics have reported high-quality solutions in severa
l fields. One of the reasons
of the good behaviour of metaheuristics is that they are defin
ed in general terms.
Therefore, metaheuristic algorithms can be adapted to fit th
e needs of most real-life
optimisation. However, such an adaptation is a hard task, and
it requires a high
computational and user effort.
There are two main ways of reducing the effort associated to th
e usage of meta-
heuristics. First, the application of hyperheuristics and
parameter setting strategies
facilitates the process of tackling novel optimisation pro
blems and instances. A
hyperheuristic can be viewed as a heuristic that iterativel
y chooses between a set
of given low-level metaheuristics in order to solve an optim
isation problem. By
using hyperheuristics, metaheuristic practitioners do no
t need to manually test a
large number of metaheuristics and parameterisations for d
iscovering the proper
algorithms to use. Instead, they can define the set of configur
ations which must
be tested, and the model tries to automatically detect the be
st-behaved ones, in
order to grant more resources to them. Second, the usage of pa
rallel environments
might speedup the process of automatic testing, so high qual
ity solutions might be
achieved in less time.
This research focuses on the design of novel hyperheuristic
s and defines a set of
models to allow their usage in parallel environments. Differ
ent hyperheuristics for
controlling mono-objective and multi-objective multi-po
int optimisation strategies
have been defined. Moreover, a set of novel multiobjectivisa
tion techniques has
been proposed. In addition, with the aim of facilitating the
usage of multiobjectivi-
sation, the performance of models that combine the usage of m
ultiobjectivisation
and hyperheuristics has been studied.
The proper performance of the proposed techniques has been v
alidated with a
set of well-known benchmark optimisation problems. In addi
tion, several practical
and complex optimisation problems have been addressed. Som
e of the analysed
problems arise in the communication field. In addition, a pac
king problem proposed
in a competition has been faced up. The proposals for such pro
blems have not
been limited to use the problem-independent schemes. Inste
ad, new metaheuristics,
operators and local search strategies have been defined. Suc
h schemes have been
integrated with the designed parallel hyperheuristics wit
h the aim of accelerating the
achievement of high quality solutions, and with the aim of fa
cilitating their usage.
In several complex optimisation problems, the current best
-known solutions have
been found with the methods defined in this dissertation.Los problemas de optimización son aquellos en los que hay que elegir cuál es la solución más adecuada entre un conjunto de alternativas. Actualmente existe una gran cantidad de algoritmos que permiten abordar este tipo de problemas. Entre ellos, las metaheurísticas son una de las técnicas más usadas. El uso de metaheurísticas ha posibilitado la resolución de una gran cantidad de problemas en diferentes campos. Esto se debe a que las metaheurísticas son técnicas generales, con lo que disponen de una gran cantidad de elementos o parámetros que pueden ser adaptados a la hora de afrontar diferentes problemas de optimización. Sin embargo, la elección de dichos parámetros no es sencilla, por lo que generalmente se requiere un gran esfuerzo computacional, y un gran esfuerzo por parte del usuario de estas técnicas. Existen diversas técnicas que atenúan este inconveniente. Por un lado, existen varios mecanismos que permiten seleccionar los valores de dichos parámetros de forma automática. Las técnicas más simples utilizan valores fijos durante toda la ejecución, mientras que las técnicas más avanzadas, como las hiperheurísticas, adaptan los valores usados a las necesidades de cada fase de optimización. Además, estas técnicas permiten usar varias metaheurísticas de forma simultánea. Por otro lado, el uso de técnicas paralelas permite acelerar el proceso de testeo automático, reduciendo el tiempo necesario para obtener soluciones de alta calidad. El objetivo principal de esta tesis ha sido diseñar nuevas hiperheurísticas e integrarlas en el modelo paralelo basado en islas. Estas técnicas se han usado para controlar los parámetros de varias metaheurísticas evolutivas. Se han definido diversas hiperheurísticas que han permitido abordar tanto problemas mono-objetivo como problemas multi-objetivo. Además, se han definido un conjunto de multiobjetivizaciones, que a su vez se han beneficiado de las hiperheurísticas propuestas. Las técnicas diseñadas se han validado con algunos de los problemas de test más ampliamente utilizados. Además, se han abordado un conjunto de problemas de optimización prácticos. Concretamente, se han tratado tres problemas que surgen en el ámbito de las telecomunicaciones, y un problema de empaquetado. En dichos problemas, además de usar las hiperheurísticas y multiobjetivizaciones, se han definido nuevos algoritmos, operadores, y estrategias de búsqueda local. En varios de los problemas, el uso combinado de todas estas técnicas ha posibilitado obtener las mejores soluciones encontradas hasta el momento
From metaheuristics to learnheuristics: Applications to logistics, finance, and computing
Un gran nombre de processos de presa de decisions en sectors estratègics com el transport i la producció representen problemes NP-difícils. Sovint, aquests processos es caracteritzen per alts nivells d'incertesa i dinamisme. Les metaheurístiques són mètodes populars per a resoldre problemes d'optimització difícils en temps de càlcul raonables. No obstant això, sovint assumeixen que els inputs, les funcions objectiu, i les restriccions són deterministes i conegudes. Aquests constitueixen supòsits forts que obliguen a treballar amb problemes simplificats. Com a conseqüència, les solucions poden conduir a resultats pobres. Les simheurístiques integren la simulació a les metaheurístiques per resoldre problemes estocàstics d'una manera natural. Anàlogament, les learnheurístiques combinen l'estadística amb les metaheurístiques per fer front a problemes en entorns dinàmics, en què els inputs poden dependre de l'estructura de la solució. En aquest context, les principals contribucions d'aquesta tesi són: el disseny de les learnheurístiques, una classificació dels treballs que combinen l'estadística / l'aprenentatge automàtic i les metaheurístiques, i diverses aplicacions en transport, producció, finances i computació.Un gran número de procesos de toma de decisiones en sectores estratégicos como el transporte y la producción representan problemas NP-difíciles. Frecuentemente, estos problemas se caracterizan por altos niveles de incertidumbre y dinamismo. Las metaheurísticas son métodos populares para resolver problemas difíciles de optimización de manera rápida. Sin embargo, suelen asumir que los inputs, las funciones objetivo y las restricciones son deterministas y se conocen de antemano. Estas fuertes suposiciones conducen a trabajar con problemas simplificados. Como consecuencia, las soluciones obtenidas pueden tener un pobre rendimiento. Las simheurísticas integran simulación en metaheurísticas para resolver problemas estocásticos de una manera natural. De manera similar, las learnheurísticas combinan aprendizaje estadístico y metaheurísticas para abordar problemas en entornos dinámicos, donde los inputs pueden depender de la estructura de la solución. En este contexto, las principales aportaciones de esta tesis son: el diseño de las learnheurísticas, una clasificación de trabajos que combinan estadística / aprendizaje automático y metaheurísticas, y varias aplicaciones en transporte, producción, finanzas y computación.A large number of decision-making processes in strategic sectors such as transport and production involve NP-hard problems, which are frequently characterized by high levels of uncertainty and dynamism. Metaheuristics have become the predominant method for solving challenging optimization problems in reasonable computing times. However, they frequently assume that inputs, objective functions and constraints are deterministic and known in advance. These strong assumptions lead to work on oversimplified problems, and the solutions may demonstrate poor performance when implemented. Simheuristics, in turn, integrate simulation into metaheuristics as a way to naturally solve stochastic problems, and, in a similar fashion, learnheuristics combine statistical learning and metaheuristics to tackle problems in dynamic environments, where inputs may depend on the structure of the solution. The main contributions of this thesis include (i) a design for learnheuristics; (ii) a classification of works that hybridize statistical and machine learning and metaheuristics; and (iii) several applications for the fields of transport, production, finance and computing
An investigation of the ant-based hyper-heuristic for capacitated vehicle routing problem and traveling salesman problem
A brief observation on recent research of routing problems shows that most of the methods used to tackle the problems are using heuristics and metaheuristics; and they often use problem specific knowledge to build or improve solutions. In the last few years, research on hyper-heuristic has been investigated which aims to raise the generality of optimisation systems. This thesis is concerned with the investigation of ant-based hyper-heuristic. Ant algorithms have been applied to vehicle routing problems and have produced competitive results. Therefore, it is assumed that there is a reasonable possibility that ant-based hyperheuristic could perform well for the problem.
The thesis first surveys the literature for some common solution methodologies for optimisation problems and explores in some detail the ant algorithms and ant algorithm hyperheuristic methods. Furthermore, the literature specifically concerns with routing problems; the capacitated routing problem (CVRP) and the travelling salesman problem (TSP). The thesis studies the ant system algorithm and further proposes the ant algorithm hyper-heuristic, which introduces a new pheromone update rule in order to improve its performance. The proposed approach, called the ant-based hyper-heuristic is tested to two routing problems; the CVRP and TSP. Although it does not produce any best known results, the experimental results have shown that it is competitive with other methods. Most importantly, it demonstrates how simple and easy to implement low level heuristics, with no extensive parameter tuning. Further analysis shows that the approach possesses learning mechanism when compared to random hyper-heuristic. The approach investigates the number of low level heuristics appropriate and found out that the more low level heuristics used, the better solution is generated. In addition an ACO hyper-heuristic which has two categories of pheromone updates is developed. However, ant-based hyper-heuristic performs better and this is inconsistent with the performance of ACO algorithm in the literature.
In TSP, we utilise two different categories of low level heuristics, the TSP heuristics and the CVRP heuristics that were previously used for the CVRP. From the observation, it can be seen that by using any heuristics for the same class of problems, ant-based hyper-heuristic is seen to be able to produce competitive results. This has demonstrated that the ant-based hyper-heuristic is a reusable method. One major advantage of this work is the usage of the same parameter for all problem instances with simple moves and swap procedures. It is hoped that in the future, results obtained will be better than current results by using better intelligent low level heuristics
An investigation of the ant-based hyper-heuristic for capacitated vehicle routing problem and traveling salesman problem
A brief observation on recent research of routing problems shows that most of the methods used to tackle the problems are using heuristics and metaheuristics; and they often use problem specific knowledge to build or improve solutions. In the last few years, research on hyper-heuristic has been investigated which aims to raise the generality of optimisation systems. This thesis is concerned with the investigation of ant-based hyper-heuristic. Ant algorithms have been applied to vehicle routing problems and have produced competitive results. Therefore, it is assumed that there is a reasonable possibility that ant-based hyperheuristic could perform well for the problem.
The thesis first surveys the literature for some common solution methodologies for optimisation problems and explores in some detail the ant algorithms and ant algorithm hyperheuristic methods. Furthermore, the literature specifically concerns with routing problems; the capacitated routing problem (CVRP) and the travelling salesman problem (TSP). The thesis studies the ant system algorithm and further proposes the ant algorithm hyper-heuristic, which introduces a new pheromone update rule in order to improve its performance. The proposed approach, called the ant-based hyper-heuristic is tested to two routing problems; the CVRP and TSP. Although it does not produce any best known results, the experimental results have shown that it is competitive with other methods. Most importantly, it demonstrates how simple and easy to implement low level heuristics, with no extensive parameter tuning. Further analysis shows that the approach possesses learning mechanism when compared to random hyper-heuristic. The approach investigates the number of low level heuristics appropriate and found out that the more low level heuristics used, the better solution is generated. In addition an ACO hyper-heuristic which has two categories of pheromone updates is developed. However, ant-based hyper-heuristic performs better and this is inconsistent with the performance of ACO algorithm in the literature.
In TSP, we utilise two different categories of low level heuristics, the TSP heuristics and the CVRP heuristics that were previously used for the CVRP. From the observation, it can be seen that by using any heuristics for the same class of problems, ant-based hyper-heuristic is seen to be able to produce competitive results. This has demonstrated that the ant-based hyper-heuristic is a reusable method. One major advantage of this work is the usage of the same parameter for all problem instances with simple moves and swap procedures. It is hoped that in the future, results obtained will be better than current results by using better intelligent low level heuristics
Offline Learning for Sequence-based Selection Hyper-heuristics
This thesis is concerned with finding solutions to discrete NP-hard problems. Such problems occur in a wide range of real-world applications, such as bin packing, industrial flow shop problems, determining Boolean satisfiability, the traveling salesman and vehicle routing problems, course timetabling, personnel scheduling, and the optimisation of water distribution networks. They are typically represented as optimisation problems where the goal is to find a ``best'' solution from a given space of feasible solutions. As no known polynomial-time algorithmic solution exists for NP-hard problems, they are usually solved by applying heuristic methods. Selection hyper-heuristics are algorithms that organise and combine a number of individual low level heuristics into a higher level framework with the objective of improving optimisation performance. Many selection hyper-heuristics employ learning algorithms in order to enhance optimisation performance by improving the selection of single heuristics, and this learning may be classified as either online or offline. This thesis presents a novel statistical framework for the offline learning of subsequences of low level heuristics in order to improve the optimisation performance of sequenced-based selection hyper-heuristics. A selection hyper-heuristic is used to optimise the HyFlex set of discrete benchmark problems. The resulting sequences of low level heuristic selections and objective function values are used to generate an offline learning database of heuristic selections. The sequences in the database are broken down into subsequences and the mathematical concept of a logarithmic return is used to discriminate between ``effective'' subsequences, that tend to lead to improvements in optimisation performance, and ``disruptive'' subsequences that tend to lead to worsening performance. Effective subsequences are used to improve hyper-heuristics performance directly, by embedding them in a simple hyper-heuristic design, and indirectly as the inputs to an appropriate hyper-heuristic learning algorithm. Furthermore, by comparing effective subsequences across different problem domains it is possible to investigate the potential for cross-domain learning. The results presented here demonstrates that the use of well chosen subsequences of heuristics can lead to small, but statistically significant, improvements in optimisation performance