Combinatorial optimization and metaheuristics

Today, combinatorial optimization is one of the youngest and most active areas of discrete mathematics. It is a branch of optimization in applied mathematics and computer science, related to operational research, algorithm theory and computational complexity theory. It sits at the intersection of several fields, including artificial intelligence, mathematics and software engineering. Its increasing interest arises for the fact that a large number of scientific and industrial problems can be formulated as abstract combinatorial optimization problems, through graphs and/or (integer) linear programs. Some of these problems have polynomial-time (“efficient”) algorithms, while most of them are NP-hard, i.e. it is not proved that they can be solved in polynomial-time. Mainly, it means that it is not possible to guarantee that an exact solution to the problem can be found and one has to settle for an approximate solution with known performance guarantees. Indeed, the goal of approximate methods is to find “quickly” (reasonable run-times), with “high” probability, provable “good” solutions (low error from the real optimal solution). In the last 20 years, a new kind of algorithm commonly called metaheuristics have emerged in this class, which basically try to combine heuristics in high level frameworks aimed at efficiently and effectively exploring the search space. This report briefly outlines the components, concepts, advantages and disadvantages of different metaheuristic approaches from a conceptual point of view, in order to analyze their similarities and differences. The two very significant forces of intensification and diversification, that mainly determine the behavior of a metaheuristic, will be pointed out. The report concludes by exploring the importance of hybridization and integration methods

Using Optimality Theory and Reference Points to Improve the Diversity and Convergence of a Fuzzy-Adaptive Multi-Objective Particle Swarm Optimizer

Particle Swarm Optimization (PSO) has received increasing attention from the evolutionary optimization research community in the last twenty years. PSO is a metaheuristic approach based on collective intelligence obtained by emulating the swarming behavior of bees. A number of multi-objective variants of the original PSO algorithm that extend its applicability to optimization problems with conflicting objectives have also been developed; these multi-objective PSO (MOPSO) algorithms demonstrate comparable performance to other state-of-the-art metaheuristics. The existence of multiple optimal solutions (Pareto-optimal set) in optimization problems with conflicting objectives is not the only challenge posed to an optimizer, as the latter needs to be able to identify and preserve a well-distributed set of solutions during the search of the decision variable space. Recent attempts by evolutionary optimization researchers to incorporate mathematical convergence conditions into genetic algorithm optimizers have led to the derivation of a point-wise proximity measure, which is based on the solution of the achievement scalarizing function (ASF) optimization problem with a complementary slackness condition that quantifies the violation of the Karush-Kuhn-Tucker necessary conditions of optimality. In this work, the aforementioned KKT proximity measure is incorporated into the original Adaptive Coevolutionary Multi-Objective Swarm Optimizer (ACMOPSO) in order to monitor the convergence of the sub-swarms towards the Pareto-optimal front and provide feedback to Mamdani-type fuzzy logic controllers (FLCs) that are utilized for online adaptation of the algorithmic parameters. The proposed Fuzzy-Adaptive Multi-Objective Optimization Algorithm with the KKT proximity measure (FAMOPSOkkt) utilizes a set of reference points to cluster the computed nondominated solutions. These clusters interact with their corresponding sub-swarms to provide the swarm leaders and are also utilized to manage the external archive of nondominated solutions. The performance of the proposed algorithm is evaluated on benchmark problems chosen from the multi-objective optimization literature and compared to the performance of state-of-the-art multi-objective optimization algorithms with similar features

Solving the waste collection problem from a multiobjective perspective: New methodologies and case studies

Fecha de lectura Tesis Doctoral: 19 de marzo de 2018.Economía Aplicada ( Matemáticas) Resumen tesis: El tratamiento de residuos es un tema de estudio por parte de las administraciones locales a nivel mundial. Distintos factores han de tenerse en cuenta para realizar un servicio eficiente. En este trabajo se desarrolla una herramienta para analizar y resolver el problema de la recogida de residuos sólidos en Málaga. Tras un análisis exhaustivo de los datos, se aborda el problema real como un problema de rutas multiobjetivo con capacidad limitada. Para los problemas multiobjetivo, no suele existir una única solución óptima, sino un conjunto de soluciones eficientes de Pareto. Las características del problema hacen inviable su resolución de forma exacta, por lo que se aplican distintas estrategias metaheurísticas para obtener una buena aproximación. En particular, se combinan las técnicas de GRASP, Path Relinking y Variable Neighborhood Search, que son adaptadas a la perspectiva multicriterio. Se trata de una aproximación en dos fases: una primera aproximación de la frontera eficiente se genera mediante un GRASP multiobjetivo. Tres son los métodos propuestos para la primera aproximación, dos de ellos derivados de la publicación de Martí et al. (2015) y el último se apoya en la función escalarizada de logro de Wierzbicki (Wierzbicki, 1980) para distintas combinaciones de pesos. A continuación, esta aproximación es mejorada con una versión de Path Relinking o Variable Neighborhood Search, con un punto de referencia diseñado para problemas multiobjetivo. Una vez generada la aproximación de la frontera eficiente, el proceso de obtención de la solución que más se adecúa a las preferencias de los gestores se basa en el desarrollo de un método interactivo sin trade – off, derivado de la filosofía NAUTILUS (Miettinen et al. 2010). Para evitar gastos de cómputo extensos, esta metodología se apoya en una pre - computación de los elementos de la frontera eficiente

Robust and Constrained Portfolio Optimization using Multiobjective Evolutionary Algorithms

Optimization plays an important role in many areas of science, management,economics and engineering. Many techniques in mathematics and operation research are available to solve such problems. However these techniques have many shortcomings to provide fast and accurate solution particularly when the optimization problem involves many variables and constraints. Investment portfolio optimization is one such important but complex problem in computational finance which needs effective and efficient solutions. In this problem each available asset is judiciously selected in such a way that the total profit is maximized while simultaneously minimizing the total risk. The literature survey reveals that due to non availability of suitable multi objective optimization tools, this problem is mostly being solved by viewing it as a single objective optimization problem

An Order-based Algorithm for Minimum Dominating Set with Application in Graph Mining

Dominating set is a set of vertices of a graph such that all other vertices have a neighbour in the dominating set. We propose a new order-based randomised local search (RLS$_o$) algorithm to solve minimum dominating set problem in large graphs. Experimental evaluation is presented for multiple types of problem instances. These instances include unit disk graphs, which represent a model of wireless networks, random scale-free networks, as well as samples from two social networks and real-world graphs studied in network science. Our experiments indicate that RLS$_o$ performs better than both a classical greedy approximation algorithm and two metaheuristic algorithms based on ant colony optimisation and local search. The order-based algorithm is able to find small dominating sets for graphs with tens of thousands of vertices. In addition, we propose a multi-start variant of RLS$_o$ that is suitable for solving the minimum weight dominating set problem. The application of RLS$_o$ in graph mining is also briefly demonstrated

Time-limited Metaheuristics for Cardinality-constrained Portfolio Optimisation

A financial portfolio contains assets that offer a return with a certain level of risk. To maximise returns or minimise risk, the portfolio must be optimised - the ideal combination of optimal quantities of assets must be found. The number of possible combinations is vast. Furthermore, to make the problem realistic, constraints can be imposed on the number of assets held in the portfolio and the maximum proportion of the portfolio that can be allocated to an asset. This problem is unsolvable using quadratic programming, which means that the optimal solution cannot be calculated. A group of algorithms, called metaheuristics, can find near-optimal solutions in a practical computing time. These algorithms have been successfully used in constrained portfolio optimisation. However, in past studies the computation time of metaheuristics is not limited, which means that the results differ in both quality and computation time, and cannot be easily compared. This study proposes a different way of testing metaheuristics, limiting their computation time to a certain duration, yielding results that differ only in quality. Given that in some use cases the priority is the quality of the solution and in others the speed, time limits of 1, 5 and 25 seconds were tested. Three metaheuristics - simulated annealing, tabu search, and genetic algorithm - were evaluated on five sets of historical market data with different numbers of assets. Although the metaheuristics could not find a competitive solution in 1 second, simulated annealing found a near-optimal solution in 5 seconds in all but one dataset. The lowest quality solutions were obtained by genetic algorithm.Comment: 51 pages, 8 tables, 3 figure

Nature-inspired Methods for Stochastic, Robust and Dynamic Optimization

Nature-inspired algorithms have a great popularity in the current scientific community, being the focused scope of many research contributions in the literature year by year. The rationale behind the acquired momentum by this broad family of methods lies on their outstanding performance evinced in hundreds of research fields and problem instances. This book gravitates on the development of nature-inspired methods and their application to stochastic, dynamic and robust optimization. Topics covered by this book include the design and development of evolutionary algorithms, bio-inspired metaheuristics, or memetic methods, with empirical, innovative findings when used in different subfields of mathematical optimization, such as stochastic, dynamic, multimodal and robust optimization, as well as noisy optimization and dynamic and constraint satisfaction problems