Adaptive Improvements of Multi-Objective Branch and Bound

Branch and bound methods which are based on the principle "divide and conquer" are a well established solution approach in single-objective integer programming. In multi-objective optimization branch and bound algorithms are increasingly attracting interest. However, the larger number of objectives raises additional difficulties for implicit enumeration approaches like branch and bound. Since bounding and pruning is considerably weaker in multiple objectives, many branches have to be (partially) searched and may not be pruned directly. The adaptive use of objective space information can guide the search in promising directions to determine a good approximation of the Pareto front already in early stages of the algorithm. In particular we focus in this article on improving the branching and queuing of subproblems and the handling of lower bound sets. In our numerical test we evaluate the impact of the proposed methods in comparison to a standard implementation of multiobjective branch and bound on knapsack problems, generalized assignment problems and (un)capacitated facility location problems

An outer approximation algorithm for multi-objective mixed-integer linear and non-linear programming

In this paper, we present the first outer approximation algorithm for multi-objective mixed-integer linear programming problems with any number of objectives. The algorithm also works for certain classes of non-linear programming problems. It produces the non-dominated extreme points as well as the facets of the convex hull of these points. The algorithm relies on an oracle which solves single-objective weighted-sum problems and we show that the required number of oracle calls is polynomial in the number of facets of the convex hull of the non-dominated extreme points in the case of multiobjective mixed-integer programming (MOMILP). Thus, for MOMILP problems for which the weighted-sum problem is solvable in polynomial time, the facets can be computed with incremental-polynomial delay. From a practical perspective, the algorithm starts from a valid lower bound set for the non-dominated extreme points and iteratively improves it. Therefore it can be used in multi-objective branch-and-bound algorithms and still provide a valid bound set at any stage, even if interrupted before converging. Moreover, the oracle produces Pareto optimal solutions, which makes the algorithm also attractive from the primal side in a multi-objective branch-and-bound context. Finally, the oracle can also be called with any relaxation of the primal problem, and the obtained points and facets still provide a valid lower bound set. A computational study on a set of benchmark instances from the literature and new non-linear multi-objective instances is provided.Comment: 21 page

Techniques for Multiobjective Optimization with Discrete Variables: Boxed Line Method and Tchebychev Weight Set Decomposition

Many real-world applications involve multiple competing objectives, but due to conflict between the objectives, it is generally impossible to find a feasible solution that optimizes all, simultaneously. In contrast to single objective optimization, the goal in multiobjective optimization is to generate a set of solutions that induces the nondominated (ND) frontier. This thesis presents two techniques for multiobjective optimization problems with discrete decision variables. First, the Boxed Line Method is an exact, criterion space search algorithm for biobjective mixed integer programs (Chapter 2). A basic version of the algorithm is presented with a recursive variant and other enhancements. The basic and recursive variants permit complexity analysis, which yields the first complexity results for this class of algorithms. Additionally, a new instance generation method is presented, and a rigorous computational study is conducted. Second, a novel weight space decomposition method for integer programs with three (or more) objectives is presented with unique geometric properties (Chapter 3). The weighted Tchebychev scalarization used for this weight space decomposition provides the benefit of including unsupported ND images but at the cost of convexity of weight set components. This work proves convexity-related properties of the weight space components, including star-shapedness. Further, a polytopal decomposition is used to properly define dimension for these nonconvex components. The weighted Tchebychev weight set decomposition is then applied as a “dual” perspective on the class of multiobjective “primal” algorithms (Chapter 4). It is shown that existing algorithms do not yield enough information for a complete decomposition, and the necessary modifications required to yield the missing information is proven. Modifications for primal algorithms to compute inner and outer approximations of the weight space components are presented. Lastly, a primal algorithm is restricted to solving for a subset of the ND frontier, where this subset represents the compromise between multiple decision makers’ weight vectors.Ph.D

Enhancing Branch-and-Bound for Multi-Objective 0-1 Programming

In the bi-objective branch-and-bound literature, a key ingredient is objective branching, i.e. to create smaller and disjoint sub-problems in the objective space, obtained from the partial dominance of the lower bound set by the upper bound set. When considering three or more objective functions, however, applying objective branching becomes more complex, and its benefit has so far been unclear. In this paper, we investigate several ingredients which allow to better exploit objective branching in a multi-objective setting. We extend the idea of probing to multiple objectives, enhance it in several ways, and show that when coupled with objective branching, it results in significant speed-ups in terms of CPU times. We also investigate cut generation based on the objective branching constraints. Besides, we generalize the best-bound idea for node selection to multiple objectives and we show that the proposed rules outperform the, in the multi-objective literature, commonly employed depth-first and breadth-first strategies. We also analyze problem specific branching rules. We test the proposed ideas on available benchmark instances for three problem classes with three and four objectives, namely the capacitated facility location problem, the uncapacitated facility location problem, and the knapsack problem. Our enhanced multi-objective branch-and-bound algorithm outperforms the best existing branch-and-bound based approach and is the first to obtain competitive and even slightly better results than a state-of-the-art objective space search method on a subset of the problem classes

Two-phase strategies for the bi-objective minimum spanning tree problem

This paper presents a new two-phase algorithm for the bi-objective minimum spanning tree (BMST) prob-lem. In the first phase, it computes the extreme supported efficient solutions resorting to both mathematicalprogramming and algorithmic approaches, while the second phase is devoted to obtaining the remaining ef-ficient solutions (non-extreme supported and non-supported). This latter phase is based on a new recursiveprocedure capable of generating all the spanning trees of a connected graph through edge interchanges basedon increasing evaluation of non-zero reduced costs of associated weighted linear programs. Such a procedureexploits a common property of a wider class of problems to which the minimum spanning tree (MST) prob-lem belongs, that is the spanning tree structure of its basic feasible solutions. Computational experimentsare conducted on different families of graphs and with different types of cost. These results show that thisnew two-phase algorithm is correct, very easy to implement and it allows one to extract conclusions on thedifficulty of finding the entire set of Pareto solutions of the BMST problem depending on the graph topologyand the possible correlation of the edge cost

Multi-objective combinatorial optimization problems in transportation and defense systems

Multi-objective Optimization problems arise in many applications; hence, solving them efficiently is important for decision makers. A common procedure to solve such problems is to generate the exact set of Pareto efficient solutions. However, if the problem is combinatorial, generating the exact set of Pareto efficient solutions can be challenging. This dissertation is dedicated to Multi-objective Combinatorial Optimization problems and their applications in system of systems architecting and railroad track inspection scheduling. In particular, multi-objective system of systems architecting problems with system flexibility and performance improvement funds have been investigated. Efficient solution methods are proposed and evaluated for not only the system of systems architecting problems, but also a generic multi-objective set covering problem. Additionally, a bi-objective track inspection scheduling problem is introduced for an automated ultrasonic inspection vehicle. Exact and approximation methods are discussed for this bi-objective track inspection scheduling problem --Abstract, page iii

A criterion space decomposition approach to generalized tri-objective tactical resource allocation

We present a tri-objective mixed-integer linear programming model of the tactical resource allocation problem with inventories, called the\ua0generalized tactical resource allocation problem\ua0(GTRAP). We propose a specialized criterion space decomposition strategy, in which the projected two-dimensional criterion space is partitioned and the corresponding sub-problems are solved in parallel by application of the\ua0quadrant shrinking method\ua0(QSM) (Boland in Eur J Oper Res 260(3):873–885, 2017) for identifying non-dominated points. To obtain an efficient implementation of the parallel variant of the QSM we suggest some modifications to reduce redundancies. Our approach is tailored for the GTRAP and is shown to have superior computational performance as compared to using the QSM without parallelization when applied to industrial instances

A Solver for Multiobjective Mixed-Integer Convex and Nonconvex Optimization

This paper proposes a general framework for solving multiobjective nonconvex optimization problems, i.e., optimization problems in which multiple objective functions have to be optimized simultaneously. Thereby, the nonconvexity might come from the objective or constraint functions, or from integrality conditions for some of the variables. In particular, multiobjective mixed-integer convex and nonconvex optimization problems are covered and form the motivation of our studies. The presented algorithm is based on a branch-and-bound method in the pre-image space, a technique which was already successfully applied for continuous nonconvex multiobjective optimization. However, extending this method to the mixed-integer setting is not straightforward, in particular with regard to convergence results. More precisely, new branching rules and lower bounding procedures are needed to obtain an algorithm that is practically applicable and convergent for multiobjective mixed-integer optimization problems. Corresponding results are a main contribution of this paper. What is more, for improving the performance of this new branch-and-bound method we enhance it with two types of cuts in the image space which are based on ideas from multiobjective mixed-integer convex optimization. Those combine continuous convex relaxations with adaptive cuts for the convex hull of the mixed-integer image set, derived from supporting hyperplanes to the relaxed sets. Based on the above ingredients, the paper provides a new multiobjective mixed-integer solver for convex problems with a stopping criterion purely in the image space. What is more, for the first time a solver for multiobjective mixed-integer nonconvex optimization is presented. We provide the results of numerical tests for the new algorithm. Where possible, we compare it with existing procedures

Global Optimization of the Maximum K-Cut Problem

RÉSUMÉ: Le problème de la k-coupe maximale (max-k-cut) est un problème de partitionnement de graphes qui est un des représentatifs de la classe des problèmes combinatoires NP-difficiles. Le max-kcut peut être utilisé dans de nombreuses applications industrielles. L’objectif de ce problème est de partitionner l’ensemble des sommets en k parties de telle façon que le poids total des arrêtes coupées soit maximisé. Les méthodes proposées dans la littérature pour résoudre le max-k-cut emploient, généralement, la programmation semidéfinie positive (SDP) associée. En comparaison avec les relaxations de la programmation linéaire (LP), les relaxations SDP sont plus fortes mais les temps de calcul sont plus élevés. Par conséquent, les méthodes basées sur la SDP ne peuvent pas résoudre de gros problèmes. Cette thèse introduit une méthode efficace de branchement et de résolution du problème max-k-cut en utilisant des relaxations SDP et LP renforcées. Cette thèse présente trois approches pour améliorer les solutions du max-k-cut. La première approche se concentre sur l’identification des classes d’inégalités les plus pertinentes des relaxations de max-k-cut. Cette approche consiste en une étude expérimentale de quatre classes d’inégalités de la littérature : clique, general clique, wheel et bicycle wheel. Afin d’inclure ces inégalités dans les formulations, nous utilisons un algorithme de plan coupant (CPA) pour ajouter seulement les inégalités les plus importantes . Ainsi, nous avons conçu plusieurs procédures de séparation pour trouver les violations. Les résultats suggèrent que les inégalités de wheel sont les plus fortes. De plus, l’inclusion de ces inégalités dans le max-k-cut peut améliorer la borne de la SDP de plus de 2%. La deuxième approche introduit les contraintes basées sur formulation SDP pour renforcer la relaxation LP. De plus, le CPA est amélioré en exploitant la technique de terminaison précoce d’une méthode de points intérieurs. Les résultats montrent que la relaxation LP avec les inégalités basées sur la SDP surpasse la relaxation SDP pour de nombreux cas, en particulier pour les instances avec un grand nombre de partitions (k � 7). La troisième approche étudie la méthode d’énumération implicite en se basant sur les résultats des dernières approches. On étudie quatre composantes de la méthode. Tout d’abord, nous présentons quatre méthodes heuristiques pour trouver des solutions réalisables : l’heuristique itérative d’agrégation, l’heuristique d’opérateur multiple, la recherche à voisinages variables, et la procédure de recherche aléatoire adaptative gloutonne. La deuxième procédure analyse les stratégies dichotomiques et polytomiques pour diviser un sous-problème. La troisième composante étudie cinq règles de branchement. Enfin, pour la sélection des noeuds de l’arbre de branchement, nous considérons les stratégies suivantes : meilleur d’abord, profondeur d’abord, et largeur d’abord. Pour chaque stratégie, nous fournissons des tests pour différentes valeurs de k. Les résultats montrent que la méthode exacte proposée est capable de trouver de nombreuses solutions. Chacune de ces trois approches a contribué à la conception d’une méthode efficace pour résoudre le problème du max-k-cut. De plus, les approches proposées peuvent être étendues pour résoudre des problèmes génériques d’optimisation en variables mixtes.----------ABSTRACT: In graph theory, the maximum k-cut (max-k-cut) problem is a representative problem of the class of NP-hard combinatorial optimization problems. It arises in many industrial applications and the objective of this problem is to partition vertices of a given graph into at most k partitions such that the total weight of the cut is maximized. The methods proposed in the literature to optimally solve the max-k-cut employ, usually, the associated semidefinite programming (SDP) relaxation in a branch-and-bound framework. In comparison with the linear programming (LP) relaxation, the SDP relaxation is stronger but it suffers from high CPU times. Therefore, methods based on SDP cannot solve large problems. This thesis introduces an efficient branch-and-bound method to solve the max-k-cut problem by using tightened SDP and LP relaxations. This thesis presents three approaches to improve the solutions of the problem. The first approach focuses on identifying relevant classes of inequalities to tighten the relaxations of the max-k-cut. This approach carries out an experimental study of four classes of inequalities from the literature: clique, general clique, wheel and bicycle wheel. In order to include these inequalities, we employ a cutting plane algorithm (CPA) to add only the most important inequalities in practice and we design several separation routines to find violations in a relaxed solution. Computational results suggest that the wheel inequalities are the strongest by far. Moreover, the inclusion of these inequalities in the max-k-cut improves the bound of the SDP formulation by more than 2%. The second approach introduces the SDP-based constraints to strengthen the LP relaxation. Moreover, the CPA is improved by exploiting the early-termination technique of an interior-point method. Computational results show that the LP relaxation with the SDP-based inequalities outperforms the SDP relaxations for many instances, especially for a large number of partitions (k � 7). The third approach investigates the branch-and-bound method using both previous approaches. Four components of the branch-and-bound are considered. First, four heuristic methods are presented to find a feasible solution: the iterative clustering heuristic, the multiple operator heuristic, the variable neighborhood search, and the greedy randomized adaptive search procedure. The second procedure analyzes the dichotomic and polytomic strategies to split a subproblem. The third feature studies five branching rules. Finally, for the node selection, we consider the following strategies: best-first search, depth-first search, and breadth-first search. For each component, we provide computational tests for different values of k. Computational results show that the proposed exact method is able to uncover many solutions. Each one of these three approaches contributed to the design of an efficient method to solve the max-k-cut problem. Moreover, the proposed approaches can be extended to solve generic mixinteger SDP problems

Approches de résolution exacte et approchée en optimisation combinatoire multi-objectif, application au problème de l'arbre couvrant de poids minimal

This thesis deals with several aspects related to solving multi-objective problems, without restriction to the bi-objective case. We consider exact solving, which generates the nondominated set, and approximate solving, which computes an approximation of the nondominated set with a priori guarantee on the quality.We first consider the determination of an explicit representation of the search region. The search region, defined with respect to a set of known feasible points, excludes from the objective space the part which is dominated by these points. Future efforts to find all nondominated points should therefore be concentrated on the search region.Then we review branch and bound and ranking algorithms and we propose a new hybrid approach for the determination of the nondominated set. We show how the proposed method can be adapted to generate an approximation of the nondominated set. This approach is instantiated on the minimum spanning tree problem. We review several properties of this problem which enable us to specialize some procedures of the proposed approach and integrate specific preprocessing rules. This approach is finally supported through experimental results.On s'attache dans cette thèse à plusieurs aspects liés à la résolution de problèmes multi-objectifs, sans se limiter au cas biobjectif. Nous considérons la résolution exacte, dans le sens de la détermination de l'ensemble des points non dominés, ainsi que la résolution approchée dans laquelle on cherche une approximation de cet ensemble dont la qualité est garantie a priori.Nous nous intéressons d'abord au problème de la détermination d'une représentation explicite de la région de recherche. La région de recherche, étant donné un ensemble de points réalisables connus, exclut la partie de l'espace des objectifs que dominent ces points et constitue donc la partie de l'espace des objectifs où les efforts futurs doivent être concentrés dans la perspective de déterminer tous les points non dominés.Puis nous considérons le recours aux algorithmes de séparation et évaluation ainsi qu'aux algorithmes de ranking afin de proposer une nouvelle méthode hybride de détermination de l'ensemble des points non dominés. Nous montrons que celle-ci peut également servir à obtenir une approximation de l'ensemble des points non dominés. Cette méthode est implantée pour le problème de l'arbre couvrant de poids minimal. Les quelques propriétés de ce problème que nous passons en revue nous permettent de spécialiser certaines procédures et d'intégrer des prétraitements spécifiques. L'intérêt de cette approche est alors soutenu à l'aide de résultats expérimentaux