Local Branching in a Constraint Programming Framework

We argue that integrating local branching in CP merges the advantages of the intensification and diversification mechanisms specific to local search methods, with constraint propagation that speeds up the neighborhood exploration by removing infeasible variable value assignments

Gestion de flotte avec fenêtres horaires : approches de résolution mixtes utilisant la programmation par contraintes

Thèse numérisée par la Direction des bibliothèques de l'Université de Montréal

Branching strategies for mixed-integer programs containing logical constraints and decomposable structure

Decision-making optimisation problems can include discrete selections, e.g. selecting a route, arranging non-overlapping items or designing a network of items. Branch-and-bound (B&B), a widely applied divide-and-conquer framework, often solves such problems by considering a continuous approximation, e.g. replacing discrete variable domains by a continuous superset. Such approximations weaken the logical relations, e.g. for discrete variables corresponding to Boolean variables. Branching in B&B reintroduces logical relations by dividing the search space. This thesis studies designing B&B branching strategies, i.e. how to divide the search space, for optimisation problems that contain both a logical and a continuous structure. We begin our study with a large-scale, industrially-relevant optimisation problem where the objective consists of machine-learnt gradient-boosted trees (GBTs) and convex penalty functions. GBT functions contain if-then queries which introduces a logical structure to this problem. We propose decomposition-based rigorous bounding strategies and an iterative heuristic that can be embedded into a B&B algorithm. We approach branching with two strategies: a pseudocost initialisation and strong branching that target the structure of GBT and convex penalty aspects of the optimisation objective, respectively. Computational tests show that our B&B approach outperforms state-of-the-art solvers in deriving rigorous bounds on optimality. Our second project investigates how satisfiability modulo theories (SMT) derived unsatisfiable cores may be utilised in a B&B context. Unsatisfiable cores are subsets of constraints that explain an infeasible result. We study two-dimensional bin packing (2BP) and develop a B&B algorithm that branches on SMT unsatisfiable cores. We use the unsatisfiable cores to derive cuts that break 2BP symmetries. Computational results show that our B&B algorithm solves 20% more instances when compared with commercial solvers on the tested instances. Finally, we study convex generalized disjunctive programming (GDP), a framework that supports logical variables and operators. Convex GDP includes disjunctions of mathematical constraints, which motivate branching by partitioning the disjunctions. We investigate separation by branching, i.e. eliminating solutions that prevent rigorous bound improvement, and propose a greedy algorithm for building the branches. We propose three scoring methods for selecting the next branching disjunction. We also analyse how to leverage infeasibility to expedite the B&B search. Computational results show that our scoring methods can reduce the number of explored B&B nodes by an order of magnitude when compared with scoring methods proposed in literature. Our infeasibility analysis further reduces the number of explored nodes.Open Acces

Modelling and solution methods for portfolio optimisation

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University, 16/01/2004.In this thesis modelling and solution methods for portfolio optimisation are presented. The investigations reported in this thesis extend the Markowitz mean-variance model to the domain of quadratic mixed integer programming (QMIP) models which are 'NP-hard' discrete optimisation problems. In addition to the modelling extensions a number of challenging aspects of solution algorithms are considered. The relative performances of sparse simplex (SSX) as well as the interior point method (IPM) are studied in detail. In particular, the roles of 'warmstart' and dual simplex are highlighted as applied to the construction of the efficient frontier which requires processing a family of problems; that is, the portfolio planning model stated in a parametric form. The method of solving QMIP models using the branch and bound algorithm is first developed; this is followed up by heuristics which improve the performance of the (discrete) solution algorithm. Some properties of the efficient frontier with discrete constraints are considered and a method of computing the discrete efficient frontier (DEF) efficiently is proposed. The computational investigation considers the efficiency and effectiveness in respect of the scale up properties of the proposed algorithm. The extensions of the real world models and the proposed solution algorithms make contribution as new knowledge

Cooperation of Combinatorial Solvers for Air Traffic Management and Control

In the context of the SESAR project, Air Traffic Control (ATC) and Management (ATM) in Europe is undergoing a paradigm shift to be able to accommodate the current traffic growth forecast: many expert-based systems will be enhanced by optimization software to improve the decisionmaking process and regulation planning. Current state-of-the-art combinatorial optimization techniques that are applied to ATC and ATM include approximation algorithms like metaheuristics (e.g. Genetic Algorithm, Tabu Search, Simulated Annealing, etc.) and complete algorithms like Constraint Programming (CP) and Mixed Integer Programming. However, the large scale of the considered instances and the handling of their inherent uncertainties result in very hard problems, which can hinder or even defeat either of the previously mentioned optimization methods alone. To overcome these difficulties and improve the resolution efficiency of standard algorithms, we propose to study the generic cooperation of any set of combinatorial solvers by sharing solutions, optimization bounds and possibly other information in order to speed up the overall process. In this thesis, we have specified and implemented a distributed system which is able to integrate any combinatorial solver with the suitable interface, adapt existing solvers to take into account and provide information on the state of the search from and to other solvers, and applied this framework to two ATC and ATM problems: the en-route conflict resolution problem and the Gate Allocation Problem (GAP). For the first one, we have presented a new generic framework for the modeling and resolution of en-route conflicts in three dimensions as well as a large set of realistic instances, which have been solved with the cooperation of a Memetic Algorithm and Integer Linear Programming (ILP) solver. For the GAP, we have presented a new CP model, as well as new optimization constraints to maximize the robustness of the schedule, and search strategies together with their parallel cooperation. The solver, implemented with the FaCiLe CP library, outperforms a state-of-the-art ILP solver on real instances

Improved Peel-and-Bound: Methods for Generating Dual Bounds with Multivalued Decision Diagrams

Decision diagrams are an increasingly important tool in cutting-edge solvers for discrete optimization. However, the field of decision diagrams is relatively new, and is still incorporating the library of techniques that conventional solvers have had decades to build. We drew inspiration from the warm-start technique used in conventional solvers to address one of the major challenges faced by decision diagram based methods. Decision diagrams become more useful the wider they are allowed to be, but also become more costly to generate, especially with large numbers of variables. In the original version of this paper, we presented a method of peeling off a sub-graph of previously constructed diagrams and using it as the initial diagram for subsequent iterations that we call peel-and-bound. We tested the method on the sequence ordering problem, and our results indicate that our peel-and-bound scheme generates stronger bounds than a branch-and-bound scheme using the same propagators, and at significantly less computational cost. In this extended version of the paper, we also propose new methods for using relaxed decision diagrams to improve the solutions found using restricted decision diagrams, discuss the heuristic decisions involved with the parallelization of peel-and-bound, and discuss how peel-and-bound can be hyper-optimized for sequencing problems. Furthermore, we test the new methods on the sequence ordering problem and the traveling salesman problem with time-windows (TSPTW), and include an updated and generalized implementation of the algorithm capable of handling any discrete optimization problem. The new results show that peel-and-bound outperforms ddo (a decision diagram based branch-and-bound solver) on the TSPTW. We also close 15 open benchmark instances of the TSPTW.Comment: 50 pages, 31 figures, published by JAIR, supplementary materials at https://github.com/IsaacRudich/ImprovedPnB. arXiv admin note: substantial text overlap with arXiv:2205.0521

Modelling and solution methods for portfolio optimisation

In this thesis modelling and solution methods for portfolio optimisation are presented. The investigations reported in this thesis extend the Markowitz mean-variance model to the domain of quadratic mixed integer programming (QMIP) models which are 'NP-hard' discrete optimisation problems. In addition to the modelling extensions a number of challenging aspects of solution algorithms are considered. The relative performances of sparse simplex (SSX) as well as the interior point method (IPM) are studied in detail. In particular, the roles of 'warmstart' and dual simplex are highlighted as applied to the construction of the efficient frontier which requires processing a family of problems; that is, the portfolio planning model stated in a parametric form. The method of solving QMIP models using the branch and bound algorithm is first developed; this is followed up by heuristics which improve the performance of the (discrete) solution algorithm. Some properties of the efficient frontier with discrete constraints are considered and a method of computing the discrete efficient frontier (DEF) efficiently is proposed. The computational investigation considers the efficiency and effectiveness in respect of the scale up properties of the proposed algorithm. The extensions of the real world models and the proposed solution algorithms make contribution as new knowledge.EThOS - Electronic Theses Online ServiceGBUnited Kingdo

Domain-independent local search for linear integer optimization

Integer and combinatorial optimization problems constitute a major challenge for algorithmics. They arise when a large number of discrete organizational decisions have to be made, subject to constraints and optimization criteria. This thesis describes and investigates new domain-independent local search strategies for linear integer optimization. We introduce WSAT(OIP), an integer local search method which operates on an algebraic problem representation. WSAT(OIP) generalizes Walksat, a successful local search procedure for propositional satisfiability (SAT), to more expressive constraint systems. For this purpose, we introduce over-constrained integer programs (OIPs), a constraint class which is closely related to integer programs. OIP allows for a natural generalization of the principles of SAT local search to integer optimization. Further, it will be shown that OIPs are a special case of integer linear programs and permit combinations with linear programming for bound computation, initialization by rounding, search space reduction, and feasibility testing. The representation is similar enough to integer programs to make use of existing algebraic modeling languages as front-end to a local search solver. To improve performance on realistic problems, WSAT(OIP) incorporates strategies from Tabu Search. We experimentally investigate WSAT(OIP) for a variety of realistic integer optimization problems from the domains of time tabling, sports scheduling, radar surveillance, course assignment, and capacitated production planning. The experimental design examines efficiency, scaling (with increasing problem size and constrainedness), and robustness. The results demonstrate that integer local search can outperform or compete with state-of-the-art integer programming (IP) branch-and-bound and constraint programming (CP) approaches to these problems in finding near-optimal solutions. Key findings of our empirical study include that integer local search is able to solve difficult constraint problems from time-tabling and sports scheduling when cast into a 0-1 representation, which are beyond the scope of IP branch-and-bound strategies and for which devising robust constraint programs is a non-trivial task. For several realistic optimization problems (0-1 integer and finite domain) we show that integer local search exhibits graceful runtime scaling with increasing problem size and constrainedness. It can therefore significantly outperform IP branch-and-bound strategies on large or tightly constrained problems in finding near-optimal solutions. The problems under consideration are mostly beyond the limitations of a previous general-purpose simulated annealing strategy for 0-1 integer programs.Ganzzahlige und kombinatorische Optimierungsprobleme stellen eine schwierige Herausforderung im Gebiet der Algorithmen dar. Sie treten auf, wenn eine große Anzahl diskreter organisatorischer Entscheidungen unter Berücksichtigung von Constraints und Optimierungskriterien zu treffen sind. Diese Arbeit beschreibt und untersucht neue, domänenunabhängige Strategien der lokalen Suche zur ganzzahligen linearen Optimierung. Wir beschreiben WSAT(OIP), eine Strategie "ganzzahliger lokaler Suche\u27;, die auf einer algebraischen Problemrepräsentation operiert. WSAT(OIP) verallgemeinert Walksat, eine erfolgreiche Prozedur lokaler Suche für das Erfüllbarkeitsproblem der Aussagenlogik (SAT), auf ausdrucksstärkere Constraint-Systeme. Für diesen Zweck führen wir die Klasse der "Over-constrained Integer Programs\u27;(OIPs) ein, eine Constraint-Klasse, die eng mit ganzzahligen Programmen verwandt ist. OIPs erlauben einerseits eine natürliche Verallgemeinerung der Prinzipien von lokaler Suche für SAT. Andererseits sind sie ein Spezialfall der ganzzahligen linearen Programme und ermöglichen die Kombination mit linearer Programmierung zur Berechnung von Schranken, Initialisierung durch Rundung, Suchraum-Reduktion und für Gültigkeits-Tests. OIPs sind ganzzahligen Programmen ähnlich, so daß existierende algebraische Modellierungssprachen als Eingabeschnittstelle für einen Problemlöser benutzt werden können, der auf lokaler Suche basiert. Um die Performanz auf realistischen Problemen zu verbessern, ist WSAT(OIP) mit Strategien der Tabu-Suche ausgestattet. Wir führen eine experimentelle Untersuchung von WSAT(OIP) auf einer Reihe von realistischen ganzzahligen Constraint- und Optimierungsproblemen durch. Die Probleme stammen aus den Domänen Zeitplan-Erstellung, Sport-Ablaufplanung, Radar- Überwachung, Kurs-Zuteilung und Produktions-Planung. Das experimentelle Design untersucht Effizienz, Skalierung mit zunehmender Problemgröße und stärkeren Constraints sowie Robustheit. Die Ergebnisse zeigen, daß ganzzahlige lokale Suche bezüglich Performanz auf diesen Problemklassen zeitgemäße Ansätze der ganzzahligen Programmierung und der Constraint-Programmierung beim Finden nahe-optimaler Lösungen schlägt oder mit ihnen konkurriert. Kernergebnisse der empirischen Untersuchung sind, daß ganzzahlige lokale Suche in der Lage ist, schwierige Constraint-Probleme der Zeitplan-Erstellung und Sport-Ablaufplanung in einer 0-1 Repräsentation zu lösen, die außerhalb der Grenzen der ganzzahligen linearen Programmierung liegen, und für die die Entwicklung eines robustes Constraint-Programms eine nicht-triviale Aufgabe darstellt. Für mehrere realistische Optimierungsprobleme (ganzzahlig 0-1 und endliche Bereiche)zeigen wir, daß ganzzahlige lokale Suche eine günstige Skalierung der Laufzeit mit zunehmender Problemgröße und Constrainedness aufweist. Dadurch zeigt das Verfahren auf großen Problemen und auf Problemen mit starken Constraints deutlich bessere Performanz für das Finden nahe-Lösungen als die Branch-and-Bound Strategie der ganzzahligen Programmierung. Die untersuchten Probleme liegen zumeist außerhalb der Grenzen einer existierenden Simulated Annealing Strategie für allgemeine lineare 0-1 Programme

G-CSC Report 2010

The present report gives a short summary of the research of the Goethe Center for Scientific Computing (G-CSC) of the Goethe University Frankfurt. G-CSC aims at developing and applying methods and tools for modelling and numerical simulation of problems from empirical science and technology. In particular, fast solvers for partial differential equations (i.e. pde) such as robust, parallel, and adaptive multigrid methods and numerical methods for stochastic differential equations are developed. These methods are highly adanvced and allow to solve complex problems.. The G-CSC is organised in departments and interdisciplinary research groups. Departments are localised directly at the G-CSC, while the task of interdisciplinary research groups is to bridge disciplines and to bring scientists form different departments together. Currently, G-CSC consists of the department Simulation and Modelling and the interdisciplinary research group Computational Finance

Iterative restricted space search : a solving approach based on hybridization

Face à la complexité qui caractérise les problèmes d'optimisation de grande taille l'exploration complète de l'espace des solutions devient rapidement un objectif inaccessible. En effet, à mesure que la taille des problèmes augmente, des méthodes de solution de plus en plus sophistiquées sont exigées afin d'assurer un certain niveau d 'efficacité. Ceci a amené une grande partie de la communauté scientifique vers le développement d'outils spécifiques pour la résolution de problèmes de grande taille tels que les méthodes hybrides. Cependant, malgré les efforts consentis dans le développement d'approches hybrides, la majorité des travaux se sont concentrés sur l'adaptation de deux ou plusieurs méthodes spécifiques, en compensant les points faibles des unes par les points forts des autres ou bien en les adaptant afin de collaborer ensemble. Au meilleur de notre connaissance, aucun travail à date n'à été effectué pour développer un cadre conceptuel pour la résolution efficace de problèmes d'optimisation de grande taille, qui soit à la fois flexible, basé sur l'échange d'information et indépendant des méthodes qui le composent. L'objectif de cette thèse est d'explorer cette avenue de recherche en proposant un cadre conceptuel pour les méthodes hybrides, intitulé la recherche itérative de l'espace restreint, ±Iterative Restricted Space Search (IRSS)>>, dont, la principale idée est la définition et l'exploration successives de régions restreintes de l'espace de solutions. Ces régions, qui contiennent de bonnes solutions et qui sont assez petites pour être complètement explorées, sont appelées espaces restreints "Restricted Spaces (RS)". Ainsi, l'IRSS est une approche de solution générique, basée sur l'interaction de deux phases algorithmiques ayant des objectifs complémentaires. La première phase consiste à identifier une région restreinte intéressante et la deuxième phase consiste à l'explorer. Le schéma hybride de l'approche de solution permet d'alterner entre les deux phases pour un nombre fixe d'itérations ou jusqu'à l'atteinte d'une certaine limite de temps. Les concepts clés associées au développement de ce cadre conceptuel et leur validation seront introduits et validés graduellement dans cette thèse. Ils sont présentés de manière à permettre au lecteur de comprendre les problèmes que nous avons rencontrés en cours de développement et comment les solutions ont été conçues et implémentées. À cette fin, la thèse a été divisée en quatre parties. La première est consacrée à la synthèse de l'état de l'art dans le domaine de recherche sur les méthodes hybrides. Elle présente les principales approches hybrides développées et leurs applications. Une brève description des approches utilisant le concept de restriction d'espace est aussi présentée dans cette partie. La deuxième partie présente les concepts clés de ce cadre conceptuel. Il s'agit du processus d'identification des régions restreintes et des deux phases de recherche. Ces concepts sont mis en oeuvre dans un schéma hybride heuristique et méthode exacte. L'approche a été appliquée à un problème d'ordonnancement avec deux niveaux de décision, relié au contexte des pâtes et papier: "Pulp Production Scheduling Problem". La troisième partie a permit d'approfondir les concepts développés et ajuster les limitations identifiées dans la deuxième partie, en proposant une recherche itérative appliquée pour l'exploration de RS de grande taille et une structure en arbre binaire pour l'exploration de plusieurs RS. Cette structure a l'avantage d'éviter l'exploration d 'un espace déjà exploré précédemment tout en assurant une diversification naturelle à la méthode. Cette extension de la méthode a été testée sur un problème de localisation et d'allocation en utilisant un schéma d'hybridation heuristique-exact de manière itérative. La quatrième partie généralise les concepts préalablement développés et conçoit un cadre général qui est flexible, indépendant des méthodes utilisées et basé sur un échange d'informations entre les phases. Ce cadre a l'avantage d'être général et pourrait être appliqué à une large gamme de problèmes