118,077 research outputs found
0-1 Integer Linear Programming with a Linear Number of Constraints
We give an exact algorithm for the 0-1 Integer Linear Programming problem
with a linear number of constraints that improves over exhaustive search by an
exponential factor. Specifically, our algorithm runs in time
where n is the number of variables and cn is the
number of constraints. The key idea for the algorithm is a reduction to the
Vector Domination problem and a new algorithm for that subproblem
Generalized Totalizer Encoding for Pseudo-Boolean Constraints
Pseudo-Boolean constraints, also known as 0-1 Integer Linear Constraints, are
used to model many real-world problems. A common approach to solve these
constraints is to encode them into a SAT formula. The runtime of the SAT solver
on such formula is sensitive to the manner in which the given pseudo-Boolean
constraints are encoded. In this paper, we propose generalized Totalizer
encoding (GTE), which is an arc-consistency preserving extension of the
Totalizer encoding to pseudo-Boolean constraints. Unlike some other encodings,
the number of auxiliary variables required for GTE does not depend on the
magnitudes of the coefficients. Instead, it depends on the number of distinct
combinations of these coefficients. We show the superiority of GTE with respect
to other encodings when large pseudo-Boolean constraints have low number of
distinct coefficients. Our experimental results also show that GTE remains
competitive even when the pseudo-Boolean constraints do not have this
characteristic.Comment: 10 pages, 2 figures, 2 tables. To be published in 21st International
Conference on Principles and Practice of Constraint Programming 201
Domain-independent local search for linear integer optimization
Integer and combinatorial optimization problems constitute a major challenge for algorithmics. They arise when a large number of discrete organizational decisions have to be made, subject to constraints and optimization criteria. This thesis describes and investigates new domain-independent local search strategies for linear integer optimization. We introduce WSAT(OIP), an integer local search method which operates on an algebraic problem representation. WSAT(OIP) generalizes Walksat, a successful local search procedure for propositional satisfiability (SAT), to more expressive constraint systems. For this purpose, we introduce over-constrained integer programs (OIPs), a constraint class which is closely related to integer programs. OIP allows for a natural generalization of the principles of SAT local search to integer optimization. Further, it will be shown that OIPs are a special case of integer linear programs and permit combinations with linear programming for bound computation, initialization by rounding, search space reduction, and feasibility testing. The representation is similar enough to integer programs to make use of existing algebraic modeling languages as front-end to a local search solver. To improve performance on realistic problems, WSAT(OIP) incorporates strategies from Tabu Search. We experimentally investigate WSAT(OIP) for a variety of realistic integer optimization problems from the domains of time tabling, sports scheduling, radar surveillance, course assignment, and capacitated production planning. The experimental design examines efficiency, scaling (with increasing problem size and constrainedness), and robustness. The results demonstrate that integer local search can outperform or compete with state-of-the-art integer programming (IP) branch-and-bound and constraint programming (CP) approaches to these problems in finding near-optimal solutions. Key findings of our empirical study include that integer local search is able to solve difficult constraint problems from time-tabling and sports scheduling when cast into a 0-1 representation, which are beyond the scope of IP branch-and-bound strategies and for which devising robust constraint programs is a non-trivial task. For several realistic optimization problems (0-1 integer and finite domain) we show that integer local search exhibits graceful runtime scaling with increasing problem size and constrainedness. It can therefore significantly outperform IP branch-and-bound strategies on large or tightly constrained problems in finding near-optimal solutions. The problems under consideration are mostly beyond the limitations of a previous general-purpose simulated annealing strategy for 0-1 integer programs.Ganzzahlige und kombinatorische Optimierungsprobleme stellen eine schwierige
Herausforderung im Gebiet der Algorithmen dar. Sie treten auf, wenn eine große
Anzahl diskreter organisatorischer Entscheidungen unter Berücksichtigung von
Constraints und Optimierungskriterien zu treffen sind. Diese Arbeit beschreibt und untersucht neue, domänenunabhängige Strategien der lokalen Suche zur ganzzahligen linearen Optimierung. Wir beschreiben WSAT(OIP), eine Strategie "ganzzahliger lokaler Suche';, die auf einer algebraischen
Problemrepräsentation operiert. WSAT(OIP) verallgemeinert Walksat, eine
erfolgreiche Prozedur lokaler Suche für das Erfüllbarkeitsproblem der Aussagenlogik (SAT), auf ausdrucksstärkere Constraint-Systeme. Für diesen Zweck führen wir die Klasse der "Over-constrained Integer Programs';(OIPs) ein, eine Constraint-Klasse, die eng mit ganzzahligen Programmen verwandt ist. OIPs erlauben einerseits eine natürliche Verallgemeinerung der Prinzipien von lokaler Suche für SAT. Andererseits sind sie ein Spezialfall der ganzzahligen linearen Programme und ermöglichen die Kombination mit linearer Programmierung zur Berechnung von Schranken, Initialisierung durch Rundung, Suchraum-Reduktion und für Gültigkeits-Tests. OIPs sind ganzzahligen Programmen ähnlich, so daß existierende algebraische Modellierungssprachen als Eingabeschnittstelle für einen Problemlöser benutzt werden können, der auf lokaler Suche basiert. Um die Performanz auf realistischen Problemen zu verbessern, ist WSAT(OIP) mit Strategien der Tabu-Suche ausgestattet. Wir führen eine experimentelle Untersuchung von WSAT(OIP) auf einer Reihe von realistischen ganzzahligen Constraint- und Optimierungsproblemen durch. Die Probleme stammen aus den Domänen Zeitplan-Erstellung, Sport-Ablaufplanung, Radar- Überwachung, Kurs-Zuteilung und Produktions-Planung. Das experimentelle Design untersucht Effizienz, Skalierung mit zunehmender Problemgröße und stärkeren Constraints sowie Robustheit. Die Ergebnisse zeigen, daß ganzzahlige lokale Suche bezüglich Performanz auf diesen Problemklassen zeitgemäße Ansätze der ganzzahligen Programmierung und der Constraint-Programmierung beim Finden nahe-optimaler Lösungen schlägt oder mit ihnen konkurriert. Kernergebnisse der empirischen Untersuchung sind, daß ganzzahlige lokale Suche in der Lage ist, schwierige Constraint-Probleme der Zeitplan-Erstellung und Sport-Ablaufplanung in einer 0-1 Repräsentation zu lösen, die außerhalb der Grenzen der ganzzahligen linearen Programmierung liegen, und für die die Entwicklung eines robustes Constraint-Programms eine nicht-triviale Aufgabe darstellt. Für mehrere realistische Optimierungsprobleme (ganzzahlig 0-1 und endliche Bereiche)zeigen wir, daß ganzzahlige lokale Suche eine günstige Skalierung der Laufzeit mit zunehmender Problemgröße und Constrainedness aufweist. Dadurch zeigt das Verfahren auf großen Problemen und auf Problemen mit starken Constraints deutlich bessere Performanz für das Finden nahe-Lösungen als die Branch-and-Bound Strategie der ganzzahligen Programmierung. Die untersuchten Probleme liegen zumeist außerhalb der Grenzen einer existierenden Simulated Annealing Strategie für allgemeine lineare 0-1 Programme
Domain-independent local search for linear integer optimization
Integer and combinatorial optimization problems constitute a major challenge for algorithmics. They arise when a large number of discrete organizational decisions have to be made, subject to constraints and optimization criteria. This thesis describes and investigates new domain-independent local search strategies for linear integer optimization. We introduce WSAT(OIP), an integer local search method which operates on an algebraic problem representation. WSAT(OIP) generalizes Walksat, a successful local search procedure for propositional satisfiability (SAT), to more expressive constraint systems. For this purpose, we introduce over-constrained integer programs (OIPs), a constraint class which is closely related to integer programs. OIP allows for a natural generalization of the principles of SAT local search to integer optimization. Further, it will be shown that OIPs are a special case of integer linear programs and permit combinations with linear programming for bound computation, initialization by rounding, search space reduction, and feasibility testing. The representation is similar enough to integer programs to make use of existing algebraic modeling languages as front-end to a local search solver. To improve performance on realistic problems, WSAT(OIP) incorporates strategies from Tabu Search. We experimentally investigate WSAT(OIP) for a variety of realistic integer optimization problems from the domains of time tabling, sports scheduling, radar surveillance, course assignment, and capacitated production planning. The experimental design examines efficiency, scaling (with increasing problem size and constrainedness), and robustness. The results demonstrate that integer local search can outperform or compete with state-of-the-art integer programming (IP) branch-and-bound and constraint programming (CP) approaches to these problems in finding near-optimal solutions. Key findings of our empirical study include that integer local search is able to solve difficult constraint problems from time-tabling and sports scheduling when cast into a 0-1 representation, which are beyond the scope of IP branch-and-bound strategies and for which devising robust constraint programs is a non-trivial task. For several realistic optimization problems (0-1 integer and finite domain) we show that integer local search exhibits graceful runtime scaling with increasing problem size and constrainedness. It can therefore significantly outperform IP branch-and-bound strategies on large or tightly constrained problems in finding near-optimal solutions. The problems under consideration are mostly beyond the limitations of a previous general-purpose simulated annealing strategy for 0-1 integer programs.Ganzzahlige und kombinatorische Optimierungsprobleme stellen eine schwierige
Herausforderung im Gebiet der Algorithmen dar. Sie treten auf, wenn eine große
Anzahl diskreter organisatorischer Entscheidungen unter Berücksichtigung von
Constraints und Optimierungskriterien zu treffen sind. Diese Arbeit beschreibt und untersucht neue, domänenunabhängige Strategien der lokalen Suche zur ganzzahligen linearen Optimierung. Wir beschreiben WSAT(OIP), eine Strategie "ganzzahliger lokaler Suche\u27;, die auf einer algebraischen
Problemrepräsentation operiert. WSAT(OIP) verallgemeinert Walksat, eine
erfolgreiche Prozedur lokaler Suche für das Erfüllbarkeitsproblem der Aussagenlogik (SAT), auf ausdrucksstärkere Constraint-Systeme. Für diesen Zweck führen wir die Klasse der "Over-constrained Integer Programs\u27;(OIPs) ein, eine Constraint-Klasse, die eng mit ganzzahligen Programmen verwandt ist. OIPs erlauben einerseits eine natürliche Verallgemeinerung der Prinzipien von lokaler Suche für SAT. Andererseits sind sie ein Spezialfall der ganzzahligen linearen Programme und ermöglichen die Kombination mit linearer Programmierung zur Berechnung von Schranken, Initialisierung durch Rundung, Suchraum-Reduktion und für Gültigkeits-Tests. OIPs sind ganzzahligen Programmen ähnlich, so daß existierende algebraische Modellierungssprachen als Eingabeschnittstelle für einen Problemlöser benutzt werden können, der auf lokaler Suche basiert. Um die Performanz auf realistischen Problemen zu verbessern, ist WSAT(OIP) mit Strategien der Tabu-Suche ausgestattet. Wir führen eine experimentelle Untersuchung von WSAT(OIP) auf einer Reihe von realistischen ganzzahligen Constraint- und Optimierungsproblemen durch. Die Probleme stammen aus den Domänen Zeitplan-Erstellung, Sport-Ablaufplanung, Radar- Überwachung, Kurs-Zuteilung und Produktions-Planung. Das experimentelle Design untersucht Effizienz, Skalierung mit zunehmender Problemgröße und stärkeren Constraints sowie Robustheit. Die Ergebnisse zeigen, daß ganzzahlige lokale Suche bezüglich Performanz auf diesen Problemklassen zeitgemäße Ansätze der ganzzahligen Programmierung und der Constraint-Programmierung beim Finden nahe-optimaler Lösungen schlägt oder mit ihnen konkurriert. Kernergebnisse der empirischen Untersuchung sind, daß ganzzahlige lokale Suche in der Lage ist, schwierige Constraint-Probleme der Zeitplan-Erstellung und Sport-Ablaufplanung in einer 0-1 Repräsentation zu lösen, die außerhalb der Grenzen der ganzzahligen linearen Programmierung liegen, und für die die Entwicklung eines robustes Constraint-Programms eine nicht-triviale Aufgabe darstellt. Für mehrere realistische Optimierungsprobleme (ganzzahlig 0-1 und endliche Bereiche)zeigen wir, daß ganzzahlige lokale Suche eine günstige Skalierung der Laufzeit mit zunehmender Problemgröße und Constrainedness aufweist. Dadurch zeigt das Verfahren auf großen Problemen und auf Problemen mit starken Constraints deutlich bessere Performanz für das Finden nahe-Lösungen als die Branch-and-Bound Strategie der ganzzahligen Programmierung. Die untersuchten Probleme liegen zumeist außerhalb der Grenzen einer existierenden Simulated Annealing Strategie für allgemeine lineare 0-1 Programme
Max-Min Diversification with Fairness Constraints: Exact and Approximation Algorithms
Diversity maximization aims to select a diverse and representative subset of
items from a large dataset. It is a fundamental optimization task that finds
applications in data summarization, feature selection, web search, recommender
systems, and elsewhere. However, in a setting where data items are associated
with different groups according to sensitive attributes like sex or race, it is
possible that algorithmic solutions for this task, if left unchecked, will
under- or over-represent some of the groups. Therefore, we are motivated to
address the problem of \emph{max-min diversification with fairness
constraints}, aiming to select items to maximize the minimum distance
between any pair of selected items while ensuring that the number of items
selected from each group falls within predefined lower and upper bounds. In
this work, we propose an exact algorithm based on integer linear programming
that is suitable for small datasets as well as a
-approximation algorithm for any that scales to large datasets. Extensive experiments on real-world datasets
demonstrate the superior performance of our proposed algorithms over existing
ones.Comment: 13 pages, 8 figures, to appear in SDM '2
Polyhedral Approximations of Quadratic Semi-Assignment Problems, Disjunctive Programs, and Base-2 Expansions of Integer Variables
This research is concerned with developing improved representations for special families of mixed-discrete programming problems. Such problems can typically be modeled using different mathematical forms, and the representation employed can greatly influence the problem\u27s ability to be solved. Generally speaking, it is desired to obtain mixed 0-1 linear forms whose continuous relaxations provide tight polyhedral outer-approximations to the convex hulls of feasible solutions. This dissertation makes contributions to three distinct problems, providing new forms that improve upon published works. The first emphasis is on devising solution procedures for the classical quadratic semi-assignment problem(QSAP), which is an NP-hard 0-1 quadratic program. The effort begins by using a reformulation-linearization technique to recast the problem as a mixed 0-1 linear program. The resulting form provides insight into identifying special instances that are readily solvable. For the general case, the form is shown to have a tight continuous relaxation, as well as to possess a decomposable structure. Specifically, a Hamiltonian decomposition of a graph interpretation is devised to motivate a Lagrangian dual whose subproblems consist of families of separable acyclic minimum-cost network flows. The result is an efficient approach for computing tight lower bounds on the optimal objective value to the original discrete program. Extensive computational experience is reported to evaluate the tightness of the representation and the expedience of the algorithm. The second contribution uses disjunctive programming arguments to model the convex hull of the union of a finite collection of polytopes. It is well known that the convex hull of the union of n polytopes can be obtained by lifting the problem into a higher-dimensional space using n auxiliary continuous (scaling) variables. When placed within a larger optimization problem, these variables must be restricted to be binary. This work examines an approach that uses fewer binary variables. The same scaling technique is employed, but the variables are treated as continuous by introducing a logarithmic number of new binary variables and constraints. The scaling variables can now be substituted from the problem. Moreover, an emphasis of this work, is that specially structured polytopes lead to well-defined projection operations that yield more concise forms. These special polytopes consist of knapsack problems having SOS-1 and SOS-2 type restrictions. Different projections are defined for the SOS-2 case, leading to forms that serve to both explain and unify alternative representations for piecewise-linear functions, as well as to promote favorable computational experience. The third contribution uses minimal cover and set covering inequalities to define the previously unknown convex hulls of special sets of binary vectors that are lexicographically lower and upper bounded by given vectors. These convex hulls are used to obtain ideal representations for base-2 expansions of bounded integer variables, and also afford a new perspective on, and extend convex hull results for, binary knapsack polytopes having weakly super-decreasing coefficients. Computational experience for base-2 expansions of integer variables exhibits a reduction in effort
FPT-algorithms for some problems related to integer programming
In this paper, we present FPT-algorithms for special cases of the shortest
lattice vector, integer linear programming, and simplex width computation
problems, when matrices included in the problems' formulations are near square.
The parameter is the maximum absolute value of rank minors of the corresponding
matrices. Additionally, we present FPT-algorithms with respect to the same
parameter for the problems, when the matrices have no singular rank
sub-matrices.Comment: arXiv admin note: text overlap with arXiv:1710.00321 From author:
some minor corrections has been don
Nonlinear Integer Programming
Research efforts of the past fifty years have led to a development of linear
integer programming as a mature discipline of mathematical optimization. Such a
level of maturity has not been reached when one considers nonlinear systems
subject to integrality requirements for the variables. This chapter is
dedicated to this topic.
The primary goal is a study of a simple version of general nonlinear integer
problems, where all constraints are still linear. Our focus is on the
computational complexity of the problem, which varies significantly with the
type of nonlinear objective function in combination with the underlying
combinatorial structure. Numerous boundary cases of complexity emerge, which
sometimes surprisingly lead even to polynomial time algorithms.
We also cover recent successful approaches for more general classes of
problems. Though no positive theoretical efficiency results are available, nor
are they likely to ever be available, these seem to be the currently most
successful and interesting approaches for solving practical problems.
It is our belief that the study of algorithms motivated by theoretical
considerations and those motivated by our desire to solve practical instances
should and do inform one another. So it is with this viewpoint that we present
the subject, and it is in this direction that we hope to spark further
research.Comment: 57 pages. To appear in: M. J\"unger, T. Liebling, D. Naddef, G.
Nemhauser, W. Pulleyblank, G. Reinelt, G. Rinaldi, and L. Wolsey (eds.), 50
Years of Integer Programming 1958--2008: The Early Years and State-of-the-Art
Surveys, Springer-Verlag, 2009, ISBN 354068274
Recommended from our members
Transformation of propositional calculus statements into integer and mixed integer programs: An approach towards automatic reformulation
A systematic procedure for transforming a set of logical statements or logical conditions imposed on a model into an Integer Linear Progamming (ILP) formulation Mixed Integer Programming (MIP) formulation is presented. An ILP stated as a system of linear constraints involving integer variables and an objective function, provides a powerful representation of decision problems through a tightly interrelated closed system of choices. It supports direct representation of logical (Boolean or prepositional calculus) expressions. Binary variables (hereafter called logical variables) are first introduced and methods of logically connecting these to other variables are then presented. Simple constraints can be combined to construct logical relationships and the methods of formulating these are discussed. A reformulation procedure which uses the extended reverse polish representation of a compound logical form is then described. These reformulation procedures are illustrated by two examples. A scheme of implementation.ithin an LP modelling system is outlined
- …