42 research outputs found
Generalized roof duality and bisubmodular functions
Consider a convex relaxation of a pseudo-boolean function . We
say that the relaxation is {\em totally half-integral} if is a
polyhedral function with half-integral extreme points , and this property is
preserved after adding an arbitrary combination of constraints of the form
, , and where \gamma\in\{0, 1, 1/2} is a
constant. A well-known example is the {\em roof duality} relaxation for
quadratic pseudo-boolean functions . We argue that total half-integrality is
a natural requirement for generalizations of roof duality to arbitrary
pseudo-boolean functions. Our contributions are as follows. First, we provide a
complete characterization of totally half-integral relaxations by
establishing a one-to-one correspondence with {\em bisubmodular functions}.
Second, we give a new characterization of bisubmodular functions. Finally, we
show some relationships between general totally half-integral relaxations and
relaxations based on the roof duality.Comment: 14 pages. Shorter version to appear in NIPS 201
Bicriteria Approximation Algorithms for Priority Matroid Median
Fairness considerations have motivated new clustering problems and algorithms in recent years. In this paper we consider the Priority Matroid Median problem which generalizes the Priority k-Median problem that has recently been studied. The input consists of a set of facilities ? and a set of clients ? that lie in a metric space (? ? ?,d), and a matroid ? = (?,?) over the facilities. In addition, each client j has a specified radius r_j ? 0 and each facility i ? ? has an opening cost f_i > 0. The goal is to choose a subset S ? ? of facilities to minimize ?_{i ? ?} f_i + ?_{j ? ?} d(j,S) subject to two constraints: (i) S is an independent set in ? (that is S ? ?) and (ii) for each client j, its distance to an open facility is at most r_j (that is, d(j,S) ? r_j). For this problem we describe the first bicriteria (c?,c?) approximations for fixed constants c?,c?: the radius constraints of the clients are violated by at most a factor of c? and the objective cost is at most c? times the optimum cost. We also improve the previously known bicriteria approximation for the uniform radius setting (r_j : = L ? j ? ?)
Novel Analysis of the Branch-and-Bound Method for Integer Programming
Mixed-integer linear programming (MILP) has become a pillar of operational decision making and optimization, with large-scale economic and societal impact. MILP solvers drive multi-billion dollar industries and the operation of critical infrastructure, and this ability to use MILPs to effectively make large-scale discrete decisions relies on the ability to solve MILPs efficiently. Despite a half-century of active research on the subject, critical components of these solvers' underlying algorithms remain poorly understood theoretically. This thesis provides novel and fundamental explanations for, and practical insights on, several long-analyzed phenomena in the branch-and-bound method, the workhorse algorithm of all state-of-the-art MILP solvers. In Chapter 1, we give some background on branch-and-bound and related works.
These implementations of branch-and-bound typically use variable branching, that is, the child nodes are obtained by fixing some integer constrained variable to one of its possible values. Even though modern MILP solvers are able to solve very large-scale instances efficiently, relatively little attention has been given to understanding why the underlying branch-and-bound algorithm performs so well. In Chapter 2, our goal is to theoretically analyze the performance of the standard variable branching based branch-and-bound algorithm. In order to avoid the exponential worst-case lower bounds, we follow the common idea of considering random instances. More precisely, we consider random integer programs where the entries of the coefficient matrix and the objective function are randomly sampled. Our main result is that with good probability branch-and-bound with variable branching explores only a polynomial number of nodes to solve these instances, for a fixed number of constraints. To the best of our knowledge this is the first known such result for a standard version of branch-and-bound. We believe that this result provides an indication as to why branch-and-bound with variable branching works so well in practice.
To understand the difficulties of branch-and-bound, in Chapter 3 we study an algorithm that can be viewed as an abstraction of modern MILP solvers: general branch-and-bound. That is, instances that are challenging for general branch-and-bound are likely to also be challenging for MILP solvers. A general branch-and-bound tree is a branch-and-bound tree which is allowed to use general disjunctions to create child nodes. We construct a packing instance, a set covering instance, and a Traveling Salesman Problem instance, such that any general branch-and-bound tree that solves these instances must be of exponential size. We also verify that an exponential lower bound on the size of general branch-and-bound trees persists even when we add Gaussian noise to the coefficients of the cross-polytope, thus showing that a polynomial-size ``smoothed analysis'' upper bound is not possible.
Full strong-branching (henceforth referred to as strong-branching) is a well-known variable selection rule that is known experimentally to produce significantly smaller branch-and-bound trees in comparison to all other known variable selection rules. In Chapter 4, we attempt an analysis of the performance of the strong-branching rule both from a theoretical and a computational perspective. On the positive side for strong-branching we identify vertex cover as a class of instances where this rule provably works well. In particular, for vertex cover we present an upper bound on the size of the branch-and-bound tree using strong-branching as a function of the additive integrality gap, show how the Nemhauser-Trotter property of persistency which can be used as a pre-solve technique for vertex cover is being recursively and consistently used through-out the strong-branching based branch-and-bound tree, and finally provide an example of a vertex cover instance where not using strong-branching leads to a tree that has at least exponentially more nodes than the branch-and-bound tree based on strong-branching. On the negative side for strong-branching, we identify another class of instances where strong-branching based branch-and-bound tree has exponentially larger tree in comparison to another branch-and-bound tree for solving these instances. On the computational side, we conduct experiments on various types of instances like the lot-sizing problem and its variants, packing integer programs (IP), covering IPs, chance constrained IPs, vertex cover, etc., to understand how much larger is the size of the strong-branching based branch-and-bound tree in comparison to the optimal branch-and-bound tree. The main take-away from these experiments is that for all these instances, the size of the strong-branching based branch-and-bound tree is within a factor of two of the size of the optimal branch-and-bound tree.
Finally, in Chapter 5 we discuss possible extensions of the work covered in this thesis.Ph.D
Recommended from our members
Combinatorial Optimization (hybrid meeting)
Combinatorial Optimization deals with optimization problems defined on combinatorial structures such as graphs and networks. Motivated by diverse practical problem setups, the topic has developed into a rich mathematical discipline with many connections to other fields of Mathematics (such as, e.g., Combinatorics, Convex Optimization and Geometry, and Real Algebraic Geometry). It also has strong ties to Theoretical Computer Science and Operations Research. A series of Oberwolfach Workshops have been crucial for establishing and developing the field. The workshop we report about was a particularly exciting event - due to the depth of results that were presented, the spectrum of developments that became apparent from the talks, the breadth of the connections to other mathematical fields that were explored, and last but not least because for many of the particiants it was the first opportunity to exchange ideas and to collaborate during an on-site workshop since almost two years
Recommended from our members
Combinatorial Optimization
Combinatorial Optimization is a very active field that benefits from bringing together ideas from different areas, e.g., graph theory and combinatorics, matroids and submodularity, connectivity and network flows, approximation algorithms and mathematical programming, discrete and computational geometry, discrete and continuous problems, algebraic and geometric methods, and applications. We continued the long tradition of triannual Oberwolfach workshops, bringing together the best researchers from the above areas, discovering new connections, and establishing new and deepening existing international collaborations
Recommended from our members
Approximation Algorithms for NP-Hard Problems
The workshop was concerned with the most important recent developments in the area of efficient approximation algorithms for NP-hard optimization problems as well as with new techniques for proving intrinsic lower bounds for efficient approximation
Methods for Structural Pattern Recognition: Complexity and Applications
Katedra kybernetik