Extended Formulations in Mixed-integer Convex Programming

We present a unifying framework for generating extended formulations for the polyhedral outer approximations used in algorithms for mixed-integer convex programming (MICP). Extended formulations lead to fewer iterations of outer approximation algorithms and generally faster solution times. First, we observe that all MICP instances from the MINLPLIB2 benchmark library are conic representable with standard symmetric and nonsymmetric cones. Conic reformulations are shown to be effective extended formulations themselves because they encode separability structure. For mixed-integer conic-representable problems, we provide the first outer approximation algorithm with finite-time convergence guarantees, opening a path for the use of conic solvers for continuous relaxations. We then connect the popular modeling framework of disciplined convex programming (DCP) to the existence of extended formulations independent of conic representability. We present evidence that our approach can yield significant gains in practice, with the solution of a number of open instances from the MINLPLIB2 benchmark library.Comment: To be presented at IPCO 201

Extended Formulations in Mixed-Integer Convex Programming

We present a unifying framework for generating extended formulations for the polyhedral outer approximations used in algorithms for mixed-integer convex programming (MICP). Extended formulations lead to fewer iterations of outer approximation algorithms and generally faster solution times. First, we observe that all MICP instances from the MINLPLIB2 benchmark library are conic representable with standard symmetric and nonsymmetric cones. Conic reformulations are shown to be effective extended formulations themselves because they encode separability structure. For mixed-integer conic-representable problems, we provide the first outer approximation algorithm with finite-time convergence guarantees, opening a path for the use of conic solvers for continuous relaxations. We then connect the popular modeling framework of disciplined convex programming (DCP) to the existence of extended formulations independent of conic representability. We present evidence that our approach can yield significant gains in practice, with the solution of a number of open instances from the MINLPLIB2 benchmark library.United States. Department of Energy. Computational Science Graduate Fellowship Program (Grant DE-FG02-97ER25308)United States. National Science Foundation. (Grant CMMI-1351619

Lot-sizing with stock upper bounds and fixed charges

Here we study the discrete lot-sizing problem with an initial stock variable and an associated variable upper bound constraint. This problem is of interest in its own right, and is also a natural relaxation of the constant capacity lot-sizing problem with upper bounds and fixed charges on the stock variables. We show that the convex hull of solutions of the discrete lot-sizing problem is obtained as the intersection of two simpler sets, one involving just 0-1 variables and the second a mixing set with a variable upper bound constraint. For these two sets we derive both inequality descriptions and polynomial-size extended formulations of their respective convex hulls. Finally we carry out some limited computational tests on single-item constant capacity lot-sizing problems with upper bounds and fixed charges on the stock variables in which we use the extended formulations derived above to strengthen the initial mixed integer programming formulations.mixed integer programming, discrete lot-sizing, stock fixed costs, mixing sets

Valid Inequalities and Reformulation Techniques for Mixed Integer Nonlinear Programming

One of the most important breakthroughs in the area of Mixed Integer Linear Programming (MILP) is the characterization of the convex hull of specially structured non-convex polyhedral sets in order to develop valid inequalities or cutting planes. Development of strong valid inequalities such as Split cuts, Gomory Mixed Integer (GMI) cuts, and Mixed Integer Rounding (MIR) cuts has resulted in highly effective branch-and-cut algorithms. While such cuts are known to be equivalent, each of their characterizations provides different advantages and insights. The study of cutting planes for Mixed Integer Nonlinear Programming (MINLP) is still much more limited than that for MILP, since characterizing cuts for MINLP requires the study of the convex hull of a non-convex and non-polyhedral set, which has proven to be significantly harder than the polyhedral case. However, there has been significant work on the computational use of cuts in MINLP. Furthermore, there has recently been a significant interest in extending the associated theoretical results from MILP to the realm of MINLP. This dissertation is focused on the development of new cuts and extended formulations for Mixed Integer Nonlinear Programs. We study the generalization of split, k-branch split, and intersection cuts from Mixed Integer Linear Programming to the realm of Mixed Integer Nonlinear Programming. Constructing such cuts requires calculating the convex hull of the difference between a convex set and an open set with a simple geometric structure. We introduce two techniques to give precise characterizations of such convex hulls and use them to construct split, k-branch split, and intersection cuts for several classes of non-polyhedral sets. We also study the relation between the introduced cuts and some known classes of cutting planes from MILP. Furthermore, we show how an aggregation technique can be easily extended to characterize the convex hull of sets defined by two quadratic or by a conic quadratic and a quadratic inequality. We also computationally evaluate the performance of the introduced cuts and extended formulations on two classes of MINLP problems

Mixing sets linked by bidirected paths

Recently there has been considerable research on simple mixed-integer sets, called mixing sets, and closely related sets arising in uncapacitated and constant capacity lot- sizing. This in turn has led to study of more general sets, called network-dual sets, for which it is possible to derive extended formulations whose projection gives the convex hull of the network-dual set. Unfortunately this formulation cannot be used (in general) to optimize in polynomial time. Furthermore the inequalities definining the convex hull of a network-dual set in the original space of variables are known only for some special cases. Here we study two new cases, in which the continuous variables of the network-dual set are linked by a bi- directed path. In the first case, which is motivated by lot-sizing problems with (lost) sales, we provide a description of the convex hull as the intersection of the convex hulls of 2^n mixing sets, where n is the number of continuous variables of the set. However optimization is polynomial as only n + 1 of the sets are required for any given objective function. In the second case, generalizing single arc flow sets, we describe again the convex hull as an intersection of an exponential number of mixing sets and also give a combinatorial polynomial-time separation algorithm.mixing sets, extended formulations, mixed integer programming, lot-sizing with sales

Compact extended formulations for low-rank functions with indicator variables

We study the mixed-integer epigraph of a low-rank convex function with non-convex indicator constraints, which are often used to impose logical constraints on the support of the solutions. Extended formulations describing the convex hull of such sets can easily be constructed via disjunctive programming, although a direct application of this method often yields prohibitively large formulations, whose size is exponential in the number of variables. In this paper, we propose a new disjunctive representation of the sets under study, which leads to compact formulations with size exponential in the rank of the function, but polynomial in the number of variables. Moreover, we show how to project out the additional variables for the case of rank-one functions, recovering or generalizing known results for the convex hulls of such sets (in the original space of variables)

Lifting Linear Extension Complexity Bounds to the Mixed-Integer Setting

Mixed-integer mathematical programs are among the most commonly used models for a wide set of problems in Operations Research and related fields. However, there is still very little known about what can be expressed by small mixed-integer programs. In particular, prior to this work, it was open whether some classical problems, like the minimum odd-cut problem, can be expressed by a compact mixed-integer program with few (even constantly many) integer variables. This is in stark contrast to linear formulations, where recent breakthroughs in the field of extended formulations have shown that many polytopes associated to classical combinatorial optimization problems do not even admit approximate extended formulations of sub-exponential size. We provide a general framework for lifting inapproximability results of extended formulations to the setting of mixed-integer extended formulations, and obtain almost tight lower bounds on the number of integer variables needed to describe a variety of classical combinatorial optimization problems. Among the implications we obtain, we show that any mixed-integer extended formulation of sub-exponential size for the matching polytope, cut polytope, traveling salesman polytope or dominant of the odd-cut polytope, needs $\Omega(n/\log n)$ many integer variables, where $n$ is the number of vertices of the underlying graph. Conversely, the above-mentioned polyhedra admit polynomial-size mixed-integer formulations with only $O(n)$ or $O(n \log n)$ (for the traveling salesman polytope) many integer variables. Our results build upon a new decomposition technique that, for any convex set $C$, allows for approximating any mixed-integer description of $C$ by the intersection of $C$ with the union of a small number of affine subspaces.Comment: A conference version of this paper will be presented at SODA 201