Approximate and Exact Merging of Knapsack Constraints with Cover Inequalities

This paper presents both approximate and exact merged knapsack cover inequalities, a class of cutting planes for knapsack and multiple knapsack integer programs. These inequalities combine the information from knapsack constraints and cover inequalities. Approximate merged knapsack cover inequalities can be generated through a O(n log n) algorithm, where n is the number of variables. This class of inequalities can be strengthened to an exact version with a pseudo-polynomial time algorithm. Computational experiments demonstrate an average improvement of approximately 8% in solution time and 5% in the number of ticks from CPLEX when approximate merged knapsack cover inequalities are implemented as preprocessing cuts to solve some benchmark multiple knapsack problems. Furthermore, exact merged knapsack cover inequalities improve the solution time and number of ticks of some random multiple knapsack instances by 15% and 5%, respectively

Mixed Integer Programming Approaches for Group Decision Making

Group decision making problems are everywhere in our day-to-day lives and have great influence on the daily operation of companies and institutions. With the recent advances in computational technology, it's not surprising that some companies would want to harvest that power to aid their decision-making procedures. Ethelo, the company that we partnered with in this project, developed an online platform that aids decision-making procedures by formulating the decision-making problem as a mixed integer nonlinear program (MINLP), providing feedback by solving the MINLP in real-time, and allowing the general public to contribute their opinions. Since an interactive component is involved, it is the goal of this thesis to attempt to reduce the solve time of their MINLP by applying tools from Operational Research. The main contribution in this thesis is threefold: first, we noticed that a big proportion of the MINLPs can be easily reposed as linear integer programs, and that a runtime reduction of at least 87.9\% can be achieved by simply redirecting them to a linear solver. Second, we identified a knapsack-like polyhedral structure that, to the best of our knowledge, has not been studied before, and derived a sufficient condition to identify the cases for which all valid cuts can be derived by considering other knapsack or covering problems. Finally, for the more general case where the objective function is nonlinear and not continuous, we derived a few different formulations to get to different approximations of the nonlinear model, and tested all of the approximations computationally

Knapsack Problems with Side Constraints

The thesis considers a specific class of resource allocation problems in Combinatorial Optimization: the Knapsack Problems. These are paradigmatic NP-hard problems where a set of items with given profits and weights is available. The aim is to select a subset of the items in order to maximize the total profit without exceeding a known knapsack capacity. In the classical 0-1 Knapsack Problem (KP), each item can be picked at most once. The focus of the thesis is on four generalizations of KP involving side constraints beyond the capacity bound. More precisely, we provide solution approaches and insights for the following problems: The Knapsack Problem with Setups; the Collapsing Knapsack Problem; the Penalized Knapsack Problem; the Incremental Knapsack Problem. These problems reveal challenging research topics with many real-life applications. The scientific contributions we provide are both from a theoretical and a practical perspective. On the one hand, we give insights into structural elements and properties of the problems and derive a series of approximation results for some of them. On the other hand, we offer valuable solution approaches for direct applications of practical interest or when the problems considered arise as sub-problems in broader contexts

Parameterized Approaches for Large-Scale Optimization Problems

In this dissertation, we study challenging discrete optimization problems from the perspective of parameterized complexity. The usefulness of this type of analysis is twofold. First, it can lead to efficient algorithms for large-scale problem instances. Second, the analysis can provide a rigorous explanation for why challenging problems might appear relatively easy in practice. We illustrate the approach on several different problems, including: the maximum clique problem in sparse graphs; 0-1 programs with many conflicts; and the node-weighted Steiner tree problem with few terminal nodes. We also study polyhedral counterparts to fixed-parameter tractable algorithms. Specifically, we provide fixed-parameter tractable extended formulations for independent set in tree-like graphs and for cardinality-constrained vertex covers

Topics in Mixed Integer Nonlinear Optimization

Mixed integer nonlinear optimization has many applications ranging from machine learning to power systems. However, these problems are very challenging to solve to global optimality due to the inherent non-convexity. This typically leads the problem to be NP-hard. Moreover, in many applications, there are time and resource limitations for solving real-world problems, and the sheer size of real instances can make solving them challenging. In this thesis, we focus on important elements of nonconvex optimization - including mixed integer linear programming and nonlinear programming, where both theoretical analyses and computational experiments are presented. In the first chapter we look at Mixed Integer Quadratic Programming (MIQP), the problem of minimizing a convex quadratic function over mixed integer points in a rational polyhedron. We utilize the augmented Lagrangian dual (ALD), which augments the usual Lagrangian dual with a weighted nonlinear penalty on the dualized constraints. We first prove that ALD will reach a zero duality gap asymptotically as the weight on the penalty goes to infinity under some mild conditions on the penalty function. We next show that a finite penalty weight is enough for a zero gap when we use any norm as the penalty function. Finally, we prove a polynomial bound on the weight on the penalty term to obtain a zero gap. In the second chapter we apply the technique of lifting to bilinear programming, a special case of quadratic constrained quadratic programming. We first show that, for sets described by one bilinear constraint together with bounds, it is always possible to sequentially lift a seed inequality. To reduce computational burden, we develop a framework based on subadditive approximations of lifting functions that permits sequence-independent lifting of seed inequalities for separable bilinear sets. We then study a separable bilinear set where the coefficients form a minimal cover with respect to the right-hand-side. For this set, we introduce a bilinear cover inequality, which is second-order cone representable. We study the lifting function of the bilinear cover inequality and lift fixed variable pairs in closed-form, thus deriving a lifted bilinear cover inequality that is valid for general separable bilinear sets with box constraints. In the third chapter we continue our research around separable bilinear programming. We first prove that the semidefinite programming relaxation provides no benefit over the McCormick relaxation for separable bilinear optimization problems. We then design a simple randomized separation heuristic for lifted bilinear cover inequalities. In our computational experiments, we separate many rounds of these inequalities starting from the McCormick relaxation of bilinear instances where each constraint is a separable bilinear constraint set. Our main result is to demonstrate that there is a significant improvement in the performance of a state-of-the-art global solver in terms of the gap closed, when these inequalities are added at the root node compared to when these inequalities are not added. In the fourth chapter we look at Mixed Integer Linear Programming (MILP) that arises in operational applications. Many routinely-solved MILPs are extremely challenging not only from a worst-case complexity perspective, but also because of the necessity to obtain good solutions within limited time. An example is the Security-Constrained Unit Commitment (SCUC) problem, solved daily to clear the day-ahead electricity markets. We develop ML-based methods for improving branch-and-bound variable selection rules that exploit key features of such operational problems: similar decisions are generated within the same day and across different days, based on the same power network. Utilizing similarity between instances and within an instance, we build one separate ML model per variable or per group of similar variables for learning to predict the strong branching score. The approach is able to produce branch-and-bound trees which gap closed only slightly worse than that of trees obtained by strong branching, while it outperforms previous machine learning schemes.Ph.D