Optimization over Integers with Robustness in Cost and Few Constraints

Robust optimization is an approach for optimization under uncertainty that has recently attracted attention both from theory and practitioners. While there is an elaborate and powerful machinery for continuous robust optimization problems, results on robust combinatorial optimization and robust linear integer programs are still rare and hardly general. In a seminal paper Bertsimas and Sim (2003) show that for an arbitrary, linear 0-1-problem, over which one can optimize, one can also optimize the cost-robust counterpart. They explicitly note that this method is confined to binary problems. We present a result of this type for general integer programs. Further, we extend the result to integer programs with uncertainty in one constraint

Minimizing Convex Functions with Integral Minimizers

Given a separation oracle $\mathsf{SO}$ for a convex function $f$ that has an integral minimizer inside a box with radius $R$, we show how to find an exact minimizer of $f$ using at most (a) $O(n (n + \log(R)))$ calls to $\mathsf{SO}$ and $\mathsf{poly}(n, \log(R))$ arithmetic operations, or (b) $O(n \log(nR))$ calls to $\mathsf{SO}$ and $\exp(n) \cdot \mathsf{poly}(\log(R))$ arithmetic operations. When the set of minimizers of $f$ has integral extreme points, our algorithm outputs an integral minimizer of $f$. This improves upon the previously best oracle complexity of $O(n^2 (n + \log(R)))$ for polynomial time algorithms obtained by [Gr\"otschel, Lov\'asz and Schrijver, Prog. Comb. Opt. 1984, Springer 1988] over thirty years ago. For the Submodular Function Minimization problem, our result immediately implies a strongly polynomial algorithm that makes at most $O(n^3)$ calls to an evaluation oracle, and an exponential time algorithm that makes at most $O(n^2 \log(n))$ calls to an evaluation oracle. These improve upon the previously best $O(n^3 \log^2(n))$ oracle complexity for strongly polynomial algorithms given in [Lee, Sidford and Wong, FOCS 2015] and [Dadush, V\'egh and Zambelli, SODA 2018], and an exponential time algorithm with oracle complexity $O(n^3 \log(n))$ given in the former work. Our result is achieved via a reduction to the Shortest Vector Problem in lattices. We show how an approximately shortest vector of certain lattice can be used to effectively reduce the dimension of the problem. Our analysis of the oracle complexity is based on a potential function that captures simultaneously the size of the search set and the density of the lattice, which we analyze via technical tools from convex geometry.Comment: This version of the paper simplifies and generalizes the results in an earlier version which will appear in SODA 202

Auction algorithms for generalized nonlinear network flow problems

Thesis (Ph.D.)--Boston UniversityNetwork flow is an area of optimization theory concerned with optimization over networks with a range of applicability in fields such as computer networks, manufacturing, finance, scheduling and routing, telecommunications, and transportation. In both linear and nonlinear networks, a family of primal-dual algorithms based on "approximate" Complementary Slackness (ε-CS) is among the fastest in centralized and distributed environments. These include the auction algorithm for the linear assignment/transportation problems, ε-relaxation and Auction/Sequential Shortest Path (ASSP) for the min-cost flow and max-flow problems. Within this family, the auction algorithm is particularly fast, as it uses "second best" information, as compared to using the more generic ε-relaxation for linear assignment/transportation. Inspired by the success of auction algorithms, we extend them to two important classes of nonlinear network flow problems. We start with the nonlinear Resource Allocation Problem (RAP). This problem consists of optimally assigning N divisible resources to M competing missions/tasks each with its own utility function. This simple yet powerful framework has found applications in diverse fields such as finance, economics, logistics, sensor and wireless networks. RAP is an instance of generalized network (networks with arc gains) flow problem but it has significant special structure analogous to the assignment/transportation problem. We develop a class of auction algorithms for RAP: a finite-time auction algorithm for both synchronous and asynchronous environments followed by a combination of forward and reverse auction with ε-scaling to achieve pseudo polynomial complexity for any non-increasing generalized convex utilities including non-continuous and/ or non-differentiable functions. These techniques are then generalized to handle shipping costs on allocations. Lastly, we demonstrate how these techniques can be used for solving a dynamic RAP where nodes may appear or disappear over time. In later part of the thesis, we consider the convex nonlinear min-cost flow problem. Although E-relaxation and ASSP are among the fastest available techniques here, we illustrate how nonlinear costs, as opposed to linear, introduce a significant bottleneck on the progress that these algorithms make per iteration. We then extend the core idea of the auction algorithm, use of second best to make aggressive steps, to overcome this bottleneck and hence develop a faster version of ε-relaxation. This new algorithm shares the same theoretical complexity as the original but outperforms it in our numerical experiments based on random test problem suites