Strong duality in conic linear programming: facial reduction and extended duals

The facial reduction algorithm of Borwein and Wolkowicz and the extended dual of Ramana provide a strong dual for the conic linear program $$(P) \sup {<c, x> | Ax \leq_K b}$$ in the absence of any constraint qualification. The facial reduction algorithm solves a sequence of auxiliary optimization problems to obtain such a dual. Ramana's dual is applicable when (P) is a semidefinite program (SDP) and is an explicit SDP itself. Ramana, Tuncel, and Wolkowicz showed that these approaches are closely related; in particular, they proved the correctness of Ramana's dual using certificates from a facial reduction algorithm. Here we give a clear and self-contained exposition of facial reduction, of extended duals, and generalize Ramana's dual: -- we state a simple facial reduction algorithm and prove its correctness; and -- building on this algorithm we construct a family of extended duals when $K$ is a {\em nice} cone. This class of cones includes the semidefinite cone and other important cones.Comment: A previous version of this paper appeared as "A simple derivation of a facial reduction algorithm and extended dual systems", technical report, Columbia University, 2000, available from http://www.unc.edu/~pataki/papers/fr.pdf Jonfest, a conference in honor of Jonathan Borwein's 60th birthday, 201

Conic convex programming and self-dual embedding

How to initialize an algorithm to solve an optimization problem is of great theoretical and practical importance. In the simplex method for linear programming this issue is resolved by either the two-phase approach or using the so-called big M technique. In the interior point method, there is a more elegant way to deal with the initialization problem, viz. the self-dual embedding technique proposed by Ye, Todd and Mizuno (30). For linear programming this technique makes it possible to identify an optimal solution or conclude the problem to be infeasible/unbounded by solving its embedded self-dual problem. The embedded self-dual problem has a trivial initial solution and has the same structure as the original problem. Hence, it eliminates the need to consider the initialization problem at all. In this paper, we extend this approach to solve general conic convex programming, including semidefinite programming. Since a nonlinear conic convex programming problem may lack the so-called strict complementarity property, it causes difficulties in identifying solutions for the original problem, based on solutions for the embedded self-dual system. We provide numerous examples from semidefinite programming to illustrate various possibilities which have no analogue in the linear programming case

Characterizations of robust and stable duality for linearly perturbed uncertain optimization problems

We introduce a robust optimization model consisting in a family of perturbation functions giving rise to certain pairs of dual optimization problems in which the dual variable depends on the uncertainty parameter. The interest of our approach is illustrated by some examples, including uncertain conic optimization and infinite optimization via discretization. The main results characterize desirable robust duality relations (as robust zero-duality gap) by formulas involving the epsilon-minima or the epsilon-subdifferentials of the objective function. The two extreme cases, namely, the usual perturbational duality (without uncertainty), and the duality for the supremum of functions (duality parameter vanishing) are analyzed in detail. © Springer Nature Switzerland AG 2020

Universal Duality in Conic Convex Optimization

Given a primal-dual pair of linear programs, it is known that if their optimal values are viewed as lying on the extended real line, then the duality gap is zero, unless both problems are infeasible, in which case the optimal values are +infinity and -infinity. In contrast, for optimization problems over nonpolyhedral convex cones, a nonzero duality gap can exist even in the case where the primal and dual problems are both feasible. For a pair of dual conic convex programs, we provide simple conditions on the onstraint matricesand cone under which the duality gap is zero for every choice of linear objective function and ight-hand-side We refer to this property as niversal duality Our conditions possess the following properties: (i) they are necessary and sufficient, in the sense that if (and only if) they do not hold, the duality gap is nonzero for some linear objective function and ight-hand-side (ii) they are metrically and topologically generic; and (iii) they can be verified by solving a single conic convex program. As a side result, we also show that the feasible sets of a primal conic convex program and its dual cannot both be bounded, unless they are both empty, and we relate this to universal duality

S-Lemma with Equality and Its Applications

Let $f(x)=x^TAx+2a^Tx+c$ and $h(x)=x^TBx+2b^Tx+d$ be two quadratic functions having symmetric matrices $A$ and $B$. The S-lemma with equality asks when the unsolvability of the system $f(x)<0, h(x)=0$ implies the existence of a real number $\mu$ such that $f(x) + \mu h(x)\ge0, ~\forall x\in \mathbb{R}^n$. The problem is much harder than the inequality version which asserts that, under Slater condition, $f(x)<0, h(x)\le0$ is unsolvable if and only if $f(x) + \mu h(x)\ge0, ~\forall x\in \mathbb{R}^n$ for some $\mu\ge0$. In this paper, we show that the S-lemma with equality does not hold only when the matrix $A$ has exactly one negative eigenvalue and $h(x)$ is a non-constant linear function ($B=0, b\not=0$). As an application, we can globally solve $\inf\{f(x)\vert h(x)=0\}$ as well as the two-sided generalized trust region subproblem $\inf\{f(x)\vert l\le h(x)\le u\}$ without any condition. Moreover, the convexity of the joint numerical range $\{(f(x), h_1(x),\ldots, h_p(x)):~x\in\Bbb R^n\}$ where $f$ is a (possibly non-convex) quadratic function and $h_1(x),\ldots,h_p(x)$ are affine functions can be characterized using the newly developed S-lemma with equality.Comment: 34 page