5,056 research outputs found
Frank-Wolfe Algorithms for Saddle Point Problems
We extend the Frank-Wolfe (FW) optimization algorithm to solve constrained
smooth convex-concave saddle point (SP) problems. Remarkably, the method only
requires access to linear minimization oracles. Leveraging recent advances in
FW optimization, we provide the first proof of convergence of a FW-type saddle
point solver over polytopes, thereby partially answering a 30 year-old
conjecture. We also survey other convergence results and highlight gaps in the
theoretical underpinnings of FW-style algorithms. Motivating applications
without known efficient alternatives are explored through structured prediction
with combinatorial penalties as well as games over matching polytopes involving
an exponential number of constraints.Comment: Appears in: Proceedings of the 20th International Conference on
Artificial Intelligence and Statistics (AISTATS 2017). 39 page
Exponential Lower Bounds for Polytopes in Combinatorial Optimization
We solve a 20-year old problem posed by Yannakakis and prove that there
exists no polynomial-size linear program (LP) whose associated polytope
projects to the traveling salesman polytope, even if the LP is not required to
be symmetric. Moreover, we prove that this holds also for the cut polytope and
the stable set polytope. These results were discovered through a new connection
that we make between one-way quantum communication protocols and semidefinite
programming reformulations of LPs.Comment: 19 pages, 4 figures. This version of the paper will appear in the
Journal of the ACM. The earlier conference version in STOC'12 had the title
"Linear vs. Semidefinite Extended Formulations: Exponential Separation and
Strong Lower Bounds
Convex Combinatorial Optimization
We introduce the convex combinatorial optimization problem, a far reaching
generalization of the standard linear combinatorial optimization problem. We
show that it is strongly polynomial time solvable over any edge-guaranteed
family, and discuss several applications
- …