215 research outputs found
Narrow Proofs May Be Maximally Long
We prove that there are 3-CNF formulas over n variables that can be refuted
in resolution in width w but require resolution proofs of size n^Omega(w). This
shows that the simple counting argument that any formula refutable in width w
must have a proof in size n^O(w) is essentially tight. Moreover, our lower
bound generalizes to polynomial calculus resolution (PCR) and Sherali-Adams,
implying that the corresponding size upper bounds in terms of degree and rank
are tight as well. Our results do not extend all the way to Lasserre, however,
where the formulas we study have proofs of constant rank and size polynomial in
both n and w
Narrow proofs may be maximally long
We prove that there are 3-CNF formulas over n variables that can be refuted in resolution in width w but require resolution proofs of size n(Omega(w)). This shows that the simple counting argument that any formula refutable in width w must have a proof in size n(O(w)) is essentially tight. Moreover, our lower bound generalizes to polynomial calculus resolution and Sherali-Adams, implying that the corresponding size upper bounds in terms of degree and rank are tight as well. The lower bound does not extend all the way to Lasserre, however, since we show that there the formulas we study have proofs of constant rank and size polynomial in both n and w.Peer ReviewedPostprint (author's final draft
Tight Size-Degree Bounds for Sums-of-Squares Proofs
We exhibit families of -CNF formulas over variables that have
sums-of-squares (SOS) proofs of unsatisfiability of degree (a.k.a. rank)
but require SOS proofs of size for values of from
constant all the way up to for some universal constant.
This shows that the running time obtained by using the Lasserre
semidefinite programming relaxations to find degree- SOS proofs is optimal
up to constant factors in the exponent. We establish this result by combining
-reductions expressible as low-degree SOS derivations with the
idea of relativizing CNF formulas in [Kraj\'i\v{c}ek '04] and [Dantchev and
Riis'03], and then applying a restriction argument as in [Atserias, M\"uller,
and Oliva '13] and [Atserias, Lauria, and Nordstr\"om '14]. This yields a
generic method of amplifying SOS degree lower bounds to size lower bounds, and
also generalizes the approach in [ALN14] to obtain size lower bounds for the
proof systems resolution, polynomial calculus, and Sherali-Adams from lower
bounds on width, degree, and rank, respectively
Lift & Project Systems Performing on the Partial-Vertex-Cover Polytope
We study integrality gap (IG) lower bounds on strong LP and SDP relaxations
derived by the Sherali-Adams (SA), Lovasz-Schrijver-SDP (LS+), and
Sherali-Adams-SDP (SA+) lift-and-project (L&P) systems for the
t-Partial-Vertex-Cover (t-PVC) problem, a variation of the classic Vertex-Cover
problem in which only t edges need to be covered. t-PVC admits a
2-approximation using various algorithmic techniques, all relying on a natural
LP relaxation. Starting from this LP relaxation, our main results assert that
for every epsilon > 0, level-Theta(n) LPs or SDPs derived by all known L&P
systems that have been used for positive algorithmic results (but the Lasserre
hierarchy) have IGs at least (1-epsilon)n/t, where n is the number of vertices
of the input graph. Our lower bounds are nearly tight.
Our results show that restricted yet powerful models of computation derived
by many L&P systems fail to witness c-approximate solutions to t-PVC for any
constant c, and for t = O(n). This is one of the very few known examples of an
intractable combinatorial optimization problem for which LP-based algorithms
induce a constant approximation ratio, still lift-and-project LP and SDP
tightenings of the same LP have unbounded IGs.
We also show that the SDP that has given the best algorithm known for t-PVC
has integrality gap n/t on instances that can be solved by the level-1 LP
relaxation derived by the LS system. This constitutes another rare phenomenon
where (even in specific instances) a static LP outperforms an SDP that has been
used for the best approximation guarantee for the problem at hand. Finally, one
of our main contributions is that we make explicit of a new and simple
methodology of constructing solutions to LP relaxations that almost trivially
satisfy constraints derived by all SDP L&P systems known to be useful for
algorithmic positive results (except the La system).Comment: 26 page
Tight Sum-of-Squares lower bounds for binary polynomial optimization problems
We give two results concerning the power of the Sum-of-Squares(SoS)/Lasserre
hierarchy. For binary polynomial optimization problems of degree and an
odd number of variables , we prove that levels of the
SoS/Lasserre hierarchy are necessary to provide the exact optimal value. This
matches the recent upper bound result by Sakaue, Takeda, Kim and Ito.
Additionally, we study a conjecture by Laurent, who considered the linear
representation of a set with no integral points. She showed that the
Sherali-Adams hierarchy requires levels to detect the empty integer hull,
and conjectured that the SoS/Lasserre rank for the same problem is . We
disprove this conjecture and derive lower and upper bounds for the rank
Extended Formulation Lower Bounds via Hypergraph Coloring?
Exploring the power of linear programming for combinatorial optimization
problems has been recently receiving renewed attention after a series of
breakthrough impossibility results. From an algorithmic perspective, the
related questions concern whether there are compact formulations even for
problems that are known to admit polynomial-time algorithms.
We propose a framework for proving lower bounds on the size of extended
formulations. We do so by introducing a specific type of extended relaxations
that we call product relaxations and is motivated by the study of the
Sherali-Adams (SA) hierarchy. Then we show that for every approximate
relaxation of a polytope P, there is a product relaxation that has the same
size and is at least as strong. We provide a methodology for proving lower
bounds on the size of approximate product relaxations by lower bounding the
chromatic number of an underlying hypergraph, whose vertices correspond to
gap-inducing vectors.
We extend the definition of product relaxations and our methodology to mixed
integer sets. However in this case we are able to show that mixed product
relaxations are at least as powerful as a special family of extended
formulations. As an application of our method we show an exponential lower
bound on the size of approximate mixed product formulations for the metric
capacitated facility location problem, a problem which seems to be intractable
for linear programming as far as constant-gap compact formulations are
concerned
Exponential Lower Bounds for Polytopes in Combinatorial Optimization
We solve a 20-year old problem posed by Yannakakis and prove that there
exists no polynomial-size linear program (LP) whose associated polytope
projects to the traveling salesman polytope, even if the LP is not required to
be symmetric. Moreover, we prove that this holds also for the cut polytope and
the stable set polytope. These results were discovered through a new connection
that we make between one-way quantum communication protocols and semidefinite
programming reformulations of LPs.Comment: 19 pages, 4 figures. This version of the paper will appear in the
Journal of the ACM. The earlier conference version in STOC'12 had the title
"Linear vs. Semidefinite Extended Formulations: Exponential Separation and
Strong Lower Bounds
Uncapacitated Flow-based Extended Formulations
An extended formulation of a polytope is a linear description of this
polytope using extra variables besides the variables in which the polytope is
defined. The interest of extended formulations is due to the fact that many
interesting polytopes have extended formulations with a lot fewer inequalities
than any linear description in the original space. This motivates the
development of methods for, on the one hand, constructing extended formulations
and, on the other hand, proving lower bounds on the sizes of extended
formulations.
Network flows are a central paradigm in discrete optimization, and are widely
used to design extended formulations. We prove exponential lower bounds on the
sizes of uncapacitated flow-based extended formulations of several polytopes,
such as the (bipartite and non-bipartite) perfect matching polytope and TSP
polytope. We also give new examples of flow-based extended formulations, e.g.,
for 0/1-polytopes defined from regular languages. Finally, we state a few open
problems
- …