47 research outputs found
Lower Bounds for CSP Refutation by SDP Hierarchies
For a k-ary predicate P, a random instance of CSP(P) with n variables and m constraints is unsatisfiable with high probability when m >= O(n). The natural algorithmic task in this regime is refutation: finding a proof that a given random instance is unsatisfiable. Recent work of Allen et al. suggests that the difficulty of refuting CSP(P) using an SDP is determined by a parameter cmplx(P), the smallest t for which there does not exist a t-wise uniform distribution over satisfying assignments to P. In particular they show that random instances of CSP(P) with m >> n^{cmplx(P)/2} can be refuted efficiently using an SDP.
In this work, we give evidence that n^{cmplx(P)/2} constraints are also necessary for refutation using SDPs. Specifically, we show that if P supports a (t-1)-wise uniform distribution over satisfying assignments, then the Sherali-Adams_+ and Lovasz-Schrijver_+ SDP hierarchies cannot refute a random instance of CSP(P) in polynomial time for any m <= n^{t/2-epsilon}
Sum of squares lower bounds for refuting any CSP
Let be a nontrivial -ary predicate. Consider a
random instance of the constraint satisfaction problem on
variables with constraints, each being applied to randomly
chosen literals. Provided the constraint density satisfies , such
an instance is unsatisfiable with high probability. The \emph{refutation}
problem is to efficiently find a proof of unsatisfiability.
We show that whenever the predicate supports a -\emph{wise uniform}
probability distribution on its satisfying assignments, the sum of squares
(SOS) algorithm of degree
(which runs in time ) \emph{cannot} refute a random instance of
. In particular, the polynomial-time SOS algorithm requires
constraints to refute random instances of
CSP when supports a -wise uniform distribution on its satisfying
assignments. Together with recent work of Lee et al. [LRS15], our result also
implies that \emph{any} polynomial-size semidefinite programming relaxation for
refutation requires at least constraints.
Our results (which also extend with no change to CSPs over larger alphabets)
subsume all previously known lower bounds for semialgebraic refutation of
random CSPs. For every constraint predicate~, they give a three-way hardness
tradeoff between the density of constraints, the SOS degree (hence running
time), and the strength of the refutation. By recent algorithmic results of
Allen et al. [AOW15] and Raghavendra et al. [RRS16], this full three-way
tradeoff is \emph{tight}, up to lower-order factors.Comment: 39 pages, 1 figur
Approximability and proof complexity
This work is concerned with the proof-complexity of certifying that
optimization problems do \emph{not} have good solutions. Specifically we
consider bounded-degree "Sum of Squares" (SOS) proofs, a powerful algebraic
proof system introduced in 1999 by Grigoriev and Vorobjov. Work of Shor,
Lasserre, and Parrilo shows that this proof system is automatizable using
semidefinite programming (SDP), meaning that any -variable degree- proof
can be found in time . Furthermore, the SDP is dual to the well-known
Lasserre SDP hierarchy, meaning that the "-round Lasserre value" of an
optimization problem is equal to the best bound provable using a degree- SOS
proof. These ideas were exploited in a recent paper by Barak et al.\ (STOC
2012) which shows that the known "hard instances" for the Unique-Games problem
are in fact solved close to optimally by a constant level of the Lasserre SDP
hierarchy.
We continue the study of the power of SOS proofs in the context of difficult
optimization problems. In particular, we show that the Balanced-Separator
integrality gap instances proposed by Devanur et al.\ can have their optimal
value certified by a degree-4 SOS proof. The key ingredient is an SOS proof of
the KKL Theorem. We also investigate the extent to which the Khot--Vishnoi
Max-Cut integrality gap instances can have their optimum value certified by an
SOS proof. We show they can be certified to within a factor .952 ()
using a constant-degree proof. These investigations also raise an interesting
mathematical question: is there a constant-degree SOS proof of the Central
Limit Theorem?Comment: 34 page
Strongly Refuting Random CSPs Below the Spectral Threshold
Random constraint satisfaction problems (CSPs) are known to exhibit threshold
phenomena: given a uniformly random instance of a CSP with variables and
clauses, there is a value of beyond which the CSP will be
unsatisfiable with high probability. Strong refutation is the problem of
certifying that no variable assignment satisfies more than a constant fraction
of clauses; this is the natural algorithmic problem in the unsatisfiable regime
(when ).
Intuitively, strong refutation should become easier as the clause density
grows, because the contradictions introduced by the random clauses become
more locally apparent. For CSPs such as -SAT and -XOR, there is a
long-standing gap between the clause density at which efficient strong
refutation algorithms are known, , and the
clause density at which instances become unsatisfiable with high probability,
.
In this paper, we give spectral and sum-of-squares algorithms for strongly
refuting random -XOR instances with clause density in time or in
rounds of the sum-of-squares hierarchy, for any
and any integer . Our algorithms provide a smooth
transition between the clause density at which polynomial-time algorithms are
known at , and brute-force refutation at the satisfiability
threshold when . We also leverage our -XOR results to obtain
strong refutation algorithms for SAT (or any other Boolean CSP) at similar
clause densities. Our algorithms match the known sum-of-squares lower bounds
due to Grigoriev and Schonebeck, up to logarithmic factors.
Additionally, we extend our techniques to give new results for certifying
upper bounds on the injective tensor norm of random tensors
Tight Size-Degree Bounds for Sums-of-Squares Proofs
We exhibit families of -CNF formulas over variables that have
sums-of-squares (SOS) proofs of unsatisfiability of degree (a.k.a. rank)
but require SOS proofs of size for values of from
constant all the way up to for some universal constant.
This shows that the running time obtained by using the Lasserre
semidefinite programming relaxations to find degree- SOS proofs is optimal
up to constant factors in the exponent. We establish this result by combining
-reductions expressible as low-degree SOS derivations with the
idea of relativizing CNF formulas in [Kraj\'i\v{c}ek '04] and [Dantchev and
Riis'03], and then applying a restriction argument as in [Atserias, M\"uller,
and Oliva '13] and [Atserias, Lauria, and Nordstr\"om '14]. This yields a
generic method of amplifying SOS degree lower bounds to size lower bounds, and
also generalizes the approach in [ALN14] to obtain size lower bounds for the
proof systems resolution, polynomial calculus, and Sherali-Adams from lower
bounds on width, degree, and rank, respectively
Hardness of robust graph isomorphism, Lasserre gaps, and asymmetry of random graphs
Building on work of Cai, F\"urer, and Immerman \cite{CFI92}, we show two
hardness results for the Graph Isomorphism problem. First, we show that there
are pairs of nonisomorphic -vertex graphs and such that any
sum-of-squares (SOS) proof of nonisomorphism requires degree . In
other words, we show an -round integrality gap for the Lasserre SDP
relaxation. In fact, we show this for pairs and which are not even
-isomorphic. (Here we say that two -vertex, -edge graphs
and are -isomorphic if there is a bijection between their
vertices which preserves at least edges.) Our second result is that
under the {\sc R3XOR} Hypothesis \cite{Fei02} (and also any of a class of
hypotheses which generalize the {\sc R3XOR} Hypothesis), the \emph{robust}
Graph Isomorphism problem is hard. I.e.\ for every , there is no
efficient algorithm which can distinguish graph pairs which are
-isomorphic from pairs which are not even
-isomorphic for some universal constant . Along the
way we prove a robust asymmetry result for random graphs and hypergraphs which
may be of independent interest
Subsampled Power Iteration: a Unified Algorithm for Block Models and Planted CSP's
We present an algorithm for recovering planted solutions in two well-known
models, the stochastic block model and planted constraint satisfaction
problems, via a common generalization in terms of random bipartite graphs. Our
algorithm matches up to a constant factor the best-known bounds for the number
of edges (or constraints) needed for perfect recovery and its running time is
linear in the number of edges used. The time complexity is significantly better
than both spectral and SDP-based approaches.
The main contribution of the algorithm is in the case of unequal sizes in the
bipartition (corresponding to odd uniformity in the CSP). Here our algorithm
succeeds at a significantly lower density than the spectral approaches,
surpassing a barrier based on the spectral norm of a random matrix.
Other significant features of the algorithm and analysis include (i) the
critical use of power iteration with subsampling, which might be of independent
interest; its analysis requires keeping track of multiple norms of an evolving
solution (ii) it can be implemented statistically, i.e., with very limited
access to the input distribution (iii) the algorithm is extremely simple to
implement and runs in linear time, and thus is practical even for very large
instances
Sum-of-squares lower bounds for planted clique
Finding cliques in random graphs and the closely related "planted" clique
variant, where a clique of size k is planted in a random G(n, 1/2) graph, have
been the focus of substantial study in algorithm design. Despite much effort,
the best known polynomial-time algorithms only solve the problem for k ~
sqrt(n).
In this paper we study the complexity of the planted clique problem under
algorithms from the Sum-of-squares hierarchy. We prove the first average case
lower bound for this model: for almost all graphs in G(n,1/2), r rounds of the
SOS hierarchy cannot find a planted k-clique unless k > n^{1/2r} (up to
logarithmic factors). Thus, for any constant number of rounds planted cliques
of size n^{o(1)} cannot be found by this powerful class of algorithms. This is
shown via an integrability gap for the natural formulation of maximum clique
problem on random graphs for SOS and Lasserre hierarchies, which in turn follow
from degree lower bounds for the Positivestellensatz proof system.
We follow the usual recipe for such proofs. First, we introduce a natural
"dual certificate" (also known as a "vector-solution" or "pseudo-expectation")
for the given system of polynomial equations representing the problem for every
fixed input graph. Then we show that the matrix associated with this dual
certificate is PSD (positive semi-definite) with high probability over the
choice of the input graph.This requires the use of certain tools. One is the
theory of association schemes, and in particular the eigenspaces and
eigenvalues of the Johnson scheme. Another is a combinatorial method we develop
to compute (via traces) norm bounds for certain random matrices whose entries
are highly dependent; we hope this method will be useful elsewhere