107 research outputs found
Limitations of Algebraic Approaches to Graph Isomorphism Testing
We investigate the power of graph isomorphism algorithms based on algebraic
reasoning techniques like Gr\"obner basis computation. The idea of these
algorithms is to encode two graphs into a system of equations that are
satisfiable if and only if if the graphs are isomorphic, and then to (try to)
decide satisfiability of the system using, for example, the Gr\"obner basis
algorithm. In some cases this can be done in polynomial time, in particular, if
the equations admit a bounded degree refutation in an algebraic proof systems
such as Nullstellensatz or polynomial calculus. We prove linear lower bounds on
the polynomial calculus degree over all fields of characteristic different from
2 and also linear lower bounds for the degree of Positivstellensatz calculus
derivations.
We compare this approach to recently studied linear and semidefinite
programming approaches to isomorphism testing, which are known to be related to
the combinatorial Weisfeiler-Lehman algorithm. We exactly characterise the
power of the Weisfeiler-Lehman algorithm in terms of an algebraic proof system
that lies between degree-k Nullstellensatz and degree-k polynomial calculus
Tight Size-Degree Bounds for Sums-of-Squares Proofs
We exhibit families of -CNF formulas over variables that have
sums-of-squares (SOS) proofs of unsatisfiability of degree (a.k.a. rank)
but require SOS proofs of size for values of from
constant all the way up to for some universal constant.
This shows that the running time obtained by using the Lasserre
semidefinite programming relaxations to find degree- SOS proofs is optimal
up to constant factors in the exponent. We establish this result by combining
-reductions expressible as low-degree SOS derivations with the
idea of relativizing CNF formulas in [Kraj\'i\v{c}ek '04] and [Dantchev and
Riis'03], and then applying a restriction argument as in [Atserias, M\"uller,
and Oliva '13] and [Atserias, Lauria, and Nordstr\"om '14]. This yields a
generic method of amplifying SOS degree lower bounds to size lower bounds, and
also generalizes the approach in [ALN14] to obtain size lower bounds for the
proof systems resolution, polynomial calculus, and Sherali-Adams from lower
bounds on width, degree, and rank, respectively
Approximability and proof complexity
This work is concerned with the proof-complexity of certifying that
optimization problems do \emph{not} have good solutions. Specifically we
consider bounded-degree "Sum of Squares" (SOS) proofs, a powerful algebraic
proof system introduced in 1999 by Grigoriev and Vorobjov. Work of Shor,
Lasserre, and Parrilo shows that this proof system is automatizable using
semidefinite programming (SDP), meaning that any -variable degree- proof
can be found in time . Furthermore, the SDP is dual to the well-known
Lasserre SDP hierarchy, meaning that the "-round Lasserre value" of an
optimization problem is equal to the best bound provable using a degree- SOS
proof. These ideas were exploited in a recent paper by Barak et al.\ (STOC
2012) which shows that the known "hard instances" for the Unique-Games problem
are in fact solved close to optimally by a constant level of the Lasserre SDP
hierarchy.
We continue the study of the power of SOS proofs in the context of difficult
optimization problems. In particular, we show that the Balanced-Separator
integrality gap instances proposed by Devanur et al.\ can have their optimal
value certified by a degree-4 SOS proof. The key ingredient is an SOS proof of
the KKL Theorem. We also investigate the extent to which the Khot--Vishnoi
Max-Cut integrality gap instances can have their optimum value certified by an
SOS proof. We show they can be certified to within a factor .952 ()
using a constant-degree proof. These investigations also raise an interesting
mathematical question: is there a constant-degree SOS proof of the Central
Limit Theorem?Comment: 34 page
New Dependencies of Hierarchies in Polynomial Optimization
We compare four key hierarchies for solving Constrained Polynomial
Optimization Problems (CPOP): Sum of Squares (SOS), Sum of Diagonally Dominant
Polynomials (SDSOS), Sum of Nonnegative Circuits (SONC), and the Sherali Adams
(SA) hierarchies. We prove a collection of dependencies among these hierarchies
both for general CPOPs and for optimization problems on the Boolean hypercube.
Key results include for the general case that the SONC and SOS hierarchy are
polynomially incomparable, while SDSOS is contained in SONC. A direct
consequence is the non-existence of a Putinar-like Positivstellensatz for
SDSOS. On the Boolean hypercube, we show as a main result that Schm\"udgen-like
versions of the hierarchies SDSOS*, SONC*, and SA* are polynomially equivalent.
Moreover, we show that SA* is contained in any Schm\"udgen-like hierarchy that
provides a O(n) degree bound.Comment: 26 pages, 4 figure
On the sum-of-squares degree of symmetric quadratic functions
We study how well functions over the boolean hypercube of the form
can be approximated by sums of squares of low-degree
polynomials, obtaining good bounds for the case of approximation in
-norm as well as in -norm. We describe three
complexity-theoretic applications: (1) a proof that the recent breakthrough
lower bound of Lee, Raghavendra, and Steurer on the positive semidefinite
extension complexity of the correlation and TSP polytopes cannot be improved
further by showing better sum-of-squares degree lower bounds on
-approximation of ; (2) a proof that Grigoriev's lower bound on
the degree of Positivstellensatz refutations for the knapsack problem is
optimal, answering an open question from his work; (3) bounds on the query
complexity of quantum algorithms whose expected output approximates such
functions.Comment: 33 pages. Second version fixes some typos and adds reference
Sum-of-squares lower bounds for planted clique
Finding cliques in random graphs and the closely related "planted" clique
variant, where a clique of size k is planted in a random G(n, 1/2) graph, have
been the focus of substantial study in algorithm design. Despite much effort,
the best known polynomial-time algorithms only solve the problem for k ~
sqrt(n).
In this paper we study the complexity of the planted clique problem under
algorithms from the Sum-of-squares hierarchy. We prove the first average case
lower bound for this model: for almost all graphs in G(n,1/2), r rounds of the
SOS hierarchy cannot find a planted k-clique unless k > n^{1/2r} (up to
logarithmic factors). Thus, for any constant number of rounds planted cliques
of size n^{o(1)} cannot be found by this powerful class of algorithms. This is
shown via an integrability gap for the natural formulation of maximum clique
problem on random graphs for SOS and Lasserre hierarchies, which in turn follow
from degree lower bounds for the Positivestellensatz proof system.
We follow the usual recipe for such proofs. First, we introduce a natural
"dual certificate" (also known as a "vector-solution" or "pseudo-expectation")
for the given system of polynomial equations representing the problem for every
fixed input graph. Then we show that the matrix associated with this dual
certificate is PSD (positive semi-definite) with high probability over the
choice of the input graph.This requires the use of certain tools. One is the
theory of association schemes, and in particular the eigenspaces and
eigenvalues of the Johnson scheme. Another is a combinatorial method we develop
to compute (via traces) norm bounds for certain random matrices whose entries
are highly dependent; we hope this method will be useful elsewhere
Generating Non-Linear Interpolants by Semidefinite Programming
Interpolation-based techniques have been widely and successfully applied in
the verification of hardware and software, e.g., in bounded-model check- ing,
CEGAR, SMT, etc., whose hardest part is how to synthesize interpolants. Various
work for discovering interpolants for propositional logic, quantifier-free
fragments of first-order theories and their combinations have been proposed.
However, little work focuses on discovering polynomial interpolants in the
literature. In this paper, we provide an approach for constructing non-linear
interpolants based on semidefinite programming, and show how to apply such
results to the verification of programs by examples.Comment: 22 pages, 4 figure
Majority is Stablest : Discrete and SoS
The Majority is Stablest Theorem has numerous applications in hardness of
approximation and social choice theory. We give a new proof of the Majority is
Stablest Theorem by induction on the dimension of the discrete cube. Unlike the
previous proof, it uses neither the "invariance principle" nor Borell's result
in Gaussian space. The new proof is general enough to include all previous
variants of majority is stablest such as "it ain't over until it's over" and
"Majority is most predictable". Moreover, the new proof allows us to derive a
proof of Majority is Stablest in a constant level of the Sum of Squares
hierarchy.This implies in particular that Khot-Vishnoi instance of Max-Cut does
not provide a gap instance for the Lasserre hierarchy
- …