4,229 research outputs found
Some upper and lower bounds on PSD-rank
Positive semidefinite rank (PSD-rank) is a relatively new quantity with
applications to combinatorial optimization and communication complexity. We
first study several basic properties of PSD-rank, and then develop new
techniques for showing lower bounds on the PSD-rank. All of these bounds are
based on viewing a positive semidefinite factorization of a matrix as a
quantum communication protocol. These lower bounds depend on the entries of the
matrix and not only on its support (the zero/nonzero pattern), overcoming a
limitation of some previous techniques. We compare these new lower bounds with
known bounds, and give examples where the new ones are better. As an
application we determine the PSD-rank of (approximations of) some common
matrices.Comment: 21 page
Lower bounds on the size of semidefinite programming relaxations
We introduce a method for proving lower bounds on the efficacy of
semidefinite programming (SDP) relaxations for combinatorial problems. In
particular, we show that the cut, TSP, and stable set polytopes on -vertex
graphs are not the linear image of the feasible region of any SDP (i.e., any
spectrahedron) of dimension less than , for some constant .
This result yields the first super-polynomial lower bounds on the semidefinite
extension complexity of any explicit family of polytopes.
Our results follow from a general technique for proving lower bounds on the
positive semidefinite rank of a matrix. To this end, we establish a close
connection between arbitrary SDPs and those arising from the sum-of-squares SDP
hierarchy. For approximating maximum constraint satisfaction problems, we prove
that SDPs of polynomial-size are equivalent in power to those arising from
degree- sum-of-squares relaxations. This result implies, for instance,
that no family of polynomial-size SDP relaxations can achieve better than a
7/8-approximation for MAX-3-SAT
Simultaneously Structured Models with Application to Sparse and Low-rank Matrices
The topic of recovery of a structured model given a small number of linear
observations has been well-studied in recent years. Examples include recovering
sparse or group-sparse vectors, low-rank matrices, and the sum of sparse and
low-rank matrices, among others. In various applications in signal processing
and machine learning, the model of interest is known to be structured in
several ways at the same time, for example, a matrix that is simultaneously
sparse and low-rank.
Often norms that promote each individual structure are known, and allow for
recovery using an order-wise optimal number of measurements (e.g.,
norm for sparsity, nuclear norm for matrix rank). Hence, it is reasonable to
minimize a combination of such norms. We show that, surprisingly, if we use
multi-objective optimization with these norms, then we can do no better,
order-wise, than an algorithm that exploits only one of the present structures.
This result suggests that to fully exploit the multiple structures, we need an
entirely new convex relaxation, i.e. not one that is a function of the convex
relaxations used for each structure. We then specialize our results to the case
of sparse and low-rank matrices. We show that a nonconvex formulation of the
problem can recover the model from very few measurements, which is on the order
of the degrees of freedom of the matrix, whereas the convex problem obtained
from a combination of the and nuclear norms requires many more
measurements. This proves an order-wise gap between the performance of the
convex and nonconvex recovery problems in this case. Our framework applies to
arbitrary structure-inducing norms as well as to a wide range of measurement
ensembles. This allows us to give performance bounds for problems such as
sparse phase retrieval and low-rank tensor completion.Comment: 38 pages, 9 figure
Lifts of convex sets and cone factorizations
In this paper we address the basic geometric question of when a given convex
set is the image under a linear map of an affine slice of a given closed convex
cone. Such a representation or 'lift' of the convex set is especially useful if
the cone admits an efficient algorithm for linear optimization over its affine
slices. We show that the existence of a lift of a convex set to a cone is
equivalent to the existence of a factorization of an operator associated to the
set and its polar via elements in the cone and its dual. This generalizes a
theorem of Yannakakis that established a connection between polyhedral lifts of
a polytope and nonnegative factorizations of its slack matrix. Symmetric lifts
of convex sets can also be characterized similarly. When the cones live in a
family, our results lead to the definition of the rank of a convex set with
respect to this family. We present results about this rank in the context of
cones of positive semidefinite matrices. Our methods provide new tools for
understanding cone lifts of convex sets.Comment: 20 pages, 2 figure
Exponential Lower Bounds for Polytopes in Combinatorial Optimization
We solve a 20-year old problem posed by Yannakakis and prove that there
exists no polynomial-size linear program (LP) whose associated polytope
projects to the traveling salesman polytope, even if the LP is not required to
be symmetric. Moreover, we prove that this holds also for the cut polytope and
the stable set polytope. These results were discovered through a new connection
that we make between one-way quantum communication protocols and semidefinite
programming reformulations of LPs.Comment: 19 pages, 4 figures. This version of the paper will appear in the
Journal of the ACM. The earlier conference version in STOC'12 had the title
"Linear vs. Semidefinite Extended Formulations: Exponential Separation and
Strong Lower Bounds
Tight Sum-of-Squares lower bounds for binary polynomial optimization problems
We give two results concerning the power of the Sum-of-Squares(SoS)/Lasserre
hierarchy. For binary polynomial optimization problems of degree and an
odd number of variables , we prove that levels of the
SoS/Lasserre hierarchy are necessary to provide the exact optimal value. This
matches the recent upper bound result by Sakaue, Takeda, Kim and Ito.
Additionally, we study a conjecture by Laurent, who considered the linear
representation of a set with no integral points. She showed that the
Sherali-Adams hierarchy requires levels to detect the empty integer hull,
and conjectured that the SoS/Lasserre rank for the same problem is . We
disprove this conjecture and derive lower and upper bounds for the rank
- …