1,159 research outputs found
On the local stability of semidefinite relaxations
We consider a parametric family of quadratically constrained quadratic
programs (QCQP) and their associated semidefinite programming (SDP)
relaxations. Given a nominal value of the parameter at which the SDP relaxation
is exact, we study conditions (and quantitative bounds) under which the
relaxation will continue to be exact as the parameter moves in a neighborhood
around the nominal value. Our framework captures a wide array of statistical
estimation problems including tensor principal component analysis, rotation
synchronization, orthogonal Procrustes, camera triangulation and resectioning,
essential matrix estimation, system identification, and approximate GCD. Our
results can also be used to analyze the stability of SOS relaxations of general
polynomial optimization problems.Comment: 23 pages, 3 figure
Tightness of the maximum likelihood semidefinite relaxation for angular synchronization
Maximum likelihood estimation problems are, in general, intractable
optimization problems. As a result, it is common to approximate the maximum
likelihood estimator (MLE) using convex relaxations. In some cases, the
relaxation is tight: it recovers the true MLE. Most tightness proofs only apply
to situations where the MLE exactly recovers a planted solution (known to the
analyst). It is then sufficient to establish that the optimality conditions
hold at the planted signal. In this paper, we study an estimation problem
(angular synchronization) for which the MLE is not a simple function of the
planted solution, yet for which the convex relaxation is tight. To establish
tightness in this context, the proof is less direct because the point at which
to verify optimality conditions is not known explicitly.
Angular synchronization consists in estimating a collection of phases,
given noisy measurements of the pairwise relative phases. The MLE for angular
synchronization is the solution of a (hard) non-bipartite Grothendieck problem
over the complex numbers. We consider a stochastic model for the data: a
planted signal (that is, a ground truth set of phases) is corrupted with
non-adversarial random noise. Even though the MLE does not coincide with the
planted signal, we show that the classical semidefinite relaxation for it is
tight, with high probability. This holds even for high levels of noise.Comment: 2 figure
A Riemannian low-rank method for optimization over semidefinite matrices with block-diagonal constraints
We propose a new algorithm to solve optimization problems of the form for a smooth function under the constraints that is positive
semidefinite and the diagonal blocks of are small identity matrices. Such
problems often arise as the result of relaxing a rank constraint (lifting). In
particular, many estimation tasks involving phases, rotations, orthonormal
bases or permutations fit in this framework, and so do certain relaxations of
combinatorial problems such as Max-Cut. The proposed algorithm exploits the
facts that (1) such formulations admit low-rank solutions, and (2) their
rank-restricted versions are smooth optimization problems on a Riemannian
manifold. Combining insights from both the Riemannian and the convex geometries
of the problem, we characterize when second-order critical points of the smooth
problem reveal KKT points of the semidefinite problem. We compare against state
of the art, mature software and find that, on certain interesting problem
instances, what we call the staircase method is orders of magnitude faster, is
more accurate and scales better. Code is available.Comment: 37 pages, 3 figure
Conic Optimization Theory: Convexification Techniques and Numerical Algorithms
Optimization is at the core of control theory and appears in several areas of
this field, such as optimal control, distributed control, system
identification, robust control, state estimation, model predictive control and
dynamic programming. The recent advances in various topics of modern
optimization have also been revamping the area of machine learning. Motivated
by the crucial role of optimization theory in the design, analysis, control and
operation of real-world systems, this tutorial paper offers a detailed overview
of some major advances in this area, namely conic optimization and its emerging
applications. First, we discuss the importance of conic optimization in
different areas. Then, we explain seminal results on the design of hierarchies
of convex relaxations for a wide range of nonconvex problems. Finally, we study
different numerical algorithms for large-scale conic optimization problems.Comment: 18 page
Certification of Bounds of Non-linear Functions: the Templates Method
The aim of this work is to certify lower bounds for real-valued multivariate
functions, defined by semialgebraic or transcendental expressions. The
certificate must be, eventually, formally provable in a proof system such as
Coq. The application range for such a tool is widespread; for instance Hales'
proof of Kepler's conjecture yields thousands of inequalities. We introduce an
approximation algorithm, which combines ideas of the max-plus basis method (in
optimal control) and of the linear templates method developed by Manna et al.
(in static analysis). This algorithm consists in bounding some of the
constituents of the function by suprema of quadratic forms with a well chosen
curvature. This leads to semialgebraic optimization problems, solved by
sum-of-squares relaxations. Templates limit the blow up of these relaxations at
the price of coarsening the approximation. We illustrate the efficiency of our
framework with various examples from the literature and discuss the interfacing
with Coq.Comment: 16 pages, 3 figures, 2 table
- …