3,579 research outputs found
Tightness of the maximum likelihood semidefinite relaxation for angular synchronization
Maximum likelihood estimation problems are, in general, intractable
optimization problems. As a result, it is common to approximate the maximum
likelihood estimator (MLE) using convex relaxations. In some cases, the
relaxation is tight: it recovers the true MLE. Most tightness proofs only apply
to situations where the MLE exactly recovers a planted solution (known to the
analyst). It is then sufficient to establish that the optimality conditions
hold at the planted signal. In this paper, we study an estimation problem
(angular synchronization) for which the MLE is not a simple function of the
planted solution, yet for which the convex relaxation is tight. To establish
tightness in this context, the proof is less direct because the point at which
to verify optimality conditions is not known explicitly.
Angular synchronization consists in estimating a collection of phases,
given noisy measurements of the pairwise relative phases. The MLE for angular
synchronization is the solution of a (hard) non-bipartite Grothendieck problem
over the complex numbers. We consider a stochastic model for the data: a
planted signal (that is, a ground truth set of phases) is corrupted with
non-adversarial random noise. Even though the MLE does not coincide with the
planted signal, we show that the classical semidefinite relaxation for it is
tight, with high probability. This holds even for high levels of noise.Comment: 2 figure
Multireference Alignment using Semidefinite Programming
The multireference alignment problem consists of estimating a signal from
multiple noisy shifted observations. Inspired by existing Unique-Games
approximation algorithms, we provide a semidefinite program (SDP) based
relaxation which approximates the maximum likelihood estimator (MLE) for the
multireference alignment problem. Although we show that the MLE problem is
Unique-Games hard to approximate within any constant, we observe that our
poly-time approximation algorithm for the MLE appears to perform quite well in
typical instances, outperforming existing methods. In an attempt to explain
this behavior we provide stability guarantees for our SDP under a random noise
model on the observations. This case is more challenging to analyze than
traditional semi-random instances of Unique-Games: the noise model is on
vertices of a graph and translates into dependent noise on the edges.
Interestingly, we show that if certain positivity constraints in the SDP are
dropped, its solution becomes equivalent to performing phase correlation, a
popular method used for pairwise alignment in imaging applications. Finally, we
show how symmetry reduction techniques from matrix representation theory can
simplify the analysis and computation of the SDP, greatly decreasing its
computational cost
Scalable Semidefinite Relaxation for Maximum A Posterior Estimation
Maximum a posteriori (MAP) inference over discrete Markov random fields is a
fundamental task spanning a wide spectrum of real-world applications, which is
known to be NP-hard for general graphs. In this paper, we propose a novel
semidefinite relaxation formulation (referred to as SDR) to estimate the MAP
assignment. Algorithmically, we develop an accelerated variant of the
alternating direction method of multipliers (referred to as SDPAD-LR) that can
effectively exploit the special structure of the new relaxation. Encouragingly,
the proposed procedure allows solving SDR for large-scale problems, e.g.,
problems on a grid graph comprising hundreds of thousands of variables with
multiple states per node. Compared with prior SDP solvers, SDPAD-LR is capable
of attaining comparable accuracy while exhibiting remarkably improved
scalability, in contrast to the commonly held belief that semidefinite
relaxation can only been applied on small-scale MRF problems. We have evaluated
the performance of SDR on various benchmark datasets including OPENGM2 and PIC
in terms of both the quality of the solutions and computation time.
Experimental results demonstrate that for a broad class of problems, SDPAD-LR
outperforms state-of-the-art algorithms in producing better MAP assignment in
an efficient manner.Comment: accepted to International Conference on Machine Learning (ICML 2014
Theory and Applications of Robust Optimization
In this paper we survey the primary research, both theoretical and applied,
in the area of Robust Optimization (RO). Our focus is on the computational
attractiveness of RO approaches, as well as the modeling power and broad
applicability of the methodology. In addition to surveying prominent
theoretical results of RO, we also present some recent results linking RO to
adaptable models for multi-stage decision-making problems. Finally, we
highlight applications of RO across a wide spectrum of domains, including
finance, statistics, learning, and various areas of engineering.Comment: 50 page
- …