2,034 research outputs found
SDPNAL+: A Matlab software for semidefinite programming with bound constraints (version 1.0)
SDPNAL+ is a {\sc Matlab} software package that implements an augmented
Lagrangian based method to solve large scale semidefinite programming problems
with bound constraints. The implementation was initially based on a majorized
semismooth Newton-CG augmented Lagrangian method, here we designed it within an
inexact symmetric Gauss-Seidel based semi-proximal ADMM/ALM (alternating
direction method of multipliers/augmented Lagrangian method) framework for the
purpose of deriving simpler stopping conditions and closing the gap between the
practical implementation of the algorithm and the theoretical algorithm. The
basic code is written in {\sc Matlab}, but some subroutines in C language are
incorporated via Mex files. We also design a convenient interface for users to
input their SDP models into the solver. Numerous problems arising from
combinatorial optimization and binary integer quadratic programming problems
have been tested to evaluate the performance of the solver. Extensive numerical
experiments conducted in [Yang, Sun, and Toh, Mathematical Programming
Computation, 7 (2015), pp. 331--366] show that the proposed method is quite
efficient and robust, in that it is able to solve 98.9\% of the 745 test
instances of SDP problems arising from various applications to the accuracy of
in the relative KKT residual
An Efficient Implementation of the Robust Tabu Search Heuristic for Sparse Quadratic Assignment Problems
We propose and develop an efficient implementation of the robust tabu search
heuristic for sparse quadratic assignment problems. The traditional
implementation of the heuristic applicable to all quadratic assignment problems
is of O(N^2) complexity per iteration for problems of size N. Using multiple
priority queues to determine the next best move instead of scanning all
possible moves, and using adjacency lists to minimize the operations needed to
determine the cost of moves, we reduce the asymptotic complexity per iteration
to O(N log N ). For practical sized problems, the complexity is O(N)
Scalable Semidefinite Relaxation for Maximum A Posterior Estimation
Maximum a posteriori (MAP) inference over discrete Markov random fields is a
fundamental task spanning a wide spectrum of real-world applications, which is
known to be NP-hard for general graphs. In this paper, we propose a novel
semidefinite relaxation formulation (referred to as SDR) to estimate the MAP
assignment. Algorithmically, we develop an accelerated variant of the
alternating direction method of multipliers (referred to as SDPAD-LR) that can
effectively exploit the special structure of the new relaxation. Encouragingly,
the proposed procedure allows solving SDR for large-scale problems, e.g.,
problems on a grid graph comprising hundreds of thousands of variables with
multiple states per node. Compared with prior SDP solvers, SDPAD-LR is capable
of attaining comparable accuracy while exhibiting remarkably improved
scalability, in contrast to the commonly held belief that semidefinite
relaxation can only been applied on small-scale MRF problems. We have evaluated
the performance of SDR on various benchmark datasets including OPENGM2 and PIC
in terms of both the quality of the solutions and computation time.
Experimental results demonstrate that for a broad class of problems, SDPAD-LR
outperforms state-of-the-art algorithms in producing better MAP assignment in
an efficient manner.Comment: accepted to International Conference on Machine Learning (ICML 2014
Efficient Relaxations for Dense CRFs with Sparse Higher Order Potentials
Dense conditional random fields (CRFs) have become a popular framework for
modelling several problems in computer vision such as stereo correspondence and
multi-class semantic segmentation. By modelling long-range interactions, dense
CRFs provide a labelling that captures finer detail than their sparse
counterparts. Currently, the state-of-the-art algorithm performs mean-field
inference using a filter-based method but fails to provide a strong theoretical
guarantee on the quality of the solution. A question naturally arises as to
whether it is possible to obtain a maximum a posteriori (MAP) estimate of a
dense CRF using a principled method. Within this paper, we show that this is
indeed possible. We will show that, by using a filter-based method, continuous
relaxations of the MAP problem can be optimised efficiently using
state-of-the-art algorithms. Specifically, we will solve a quadratic
programming (QP) relaxation using the Frank-Wolfe algorithm and a linear
programming (LP) relaxation by developing a proximal minimisation framework. By
exploiting labelling consistency in the higher-order potentials and utilising
the filter-based method, we are able to formulate the above algorithms such
that each iteration has a complexity linear in the number of classes and random
variables. The presented algorithms can be applied to any labelling problem
using a dense CRF with sparse higher-order potentials. In this paper, we use
semantic segmentation as an example application as it demonstrates the ability
of the algorithm to scale to dense CRFs with large dimensions. We perform
experiments on the Pascal dataset to indicate that the presented algorithms are
able to attain lower energies than the mean-field inference method
A Newton-bracketing method for a simple conic optimization problem
For the Lagrangian-DNN relaxation of quadratic optimization problems (QOPs),
we propose a Newton-bracketing method to improve the performance of the
bisection-projection method implemented in BBCPOP [to appear in ACM Tran.
Softw., 2019]. The relaxation problem is converted into the problem of finding
the largest zero of a continuously differentiable (except at )
convex function such that if
and otherwise. In theory, the method generates lower
and upper bounds of both converging to . Their convergence is
quadratic if the right derivative of at is positive. Accurate
computation of is necessary for the robustness of the method, but it is
difficult to achieve in practice. As an alternative, we present a
secant-bracketing method. We demonstrate that the method improves the quality
of the lower bounds obtained by BBCPOP and SDPNAL+ for binary QOP instances
from BIQMAC. Moreover, new lower bounds for the unknown optimal values of large
scale QAP instances from QAPLIB are reported.Comment: 19 pages, 2 figure
- …