79 research outputs found
Generalized roof duality and bisubmodular functions
Consider a convex relaxation of a pseudo-boolean function . We
say that the relaxation is {\em totally half-integral} if is a
polyhedral function with half-integral extreme points , and this property is
preserved after adding an arbitrary combination of constraints of the form
, , and where \gamma\in\{0, 1, 1/2} is a
constant. A well-known example is the {\em roof duality} relaxation for
quadratic pseudo-boolean functions . We argue that total half-integrality is
a natural requirement for generalizations of roof duality to arbitrary
pseudo-boolean functions. Our contributions are as follows. First, we provide a
complete characterization of totally half-integral relaxations by
establishing a one-to-one correspondence with {\em bisubmodular functions}.
Second, we give a new characterization of bisubmodular functions. Finally, we
show some relationships between general totally half-integral relaxations and
relaxations based on the roof duality.Comment: 14 pages. Shorter version to appear in NIPS 201
Playing with Duality: An Overview of Recent Primal-Dual Approaches for Solving Large-Scale Optimization Problems
Optimization methods are at the core of many problems in signal/image
processing, computer vision, and machine learning. For a long time, it has been
recognized that looking at the dual of an optimization problem may drastically
simplify its solution. Deriving efficient strategies which jointly brings into
play the primal and the dual problems is however a more recent idea which has
generated many important new contributions in the last years. These novel
developments are grounded on recent advances in convex analysis, discrete
optimization, parallel processing, and non-smooth optimization with emphasis on
sparsity issues. In this paper, we aim at presenting the principles of
primal-dual approaches, while giving an overview of numerical methods which
have been proposed in different contexts. We show the benefits which can be
drawn from primal-dual algorithms both for solving large-scale convex
optimization problems and discrete ones, and we provide various application
examples to illustrate their usefulness
Maximum Persistency in Energy Minimization
We consider discrete pairwise energy minimization problem (weighted
constraint satisfaction, max-sum labeling) and methods that identify a globally
optimal partial assignment of variables. When finding a complete optimal
assignment is intractable, determining optimal values for a part of variables
is an interesting possibility. Existing methods are based on different
sufficient conditions. We propose a new sufficient condition for partial
optimality which is: (1) verifiable in polynomial time (2) invariant to
reparametrization of the problem and permutation of labels and (3) includes
many existing sufficient conditions as special cases. We pose the problem of
finding the maximum optimal partial assignment identifiable by the new
sufficient condition. A polynomial method is proposed which is guaranteed to
assign same or larger part of variables than several existing approaches. The
core of the method is a specially constructed linear program that identifies
persistent assignments in an arbitrary multi-label setting.Comment: Extended technical report for the CVPR 2014 paper. Update: correction
to the proof of characterization theore
Efficient Semidefinite Branch-and-Cut for MAP-MRF Inference
We propose a Branch-and-Cut (B&C) method for solving general MAP-MRF
inference problems. The core of our method is a very efficient bounding
procedure, which combines scalable semidefinite programming (SDP) and a
cutting-plane method for seeking violated constraints. In order to further
speed up the computation, several strategies have been exploited, including
model reduction, warm start and removal of inactive constraints.
We analyze the performance of the proposed method under different settings,
and demonstrate that our method either outperforms or performs on par with
state-of-the-art approaches. Especially when the connectivities are dense or
when the relative magnitudes of the unary costs are low, we achieve the best
reported results. Experiments show that the proposed algorithm achieves better
approximation than the state-of-the-art methods within a variety of time
budgets on challenging non-submodular MAP-MRF inference problems.Comment: 21 page
Combinatorial persistency criteria for multicut and max-cut
In combinatorial optimization, partial variable assignments are called
persistent if they agree with some optimal solution. We propose persistency
criteria for the multicut and max-cut problem as well as fast combinatorial
routines to verify them. The criteria that we derive are based on mappings that
improve feasible multicuts, respectively cuts. Our elementary criteria can be
checked enumeratively. The more advanced ones rely on fast algorithms for upper
and lower bounds for the respective cut problems and max-flow techniques for
auxiliary min-cut problems. Our methods can be used as a preprocessing
technique for reducing problem sizes or for computing partial optimality
guarantees for solutions output by heuristic solvers. We show the efficacy of
our methods on instances of both problems from computer vision, biomedical
image analysis and statistical physics
Discrete Optimization in Early Vision - Model Tractability Versus Fidelity
Early vision is the process occurring before any semantic interpretation of an image takes place. Motion estimation, object segmentation and detection are all parts of early vision, but recognition is not. Some models in early vision are easy to perform inference with---they are tractable. Others describe the reality well---they have high fidelity. This thesis improves the tractability-fidelity trade-off of the current state of the art by introducing new discrete methods for image segmentation and other problems of early vision. The first part studies pseudo-boolean optimization, both from a theoretical perspective as well as a practical one by introducing new algorithms. The main result is the generalization of the roof duality concept to polynomials of higher degree than two. Another focus is parallelization; discrete optimization methods for multi-core processors, computer clusters, and graphical processing units are presented. Remaining in an image segmentation context, the second part studies parametric problems where a set of model parameters and a segmentation are estimated simultaneously. For a small number of parameters these problems can still be optimally solved. One application is an optimal method for solving the two-phase Mumford-Shah functional. The third part shifts the focus to curvature regularization---where the commonly used length and area penalization is replaced by curvature in two and three dimensions. These problems can be discretized over a mesh and special attention is given to the mesh geometry. Specifically, hexagonal meshes in the plane are compared to square ones and a method for generating adaptive meshes is introduced and evaluated. The framework is then extended to curvature regularization of surfaces. Finally, the thesis is concluded by three applications to early vision problems: cardiac MRI segmentation, image registration, and cell classification
- …