3 research outputs found
Block Stability for MAP Inference
To understand the empirical success of approximate MAP inference, recent work
(Lang et al., 2018) has shown that some popular approximation algorithms
perform very well when the input instance is stable. The simplest stability
condition assumes that the MAP solution does not change at all when some of the
pairwise potentials are (adversarially) perturbed. Unfortunately, this strong
condition does not seem to be satisfied in practice. In this paper, we
introduce a significantly more relaxed condition that only requires blocks
(portions) of an input instance to be stable. Under this block stability
condition, we prove that the pairwise LP relaxation is persistent on the stable
blocks. We complement our theoretical results with an empirical evaluation of
real-world MAP inference instances from computer vision. We design an algorithm
to find stable blocks, and find that these real instances have large stable
regions. Our work gives a theoretical explanation for the widespread empirical
phenomenon of persistency for this LP relaxation
Discrete graphical models -- an optimization perspective
This monograph is about discrete energy minimization for discrete graphical
models. It considers graphical models, or, more precisely, maximum a posteriori
inference for graphical models, purely as a combinatorial optimization problem.
Modeling, applications, probabilistic interpretations and many other aspects
are either ignored here or find their place in examples and remarks only. It
covers the integer linear programming formulation of the problem as well as its
linear programming, Lagrange and Lagrange decomposition-based relaxations. In
particular, it provides a detailed analysis of the polynomially solvable
acyclic and submodular problems, along with the corresponding exact
optimization methods. Major approximate methods, such as message passing and
graph cut techniques are also described and analyzed comprehensively. The
monograph can be useful for undergraduate and graduate students studying
optimization or graphical models, as well as for experts in optimization who
want to have a look into graphical models. To make the monograph suitable for
both categories of readers we explicitly separate the mathematical optimization
background chapters from those specific to graphical models.Comment: 270 page