625 research outputs found
Symmetric Submodular Function Minimization Under Hereditary Family Constraints
We present an efficient algorithm to find non-empty minimizers of a symmetric
submodular function over any family of sets closed under inclusion. This for
example includes families defined by a cardinality constraint, a knapsack
constraint, a matroid independence constraint, or any combination of such
constraints. Our algorithm make oracle calls to the submodular
function where is the cardinality of the ground set. In contrast, the
problem of minimizing a general submodular function under a cardinality
constraint is known to be inapproximable within (Svitkina
and Fleischer [2008]).
The algorithm is similar to an algorithm of Nagamochi and Ibaraki [1998] to
find all nontrivial inclusionwise minimal minimizers of a symmetric submodular
function over a set of cardinality using oracle calls. Their
procedure in turn is based on Queyranne's algorithm [1998] to minimize a
symmetric submodularComment: 13 pages, Submitted to SODA 201
Submodular Minimization Under Congruency Constraints
Submodular function minimization (SFM) is a fundamental and efficiently
solvable problem class in combinatorial optimization with a multitude of
applications in various fields. Surprisingly, there is only very little known
about constraint types under which SFM remains efficiently solvable. The
arguably most relevant non-trivial constraint class for which polynomial SFM
algorithms are known are parity constraints, i.e., optimizing only over sets of
odd (or even) cardinality. Parity constraints capture classical combinatorial
optimization problems like the odd-cut problem, and they are a key tool in a
recent technique to efficiently solve integer programs with a constraint matrix
whose subdeterminants are bounded by two in absolute value.
We show that efficient SFM is possible even for a significantly larger class
than parity constraints, by introducing a new approach that combines techniques
from Combinatorial Optimization, Combinatorics, and Number Theory. In
particular, we can show that efficient SFM is possible over all sets (of any
given lattice) of cardinality r mod m, as long as m is a constant prime power.
This covers generalizations of the odd-cut problem with open complexity status,
and with relevance in the context of integer programming with higher
subdeterminants. To obtain our results, we establish a connection between the
correctness of a natural algorithm, and the inexistence of set systems with
specific combinatorial properties. We introduce a general technique to disprove
the existence of such set systems, which allows for obtaining extensions of our
results beyond the above-mentioned setting. These extensions settle two open
questions raised by Geelen and Kapadia [Combinatorica, 2017] in the context of
computing the girth and cogirth of certain types of binary matroids
Algorithms for Approximate Minimization of the Difference Between Submodular Functions, with Applications
We extend the work of Narasimhan and Bilmes [30] for minimizing set functions
representable as a difference between submodular functions. Similar to [30],
our new algorithms are guaranteed to monotonically reduce the objective
function at every step. We empirically and theoretically show that the
per-iteration cost of our algorithms is much less than [30], and our algorithms
can be used to efficiently minimize a difference between submodular functions
under various combinatorial constraints, a problem not previously addressed. We
provide computational bounds and a hardness result on the mul- tiplicative
inapproximability of minimizing the difference between submodular functions. We
show, however, that it is possible to give worst-case additive bounds by
providing a polynomial time computable lower-bound on the minima. Finally we
show how a number of machine learning problems can be modeled as minimizing the
difference between submodular functions. We experimentally show the validity of
our algorithms by testing them on the problem of feature selection with
submodular cost features.Comment: 17 pages, 8 figures. A shorter version of this appeared in Proc.
Uncertainty in Artificial Intelligence (UAI), Catalina Islands, 201
Efficient Decomposed Learning for Structured Prediction
Structured prediction is the cornerstone of several machine learning
applications. Unfortunately, in structured prediction settings with expressive
inter-variable interactions, exact inference-based learning algorithms, e.g.
Structural SVM, are often intractable. We present a new way, Decomposed
Learning (DecL), which performs efficient learning by restricting the inference
step to a limited part of the structured spaces. We provide characterizations
based on the structure, target parameters, and gold labels, under which DecL is
equivalent to exact learning. We then show that in real world settings, where
our theoretical assumptions may not completely hold, DecL-based algorithms are
significantly more efficient and as accurate as exact learning.Comment: ICML201
- …