The power of linear programming for general-valued CSPs

Let $D$, called the domain, be a fixed finite set and let $\Gamma$, called the valued constraint language, be a fixed set of functions of the form $f:D^m\to\mathbb{Q}\cup\{\infty\}$, where different functions might have different arity $m$. We study the valued constraint satisfaction problem parametrised by $\Gamma$, denoted by VCSP$(\Gamma)$. These are minimisation problems given by $n$ variables and the objective function given by a sum of functions from $\Gamma$, each depending on a subset of the $n$ variables. Finite-valued constraint languages contain functions that take on only rational values and not infinite values. Our main result is a precise algebraic characterisation of valued constraint languages whose instances can be solved exactly by the basic linear programming relaxation (BLP). For a valued constraint language $\Gamma$, BLP is a decision procedure for $\Gamma$ if and only if $\Gamma$ admits a symmetric fractional polymorphism of every arity. For a finite-valued constraint language $\Gamma$, BLP is a decision procedure if and only if $\Gamma$ admits a symmetric fractional polymorphism of some arity, or equivalently, if $\Gamma$ admits a symmetric fractional polymorphism of arity 2. Using these results, we obtain tractability of several novel classes of problems, including problems over valued constraint languages that are: (1) submodular on arbitrary lattices; (2) $k$-submodular on arbitrary finite domains; (3) weakly (and hence strongly) tree-submodular on arbitrary trees.Comment: A full version of a FOCS'12 paper by the last two authors (arXiv:1204.1079) and an ICALP'13 paper by the first author (arXiv:1207.7213) to appear in SIAM Journal on Computing (SICOMP

A maximal tractable class of soft constraints

Many researchers in artificial intelligence are beginning to explore the use of soft constraints to express a set of (possibly conflicting) problem requirements. A soft constraint is a function defined on a collection of variables which associates some measure of desirability with each possible combination of values for those variables. However, the crucial question of the computational complexity of finding the optimal solution to a collection of soft constraints has so far received very little attention. In this paper we identify a class of soft binary constraints for which the problem of finding the optimal solution is tractable. In other words, we show that for any given set of such constraints, there exists a polynomial time algorithm to determine the assignment having the best overall combined measure of desirability. This tractable class includes many commonly-occurring soft constraints, such as 'as near as possible' or 'as soon as possible after', as well as crisp constraints such as 'greater than'. Finally, we show that this tractable class is maximal, in the sense that adding any other form of soft binary constraint which is not in the class gives rise to a class of problems which is NP-hard

Hybrid VCSPs with crisp and conservative valued templates

A constraint satisfaction problem (CSP) is a problem of computing a homomorphism ${\bf R} \rightarrow {\bf \Gamma}$ between two relational structures. Analyzing its complexity has been a very fruitful research direction, especially for fixed template CSPs, denoted $CSP({\bf \Gamma})$, in which the right side structure ${\bf \Gamma}$ is fixed and the left side structure ${\bf R}$ is unconstrained. Recently, the hybrid setting, written $CSP_{\mathcal{H}}({\bf \Gamma})$, where both sides are restricted simultaneously, attracted some attention. It assumes that ${\bf R}$ is taken from a class of relational structures $\mathcal{H}$ that additionally is closed under inverse homomorphisms. The last property allows to exploit algebraic tools that have been developed for fixed template CSPs. The key concept that connects hybrid CSPs with fixed-template CSPs is the so called "lifted language". Namely, this is a constraint language ${\bf \Gamma}_{{\bf R}}$ that can be constructed from an input ${\bf R}$. The tractability of that language for any input ${\bf R}\in\mathcal{H}$ is a necessary condition for the tractability of the hybrid problem. In the first part we investigate templates ${\bf \Gamma}$ for which the latter condition is not only necessary, but also is sufficient. We call such templates ${\bf \Gamma}$ widely tractable. For this purpose, we construct from ${\bf \Gamma}$ a new finite relational structure ${\bf \Gamma}'$ and define $\mathcal{H}_0$ as a class of structures homomorphic to ${\bf \Gamma}'$. We prove that wide tractability is equivalent to the tractability of $CSP_{\mathcal{H}_0}({\bf \Gamma})$. Our proof is based on the key observation that ${\bf R}$ is homomorphic to ${\bf \Gamma}'$ if and only if the core of ${\bf \Gamma}_{{\bf R}}$ is preserved by a Siggers polymorphism. Analogous result is shown for valued conservative CSPs.Comment: 21 pages. arXiv admin note: text overlap with arXiv:1504.0706

IST Austria Thesis

An instance of the Constraint Satisfaction Problem (CSP) is given by a finite set of variables, a finite domain of labels, and a set of constraints, each constraint acting on a subset of the variables. The goal is to find an assignment of labels to its variables that satisfies all constraints (or decide whether one exists). If we allow more general “soft” constraints, which come with (possibly infinite) costs of particular assignments, we obtain instances from a richer class called Valued Constraint Satisfaction Problem (VCSP). There the goal is to find an assignment with minimum total cost. In this thesis, we focus (assuming that P 6 = NP) on classifying computational com- plexity of CSPs and VCSPs under certain restricting conditions. Two results are the core content of the work. In one of them, we consider VCSPs parametrized by a constraint language, that is the set of “soft” constraints allowed to form the instances, and finish the complexity classification modulo (missing pieces of) complexity classification for analogously parametrized CSP. The other result is a generalization of Edmonds’ perfect matching algorithm. This generalization contributes to complexity classfications in two ways. First, it gives a new (largest known) polynomial-time solvable class of Boolean CSPs in which every variable may appear in at most two constraints and second, it settles full classification of Boolean CSPs with planar drawing (again parametrized by a constraint language)

Minimizing Submodular Functions on Diamonds via Generalized Fractional Matroid Matchings

In this paper we show the first polynomial-time algorithm for the problem of minimizing submodular functions on the product of diamonds. This submodular function minimization problem is reduced to the membership problem for an associated polyhedron, which is equivalent to the optimization problem over the polyhedron, based on the ellipsoid method. The latter optimization problem is solved by polynomial number of solutions of subproblems, each being a generalization of the weighted fractional matroid matching problem. We give a combinatorial polynomial-time algorithm for this optimization problem by extending the result by Gijswijt and Pap [D.~Gijswijt and G.~Pap, An algorithm for weighted fractional matroid matching, J.\ Combin.\ Theory, Ser.~B 103 (2013), 509--520]

MAP inference via Block-Coordinate Frank-Wolfe Algorithm

We present a new proximal bundle method for Maximum-A-Posteriori (MAP) inference in structured energy minimization problems. The method optimizes a Lagrangean relaxation of the original energy minimization problem using a multi plane block-coordinate Frank-Wolfe method that takes advantage of the specific structure of the Lagrangean decomposition. We show empirically that our method outperforms state-of-the-art Lagrangean decomposition based algorithms on some challenging Markov Random Field, multi-label discrete tomography and graph matching problems