Fast counting with tensor networks

We introduce tensor network contraction algorithms for counting satisfying assignments of constraint satisfaction problems (#CSPs). We represent each arbitrary #CSP formula as a tensor network, whose full contraction yields the number of satisfying assignments of that formula, and use graph theoretical methods to determine favorable orders of contraction. We employ our heuristics for the solution of #P-hard counting boolean satisfiability (#SAT) problems, namely monotone #1-in-3SAT and #Cubic-Vertex-Cover, and find that they outperform state-of-the-art solvers by a significant margin.Comment: v2: added results for monotone #1-in-3SAT; published versio

Minimal Forward Checking--a Lazy Constraint Satisfaction Search Algorithm: Experimental And Theoretical Results

Many problems that occur in Artificial Intelligence and Operations Research can be naturally represented as Constraint Satisfaction Problems (CSPs). One of the most popular backtracking search algorithms used to solve CSPs is called Forward Checking (FC). FC performs a limited amount of lookahead during its search attempting to detect future inconsistencies thereby avoiding inconsistent parts of the search tree. In this thesis we describe a new backtracking search algorithm called Minimal Forward Checking (MFC) which maintains FC\u27s ability to detect inconsistencies but which is lazy in is method of doing so. We prove that MFC is sound and complete. We also prove the MFC and FC visit the same nodes in the search tree. Most significantly, we prove that MFC\u27s worst case performance in terms of number of constraint checks performed (the common measure of performance of these algorithms) is the number of constraint checks performed by FC. We then describe how the MFC algorithm can be seen as one algorithm in a family of lazy CSP search algorithms.;As theoretical results on the average case complexity for CSP search algorithms are extremely difficult to derive, empirical comparisons need to be performed. A commonly used testbed is randomly generated problems drawn from a standard model of binary CSPs at a specific location known to contain problems that are relatively hard to solve. We generalize the standard model of binary CSPs and show how to find problems in this model that are relatively hard to solve. We also show that these hard problems are of similar hardness or harder than hard problems drawn from the standard model especially as the problem size grows and the problem has a relatively sparse structure. We perform large empirical studies of many CSP search algorithms including variants of MFC and FC with non-chronological backtracking and variants of the Fail First heuristic on two testbeds of hard random problems, each drawn from one of the two models. Our empirical comparisons on both testbeds indicate that the average case performance of algorithms based on MFC are better than all the other algorithms in the comparison in terms of the number of constraint checks performed

Quantitative Analysis and Performance Study of Ant Colony Optimization Models Applied to Multi-Mode Resource Constraint Project Scheduling Problem

Constraint Satisfaction Problems (CSP) belongs to this kind of traditional NP-hard problems with a high impact in both, research and industrial domains. However, due to the complexity that CSP problems exhibit, researchers are forced to use heuristic algorithms for solving the problems in a reasonable time. One of the most famous heuristic al- gorithms is Ant Colony Optimization (ACO) algorithm. The possible utilization of ACO algorithms to solve CSP problems requires the de- sign of a decision graph where the ACO is executed. Nevertheless, the classical approaches build a graph where the nodes represent the vari- able/value pairs and the edges connect those nodes whose variables are different. In order to solve this problem, a novel ACO model have been recently designed. The goal of this paper is to analyze the performance of this novelty algorithm when solving Multi-Mode Resource-Constraint Satisfaction Problems. Experimental results reveals that the new ACO model provides competitive results whereas the number of pheromones created in the system is drastically reduced

Tree Projections and Constraint Optimization Problems: Fixed-Parameter Tractability and Parallel Algorithms

Tree projections provide a unifying framework to deal with most structural decomposition methods of constraint satisfaction problems (CSPs). Within this framework, a CSP instance is decomposed into a number of sub-problems, called views, whose solutions are either already available or can be computed efficiently. The goal is to arrange portions of these views in a tree-like structure, called tree projection, which determines an efficiently solvable CSP instance equivalent to the original one. Deciding whether a tree projection exists is NP-hard. Solution methods have therefore been proposed in the literature that do not require a tree projection to be given, and that either correctly decide whether the given CSP instance is satisfiable, or return that a tree projection actually does not exist. These approaches had not been generalized so far on CSP extensions for optimization problems, where the goal is to compute a solution of maximum value/minimum cost. The paper fills the gap, by exhibiting a fixed-parameter polynomial-time algorithm that either disproves the existence of tree projections or computes an optimal solution, with the parameter being the size of the expression of the objective function to be optimized over all possible solutions (and not the size of the whole constraint formula, used in related works). Tractability results are also established for the problem of returning the best K solutions. Finally, parallel algorithms for such optimization problems are proposed and analyzed. Given that the classes of acyclic hypergraphs, hypergraphs of bounded treewidth, and hypergraphs of bounded generalized hypertree width are all covered as special cases of the tree projection framework, the results in this paper directly apply to these classes. These classes are extensively considered in the CSP setting, as well as in conjunctive database query evaluation and optimization

Statistical modelling of CSP solving algorithms performance

The goal of this work is to try to create a statistical model, based only on easily computable parameters from the CSP problem to predict runtime behaviour of the solving algorithms, and let us choose the best algorithm to solve the problem. Although it seems that the obvious choice should be MAC, experimental results obtained so far show, that with big numbers of variables, other algorithms perfom much better, specially for hard problems in the transition phase

FPTAS for Weighted Fibonacci Gates and Its Applications

Fibonacci gate problems have severed as computation primitives to solve other problems by holographic algorithm and play an important role in the dichotomy of exact counting for Holant and CSP frameworks. We generalize them to weighted cases and allow each vertex function to have different parameters, which is a much boarder family and #P-hard for exactly counting. We design a fully polynomial-time approximation scheme (FPTAS) for this generalization by correlation decay technique. This is the first deterministic FPTAS for approximate counting in the general Holant framework without a degree bound. We also formally introduce holographic reduction in the study of approximate counting and these weighted Fibonacci gate problems serve as computation primitives for approximate counting. Under holographic reduction, we obtain FPTAS for other Holant problems and spin problems. One important application is developing an FPTAS for a large range of ferromagnetic two-state spin systems. This is the first deterministic FPTAS in the ferromagnetic range for two-state spin systems without a degree bound. Besides these algorithms, we also develop several new tools and techniques to establish the correlation decay property, which are applicable in other problems