4,956 research outputs found
Reweighted belief propagation and quiet planting for random K-SAT
We study the random K-satisfiability problem using a partition function where
each solution is reweighted according to the number of variables that satisfy
every clause. We apply belief propagation and the related cavity method to the
reweighted partition function. This allows us to obtain several new results on
the properties of random K-satisfiability problem. In particular the
reweighting allows to introduce a planted ensemble that generates instances
that are, in some region of parameters, equivalent to random instances. We are
hence able to generate at the same time a typical random SAT instance and one
of its solutions. We study the relation between clustering and belief
propagation fixed points and we give a direct evidence for the existence of
purely entropic (rather than energetic) barriers between clusters in some
region of parameters in the random K-satisfiability problem. We exhibit, in
some large planted instances, solutions with a non-trivial whitening core; such
solutions were known to exist but were so far never found on very large
instances. Finally, we discuss algorithmic hardness of such planted instances
and we determine a region of parameters in which planting leads to satisfiable
benchmarks that, up to our knowledge, are the hardest known.Comment: 23 pages, 4 figures, revised for readability, stability expression
correcte
Monte Carlo algorithms are very effective in finding the largest independent set in sparse random graphs
The effectiveness of stochastic algorithms based on Monte Carlo dynamics in
solving hard optimization problems is mostly unknown. Beyond the basic
statement that at a dynamical phase transition the ergodicity breaks and a
Monte Carlo dynamics cannot sample correctly the probability distribution in
times linear in the system size, there are almost no predictions nor intuitions
on the behavior of this class of stochastic dynamics. The situation is
particularly intricate because, when using a Monte Carlo based algorithm as an
optimization algorithm, one is usually interested in the out of equilibrium
behavior which is very hard to analyse. Here we focus on the use of Parallel
Tempering in the search for the largest independent set in a sparse random
graph, showing that it can find solutions well beyond the dynamical threshold.
Comparison with state-of-the-art message passing algorithms reveals that
parallel tempering is definitely the algorithm performing best, although a
theory explaining its behavior is still lacking.Comment: 14 pages, 12 figure
The backtracking survey propagation algorithm for solving random K-SAT problems
Discrete combinatorial optimization has a central role in many scientific
disciplines, however, for hard problems we lack linear time algorithms that
would allow us to solve very large instances. Moreover, it is still unclear
what are the key features that make a discrete combinatorial optimization
problem hard to solve. Here we study random K-satisfiability problems with
, which are known to be very hard close to the SAT-UNSAT threshold,
where problems stop having solutions. We show that the backtracking survey
propagation algorithm, in a time practically linear in the problem size, is
able to find solutions very close to the threshold, in a region unreachable by
any other algorithm. All solutions found have no frozen variables, thus
supporting the conjecture that only unfrozen solutions can be found in linear
time, and that a problem becomes impossible to solve in linear time when all
solutions contain frozen variables.Comment: 11 pages, 10 figures. v2: data largely improved and manuscript
rewritte
Biased landscapes for random Constraint Satisfaction Problems
The typical complexity of Constraint Satisfaction Problems (CSPs) can be
investigated by means of random ensembles of instances. The latter exhibit many
threshold phenomena besides their satisfiability phase transition, in
particular a clustering or dynamic phase transition (related to the tree
reconstruction problem) at which their typical solutions shatter into
disconnected components. In this paper we study the evolution of this
phenomenon under a bias that breaks the uniformity among solutions of one CSP
instance, concentrating on the bicoloring of k-uniform random hypergraphs. We
show that for small k the clustering transition can be delayed in this way to
higher density of constraints, and that this strategy has a positive impact on
the performances of Simulated Annealing algorithms. We characterize the modest
gain that can be expected in the large k limit from the simple implementation
of the biasing idea studied here. This paper contains also a contribution of a
more methodological nature, made of a review and extension of the methods to
determine numerically the discontinuous dynamic transition threshold.Comment: 32 pages, 16 figure
What is the Computational Value of Finite Range Tunneling?
Quantum annealing (QA) has been proposed as a quantum enhanced optimization
heuristic exploiting tunneling. Here, we demonstrate how finite range tunneling
can provide considerable computational advantage. For a crafted problem
designed to have tall and narrow energy barriers separating local minima, the
D-Wave 2X quantum annealer achieves significant runtime advantages relative to
Simulated Annealing (SA). For instances with 945 variables, this results in a
time-to-99%-success-probability that is times faster than SA
running on a single processor core. We also compared physical QA with Quantum
Monte Carlo (QMC), an algorithm that emulates quantum tunneling on classical
processors. We observe a substantial constant overhead against physical QA:
D-Wave 2X again runs up to times faster than an optimized
implementation of QMC on a single core. We note that there exist heuristic
classical algorithms that can solve most instances of Chimera structured
problems in a timescale comparable to the D-Wave 2X. However, we believe that
such solvers will become ineffective for the next generation of annealers
currently being designed. To investigate whether finite range tunneling will
also confer an advantage for problems of practical interest, we conduct
numerical studies on binary optimization problems that cannot yet be
represented on quantum hardware. For random instances of the number
partitioning problem, we find numerically that QMC, as well as other algorithms
designed to simulate QA, scale better than SA. We discuss the implications of
these findings for the design of next generation quantum annealers.Comment: 17 pages, 13 figures. Edited for clarity, in part in response to
comments. Added link to benchmark instance
Spectral Detection on Sparse Hypergraphs
We consider the problem of the assignment of nodes into communities from a
set of hyperedges, where every hyperedge is a noisy observation of the
community assignment of the adjacent nodes. We focus in particular on the
sparse regime where the number of edges is of the same order as the number of
vertices. We propose a spectral method based on a generalization of the
non-backtracking Hashimoto matrix into hypergraphs. We analyze its performance
on a planted generative model and compare it with other spectral methods and
with Bayesian belief propagation (which was conjectured to be asymptotically
optimal for this model). We conclude that the proposed spectral method detects
communities whenever belief propagation does, while having the important
advantages to be simpler, entirely nonparametric, and to be able to learn the
rule according to which the hyperedges were generated without prior
information.Comment: 8 pages, 5 figure
- …