13 research outputs found
Algorithmic and enumerative aspects of the Moser-Tardos distribution
Moser & Tardos have developed a powerful algorithmic approach (henceforth
"MT") to the Lovasz Local Lemma (LLL); the basic operation done in MT and its
variants is a search for "bad" events in a current configuration. In the
initial stage of MT, the variables are set independently. We examine the
distributions on these variables which arise during intermediate stages of MT.
We show that these configurations have a more or less "random" form, building
further on the "MT-distribution" concept of Haeupler et al. in understanding
the (intermediate and) output distribution of MT. This has a variety of
algorithmic applications; the most important is that bad events can be found
relatively quickly, improving upon MT across the complexity spectrum: it makes
some polynomial-time algorithms sub-linear (e.g., for Latin transversals, which
are of basic combinatorial interest), gives lower-degree polynomial run-times
in some settings, transforms certain super-polynomial-time algorithms into
polynomial-time ones, and leads to Las Vegas algorithms for some coloring
problems for which only Monte Carlo algorithms were known.
We show that in certain conditions when the LLL condition is violated, a
variant of the MT algorithm can still produce a distribution which avoids most
of the bad events. We show in some cases this MT variant can run faster than
the original MT algorithm itself, and develop the first-known criterion for the
case of the asymmetric LLL. This can be used to find partial Latin transversals
-- improving upon earlier bounds of Stein (1975) -- among other applications.
We furthermore give applications in enumeration, showing that most applications
(where we aim for all or most of the bad events to be avoided) have many more
solutions than known before by proving that the MT-distribution has "large"
min-entropy and hence that its support-size is large
Using deep learning to construct stochastic local search SAT solvers with performance bounds
The Boolean Satisfiability problem (SAT) is the most prototypical NP-complete
problem and of great practical relevance. One important class of solvers for
this problem are stochastic local search (SLS) algorithms that iteratively and
randomly update a candidate assignment. Recent breakthrough results in
theoretical computer science have established sufficient conditions under which
SLS solvers are guaranteed to efficiently solve a SAT instance, provided they
have access to suitable "oracles" that provide samples from an
instance-specific distribution, exploiting an instance's local structure.
Motivated by these results and the well established ability of neural networks
to learn common structure in large datasets, in this work, we train oracles
using Graph Neural Networks and evaluate them on two SLS solvers on random SAT
instances of varying difficulty. We find that access to GNN-based oracles
significantly boosts the performance of both solvers, allowing them, on
average, to solve 17% more difficult instances (as measured by the ratio
between clauses and variables), and to do so in 35% fewer steps, with
improvements in the median number of steps of up to a factor of 8. As such,
this work bridges formal results from theoretical computer science and
practically motivated research on deep learning for constraint satisfaction
problems and establishes the promise of purpose-trained SAT solvers with
performance guarantees.Comment: 15 pages, 9 figures, code available at
https://github.com/porscheofficial/sls_sat_solving_with_deep_learnin
Commutative Algorithms Approximate the LLL-distribution
Following the groundbreaking Moser-Tardos algorithm for the Lovasz Local
Lemma (LLL), a series of works have exploited a key ingredient of the original
analysis, the witness tree lemma, in order to: derive deterministic, parallel
and distributed algorithms for the LLL, to estimate the entropy of the output
distribution, to partially avoid bad events, to deal with super-polynomially
many bad events, and even to devise new algorithmic frameworks. Meanwhile, a
parallel line of work, has established tools for analyzing stochastic local
search algorithms motivated by the LLL that do not fall within the Moser-Tardos
framework. Unfortunately, the aforementioned results do not transfer to these
more general settings. Mainly, this is because the witness tree lemma,
provably, no longer holds. Here we prove that for commutative algorithms, a
class recently introduced by Kolmogorov and which captures the vast majority of
LLL applications, the witness tree lemma does hold. Armed with this fact, we
extend the main result of Haeupler, Saha, and Srinivasan to commutative
algorithms, establishing that the output of such algorithms well-approximates
the LLL-distribution, i.e., the distribution obtained by conditioning on all
bad events being avoided, and give several new applications. For example, we
show that the recent algorithm of Molloy for list coloring number of sparse,
triangle-free graphs can output exponential many list colorings of the input
graph
LIPIcs
The Lovász Local Lemma (LLL) is a powerful tool in probabilistic combinatorics which can be used to establish the existence of objects that satisfy certain properties. The breakthrough paper of Moser and Tardos and follow-up works revealed that the LLL has intimate connections with a class of stochastic local search algorithms for finding such desirable objects. In particular, it can be seen as a sufficient condition for this type of algorithms to converge fast. Besides conditions for existence of and fast convergence to desirable objects, one may naturally ask further questions regarding properties of these algorithms. For instance, "are they parallelizable?", "how many solutions can they output?", "what is the expected "weight" of a solution?", etc. These questions and more have been answered for a class of LLL-inspired algorithms called commutative. In this paper we introduce a new, very natural and more general notion of commutativity (essentially matrix commutativity) which allows us to show a number of new refined properties of LLL-inspired local search algorithms with significantly simpler proofs
The Moser-Tardos Framework with Partial Resampling
The resampling algorithm of Moser \& Tardos is a powerful approach to develop
constructive versions of the Lov\'{a}sz Local Lemma (LLL). We generalize this
to partial resampling: when a bad event holds, we resample an
appropriately-random subset of the variables that define this event, rather
than the entire set as in Moser & Tardos. This is particularly useful when the
bad events are determined by sums of random variables. This leads to several
improved algorithmic applications in scheduling, graph transversals, packet
routing etc. For instance, we settle a conjecture of Szab\'{o} & Tardos (2006)
on graph transversals asymptotically, and obtain improved approximation ratios
for a packet routing problem of Leighton, Maggs, & Rao (1994)
A new notion of commutativity for the algorithmic Lov\'{a}sz Local Lemma
The Lov\'{a}sz Local Lemma (LLL) is a powerful tool in probabilistic
combinatorics which can be used to establish the existence of objects that
satisfy certain properties. The breakthrough paper of Moser and Tardos and
follow-up works revealed that the LLL has intimate connections with a class of
stochastic local search algorithms for finding such desirable objects. In
particular, it can be seen as a sufficient condition for this type of
algorithms to converge fast.
Besides conditions for existence of and fast convergence to desirable
objects, one may naturally ask further questions regarding properties of these
algorithms. For instance, "are they parallelizable?", "how many solutions can
they output?", "what is the expected "weight" of a solution?", etc. These
questions and more have been answered for a class of LLL-inspired algorithms
called commutative. In this paper we introduce a new, very natural and more
general notion of commutativity (essentially matrix commutativity) which allows
us to show a number of new refined properties of LLL-inspired local search
algorithms with significantly simpler proofs
Deterministic algorithms for the Lovasz Local Lemma: simpler, more general, and more parallel
The Lov\'{a}sz Local Lemma (LLL) is a keystone principle in probability
theory, guaranteeing the existence of configurations which avoid a collection
of "bad" events which are mostly independent and have low
probability. In its simplest "symmetric" form, it asserts that whenever a
bad-event has probability and affects at most bad-events, and , then a configuration avoiding all exists.
A seminal algorithm of Moser & Tardos (2010) gives nearly-automatic
randomized algorithms for most constructions based on the LLL. However,
deterministic algorithms have lagged behind. We address three specific
shortcomings of the prior deterministic algorithms. First, our algorithm
applies to the LLL criterion of Shearer (1985); this is more powerful than
alternate LLL criteria and also removes a number of nuisance parameters and
leads to cleaner and more legible bounds. Second, we provide parallel
algorithms with much greater flexibility in the functional form of of the
bad-events. Third, we provide a derandomized version of the MT-distribution,
that is, the distribution of the variables at the termination of the MT
algorithm.
We show applications to non-repetitive vertex coloring, independent
transversals, strong coloring, and other problems. These give deterministic
algorithms which essentially match the best previous randomized sequential and
parallel algorithms.Comment: This superseded arxiv:1807.0667