9 research outputs found
Commutative Algorithms Approximate the LLL-distribution
Following the groundbreaking Moser-Tardos algorithm for the Lovasz Local
Lemma (LLL), a series of works have exploited a key ingredient of the original
analysis, the witness tree lemma, in order to: derive deterministic, parallel
and distributed algorithms for the LLL, to estimate the entropy of the output
distribution, to partially avoid bad events, to deal with super-polynomially
many bad events, and even to devise new algorithmic frameworks. Meanwhile, a
parallel line of work, has established tools for analyzing stochastic local
search algorithms motivated by the LLL that do not fall within the Moser-Tardos
framework. Unfortunately, the aforementioned results do not transfer to these
more general settings. Mainly, this is because the witness tree lemma,
provably, no longer holds. Here we prove that for commutative algorithms, a
class recently introduced by Kolmogorov and which captures the vast majority of
LLL applications, the witness tree lemma does hold. Armed with this fact, we
extend the main result of Haeupler, Saha, and Srinivasan to commutative
algorithms, establishing that the output of such algorithms well-approximates
the LLL-distribution, i.e., the distribution obtained by conditioning on all
bad events being avoided, and give several new applications. For example, we
show that the recent algorithm of Molloy for list coloring number of sparse,
triangle-free graphs can output exponential many list colorings of the input
graph
Simple Local Computation Algorithms for the General Lovasz Local Lemma
We consider the task of designing Local Computation Algorithms (LCA) for
applications of the Lov\'{a}sz Local Lemma (LLL). LCA is a class of sublinear
algorithms proposed by Rubinfeld et al.~\cite{Ronitt} that have received a lot
of attention in recent years. The LLL is an existential, sufficient condition
for a collection of sets to have non-empty intersection (in applications,
often, each set comprises all objects having a certain property). The
ground-breaking algorithm of Moser and Tardos~\cite{MT} made the LLL fully
constructive, following earlier results by Beck~\cite{beck_lll} and
Alon~\cite{alon_lll} giving algorithms under significantly stronger LLL-like
conditions. LCAs under those stronger conditions were given in~\cite{Ronitt},
where it was asked if the Moser-Tardos algorithm can be used to design LCAs
under the standard LLL condition. The main contribution of this paper is to
answer this question affirmatively. In fact, our techniques yield LCAs for
settings beyond the standard LLL condition
Fundamentals of Partial Rejection Sampling
Partial Rejection Sampling is an algorithmic approach to obtaining a perfect
sample from a specified distribution. The objects to be sampled are assumed to
be represented by a number of random variables. In contrast to classical
rejection sampling, in which all variables are resampled until a feasible
solution is found, partial rejection sampling aims at greater efficiency by
resampling only a subset of variables that `go wrong'. Partial rejection
sampling is closely related to Moser and Tardos' algorithmic version of the
Lov\'asz Local Lemma, but with the additional requirement that a specified
output distribution should be met. This article provides a largely
self-contained account of the basic form of the algorithm and its analysis
LIPIcs
The Lovász Local Lemma (LLL) is a powerful tool in probabilistic combinatorics which can be used to establish the existence of objects that satisfy certain properties. The breakthrough paper of Moser and Tardos and follow-up works revealed that the LLL has intimate connections with a class of stochastic local search algorithms for finding such desirable objects. In particular, it can be seen as a sufficient condition for this type of algorithms to converge fast. Besides conditions for existence of and fast convergence to desirable objects, one may naturally ask further questions regarding properties of these algorithms. For instance, "are they parallelizable?", "how many solutions can they output?", "what is the expected "weight" of a solution?", etc. These questions and more have been answered for a class of LLL-inspired algorithms called commutative. In this paper we introduce a new, very natural and more general notion of commutativity (essentially matrix commutativity) which allows us to show a number of new refined properties of LLL-inspired local search algorithms with significantly simpler proofs
A new notion of commutativity for the algorithmic Lov\'{a}sz Local Lemma
The Lov\'{a}sz Local Lemma (LLL) is a powerful tool in probabilistic
combinatorics which can be used to establish the existence of objects that
satisfy certain properties. The breakthrough paper of Moser and Tardos and
follow-up works revealed that the LLL has intimate connections with a class of
stochastic local search algorithms for finding such desirable objects. In
particular, it can be seen as a sufficient condition for this type of
algorithms to converge fast.
Besides conditions for existence of and fast convergence to desirable
objects, one may naturally ask further questions regarding properties of these
algorithms. For instance, "are they parallelizable?", "how many solutions can
they output?", "what is the expected "weight" of a solution?", etc. These
questions and more have been answered for a class of LLL-inspired algorithms
called commutative. In this paper we introduce a new, very natural and more
general notion of commutativity (essentially matrix commutativity) which allows
us to show a number of new refined properties of LLL-inspired local search
algorithms with significantly simpler proofs
Recommended from our members
Stochastic Local Search and the Lovasz Local Lemma
Stochastic Local Search and the Lovasz Local LemmabyFotios IliopoulosDoctor of Philosophy in Computer ScienceUniversity of California, BerkeleyProfessor Alistair Sinclair, ChairThis thesis studies randomized local search algorithms for finding solutions of constraint satisfaction problems inspired by and extending the Lovasz Local Lemma (LLL). The LLL is a powerful probabilistic tool for establishing the existence of objects satisfying certain properties (constraints). As a probability statement it asserts that, given a family of “bad” events, if each bad event is individually not very likely and independent of all but a small number of other bad events, then the probability of avoiding all bad events is strictly positive. In a celebrated breakthrough, Moser and Tardos made the LLL constructive for any product probability measure over explicitly presented variables. Specifically, they proved that whenever the LLL condition holds, their Resample algorithm, which repeatedly selects any occurring bad event and resamples all its variables according to the measure, quickly converges to an object with desired properties. In this dissertation we present a framework that extends the work of Moser and Tardos and can be used to analyze arbitrary, possibly complex, focused local search algorithms, i.e., search algorithms whose process for addressing violated constraints, while local, is more sophisticated than obliviously resampling their variables independently of the current configuration. We give several applications of this framework, notably a new vertex coloring algorithm for graphs with sparse vertex neighborhoods that uses a number of colors that matches the algorithmic barrier for random graphs, and polynomial time algorithms for the celebrated (non-constructive) results of Kahn for the Goldberg-Seymour and List-Edge-Coloring Conjectures.Finally, we introduce a generalization of Kolmogorov’s notion of commutative algorithms, cast as matrix commutativity, and show that their output distribution approximates the so-called “LLL-distribution”, i.e., the distribution obtained by conditioning on avoiding all bad events. This fact allows us to consider questions such as the number of possible distinct final states and the probability that certain portions of the state space are visited by a local search algorithm, extending existing results for the Moser-Tardos algorithm to commutative algorithms