376 research outputs found

    Uniform Sampling through the Lovász Local Lemma

    Get PDF
    We propose a new algorithmic framework, called `"partial rejection sampling'', to draw samples exactly from a product distribution, conditioned on none of a number of bad events occurring. Our framework builds new connections between the variable framework of the Lovász Local Lemma and some classical sampling algorithms such as the "cycle-popping"' algorithm for rooted spanning trees. Among other applications, we discover new algorithms to sample satisfying assignments of k-CNF formulas with bounded variable occurrences

    Escaping the Local Minima via Simulated Annealing: Optimization of Approximately Convex Functions

    Full text link
    We consider the problem of optimizing an approximately convex function over a bounded convex set in Rn\mathbb{R}^n using only function evaluations. The problem is reduced to sampling from an \emph{approximately} log-concave distribution using the Hit-and-Run method, which is shown to have the same O∗\mathcal{O}^* complexity as sampling from log-concave distributions. In addition to extend the analysis for log-concave distributions to approximate log-concave distributions, the implementation of the 1-dimensional sampler of the Hit-and-Run walk requires new methods and analysis. The algorithm then is based on simulated annealing which does not relies on first order conditions which makes it essentially immune to local minima. We then apply the method to different motivating problems. In the context of zeroth order stochastic convex optimization, the proposed method produces an ϵ\epsilon-minimizer after O∗(n7.5ϵ−2)\mathcal{O}^*(n^{7.5}\epsilon^{-2}) noisy function evaluations by inducing a O(ϵ/n)\mathcal{O}(\epsilon/n)-approximately log concave distribution. We also consider in detail the case when the "amount of non-convexity" decays towards the optimum of the function. Other applications of the method discussed in this work include private computation of empirical risk minimizers, two-stage stochastic programming, and approximate dynamic programming for online learning.Comment: 27 page

    Improved Bounds for Randomly Colouring Simple Hypergraphs

    Get PDF
    We study the problem of sampling almost uniform proper q-colourings in k-uniform simple hypergraphs with maximum degree ?. For any ? > 0, if k ? 20(1+?)/? and q ? 100?^({2+?}/{k-4/?-4}), the running time of our algorithm is O?(poly(? k)? n^1.01), where n is the number of vertices. Our result requires fewer colours than previous results for general hypergraphs (Jain, Pham, and Vuong, 2021; He, Sun, and Wu, 2021), and does not require ?(log n) colours unlike the work of Frieze and Anastos (2017)

    Unsplittable coverings in the plane

    Get PDF
    A system of sets forms an {\em mm-fold covering} of a set XX if every point of XX belongs to at least mm of its members. A 11-fold covering is called a {\em covering}. The problem of splitting multiple coverings into several coverings was motivated by classical density estimates for {\em sphere packings} as well as by the {\em planar sensor cover problem}. It has been the prevailing conjecture for 35 years (settled in many special cases) that for every plane convex body CC, there exists a constant m=m(C)m=m(C) such that every mm-fold covering of the plane with translates of CC splits into 22 coverings. In the present paper, it is proved that this conjecture is false for the unit disk. The proof can be generalized to construct, for every mm, an unsplittable mm-fold covering of the plane with translates of any open convex body CC which has a smooth boundary with everywhere {\em positive curvature}. Somewhat surprisingly, {\em unbounded} open convex sets CC do not misbehave, they satisfy the conjecture: every 33-fold covering of any region of the plane by translates of such a set CC splits into two coverings. To establish this result, we prove a general coloring theorem for hypergraphs of a special type: {\em shift-chains}. We also show that there is a constant c>0c>0 such that, for any positive integer mm, every mm-fold covering of a region with unit disks splits into two coverings, provided that every point is covered by {\em at most} c2m/2c2^{m/2} sets
    • …
    corecore