Metric structures in L_1: Dimension, snowflakes, and average distortion

We study the metric properties of finite subsets of L_1. The analysis of such metrics is central to a number of important algorithmic problems involving the cut structure of weighted graphs, including the Sparsest Cut Problem, one of the most compelling open problems in the field of approximation algorithms. Additionally, many open questions in geometric non-linear functional analysis involve the properties of finite subsets of L_1.Comment: 9 pages, 1 figure. To appear in European Journal of Combinatorics. Preliminary version appeared in LATIN '0

Impossibility of dimension reduction in the nuclear norm

Let $\mathsf{S}_1$ (the Schatten--von Neumann trace class) denote the Banach space of all compact linear operators $T:\ell_2\to \ell_2$ whose nuclear norm $\|T\|_{\mathsf{S}_1}=\sum_{j=1}^\infty\sigma_j(T)$ is finite, where $\{\sigma_j(T)\}_{j=1}^\infty$ are the singular values of $T$. We prove that for arbitrarily large $n\in \mathbb{N}$ there exists a subset $\mathcal{C}\subseteq \mathsf{S}_1$ with $|\mathcal{C}|=n$ that cannot be embedded with bi-Lipschitz distortion $O(1)$ into any $n^{o(1)}$-dimensional linear subspace of $\mathsf{S}_1$. $\mathcal{C}$ is not even a $O(1)$-Lipschitz quotient of any subset of any $n^{o(1)}$-dimensional linear subspace of $\mathsf{S}_1$. Thus, $\mathsf{S}_1$ does not admit a dimension reduction result \'a la Johnson and Lindenstrauss (1984), which complements the work of Harrow, Montanaro and Short (2011) on the limitations of quantum dimension reduction under the assumption that the embedding into low dimensions is a quantum channel. Such a statement was previously known with $\mathsf{S}_1$ replaced by the Banach space $\ell_1$ of absolutely summable sequences via the work of Brinkman and Charikar (2003). In fact, the above set $\mathcal{C}$ can be taken to be the same set as the one that Brinkman and Charikar considered, viewed as a collection of diagonal matrices in $\mathsf{S}_1$. The challenge is to demonstrate that $\mathcal{C}$ cannot be faithfully realized in an arbitrary low-dimensional subspace of $\mathsf{S}_1$, while Brinkman and Charikar obtained such an assertion only for subspaces of $\mathsf{S}_1$ that consist of diagonal operators (i.e., subspaces of $\ell_1$). We establish this by proving that the Markov 2-convexity constant of any finite dimensional linear subspace $X$ of $\mathsf{S}_1$ is at most a universal constant multiple of $\sqrt{\log \mathrm{dim}(X)}$

Recursive Sketching For Frequency Moments

In a ground-breaking paper, Indyk and Woodruff (STOC 05) showed how to compute $F_k$ (for $k>2$) in space complexity O(\mbox{\em poly-log}(n,m)\cdot n^{1-\frac2k}), which is optimal up to (large) poly-logarithmic factors in $n$ and $m$, where $m$ is the length of the stream and $n$ is the upper bound on the number of distinct elements in a stream. The best known lower bound for large moments is $\Omega(\log(n)n^{1-\frac2k})$. A follow-up work of Bhuvanagiri, Ganguly, Kesh and Saha (SODA 2006) reduced the poly-logarithmic factors of Indyk and Woodruff to $O(\log^2(m)\cdot (\log n+ \log m)\cdot n^{1-{2\over k}})$. Further reduction of poly-log factors has been an elusive goal since 2006, when Indyk and Woodruff method seemed to hit a natural "barrier." Using our simple recursive sketch, we provide a different yet simple approach to obtain a $O(\log(m)\log(nm)\cdot (\log\log n)^4\cdot n^{1-{2\over k}})$ algorithm for constant $\epsilon$ (our bound is, in fact, somewhat stronger, where the $(\log\log n)$ term can be replaced by any constant number of $\log$ iterations instead of just two or three, thus approaching $log^*n$. Our bound also works for non-constant $\epsilon$ (for details see the body of the paper). Further, our algorithm requires only $4$-wise independence, in contrast to existing methods that use pseudo-random generators for computing large frequency moments

The fractional Keller-Segel model

The Keller-Segel model is a system of partial differential equations modelling chemotactic aggregation in cellular systems. This model has blowing up solutions for large enough initial conditions in dimensions d >= 2, but all the solutions are regular in one dimension; a mathematical fact that crucially affects the patterns that can form in the biological system. One of the strongest assumptions of the Keller-Segel model is the diffusive character of the cellular motion, known to be false in many situations. We extend this model to such situations in which the cellular dispersal is better modelled by a fractional operator. We analyze this fractional Keller-Segel model and find that all solutions are again globally bounded in time in one dimension. This fact shows the robustness of the main biological conclusions obtained from the Keller-Segel model

Differentially Private Release and Learning of Threshold Functions

We prove new upper and lower bounds on the sample complexity of $(\epsilon, \delta)$ differentially private algorithms for releasing approximate answers to threshold functions. A threshold function $c_x$ over a totally ordered domain $X$ evaluates to $c_x(y) = 1$ if $y \le x$, and evaluates to $0$ otherwise. We give the first nontrivial lower bound for releasing thresholds with $(\epsilon,\delta)$ differential privacy, showing that the task is impossible over an infinite domain $X$, and moreover requires sample complexity $n \ge \Omega(\log^*|X|)$, which grows with the size of the domain. Inspired by the techniques used to prove this lower bound, we give an algorithm for releasing thresholds with $n \le 2^{(1+ o(1))\log^*|X|}$ samples. This improves the previous best upper bound of $8^{(1 + o(1))\log^*|X|}$ (Beimel et al., RANDOM '13). Our sample complexity upper and lower bounds also apply to the tasks of learning distributions with respect to Kolmogorov distance and of properly PAC learning thresholds with differential privacy. The lower bound gives the first separation between the sample complexity of properly learning a concept class with $(\epsilon,\delta)$ differential privacy and learning without privacy. For properly learning thresholds in $\ell$ dimensions, this lower bound extends to $n \ge \Omega(\ell \cdot \log^*|X|)$. To obtain our results, we give reductions in both directions from releasing and properly learning thresholds and the simpler interior point problem. Given a database $D$ of elements from $X$, the interior point problem asks for an element between the smallest and largest elements in $D$. We introduce new recursive constructions for bounding the sample complexity of the interior point problem, as well as further reductions and techniques for proving impossibility results for other basic problems in differential privacy.Comment: 43 page