Low-distortion Subspace Embeddings in Input-sparsity Time and Applications to Robust Linear Regression

Low-distortion embeddings are critical building blocks for developing random sampling and random projection algorithms for linear algebra problems. We show that, given a matrix $A \in \R^{n \times d}$ with $n \gg d$ and a $p \in [1, 2)$, with a constant probability, we can construct a low-distortion embedding matrix \Pi \in \R^{O(\poly(d)) \times n} that embeds \A_p, the $\ell_p$ subspace spanned by $A$'s columns, into (\R^{O(\poly(d))}, \| \cdot \|_p); the distortion of our embeddings is only O(\poly(d)), and we can compute $\Pi A$ in O(\nnz(A)) time, i.e., input-sparsity time. Our result generalizes the input-sparsity time $\ell_2$ subspace embedding by Clarkson and Woodruff [STOC'13]; and for completeness, we present a simpler and improved analysis of their construction for $\ell_2$. These input-sparsity time $\ell_p$ embeddings are optimal, up to constants, in terms of their running time; and the improved running time propagates to applications such as $(1\pm \epsilon)$-distortion $\ell_p$ subspace embedding and relative-error $\ell_p$ regression. For $\ell_2$, we show that a $(1+\epsilon)$-approximate solution to the $\ell_2$ regression problem specified by the matrix $A$ and a vector $b \in \R^n$ can be computed in O(\nnz(A) + d^3 \log(d/\epsilon) /\epsilon^2) time; and for $\ell_p$, via a subspace-preserving sampling procedure, we show that a $(1\pm \epsilon)$-distortion embedding of \A_p into \R^{O(\poly(d))} can be computed in O(\nnz(A) \cdot \log n) time, and we also show that a $(1+\epsilon)$-approximate solution to the $\ell_p$ regression problem $\min_{x \in \R^d} \|A x - b\|_p$ can be computed in O(\nnz(A) \cdot \log n + \poly(d) \log(1/\epsilon)/\epsilon^2) time. Moreover, we can improve the embedding dimension or equivalently the sample size to $O(d^{3+p/2} \log(1/\epsilon) / \epsilon^2)$ without increasing the complexity.Comment: 22 page

Volume Dependence of Spectral Weights for Unstable Particles in a Solvable Model

Volume dependence of the spectral weight is usually used as a simple criteria to distinguish single-particle states from multi-particle states in lattice QCD calculations. Within a solvable model, the Lee model, we show that this criteria is in principle only valid for a stable particle or a narrow resonance. If the resonance being studied is broad, then the volume dependence of the corresponding spectral weight resembles that of a multi-particle state instead of a single-particle one. For an unstable $V$-particle in the Lee model, the transition from single-particle to multi-particle volume dependence is governed by the ratio of its physical width to the typical level spacing in the finite volume. We estimate this ratio for practical lattice QCD simulations and find that, for most cases, the resonance studied in lattice QCD simulations still resembles the single particle behavior.Comment: 15 pages, no figures. Title modified. Version to appear on Phys. Rev.