Two Studies in Representation of Signals

The thesis consists of two parts. In the first part deals with a multi-scale approach to vector quantization. An algorithm, dubbed reconstruction trees, is proposed and analyzed. Here the goal is parsimonious reconstruction of unsupervised data; the algorithm leverages a family of given partitions, to quickly explore the data in a coarse-to-fine multi-scale fashion. The main technical contribution is an analysis of the expected distortion achieved by the proposed algorithm, when the data are assumed to be sampled from a fixed unknown probability measure. Both asymptotic and finite sample results are provided, under suitable regularity assumptions on the probability measure. Special attention is devoted to the case in which the probability measure is supported on a smooth sub-manifold of the ambient space, and is absolutely continuous with respect to the Riemannian measure of it; in this case asymptotic optimal quantization is well understood and a benchmark for understanding the results is offered. The second part of the thesis deals with a novel approach to Graph Signal Processing which is based on Matroid Theory. Graph Signal Processing is the study of complex functions of the vertex set of a graph, based on the combinatorial Graph Laplacian operator of the underlying graph. This naturally gives raise to a linear operator, that to many regards resembles a Fourier transform, mirroring the graph domain into a frequency domain. On the one hand this structure asymptotically tends to mimic analysis on locally compact groups or manifolds, but on the other hand its discrete nature triggers a whole new scenario of algebraic phenomena. Hints towards making sense of this scenario are objects that already embody a discrete nature in continuous setting, such as measures with discrete support in time and frequency, also called Dirac combs. While these measures are key towards formulating sampling theorems and constructing wavelet frames in time-frequency Analysis, in the graph-frequency setting these boil down to distinguished combinatorial objects, the so called Circuits of a matroid, corresponding to the Fourier transform operator. In a particularly symmetric case, corresponding to Cayley graphs of finite abelian groups, the Dirac combs are proven to completely describe the so called lattice of cyclic flats, exhibiting the property of being atomistic, among other properties. This is a strikingly concise description of the matroid, that opens many questions concerning how this highly regular structure relaxes into more general instances. Lastly, a related problem concerning the combinatorial interplay between Fourier operator and its Spectrum is described, provided with some ideas towards its future development

Multi-scale vector quantization with reconstruction trees

We propose and study a multi-scale approach to vector quantization (VQ). We develop an algorithm, dubbed reconstruction trees, inspired by decision trees. Here the objective is parsimonious reconstruction of unsupervised data, rather than classification. Contrasted to more standard VQ methods, such as k-means, the proposed approach leverages a family of given partitions, to quickly explore the data in a coarse-to-fine multi-scale fashion. Our main technical contribution is an analysis of the expected distortion achieved by the proposed algorithm, when the data are assumed to be sampled from a fixed unknown distribution. In this context, we derive both asymptotic and finite sample results under suitable regularity assumptions on the distribution. As a special case, we consider the setting where the data generating distribution is supported on a compact Riemannian submanifold. Tools from differential geometry and concentration of measure are useful in our analysis