9,207 research outputs found
Compressive Sensing for Spectroscopy and Polarimetry
We demonstrate through numerical simulations with real data the feasibility
of using compressive sensing techniques for the acquisition of
spectro-polarimetric data. This allows us to combine the measurement and the
compression process into one consistent framework. Signals are recovered thanks
to a sparse reconstruction scheme from projections of the signal of interest
onto appropriately chosen vectors, typically noise-like vectors. The
compressibility properties of spectral lines are analyzed in detail. The
results shown in this paper demonstrate that, thanks to the compressibility
properties of spectral lines, it is feasible to reconstruct the signals using
only a small fraction of the information that is measured nowadays. We
investigate in depth the quality of the reconstruction as a function of the
amount of data measured and the influence of noise. This change of paradigm
also allows us to define new instrumental strategies and to propose
modifications to existing instruments in order to take advantage of compressive
sensing techniques.Comment: 11 pages, 9 figures, accepted for publication in A&
Compressive Mining: Fast and Optimal Data Mining in the Compressed Domain
Real-world data typically contain repeated and periodic patterns. This
suggests that they can be effectively represented and compressed using only a
few coefficients of an appropriate basis (e.g., Fourier, Wavelets, etc.).
However, distance estimation when the data are represented using different sets
of coefficients is still a largely unexplored area. This work studies the
optimization problems related to obtaining the \emph{tightest} lower/upper
bound on Euclidean distances when each data object is potentially compressed
using a different set of orthonormal coefficients. Our technique leads to
tighter distance estimates, which translates into more accurate search,
learning and mining operations \textit{directly} in the compressed domain.
We formulate the problem of estimating lower/upper distance bounds as an
optimization problem. We establish the properties of optimal solutions, and
leverage the theoretical analysis to develop a fast algorithm to obtain an
\emph{exact} solution to the problem. The suggested solution provides the
tightest estimation of the -norm or the correlation. We show that typical
data-analysis operations, such as k-NN search or k-Means clustering, can
operate more accurately using the proposed compression and distance
reconstruction technique. We compare it with many other prevalent compression
and reconstruction techniques, including random projections and PCA-based
techniques. We highlight a surprising result, namely that when the data are
highly sparse in some basis, our technique may even outperform PCA-based
compression.
The contributions of this work are generic as our methodology is applicable
to any sequential or high-dimensional data as well as to any orthogonal data
transformation used for the underlying data compression scheme.Comment: 25 pages, 20 figures, accepted in VLD
Image encoding by independent principal components
The encoding of images by semantic entities is still an unresolved task. This paper proposes the encoding of images by only a few important components or image primitives. Classically, this can be done by the Principal Component Analysis (PCA). Recently, the Independent Component Analysis (ICA) has found strong interest in the signal processing and neural network community. Using this as pattern primitives we aim for source patterns with the highest occurrence probability or highest information. For the example of a synthetic image composed by characters this idea selects the salient ones. For natural images it does not lead to an acceptable reproduction error since no a-priori probabilities can be computed. Combining the traditional principal component criteria of PCA with the independence property of ICA we obtain a better encoding. It turns out that the Independent Principal Components (IPC) in contrast to the Principal Independent Components (PIC) implement the classical demand of Shannon’s rate distortion theory
- …