Data compression and harmonic analysis

In this paper we review some recent interactions between harmonic analysis and data compression. The story goes back of course to Shannon’

Engineering studies related to geodetic and oceanographic remote sensing using short pulse techniques

For the Skylab S-193 radar altimeter, data processing flow charts and identification of calibration requirements and problem areas for defined S-193 altimeter experiments are presented. An analysis and simulation of the relationship between one particular S-193 measurement and the parameter of interest for determining the sea surface scattering cross-section are considered. For the GEOS-C radar altimeter, results are presented for system analyses pertaining to signal-to-noise ratio, pulse compression threshold behavior, altimeter measurement variance characteristics, desirability of onboard averaging, tracker bandwidth considerations, and statistical character of the altimeter data in relation to harmonic analysis properties of the geodetic signal

Seismic Data Compression using Wave Atom Transform

Seismic data compression SDC is crucially confronted in the oil Industry with large data volumes and Incomplete data measurements In this research we present a comprehensive method of exploiting wave packets to perform seismic data compression Wave atoms are the modern addition to the collection of mathematical transforms for harmonic computational analysis Wave atoms are variant of 2D wavelet packets that keep an isotropic aspect ratio Wave atoms have a spiky frequency localization that cannot be attained using a filter bank based on wavelet packets and offer a significantly sparser expansion for oscillatory functions than wavelets curvelets and Gabor atom

Expansion-maximization-compression algorithm with spherical harmonics for single particle imaging with X-ray lasers

In 3D single particle imaging with X-ray free-electron lasers, particle orientation is not recorded during measurement but is instead recovered as a necessary step in the reconstruction of a 3D image from the diffraction data. Here we use harmonic analysis on the sphere to cleanly separate the angu- lar and radial degrees of freedom of this problem, providing new opportunities to efficiently use data and computational resources. We develop the Expansion-Maximization-Compression algorithm into a shell-by-shell approach and implement an angular bandwidth limit that can be gradually raised during the reconstruction. We study the minimum number of patterns and minimum rotation sampling required for a desired angular and radial resolution. These extensions provide new av- enues to improve computational efficiency and speed of convergence, which are critically important considering the very large datasets expected from experiment

Redshift Distortions and Clustering in the PSCz Survey

We have constrained the redshift-distortion parameter $beta equiv Omega^{0.6}/b$ and the real-space power spectrum of the IRAS PSCz survey using a spherical-harmonic redshift-distortion analysis combined with a data compression method which is designed to deal with correlated parameters. Our latest result, $beta=0.4 pm 0.1$, strongly rules out $beta=1$

Wavemoth -- Fast spherical harmonic transforms by butterfly matrix compression

We present Wavemoth, an experimental open source code for computing scalar spherical harmonic transforms (SHTs). Such transforms are ubiquitous in astronomical data analysis. Our code performs substantially better than existing publicly available codes due to improvements on two fronts. First, the computational core is made more efficient by using small amounts of precomputed data, as well as paying attention to CPU instruction pipelining and cache usage. Second, Wavemoth makes use of a fast and numerically stable algorithm based on compressing a set of linear operators in a precomputation step. The resulting SHT scales as O(L^2 (log L)^2) for the resolution range of practical interest, where L denotes the spherical harmonic truncation degree. For low and medium-range resolutions, Wavemoth tends to be twice as fast as libpsht, which is the current state of the art implementation for the HEALPix grid. At the resolution of the Planck experiment, L ~ 4000, Wavemoth is between three and six times faster than libpsht, depending on the computer architecture and the required precision. Due to the experimental nature of the project, only spherical harmonic synthesis is currently supported, although adding support or spherical harmonic analysis should be trivial.Comment: 13 pages, 6 figures, accepted by ApJ