Content adaptive wavelet based method for joint denoising of depth and luminance images

In this paper we present a new method for joint denoising of depth and luminance images produced by time-of-flight camera. Here we assume that the sequence does not contain outlier points which can be present in the depth images. Our method first performs estimation of noise and signal covariance matrices and then performs vector denoising. Luminance image is segmented into similar contexts usina k-means algorithm, which are used for calculation of covariance matrices. Denoising results are compared with the ground truth images obtained by averaging of the multiple frames of the still scene

High spatial resolution and high contrast optical speckle imaging with FASTCAM at the ORM

In this paper, we present an original observational approach, which combines, for the first time, traditional speckle imaging with image post-processing to obtain in the optical domain diffraction-limited images with high contrast (1e-5) within 0.5 to 2 arcseconds around a bright star. The post-processing step is based on wavelet filtering an has analogy with edge enhancement and high-pass filtering. Our I-band on-sky results with the 2.5-m Nordic Telescope (NOT) and the lucky imaging instrument FASTCAM show that we are able to detect L-type brown dwarf companions around a solar-type star with a contrast DI~12 at 2" and with no use of any coronographic capability, which greatly simplifies the instrumental and hardware approach. This object has been detected from the ground in J and H bands so far only with AO-assisted 8-10 m class telescopes (Gemini, Keck), although more recently detected with small-class telescopes in the K band. Discussing the advantage and disadvantage of the optical regime for the detection of faint intrinsic fluxes close to bright stars, we develop some perspectives for other fields, including the study of dense cores in globular clusters. To the best of our knowledge this is the first time that high contrast considerations are included in optical speckle imaging approach.Comment: Proceedings of SPIE conference - Ground-based and Airborne Instrumentation for Astronomy III (Conference 7735), San Diego 201

Wavelet based joint denoising of depth and luminance images

In this paper we present a new method for joint denoising of depth and luminance images produced by time-of-flight camera. Here we assume that the sequence does not contain outlier points which can be present in the depth images. Our method first performs estimation of noise and signal covariance matrices and then performs vector denoising. Two versions of the algorithm are presented, depending on the method used for the classification of the image contexts. Denoising results are compared with the ground truth images obtained by averaging of the multiple frames of the still scene

Online Localization and Tracking of Multiple Moving Speakers in Reverberant Environments

We address the problem of online localization and tracking of multiple moving speakers in reverberant environments. The paper has the following contributions. We use the direct-path relative transfer function (DP-RTF), an inter-channel feature that encodes acoustic information robust against reverberation, and we propose an online algorithm well suited for estimating DP-RTFs associated with moving audio sources. Another crucial ingredient of the proposed method is its ability to properly assign DP-RTFs to audio-source directions. Towards this goal, we adopt a maximum-likelihood formulation and we propose to use an exponentiated gradient (EG) to efficiently update source-direction estimates starting from their currently available values. The problem of multiple speaker tracking is computationally intractable because the number of possible associations between observed source directions and physical speakers grows exponentially with time. We adopt a Bayesian framework and we propose a variational approximation of the posterior filtering distribution associated with multiple speaker tracking, as well as an efficient variational expectation-maximization (VEM) solver. The proposed online localization and tracking method is thoroughly evaluated using two datasets that contain recordings performed in real environments.Comment: IEEE Journal of Selected Topics in Signal Processing, 201

Horizontal flow fields observed in Hinode G-band images. I. Methods

Context: The interaction of plasma motions and magnetic fields is an important mechanism, which drives solar activity in all its facets. For example, photospheric flows are responsible for the advection of magnetic flux, the redistribution of flux during the decay of sunspots, and the built-up of magnetic shear in flaring active regions. Aims: Systematic studies based on G-band data from the Japanese Hinode mission provide the means to gather statistical properties of horizontal flow fields. This facilitates comparative studies of solar features, e.g., G-band bright points, magnetic knots, pores, and sunspots at various stages of evolution and in distinct magnetic environments, thus, enhancing our understanding of the dynamic Sun. Methods: We adapted Local Correlation Tracking (LCT) to measure horizontal flow fields based on G-band images obtained with the Solar Optical Telescope on board Hinode. In total about 200 time-series with a duration between 1-16 h and a cadence between 15-90 s were analyzed. Selecting both a high-cadence (dt = 15 s) and a long-duration (dT = 16 h) time-series enabled us to optimize and validate the LCT input parameters, hence, ensuring a robust, reliable, uniform, and accurate processing of a huge data volume. Results: The LCT algorithm produces best results for G-band images having a cadence of 60-90 s. If the cadence is lower, the velocity of slowly moving features will not be reliably detected. If the cadence is higher, the scene on the Sun will have evolved too much to bear any resemblance with the earlier situation. Consequently, in both instances horizontal proper motions are underestimated. The most reliable and yet detailed flow maps are produced using a Gaussian kernel with a size of 2560 km x 2560 km and a full-width-at-half-maximum (FWHM) of 1200 km (corresponding to the size of a typical granule) as sampling window.Comment: 12 pages, 8 figures, 4 tables, accepted for publication in Astronomy and Astrophysic