Blind channel deconvolution of real world signals using source separation techniques

In this paper we present a method for blind deconvolution of linear channels based on source separation techniques, for real word signals. This technique applied to blind deconvolution problems is based in exploiting not the spatial independence between signals but the temporal independence between samples of the signal. Our objective is to minimize the mutual information between samples of the output in order to retrieve the original signal. In order to make use of use this idea the input signal must be a non-Gaussian i.i.d. signal. Because most real world signals do not have this i.i.d. nature, we will need to preprocess the original signal before the transmission into the channel. Likewise we should assure that the transmitted signal has non-Gaussian statistics in order to achieve the correct function of the algorithm. The strategy used for this preprocessing will be presented in this paper. If the receiver has the inverse of the preprocess, the original signal can be reconstructed without the convolutive distortion

Linear theory for filtering nonlinear multiscale systems with model error

We study filtering of multiscale dynamical systems with model error arising from unresolved smaller scale processes. The analysis assumes continuous-time noisy observations of all components of the slow variables alone. For a linear model with Gaussian noise, we prove existence of a unique choice of parameters in a linear reduced model for the slow variables. The linear theory extends to to a non-Gaussian, nonlinear test problem, where we assume we know the optimal stochastic parameterization and the correct observation model. We show that when the parameterization is inappropriate, parameters chosen for good filter performance may give poor equilibrium statistical estimates and vice versa. Given the correct parameterization, it is imperative to estimate the parameters simultaneously and to account for the nonlinear feedback of the stochastic parameters into the reduced filter estimates. In numerical experiments on the two-layer Lorenz-96 model, we find that parameters estimated online, as part of a filtering procedure, produce accurate filtering and equilibrium statistical prediction. In contrast, a linear regression based offline method, which fits the parameters to a given training data set independently from the filter, yields filter estimates which are worse than the observations or even divergent when the slow variables are not fully observed

The Cramer-Rao Bound and DMT Signal Optimisation for the Identification of a Wiener-Type Model

In linear system identification, optimal excitation signals can be determined using the Cramer-Rao bound. This problem has not been thoroughly studied for the nonlinear case. In this work, the Cramer-Rao bound for a factorisable Volterra model is derived. The analytical result is supported with simulation examples. The bound is then used to find the optimal excitation signal out of the class of discrete multitone signals. As the model is nonlinear in the parameters, the bound depends on the model parameters themselves. On this basis, a three-step identification procedure is proposed. To illustrate the procedure, signal optimisation is explicitly performed for a third-order nonlinear model. Methods of nonlinear optimisation are applied for the parameter estimation of the model. As a baseline, the problem of optimal discrete multitone signals for linear FIR filter estimation is reviewed

Stochastic resonance in chua's circuit driven by alpha-stable noise

Thesis (Master)--Izmir Institute of Technology, Electronics and Communication Engineering, Izmir, 2012Includes bibliographical references (leaves: 75-80)Text in English; Abstract: Turkish and Englishx, 80 leavesThe main aim of this thesis is to investigate the stochastic resonance (SR) in Chua's circuit driven by alpha-stable noise which has better approximation to a real-world signal than Gaussian distribution. SR is a phenomenon in which the response of a nonlinear system to a sub-threshold (weak) input signal is enhanced with the addition of an optimal amount of noise. There have been an increasing amount of applications based on SR in various fields. Almost all studies related to SR in chaotic systems assume that the noise is Gaussian, which leads researchers to investigate the cases in which the noise is non-Gaussian hence has infinite variance. In this thesis, the spectral power amplification which is used to quantify the SR has been evaluated through fractional lower order Wigner Ville distribution of the response of a system and analyzed for various parameters of alpha-stable noise. The results provide a visible SR effect in Chua’s circuit driven by symmetric and skewed-symmetric alpha-stable noise distributions. Furthermore, a series of simulations reveal that the mean residence time that is the average time spent by the trajectory in an attractor can vary depending on different alpha-stable noise parameters

Maximal height statistics for 1/f^alpha signals

Numerical and analytical results are presented for the maximal relative height distribution of stationary periodic Gaussian signals (one dimensional interfaces) displaying a 1/f^alpha power spectrum. For 0<alpha<1 (regime of decaying correlations), we observe that the mathematically established limiting distribution (Fisher-Tippett-Gumbel distribution) is approached extremely slowly as the sample size increases. The convergence is rapid for alpha>1 (regime of strong correlations) and a highly accurate picture gallery of distribution functions can be constructed numerically. Analytical results can be obtained in the limit alpha -> infinity and, for large alpha, by perturbation expansion. Furthermore, using path integral techniques we derive a trace formula for the distribution function, valid for alpha=2n even integer. From the latter we extract the small argument asymptote of the distribution function whose analytic continuation to arbitrary alpha > 1 is found to be in agreement with simulations. Comparison of the extreme and roughness statistics of the interfaces reveals similarities in both the small and large argument asymptotes of the distribution functions.Comment: 17 pages, 8 figures, RevTex

Glassy phases in Random Heteropolymers with correlated sequences

We develop a new analytic approach for the study of lattice heteropolymers, and apply it to copolymers with correlated Markovian sequences. According to our analysis, heteropolymers present three different dense phases depending upon the temperature, the nature of the monomer interactions, and the sequence correlations: (i) a liquid phase, (ii) a ``soft glass'' phase, and (iii) a ``frozen glass'' phase. The presence of the new intermediate ``soft glass'' phase is predicted for instance in the case of polyampholytes with sequences that favor the alternation of monomers. Our approach is based on the cavity method, a refined Bethe Peierls approximation adapted to frustrated systems. It amounts to a mean field treatment in which the nearest neighbor correlations, which are crucial in the dense phases of heteropolymers, are handled exactly. This approach is powerful and versatile, it can be improved systematically and generalized to other polymeric systems

Blind deconvolution of medical ultrasound images: parametric inverse filtering approach

©2007 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or distribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE. This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.DOI: 10.1109/TIP.2007.910179The problem of reconstruction of ultrasound images by means of blind deconvolution has long been recognized as one of the central problems in medical ultrasound imaging. In this paper, this problem is addressed via proposing a blind deconvolution method which is innovative in several ways. In particular, the method is based on parametric inverse filtering, whose parameters are optimized using two-stage processing. At the first stage, some partial information on the point spread function is recovered. Subsequently, this information is used to explicitly constrain the spectral shape of the inverse filter. From this perspective, the proposed methodology can be viewed as a ldquohybridizationrdquo of two standard strategies in blind deconvolution, which are based on either concurrent or successive estimation of the point spread function and the image of interest. Moreover, evidence is provided that the ldquohybridrdquo approach can outperform the standard ones in a number of important practical cases. Additionally, the present study introduces a different approach to parameterizing the inverse filter. Specifically, we propose to model the inverse transfer function as a member of a principal shift-invariant subspace. It is shown that such a parameterization results in considerably more stable reconstructions as compared to standard parameterization methods. Finally, it is shown how the inverse filters designed in this way can be used to deconvolve the images in a nonblind manner so as to further improve their quality. The usefulness and practicability of all the introduced innovations are proven in a series of both in silico and in vivo experiments. Finally, it is shown that the proposed deconvolution algorithms are capable of improving the resolution of ultrasound images by factors of 2.24 or 6.52 (as judged by the autocorrelation criterion) depending on the type of regularization method used