An Efficient Algorithm by Kurtosis Maximization in Reference-Based Framework

This paper deals with the optimization of kurtosis for complex-valued signals in the independent component analysis (ICA) framework, where source signals are linearly and instantaneously mixed. Inspired by the recently proposed reference-based contrast schemes, a similar contrast function is put forward, based on which a new fast fixed-point (FastICA) algorithm is proposed. The new optimization method is similar in spirit to the former classical kurtosis-based FastICA algorithm but differs in the fact that it is much more efficient than the latter in terms of computational speed, which is significantly striking with large number of samples. The performance of this new algorithm is confirmed through computer simulations

A Novel FastICA Method for the Reference-based Contrast Functions

This paper deals with the efficient optimization problem of Cumulant-based contrast criteria in the Blind Source Separation (BSS) framework, in which sources are retrieved by maximizing the Kurtosis contrast function. Combined with the recently proposed reference-based contrast schemes, a new fast fixed-point (FastICA) algorithm is proposed for the case of linear and instantaneous mixture. Due to its quadratic dependence on the number of searched parameters, the main advantage of this new method consists in the significant decrement of computational speed, which is particularly striking with large number of samples. The method is essentially similar to the classical algorithm based on the Kurtosis contrast function, but differs in the fact that the reference-based idea is utilized. The validity of this new method was demonstrated by simulations

Convolutional Dictionary Learning through Tensor Factorization

Tensor methods have emerged as a powerful paradigm for consistent learning of many latent variable models such as topic models, independent component analysis and dictionary learning. Model parameters are estimated via CP decomposition of the observed higher order input moments. However, in many domains, additional invariances such as shift invariances exist, enforced via models such as convolutional dictionary learning. In this paper, we develop novel tensor decomposition algorithms for parameter estimation of convolutional models. Our algorithm is based on the popular alternating least squares method, but with efficient projections onto the space of stacked circulant matrices. Our method is embarrassingly parallel and consists of simple operations such as fast Fourier transforms and matrix multiplications. Our algorithm converges to the dictionary much faster and more accurately compared to the alternating minimization over filters and activation maps

Hybrid solutions to instantaneous MIMO blind separation and decoding: narrowband, QAM and square cases

Future wireless communication systems are desired to support high data rates and high quality transmission when considering the growing multimedia applications. Increasing the channel throughput leads to the multiple input and multiple output and blind equalization techniques in recent years. Thereby blind MIMO equalization has attracted a great interest.Both system performance and computational complexities play important roles in real time communications. Reducing the computational load and providing accurate performances are the main challenges in present systems. In this thesis, a hybrid method which can provide an affordable complexity with good performance for Blind Equalization in large constellation MIMO systems is proposed first. Saving computational cost happens both in the signal sep- aration part and in signal detection part. First, based on Quadrature amplitude modulation signal characteristics, an efficient and simple nonlinear function for the Independent Compo- nent Analysis is introduced. Second, using the idea of the sphere decoding, we choose the soft information of channels in a sphere, and overcome the so- called curse of dimensionality of the Expectation Maximization (EM) algorithm and enhance the final results simultaneously. Mathematically, we demonstrate in the digital communication cases, the EM algorithm shows Newton -like convergence.Despite the widespread use of forward -error coding (FEC), most multiple input multiple output (MIMO) blind channel estimation techniques ignore its presence, and instead make the sim- plifying assumption that the transmitted symbols are uncoded. However, FEC induces code structure in the transmitted sequence that can be exploited to improve blind MIMO channel estimates. In final part of this work, we exploit the iterative channel estimation and decoding performance for blind MIMO equalization. Experiments show the improvements achievable by exploiting the existence of coding structures and that it can access the performance of a BCJR equalizer with perfect channel information in a reasonable SNR range. All results are confirmed experimentally for the example of blind equalization in block fading MIMO systems

New Negentropy Optimization Schemes for Blind Signal Extraction of Complex Valued Sources

Blind signal extraction, a hot issue in the field of communication signal processing, aims to retrieve the sources through the optimization of contrast functions. Many contrasts based on higher-order statistics such as kurtosis, usually behave sensitive to outliers. Thus, to achieve robust results, nonlinear functions are utilized as contrasts to approximate the negentropy criterion, which is also a classical metric for non-Gaussianity. However, existing methods generally have a high computational cost, hence leading us to address the problem of efficient optimization of contrast function. More precisely, we design a novel “reference-based” contrast function based on negentropy approximations, and then propose a new family of algorithms (Alg.1 and Alg.2) to maximize it. Simulations confirm the convergence of our method to a separating solution, which is also analyzed in theory. We also validate the theoretic complexity analysis that Alg.2 has a much lower computational cost than Alg.1 and existing optimization methods based on negentropy criterion. Finally, experiments for the separation of single sideband signals illustrate that our method has good prospects in real-world applications

New kurtosis optimization schemes for MISO equalization

International audienceThis paper deals with efficient optimization of cumulant based contrast functions. Such a problem occurs in the blind source separation framework, where contrast functions are criteria to be maximized in order to retrieve the sources. More precisely, we focus on the extraction of one source signal and our method applies in deflation approaches, where the sources are extracted one by one. We propose new methods to maximize the kurtosis contrast function. These methods are intermediate between a gradient and an iterative "fixed-point" optimization of so-called reference contrasts. They rely on iterative updates of the parameters which monotonically increase the contrast function value: we point out the strong similarity with the Expectation-Maximization (EM) method and with recent generalizations referred to as Minimization-Maximization (MM). We also prove the global convergence of the algorithm to a stationary point. Simulations confirm the convergence of our methods to a separating solution. They also show experimentally that our methods have a much lower computational cost than former classical optimization methods. Finally, simulations suggest that the methods remain valid under weaker conditions than those required for proving convergence