1,344,941 research outputs found
Statistical physics of independent component analysis
Statistical physics is used to investigate independent component analysis
with polynomial contrast functions. While the replica method fails, an adapted
cavity approach yields valid results. The learning curves, obtained in a
suitable thermodynamic limit, display a first order phase transition from poor
to perfect generalization.Comment: 7 pages, 1 figure, to appear in Europhys. Lett
A Tutorial on Independent Component Analysis
Independent component analysis (ICA) has become a standard data analysis
technique applied to an array of problems in signal processing and machine
learning. This tutorial provides an introduction to ICA based on linear algebra
formulating an intuition for ICA from first principles. The goal of this
tutorial is to provide a solid foundation on this advanced topic so that one
might learn the motivation behind ICA, learn why and when to apply this
technique and in the process gain an introduction to this exciting field of
active research
Robust Independent Component Analysis via Minimum Divergence Estimation
Independent component analysis (ICA) has been shown to be useful in many
applications. However, most ICA methods are sensitive to data contamination and
outliers. In this article we introduce a general minimum U-divergence framework
for ICA, which covers some standard ICA methods as special cases. Within the
U-family we further focus on the gamma-divergence due to its desirable property
of super robustness, which gives the proposed method gamma-ICA. Statistical
properties and technical conditions for the consistency of gamma-ICA are
rigorously studied. In the limiting case, it leads to a necessary and
sufficient condition for the consistency of MLE-ICA. This necessary and
sufficient condition is weaker than the condition known in the literature.
Since the parameter of interest in ICA is an orthogonal matrix, a geometrical
algorithm based on gradient flows on special orthogonal group is introduced to
implement gamma-ICA. Furthermore, a data-driven selection for the gamma value,
which is critical to the achievement of gamma-ICA, is developed. The
performance, especially the robustness, of gamma-ICA in comparison with
standard ICA methods is demonstrated through experimental studies using
simulated data and image data.Comment: 7 figure
- …