Sparse Component Analysis in Presence of Noise Using an Iterative EM-MAP Algorithm

Series: Lecture Notes in Computer Science Subseries: Information Systems and Applications, incl. Internet/Web, and HCI , Vol. 4666 Davies, M.E.; James, C.C.; Abdallah, S.A.; Plumbley, M.D. (Eds.) ISBN: 978-3-540-74493-1International audienceIn this paper, a new algorithm for source recovery in under-determined Sparse Component Analysis (SCA) or atomic decomposition on over-complete dictionaries is presented in the noisy case. The algorithm is essentially a method for obtaining sufficiently sparse solutions of under-determined systems of linear equations with additive Gaussian noise. The method is based on iterative Expectation-Maximization of a Maximum A Posteriori estimation of sources (EM-MAP) and a new steepest-descent method is introduced for the optimization in the M-step. The solution obtained by the proposed algorithm is compared to the minimum L1-norm solution achieved by Linear Programming (LP). It is experimentally shown that the proposed algorithm is about one order of magnitude faster than the interior-point LP method, while providing better accuracy