Mixtures of independent component analyzers for EEG prediction

This paper presents a new application of independent component analysis mixture modeling (ICAMM) for prediction of electroencephalographic (EEG) signals. Demonstrations in prediction of missing EEG data in a working memory task using classic methods and an ICAMM-based algorithm are included. The performance of the methods is measured by using four error indicators: signal-to-interference (SIR) ratio, Kullback-Leibler divergence, correlation at lag zero and mean structural similarity index. The results show that the ICAMM-based algorithm outperforms the classical spherical splines method which is commonly used in EEG signal processing. Hence, the potential of using mixtures of independent component analyzers (ICAs) to improve prediction, as opposed on estimating only one ICA is demonstrated.This work has been supported by Generalitat Valenciana under grants PROMETEO/2010/040 and ISIC/2012/006Safont Armero, G.; Salazar Afanador, A.; Vergara Domínguez, L.; Gonzalez, A.; Vidal Maciá, AM. (2012). Mixtures of independent component analyzers for EEG prediction. En Green and smart technology with sensor applications. Springer Verlag (Germany). 338:328-335. doi:10.1007/978-3-642-35251-5_46S328335338Common, P., Jutten, C.: Handbook of Blind Source Separation: Independent Component Analysis and Applications. Academic Press, USA (2010)Salazar, A., Vergara, L., Serrano, A., Igual, J.: A general procedure for learning mixtures of independent component analyzers. Pattern Recognition 43(1), 69–85 (2010)Lee, T.W., Lewicki, M.S., Sejnowski, T.J.: ICA mixture models for unsupervised classification of non-gaussian classes and automatic context switching in blind signal separation. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(10), 1078–1089 (2000)Salazar, A., Vergara, L.: ICA mixtures applied to ultrasonic nondestructive classification of archaeological ceramics. Eurasip Journal on Advances in Signal Processing 2010, article ID 125201, 11 pages (2010), doi:10.1155/2010/125201Klein, C., Feige, B.: An independent component analysis (ICA) approach to the study of developmental differences in the saccadic contingent negative variation. Biological Psychology 70, 105–114 (2005)Makeig, S., Westerfield, M., Jung, T.P., Covington, J., Townsend, J., Sejnowski, T.J., Courchesne, E.: Functionally Independent Components of the Late Positive Event-Related Potential during Visual Spatial Attention. Journal of Neuroscience 19(7), 2665–2680 (1999)Wibral, M., Turi, G., Linden, D.E.J., Kaiser, J., Bledowski, C.: Decomposition of working memory-related scalp ERPs: Crossvalidation of fMRI-constrained source analysis and ICA. Internt J. of Psychol. 67, 200–211 (2008)Castellanos, N.P., Makarov, V.A.: Recovering EEG brain signals: Artifact suppression with wavelet enhanced independent component analysis. Journal of Neuroscience Methods 158, 300–312 (2006)Salazar, A., Vergara, L., Miralles, R.: On including sequential dependence in ICA mixture models. Signal Processing 90, 2314–2318 (2010)Dayan, P., Abbot, L.F.: Theoretical neuroscience: computational and mathematical modeling of neural systems. The MIT Press (2001)Sternberg, S.: High-speed scanning in human memory. Science 153(3736), 652–654 (1966)Raghavachari, S., Lisman, J.E., Tully, M., Madsen, J.R., Bromfield, E.B., Kahana, M.J.: Theta oscillations in human cortex during a working-memory task: evidence for local generators. J. of Neurophys. 95, 1630–1638 (2006)Gorriz, J.M., Puntonet, C.G., Salmeron, G., Lang, E.W.: Time series prediction using ICA algorithms. In: Proc. of 2nd IEEE Internat. W. on Intellig Data Acquisition and Advanc. Comp. Systems: Tech. and App., pp. 226–230 (2003)Lin, C.-T., Cheng, W.-C., Liang, S.-F.: An On-line ICA-Mixture-Model-Based Self-Constructing Fuzzy Neural Network. IEEE Transactions on Circuits and Systems I: Regular Papers 52(1), 207–221 (2005)Lee, T.W., Girolami, M., Sejnowski, T.J.: Independent component analysis using an extended InfoMax algorithm for mixed sub-gaussian and super-gaussian sources. Neural Computation 11(2), 417–441 (1999)Perrin, F., Pernier, J., Bertrand, D., Echallier, J.F.: Spherical splines for scalp potential and current density matching. Electroencep. and Clin. Neurophys. 72, 184–187 (1989)Wang, Z., Bovik, A., Sheikh, H., Simoncelli, E.: Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing 13(4), 600–612 (2004

Multispectral analysis of solar EUV images:linking temperature to morphology

Solar images taken simultaneously at different wavelengths in the EUV are widely used for understanding structures such as flares, coronal holes, loops, etc. The line-of-sight integration and the finite spectral resolution of EUV telescopes, however, hinders interpretation of these individual images in terms of temperature bands. Traditional approaches involve simple visualisation or explicit modelling. We take a more empirical approach, using statistical methods. The morphology of solar structures changes with the wavelength of observation and, therefore, with temperature. We explore the possibility of separating the different solar structures from a linear combination of images. Using a blind source separation approach, we build a new set of statistically independent "source" images from the original EUV images. Two techniques are compared: the singular value decomposition and independent component analysis. The source images show more contrast than the original ones, thereby easing the characterisation of morphological structures. A comparison with the differential emission measure shows that each source image also isolates structures with specific emission temperatures.Comment: 8 figures, to appear in A&

A stochastic algorithm for probabilistic independent component analysis

The decomposition of a sample of images on a relevant subspace is a recurrent problem in many different fields from Computer Vision to medical image analysis. We propose in this paper a new learning principle and implementation of the generative decomposition model generally known as noisy ICA (for independent component analysis) based on the SAEM algorithm, which is a versatile stochastic approximation of the standard EM algorithm. We demonstrate the applicability of the method on a large range of decomposition models and illustrate the developments with experimental results on various data sets.Comment: Published in at http://dx.doi.org/10.1214/11-AOAS499 the Annals of Applied Statistics (http://www.imstat.org/aoas/) by the Institute of Mathematical Statistics (http://www.imstat.org

Выделение скрытых областей слабоконтрастных изображений методом ортогональной декомпозиции

Рассмотрены информационные возможности метода анализа слабоконтрастных изображений. Суть метода основана на разделении анализируемых компонент многопараметрового (мультиспектрального) изображения на ортогональные составляющие, при этом в составляющих высокого порядка выделяются области, первоначально неразличимые на исходных изображениях. Представлены результаты численного моделирования и реальной проверки работоспособности метода.Розглянуто інформаційні можливості нового методу аналізу низькоконтрастних зображень. Суть методу полягає у розділенні аналізованих компонент багатопараметрового зображення на ортогональні складові, при цьому на складових більш високого порядку виділяються ділянки, невидимі на первісних зображеннях. Представлені результати реальної перевірки працездатності методу.Information possibilities of a new method low contrast images analysis are considered. The main idea of the method is founded on separation of analyzed image on orthogonal components. For solution of this problem in the article were used two approaches: the first one is based on using the singular value decomposition (it is an algebraic method) and the second one is based on independent component method. The last provides the stochastic orthogonalization. Hidden domains of analyzed image are separated on orthogonalyzed image of high order. The results of real testing of the method possibilities are presented. The ones had shown that both methods are complement each other

Image Decomposition and Separation Using Sparse Representations: An Overview

This paper gives essential insights into the use of sparsity and morphological diversity in image decomposition and source separation by reviewing our recent work in this field. The idea to morphologically decompose a signal into its building blocks is an important problem in signal processing and has far-reaching applications in science and technology. Starck , proposed a novel decomposition method—morphological component analysis (MCA)—based on sparse representation of signals. MCA assumes that each (monochannel) signal is the linear mixture of several layers, the so-called morphological components, that are morphologically distinct, e.g., sines and bumps. The success of this method relies on two tenets: sparsity and morphological diversity. That is, each morphological component is sparsely represented in a specific transform domain, and the latter is highly inefficient in representing the other content in the mixture. Once such transforms are identified, MCA is an iterative thresholding algorithm that is capable of decoupling the signal content. Sparsity and morphological diversity have also been used as a novel and effective source of diversity for blind source separation (BSS), hence extending the MCA to multichannel data. Building on these ingredients, we will provide an overview the generalized MCA introduced by the authors in and as a fast and efficient BSS method. We will illustrate the application of these algorithms on several real examples. We conclude our tour by briefly describing our software toolboxes made available for download on the Internet for sparse signal and image decomposition and separation

Multi-modal dictionary learning for image separation with application in art investigation

In support of art investigation, we propose a new source separation method that unmixes a single X-ray scan acquired from double-sided paintings. In this problem, the X-ray signals to be separated have similar morphological characteristics, which brings previous source separation methods to their limits. Our solution is to use photographs taken from the front and back-side of the panel to drive the separation process. The crux of our approach relies on the coupling of the two imaging modalities (photographs and X-rays) using a novel coupled dictionary learning framework able to capture both common and disparate features across the modalities using parsimonious representations; the common component models features shared by the multi-modal images, whereas the innovation component captures modality-specific information. As such, our model enables the formulation of appropriately regularized convex optimization procedures that lead to the accurate separation of the X-rays. Our dictionary learning framework can be tailored both to a single- and a multi-scale framework, with the latter leading to a significant performance improvement. Moreover, to improve further on the visual quality of the separated images, we propose to train coupled dictionaries that ignore certain parts of the painting corresponding to craquelure. Experimentation on synthetic and real data - taken from digital acquisition of the Ghent Altarpiece (1432) - confirms the superiority of our method against the state-of-the-art morphological component analysis technique that uses either fixed or trained dictionaries to perform image separation.Comment: submitted to IEEE Transactions on Images Processin