Behaviourally meaningful representations from normalisation and context-guided denoising

Many existing independent component analysis algorithms include a preprocessing stage where the inputs are sphered. This amounts to normalising the data such that all correlations between the variables are removed. In this work, I show that sphering allows very weak contextual modulation to steer the development of meaningful features. Context-biased competition has been proposed as a model of covert attention and I propose that sphering-like normalisation also allows weaker top-down bias to guide attention

Bi-Objective Nonnegative Matrix Factorization: Linear Versus Kernel-Based Models

Nonnegative matrix factorization (NMF) is a powerful class of feature extraction techniques that has been successfully applied in many fields, namely in signal and image processing. Current NMF techniques have been limited to a single-objective problem in either its linear or nonlinear kernel-based formulation. In this paper, we propose to revisit the NMF as a multi-objective problem, in particular a bi-objective one, where the objective functions defined in both input and feature spaces are taken into account. By taking the advantage of the sum-weighted method from the literature of multi-objective optimization, the proposed bi-objective NMF determines a set of nondominated, Pareto optimal, solutions instead of a single optimal decomposition. Moreover, the corresponding Pareto front is studied and approximated. Experimental results on unmixing real hyperspectral images confirm the efficiency of the proposed bi-objective NMF compared with the state-of-the-art methods

Parameterization and R-Peak Error Estimations of ECG Signals Using Independent Component Analysis

Principal component analysis (PCA) is used to reduce dimensionality of electrocardiogram (ECG) data prior to performing independent component analysis (ICA). A newly developed PCA variance estimator by the author has been applied for detecting true, actual and false peaks of ECG data files. In this paper, it is felt that the ability of ICA is also checked for parameterization of ECG signals, which is necessary at times. Independent components (ICs) of properly parameterized ECG signals are more readily interpretable than the measurements themselves, or their ICs. The original ECG recordings and the samples are corrected by statistical measures to estimate the noise statistics of ECG signals and find the reconstruction errors. The capability of ICA is justified by finding the true, false and actual peaks of around 25–50, CSE (common standards for electrocardiography) database ECG files. In the present work, joint approximation for diagonalization of the eigen matrices (Jade) algorithm is applied to 3-channel ECG. ICA processing of different cases is dealt with and the R-peak magnitudes of the ECG waveforms before and after applying ICA are found and marked. ICA results obtained indicate that in most of the cases, the percentage error in reconstruction is very small. The developed PCA variance estimator along with the quadratic spline wavelet gave a sensitivity of 97.47% before applying ICA and 98.07% after ICA processing

Blind audio-visual localization and separation via low-rank and sparsity

The ability to localize visual objects that are associated with an audio source and at the same time to separate the audio signal is a cornerstone in audio-visual signal-processing applications. However, available methods mainly focus on localizing only the visual objects, without audio separation abilities. Besides that, these methods often rely on either laborious preprocessing steps to segment video frames into semantic regions, or additional supervisions to guide their localization. In this paper, we aim to address the problem of visual source localization and audio separation in an unsupervised manner and avoid all preprocessing or post-processing steps. To this end, we devise a novel structured matrix decomposition method that decomposes the data matrix of each modality as a superposition of three terms: 1) a low-rank matrix capturing the background information; 2) a sparse matrix capturing the correlated components among the two modalities and, hence, uncovering the sound source in visual modality and the associated sound in audio modality; and 3) a third sparse matrix accounting for uncorrelated components, such as distracting objects in visual modality and irrelevant sound in audio modality. The generality of the proposed method is demonstrated by applying it onto three applications, namely: 1) visual localization of a sound source; 2) visually assisted audio separation; and 3) active speaker detection. Experimental results indicate the effectiveness of the proposed method on these application domains