Behaviourally meaningful representations from normalisation and context-guided denoising

Many existing independent component analysis algorithms include a preprocessing stage where the inputs are sphered. This amounts to normalising the data such that all correlations between the variables are removed. In this work, I show that sphering allows very weak contextual modulation to steer the development of meaningful features. Context-biased competition has been proposed as a model of covert attention and I propose that sphering-like normalisation also allows weaker top-down bias to guide attention

Representation Learning: A Review and New Perspectives

The success of machine learning algorithms generally depends on data representation, and we hypothesize that this is because different representations can entangle and hide more or less the different explanatory factors of variation behind the data. Although specific domain knowledge can be used to help design representations, learning with generic priors can also be used, and the quest for AI is motivating the design of more powerful representation-learning algorithms implementing such priors. This paper reviews recent work in the area of unsupervised feature learning and deep learning, covering advances in probabilistic models, auto-encoders, manifold learning, and deep networks. This motivates longer-term unanswered questions about the appropriate objectives for learning good representations, for computing representations (i.e., inference), and the geometrical connections between representation learning, density estimation and manifold learning

Neural networks and separation of Cosmic Microwave Background and astrophysical signals in sky maps

The Independent Component Analysis (ICA) algorithm is implemented as a neural network for separating signals of different origin in astrophysical sky maps. Due to its self-organizing capability, it works without prior assumptions on the signals, neither on their frequency scaling, nor on the signal maps themselves; instead, it learns directly from the input data how to separate the physical components, making use of their statistical independence. To test the capabilities of this approach, we apply the ICA algorithm on sky patches, taken from simulations and observations, at the microwave frequencies, that are going to be deeply explored in a few years on the whole sky, by the Microwave Anisotropy Probe (MAP) and by the {\sc Planck} Surveyor Satellite. The maps are at the frequencies of the Low Frequency Instrument (LFI) aboard the {\sc Planck} satellite (30, 44, 70 and 100 GHz), and contain simulated astrophysical radio sources, Cosmic Microwave Background (CMB) radiation, and Galactic diffuse emissions from thermal dust and synchrotron. We show that the ICA algorithm is able to recover each signal, with precision going from 10% for the Galactic components to percent for CMB; radio sources are almost completely recovered down to a flux limit corresponding to $0.7\sigma_{CMB}$, where $\sigma_{CMB}$ is the rms level of CMB fluctuations. The signal recovering possesses equal quality on all the scales larger then the pixel size. In addition, we show that the frequency scalings of the input signals can be partially inferred from the ICA outputs, at the percent precision for the dominant components, radio sources and CMB.Comment: 15 pages; 6 jpg and 1 ps figures. Final version to be published in MNRA

Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches

Imaging spectrometers measure electromagnetic energy scattered in their instantaneous field view in hundreds or thousands of spectral channels with higher spectral resolution than multispectral cameras. Imaging spectrometers are therefore often referred to as hyperspectral cameras (HSCs). Higher spectral resolution enables material identification via spectroscopic analysis, which facilitates countless applications that require identifying materials in scenarios unsuitable for classical spectroscopic analysis. Due to low spatial resolution of HSCs, microscopic material mixing, and multiple scattering, spectra measured by HSCs are mixtures of spectra of materials in a scene. Thus, accurate estimation requires unmixing. Pixels are assumed to be mixtures of a few materials, called endmembers. Unmixing involves estimating all or some of: the number of endmembers, their spectral signatures, and their abundances at each pixel. Unmixing is a challenging, ill-posed inverse problem because of model inaccuracies, observation noise, environmental conditions, endmember variability, and data set size. Researchers have devised and investigated many models searching for robust, stable, tractable, and accurate unmixing algorithms. This paper presents an overview of unmixing methods from the time of Keshava and Mustard's unmixing tutorial [1] to the present. Mixing models are first discussed. Signal-subspace, geometrical, statistical, sparsity-based, and spatial-contextual unmixing algorithms are described. Mathematical problems and potential solutions are described. Algorithm characteristics are illustrated experimentally.Comment: This work has been accepted for publication in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensin

Image Contrast Enhancement with Brightness preserving using Curvelet Transform and Multilayer Perceptron

Image Improvement Techniques Are Veryuseful In Our Daily Routine. In The Field Ofimage Enhancement Histogram Equalizationis A Very Powerful, Effective And Simplemethod. But In Histogram Equalizationmethod The Brightness Will Disturb Whileprocessing. Original Image Brightnessshould Be Kept In The Processed Image. Soimage Contrast Must Be Enhanced Withoutchanging Brightness Of Input Image. In Ourproposed Method Of Image Contrastenhancement With Brightness Preservingusing Curvelet Transform And Multilayerperceptron We Will Solve This Problem Andget Better Result Than Existing Methods.Results Are Compared On The Basis Of Twoimportant Parameter For Image Quality Suchas Absolute Mean Brightness Error (Ambe)And Peak Signal To Noise Ratio (Psnr)