Skip to main content
Article thumbnail
Location of Repository

Independent component analysis in spiking neurons

By Cristina Savin, Prashant Joshi and Jochen Triesch

Abstract

Although models based on independent component analysis (ICA) have been successful in explaining various properties of sensory coding in the cortex, it remains unclear how networks of spiking neurons using realistic plasticity rules can realize such computation. Here, we propose a biologically plausible mechanism for ICA-like learning with spiking neurons. Our model combines spike-timing dependent plasticity and synaptic scaling with an intrinsic plasticity rule that regulates neuronal excitability to maximize information transmission. We show that a stochastically spiking neuron learns one independent component for inputs encoded either as rates or using spike-spike correlations. Furthermore, different independent components can be recovered, when the activity of different neurons is decorrelated by adaptive lateral inhibition

Topics: ddc:150
Year: 2010
OAI identifier: oai:publikationen.ub.uni-frankfurt.de:20111

Suggested articles

Citations

  1. (2009). A
  2. (1996). A neuronal learning rule for sub-millisecond temporal coding.
  3. (2006). A simple Hebbian/anti-Hebbian network learns the sparse, independent components of natural images.
  4. (2008). A sparse generative model of V1 simple cells with intrinsic plasticity.
  5. (2000). Competitive Hebbian learning through spiketiming-dependent synaptic plasticity.
  6. (2010). Connectivity reflects coding: a model of voltage-based stdp with homeostasis.
  7. (1996). Emergence of simple-cell receptive field properties by learning a sparse code for natural images.
  8. (1990). Forming sparse representations by local anti-Hebbian learning.
  9. (2005). Generalized BienenstockCooper-Munro rule for spiking neurons that maximizes information transmission.
  10. (2009). Generating spike trains with specified correlation coefficients.
  11. (2004). Homeostatic plasticity in the developing nervous system.
  12. (1999). How voltage-dependent conductances can adapt to maximize the information encoded by neuronal firing rate.
  13. (1997). Hyva ¨rinen A
  14. (2001). Independent Component Analysis.
  15. (1998). Independent component filters of natural images compared with simple cells in primary visual cortex.
  16. (2007). Learning sensory representations with intrinsic plasticity.
  17. (2004). Long-term potentiation of intrinsic excitability in LV visual cortical neurons.
  18. (2008). Maximal causes for non-linear component extraction.
  19. (1990). Maximum Entropy Models in Science and Engineering WileyInterscience.
  20. (2001). Natural image statistics and neural representation.
  21. (2001). Natural image statistics and neural representations.
  22. (1998). Neuronal goals: efficient coding and coincidence detection.
  23. (1992). Objective function formulation of the BCM theory of visual cortical plasticity: Statistical connections, stability conditions.
  24. (1985). Projection pursuit.
  25. (1998). Receptive field formation in natural scene environments: comparison of single cell learning rules.
  26. (2009). Receptive field self-organization in a model of the fine-structure in V1 cortical columns.
  27. (2001). Redundancy reduction revisited.
  28. (1997). Regulation of synaptic efficacy by coincidence of postsynaptic APS and EPSPS.
  29. (2003). Relating STDP to BCM.
  30. (1997). Responses of neurons in primary and inferior temporal visual cortices to natural scenes.
  31. (2009). Rules for information-maximization in spiking neurons using intrinsic plasticity. In:
  32. (1955). Some statistical methods connected with series of events.
  33. (2004). Sparse coding of sensory inputs.
  34. (1997). Sparse coding with an overcomplete basis set: A strategy employed by V1?
  35. (2009). Spiking neurons can learn to solve information bottleneck problems and extract independent components.
  36. (1998). Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type.
  37. (2007). Synergies between intrinsic and synaptic plasticity mechanisms.
  38. (2003). The cost of neural computation.
  39. (1997). The independent components of natural scenes are edge filters.
  40. (1997). The nonlinear PCA learning rule in independent component analysis.
  41. (2003). The other side of the engram: experience-dependent changes in neuronal intrinsic excitability.
  42. (2004). The role of fixational eye movements in visual perception.
  43. (1982). Theory for the development of neuron selectivity: Orientation specificity and binocular interactions in visual cortex.
  44. (2006). Triplets of spikes in a model of spike timingdependent plasticity.
  45. (2003). Vision and the statistics of the visual environment.

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.