Skip to main content
Article thumbnail
Location of Repository

Neural coding strategies and mechanisms of competition

By Dr M W Spratling and Prof M H Johnson

Abstract

A long running debate has concerned the question of whether neural representations are encoded using a distributed or a local coding scheme. In both schemes individual neurons respond to certain specific patterns of pre-synaptic activity. Hence, rather than being dichotomous, both coding schemes are based on the same representational mechanism. We argue that a population of neurons needs to be capable of learning both local and distributed representations, as appropriate to the task, and should be capable of generating both local and distributed codes in response to different stimuli. Many neural network algorithms, which are often employed as models of cognitive processes, fail to meet all these requirements. In contrast, we present a neural network architecture which enables a single algorithm to efficiently learn, and respond using, both types of coding scheme

Topics: Neural Modelling, Neural Nets
Year: 2004
OAI identifier: oai:cogprints.org:3541
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://cogprints.org/3541/1/co... (external link)
  • http://cogprints.org/3541/ (external link)
  • Suggested articles

    Citations

    1. (1989). Adaptive network for optimal linear feature extraction.
    2. (2000). An overview of hybrid neural systems.
    3. (1999). Artificial Ontogenesis: A Connectionist Model of Development.
    4. (1995). Behaviourist intelligence and the scaling problem.
    5. (1992). CALM: categorizing and learning module.
    6. (1986). Certain aspects of the anatomy and physiology of the cerebral cortex.
    7. (2001). Computation, reduction, and teleology of consciousness. doi
    8. (1990). Computational constraints on higher neural representations.
    9. (1990). Conditions for versatile learning, Helmholtz’s unconscious inference, and the task of perception.
    10. (2000). Connectionist modelling in psychology: a localist manifesto.
    11. (1994). Cooperative self-organization of afferent and lateral connections in cortical maps. doi
    12. (1998). Cortical plasticity in perceptual learning demonstrated by transcranial magnetic stimulation. doi
    13. (1999). Dendritic integration.
    14. (1995). Dendritic processing.
    15. (1999). Dendritic structure and spines. doi
    16. (1999). Distributed vs. local representation.
    17. (1997). Effect, number and location of synapses made by single pyramidal cells onto aspiny interneurones of cat visual cortex.
    18. (2000). Effects of visual experience on the representation of objects in the prefrontal cortex.
    19. (1996). Emergence of simple-cell receptive properties by learning sparse code for natural images.
    20. (1998). Excitable dendrites and spines: earlier theoretical insights elucidate recent direct observations. Trends in
    21. (1997). Fast IPSPs elicited via multiple synaptic release sites by different types of GABAergic neurone in the cat visual cortex.
    22. (1985). Feature discovery by competitive learning.
    23. (1990). Forming sparse representations by local anti-Hebbian learning.
    24. (1999). Hierarchical models of object recognition in cortex.
    25. (1970). Introduction to the Anatomy and Physiology of the Nervous System.
    26. (1998). Is there a neural code? doi
    27. (2000). Learning to find a shape.
    28. (1999). Learning to recognize objects.
    29. (1995). Localized versus distributed representations.
    30. (1987). Logic operations are properties of computer-simulated interactions between excitable dendritic spines.
    31. (1996). Natural image statistics and efficient coding.
    32. (1991). Nerve Cells and Nervous Systems: An Introduction to Neuroscience.
    33. (1992). Neural Computation and Self-Organizing Maps. An Introduction.
    34. (1996). Neural mechanisms for visual memory and their role in attention. doi
    35. (1989). Neural networks, principle components, and subspaces.
    36. (2000). Neural representation and the cortical code. Annual Review of Neuroscience,
    37. (2000). Neuronal mechanisms of selectivity for object features revealed by blocking inhibition in inferotemporal cortex.
    38. (1989). Optimal unsupervised learning in a single-layer linear feedforward neural network. Neural Networks,
    39. (1992). Organisation and functions of cells responsive to faces in the temporal cortex.
    40. (1998). Orientation tuning and receptive field structure in cat striate neurons during local blockade of intrcortical inhibition. doi
    41. (1998). Perceptual Neuroscience: The Cerebral Cortex.
    42. (2002). Pre-integration lateral inhibition enhances unsupervised learning. doi
    43. (1996). Re-presenting representation.
    44. (1996). Representation of visual feature objects in the inferotemporal cortex.
    45. (1995). Robust reasoning: integrating rule-based and similarity-based reasoning. doi
    46. (1973). Self-organisation of orientation sensitive cells in the striate cortex.
    47. (1995). Similarity, connectionism, and the problem of representation in vision. doi
    48. (1998). Six principles for biologically based computational models of cortical cognition.
    49. (1977). Storing covariance with nonlinearly interacting neurons.
    50. (1991). The animat path to AI.
    51. (1998). The effects of practice on the functional anatomy of task performance.
    52. (1995). The neuron doctrine in perception.
    53. (1992). The pyramidal neuron of the cerebral cortex: morphological and chemical characteristics of the synaptic inputs. doi
    54. (1990). The Synaptic Organization of the Brain.
    55. (1964). Theoretical significance of dendritic trees for neuronal input-output relations.
    56. (1997). Trading spaces: computation, representation and the limits of uninformed learning.
    57. (1997). Truth-from-trash learning and the mobot footballer.
    58. (1982). Two cortical visual systems.
    59. (1996). Unsupervised constructive learning.
    60. (1996). Using spatio-temporal correlations to learn invariant object recognition. doi
    61. (1996). View-dependent coding in the ventral stream and its consequences for recognition.
    62. (2001). Visual categorization shapes feature selectivity in the primate temporal cortex.
    63. (1998). Visual input evokes transient and strong shunting inhibition in visual cortical neurons.
    64. (1996). What and where in the human brain? evidence from functional brain imaging studies.
    65. (1994). What is the computational goal of the neocortex?
    66. (1994). What is the goal of sensory coding? doi

    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.