2,347 research outputs found
Prospective Coding by Spiking Neurons
Animals learn to make predictions, such as associating the sound of a bell with upcoming feeding or predicting a movement that a motor command is eliciting. How predictions are realized on the neuronal level and what plasticity rule underlies their learning is not well understood. Here we propose a biologically plausible synaptic plasticity rule to learn predictions on a single neuron level on a timescale of seconds. The learning rule allows a spiking two-compartment neuron to match its current firing rate to its own expected future discounted firing rate. For instance, if an originally neutral event is repeatedly followed by an event that elevates the firing rate of a neuron, the originally neutral event will eventually also elevate the neuron's firing rate. The plasticity rule is a form of spike timing dependent plasticity in which a presynaptic spike followed by a postsynaptic spike leads to potentiation. Even if the plasticity window has a width of 20 milliseconds, associations on the time scale of seconds can be learned. We illustrate prospective coding with three examples: learning to predict a time varying input, learning to predict the next stimulus in a delayed paired-associate task and learning with a recurrent network to reproduce a temporally compressed version of a sequence. We discuss the potential role of the learning mechanism in classical trace conditioning. In the special case that the signal to be predicted encodes reward, the neuron learns to predict the discounted future reward and learning is closely related to the temporal difference learning algorithm TD(λ)
Real time unsupervised learning of visual stimuli in neuromorphic VLSI systems
Neuromorphic chips embody computational principles operating in the nervous
system, into microelectronic devices. In this domain it is important to
identify computational primitives that theory and experiments suggest as
generic and reusable cognitive elements. One such element is provided by
attractor dynamics in recurrent networks. Point attractors are equilibrium
states of the dynamics (up to fluctuations), determined by the synaptic
structure of the network; a `basin' of attraction comprises all initial states
leading to a given attractor upon relaxation, hence making attractor dynamics
suitable to implement robust associative memory. The initial network state is
dictated by the stimulus, and relaxation to the attractor state implements the
retrieval of the corresponding memorized prototypical pattern. In a previous
work we demonstrated that a neuromorphic recurrent network of spiking neurons
and suitably chosen, fixed synapses supports attractor dynamics. Here we focus
on learning: activating on-chip synaptic plasticity and using a theory-driven
strategy for choosing network parameters, we show that autonomous learning,
following repeated presentation of simple visual stimuli, shapes a synaptic
connectivity supporting stimulus-selective attractors. Associative memory
develops on chip as the result of the coupled stimulus-driven neural activity
and ensuing synaptic dynamics, with no artificial separation between learning
and retrieval phases.Comment: submitted to Scientific Repor
Supervised Associative Learning in Spiking Neural Network
In this paper, we propose a simple supervised associative learning approach for spiking neural networks. In an excitatory-inhibitory network paradigm with Izhikevich spiking neurons, synaptic plasticity is implemented on excitatory to excitatory synapses dependent on both spike emission rates and spike timings. As results of learning, the network is able to associate not just familiar stimuli but also novel stimuli observed through synchronised activity within the same subpopulation and between two associated subpopulations
Linking Cellular Mechanisms to Behavior: Entorhinal Persistent Spiking and Membrane Potential Oscillations May Underlie Path Integration, Grid Cell Firing, and Episodic Memory
The entorhinal cortex plays an important role in spatial memory and episodic memory functions. These functions may result from cellular mechanisms for integration of the afferent input to entorhinal cortex. This article reviews physiological data on persistent spiking and membrane potential oscillations in entorhinal cortex then presents models showing how both these cellular mechanisms could contribute to properties observed during unit recording, including grid cell firing, and how they could underlie behavioural functions including path integration. The interaction of oscillations and persistent firing could contribute to encoding and retrieval of trajectories through space and time as a mechanism relevant to episodic memory.Silvio O. Conte Center (NIMH MH71702, MH60450); National Institute of Mental Health Research (MH60013, MH61492); National Science Foundation (SLC SBE 0354378); National Institute of Drug Abuse (DA16454)
Reading the Neural Code: What do Spikes Mean for Behavior?
The present study reveals the existence of an intrinsic spatial code within neuronal spikes that predicts behavior. As rats learnt a T-maze procedural task, simultaneous changes in temporal occurrence of spikes and spike directivity are evidenced in “expert” neurons. While the number of spikes between the tone delivery and the beginning of turn phase reduced with learning, the generated spikes between these two events acquired behavioral meaning that is of highest value for action selection. Spike directivity is thus a hidden feature that reveals the semantics of each spike and in the current experiment, predicts the correct turn that the animal would subsequently make to obtain reward. Semantic representation of behavior can then be revealed as modulations in spike directivity during the time. This predictability of observed behavior based on subtle changes in spike directivity represents an important step towards reading and understanding the underlying neural code
Dwelling Quietly in the Rich Club: Brain Network Determinants of Slow Cortical Fluctuations
For more than a century, cerebral cartography has been driven by
investigations of structural and morphological properties of the brain across
spatial scales and the temporal/functional phenomena that emerge from these
underlying features. The next era of brain mapping will be driven by studies
that consider both of these components of brain organization simultaneously --
elucidating their interactions and dependencies. Using this guiding principle,
we explored the origin of slowly fluctuating patterns of synchronization within
the topological core of brain regions known as the rich club, implicated in the
regulation of mood and introspection. We find that a constellation of densely
interconnected regions that constitute the rich club (including the anterior
insula, amygdala, and precuneus) play a central role in promoting a stable,
dynamical core of spontaneous activity in the primate cortex. The slow time
scales are well matched to the regulation of internal visceral states,
corresponding to the somatic correlates of mood and anxiety. In contrast, the
topology of the surrounding "feeder" cortical regions show unstable, rapidly
fluctuating dynamics likely crucial for fast perceptual processes. We discuss
these findings in relation to psychiatric disorders and the future of
connectomics.Comment: 35 pages, 6 figure
- …