56 research outputs found
A bio-inspired image coder with temporal scalability
We present a novel bio-inspired and dynamic coding scheme for static images.
Our coder aims at reproducing the main steps of the visual stimulus processing
in the mammalian retina taking into account its time behavior. The main novelty
of this work is to show how to exploit the time behavior of the retina cells to
ensure, in a simple way, scalability and bit allocation. To do so, our main
source of inspiration will be the biologically plausible retina model called
Virtual Retina. Following a similar structure, our model has two stages. The
first stage is an image transform which is performed by the outer layers in the
retina. Here it is modelled by filtering the image with a bank of difference of
Gaussians with time-delays. The second stage is a time-dependent
analog-to-digital conversion which is performed by the inner layers in the
retina. Thanks to its conception, our coder enables scalability and bit
allocation across time. Also, our decoded images do not show annoying artefacts
such as ringing and block effects. As a whole, this article shows how to
capture the main properties of a biological system, here the retina, in order
to design a new efficient coder.Comment: 12 pages; Advanced Concepts for Intelligent Vision Systems (ACIVS
2011
The Temporal Winner-Take-All Readout
How can the central nervous system make accurate decisions about external stimuli
at short times on the basis of the noisy responses of nerve cell populations? It
has been suggested that spike time latency is the source of fast decisions.
Here, we propose a simple and fast readout mechanism, the temporal
Winner-Take-All (tWTA), and undertake a study of its accuracy. The tWTA is
studied in the framework of a statistical model for the dynamic response of a
nerve cell population to an external stimulus. Each cell is characterized by a
preferred stimulus, a unique value of the external stimulus for which it
responds fastest. The tWTA estimate for the stimulus is the preferred stimulus
of the cell that fired the first spike in the entire population. We then pose
the questions: How accurate is the tWTA readout? What are the parameters that
govern this accuracy? What are the effects of noise correlations and baseline
firing? We find that tWTA sensitivity to the stimulus grows algebraically fast
with the number of cells in the population, N, in contrast to
the logarithmic slow scaling of the conventional rate-WTA sensitivity with
N. Noise correlations in first-spike times of different
cells can limit the accuracy of the tWTA readout, even in the limit of large
N, similar to the effect that has been observed in
population coding theory. We show that baseline firing also has a detrimental
effect on tWTA accuracy. We suggest a generalization of the tWTA, the
n-tWTA, which estimates the stimulus by the identity of the
group of cells firing the first n spikes and show how this
simple generalization can overcome the detrimental effect of baseline firing.
Thus, the tWTA can provide fast and accurate responses discriminating between a
small number of alternatives. High accuracy in estimation of a continuous
stimulus can be obtained using the n-tWTA
Labels direct infants’ attention to commonalities during novel category learning
Recent studies have provided evidence that labeling can influence the outcome of infants’ visual categorization. However, what exactly happens during learning remains unclear. Using eye-tracking, we examined infants’ attention to object parts during learning. Our analysis of looking behaviors during learning provide insights going beyond merely observing the learning outcome. Both labeling and non-labeling phrases facilitated category formation in 12-month-olds but not 8-month-olds (Experiment 1). Non-linguistic sounds did not produce this effect (Experiment 2). Detailed analyses of infants’ looking patterns during learning revealed that only infants who heard labels exhibited a rapid focus on the object part successive exemplars had in common. Although other linguistic stimuli may also be beneficial for learning, it is therefore concluded that labels have a unique impact on categorization
Dynamical mean-field theory of spiking neuron ensembles: response to a single spike with independent noises
Dynamics of an ensemble of -unit FitzHugh-Nagumo (FN) neurons subject to
white noises has been studied by using a semi-analytical dynamical mean-field
(DMF) theory in which the original -dimensional {\it stochastic}
differential equations are replaced by 8-dimensional {\it deterministic}
differential equations expressed in terms of moments of local and global
variables. Our DMF theory, which assumes weak noises and the Gaussian
distribution of state variables, goes beyond weak couplings among constituent
neurons. By using the expression for the firing probability due to an applied
single spike, we have discussed effects of noises, synaptic couplings and the
size of the ensemble on the spike timing precision, which is shown to be
improved by increasing the size of the neuron ensemble, even when there are no
couplings among neurons. When the coupling is introduced, neurons in ensembles
respond to an input spike with a partial synchronization. DMF theory is
extended to a large cluster which can be divided into multiple sub-clusters
according to their functions. A model calculation has shown that when the noise
intensity is moderate, the spike propagation with a fairly precise timing is
possible among noisy sub-clusters with feed-forward couplings, as in the
synfire chain. Results calculated by our DMF theory are nicely compared to
those obtained by direct simulations. A comparison of DMF theory with the
conventional moment method is also discussed.Comment: 29 pages, 2 figures; augmented the text and added Appendice
Spatial representation of temporal information through spike timing dependent plasticity
We suggest a mechanism based on spike time dependent plasticity (STDP) of
synapses to store, retrieve and predict temporal sequences. The mechanism is
demonstrated in a model system of simplified integrate-and-fire type neurons
densely connected by STDP synapses. All synapses are modified according to the
so-called normal STDP rule observed in various real biological synapses. After
conditioning through repeated input of a limited number of of temporal
sequences the system is able to complete the temporal sequence upon receiving
the input of a fraction of them. This is an example of effective unsupervised
learning in an biologically realistic system. We investigate the dependence of
learning success on entrainment time, system size and presence of noise.
Possible applications include learning of motor sequences, recognition and
prediction of temporal sensory information in the visual as well as the
auditory system and late processing in the olfactory system of insects.Comment: 13 pages, 14 figures, completely revised and augmented versio
Stochastic Resonance of Ensemble Neurons for Transient Spike Trains: A Wavelet Analysis
By using the wavelet transformation (WT), we have analyzed the response of an
ensemble of (=1, 10, 100 and 500) Hodgkin-Huxley (HH) neurons to {\it
transient} -pulse spike trains () with independent Gaussian noises.
The cross-correlation between the input and output signals is expressed in
terms of the WT expansion coefficients. The signal-to-noise ratio (SNR) is
evaluated by using the {\it denoising} method within the WT, by which the noise
contribution is extracted from output signals. Although the response of a
single (N=1) neuron to sub-threshold transient signals with noises is quite
unreliable, the transmission fidelity assessed by the cross-correlation and SNR
is shown to be much improved by increasing the value of : a population of
neurons play an indispensable role in the stochastic resonance (SR) for
transient spike inputs. It is also shown that in a large-scale ensemble, the
transmission fidelity for supra-threshold transient spikes is not significantly
degraded by a weak noise which is responsible to SR for sub-threshold inputs.Comment: 20 pages, 4 figure
Representation of Time-Varying Stimuli by a Network Exhibiting Oscillations on a Faster Time Scale
Sensory processing is associated with gamma frequency oscillations (30–80 Hz) in sensory cortices. This raises the question whether gamma oscillations can be directly involved in the representation of time-varying stimuli, including stimuli whose time scale is longer than a gamma cycle. We are interested in the ability of the system to reliably distinguish different stimuli while being robust to stimulus variations such as uniform time-warp. We address this issue with a dynamical model of spiking neurons and study the response to an asymmetric sawtooth input current over a range of shape parameters. These parameters describe how fast the input current rises and falls in time. Our network consists of inhibitory and excitatory populations that are sufficient for generating oscillations in the gamma range. The oscillations period is about one-third of the stimulus duration. Embedded in this network is a subpopulation of excitatory cells that respond to the sawtooth stimulus and a subpopulation of cells that respond to an onset cue. The intrinsic gamma oscillations generate a temporally sparse code for the external stimuli. In this code, an excitatory cell may fire a single spike during a gamma cycle, depending on its tuning properties and on the temporal structure of the specific input; the identity of the stimulus is coded by the list of excitatory cells that fire during each cycle. We quantify the properties of this representation in a series of simulations and show that the sparseness of the code makes it robust to uniform warping of the time scale. We find that resetting of the oscillation phase at stimulus onset is important for a reliable representation of the stimulus and that there is a tradeoff between the resolution of the neural representation of the stimulus and robustness to time-warp.
Author Summary
Sensory processing of time-varying stimuli, such as speech, is associated with high-frequency oscillatory cortical activity, the functional significance of which is still unknown. One possibility is that the oscillations are part of a stimulus-encoding mechanism. Here, we investigate a computational model of such a mechanism, a spiking neuronal network whose intrinsic oscillations interact with external input (waveforms simulating short speech segments in a single acoustic frequency band) to encode stimuli that extend over a time interval longer than the oscillation's period. The network implements a temporally sparse encoding, whose robustness to time warping and neuronal noise we quantify. To our knowledge, this study is the first to demonstrate that a biophysically plausible model of oscillations occurring in the processing of auditory input may generate a representation of signals that span multiple oscillation cycles.National Science Foundation (DMS-0211505); Burroughs Wellcome Fund; U.S. Air Force Office of Scientific Researc
Coding “What” and “When” in the Archer Fish Retina
Traditionally, the information content of the neural response is quantified using statistics of the responses relative to stimulus onset time with the assumption that the brain uses onset time to infer stimulus identity. However, stimulus onset time must also be estimated by the brain, making the utility of such an approach questionable. How can stimulus onset be estimated from the neural responses with sufficient accuracy to ensure reliable stimulus identification? We address this question using the framework of colour coding by the archer fish retinal ganglion cell. We found that stimulus identity, “what”, can be estimated from the responses of best single cells with an accuracy comparable to that of the animal's psychophysical estimation. However, to extract this information, an accurate estimation of stimulus onset is essential. We show that stimulus onset time, “when”, can be estimated using a linear-nonlinear readout mechanism that requires the response of a population of 100 cells. Thus, stimulus onset time can be estimated using a relatively simple readout. However, large nerve cell populations are required to achieve sufficient accuracy
The Timing of the Cognitive Cycle
We propose that human cognition consists of cascading cycles of recurring brain
events. Each cognitive cycle senses the current situation, interprets it with
reference to ongoing goals, and then selects an internal or external action in
response. While most aspects of the cognitive cycle are unconscious, each cycle
also yields a momentary “ignition” of conscious broadcasting.
Neuroscientists have independently proposed ideas similar to the cognitive
cycle, the fundamental hypothesis of the LIDA model of cognition. High-level
cognition, such as deliberation, planning, etc., is typically enabled by
multiple cognitive cycles. In this paper we describe a timing model LIDA's
cognitive cycle. Based on empirical and simulation data we propose that an
initial phase of perception (stimulus recognition) occurs 80–100 ms from
stimulus onset under optimal conditions. It is followed by a conscious episode
(broadcast) 200–280 ms after stimulus onset, and an action selection phase
60–110 ms from the start of the conscious phase. One cognitive cycle would
therefore take 260–390 ms. The LIDA timing model is consistent with brain
evidence indicating a fundamental role for a theta-gamma wave, spreading forward
from sensory cortices to rostral corticothalamic regions. This posteriofrontal
theta-gamma wave may be experienced as a conscious perceptual event starting at
200–280 ms post stimulus. The action selection component of the cycle is
proposed to involve frontal, striatal and cerebellar regions. Thus the cycle is
inherently recurrent, as the anatomy of the thalamocortical system suggests. The
LIDA model fits a large body of cognitive and neuroscientific evidence. Finally,
we describe two LIDA-based software agents: the LIDA Reaction Time agent that
simulates human performance in a simple reaction time task, and the LIDA Allport
agent which models phenomenal simultaneity within timeframes comparable to human
subjects. While there are many models of reaction time performance, these
results fall naturally out of a biologically and computationally plausible
cognitive architecture
Distributed processing and temporal codes in neuronal networks
The cerebral cortex presents itself as a distributed dynamical system with the characteristics of a small world network. The neuronal correlates of cognitive and executive processes often appear to consist of the coordinated activity of large assemblies of widely distributed neurons. These features require mechanisms for the selective routing of signals across densely interconnected networks, the flexible and context dependent binding of neuronal groups into functionally coherent assemblies and the task and attention dependent integration of subsystems. In order to implement these mechanisms, it is proposed that neuronal responses should convey two orthogonal messages in parallel. They should indicate (1) the presence of the feature to which they are tuned and (2) with which other neurons (specific target cells or members of a coherent assembly) they are communicating. The first message is encoded in the discharge frequency of the neurons (rate code) and it is proposed that the second message is contained in the precise timing relationships between individual spikes of distributed neurons (temporal code). It is further proposed that these precise timing relations are established either by the timing of external events (stimulus locking) or by internal timing mechanisms. The latter are assumed to consist of an oscillatory modulation of neuronal responses in different frequency bands that cover a broad frequency range from <2 Hz (delta) to >40 Hz (gamma) and ripples. These oscillations limit the communication of cells to short temporal windows whereby the duration of these windows decreases with oscillation frequency. Thus, by varying the phase relationship between oscillating groups, networks of functionally cooperating neurons can be flexibly configurated within hard wired networks. Moreover, by synchronizing the spikes emitted by neuronal populations, the saliency of their responses can be enhanced due to the coincidence sensitivity of receiving neurons in very much the same way as can be achieved by increasing the discharge rate. Experimental evidence will be reviewed in support of the coexistence of rate and temporal codes. Evidence will also be provided that disturbances of temporal coding mechanisms are likely to be one of the pathophysiological mechanisms in schizophrenia
- …