3,728 research outputs found
Competition through selective inhibitory synchrony
Models of cortical neuronal circuits commonly depend on inhibitory feedback
to control gain, provide signal normalization, and to selectively amplify
signals using winner-take-all (WTA) dynamics. Such models generally assume that
excitatory and inhibitory neurons are able to interact easily, because their
axons and dendrites are co-localized in the same small volume. However,
quantitative neuroanatomical studies of the dimensions of axonal and dendritic
trees of neurons in the neocortex show that this co-localization assumption is
not valid. In this paper we describe a simple modification to the WTA circuit
design that permits the effects of distributed inhibitory neurons to be coupled
through synchronization, and so allows a single WTA to be distributed widely in
cortical space, well beyond the arborization of any single inhibitory neuron,
and even across different cortical areas. We prove by non-linear contraction
analysis, and demonstrate by simulation that distributed WTA sub-systems
combined by such inhibitory synchrony are inherently stable. We show
analytically that synchronization is substantially faster than winner
selection. This circuit mechanism allows networks of independent WTAs to fully
or partially compete with each other.Comment: in press at Neural computation; 4 figure
Integrate and Fire Neural Networks, Piecewise Contractive Maps and Limit Cycles
We study the global dynamics of integrate and fire neural networks composed
of an arbitrary number of identical neurons interacting by inhibition and
excitation. We prove that if the interactions are strong enough, then the
support of the stable asymptotic dynamics consists of limit cycles. We also
find sufficient conditions for the synchronization of networks containing
excitatory neurons. The proofs are based on the analysis of the equivalent
dynamics of a piecewise continuous Poincar\'e map associated to the system. We
show that for strong interactions the Poincar\'e map is piecewise contractive.
Using this contraction property, we prove that there exist a countable number
of limit cycles attracting all the orbits dropping into the stable subset of
the phase space. This result applies not only to the Poincar\'e map under
study, but also to a wide class of general n-dimensional piecewise contractive
maps.Comment: 46 pages. In this version we added many comments suggested by the
referees all along the paper, we changed the introduction and the section
containing the conclusions. The final version will appear in Journal of
Mathematical Biology of SPRINGER and will be available at
http://www.springerlink.com/content/0303-681
Synchronization and Redundancy: Implications for Robustness of Neural Learning and Decision Making
Learning and decision making in the brain are key processes critical to
survival, and yet are processes implemented by non-ideal biological building
blocks which can impose significant error. We explore quantitatively how the
brain might cope with this inherent source of error by taking advantage of two
ubiquitous mechanisms, redundancy and synchronization. In particular we
consider a neural process whose goal is to learn a decision function by
implementing a nonlinear gradient dynamics. The dynamics, however, are assumed
to be corrupted by perturbations modeling the error which might be incurred due
to limitations of the biology, intrinsic neuronal noise, and imperfect
measurements. We show that error, and the associated uncertainty surrounding a
learned solution, can be controlled in large part by trading off
synchronization strength among multiple redundant neural systems against the
noise amplitude. The impact of the coupling between such redundant systems is
quantified by the spectrum of the network Laplacian, and we discuss the role of
network topology in synchronization and in reducing the effect of noise. A
range of situations in which the mechanisms we model arise in brain science are
discussed, and we draw attention to experimental evidence suggesting that
cortical circuits capable of implementing the computations of interest here can
be found on several scales. Finally, simulations comparing theoretical bounds
to the relevant empirical quantities show that the theoretical estimates we
derive can be tight.Comment: Preprint, accepted for publication in Neural Computatio
Complete synchronization in coupled Type-I neurons
For a system of type-I neurons bidirectionally coupled through a nonlinear
feedback mechanism, we discuss the issue of noise-induced complete
synchronization (CS). For the inputs to the neurons, we point out that the rate
of change of instantaneous frequency with the instantaneous phase of the
stochastic inputs to each neuron matches exactly with that for the other in the
event of CS of their outputs. Our observation can be exploited in practical
situations to produce completely synchronized outputs in artificial devices.
For excitatory-excitatory synaptic coupling, a functional dependence for the
synchronization error on coupling and noise strengths is obtained. Finally we
report an observation of noise-induced CS between non-identical neurons coupled
bidirectionally through random non-zero couplings in an all-to- all way in a
large neuronal ensemble.Comment: 24 pages, 9 figure
Collective stability of networks of winner-take-all circuits
The neocortex has a remarkably uniform neuronal organization, suggesting that
common principles of processing are employed throughout its extent. In
particular, the patterns of connectivity observed in the superficial layers of
the visual cortex are consistent with the recurrent excitation and inhibitory
feedback required for cooperative-competitive circuits such as the soft
winner-take-all (WTA). WTA circuits offer interesting computational properties
such as selective amplification, signal restoration, and decision making. But,
these properties depend on the signal gain derived from positive feedback, and
so there is a critical trade-off between providing feedback strong enough to
support the sophisticated computations, while maintaining overall circuit
stability. We consider the question of how to reason about stability in very
large distributed networks of such circuits. We approach this problem by
approximating the regular cortical architecture as many interconnected
cooperative-competitive modules. We demonstrate that by properly understanding
the behavior of this small computational module, one can reason over the
stability and convergence of very large networks composed of these modules. We
obtain parameter ranges in which the WTA circuit operates in a high-gain
regime, is stable, and can be aggregated arbitrarily to form large stable
networks. We use nonlinear Contraction Theory to establish conditions for
stability in the fully nonlinear case, and verify these solutions using
numerical simulations. The derived bounds allow modes of operation in which the
WTA network is multi-stable and exhibits state-dependent persistent activities.
Our approach is sufficiently general to reason systematically about the
stability of any network, biological or technological, composed of networks of
small modules that express competition through shared inhibition.Comment: 7 Figure
- …