3,376 research outputs found
Spiking Neural Networks for Inference and Learning: A Memristor-based Design Perspective
On metrics of density and power efficiency, neuromorphic technologies have
the potential to surpass mainstream computing technologies in tasks where
real-time functionality, adaptability, and autonomy are essential. While
algorithmic advances in neuromorphic computing are proceeding successfully, the
potential of memristors to improve neuromorphic computing have not yet born
fruit, primarily because they are often used as a drop-in replacement to
conventional memory. However, interdisciplinary approaches anchored in machine
learning theory suggest that multifactor plasticity rules matching neural and
synaptic dynamics to the device capabilities can take better advantage of
memristor dynamics and its stochasticity. Furthermore, such plasticity rules
generally show much higher performance than that of classical Spike Time
Dependent Plasticity (STDP) rules. This chapter reviews the recent development
in learning with spiking neural network models and their possible
implementation with memristor-based hardware
Exact computation of the Maximum Entropy Potential of spiking neural networks models
Understanding how stimuli and synaptic connectivity in uence the statistics
of spike patterns in neural networks is a central question in computational
neuroscience. Maximum Entropy approach has been successfully used to
characterize the statistical response of simultaneously recorded spiking
neurons responding to stimuli. But, in spite of good performance in terms of
prediction, the fitting parameters do not explain the underlying mechanistic
causes of the observed correlations. On the other hand, mathematical models of
spiking neurons (neuro-mimetic models) provide a probabilistic mapping between
stimulus, network architecture and spike patterns in terms of conditional
proba- bilities. In this paper we build an exact analytical mapping between
neuro-mimetic and Maximum Entropy models.Comment: arXiv admin note: text overlap with arXiv:1309.587
Topological Schemas of Memory Spaces
Hippocampal cognitive map---a neuronal representation of the spatial
environment---is broadly discussed in the computational neuroscience literature
for decades. More recent studies point out that hippocampus plays a major role
in producing yet another cognitive framework that incorporates not only
spatial, but also nonspatial memories---the memory space. However, unlike
cognitive maps, memory spaces have been barely studied from a theoretical
perspective. Here we propose an approach for modeling hippocampal memory spaces
as an epiphenomenon of neuronal spiking activity. First, we suggest that the
memory space may be viewed as a finite topological space---a hypothesis that
allows treating both spatial and nonspatial aspects of hippocampal function on
equal footing. We then model the topological properties of the memory space to
demonstrate that this concept naturally incorporates the notion of a cognitive
map. Lastly, we suggest a formal description of the memory consolidation
process and point out a connection between the proposed model of the memory
spaces to the so-called Morris' schemas, which emerge as the most compact
representation of the memory structure.Comment: 24 pages, 8 Figures, 1 Suppl. Figur
Discovering Functional Communities in Dynamical Networks
Many networks are important because they are substrates for dynamical
systems, and their pattern of functional connectivity can itself be dynamic --
they can functionally reorganize, even if their underlying anatomical structure
remains fixed. However, the recent rapid progress in discovering the community
structure of networks has overwhelmingly focused on that constant anatomical
connectivity. In this paper, we lay out the problem of discovering_functional
communities_, and describe an approach to doing so. This method combines recent
work on measuring information sharing across stochastic networks with an
existing and successful community-discovery algorithm for weighted networks. We
illustrate it with an application to a large biophysical model of the
transition from beta to gamma rhythms in the hippocampus.Comment: 18 pages, 4 figures, Springer "Lecture Notes in Computer Science"
style. Forthcoming in the proceedings of the workshop "Statistical Network
Analysis: Models, Issues and New Directions", at ICML 2006. Version 2: small
clarifications, typo corrections, added referenc
From Parallel Sequence Representations to Calligraphic Control: A Conspiracy of Neural Circuits
Calligraphic writing presents a rich set of challenges to the human movement control system. These challenges include: initial learning, and recall from memory, of prescribed stroke sequences; critical timing of stroke onsets and durations; fine control of grip and contact forces; and letter-form invariance under voluntary size scaling, which entails fine control of stroke direction and amplitude during recruitment and derecruitment of musculoskeletal degrees of freedom. Experimental and computational studies in behavioral neuroscience have made rapid progress toward explaining the learning, planning and contTOl exercised in tasks that share features with calligraphic writing and drawing. This article summarizes computational neuroscience models and related neurobiological data that reveal critical operations spanning from parallel sequence representations to fine force control. Part one addresses stroke sequencing. It treats competitive queuing (CQ) models of sequence representation, performance, learning, and recall. Part two addresses letter size scaling and motor equivalence. It treats cursive handwriting models together with models in which sensory-motor tmnsformations are performed by circuits that learn inverse differential kinematic mappings. Part three addresses fine-grained control of timing and transient forces, by treating circuit models that learn to solve inverse dynamics problems.National Institutes of Health (R01 DC02852
- …