3 research outputs found
Self-control dynamics for sparsely coded networks with synaptic noise
For the retrieval dynamics of sparsely coded attractor associative memory
models with synaptic noise the inclusion of a macroscopic time-dependent
threshold is studied. It is shown that if the threshold is chosen appropriately
as a function of the cross-talk noise and of the activity of the memorized
patterns, adapting itself automatically in the course of the time evolution, an
autonomous functioning of the model is guaranteed. This self-control mechanism
considerably improves the quality of the fixed-point retrieval dynamics, in
particular the storage capacity, the basins of attraction and the mutual
information content.Comment: 5 pages Latex, 1 ps and 4 eps figures, to appear in the proceedings
of the 2004 International Joint Conference on Neural Networks, Budapest
(IEEE
Adaptive thresholds for neural networks with synaptic noise
The inclusion of a macroscopic adaptive threshold is studied for the
retrieval dynamics of both layered feedforward and fully connected neural
network models with synaptic noise. These two types of architectures require a
different method to be solved numerically. In both cases it is shown that, if
the threshold is chosen appropriately as a function of the cross-talk noise and
of the activity of the stored patterns, adapting itself automatically in the
course of the recall process, an autonomous functioning of the network is
guaranteed. This self-control mechanism considerably improves the quality of
retrieval, in particular the storage capacity, the basins of attraction and the
mutual information content.Comment: 12 pages, 10 figure
Mutual Information of Three-State Low Activity Diluted Neural Networks with Self-Control
The influence of a macroscopic time-dependent threshold on the retrieval
process of three-state extremely diluted neural networks is examined. If the
threshold is chosen appropriately in function of the noise and the pattern
activity of the network, adapting itself in the course of the time evolution,
it guarantees an autonomous functioning of the network. It is found that this
self-control mechanism considerably improves the retrieval quality, especially
in the limit of low activity, including the storage capacity, the basins of
attraction and the information content. The mutual information is shown to be
the relevant parameter to study the retrieval quality of such low activity
models. Numerical results confirm these observations.Comment: Change of title and small corrections (16 pages and 6 figures