20 research outputs found
Bifurcation analysis in an associative memory model
We previously reported the chaos induced by the frustration of interaction in
a non-monotonic sequential associative memory model, and showed the chaotic
behaviors at absolute zero. We have now analyzed bifurcation in a stochastic
system, namely a finite-temperature model of the non-monotonic sequential
associative memory model. We derived order-parameter equations from the
stochastic microscopic equations. Two-parameter bifurcation diagrams obtained
from those equations show the coexistence of attractors, which do not appear at
absolute zero, and the disappearance of chaos due to the temperature effect.Comment: 19 page
The path-integral analysis of an associative memory model storing an infinite number of finite limit cycles
It is shown that an exact solution of the transient dynamics of an
associative memory model storing an infinite number of limit cycles with l
finite steps by means of the path-integral analysis. Assuming the Maxwell
construction ansatz, we have succeeded in deriving the stationary state
equations of the order parameters from the macroscopic recursive equations with
respect to the finite-step sequence processing model which has retarded
self-interactions. We have also derived the stationary state equations by means
of the signal-to-noise analysis (SCSNA). The signal-to-noise analysis must
assume that crosstalk noise of an input to spins obeys a Gaussian distribution.
On the other hand, the path-integral method does not require such a Gaussian
approximation of crosstalk noise. We have found that both the signal-to-noise
analysis and the path-integral analysis give the completely same result with
respect to the stationary state in the case where the dynamics is
deterministic, when we assume the Maxwell construction ansatz.
We have shown the dependence of storage capacity (alpha_c) on the number of
patterns per one limit cycle (l). Storage capacity monotonously increases with
the number of steps, and converges to alpha_c=0.269 at l ~= 10. The original
properties of the finite-step sequence processing model appear as long as the
number of steps of the limit cycle has order l=O(1).Comment: 24 pages, 3 figure
Storage Capacity Diverges with Synaptic Efficiency in an Associative Memory Model with Synaptic Delay and Pruning
It is known that storage capacity per synapse increases by synaptic pruning
in the case of a correlation-type associative memory model. However, the
storage capacity of the entire network then decreases. To overcome this
difficulty, we propose decreasing the connecting rate while keeping the total
number of synapses constant by introducing delayed synapses. In this paper, a
discrete synchronous-type model with both delayed synapses and their prunings
is discussed as a concrete example of the proposal. First, we explain the
Yanai-Kim theory by employing the statistical neurodynamics. This theory
involves macrodynamical equations for the dynamics of a network with serial
delay elements. Next, considering the translational symmetry of the explained
equations, we re-derive macroscopic steady state equations of the model by
using the discrete Fourier transformation. The storage capacities are analyzed
quantitatively. Furthermore, two types of synaptic prunings are treated
analytically: random pruning and systematic pruning. As a result, it becomes
clear that in both prunings, the storage capacity increases as the length of
delay increases and the connecting rate of the synapses decreases when the
total number of synapses is constant. Moreover, an interesting fact becomes
clear: the storage capacity asymptotically approaches due to random
pruning. In contrast, the storage capacity diverges in proportion to the
logarithm of the length of delay by systematic pruning and the proportion
constant is . These results theoretically support the significance of
pruning following an overgrowth of synapses in the brain and strongly suggest
that the brain prefers to store dynamic attractors such as sequences and limit
cycles rather than equilibrium states.Comment: 27 pages, 14 figure