12,453 research outputs found
Dreaming neural networks: forgetting spurious memories and reinforcing pure ones
The standard Hopfield model for associative neural networks accounts for
biological Hebbian learning and acts as the harmonic oscillator for pattern
recognition, however its maximal storage capacity is , far
from the theoretical bound for symmetric networks, i.e. . Inspired
by sleeping and dreaming mechanisms in mammal brains, we propose an extension
of this model displaying the standard on-line (awake) learning mechanism (that
allows the storage of external information in terms of patterns) and an
off-line (sleep) unlearningconsolidating mechanism (that allows
spurious-pattern removal and pure-pattern reinforcement): this obtained daily
prescription is able to saturate the theoretical bound , remaining
also extremely robust against thermal noise. Both neural and synaptic features
are analyzed both analytically and numerically. In particular, beyond obtaining
a phase diagram for neural dynamics, we focus on synaptic plasticity and we
give explicit prescriptions on the temporal evolution of the synaptic matrix.
We analytically prove that our algorithm makes the Hebbian kernel converge with
high probability to the projection matrix built over the pure stored patterns.
Furthermore, we obtain a sharp and explicit estimate for the "sleep rate" in
order to ensure such a convergence. Finally, we run extensive numerical
simulations (mainly Monte Carlo sampling) to check the approximations
underlying the analytical investigations (e.g., we developed the whole theory
at the so called replica-symmetric level, as standard in the
Amit-Gutfreund-Sompolinsky reference framework) and possible finite-size
effects, finding overall full agreement with the theory.Comment: 31 pages, 12 figure
Ab initio compressive phase retrieval
Any object on earth has two fundamental properties: it is finite, and it is
made of atoms. Structural information about an object can be obtained from
diffraction amplitude measurements that account for either one of these traits.
Nyquist-sampling of the Fourier amplitudes is sufficient to image single
particles of finite size at any resolution. Atomic resolution data is routinely
used to image molecules replicated in a crystal structure. Here we report an
algorithm that requires neither information, but uses the fact that an image of
a natural object is compressible. Intended applications include tomographic
diffractive imaging, crystallography, powder diffraction, small angle x-ray
scattering and random Fourier amplitude measurements.Comment: 7 pages, 4 figures, presented at the XXI IUCr Congress, Aug. 2008,
Osaka Japa
- …