Learning and generation of long-range correlated sequences

We study the capability to learn and to generate long-range, power-law correlated sequences by a fully connected asymmetric network. The focus is set on the ability of neural networks to extract statistical features from a sequence. We demonstrate that the average power-law behavior is learnable, namely, the sequence generated by the trained network obeys the same statistical behavior. The interplay between a correlated weight matrix and the sequence generated by such a network is explored. A weight matrix with a power-law correlation function along the vertical direction, gives rise to a sequence with a similar statistical behavior.Comment: 5 pages, 3 figures, accepted for publication in Physical Review

Correlations between hidden units in multilayer neural networks and replica symmetry breaking

We consider feed-forward neural networks with one hidden layer, tree architecture and a fixed hidden-to-output Boolean function. Focusing on the saturation limit of the storage problem the influence of replica symmetry breaking on the distribution of local fields at the hidden units is investigated. These field distributions determine the probability for finding a specific activation pattern of the hidden units as well as the corresponding correlation coefficients and therefore quantify the division of labor among the hidden units. We find that although modifying the storage capacity and the distribution of local fields markedly replica symmetry breaking has only a minor effect on the correlation coefficients. Detailed numerical results are provided for the PARITY, COMMITTEE and AND machines with K=3 hidden units and nonoverlapping receptive fields.Comment: 9 pages, 3 figures, RevTex, accepted for publication in Phys. Rev.

Finite size scaling in neural networks

We demonstrate that the fraction of pattern sets that can be stored in single- and hidden-layer perceptrons exhibits finite size scaling. This feature allows to estimate the critical storage capacity \alpha_c from simulations of relatively small systems. We illustrate this approach by determining \alpha_c, together with the finite size scaling exponent \nu, for storing Gaussian patterns in committee and parity machines with binary couplings and up to K=5 hidden units.Comment: 4 pages, RevTex, 5 figures, uses multicol.sty and psfig.st

Multilayer neural networks with extensively many hidden units

The information processing abilities of a multilayer neural network with a number of hidden units scaling as the input dimension are studied using statistical mechanics methods. The mapping from the input layer to the hidden units is performed by general symmetric Boolean functions whereas the hidden layer is connected to the output by either discrete or continuous couplings. Introducing an overlap in the space of Boolean functions as order parameter the storage capacity if found to scale with the logarithm of the number of implementable Boolean functions. The generalization behaviour is smooth for continuous couplings and shows a discontinuous transition to perfect generalization for discrete ones.Comment: 4 pages, 2 figure

Neural cytoskeleton capabilities for learning and memory

This paper proposes a physical model involving the key structures within the neural cytoskeleton as major players in molecular-level processing of information required for learning and memory storage. In particular, actin filaments and microtubules are macromolecules having highly charged surfaces that enable them to conduct electric signals. The biophysical properties of these filaments relevant to the conduction of ionic current include a condensation of counterions on the filament surface and a nonlinear complex physical structure conducive to the generation of modulated waves. Cytoskeletal filaments are often directly connected with both ionotropic and metabotropic types of membrane-embedded receptors, thereby linking synaptic inputs to intracellular functions. Possible roles for cable-like, conductive filaments in neurons include intracellular information processing, regulating developmental plasticity, and mediating transport. The cytoskeletal proteins form a complex network capable of emergent information processing, and they stand to intervene between inputs to and outputs from neurons. In this manner, the cytoskeletal matrix is proposed to work with neuronal membrane and its intrinsic components (e.g., ion channels, scaffolding proteins, and adaptor proteins), especially at sites of synaptic contacts and spines. An information processing model based on cytoskeletal networks is proposed that may underlie certain types of learning and memory

Chaos in neural networks with a nonmonotonic transfer function

Time evolution of diluted neural networks with a nonmonotonic transfer function is analitically described by flow equations for macroscopic variables. The macroscopic dynamics shows a rich variety of behaviours: fixed-point, periodicity and chaos. We examine in detail the structure of the strange attractor and in particular we study the main features of the stable and unstable manifolds, the hyperbolicity of the attractor and the existence of homoclinic intersections. We also discuss the problem of the robustness of the chaos and we prove that in the present model chaotic behaviour is fragile (chaotic regions are densely intercalated with periodicity windows), according to a recently discussed conjecture. Finally we perform an analysis of the microscopic behaviour and in particular we examine the occurrence of damage spreading by studying the time evolution of two almost identical initial configurations. We show that for any choice of the parameters the two initial states remain microscopically distinct.Comment: 12 pages, 11 figures. Accepted for publication in Physical Review E. Originally submitted to the neuro-sys archive which was never publicly announced (was 9905001

Comment on "On the subtleties of searching for dark matter with liquid xenon detectors"

In a recent manuscript (arXiv:1208.5046) Peter Sorensen claims that XENON100's upper limits on spin-independent WIMP-nucleon cross sections for WIMP masses below 10 GeV "may be understated by one order of magnitude or more". Having performed a similar, though more detailed analysis prior to the submission of our new result (arXiv:1207.5988), we do not confirm these findings. We point out the rationale for not considering the described effect in our final analysis and list several potential problems with his study.Comment: 3 pages, no figure

Lowering the radioactivity of the photomultiplier tubes for the XENON1T dark matter experiment

The low-background, VUV-sensitive 3-inch diameter photomultiplier tube R11410 has been developed by Hamamatsu for dark matter direct detection experiments using liquid xenon as the target material. We present the results from the joint effort between the XENON collaboration and the Hamamatsu company to produce a highly radio-pure photosensor (version R11410-21) for the XENON1T dark matter experiment. After introducing the photosensor and its components, we show the methods and results of the radioactive contamination measurements of the individual materials employed in the photomultiplier production. We then discuss the adopted strategies to reduce the radioactivity of the various PMT versions. Finally, we detail the results from screening 216 tubes with ultra-low background germanium detectors, as well as their implications for the expected electronic and nuclear recoil background of the XENON1T experiment.Comment: 10 pages, 5 figure

Search for Event Rate Modulation in XENON100 Electronic Recoil Data

We have searched for periodic variations of the electronic recoil event rate in the (2-6) keV energy range recorded between February 2011 and March 2012 with the XENON100 detector, adding up to 224.6 live days in total. Following a detailed study to establish the stability of the detector and its background contributions during this run, we performed an un-binned profile likelihood analysis to identify any periodicity up to 500 days. We find a global significance of less than 1 sigma for all periods suggesting no statistically significant modulation in the data. While the local significance for an annual modulation is 2.8 sigma, the analysis of a multiple-scatter control sample and the phase of the modulation disfavor a dark matter interpretation. The DAMA/LIBRA annual modulation interpreted as a dark matter signature with axial-vector coupling of WIMPs to electrons is excluded at 4.8 sigma.Comment: 6 pages, 4 figure

Search for Two-Neutrino Double Electron Capture of 124^{124}Xe with XENON100

Two-neutrino double electron capture is a rare nuclear decay where two electrons are simultaneously captured from the atomic shell. For $^{124}$Xe this process has not yet been observed and its detection would provide a new reference for nuclear matrix element calculations. We have conducted a search for two-neutrino double electron capture from the K-shell of $^{124}$Xe using 7636 kg$\cdot$d of data from the XENON100 dark matter detector. Using a Bayesian analysis we observed no significant excess above background, leading to a lower 90 % credibility limit on the half-life $T_{1/2}>6.5\times10^{20}$ yr. We also evaluated the sensitivity of the XENON1T experiment, which is currently being commissioned, and find a sensitivity of $T_{1/2}>6.1\times10^{22}$ yr after an exposure of 2 t$\cdot$yr.Comment: 6 pages, 4 figure