Stability of the replica symmetric solution for the information conveyed by by a neural network

The information that a pattern of firing in the output layer of a feedforward network of threshold-linear neurons conveys about the network's inputs is considered. A replica-symmetric solution is found to be stable for all but small amounts of noise. The region of instability depends on the contribution of the threshold and the sparseness: for distributed pattern distributions, the unstable region extends to higher noise variances than for very sparse distributions, for which it is almost nonexistant.Comment: 19 pages, LaTeX, 5 figures. Also available at http://www.mrc-bbc.ox.ac.uk/~schultz/papers.html . Submitted to Phys. Rev. E Minor change

Replica symmetric evaluation of the information transfer in a two-layer network in presence of continuous+discrete stimuli

In a previous report we have evaluated analytically the mutual information between the firing rates of N independent units and a set of multi-dimensional continuous+discrete stimuli, for a finite population size and in the limit of large noise. Here, we extend the analysis to the case of two interconnected populations, where input units activate output ones via gaussian weights and a threshold linear transfer function. We evaluate the information carried by a population of M output units, again about continuous+discrete correlates. The mutual information is evaluated solving saddle point equations under the assumption of replica symmetry, a method which, by taking into account only the term linear in N of the input information, is equivalent to assuming the noise to be large. Within this limitation, we analyze the dependence of the information on the ratio M/N, on the selectivity of the input units and on the level of the output noise. We show analytically, and confirm numerically, that in the limit of a linear transfer function and of a small ratio between output and input noise, the output information approaches asymptotically the information carried in input. Finally, we show that the information loss in output does not depend much on the structure of the stimulus, whether purely continuous, purely discrete or mixed, but only on the position of the threshold nonlinearity, and on the ratio between input and output noise.Comment: 19 pages, 4 figure

An associative network with spatially organized connectivity

We investigate the properties of an autoassociative network of threshold-linear units whose synaptic connectivity is spatially structured and asymmetric. Since the methods of equilibrium statistical mechanics cannot be applied to such a network due to the lack of a Hamiltonian, we approach the problem through a signal-to-noise analysis, that we adapt to spatially organized networks. The conditions are analyzed for the appearance of stable, spatially non-uniform profiles of activity with large overlaps with one of the stored patterns. It is also shown, with simulations and analytic results, that the storage capacity does not decrease much when the connectivity of the network becomes short range. In addition, the method used here enables us to calculate exactly the storage capacity of a randomly connected network with arbitrary degree of dilution.Comment: 27 pages, 6 figures; Accepted for publication in JSTA

Possible Contribution to Electron and Positron Fluxes from Pulsars and their Nebulae

The AMS-02 experiment confirms the excess of positrons in cosmic rays (CRs) for energy above 10 GeV with respect to the secondary production of positrons in the interstellar medium. This is interpreted as evidence of the existence of a primary source of these particles. Possible candidates are dark matter or astrophysical sources. In this work we discuss the possible contribution due to pulsars and their nebulae. Our key assumption is that the primary spectrum of electrons and positrons at the source is the same of the well known photon spectrum observed from gamma-rays telescopes. Using a diffusion model in the Galaxy we propagate the source spectra up to the Solar System. We compare our results with the recent experiments and with the LIS modelComment: To appear in the Proceedings of the 14th ICATPP Conference, Villa Olmo 23-27 September 201

What is the redshift of the gamma- ray BL Lac source S4 0954+65?

High signal-to-noise ratio spectroscopic observations of the BL Lac object S4 0954+65 at the alleged redshift z = 0.367 are presented. This source was detected at gamma frequencies by MAGIC (TeV) and FERMI (GeV) telescopes during a remarkable outburst that occurred in February 2015, making the determination of its distance particularly relevant for our understanding of the properties of the Extragalactic Background Light. Contrary to previous reports on the redshift, we found that the optical spectrum is featureless at an equivalent width limit of \sim 0.1 Ang. A critical analysis of the existing observations indicates that the redshift is still unknown. Based on the new data we estimate a lower limit to the redshift at z \geq 0.45.Comment: Minor comment and accepted for publication in Astronomical Journa

Pulsar Wind Nebulae as a source of the observed electron and positron excess at high energy: the case of Vela-X

We investigate, in terms of production from pulsars and their nebulae, the cosmic ray positron and electron fluxes above $\sim10$ GeV, observed by the AMS-02 experiment up to 1 TeV. We concentrate on the Vela-X case. Starting from the gamma-ray photon spectrum of the source, generated via synchrotron and inverse Compton processes, we estimated the electron and positron injection spectra. Several features are fixed from observations of Vela-X and unknown parameters are borrowed from the Crab nebula. The particle spectra produced in the pulsar wind nebula are then propagated up to the Solar System, using a diffusion model. Differently from previous works, the omnidirectional intensity excess for electrons and positrons is obtained as a difference between the AMS-02 data and the corresponding local interstellar spectrum. An equal amount of electron and positron excess is observed and we interpreted this excess (above $\sim$100 GeV in the AMS-02 data) as a supply coming from Vela-X. The particle contribution is consistent with models predicting the gamma-ray emission at the source. The input of a few more young pulsars is also allowed, while below $\sim$100 GeV more aged pulsars could be the main contributors.Comment: Accepted for publication in Journal of High Energy Astrophysics (2015

Angular and Linear Speed Cells in the Parahippocampal Circuits

An essential role of the hippocampal region is to integrate information to compute and update representations. How this transpires is highly debated. Many theories hinge on the integration of self-motion signals and the existence of continuous attractor networks (CAN). CAN models hypothesise that neurons coding for navigational correlates – such as position and direction – receive inputs from cells conjunctively coding for position, direction and self-motion. As yet, such conjunctive coding had not been found in the hippocampal region. Here, we report neurons coding for angular and linear velocity, distributed across the medial entorhinal cortex, the presubiculum and the parasubiculum. These self-motion neurons often conjunctively encoded position and/or direction, yet lacked a structured organisation, calling for the revision of current CAN models. These results offer insights as to how linear/angular speed – derivative in time of position/direction – may allow the updating of spatial representations, possibly uncovering a generalised algorithm to update any representation

Functional characterization of orbicularis oculi and extraocular muscles

The orbicularis oculi are the sphincter muscles of the eyelids and are involved in modulating facial expression. They differ from both limb and extraocular muscles (EOMs) in their histology and biochemistry. Weakness of the orbicularis oculi muscles is a feature of neuromuscular disorders affecting the neuromuscular junction, and weakness of facial muscles and ptosis have also been described in patients with mutations in the ryanodine receptor gene. Here, we investigate human orbicularis oculi muscles and find that they are functionally more similar to quadriceps than to EOMs in terms of excitation-contraction coupling components. In particular, they do not express the cardiac isoform of the dihydropyridine receptor, which we find to be highly expressed in EOMs where it is likely responsible for the large depolarization-induced calcium influx. We further show that human orbicularis oculi and EOMs express high levels of utrophin and low levels of dystrophin, whereas quadriceps express dystrophin and low levels of utrophin. The results of this study highlight the notion that myotubes obtained by explanting satellite cells from different muscles are not functionally identical and retain the physiological characteristics of their muscle of origin. Furthermore, our results indicate that sparing of facial and EOMs in patients with Duchenne muscular dystrophy is the result of the higher levels of utrophin expression

The Neutron Stars Census

The paucity of old isolated accreting neutron stars in ROSAT observations is used to derive a lower limit on the mean velocity of neutron stars at birth. The secular evolution of the population is simulated following the paths of a statistical sample of stars for different values of the initial kick velocity, drawn from an isotropic Gaussian distribution with mean velocity $0\leq < V>\leq 550$ ${\rm km s^{-1}}$. The spin--down, induced by dipole losses and the interaction with the ambient medium, is tracked together with the dynamical evolution in the Galactic potential, allowing for the determination of the fraction of stars which are, at present, in each of the four possible stages: Ejector, Propeller, Accretor, and Georotator. Taking from the ROSAT All Sky Survey an upper limit of $\sim 10$ accreting neutron stars within $\sim 140$ pc from the Sun, we infer a lower bound for the mean kick velocity, $\gtrsim 200-300$ ${\rm km s^{-1}},$ corresponding to a velocity dispersion $\sigma_V\gtrsim 125-190$ km s$^{-1}$. The same conclusion is reached for both a constant magnetic field ($B\sim 10^{12}$ G) and a magnetic field decaying exponentially with a timescale $\sim 10^9$ yr. Such high velocities are consistent with those derived from radio pulsar observations. Present results, moreover, constrain the fraction of low velocity stars, which could have escaped pulsar statistics, to less than 1%.Comment: 13 pages, 6 PostScript figures, accepted to Ap

Continuous attractors for dynamic memories

Episodic memory has a dynamic nature: when we recall past episodes, we retrieve not only their content, but also their temporal structure. The phenomenon of replay, in the hippocampus of mammals, offers a remarkable example of this temporal dynamics. However, most quantitative models of memory treat memories as static configurations, neglecting the temporal unfolding of the retrieval process. Here, we introduce a continuous attractor network model with a memory-dependent asymmetric component in the synaptic connectivity, which spontaneously breaks the equilibrium of the memory configurations and produces dynamic retrieval. The detailed analysis of the model with analytical calculations and numerical simulations shows that it can robustly retrieve multiple dynamical memories, and that this feature is largely independent of the details of its implementation. By calculating the storage capacity, we show that the dynamic component does not impair memory capacity, and can even enhance it in certain regimes