992 research outputs found

    Hierarchical Self-Programming in Recurrent Neural Networks

    Full text link
    We study self-programming in recurrent neural networks where both neurons (the `processors') and synaptic interactions (`the programme') evolve in time simultaneously, according to specific coupled stochastic equations. The interactions are divided into a hierarchy of LL groups with adiabatically separated and monotonically increasing time-scales, representing sub-routines of the system programme of decreasing volatility. We solve this model in equilibrium, assuming ergodicity at every level, and find as our replica-symmetric solution a formalism with a structure similar but not identical to Parisi's LL-step replica symmetry breaking scheme. Apart from differences in details of the equations (due to the fact that here interactions, rather than spins, are grouped into clusters with different time-scales), in the present model the block sizes mim_i of the emerging ultrametric solution are not restricted to the interval [0,1][0,1], but are independent control parameters, defined in terms of the noise strengths of the various levels in the hierarchy, which can take any value in [0,\infty\ket. This is shown to lead to extremely rich phase diagrams, with an abundance of first-order transitions especially when the level of stochasticity in the interaction dynamics is chosen to be low.Comment: 53 pages, 19 figures. Submitted to J. Phys.

    Spin Models on Thin Graphs

    Get PDF
    We discuss the utility of analytical and numerical investigation of spin models, in particular spin glasses, on ordinary ``thin'' random graphs (in effect Feynman diagrams) using methods borrowed from the ``fat'' graphs of two dimensional gravity. We highlight the similarity with Bethe lattice calculations and the advantages of the thin graph approach both analytically and numerically for investigating mean field results.Comment: Contribution to Parallel Session at Lattice95, 4 pages. Dodgy compressed ps file replaced with uuencoded LaTex original + ps figure

    The XY Spin-Glass with Slow Dynamic Couplings

    Full text link
    We investigate an XY spin-glass model in which both spins and couplings evolve in time: the spins change rapidly according to Glauber-type rules, whereas the couplings evolve slowly with a dynamics involving spin correlations and Gaussian disorder. For large times the model can be solved using replica theory. In contrast to the XY-model with static disordered couplings, solving the present model requires two levels of replicas, one for the spins and one for the couplings. Relevant order parameters are defined and a phase diagram is obtained upon making the replica-symmetric Ansatz. The system exhibits two different spin-glass phases, with distinct de Almeida-Thouless lines, marking continuous replica-symmetry breaking: one describing freezing of the spins only, and one describing freezing of both spins and couplings.Comment: 7 pages, Latex, 3 eps figure

    Replica field theory and renormalization group for the Ising spin glass in an external magnetic field

    Full text link
    We use the generic replica symmetric cubic field-theory to study the transition of short range Ising spin glasses in a magnetic field around the upper critical dimension, d=6. A novel fixed-point is found, in addition to the well-known zero magnetic field fixed-point, from the application of the renormalization group. In the spin glass limit, n going to 0, this fixed-point governs the critical behaviour of a class of systems characterised by a single cubic interaction parameter. For this universality class, the spin glass susceptibility diverges at criticality, whereas the longitudinal mode remains massive. The third mode, the so-called anomalous one, however, behaves unusually, having a jump at criticality. The physical consequences of this unusual behaviour are discussed, and a comparison with the conventional de Almeida-Thouless scenario presented.Comment: 5 pages written in revtex4. Accepted for publication in Phys. Rev. Let

    Replica symmetry breaking in an adiabatic spin-glass model of adaptive evolution

    Full text link
    We study evolutionary canalization using a spin-glass model with replica theory, where spins and their interactions are dynamic variables whose configurations correspond to phenotypes and genotypes, respectively. The spins are updated under temperature T_S, and the genotypes evolve under temperature T_J, according to the evolutionary fitness. It is found that adaptation occurs at T_S < T_S^{RS}, and a replica symmetric phase emerges at T_S^{RSB} < T_S < T_S^{RS}. The replica symmetric phase implies canalization, and replica symmetry breaking at lower temperatures indicates loss of robustness.Comment: 5pages, 2 figure

    To Learn or Not to Learn Features for Deformable Registration?

    Full text link
    Feature-based registration has been popular with a variety of features ranging from voxel intensity to Self-Similarity Context (SSC). In this paper, we examine the question on how features learnt using various Deep Learning (DL) frameworks can be used for deformable registration and whether this feature learning is necessary or not. We investigate the use of features learned by different DL methods in the current state-of-the-art discrete registration framework and analyze its performance on 2 publicly available datasets. We draw insights into the type of DL framework useful for feature learning and the impact, if any, of the complexity of different DL models and brain parcellation methods on the performance of discrete registration. Our results indicate that the registration performance with DL features and SSC are comparable and stable across datasets whereas this does not hold for low level features.Comment: 9 pages, 4 figure

    Statistical mechanics of clonal expansion in lymphocyte networks modelled with slow and fast variables

    Get PDF
    We study the Langevin dynamics of the adaptive immune system, modelled by a lymphocyte network in which the B cells are interacting with the T cells and antigen. We assume that B clones and T clones are evolving in different thermal noise environments and on different timescales. We derive stationary distributions and use statistical mechanics to study clonal expansion of B clones in this model when the B and T clone sizes are assumed to be the slow and fast variables respectively and vice versa. We derive distributions of B clone sizes and use general properties of ferromagnetic systems to predict characteristics of these distributions, such as the average B cell concentration, in some regimes where T cells can be modelled as binary variables. This analysis is independent of network topologies and its results are qualitatively consistent with experimental observations. In order to obtain full distributions we assume that the network topologies are random and locally equivalent to trees. The latter allows us to employ the Bethe-Peierls approach and to develop a theoretical framework which can be used to predict the distributions of B clone sizes. As an example we use this theory to compute distributions for the models of immune system defined on random regular networks.Comment: A more recent version (accepted for publication in Journal of Physics A: Mathematical and Theoretical) with improved figures, references, et

    Spin Glasses on Thin Graphs

    Full text link
    In a recent paper we found strong evidence from simulations that the Isingantiferromagnet on ``thin'' random graphs - Feynman diagrams - displayed amean-field spin glass transition. The intrinsic interest of considering such random graphs is that they give mean field results without long range interactions or the drawbacks, arising from boundary problems, of the Bethe lattice. In this paper we reprise the saddle point calculations for the Ising and Potts ferromagnet, antiferromagnet and spin glass on Feynman diagrams. We use standard results from bifurcation theory that enable us to treat an arbitrary number of replicas and any quenched bond distribution. We note the agreement between the ferromagnetic and spin glass transition temperatures thus calculated and those derived by analogy with the Bethe lattice, or in previous replica calculations. We then investigate numerically spin glasses with a plus or minus J bond distribution for the Ising and Q=3,4,10,50 state Potts models, paying particular attention to the independence of the spin glass transition from the fraction of positive and negative bonds in the Ising case and the qualitative form of the overlap distribution in all the models. The parallels with infinite range spin glass models in both the analytical calculations and simulations are pointed out.Comment: 13 pages of LaTex and 11 postscript figures bundled together with uufiles. Discussion of first order transitions for three or more replicas included and similarity to Ising replica magnet pointed out. Some additional reference

    Excitatory amino acid binding sites in the caudate nucleus and frontal cortex of huntington's disease

    Full text link
    Huntington's disease is a dominantly inherited, progressive neurodegenerative disorder causing marked pathology in the basal ganglia. The pathophysiology of the selective neuronal death in as yet unknown, but evidence suggests that the neurotoxicity may result from endogenous substances acting at excitatory amino acid receptors. Previous data have shown a selective decrease in binding to one class of glutamate receptors, the N -methyl-D-aspartate (NMDA) receptor in the putamen of Huntington's disease. The present study was undertaken to determine the relative density of binding to all of the currently defined subpopulations of excitatory amino acid receptors in the caudate nuclei and frontal cortex of patients with Huntington's disease and of control subjects, using quantitative in vitro autoradiography. NMDA, MK-801, glycine, kainate, and Α-amino-3-hydroxy-5-methylisoxazole propionic acid (AMPA) receptor binding were all decreased to a similar extent (50–60°). Binding to the metabotropic quisqualate receptor and to the non-NMDA, nonkainate, nonquisqualate (NNKQ) site was decreased nonsignificantly by 31° and 26°, respectively. Autoradiograms of NMDA, MK-801, AMPA, kainate, metabotropic, and NNKQ receptors in caudates revealed an inhomogeneous pattern of binding that is different from the binding pattern seen in control caudates. Binding to all receptor subtypes was the same in the frontal cortex from Huntington's disease patients and control subjects. The data suggest that no single excitatory amino acid receptor is selectively decreased in the caudate of Huntington's disease.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/50348/1/410300607_ftp.pd
    corecore