Correlation of internal representations in feed-forward neural networks

Feed-forward multilayer neural networks implementing random input-output mappings develop characteristic correlations between the activity of their hidden nodes which are important for the understanding of the storage and generalization performance of the network. It is shown how these correlations can be calculated from the joint probability distribution of the aligning fields at the hidden units for arbitrary decoder function between hidden layer and output. Explicit results are given for the parity-, and-, and committee-machines with arbitrary number of hidden nodes near saturation.Comment: 6 pages, latex, 1 figur

A canonical ensemble approach to graded-response perceptrons

Perceptrons with graded input-output relations and a limited output precision are studied within the Gardner-Derrida canonical ensemble approach. Soft non- negative error measures are introduced allowing for extended retrieval properties. In particular, the performance of these systems for a linear and quadratic error measure, corresponding to the perceptron respectively the adaline learning algorithm, is compared with the performance for a rigid error measure, simply counting the number of errors. Replica-symmetry-breaking effects are evaluated.Comment: 26 pages, 10 ps figure

Iron Status and Analysis of Efficacy and Safety of Ferric Carboxymaltose Treatment in Patients with Inflammatory Bowel Disease

Background and Aims:We analyzed iron deficiency and the therapeutic response following intravenous ferric carboxymaltose in a large single-center inflammatory bowel disease (IBD) cohort. Methods: 250 IBD patients were retrospectively analyzed for iron deficiency and iron deficiency anemia. A subgroup was analyzed regarding efficacy and side effects of iron supplementation with ferric carboxymaltose. Results: In the cohort (n = 250), 54.4% of the patients had serum iron levels 60 mu g/dl, 61.6% had ferritin >100 ng/ml, and 90.7% reached Hb >12/13 g/dl at follow-up (p < 0.0001 for all parameters vs. pretreatment values). The most frequent adverse event was a transient increase of liver enzymes with male gender as risk factor (p = 0.008, OR 8.62, 95% CI 1.74-41.66). Conclusions: Iron deficiency and anemia are frequent in IBD patients. Treatment with ferric carboxymaltose is efficious, safe and well tolerated in iron-deficient IBD patients. Copyright (C) 2011 S. Karger AG, Base

Retrieval behavior and thermodynamic properties of symmetrically diluted Q-Ising neural networks

The retrieval behavior and thermodynamic properties of symmetrically diluted Q-Ising neural networks are derived and studied in replica-symmetric mean-field theory generalizing earlier works on either the fully connected or the symmetrical extremely diluted network. Capacity-gain parameter phase diagrams are obtained for the Q=3, Q=4 and $Q=\infty$ state networks with uniformly distributed patterns of low activity in order to search for the effects of a gradual dilution of the synapses. It is shown that enlarged regions of continuous changeover into a region of optimal performance are obtained for finite stochastic noise and small but finite connectivity. The de Almeida-Thouless lines of stability are obtained for arbitrary connectivity, and the resulting phase diagrams are used to draw conclusions on the behavior of symmetrically diluted networks with other pattern distributions of either high or low activity.Comment: 21 pages, revte

Parisi Phase in a Neuron

Pattern storage by a single neuron is revisited. Generalizing Parisi's framework for spin glasses we obtain a variational free energy functional for the neuron. The solution is demonstrated at high temperature and large relative number of examples, where several phases are identified by thermodynamical stability analysis, two of them exhibiting spontaneous full replica symmetry breaking. We give analytically the curved segments of the order parameter function and in representative cases compute the free energy, the storage error, and the entropy.Comment: 4 pages in prl twocolumn format + 3 Postscript figures. Submitted to Physical Review Letter

Optimally adapted multi-state neural networks trained with noise

The principle of adaptation in a noisy retrieval environment is extended here to a diluted attractor neural network of Q-state neurons trained with noisy data. The network is adapted to an appropriate noisy training overlap and training activity which are determined self-consistently by the optimized retrieval attractor overlap and activity. The optimized storage capacity and the corresponding retriever overlap are considerably enhanced by an adequate threshold in the states. Explicit results for improved optimal performance and new retriever phase diagrams are obtained for Q=3 and Q=4, with coexisting phases over a wide range of thresholds. Most of the interesting results are stable to replica-symmetry-breaking fluctuations.Comment: 22 pages, 5 figures, accepted for publication in PR

Storage capacity of a constructive learning algorithm

Upper and lower bounds for the typical storage capacity of a constructive algorithm, the Tilinglike Learning Algorithm for the Parity Machine [M. Biehl and M. Opper, Phys. Rev. A {\bf 44} 6888 (1991)], are determined in the asymptotic limit of large training set sizes. The properties of a perceptron with threshold, learning a training set of patterns having a biased distribution of targets, needed as an intermediate step in the capacity calculation, are determined analytically. The lower bound for the capacity, determined with a cavity method, is proportional to the number of hidden units. The upper bound, obtained with the hypothesis of replica symmetry, is close to the one predicted by Mitchinson and Durbin [Biol. Cyber. {\bf 60} 345 (1989)].Comment: 13 pages, 1 figur

Feasibility of salivary DNA collection in a population-based case-control study: A pilot study of pediatric Crohn’s disease

Background: Epidemiologic studies combining exposure and outcome data with the collection of biosamples are needed to study gene-environment interactions that might contribute to the etiology of complex diseases such as pediatric Crohn’s disease (CD). Nationwide registries, including those in Denmark and other Scandinavian countries, provide efficient and reliable sources of data for epidemiological studies evaluating the environmental determinants of disease. We performed a pilot study to test the feasibility of collecting salivary DNA to augment registry data in established cases of pediatric CD and randomly selected, population-based controls. Subjects and methods: Cases of CD born after 1995 and residing in the central region of Denmark were identified through the Danish National Patient Registry and confirmed by using standard diagnostic criteria. Age- and gender-matched controls were selected at random through the civil registration system. Cases and controls were contacted by mail and telephone and invited to submit a saliva sample. DNA was extracted and genotyped for six CD-associated single-nucleotide polymorphisms (SNPs). Results: A total of 53 cases of pediatric CD were invited, and 40 contributed a saliva sample (75% response rate). A total of 126 controls were invited, and 54 contributed a saliva sample (44% response rate). As expected, demographic characteristics did not differ between cases and controls. DNA was successfully isolated from 93 of 94 samples. Genotyping was performed with only 2% undetermined genotypes. For five of six SNPs known to be associated with CD, risk allele frequencies were higher in cases than controls. Conclusion: This pilot study strongly supports the feasibility of augmenting traditional epidemiological data from Danish population-based registries with the de novo collection of genetic information from population-based cases and controls. This will facilitate rigorous studies of gene-environment interactions in complex chronic conditions such as CD

Risk of cancer in patients with inflammatory bowel diseases: A nationwide population-based cohort study with 30 years of follow-up evaluation

Data regarding the risk of gastrointestinal and extra-intestinal cancers in Crohn’s disease (CD) and ulcerative colitis (UC) are needed to understand the clinical course of inflammatory bowel diseases (IBDs) and their treatments

Comparison of the novel subtype-selective GABAA receptorpositive allosteric modulator NS11394 [3’-[5-(1-hydroxy-1-methyl-ethyl)- benzoimidazol-1-yl]-biphenyl-2-carbonitrile] with diazepam, zolpidem

ABSTRACT Spinal administration of GABA A receptor modulators, such as the benzodiazepine drug diazepam, partially alleviates neuropathic hypersensitivity that manifests as spontaneous pain, allodynia, and hyperalgesia. However, benzodiazepines are hindered by sedative impairments and other side effect issues occurring mainly as a consequence of binding to GABA A receptors containing the ␣ 1 subunit. Here, we report on the novel subtype-selective GABA A receptor-positive modulator NS11394 [3Ј-[5-(1-hydroxy-1-methyl-ethyl)-benzoimidazol-1-yl]-biphenyl-2-carbonitrile], which possesses a functional efficacy selectivity profile of ␣ 5 Ͼ ␣ 3 Ͼ ␣ 2 Ͼ ␣ 1 at GABA A ␣ subunit-containing receptors