Correlation of internal representations in feed-forward neural networks

Feed-forward multilayer neural networks implementing random input-output mappings develop characteristic correlations between the activity of their hidden nodes which are important for the understanding of the storage and generalization performance of the network. It is shown how these correlations can be calculated from the joint probability distribution of the aligning fields at the hidden units for arbitrary decoder function between hidden layer and output. Explicit results are given for the parity-, and-, and committee-machines with arbitrary number of hidden nodes near saturation.Comment: 6 pages, latex, 1 figur

Statistical Mechanics of Learning: A Variational Approach for Real Data

Using a variational technique, we generalize the statistical physics approach of learning from random examples to make it applicable to real data. We demonstrate the validity and relevance of our method by computing approximate estimators for generalization errors that are based on training data alone.Comment: 4 pages, 2 figure

Food Quality Affects Secondary Consumers Even at Low Quantities: An Experimental Test with Larval European Lobster

The issues of food quality and food quantity are crucial for trophic interactions. Although most research has focussed on the primary producer – herbivore link, recent studies have shown that quality effects at the bottom of the food web propagate to higher trophic levels. Negative effects of poor food quality have almost exclusively been demonstrated at higher food quantities. Whether these negative effects have the same impact at low food availability in situations where the majority if not all of the resources are channelled into routine metabolism, is under debate. In this study a tri-trophic food chain was designed, consisting of the algae Rhodomonas salina, the copepod Acartia tonsa and freshly hatched larvae of the European lobster Homarus gammarus. The lobster larvae were presented with food of two different qualities (C∶P ratios) and four different quantities to investigate the combined effects of food quality and quantity. Our results show that the quality of food has an impact on the condition of lobster larvae even at very low food quantities. Food with a lower C∶P content resulted in higher condition of the lobster larvae regardless of the quantity of food. These interacting effects of food quality and food quantity can have far reaching consequences for ecosystem productivity

Replica theory for learning curves for Gaussian processes on random graphs

Statistical physics approaches can be used to derive accurate predictions for the performance of inference methods learning from potentially noisy data, as quantified by the learning curve defined as the average error versus number of training examples. We analyse a challenging problem in the area of non-parametric inference where an effectively infinite number of parameters has to be learned, specifically Gaussian process regression. When the inputs are vertices on a random graph and the outputs noisy function values, we show that replica techniques can be used to obtain exact performance predictions in the limit of large graphs. The covariance of the Gaussian process prior is defined by a random walk kernel, the discrete analogue of squared exponential kernels on continuous spaces. Conventionally this kernel is normalised only globally, so that the prior variance can differ between vertices; as a more principled alternative we consider local normalisation, where the prior variance is uniform

Proteotypic classification of spontaneous and transgenic mammary neoplasms

INTRODUCTION: Mammary tumors in mice are categorized by using morphologic and architectural criteria. Immunolabeling for terminal differentiation markers was compared among a variety of mouse mammary neoplasms because expression of terminal differentiation markers, and especially of keratins, provides important information on the origin of neoplastic cells and their degree of differentiation. METHODS: Expression patterns for terminal differentiation markers were used to characterize tumor types and to study tumor progression in transgenic mouse models of mammary neoplasia (mice overexpressing Neu (Erbb2), Hras, Myc, Notch4, SV40-TAg, Tgfa, and Wnt1), in spontaneous mammary carcinomas, and in mammary neoplasms associated with infection by the mouse mammary tumor virus (MMTV). RESULTS: On the basis of the expression of terminal differentiation markers, three types of neoplasm were identified: first, simple carcinomas composed exclusively of cells with a luminal phenotype are characteristic of neoplasms arising in mice transgenic for Neu, Hras, Myc, Notch4, and SV40-TAg; second, 'complex carcinomas' displaying luminal and myoepithelial differentiation are characteristic of type P tumors arising in mice transgenic for Wnt1, neoplasms arising in mice infected by the MMTV, and spontaneous adenosquamous carcinomas; and third, 'carcinomas with epithelial to mesenchymal transition (EMT)' are a characteristic feature of tumor progression in Hras-, Myc-, and SV40-TAg-induced mammary neoplasms and PL/J and SJL/J mouse strains, and display de novo expression of myoepithelial and mesenchymal cell markers. In sharp contrast, EMT was not detected in papillary adenocarcinomas arising in BALB/cJ mice, spontaneous adenoacanthomas, neoplasms associated with MMTV-infection, or in neoplasms arising in mice transgenic for Neu and Wnt1. CONCLUSIONS: Immunohistochemical profiles of complex neoplasms are consistent with a stem cell origin, whereas simple carcinomas might originate from a cell committed to the luminal lineage. In addition, these results suggest that the initiating oncogenic events determine the morphologic features associated with cancer progression because EMT is observed only in certain types of neoplasm

Modeling Light Adaptation in Circadian Clock: Prediction of the Response That Stabilizes Entrainment

Periods of biological clocks are close to but often different from the rotation period of the earth. Thus, the clocks of organisms must be adjusted to synchronize with day-night cycles. The primary signal that adjusts the clocks is light. In Neurospora, light transiently up-regulates the expression of specific clock genes. This molecular response to light is called light adaptation. Does light adaptation occur in other organisms? Using published experimental data, we first estimated the time course of the up-regulation rate of gene expression by light. Intriguingly, the estimated up-regulation rate was transient during light period in mice as well as Neurospora. Next, we constructed a computational model to consider how light adaptation had an effect on the entrainment of circadian oscillation to 24-h light-dark cycles. We found that cellular oscillations are more likely to be destabilized without light adaption especially when light intensity is very high. From the present results, we predict that the instability of circadian oscillations under 24-h light-dark cycles can be experimentally observed if light adaptation is altered. We conclude that the functional consequence of light adaptation is to increase the adjustability to 24-h light-dark cycles and then adapt to fluctuating environments in nature

Frequently increased epidermal growth factor receptor (EGFR) copy numbers and decreased BRCA1 mRNA expression in Japanese triple-negative breast cancers

<p>Abstract</p> <p>Background</p> <p>Triple-negative breast cancer (estrogen receptor-, progesterone receptor-, and HER2-negative) (TNBC) is a high risk breast cancer that lacks specific therapy targeting these proteins.</p> <p>Methods</p> <p>We studied 969 consecutive Japanese patients diagnosed with invasive breast cancer from January 1981 to December 2003, and selected TNBCs based on the immunohistochemical data. Analyses of epidermal growth factor receptor (<it>EGFR</it>) gene mutations and amplification, and <it>BRCA</it>1 mRNA expression were performed on these samples using TaqMan PCR assays. The prognostic significance of TNBCs was also explored. Median follow-up was 8.3 years.</p> <p>Results</p> <p>A total of 110 (11.3%) patients had TNBCs in our series. Genotyping of the <it>EGFR </it>gene was performed to detect 14 known <it>EGFR </it>mutations, but none was identified. However, <it>EGFR </it>gene copy number was increased in 21% of TNBCs, while only 2% of ER- and PgR-positive, HER2-negative tumors showed slightly increased <it>EGFR </it>gene copy numbers. Thirty-one percent of TNBCs stained positive for EGFR protein by immunohistochemistry. <it>BRCA1 </it>mRNA expression was also decreased in TNBCs compared with controls. Triple negativity was significantly associated with grade 3 tumors, TP53 protein accumulation, and high Ki67 expression. TNBC patients had shorter disease-free survival than non-TNBC in node-negative breast cancers.</p> <p>Conclusion</p> <p>TNBCs have an aggressive clinical course, and <it>EGFR </it>and <it>BRCA1 </it>might be candidate therapeutic targets in this disease.</p

Ocean current connectivity propelling the secondary spread of a marine invasive comb jelly across western Eurasia

Aim: Invasive species are of increasing global concern. Nevertheless, the mechanisms driving furtherdistribution after the initial establishment of non-native species remain largely unresolved, especiallyin marine systems. Ocean currents can be a major driver governing range occupancy, but this hasnot been accounted for in most invasion ecology studies so far. We investigate how well initialestablishment areas are interconnected to later occupancy regions to test for the potential role ofocean currents driving secondary spread dynamics in order to infer invasion corridors and thesource–sink dynamics of a non-native holoplanktonic biological probe species on a continental scale.Location: Western Eurasia.Time period: 1980s–2016.Major taxa studied: ‘Comb jelly’ Mnemiopsis leidyi.Methods: Based on 12,400 geo-referenced occurrence data, we reconstruct the invasion historyof M. leidyi in western Eurasia. We model ocean currents and calculate their stability to match thetemporal and spatial spread dynamics with large-scale connectivity patterns via ocean currents.Additionally, genetic markers are used to test the predicted connectivity between subpopulations.Results: Ocean currents can explain secondary spread dynamics, matching observed range expansionsand the timing of first occurrence of our holoplanktonic non-native biological probe species,leading to invasion corridors in western Eurasia. In northern Europe, regional extinctions after coldwinters were followed by rapid recolonizations at a speed of up to 2,000 km per season. SourceJASPERS ET AL. | 815areas hosting year-round populations in highly interconnected regions can re-seed genotypes overlarge distances after local extinctions.Main conclusions: Although the release of ballast water from container ships may contribute tothe dispersal of non-native species, our results highlight the importance of ocean currents drivingsecondary spread dynamics. Highly interconnected areas hosting invasive species are crucial forsecondary spread dynamics on a continental scale. Invasion risk assessments should considerlarge-scale connectivity patterns and the potential source regions of non-native marine species

The key hypoxia regulated gene CAIX is upregulated in basal-like breast tumours and is associated with resistance to chemotherapy

Basal-like tumours account for 15% of invasive breast carcinomas and are associated with a poorer prognosis and resistance to therapy. We hypothesised that this aggressive phenotype is because of an intrinsically elevated hypoxic response. Microarrayed tumours from 188 patients were stained for hypoxia-inducible factor (HIF)-1α, prolyl hydroxylase (PHD)1, PHD2, PHD3 and factor inhibiting HIF (FIH)-1, and carbonic anhydrase (CA) IX stained in 456 breast tumours. Tumour subtypes were correlated with standard clincopathological parameters as well as hypoxic markers. Out of 456 tumours 62 (14%) tumours were basal-like. These tumours were positively correlated with high tumour grade (P<0.001) and were associated with a significantly worse disease-free survival compared with luminal tumours (P<0.001). Fifty percent of basal-like tumours expressed HIF-1α, and more than half expressed at least one of the PHD enzymes and FIH-1. Basal-like tumours were nine times more likely to be associated with CAIX expression (P<0.001) in a multivariate analysis. Carbonic anhydrase IX expression was positively correlated with tumour size (P=0.005), tumour grade (P<0.001) and oestrogen receptor (ER) negativity (P<0.001). Patients with any CAIX-positive breast tumour phenotype and in the basal tumour group had a significantly worse prognosis than CAIX-negative tumours when treated with chemotherapy (P<0.001 and P=0.03, respectively). The association between basal phenotype and CAIX suggests that the more aggressive behaviour of these tumours is partly due to an enhanced hypoxic response. Further, the association with chemoresistance in CAIX-positive breast tumours and basal-like tumours in particular raises the possibility that targeted therapy against HIF pathway or downstream genes such as CAs may be an approach to investigate for these patients