Online Continual Learning on Sequences

Online continual learning (OCL) refers to the ability of a system to learn over time from a continuous stream of data without having to revisit previously encountered training samples. Learning continually in a single data pass is crucial for agents and robots operating in changing environments and required to acquire, fine-tune, and transfer increasingly complex representations from non-i.i.d. input distributions. Machine learning models that address OCL must alleviate \textit{catastrophic forgetting} in which hidden representations are disrupted or completely overwritten when learning from streams of novel input. In this chapter, we summarize and discuss recent deep learning models that address OCL on sequential input through the use (and combination) of synaptic regularization, structural plasticity, and experience replay. Different implementations of replay have been proposed that alleviate catastrophic forgetting in connectionists architectures via the re-occurrence of (latent representations of) input sequences and that functionally resemble mechanisms of hippocampal replay in the mammalian brain. Empirical evidence shows that architectures endowed with experience replay typically outperform architectures without in (online) incremental learning tasks.Comment: L. Oneto et al. (eds.), Recent Trends in Learning From Data, Studies in Computational Intelligence 89

Glutathione pathway gene variation and risk of autism spectrum disorders

Despite evidence that autism is highly heritable with estimates of 15 or more genes involved, few studies have directly examined associations of multiple gene interactions. Since inability to effectively combat oxidative stress has been suggested as a mechanism of autism, we examined genetic variation 42 genes (308 single-nucleotide polymorphisms (SNPs)) related to glutathione, the most important antioxidant in the brain, for both marginal association and multi-gene interaction among 318 case–parent trios from The Autism Genetic Resource Exchange. Models of multi-SNP interactions were estimated using the trio Logic Regression method. A three-SNP joint effect was observed for genotype combinations of SNPs in glutaredoxin, glutaredoxin 3 (GLRX3), and cystathione gamma lyase (CTH); OR = 3.78, 95% CI: 2.36, 6.04. Marginal associations were observed for four genes including two involved in the three-way interaction: CTH, alcohol dehydrogenase 5, gamma-glutamylcysteine synthetase, catalytic subunit and GLRX3. These results suggest that variation in genes involved in counterbalancing oxidative stress may contribute to autism, though replication is necessary

Replication and Meta-Analysis of GWAS Identified Susceptibility Loci in Kawasaki Disease Confirm the Importance of B Lymphoid Tyrosine Kinase (BLK) in Disease Susceptibility

10.1371/journal.pone.0072037PLoS ONE88-POLN

Chromosome landmarks and autosome-sex chromosome translocations in Rumex hastatulus, a plant with XX/XY1Y2 sex chromosome system

Rumex hastatulus is the North American endemic dioecious plant with heteromorphic sex chromosomes. It is differentiated into two chromosomal races: Texas (T) race characterised by a simple XX/XY sex chromosome system and North Carolina (NC) race with a polymorphic XX/XY1Y2 sex chromosome system. The gross karyotype morphology in NC race resembles the derived type, but chromosomal changes that occurred during its evolution are poorly understood. Our C-banding/DAPI and fluorescence in situ hybridization (FISH) experiments demonstrated that Y chromosomes of both races are enriched in DAPI-positive sequences and that the emergence of polymorphic sex chromosome system was accompanied by the break of ancestral Y chromosome and switch in the localization of 5S rDNA, from autosomes to sex chromosomes (X and Y2). Two contrasting domains were detected within North Carolina Y chromosomes: the older, highly heterochromatinised, inherited from the original Y chromosome and the younger, euchromatic, representing translocated autosomal material. The flow-cytometric DNA estimation showed ∼3.5 % genome downsizing in the North Carolina race. Our results are in contradiction to earlier reports on the lack of heterochromatin within Y chromosomes of this species and enable unambiguous identification of autosomes involved in the autosome-heterosome translocation, providing useful chromosome landmarks for further studies on the karyotype and sex chromosome differentiation in this species

Reversal of Obesity and Insulin Resistance by a Non-Peptidic Glucagon-Like Peptide-1 Receptor Agonist in Diet-Induced Obese Mice

BACKGROUND: Glucagon-like peptide-1 (GLP-1) is recognized as an important regulator of glucose homeostasis. Efforts to utilize GLP-1 mimetics in the treatment of diabetes have yielded clinical benefits. A major hurdle for an effective oral therapy has been the difficulty of finding a non-peptidic GLP-1 receptor (GLP-1R) agonist. While its oral bioavailability still poses significant challenges, Boc5, one of the first such compounds, has demonstrated the attainment of GLP-1R agonism in diabetic mice. The present work was to investigate whether subchronic Boc5 treatment can restore glycemic control and induce sustainable weight loss in diet-induced obese (DIO) mice, an animal model of human obesity and insulin resistance. METHODOLOGY/PRINCIPAL FINDINGS: DIO mice were treated three times a week with Boc5 (0.3, 1 and 3 mg) for 12 weeks. Body weight, body mass index (BMI), food intake, fasting glucose, intraperitoneal glucose tolerance and insulin induced glucose clearance were monitored regularly throughout the treatment. Glucose-stimulated insulin secretion, β-cell mass, islet size, body composition, serum metabolic profiles, lipogenesis, lipolysis, adipose hypertrophy and lipid deposition in the liver and muscle were also measured after 12 weeks of dosing. Boc5 dose-dependently reduced body weight, BMI and food intake in DIO mice. These changes were associated with significant decreases in fat mass, adipocyte hypertrophy and peripheral tissue lipid accumulation. Boc5 treatment also restored glycemic control through marked improvement of insulin sensitivity and normalization of β-cell mass. Administration of Boc5 (3 mg) reduced basal but enhanced insulin-mediated glucose incorporation and noradrenaline-stimulated lipolysis in isolated adipocytes from obese mice. Furthermore, circulating leptin, adiponectin, triglyceride, total cholesterol, nonesterified fatty acid and high-density lipoprotein/low-density lipoprotein ratio were normalized to various extents by Boc5 treatment. CONCLUSIONS/SIGNIFICANCE: Boc5 may produce metabolic benefits via multiple synergistic mechanisms and may represent an attractive tool for therapeutic intervention of obesity and diabetes, by means of non-peptidic GLP-1R agonism

Molecular and Evolutionary Bases of Within-Patient Genotypic and Phenotypic Diversity in Escherichia coli Extraintestinal Infections

Although polymicrobial infections, caused by combinations of viruses, bacteria, fungi and parasites, are being recognised with increasing frequency, little is known about the occurrence of within-species diversity in bacterial infections and the molecular and evolutionary bases of this diversity. We used multiple approaches to study the genomic and phenotypic diversity among 226 Escherichia coli isolates from deep and closed visceral infections occurring in 19 patients. We observed genomic variability among isolates from the same site within 11 patients. This diversity was of two types, as patients were infected either by several distinct E. coli clones (4 patients) or by members of a single clone that exhibit micro-heterogeneity (11 patients); both types of diversity were present in 4 patients. A surprisingly wide continuum of antibiotic resistance, outer membrane permeability, growth rate, stress resistance, red dry and rough morphotype characteristics and virulence properties were present within the isolates of single clones in 8 of the 11 patients showing genomic micro-heterogeneity. Many of the observed phenotypic differences within clones affected the trade-off between self-preservation and nutritional competence (SPANC). We showed in 3 patients that this phenotypic variability was associated with distinct levels of RpoS in co-existing isolates. Genome mutational analysis and global proteomic comparisons in isolates from a patient revealed a star-like relationship of changes amongst clonally diverging isolates. A mathematical model demonstrated that multiple genotypes with distinct RpoS levels can co-exist as a result of the SPANC trade-off. In the cases involving infection by a single clone, we present several lines of evidence to suggest diversification during the infectious process rather than an infection by multiple isolates exhibiting a micro-heterogeneity. Our results suggest that bacteria are subject to trade-offs during an infectious process and that the observed diversity resembled results obtained in experimental evolution studies. Whatever the mechanisms leading to diversity, our results have strong medical implications in terms of the need for more extensive isolate testing before deciding on antibiotic therapies

Two-particle BoseEinstein correlations in pp collisions at √s = 0.9 and 7 TeV measured with the ATLAS detector

The paper presents studies of Bose–Einstein Correlations (BEC) for pairs of like-sign charged particles measured in the kinematic range pT > 100 MeV and |η| <2.5 in proton–proton collisions at centre-of-mass energies of 0.9 and 7 TeV with the ATLAS detector at the CERN Large Hadron Collider. The integrated luminosities are approximately 7 μb−1, 190 μb−1 and 12.4 nb-1 for 0.9 TeV,7 TeV minimum-bias and 7 TeV high-multiplicity data samples, respectively. The multiplicity dependence of the BEC parameters characterizing the correlation strength and the correlation source size are investigated for charged-particle multiplicities of up to 240. A saturation effect in the multiplicity dependence of the correlation source size parameter is observed using the high-multiplicity 7 TeV data sample. The dependence of the BEC parameters on the average transverse momentum of the particle pair is also investigated

Post-transcriptional control during chronic inflammation and cancer: a focus on AU-rich elements

A considerable number of genes that code for AU-rich mRNAs including cytokines, growth factors, transcriptional factors, and certain receptors are involved in both chronic inflammation and cancer. Overexpression of these genes is affected by aberrations or by prolonged activation of several signaling pathways. AU-rich elements (ARE) are important cis-acting short sequences in the 3′UTR that mediate recognition of an array of RNA-binding proteins and affect mRNA stability and translation. This review addresses the cellular and molecular mechanisms that are common between inflammation and cancer and that also govern ARE-mediated post-transcriptional control. The first part examines the role of the ARE-genes in inflammation and cancer and sequence characteristics of AU-rich elements. The second part addresses the common signaling pathways in inflammation and cancer that regulate the ARE-mediated pathways and how their deregulations affect ARE-gene regulation and disease outcome