Generative Models from the perspective of Continual Learning

Which generative model is the most suitablefor Continual Learning? This paper aims at evaluating andcomparing generative models on disjoint sequential imagegeneration tasks. We investigate how several models learn andforget, considering various strategies: rehearsal, regularization,generative replay and fine-tuning. We used two quantitativemetrics to estimate the generation quality and memory ability.We experiment with sequential tasks on three commonly usedbenchmarks for Continual Learning (MNIST, Fashion MNISTand CIFAR10). We found that among all models, the originalGAN performs best and among Continual Learning strategies,generative replay outperforms all other methods. Even ifwe found satisfactory combinations on MNIST and FashionMNIST, training generative models sequentially on CIFAR10is particularly instable, and remains a challenge. Our code isavailable online

Deterministic approach to microscopic three-phase traffic theory

Two different deterministic microscopic traffic flow models, which are in the context of the Kerner's there-phase traffic theory, are introduced. In an acceleration time delay model (ATD-model), different time delays in driver acceleration associated with driver behaviour in various local driving situations are explicitly incorporated into the model. Vehicle acceleration depends on local traffic situation, i.e., whether a driver is within the free flow, or synchronized flow, or else wide moving jam traffic phase. In a speed adaptation model (SA-model), vehicle speed adaptation occurs in synchronized flow depending on driving conditions. It is found that the ATD- and SA-models show spatiotemporal congested traffic patterns that are adequate with empirical results. In the ATD- and SA-models, the onset of congestion in free flow at a freeway bottleneck is associated with a first-order phase transition from free flow to synchronized flow; moving jams emerge spontaneously in synchronized flow only. Differences between the ATD- and SA-models are studied. A comparison of the ATD- and SA-models with stochastic models in the context of three phase traffic theory is made. A critical discussion of earlier traffic flow theories and models based on the fundamental diagram approach is presented.Comment: 40 pages, 14 figure

Reciprocal Changes in Factor XIII and Retinal Transglutaminase Expressions in the Fish Retina During Optic Nerve Regeneration

[email protected] mammals, fish retinal ganglion cells have the capacity to repair their axons even after optic nerve transection. In the process of fish optic nerve regeneration, a large number of genes have been described as regeneration-associated molecules. Using molecular cloning techniques, we identified two types of cDNA clones belonging to the transglutaminase (TG) family which were upregulation genes; one is cellular factor XIII (cFXIII) and the other is a tissue type TG named retinal transglutaminase (TGR). cFXIII mRNA started to increase in the retinal ganglion cells at 1-2 days, peaked at 5-7 days, and returned to the control level by 20 days post optic nerve injury. In contrast, TGR mRNA started to increase at day 5-10, peaked at day 20, and then gradually decreased by day 40 after nerve injury. To elucidate the molecular involvement of these TGs in optic nerve regeneration, we studied the effects of recombinant TGR protein or overexpression of cFXIII using a retinal explant culture system. cFXIII effectively induced neurite outgrowth only from naïve (intact) retinas. In contrast, the TGR protein significantly enhanced neurite outgrowth only from primed retinas, in which the optic nerve had been crushed 5-7 days previously. These reciprocal expressions of cFXIII and TGR suggest that these two types of TGs are important for the neurite sprouting and axonal elongation processes, respectively, during optic nerve regeneration processes

In Vivo Regulation of Glycogen Synthase Kinase-3β (GSK3β) by Serotonergic Activity in Mouse Brain

The goal of this study was to determine if serotonergic activity, which is impaired in depression, regulates the phosphorylation of glycogen synthase kinase-3β (GSK3β) in mouse brain in vivo. GSK3β is inhibited by phosphorylation on serine-9 and is a target of the mood stabilizer lithium. Following administration to mice of d-fenfluramine to stimulate serotonin (5HT) release and reduce its reuptake, and clorgyline to inhibit 5HT catabolism, levels of phospho-Ser9-GSK3β were 300–400% of control levels in the prefrontal cortex, hippocampus, and striatum. Treatment with monoamine reuptake inhibitors fluoxetine and imipramine also increased the level of phospho-Ser9-GSK3β. Using receptor selective agonists and antagonists, 5HT1A receptors were found to mediate increases, and 5HT2 receptors decreases, in phospho-Ser9-GSK3β levels. This indicates that serotonergic regulation of the phosphorylation of GSK3β is achieved by a balance between the opposing actions of these 5HT receptor subtypes. These findings demonstrate for the first time that serotonergic activity regulates the phosphorylation of GSK3β and show that this regulation occurs in mammalian brain in vivo. These results raise the possibility that impaired inhibitory control of GSK3β may occur in conditions where serotonergic activity is dysregulated, such as in mood disorders

14-3-3theta Protects against Neurotoxicity in a Cellular Parkinson's Disease Model through Inhibition of the Apoptotic Factor Bax

Disruption of 14-3-3 function by alpha-synuclein has been implicated in Parkinson's disease. As 14-3-3s are important regulators of cell death pathways, disruption of 14-3-3s could result in the release of pro-apoptotic factors, such as Bax. We have previously shown that overexpression of 14-3-3θ reduces cell loss in response to rotenone and MPP+ in dopaminergic cell culture and reduces cell loss in transgenic C. elegans that overexpress alpha-synuclein. In this study, we investigate the mechanism for 14-3-3θ's neuroprotection against rotenone toxicity. While 14-3-3s can inhibit many pro-apoptotic factors, we demonstrate that inhibition of one factor in particular, Bax, is important to 14-3-3s' protection against rotenone toxicity in dopaminergic cells. We found that 14-3-3θ overexpression reduced Bax activation and downstream signaling events, including cytochrome C release and caspase 3 activation. Pharmacological inhibition or shRNA knockdown of Bax provided protection against rotenone, comparable to 14-3-3θ's neuroprotective effects. A 14-3-3θ mutant incapable of binding Bax failed to protect against rotenone. These data suggest that 14-3-3θ's neuroprotective effects against rotenone are at least partially mediated by Bax inhibition and point to a potential therapeutic role of 14-3-3s in Parkinson's disease

Significant Association of Estrogen Receptor Binding Site Variation with Bipolar Disorder in Females

Major depression is nearly twice as prevalent in women compared to men. In bipolar disorder, depressive episodes have been reported to be more common amongst female patients. Furthermore, periods of depression often correlate with periods of hormonal fluctuations. A link between hormone signaling and these mood disorders has, therefore, been suggested to exist in many studies. Estrogen, one of the primary female sex hormones, mediates its effect mostly by binding to estrogen receptors (ERs). Nuclear ERs function as transcription factors and regulate gene transcription by binding to specific DNA sequences. A nucleotide change in the binding sequence might alter the binding efficiency, which could affect transcription levels of nearby genes. In order to investigate if variation in ER DNA-binding sequences may be involved in mood disorders, we conducted a genome-wide study of ER DNA-binding in patients diagnosed with major depression or bipolar disorder. Association studies were performed within each gender separately and the results were corrected for multiple testing by the Bonferroni method. In the female bipolar disorder material a significant association result was found for rs6023059 (corrected p-value = 0.023; odds ratio (OR) 0.681, 95% confidence interval (CI) 0.570–0.814), a single nucleotide polymorphism (SNP) placed downstream of the gene coding for transglutaminase 2 (TGM2). Thus, females with a specific genotype at this SNP may be more vulnerable to fluctuating estrogen levels, which may then act as a triggering factor for bipolar disorder

Accessible Cultural Heritage through Explainable Artificial Intelligence

International audienceEthics Guidelines for Trustworthy AI advocate for AI technology that is, among other things, more inclusive. Explainable AI (XAI) aims at making state of the art opaque models more transparent, and defends AI-based outcomes endorsed with a rationale explanation, i.e., an explanation that has as target the non-technical users. XAI and Responsible AI principles defend the fact that the audience expertise should be included in the evaluation of explainable AI systems. However, AI has not yet reached all public and audiences , some of which may need it the most. One example of domain where accessibility has not much been influenced by the latest AI advances is cultural heritage. We propose including minorities as special user and evaluator of the latest XAI techniques. In order to define catalytic scenarios for collaboration and improved user experience, we pose some challenges and research questions yet to address by the latest AI models likely to be involved in such synergy

Transglutaminase activation in neurodegenerative diseases

The following review examines the role of calcium in promoting the in vitro and in vivo activation of transglutaminases in neurodegenerative disorders. Diseases such as Alzheimer's disease, Parkinson's disease and Huntington's disease exhibit increased transglutaminase activity and rises in intracellular calcium concentrations, which may be related. The aberrant activation of transglutaminase by calcium is thought to give rise to a variety of pathological moieties in these diseases, and the inhibition has been shown to have therapeutic benefit in animal and cellular models of neurodegeneration. Given the potential clinical relevance of transglutaminase inhibitors, we have also reviewed the recent development of such compounds

Transglutaminase 6: a protein associated with central nervous system development and motor function.

Transglutaminases (TG) form a family of enzymes that catalyse various post-translational modifications of glutamine residues in proteins and peptides including intra- and intermolecular isopeptide bond formation, esterification and deamidation. We have characterized a novel member of the mammalian TG family, TG6, which is expressed in a human carcinoma cell line with neuronal characteristics and in mouse brain. Besides full-length protein, alternative splicing results in a short variant lacking the second β-barrel domain in man and a variant with truncated β-sandwich domain in mouse. Biochemical data show that TG6 is allosterically regulated by Ca(2+) and guanine nucleotides. Molecular modelling indicates that TG6 could have Ca(2+) and GDP-binding sites related to those of TG3 and TG2, respectively. Localization of mRNA and protein in the mouse identified abundant expression of TG6 in the central nervous system. Analysis of its temporal and spatial pattern of induction in mouse development indicates an association with neurogenesis. Neuronal expression of TG6 was confirmed by double-labelling of mouse forebrain cells with cell type-specific markers. Induction of differentiation in mouse Neuro 2a cells with NGF or dibutyryl cAMP is associated with an upregulation of TG6 expression. Familial ataxia has recently been linked to mutations in the TGM6 gene. Autoantibodies to TG6 were identified in immune-mediated ataxia in patients with gluten sensitivity. These findings suggest a critical role for TG6 in cortical and cerebellar neurons