Overcoming catastrophic forgetting in neural networks

The ability to learn tasks in a sequential fashion is crucial to the development of artificial intelligence. Until now neural networks have not been capable of this and it has been widely thought that catastrophic forgetting is an inevitable feature of connectionist models. We show that it is possible to overcome this limitation and train networks that can maintain expertise on tasks that they have not experienced for a long time. Our approach remembers old tasks by selectively slowing down learning on the weights important for those tasks. We demonstrate our approach is scalable and effective by solving a set of classification tasks based on a hand-written digit dataset and by learning several Atari 2600 games sequentially

The PPCD1 Mouse: Characterization of a Mouse Model for Posterior Polymorphous Corneal Dystrophy and Identification of a Candidate Gene

The PPCD1 mouse, a spontaneous mutant that arose in our mouse colony, is characterized by an enlarged anterior chamber resulting from metaplasia of the corneal endothelium and blockage of the iridocorneal angle by epithelialized corneal endothelial cells. The presence of stratified multilayered corneal endothelial cells with abnormal patterns of cytokeratin expression are remarkably similar to those observed in human posterior polymorphous corneal dystrophy (PPCD) and the sporadic condition, iridocorneal endothelial syndrome. Affected eyes exhibit epithelialized corneal endothelial cells, with inappropriate cytokeratin expression and proliferation over the iridocorneal angle and posterior cornea. We have termed this the “mouse PPCD1” phenotype and mapped the mouse locus for this phenotype, designated “Ppcd1”, to a 6.1 Mbp interval on Chromosome 2, which is syntenic to the human Chromosome 20 PPCD1 interval. Inheritance of the mouse PPCD1 phenotype is autosomal dominant, with complete penetrance on the sensitive DBA/2J background and decreased penetrance on the C57BL/6J background. Comparative genome hybridization has identified a hemizygous 78 Kbp duplication in the mapped interval. The endpoints of the duplication are located in positions that disrupt the genes Csrp2bp and 6330439K17Rik and lead to duplication of the pseudogene LOC100043552. Quantitative reverse transcriptase-PCR indicates that expression levels of Csrp2bp and 6330439K17Rik are decreased in eyes of PPCD1 mice. Based on the observations of decreased gene expression levels, association with ZEB1-related pathways, and the report of corneal opacities in Csrp2bptm1a(KOMP)Wtsi heterozygotes and embryonic lethality in nulls, we postulate that duplication of the 78 Kbp segment leading to haploinsufficiency of Csrp2bp is responsible for the mouse PPCD1 phenotype. Similarly, CSRP2BP haploinsufficiency may lead to human PPCD

Targeted Inactivation of p12Cdk2ap1, CDK2 Associating Protein 1, Leads to Early Embryonic Lethality

Targeted disruption of murine Cdk2ap1, an inhibitor of CDK2 function and hence G1/S transition, results in the embryonic lethality with a high penetration rate. Detailed timed pregnancy analysis of embryos showed that the lethality occurred between embryonic day 3.5 pc and 5.5 pc, a period of implantation and early development of implanted embryos. Two homozygous knockout mice that survived to term showed identical craniofacial defect, including a short snout and a round forehead. Examination of craniofacial morphology by measuring Snout Length (SL) vs. Face Width (FW) showed that the Cdk2ap1+/− mice were born with a reduced SL/FW ratio compared to the Cdk2ap1+/+ and the reduction was more pronounced in Cdk2ap1−/− mice. A transgenic rescue of the lethality was attempted by crossing Cdk2ap1+/− animals with K14-Cdk2ap1 transgenic mice. Resulting Cdk2ap1+/−:K14-Cdk2ap1 transgenic mice showed an improved incidence of full term animals (16.7% from 0.5%) on a Cdk2ap1−/− background. Transgenic expression of Cdk2ap1 in Cdk2ap1−/−:K14-Cdk2ap1 animals restored SL/FW ratio to the level of Cdk2ap1+/−:K14-Cdk2ap1 mice, but not to that of the Cdk2ap1+/+:K14-Cdk2ap1 mice. Teratoma formation analysis using mESCs showed an abrogated in vivo pluripotency of Cdk2ap1−/− mESCs towards a restricted mesoderm lineage specification. This study demonstrates that Cdk2ap1 plays an essential role in the early stage of embryogenesis and has a potential role during craniofacial morphogenesis

Expression profiling in transgenic FVB/N embryonic stem cells overexpressing STAT3

BACKGROUND: The transcription factor STAT3 is a downstream target of the LIF signalling cascade. LIF signalling or activation is sufficient to maintain embryonic stem (ES) cells in an undifferentiated and pluripotent state. To further investigate the importance of STAT3 in the establishment of ES cells we have in a first step derived stable pluripotent embryonic stem cells from transgenic FVB mice expressing a conditional tamoxifen dependent STAT3-MER fusion protein. In a second step, STAT3-MER overexpressing cells were used to identify STAT3 pathway-related genes by expression profiling in order to identify new key-players involved in maintenance of pluripotency in ES cells. RESULTS: Transgenic STAT3-MER blastocysts yielded pluripotent germline-competent ES cells at a high frequency in the absence of LIF when established in tamoxifen-containing medium. Expression profiling of tamoxifen-induced transgenic FVB ES cell lines revealed a set of 26 genes that were markedly up- or down-regulated when compared with wild type cells. The expression of four of the up-regulated genes (Hexokinase II, Lefty2, Pramel7, PP1rs15B) was shown to be restricted to the inner cell mass (ICM) of the blastocysts. These differentially expressed genes represent potential candidates for the maintenance of pluripotency of ES cells. We finally overexpressed two candidate genes, Pem/Rhox5 and Pramel7, in ES cells and demonstrated that their overexpression is sufficient for the maintenance of expression of ES cell markers as well as of the typical morphology of pluripotent ES cells in absence of LIF. CONCLUSION: Overexpression of STAT3-MER in the inner cell mass of blastocyst facilitates the establishment of ES cells and induces the upregulation of potential candidate genes involved in the maintenance of pluripotency. Two of them, Pem/Rhox5 and Pramel7, when overexpressed in ES cells are able to maintain the embryonic stem cells in a pluripotent state in a LIF independent manner as STAT3 or Nanog

Expression of hereditary hemochromatosis C282Y HFE protein in HEK293 cells activates specific endoplasmic reticulum stress responses

<p>Abstract</p> <p>Background</p> <p>Hereditary Hemochromatosis (HH) is a genetic disease associated with iron overload, in which individuals homozygous for the mutant C282Y <it>HFE </it>associated allele are at risk for the development of a range of disorders particularly liver disease. Conformational diseases are a class of disorders associated with the expression of misfolded protein. HFE C282Y is a mutant protein that does not fold correctly and consequently is retained in the Endoplasmic Reticulum (ER). In this context, we sought to identify ER stress signals associated with mutant C282Y HFE protein expression, which may have a role in the molecular pathogenesis of HH.</p> <p>Results</p> <p>Vector constructs of Wild type HFE and Mutant C282Y HFE were made and transfected into HEK293 cell lines. We have shown that expression of C282Y HFE protein triggers both an unfolded protein response (UPR), as revealed by the increased GRP78, ATF6 and CHOP expression, and an ER overload response (EOR), as indicated by NF-κB activation. Furthermore, C282Y HFE protein induced apoptotic responses associated with activation of ER stress. Inhibition studies demonstrated that tauroursodeoxycholic acid, an endogenous bile acid, downregulates these events. Finally, we found that the co-existence of both C282Y HFE and Z alpha 1-antitrypsin protein (the protein associated with the liver disease of Z alpha 1-antitrypsin deficiency) expression on ER stress responses acted as potential disease modifiers with respect to each other.</p> <p>Conclusion</p> <p>Our novel observations suggest that both the ER overload response (EOR) and the unfolded protein response (UPR) are activated by mutant C282Y HFE protein.</p

A comparison of four fibrosis indexes in chronic HCV: Development of new fibrosis-cirrhosis index (FCI)

<p>Abstract</p> <p>Background</p> <p>Hepatitis C can lead to liver fibrosis and cirrhosis. We compared readily available non-invasive fibrosis indexes for the fibrosis progression discrimination to find a better combination of existing non-invasive markers.</p> <p>Methods</p> <p>We studied 157 HCV infected patients who underwent liver biopsy. In order to differentiate HCV fibrosis progression, readily available AAR, APRI, FI and FIB-4 serum indexes were tested in the patients. We derived a new fibrosis-cirrhosis index (FCI) comprised of ALP, bilirubin, serum albumin and platelet count. FCI = [(ALP × Bilirubin) / (Albumin × Platelet count)].</p> <p>Results</p> <p>Already established serum indexes AAR, APRI, FI and FIB-4 were able to stage liver fibrosis with correlation coefficient indexes 0.130, 0.444, 0.578 and 0.494, respectively. Our new fibrosis cirrhosis index FCI significantly correlated with the histological fibrosis stages F0-F1, F2-F3 and F4 (r = 0.818, p < 0.05) with AUROCs 0.932 and 0.996, respectively. The sensitivity and PPV of FCI at a cutoff value < 0.130 for predicting fibrosis stage F0-F1 was 81% and 82%, respectively with AUROC 0.932. Corresponding value of FCI at a cutoff value ≥1.25 for the prediction of cirrhosis was 86% and 100%.</p> <p>Conclusions</p> <p>The fibrosis-cirrhosis index (FCI) accurately predicted fibrosis stages in HCV infected patients and seems more efficient than frequently used serum indexes.</p