LIRA: Lifelong Image Restoration from Unknown Blended Distortions

Most existing image restoration networks are designed in a disposable way and catastrophically forget previously learned distortions when trained on a new distortion removal task. To alleviate this problem, we raise the novel lifelong image restoration problem for blended distortions. We first design a base fork-join model in which multiple pre-trained expert models specializing in individual distortion removal task work cooperatively and adaptively to handle blended distortions. When the input is degraded by a new distortion, inspired by adult neurogenesis in human memory system, we develop a neural growing strategy where the previously trained model can incorporate a new expert branch and continually accumulate new knowledge without interfering with learned knowledge. Experimental results show that the proposed approach can not only achieve state-of-the-art performance on blended distortions removal tasks in both PSNR/SSIM metrics, but also maintain old expertise while learning new restoration tasks.Comment: ECCV2020 accepte

Adult-Generated Hippocampal Neurons Allow the Flexible Use of Spatially Precise Learning Strategies

Despite enormous progress in the past few years the specific contribution of newly born granule cells to the function of the adult hippocampus is still not clear. We hypothesized that in order to solve this question particular attention has to be paid to the specific design, the analysis, and the interpretation of the learning test to be used. We thus designed a behavioral experiment along hypotheses derived from a computational model predicting that new neurons might be particularly relevant for learning conditions, in which novel aspects arise in familiar situations, thus putting high demands on the qualitative aspects of (re-)learning

Online Continual Learning on Sequences

Online continual learning (OCL) refers to the ability of a system to learn over time from a continuous stream of data without having to revisit previously encountered training samples. Learning continually in a single data pass is crucial for agents and robots operating in changing environments and required to acquire, fine-tune, and transfer increasingly complex representations from non-i.i.d. input distributions. Machine learning models that address OCL must alleviate \textit{catastrophic forgetting} in which hidden representations are disrupted or completely overwritten when learning from streams of novel input. In this chapter, we summarize and discuss recent deep learning models that address OCL on sequential input through the use (and combination) of synaptic regularization, structural plasticity, and experience replay. Different implementations of replay have been proposed that alleviate catastrophic forgetting in connectionists architectures via the re-occurrence of (latent representations of) input sequences and that functionally resemble mechanisms of hippocampal replay in the mammalian brain. Empirical evidence shows that architectures endowed with experience replay typically outperform architectures without in (online) incremental learning tasks.Comment: L. Oneto et al. (eds.), Recent Trends in Learning From Data, Studies in Computational Intelligence 89

Cellular and Behavioral Effects of Cranial Irradiation of the Subventricular Zone in Adult Mice

Background: In mammals, new neurons are added to the olfactory bulb (OB) throughout life. Most of these new neurons, granule and periglomerular cells originate from the subventricular zone (SVZ) lining the lateral ventricles and migrate via the rostral migratory stream toward the OB. Thousands of new neurons appear each day, but the function of this ongoing neurogenesis remains unclear. Methodology/Principal Findings: In this study, we irradiated adult mice to impair constitutive OB neurogenesis, and explored the functional impacts of this irradiation on the sense of smell. We found that focal irradiation of the SVZ greatly decreased the rate of production of new OB neurons, leaving other brain areas intact. This effect persisted for up to seven months after exposure to 15 Gray. Despite this robust impairment, the thresholds for detecting pure odorant molecules and short-term olfactory memory were not affected by irradiation. Similarly, the ability to distinguish between odorant molecules and the odorant-guided social behavior of irradiated mice were not affected by the decrease in the number of new neurons. Only long-term olfactory memory was found to be sensitive to SVZ irradiation. Conclusion/Significance: These findings suggest that the continuous production of adult-generated neurons is involved i

Microarray analysis of expression of cell death-associated genes in rat spinal cord cells exposed to cyclic tensile stresses in vitro

<p>Abstract</p> <p>Background</p> <p>The application of mechanical insults to the spinal cord results in profound cellular and molecular changes, including the induction of neuronal cell death and altered gene expression profiles. Previous studies have described alterations in gene expression following spinal cord injury, but the specificity of this response to mechanical stimuli is difficult to investigate in vivo. Therefore, we have investigated the effect of cyclic tensile stresses on cultured spinal cord cells from E15 Sprague-Dawley rats, using the FX3000^®Flexercell Strain Unit. We examined cell morphology and viability over a 72 hour time course. Microarray analysis of gene expression was performed using the Affymetrix GeneChip System^®, where categorization of identified genes was performed using the Gene Ontology (GO) and Kyoto Encyclopedia of Genes and Genomes (KEGG) systems. Changes in expression of 12 genes were validated with quantitative real-time reverse transcription polymerase chain reaction (RT-PCR).</p> <p>Results</p> <p>The application of cyclic tensile stress reduced the viability of cultured spinal cord cells significantly in a dose- and time-dependent manner. Increasing either the strain or the strain rate independently was associated with significant decreases in spinal cord cell survival. There was no clear evidence of additive effects of strain level with strain rate. GO analysis identified 44 candidate genes which were significantly related to "apoptosis" and 17 genes related to "response to stimulus". KEGG analysis identified changes in the expression levels of 12 genes of the mitogen-activated protein kinase (MAPK) signaling pathway, which were confirmed to be upregulated by RT-PCR analysis.</p> <p>Conclusions</p> <p>We have demonstrated that spinal cord cells undergo cell death in response to cyclic tensile stresses, which were dose- and time-dependent. In addition, we have identified the up regulation of various genes, in particular of the MAPK pathway, which may be involved in this cellular response. These data may prove useful, as the accurate knowledge of neuronal gene expression in response to cyclic tensile stress will help in the development of molecular-based therapies for spinal cord injury.</p

Early Natural Stimulation through Environmental Enrichment Accelerates Neuronal Development in the Mouse Dentate Gyrus

The dentate gyrus is the primary afferent into the hippocampal formation, with important functions in learning and memory. Granule cells, the principle neuronal type in the dentate gyrus, are mostly formed postnatally, in a process that continues into adulthood. External stimuli, including environmental enrichment, voluntary exercise and learning, have been shown to significantly accelerate the generation and maturation of dentate granule cells in adult rodents. Whether, and to what extent, such environmental stimuli regulate the development and maturation of dentate granule cells during early postnatal development is largely unknown. Furthermore, whether natural stimuli affect the synaptic properties of granule cells had been investigated neither in newborn neurons of the adult nor during early development. To examine the effect of natural sensory stimulation on the dentate gyrus, we reared newborn mice in an enriched environment (EE). Using immunohistochemistry, we showed that dentate granule cells from EE-reared mice exhibited earlier morphological maturation, manifested as faster peaking of doublecortin expression and elevated expression of mature neuronal markers (including NeuN, calbindin and MAP2) at the end of the second postnatal week. Also at the end of the second postnatal week, we found increased density of dendritic spines across the entire dentate gyrus, together with elevated levels of postsynaptic scaffold (post-synaptic density 95) and receptor proteins (GluR2 and GABAARγ2) of excitatory and inhibitory synapses. Furthermore, dentate granule cells of P14 EE-reared mice had lower input resistances and increased glutamatergic and GABAergic synaptic inputs. Together, our results demonstrate that EE-rearing promotes morphological and electrophysiological maturation of dentate granule cells, underscoring the importance of natural environmental stimulation on development of the dentate gyrus

Enhanced Functional Recovery in MRL/MpJ Mice after Spinal Cord Dorsal Hemisection

Adult MRL/MpJ mice have been shown to possess unique regeneration capabilities. They are able to heal an ear-punched hole or an injured heart with normal tissue architecture and without scar formation. Here we present functional and histological evidence for enhanced recovery following spinal cord injury (SCI) in MRL/MpJ mice. A control group (C57BL/6 mice) and MRL/MpJ mice underwent a dorsal hemisection at T9 (thoracic vertebra 9). Our data show that MRL/MpJ mice recovered motor function significantly faster and more completely. We observed enhanced regeneration of the corticospinal tract (CST). Furthermore, we observed a reduced astrocytic response and fewer micro-cavities at the injury site, which appear to create a more growth-permissive environment for the injured axons. Our data suggest that the reduced astrocytic response is in part due to a lower lesion-induced increase of cell proliferation post-SCI, and a reduced astrocytic differentiation of the proliferating cells. Interestingly, we also found an increased number of proliferating microglia, which could be involved in the MRL/MpJ spinal cord repair mechanisms. Finally, to evaluate the molecular basis of faster spinal cord repair, we examined the difference in gene expression changes in MRL/MpJ and C57BL/6 mice after SCI. Our microarray data support our histological findings and reveal a transcriptional profile associated with a more efficient spinal cord repair in MRL/MpJ mice

Role of C/EBPβ Transcription Factor in Adult Hippocampal Neurogenesis

[Background]: The dentate gyrus of the hippocampus is one of the regions in which neurogenesis takes place in the adult brain. We have previously demonstrated that CCAAT/enhancer binding protein β (C/EBPβ) is expressed in the granular layer of the dentate gyrus of the adult mouse hippocampus. Taking into account the important role of C/EBPβ in the consolidation of long term memory, the fact that newborn neurons in the hippocampus contribute to learning and memory processes, and the role of this transcription factor, previously demonstrated by our group, in regulating neuronal differentiation, we speculated that this transcription factor could regulate stem/progenitor cells in this region of the brain. [Methodologu/Principal Findings]: Here, we show, using C/EBPβ knockout mice, that C/EBPβ expression is observed in the subset of newborn cells that proliferate in the hippocampus of the adult brain. Mice lacking C/EBPβ present reduced survival of newborn cells in the hippocampus, a decrease in the number of these cells that differentiate into neurons and a diminished number of cells that are proliferating in the subgranular zone of the dentate gyrus. These results were further confirmed in vitro. Neurosphere cultures from adult mice deficient in C/EBPβ present less proliferation and neuronal differentiation than neurospheres derived from wild type mice. [Conclusions/Significance]: In summary, using in vivo and in vitro strategies, we have identified C/EBPβ as a key player in the proliferation and survival of the new neurons produced in the adult mouse hippocampus. Our results support a novel role of C/EBPβ in the processes of adult hippocampal neurogenesis, providing new insights into the mechanisms that control neurogenesis in this region of the brain.This work was supported by a postdoctoral fellowship of the Consejo Superior de Investigaciones Cientificas (M.C.-C.) Grant Sponsor: Ministerio de Investigación y Ciencia; Grant numbers: SAF2007-62811 and SAF2010-16365. CIBERNED is funded by the Instituto de Salud Carlos III.Peer reviewe

Learning to Learn: Theta Oscillations Predict New Learning, which Enhances Related Learning and Neurogenesis

Animals in the natural world continuously encounter learning experiences of varying degrees of novelty. New neurons in the hippocampus are especially responsive to learning associations between novel events and more cells survive if a novel and challenging task is learned. One might wonder whether new neurons would be rescued from death upon each new learning experience or whether there is an internal control system that limits the number of cells that are retained as a function of learning. In this experiment, it was hypothesized that learning a task that was similar in content to one already learned previously would not increase cell survival. We further hypothesized that in situations in which the cells are rescued hippocampal theta oscillations (3–12 Hz) would be involved and perhaps necessary for increasing cell survival. Both hypotheses were disproved. Adult male Sprague-Dawley rats were trained on two similar hippocampus-dependent tasks, trace and very-long delay eyeblink conditioning, while recording hippocampal local-field potentials. Cells that were generated after training on the first task were labeled with bromodeoxyuridine and quantified after training on both tasks had ceased. Spontaneous theta activity predicted performance on the first task and the conditioned stimulus induced a theta-band response early in learning the first task. As expected, performance on the first task correlated with performance on the second task. However, theta activity did not increase during training on the second task, even though more cells were present in animals that had learned. Therefore, as long as learning occurs, relatively small changes in the environment are sufficient to increase the number of surviving neurons in the adult hippocampus and they can do so in the absence of an increase in theta activity. In conclusion, these data argue against an upper limit on the number of neurons that can be rescued from death by learning

APP Intracellular Domain Impairs Adult Neurogenesis in Transgenic Mice by Inducing Neuroinflammation

A devastating aspect of Alzheimer's disease (AD) is the progressive deterioration of memory due to neuronal loss. Amyloid precursor protein (APP) occupies a central position in AD and APP-derived amyloid-β (Aβ) peptides are thought to play a pivotal role in disease pathogenesis. Nonetheless, it is becoming clear that AD etiology is highly complex and that factors other than Aβ also contribute to AD pathogenesis. APP intracellular domain (AICD) is generated together with Aβ and we recently showed that AICD transgenic mice recapitulate pathological features of AD such as tau hyperphosphorylation, memory deficits and neurodegeneration without increasing the Aβ levels. Since impaired adult neurogenesis is shown to augment memory deficits in AD mouse models, here we examined the status of adult neurogenesis in AICD transgenic mice.We previously generated transgenic mice co-expressing 59-residue long AICD fragment and its binding partner Fe65. Hippocampal progenitor cell proliferation was determined by BrdU incorporation at 1.5, 3 and 12 months of age. Only male transgenic and their respective wilt type littermate control mice were used. We find age-dependent decrease in BrdU incorporation and doublecortin-positive cells in the dentate gyrus of AICD transgenic mice suggesting impaired adult neurogenesis. This deficit resulted from decreased proliferation and survival, whereas neuronal differentiation remained unaffected. Importantly, this impairment was independent of Aβ since APP-KO mice expressing AICD also exhibit reduced neurogenesis. The defects in adult neurogenesis are prevented by long-term treatment with the non-steroidal anti-inflammatory agents ibuprofen or naproxen suggesting that neuroinflammation is critically involved in impaired adult neurogenesis in AICD transgenic mice.Since adult neurogenesis is crucial for spatial memory, which is particularly vulnerable in AD, these findings suggest that AICD can exacerbate memory defects in AD by impairing adult neurogenesis. Our findings further establish that AICD, in addition to Aβ, contributes to AD pathology and that neuroinflammation plays a much broader role in AD pathogenesis than previously thought