Lifelong Learning of Spatiotemporal Representations with Dual-Memory Recurrent Self-Organization

Artificial autonomous agents and robots interacting in complex environments are required to continually acquire and fine-tune knowledge over sustained periods of time. The ability to learn from continuous streams of information is referred to as lifelong learning and represents a long-standing challenge for neural network models due to catastrophic forgetting. Computational models of lifelong learning typically alleviate catastrophic forgetting in experimental scenarios with given datasets of static images and limited complexity, thereby differing significantly from the conditions artificial agents are exposed to. In more natural settings, sequential information may become progressively available over time and access to previous experience may be restricted. In this paper, we propose a dual-memory self-organizing architecture for lifelong learning scenarios. The architecture comprises two growing recurrent networks with the complementary tasks of learning object instances (episodic memory) and categories (semantic memory). Both growing networks can expand in response to novel sensory experience: the episodic memory learns fine-grained spatiotemporal representations of object instances in an unsupervised fashion while the semantic memory uses task-relevant signals to regulate structural plasticity levels and develop more compact representations from episodic experience. For the consolidation of knowledge in the absence of external sensory input, the episodic memory periodically replays trajectories of neural reactivations. We evaluate the proposed model on the CORe50 benchmark dataset for continuous object recognition, showing that we significantly outperform current methods of lifelong learning in three different incremental learning scenario

Neural synchrony in cortical networks : history, concept and current status

Following the discovery of context-dependent synchronization of oscillatory neuronal responses in the visual system, the role of neural synchrony in cortical networks has been expanded to provide a general mechanism for the coordination of distributed neural activity patterns. In the current paper, we present an update of the status of this hypothesis through summarizing recent results from our laboratory that suggest important new insights regarding the mechanisms, function and relevance of this phenomenon. In the first part, we present recent results derived from animal experiments and mathematical simulations that provide novel explanations and mechanisms for zero and nero-zero phase lag synchronization. In the second part, we shall discuss the role of neural synchrony for expectancy during perceptual organization and its role in conscious experience. This will be followed by evidence that indicates that in addition to supporting conscious cognition, neural synchrony is abnormal in major brain disorders, such as schizophrenia and autism spectrum disorders. We conclude this paper with suggestions for further research as well as with critical issues that need to be addressed in future studies

Neural synchrony in cortical networks : history, concept and current status

Following the discovery of context-dependent synchronization of oscillatory neuronal responses in the visual system, the role of neural synchrony in cortical networks has been expanded to provide a general mechanism for the coordination of distributed neural activity patterns. In the current paper, we present an update of the status of this hypothesis through summarizing recent results from our laboratory that suggest important new insights regarding the mechanisms, function and relevance of this phenomenon. In the first part, we present recent results derived from animal experiments and mathematical simulations that provide novel explanations and mechanisms for zero and nero-zero phase lag synchronization. In the second part, we shall discuss the role of neural synchrony for expectancy during perceptual organization and its role in conscious experience. This will be followed by evidence that indicates that in addition to supporting conscious cognition, neural synchrony is abnormal in major brain disorders, such as schizophrenia and autism spectrum disorders. We conclude this paper with suggestions for further research as well as with critical issues that need to be addressed in future studies

Incremental construction of LSTM recurrent neural network

Long Short--Term Memory (LSTM) is a recurrent neural network that uses structures called memory blocks to allow the net remember significant events distant in the past input sequence in order to solve long time lag tasks, where other RNN approaches fail. Throughout this work we have performed experiments using LSTM networks extended with growing abilities, which we call GLSTM. Four methods of training growing LSTM has been compared. These methods include cascade and fully connected hidden layers as well as two different levels of freezing previous weights in the cascade case. GLSTM has been applied to a forecasting problem in a biomedical domain, where the input/output behavior of five controllers of the Central Nervous System control has to be modelled. We have compared growing LSTM results against other neural networks approaches, and our work applying conventional LSTM to the task at hand.Postprint (published version

Magnetoencephalography as a tool in psychiatric research: current status and perspective

The application of neuroimaging to provide mechanistic insights into circuit dysfunctions in major psychiatric conditions and the development of biomarkers are core challenges in current psychiatric research. In this review, we propose that recent technological and analytic advances in Magnetoencephalography (MEG), a technique which allows the measurement of neuronal events directly and non-invasively with millisecond resolution, provides novel opportunities to address these fundamental questions. Because of its potential in delineating normal and abnormal brain dynamics, we propose that MEG provides a crucial tool to advance our understanding of pathophysiological mechanisms of major neuropsychiatric conditions, such as Schizophrenia, Autism Spectrum Disorders, and the dementias. In our paper, we summarize the mechanisms underlying the generation of MEG signals and the tools available to reconstruct generators and underlying networks using advanced source-reconstruction techniques. We then survey recent studies that have utilized MEG to examine aberrant rhythmic activity in neuropsychiatric disorders. This is followed by links with preclinical research, which have highlighted possible neurobiological mechanisms, such as disturbances in excitation/inhibition parameters, which could account for measured changes in neural oscillations. In the final section of the paper, challenges as well as novel methodological developments are discussed which could pave the way for a widespread application of MEG in translational research with the aim of developing biomarkers for early detection and diagnosis

Working memory revived in older adults by synchronizing rhythmic brain circuits

Published in final edited form as: Nat Neurosci. 2019 May ; 22(5): 820–827. doi:10.1038/s41593-019-0371-x.Understanding normal brain aging and developing methods to maintain or improve cognition in older adults are major goals of fundamental and translational neuroscience. Here we show a core feature of cognitive decline—working-memory deficits—emerges from disconnected local and long-range circuits instantiated by theta–gamma phase–amplitude coupling in temporal cortex and theta phase synchronization across frontotemporal cortex. We developed a noninvasive stimulation procedure for modulating long-range theta interactions in adults aged 60–76 years. After 25 min of stimulation, frequency-tuned to individual brain network dynamics, we observed a preferential increase in neural synchronization patterns and the return of sender–receiver relationships of information flow within and between frontotemporal regions. The end result was rapid improvement in working-memory performance that outlasted a 50 min post-stimulation period. The results provide insight into the physiological foundations of age-related cognitive impairment and contribute to groundwork for future non-pharmacological interventions targeting aspects of cognitive decline.Accepted manuscrip

Brain rhythms of pain

Pain is an integrative phenomenon that results from dynamic interactions between sensory and contextual (i.e., cognitive, emotional, and motivational) processes. In the brain the experience of pain is associated with neuronal oscillations and synchrony at different frequencies. However, an overarching framework for the significance of oscillations for pain remains lacking. Recent concepts relate oscillations at different frequencies to the routing of information flow in the brain and the signaling of predictions and prediction errors. The application of these concepts to pain promises insights into how flexible routing of information flow coordinates diverse processes that merge into the experience of pain. Such insights might have implications for the understanding and treatment of chronic pain

A computational study on altered theta-gamma coupling during learning and phase coding

There is considerable interest in the role of coupling between theta and gamma oscillations in the brain in the context of learning and memory. Here we have used a neural network model which is capable of producing coupling of theta phase to gamma amplitude firstly to explore its ability to reproduce reported learning changes and secondly to memory-span and phase coding effects. The spiking neural network incorporates two kinetically different GABAA receptor-mediated currents to generate both theta and gamma rhythms and we have found that by selective alteration of both NMDA receptors and GABAA,slow receptors it can reproduce learning-related changes in the strength of coupling between theta and gamma either with or without coincident changes in theta amplitude. When the model was used to explore the relationship between theta and gamma oscillations, working memory capacity and phase coding it showed that the potential storage capacity of short term memories, in terms of nested gamma-subcycles, coincides with the maximal theta power. Increasing theta power is also related to the precision of theta phase which functions as a potential timing clock for neuronal firing in the cortex or hippocampus

Oscillations, metastability and phase transitions in brain and models of cognition

Neuroscience is being practiced in many different forms and at many different organizational levels of the Nervous System. Which of these levels and associated conceptual frameworks is most informative for elucidating the association of neural processes with processes of Cognition is an empirical question and subject to pragmatic validation. In this essay, I select the framework of Dynamic System Theory. Several investigators have applied in recent years tools and concepts of this theory to interpretation of observational data, and for designing neuronal models of cognitive functions. I will first trace the essentials of conceptual development and hypotheses separately for discerning observational tests and criteria for functional realism and conceptual plausibility of the alternatives they offer. I will then show that the statistical mechanics of phase transitions in brain activity, and some of its models, provides a new and possibly revealing perspective on brain events in cognition