A Bio-Logical Theory of Animal Learning

This article provides the foundation for a new predictive theory of animal learning that is based upon a simple logical model. The knowledge of experimental subjects at a given time is described using logical equations. These logical equations are then used to predict a subject’s response when presented with a known or a previously unknown situation. This new theory suc- cessfully anticipates phenomena that existing theories predict, as well as phenomena that they cannot. It provides a theoretical account for phenomena that are beyond the domain of existing models, such as extinction and the detection of novelty, from which “external inhibition” can be explained. Examples of the methods applied to make predictions are given using previously published results. The present theory proposes a new way to envision the minimal functions of the nervous system, and provides possible new insights into the way that brains ultimately create and use knowledge about the world

Overshadowing by fixed- and variable-duration stimuli

Two experiments investigated the effect of the temporal distribution form of a stimulus on its ability to produce an overshadowing effect. The overshadowing stimuli were either of the same duration on every trial, or of a variable duration drawn from an exponential distribution with the same mean duration as that of the fixed stimulus. Both experiments provided evidence that a variable-duration stimulus was less effective than a fixed-duration cue at overshadowing conditioning to a target conditioned stimulus (CS); moreover, this effect was independent of whether the overshadowed CS was fixed or variable. The findings presented here are consistent with the idea that the strength of the association between CS and unconditioned stimulus (US) is, in part, determined by the temporal distribution form of the CS. These results are discussed in terms of time-accumulation and trial-based theories of conditioning and timing

Role of MeCP2, DNA methylation, and HDACs in regulating synapse function

Over the past several years there has been intense effort to delineate the role of epigenetic factors, including methyl-CpG-binding protein 2, histone deacetylases, and DNA methyltransferases, in synaptic function. Studies from our group as well as others have shown that these key epigenetic mechanisms are critical regulators of synapse formation, maturation, as well as function. Although most studies have identified selective deficits in excitatory neurotransmission, the latest work has also uncovered deficits in inhibitory neurotransmission as well. Despite the rapid pace of advances, the exact synaptic mechanisms and gene targets that mediate these effects on neurotransmission remain unclear. Nevertheless, these findings not only open new avenues for understanding neuronal circuit abnormalities associated with neurodevelopmental disorders but also elucidate potential targets for addressing the pathophysiology of several intractable neuropsychiatric disorders

Murine GRPR and Stathmin Control in Opposite Directions both Cued Fear Extinction and Neural Activities of the Amygdala and Prefrontal Cortex

Extinction is an integral part of normal healthy fear responses, while it is compromised in several fear-related mental conditions in humans, such as post-traumatic stress disorder (PTSD). Although much research has recently been focused on fear extinction, its molecular and cellular underpinnings are still unclear. The development of animal models for extinction will greatly enhance our approaches to studying its neural circuits and the mechanisms involved. Here, we describe two gene-knockout mouse lines, one with impaired and another with enhanced extinction of learned fear. These mutant mice are based on fear memory-related genes, stathmin and gastrin-releasing peptide receptor (GRPR). Remarkably, both mutant lines showed changes in fear extinction to the cue but not to the context. We performed indirect imaging of neuronal activity on the second day of cued extinction, using immediate-early gene c-Fos. GRPR knockout mice extinguished slower (impaired extinction) than wildtype mice, which was accompanied by an increase in c-Fos activity in the basolateral amygdala and a decrease in the prefrontal cortex. By contrast, stathmin knockout mice extinguished faster (enhanced extinction) and showed a decrease in c-Fos activity in the basolateral amygdala and an increase in the prefrontal cortex. At the same time, c-Fos activity in the dentate gyrus was increased in both mutant lines. These experiments provide genetic evidence that the balance between neuronal activities of the amygdala and prefrontal cortex defines an impairment or facilitation of extinction to the cue while the hippocampus is involved in the context-specificity of extinction

Double Dissociation of Amygdala and Hippocampal Contributions to Trace and Delay Fear Conditioning

A key finding in studies of the neurobiology of learning memory is that the amygdala is critically involved in Pavlovian fear conditioning. This is well established in delay-cued and contextual fear conditioning; however, surprisingly little is known of the role of the amygdala in trace conditioning. Trace fear conditioning, in which the CS and US are separated in time by a trace interval, requires the hippocampus and prefrontal cortex. It is possible that recruitment of cortical structures by trace conditioning alters the role of the amygdala compared to delay fear conditioning, where the CS and US overlap. To investigate this, we inactivated the amygdala of male C57BL/6 mice with GABA A agonist muscimol prior to 2-pairing trace or delay fear conditioning. Amygdala inactivation produced deficits in contextual and delay conditioning, but had no effect on trace conditioning. As controls, we demonstrate that dorsal hippocampal inactivation produced deficits in trace and contextual, but not delay fear conditioning. Further, pre- and post-training amygdala inactivation disrupted the contextual but the not cued component of trace conditioning, as did muscimol infusion prior to 1- or 4-pairing trace conditioning. These findings demonstrate that insertion of a temporal gap between the CS and US can generate amygdala-independent fear conditioning. We discuss the implications of this surprising finding for current models of the neural circuitry involved in fear conditioning

A Novel Task for the Investigation of Action Acquisition

We present a behavioural task designed for the investigation of how novel instrumental actions are discovered and learnt. The task consists of free movement with a manipulandum, during which the full range of possible movements can be explored by the participant and recorded. A subset of these movements, the ‘target’, is set to trigger a reinforcing signal. The task is to discover what movements of the manipulandum evoke the reinforcement signal. Targets can be defined in spatial, temporal, or kinematic terms, can be a combination of these aspects, or can represent the concatenation of actions into a larger gesture. The task allows the study of how the specific elements of behaviour which cause the reinforcing signal are identified, refined and stored by the participant. The task provides a paradigm where the exploratory motive drives learning and as such we view it as in the tradition of Thorndike [1]. Most importantly it allows for repeated measures, since when a novel action is acquired the criterion for triggering reinforcement can be changed requiring a new action to be discovered. Here, we present data using both humans and rats as subjects, showing that our task is easily scalable in difficulty, adaptable across species, and produces a rich set of behavioural measures offering new and valuable insight into the action learning process

Variation in the Large-Scale Organization of Gene Expression Levels in the Hippocampus Relates to Stable Epigenetic Variability in Behavior

Despite sharing the same genes, identical twins demonstrate substantial variability in behavioral traits and in their risk for disease. Epigenetic factors-DNA and chromatin modifications that affect levels of gene expression without affecting the DNA sequence-are thought to be important in establishing this variability. Epigenetically-mediated differences in the levels of gene expression that are associated with individual variability traditionally are thought to occur only in a gene-specific manner. We challenge this idea by exploring the large-scale organizational patterns of gene expression in an epigenetic model of behavioral variability.To study the effects of epigenetic influences on behavioral variability, we examine gene expression in genetically identical mice. Using a novel approach to microarray analysis, we show that variability in the large-scale organization of gene expression levels, rather than differences in the expression levels of specific genes, is associated with individual differences in behavior. Specifically, increased activity in the open field is associated with increased variance of log-transformed measures of gene expression in the hippocampus, a brain region involved in open field activity. Early life experience that increases adult activity in the open field also similarly modifies the variance of gene expression levels. The same association of the variance of gene expression levels with behavioral variability is found with levels of gene expression in the hippocampus of genetically heterogeneous outbred populations of mice, suggesting that variation in the large-scale organization of gene expression levels may also be relevant to phenotypic differences in outbred populations such as humans. We find that the increased variance in gene expression levels is attributable to an increasing separation of several large, log-normally distributed families of gene expression levels. We also show that the presence of these multiple log-normal distributions of gene expression levels is a universal characteristic of gene expression in eurkaryotes. We use data from the MicroArray Quality Control Project (MAQC) to demonstrate that our method is robust and that it reliably detects biological differences in the large-scale organization of gene expression levels.Our results contrast with the traditional belief that epigenetic effects on gene expression occur only at the level of specific genes and suggest instead that the large-scale organization of gene expression levels provides important insights into the relationship of gene expression with behavioral variability. Understanding the epigenetic, genetic, and environmental factors that regulate the large-scale organization of gene expression levels, and how changes in this large-scale organization influences brain development and behavior will be a major future challenge in the field of behavioral genomics

A hippocampal Cdk5 pathway regulates extinction of contextual fear

Treatment of emotional disorders involves the promotion of extinction processes, which are defined as the learned reduction of fear. The molecular mechanisms underlying extinction have only begun to be elucidated. By employing genetic and pharmacological approaches in mice, we show here that extinction requires downregulation of Rac-1 and cyclin-dependent kinase 5 (Cdk5), and upregulation of p21 activated kinase-1 (PAK-1) activity. This is physiologically achieved by a Rac-1–dependent relocation of the Cdk5 activator p35 from the membrane to the cytosol and dissociation of p35 from PAK-1. Moreover, our data suggest that Cdk5/p35 activity prevents extinction in part by inhibition of PAK-1 activity in a Rac-1–dependent manner. We propose that extinction of contextual fear is regulated by counteracting components of a molecular pathway involving Rac-1, Cdk5 and PAK-1. Our data suggest that this pathway could provide a suitable target for therapeutic treatment of emotional disorders.National Institutes of Health (U.S.) (Grant NS051874)Alexander von Humboldt-Stiftung (German Research Foundation Fellowship)European Neuroscience Institute Goettinge

A Mismatch-Based Model for Memory Reconsolidation and Extinction in Attractor Networks

The processes of memory reconsolidation and extinction have received increasing attention in recent experimental research, as their potential clinical applications begin to be uncovered. A number of studies suggest that amnestic drugs injected after reexposure to a learning context can disrupt either of the two processes, depending on the behavioral protocol employed. Hypothesizing that reconsolidation represents updating of a memory trace in the hippocampus, while extinction represents formation of a new trace, we have built a neural network model in which either simple retrieval, reconsolidation or extinction of a stored attractor can occur upon contextual reexposure, depending on the similarity between the representations of the original learning and reexposure sessions. This is achieved by assuming that independent mechanisms mediate Hebbian-like synaptic strengthening and mismatch-driven labilization of synaptic changes, with protein synthesis inhibition preferentially affecting the former. Our framework provides a unified mechanistic explanation for experimental data showing (a) the effect of reexposure duration on the occurrence of reconsolidation or extinction and (b) the requirement of memory updating during reexposure to drive reconsolidation