A Bio-Logical Theory of Animal Learning

This article provides the foundation for a new predictive theory of animal learning that is based upon a simple logical model. The knowledge of experimental subjects at a given time is described using logical equations. These logical equations are then used to predict a subject’s response when presented with a known or a previously unknown situation. This new theory suc- cessfully anticipates phenomena that existing theories predict, as well as phenomena that they cannot. It provides a theoretical account for phenomena that are beyond the domain of existing models, such as extinction and the detection of novelty, from which “external inhibition” can be explained. Examples of the methods applied to make predictions are given using previously published results. The present theory proposes a new way to envision the minimal functions of the nervous system, and provides possible new insights into the way that brains ultimately create and use knowledge about the world

Overshadowing by fixed- and variable-duration stimuli

Two experiments investigated the effect of the temporal distribution form of a stimulus on its ability to produce an overshadowing effect. The overshadowing stimuli were either of the same duration on every trial, or of a variable duration drawn from an exponential distribution with the same mean duration as that of the fixed stimulus. Both experiments provided evidence that a variable-duration stimulus was less effective than a fixed-duration cue at overshadowing conditioning to a target conditioned stimulus (CS); moreover, this effect was independent of whether the overshadowed CS was fixed or variable. The findings presented here are consistent with the idea that the strength of the association between CS and unconditioned stimulus (US) is, in part, determined by the temporal distribution form of the CS. These results are discussed in terms of time-accumulation and trial-based theories of conditioning and timing

A Novel Task for the Investigation of Action Acquisition

We present a behavioural task designed for the investigation of how novel instrumental actions are discovered and learnt. The task consists of free movement with a manipulandum, during which the full range of possible movements can be explored by the participant and recorded. A subset of these movements, the ‘target’, is set to trigger a reinforcing signal. The task is to discover what movements of the manipulandum evoke the reinforcement signal. Targets can be defined in spatial, temporal, or kinematic terms, can be a combination of these aspects, or can represent the concatenation of actions into a larger gesture. The task allows the study of how the specific elements of behaviour which cause the reinforcing signal are identified, refined and stored by the participant. The task provides a paradigm where the exploratory motive drives learning and as such we view it as in the tradition of Thorndike [1]. Most importantly it allows for repeated measures, since when a novel action is acquired the criterion for triggering reinforcement can be changed requiring a new action to be discovered. Here, we present data using both humans and rats as subjects, showing that our task is easily scalable in difficulty, adaptable across species, and produces a rich set of behavioural measures offering new and valuable insight into the action learning process

A hippocampal Cdk5 pathway regulates extinction of contextual fear

Treatment of emotional disorders involves the promotion of extinction processes, which are defined as the learned reduction of fear. The molecular mechanisms underlying extinction have only begun to be elucidated. By employing genetic and pharmacological approaches in mice, we show here that extinction requires downregulation of Rac-1 and cyclin-dependent kinase 5 (Cdk5), and upregulation of p21 activated kinase-1 (PAK-1) activity. This is physiologically achieved by a Rac-1–dependent relocation of the Cdk5 activator p35 from the membrane to the cytosol and dissociation of p35 from PAK-1. Moreover, our data suggest that Cdk5/p35 activity prevents extinction in part by inhibition of PAK-1 activity in a Rac-1–dependent manner. We propose that extinction of contextual fear is regulated by counteracting components of a molecular pathway involving Rac-1, Cdk5 and PAK-1. Our data suggest that this pathway could provide a suitable target for therapeutic treatment of emotional disorders.National Institutes of Health (U.S.) (Grant NS051874)Alexander von Humboldt-Stiftung (German Research Foundation Fellowship)European Neuroscience Institute Goettinge

Variation in the Large-Scale Organization of Gene Expression Levels in the Hippocampus Relates to Stable Epigenetic Variability in Behavior

Despite sharing the same genes, identical twins demonstrate substantial variability in behavioral traits and in their risk for disease. Epigenetic factors-DNA and chromatin modifications that affect levels of gene expression without affecting the DNA sequence-are thought to be important in establishing this variability. Epigenetically-mediated differences in the levels of gene expression that are associated with individual variability traditionally are thought to occur only in a gene-specific manner. We challenge this idea by exploring the large-scale organizational patterns of gene expression in an epigenetic model of behavioral variability.To study the effects of epigenetic influences on behavioral variability, we examine gene expression in genetically identical mice. Using a novel approach to microarray analysis, we show that variability in the large-scale organization of gene expression levels, rather than differences in the expression levels of specific genes, is associated with individual differences in behavior. Specifically, increased activity in the open field is associated with increased variance of log-transformed measures of gene expression in the hippocampus, a brain region involved in open field activity. Early life experience that increases adult activity in the open field also similarly modifies the variance of gene expression levels. The same association of the variance of gene expression levels with behavioral variability is found with levels of gene expression in the hippocampus of genetically heterogeneous outbred populations of mice, suggesting that variation in the large-scale organization of gene expression levels may also be relevant to phenotypic differences in outbred populations such as humans. We find that the increased variance in gene expression levels is attributable to an increasing separation of several large, log-normally distributed families of gene expression levels. We also show that the presence of these multiple log-normal distributions of gene expression levels is a universal characteristic of gene expression in eurkaryotes. We use data from the MicroArray Quality Control Project (MAQC) to demonstrate that our method is robust and that it reliably detects biological differences in the large-scale organization of gene expression levels.Our results contrast with the traditional belief that epigenetic effects on gene expression occur only at the level of specific genes and suggest instead that the large-scale organization of gene expression levels provides important insights into the relationship of gene expression with behavioral variability. Understanding the epigenetic, genetic, and environmental factors that regulate the large-scale organization of gene expression levels, and how changes in this large-scale organization influences brain development and behavior will be a major future challenge in the field of behavioral genomics

Double Dissociation of Amygdala and Hippocampal Contributions to Trace and Delay Fear Conditioning

A key finding in studies of the neurobiology of learning memory is that the amygdala is critically involved in Pavlovian fear conditioning. This is well established in delay-cued and contextual fear conditioning; however, surprisingly little is known of the role of the amygdala in trace conditioning. Trace fear conditioning, in which the CS and US are separated in time by a trace interval, requires the hippocampus and prefrontal cortex. It is possible that recruitment of cortical structures by trace conditioning alters the role of the amygdala compared to delay fear conditioning, where the CS and US overlap. To investigate this, we inactivated the amygdala of male C57BL/6 mice with GABA A agonist muscimol prior to 2-pairing trace or delay fear conditioning. Amygdala inactivation produced deficits in contextual and delay conditioning, but had no effect on trace conditioning. As controls, we demonstrate that dorsal hippocampal inactivation produced deficits in trace and contextual, but not delay fear conditioning. Further, pre- and post-training amygdala inactivation disrupted the contextual but the not cued component of trace conditioning, as did muscimol infusion prior to 1- or 4-pairing trace conditioning. These findings demonstrate that insertion of a temporal gap between the CS and US can generate amygdala-independent fear conditioning. We discuss the implications of this surprising finding for current models of the neural circuitry involved in fear conditioning

A Mismatch-Based Model for Memory Reconsolidation and Extinction in Attractor Networks

The processes of memory reconsolidation and extinction have received increasing attention in recent experimental research, as their potential clinical applications begin to be uncovered. A number of studies suggest that amnestic drugs injected after reexposure to a learning context can disrupt either of the two processes, depending on the behavioral protocol employed. Hypothesizing that reconsolidation represents updating of a memory trace in the hippocampus, while extinction represents formation of a new trace, we have built a neural network model in which either simple retrieval, reconsolidation or extinction of a stored attractor can occur upon contextual reexposure, depending on the similarity between the representations of the original learning and reexposure sessions. This is achieved by assuming that independent mechanisms mediate Hebbian-like synaptic strengthening and mismatch-driven labilization of synaptic changes, with protein synthesis inhibition preferentially affecting the former. Our framework provides a unified mechanistic explanation for experimental data showing (a) the effect of reexposure duration on the occurrence of reconsolidation or extinction and (b) the requirement of memory updating during reexposure to drive reconsolidation

A Rescorla-Wagner Drift-Diffusion Model of Conditioning and Timing

Computational models of classical conditioning have made significant contributions to the theoretic understanding of associative learning, yet they still struggle when the temporal aspects of conditioning are taken into account. Interval timing models have contributed a rich variety of time representations and provided accurate predictions for the timing of responses, but they usually have little to say about associative learning. In this article we present a unified model of conditioning and timing that is based on the influential Rescorla-Wagner conditioning model and the more recently developed Timing Drift-Diffusion model. We test the model by simulating 10 experimental phenomena and show that it can provide an adequate account for 8, and a partial account for the other 2. We argue that the model can account for more phenomena in the chosen set than these other similar in scope models: CSC-TD, MS-TD, Learning to Time and Modular Theory. A comparison and analysis of the mechanisms in these models is provided, with a focus on the types of time representation and associative learning rule used

Effects of Alcohol on the Acquisition and Expression of Fear Potentiated Startle in Mouse Lines Selectively Bred for High and Low Alcohol Preference

Rationale: Anxiety disorders and alcohol-use disorders frequently co-occur in humans perhaps because alcohol relieves anxiety. Studies in humans and rats indicate that alcohol may have greater anxiolytic effects in organisms with increased genetic propensity for high alcohol consumption. Objectives and Methods: The purpose of this study was to investigate the effects of moderate doses of alcohol (0.5, 1.0, 1.5 g/kg) on the acquisition and expression of anxiety-related behavior using a fear-potentiated startle (FPS) procedure. Experiments were conducted in two replicate pairs of mouse lines selectively bred for high- (HAP1 and HAP2) and low- (LAP1 and LAP2) alcohol preference; these lines have previously shown a genetic correlation between alcohol preference and FPS (HAP\u3eLAP; Barrenha and Chester 2007). In a control experiment, the effect of diazepam (4.0 mg/kg) on the expression of FPS was tested in HAP2 and LAP2 mice. Results: The 1.5 g/kg alcohol dose moderately decreased the expression of FPS in both HAP lines but not LAP lines. Alcohol had no effect on the acquisition of FPS in any line. Diazepam reduced FPS to a similar extent in both HAP2 and LAP2 mice. Conclusions: HAP mice may be more sensitive to the anxiolytic effects of alcohol than LAP mice when alcohol is given prior to the expression of FPS. These data collected in two pairs of HAP/LAP mouse lines suggest that the anxiolytic response to alcohol in HAP mice may be genetically correlated with their propensity toward high alcohol preference and robust FPS