A Bio-Logical Theory of Animal Learning

This article provides the foundation for a new predictive theory of animal learning that is based upon a simple logical model. The knowledge of experimental subjects at a given time is described using logical equations. These logical equations are then used to predict a subject’s response when presented with a known or a previously unknown situation. This new theory suc- cessfully anticipates phenomena that existing theories predict, as well as phenomena that they cannot. It provides a theoretical account for phenomena that are beyond the domain of existing models, such as extinction and the detection of novelty, from which “external inhibition” can be explained. Examples of the methods applied to make predictions are given using previously published results. The present theory proposes a new way to envision the minimal functions of the nervous system, and provides possible new insights into the way that brains ultimately create and use knowledge about the world

Overshadowing by fixed- and variable-duration stimuli

Two experiments investigated the effect of the temporal distribution form of a stimulus on its ability to produce an overshadowing effect. The overshadowing stimuli were either of the same duration on every trial, or of a variable duration drawn from an exponential distribution with the same mean duration as that of the fixed stimulus. Both experiments provided evidence that a variable-duration stimulus was less effective than a fixed-duration cue at overshadowing conditioning to a target conditioned stimulus (CS); moreover, this effect was independent of whether the overshadowed CS was fixed or variable. The findings presented here are consistent with the idea that the strength of the association between CS and unconditioned stimulus (US) is, in part, determined by the temporal distribution form of the CS. These results are discussed in terms of time-accumulation and trial-based theories of conditioning and timing

Role of MeCP2, DNA methylation, and HDACs in regulating synapse function

Over the past several years there has been intense effort to delineate the role of epigenetic factors, including methyl-CpG-binding protein 2, histone deacetylases, and DNA methyltransferases, in synaptic function. Studies from our group as well as others have shown that these key epigenetic mechanisms are critical regulators of synapse formation, maturation, as well as function. Although most studies have identified selective deficits in excitatory neurotransmission, the latest work has also uncovered deficits in inhibitory neurotransmission as well. Despite the rapid pace of advances, the exact synaptic mechanisms and gene targets that mediate these effects on neurotransmission remain unclear. Nevertheless, these findings not only open new avenues for understanding neuronal circuit abnormalities associated with neurodevelopmental disorders but also elucidate potential targets for addressing the pathophysiology of several intractable neuropsychiatric disorders

A hippocampal Cdk5 pathway regulates extinction of contextual fear

Treatment of emotional disorders involves the promotion of extinction processes, which are defined as the learned reduction of fear. The molecular mechanisms underlying extinction have only begun to be elucidated. By employing genetic and pharmacological approaches in mice, we show here that extinction requires downregulation of Rac-1 and cyclin-dependent kinase 5 (Cdk5), and upregulation of p21 activated kinase-1 (PAK-1) activity. This is physiologically achieved by a Rac-1–dependent relocation of the Cdk5 activator p35 from the membrane to the cytosol and dissociation of p35 from PAK-1. Moreover, our data suggest that Cdk5/p35 activity prevents extinction in part by inhibition of PAK-1 activity in a Rac-1–dependent manner. We propose that extinction of contextual fear is regulated by counteracting components of a molecular pathway involving Rac-1, Cdk5 and PAK-1. Our data suggest that this pathway could provide a suitable target for therapeutic treatment of emotional disorders.National Institutes of Health (U.S.) (Grant NS051874)Alexander von Humboldt-Stiftung (German Research Foundation Fellowship)European Neuroscience Institute Goettinge

A Novel Task for the Investigation of Action Acquisition

We present a behavioural task designed for the investigation of how novel instrumental actions are discovered and learnt. The task consists of free movement with a manipulandum, during which the full range of possible movements can be explored by the participant and recorded. A subset of these movements, the ‘target’, is set to trigger a reinforcing signal. The task is to discover what movements of the manipulandum evoke the reinforcement signal. Targets can be defined in spatial, temporal, or kinematic terms, can be a combination of these aspects, or can represent the concatenation of actions into a larger gesture. The task allows the study of how the specific elements of behaviour which cause the reinforcing signal are identified, refined and stored by the participant. The task provides a paradigm where the exploratory motive drives learning and as such we view it as in the tradition of Thorndike [1]. Most importantly it allows for repeated measures, since when a novel action is acquired the criterion for triggering reinforcement can be changed requiring a new action to be discovered. Here, we present data using both humans and rats as subjects, showing that our task is easily scalable in difficulty, adaptable across species, and produces a rich set of behavioural measures offering new and valuable insight into the action learning process

A Mismatch-Based Model for Memory Reconsolidation and Extinction in Attractor Networks

The processes of memory reconsolidation and extinction have received increasing attention in recent experimental research, as their potential clinical applications begin to be uncovered. A number of studies suggest that amnestic drugs injected after reexposure to a learning context can disrupt either of the two processes, depending on the behavioral protocol employed. Hypothesizing that reconsolidation represents updating of a memory trace in the hippocampus, while extinction represents formation of a new trace, we have built a neural network model in which either simple retrieval, reconsolidation or extinction of a stored attractor can occur upon contextual reexposure, depending on the similarity between the representations of the original learning and reexposure sessions. This is achieved by assuming that independent mechanisms mediate Hebbian-like synaptic strengthening and mismatch-driven labilization of synaptic changes, with protein synthesis inhibition preferentially affecting the former. Our framework provides a unified mechanistic explanation for experimental data showing (a) the effect of reexposure duration on the occurrence of reconsolidation or extinction and (b) the requirement of memory updating during reexposure to drive reconsolidation

Effects of Alcohol on the Acquisition and Expression of Fear Potentiated Startle in Mouse Lines Selectively Bred for High and Low Alcohol Preference

Rationale: Anxiety disorders and alcohol-use disorders frequently co-occur in humans perhaps because alcohol relieves anxiety. Studies in humans and rats indicate that alcohol may have greater anxiolytic effects in organisms with increased genetic propensity for high alcohol consumption. Objectives and Methods: The purpose of this study was to investigate the effects of moderate doses of alcohol (0.5, 1.0, 1.5 g/kg) on the acquisition and expression of anxiety-related behavior using a fear-potentiated startle (FPS) procedure. Experiments were conducted in two replicate pairs of mouse lines selectively bred for high- (HAP1 and HAP2) and low- (LAP1 and LAP2) alcohol preference; these lines have previously shown a genetic correlation between alcohol preference and FPS (HAP\u3eLAP; Barrenha and Chester 2007). In a control experiment, the effect of diazepam (4.0 mg/kg) on the expression of FPS was tested in HAP2 and LAP2 mice. Results: The 1.5 g/kg alcohol dose moderately decreased the expression of FPS in both HAP lines but not LAP lines. Alcohol had no effect on the acquisition of FPS in any line. Diazepam reduced FPS to a similar extent in both HAP2 and LAP2 mice. Conclusions: HAP mice may be more sensitive to the anxiolytic effects of alcohol than LAP mice when alcohol is given prior to the expression of FPS. These data collected in two pairs of HAP/LAP mouse lines suggest that the anxiolytic response to alcohol in HAP mice may be genetically correlated with their propensity toward high alcohol preference and robust FPS

A Rescorla-Wagner Drift-Diffusion Model of Conditioning and Timing

Computational models of classical conditioning have made significant contributions to the theoretic understanding of associative learning, yet they still struggle when the temporal aspects of conditioning are taken into account. Interval timing models have contributed a rich variety of time representations and provided accurate predictions for the timing of responses, but they usually have little to say about associative learning. In this article we present a unified model of conditioning and timing that is based on the influential Rescorla-Wagner conditioning model and the more recently developed Timing Drift-Diffusion model. We test the model by simulating 10 experimental phenomena and show that it can provide an adequate account for 8, and a partial account for the other 2. We argue that the model can account for more phenomena in the chosen set than these other similar in scope models: CSC-TD, MS-TD, Learning to Time and Modular Theory. A comparison and analysis of the mechanisms in these models is provided, with a focus on the types of time representation and associative learning rule used