Lever Insertion as a Salient Stimulus Promoting Insensitivity to Outcome Devaluation

Flexible and efficient decision-making in complex environments can be achieved through constant interactions between the goal-directed and habitual systems. While goal-directed behavior is considered dependent upon Response-Outcome (R-O) associations, habits instead rely on Stimulus-Response (S-R) associations. However, the stimuli that support the S-R association underlying habitual responding in typical instrumental procedures are poorly defined. To resolve this issue, we designed a discrete-trials procedure, in which rats must wait for lever insertion and complete a sequence of five lever presses to obtain a reward (20% sucrose or grain-based pellets). Lever insertion thus constituted an audio-visual stimulus signaling the opportunity for reward. Using sensory-specific satiety-induced devaluation, we found that rats trained with grain-based pellets remained sensitive to outcome devaluation over the course of training with this procedure whereas rats trained with a solution of 20% sucrose rapidly developed habit, and that insensitivity to outcome devaluation in rats trained with sucrose did not result from a bias in general satiety. Importantly, although rats trained with pellets were sensitive to satiety-induced devaluation, their performance was not affected by degradation of instrumental contingency and devaluation by conditioned taste aversion (CTA), suggesting that these rats may also have developed habitual responding. To test whether the discrete-trials procedure biases subjects towards habitual responding, we compared discrete-trials to free-running instrumental responding, and found that rats trained with sucrose in a fixed-ratio 5 (FR5) procedure with continuous presentation of the lever were goal-directed. Together, these results demonstrate that discrete presentations of a stimulus predictive of reward availability promoted the formation of S-R habit in rats trained with liquid sucrose. Further research is necessary to explain inconsistencies in sensitivity to outcome devaluation when rats are trained with grain-based pellets

Long-range orbitofrontal and amygdala axons show divergent patterns of maturation in the frontal cortex across adolescence.

The adolescent transition from juvenile to adult is marked by anatomical and functional remodeling of brain networks. Currently, the cellular and synaptic level changes underlying the adolescent transition are only coarsely understood. Here, we use two-photon imaging to make time-lapse observations of long-range axons that innervate the frontal cortex in the living brain. We labeled cells in the orbitofrontal cortex (OFC) and basolateral amygdala (BLA) and imaged their axonal afferents to the dorsomedial prefrontal cortex (dmPFC). We also imaged the apical dendrites of dmPFC pyramidal neurons. Images were taken daily in separate cohorts of juvenile (P24-P28) and young adult mice (P64-P68), ages where we have previously discovered differences in dmPFC dependent decision-making. Dendritic spines were pruned across this peri-adolescent period, while BLA and OFC afferents followed alternate developmental trajectories. OFC boutons showed no decrease in density, but did show a decrease in daily bouton gain and loss with age. BLA axons showed an increase in both bouton density and daily bouton gain at the later age, suggesting a delayed window of enhanced plasticity. Our findings reveal projection specific maturation of synaptic structures within a single frontal region and suggest that stabilization is a more general characteristic of maturation than pruning

Dopamine neurons create Pavlovian conditioned stimuli with circuit-defined motivational properties.

Environmental cues, through Pavlovian learning, become conditioned stimuli that guide animals toward the acquisition of rewards (for example, food) that are necessary for survival. We tested the fundamental role of midbrain dopamine neurons in conferring predictive and motivational properties to cues, independent of external rewards. We found that brief phasic optogenetic excitation of dopamine neurons, when presented in temporal association with discrete sensory cues, was sufficient to instantiate those cues as conditioned stimuli that subsequently both evoked dopamine neuron activity on their own and elicited cue-locked conditioned behavior. Notably, we identified highly parcellated functions for dopamine neuron subpopulations projecting to different regions of striatum, revealing dissociable dopamine systems for the generation of incentive value and conditioned movement invigoration. Our results indicate that dopamine neurons orchestrate Pavlovian conditioning via functionally heterogeneous, circuit-specific motivational signals to create, gate, and shape cue-controlled behaviors

Responses to ethanol in C57BL/6 versus C57BL/6 × 129 hybrid mice

Although genetic background alters responses to ethanol, there has not yet been a methodical quantification of differences in ethanol-related behaviors between inbred and hybrid mice commonly used in gene-targeting studies. Here, we compared C57BL/6NTac × 129S6/SvEvTac F1 hybrid mice (B6129S6) with C57BL/6NTac inbred mice (B6NT), and C57BL/6J × 129X1/SvJ (B6129X1) and C57BL/6J × 129S4/SvJae F1 hybrids (B6129S4) with C57BL/6J mice (B6J), in five commonly used tests: continuous access two-bottle choice drinking, intermittent limited-access binge drinking, ethanol clearance, ethanol-induced loss of the righting reflex, and conditioned place preference (CPP) for ethanol. We found that inbred B6J and B6NT mice showed greater ethanol preference and consumption than their respective hybrids when ethanol was continuously available. Within the intermittent limited-access drinking procedure, though all lines showed similar intake over eight drinking sessions, the average of all sessions showed that B6NT mice drank significantly more ethanol than B6129S6 mice. In addition, B6J mice consumed more ethanol than B6129X1 mice, although they drank less than B6129S4 mice. No differences in ethanol LORR duration were observed between inbred and hybrid mice. Although ethanol clearance was similar among B6J mice and their respective hybrids, B6NT mice cleared ethanol more rapidly than B6129S6 mice. All lines developed CPP for ethanol. Our findings indicate that it may not be necessary to backcross hybrids to an inbred B6 background to study many ethanol-related behaviors in gene-targeted mice

Pavlovian-conditioned alcohol-seeking behavior in rats is invigorated by the interaction between discrete and contextual alcohol cues: implications for relapse

Introduction: Drug craving can be independently stimulated by cues that are directly associated with drug intake (discrete drug cues), as well as by environmental contexts in which drug use occurs (contextual drug cues). We tested the hypothesis that the context in which a discrete alcohol-predictive cue is experienced can influence how robustly that cue stimulates alcohol-seeking behavior. Methods: Male, Long-Evans rats received Pavlovian discrimination training (PDT) sessions in which one conditioned stimulus (CS+; 16 trials/session) was paired with ethanol (0.2 mL/CS+) and a second stimulus (CS-; 16 trials/ session) was not. PDT occurred in a specific context, and entries into a fluid port where ethanol was delivered were measured during each CS. Next, rats were acclimated to an alternate (nonalcohol) context where cues and ethanol were withheld. Responses to the nonextinguished CS+ and CS- were then tested without ethanol in the alcohol-associated PDT context, the nonalcohol context or a third, novel context. Results: Across PDT the CS+ elicited more port entries than the CS-, indicative of Pavlovian discrimination learning. At test, the CS+ elicited more port entries than the CS- in all three contexts: however, alcohol seeking driven by the CS+ was more robust in the alcohol- associated context. In a separate experiment, extinguishing the context- alcohol association did not influence subsequent CS+ responding but reduced alcohol seeking during non-CS+ intervals during a spontaneous recovery test. Conclusion: These results indicate that alcohol-seeking behavior driven by a discrete Pavlovian alcohol cue is strongly invigorated by an alcohol context, and suggest that contexts may function as excitatory Pavlovian conditioned stimuli that directly trigger alcohol-seeking behavior

A Transgenic Rat for Investigating the Anatomy and Function of Corticotrophin Releasing Factor Circuits.

Corticotrophin-releasing factor (CRF) is a 41 amino acid neuropeptide that coordinates adaptive responses to stress. CRF projections from neurons in the central nucleus of the amygdala (CeA) to the brainstem are of particular interest for their role in motivated behavior. To directly examine the anatomy and function of CRF neurons, we generated a BAC transgenic Crh-Cre rat in which bacterial Cre recombinase is expressed from the Crh promoter. Using Cre-dependent reporters, we found that Cre expressing neurons in these rats are immunoreactive for CRF and are clustered in the lateral CeA (CeL) and the oval nucleus of the BNST. We detected major projections from CeA CRF neurons to parabrachial nuclei and the locus coeruleus, dorsal and ventral BNST, and more minor projections to lateral portions of the substantia nigra, ventral tegmental area, and lateral hypothalamus. Optogenetic stimulation of CeA CRF neurons evoked GABA-ergic responses in 11% of non-CRF neurons in the medial CeA (CeM) and 44% of non-CRF neurons in the CeL. Chemogenetic stimulation of CeA CRF neurons induced Fos in a similar proportion of non-CRF CeM neurons but a smaller proportion of non-CRF CeL neurons. The CRF1 receptor antagonist R121919 reduced this Fos induction by two-thirds in these regions. These results indicate that CeL CRF neurons provide both local inhibitory GABA and excitatory CRF signals to other CeA neurons, and demonstrate the value of the Crh-Cre rat as a tool for studying circuit function and physiology of CRF neurons

a4-Containing GABA _A Receptors on DRD2 Neurons of the Nucleus Accumbens Mediate Instrumental Responding for Conditioned Reinforcers and Its Potentiation by Cocaine

Extrasynaptic GABA A receptors (GABA ARs) composed of a4, b, and d subunits mediate GABAergic tonic inhibition and are potential molecular targets in the modulation of behavioral responses to natural and drug rewards. These GABA ARs are highly expressed within the nucleus accumbens (NAc), where they influence the excitability of the medium spiny neurons. Here, we explore their role in modulating behavioral responses to food-conditioned cues and the behavior-potentiating effects of cocaine. a4-Subunit constitutive knock-out mice (a4 /) showed higher rates of instrumental responding for reward-paired stimuli in a test of conditioned reinforcement (CRf). A similar effect was seen fol-lowing viral knockdown of GABA AR a4 subunits within the NAc. Local infusion of the a4b d-GABA AR-preferring agonist THIP (4,5,6,7-tetrahydroisoxazolo[5,4-c]pyridin-3-ol; Gaboxadol) into the NAc had no effect on responding when given alone but reduced cocaine potentiation of responding for conditioned reinforcers in wild-type, but not a4 / mice. Finally, specific deletion of a4-subunits from dopamine D2, but not D1, receptor-expressing neurons (DRD2 and DRD1 neurons), mimicked the phenotype of the constitutive knockout, potentiating CRf responding, and blocking intra-accumbal THIP attenuation of cocaine-potentiated CRf responding. These data demonstrate that a4-GABA AR-mediated inhibition of DRD2 neurons reduces instrumental responding for a conditioned reinforcer and its po-tentiation by cocaine and emphasize the importance of GABAergic signaling within the NAc in mediating the effects of cocaine.</p

Recombinase-Driver Rat Lines: Tools, Techniques, and Optogenetic Application to Dopamine-Mediated Reinforcement

Currently there is no general approach for achieving specific optogenetic control of genetically-defined cell types in rats, which provide a powerful experimental system for numerous established neurophysiological and behavioral paradigms. To overcome this challenge we have generated genetically-restricted recombinase-driver rat lines suitable for driving gene expression in specific cell-types, expressing Cre recombinase under control of large genomic regulatory regions (200–300 Kb). Multiple tyrosine hydroxylase (Th)::Cre and choline acetyltransferase (Chat)::Cre lines were produced that exhibited specific opsin expression in targeted cell-types. We additionally developed methods for utilizing optogenetic tools in freely-moving rats, and leveraged these technologies to clarify the causal relationship between dopamine (DA) neuron firing and positive reinforcement, observing that optical stimulation of DA neurons in the ventral tegmental area (VTA) of Th::Cre rats is sufficient to support vigorous intracranial self-stimulation (ICSS). These studies complement existing targeting approaches by extending generalizability of optogenetics to traditionally non-genetically-tractable but vital animal models

Similar Neural Activity during Fear and Disgust in the Rat Basolateral Amygdala

Much research has focused on how the amygdala processes individual affects, yet little is known about how multiple types of positive and negative affects are encoded relative to one another at the single-cell level. In particular, it is unclear whether different negative affects, such as fear and disgust, are encoded more similarly than negative and positive affects, such as fear and pleasure. Here we test the hypothesis that the basolateral nucleus of the amygdala (BLA), a region known to be important for learned fear and other affects, encodes affective valence by comparing neuronal activity in the BLA during a conditioned fear stimulus (fear CS) with activity during intraoral delivery of an aversive fluid that induces a disgust response and a rewarding fluid that induces a hedonic response. Consistent with the hypothesis, neuronal activity during the fear CS and aversive fluid infusion, but not during the fear CS and rewarding fluid infusion, was more similar than expected by chance. We also found that the greater similarity in activity during the fear- and disgust-eliciting stimuli was specific to a subpopulation of cells and a limited window of time. Our results suggest that a subpopulation of BLA neurons encodes affective valence during learned fear, and furthermore, within this subpopulation, different negative affects are encoded more similarly than negative and positive affects in a time-specific manner