Reward-Related Behavioral Paradigms for Addiction Research in the Mouse: Performance of Common Inbred Strains

The mouse has emerged as a uniquely valuable species for studying the molecular and genetic basis of complex behaviors and modeling neuropsychiatric disease states. While valid and reliable preclinical assays for reward-related behaviors are critical to understanding addiction-related processes, and various behavioral procedures have been developed and characterized in rats and primates, there have been relatively few studies using operant-based addiction-relevant behavioral paradigms in the mouse. Here we describe the performance of the C57BL/6J inbred mouse strain on three major reward-related paradigms, and replicate the same procedures in two other commonly used inbred strains (DBA/2J, BALB/cJ). We examined Pavlovian-instrumental transfer (PIT) by measuring the ability of an auditory cue associated with food reward to promote an instrumental (lever press) response. In a separate experiment, we assessed the acquisition and extinction of a simple stimulus-reward instrumental behavior on a touchscreen-based task. Reinstatement of this behavior was then examined following either continuous exposure to cues (conditioned reinforcers, CRs) associated with reward, brief reward and CR exposure, or brief reward exposure followed by continuous CR exposure. The third paradigm examined sensitivity of an instrumental (lever press) response to devaluation of food reward (a probe for outcome insensitive, habitual behavior) by repeated pairing with malaise. Results showed that C57BL/6J mice displayed robust PIT, as well as clear extinction and reinstatement, but were insensitive to reinforcer devaluation. DBA/2J mice showed good PIT and (rewarded) reinstatement, but were slow to extinguish and did not show reinforcer devaluation or significant CR-reinstatement. BALB/cJ mice also displayed good PIT, extinction and reinstatement, and retained instrumental responding following devaluation, but, unlike the other strains, demonstrated reduced Pavlovian approach behavior (food magazine head entries). Overall, these assays provide robust paradigms for future studies using the mouse to elucidate the neural, molecular and genetic factors underpinning reward-related behaviors relevant to addiction research

Ethanol seeking triggered by environmental context is attenuated by blocking dopamine D1 receptors in the nucleus accumbens core and shell in rats

Conditioned behavioral responses to discrete drug-associated cues can be modulated by the environmental context in which those cues are experienced, a process that may facilitate relapse in humans. Rodent models of drug self-administration have been adapted to reveal the capacity of contexts to trigger drug seeking, thereby enabling neurobiological investigations of this effect. We tested the hypothesis that dopamine transmission in the nucleus accumbens, a neural structure that mediates reinforcement, is necessary for context-induced reinstatement of responding for ethanol-associated cues. Rats pressed one lever (active) for oral ethanol (0.1 ml; 10% v/v) in operant conditioning chambers distinguished by specific visual, olfactory, and tactile contextual stimuli. Ethanol delivery was paired with a discrete (4 s) light-noise stimulus. Responses on a second lever (inactive) were not reinforced. Behavior was then extinguished by withholding ethanol but not the discrete stimulus in a different context. Reinstatement, expressed as elevated responding for the discrete stimulus without ethanol delivery, was tested by placing rats into the prior self-administration context after administration of saline or the dopamine D1 receptor antagonist, SCH 23390 (0.006, 0.06, and 0.6 μg/side), into the nucleus accumbens core or shell. Compared with extinction responding, active lever pressing in saline-pretreated rats was enhanced by placement into the prior ethanol self-administration context. SCH 23390 dose-dependently reduced reinstatement after infusion into the core or shell. These findings suggest a critical role for dopamine acting via D1 receptors in the nucleus accumbens in the reinstatement of responding for ethanol cues triggered by placement into an ethanol-associated context

Heroin versus cocaine: opposite choice as a function of context but not of drug history in the rat

Rationale Previous studies have shown that rats trained to self-administer heroin and cocaine exhibit opposite preferences, as a function of setting, when tested in a choice paradigm. Rats tested at home prefer heroin to cocaine whereas rats tested outside the home prefer cocaine to heroin. Here we investigated whether drug history would influence subsequent drug preference in distinct settings. Based on a theoretical model of drug-setting interaction, we predicted that regardless of drug history rats would prefer heroin at home and cocaine outside the home. Methods Rats with double-lumen catheters were first trained to self-administer either heroin (25 μg/kg) or cocaine (400 μg/kg) for 12 consecutive sessions. Twenty-six rats were housed in the self-administration chambers (thus, they were tested at home) whereas 30 rats lived in distinct home cages and were transferred to self-administration chambers only for the self-administration session (thus, they were tested outside the home). The rats were then allowed to choose repeatedly between heroin and cocaine within the same session for 7 sessions. Results Regardless of the training drug, the rats tested outside the home preferred cocaine to heroin whereas the rats tested at home preferred heroin to cocaine. There was no correlation between drug preference and drug intake during the training phase. Conclusion Drug preferences were powerfully influenced by the setting but, quite surprisingly, not by drug history. This suggests that, under certain conditions, associative learning processes and drug-induced neuroplastic adaptations play a minor role in shaping individual preferences for one drug or the other

Transcriptional Changes Common to Human Cocaine, Cannabis and Phencyclidine Abuse

A major goal of drug abuse research is to identify and understand drug-induced changes in brain function that are common to many or all drugs of abuse. As these may underlie drug dependence and addiction, the purpose of the present study was to examine if different drugs of abuse effect changes in gene expression that converge in common molecular pathways. Microarray analysis was employed to assay brain gene expression in postmortem anterior prefrontal cortex (aPFC) from 42 human cocaine, cannabis and/or phencyclidine abuse cases and 30 control cases, which were characterized by toxicology and drug abuse history. Common transcriptional changes were demonstrated for a majority of drug abuse cases (N = 34), representing a number of consistently changed functional classes: Calmodulin-related transcripts (CALM1, CALM2, CAMK2B) were decreased, while transcripts related to cholesterol biosynthesis and trafficking (FDFT1, APOL2, SCARB1), and Golgi/endoplasmic reticulum (ER) functions (SEMA3B, GCC1) were all increased. Quantitative PCR validated decreases in calmodulin 2 (CALM2) mRNA and increases in apolipoprotein L, 2 (APOL2) and semaphorin 3B (SEMA3B) mRNA for individual cases. A comparison between control cases with and without cardiovascular disease and elevated body mass index indicated that these changes were not due to general cellular and metabolic stress, but appeared specific to the use of drugs. Therefore, humans who abused cocaine, cannabis and/or phencyclidine share a decrease in transcription of calmodulin-related genes and increased transcription related to lipid/cholesterol and Golgi/ER function. These changes represent common molecular features of drug abuse, which may underlie changes in synaptic function and plasticity that could have important ramifications for decision-making capabilities in drug abusers

Expression of amphetamine sensitization is associated with recruitment of a reactive neuronal population in the nucleus accumbens core

Rationale: Repeated exposure to psychostimulant drugs causes a long-lasting increase in the psychomotor and reinforcing effects of these drugs and an array of neuroadaptations. One such alteration is a hypersensitivity of striatal activity such that a low dose of amphetamine in sensitized animals produces dorsal striatal activation patterns similar to acute treatment with a high dose of amphetamine. Objectives: To extend previous findings of striatal hypersensitivity with behavioral observations and with cellular activity in the nucleus accumbens and prefrontal cortex in sensitized animals. Materials and methods: Rats treated acutely with 0, 1, 2.5, or 5 mg/kg i.p. amphetamine and sensitized rats challenged with 1 mg/kg i.p. amphetamine were scored for stereotypy, rearing, and grooming, and locomotor activity recorded. c-fos positive nuclei were quantified in the nucleus accumbens and prefrontal cortex after expression of sensitization with 1 mg/kg i.p. amphetamine. Results: Intense stereotypy was seen in animals treated acutely with 5 mg/kg amphetamine, but not in the sensitized group treated with 1 mg/kg amphetamine. The c-fos response to amphetamine in the accumbens core was augmented in amphetamine-pretreated animals with a shift in the distribution of optical density, while no effect of sensitization was seen in the nucleus accumbens shell or prefrontal cortex. Conclusions A lack of stereotypy in the sensitized group indicates a dissociation of behavioral responses to amphetamine and striatal immediate-early gene activation patterns. The increase in c-fos positive nuclei and shift in the distribution of optical density observed in the nucleus accumbens core suggests recruitment of a new population of neurons during expression of sensitization

Repeated Methamphetamine Administration Differentially Alters Fos Expression in Caudate-Putamen Patch and Matrix Compartments and Nucleus Accumbens

Background: The repeated administration of psychostimulant drugs produces a persistent and long-lasting increase (‘‘sensitization’’) in their psychomotor effects, which is thought to be due to changes in the neural circuitry that mediate these behaviors. One index of neuronal activation used to identify brain regions altered by repeated exposure to drugs involves their ability to induce immediate early genes, such as c-fos. Numerous reports have demonstrated that past drug experience alters the ability of drugs to induce c-fos in the striatum, but very few have examined Fos protein expression in the two major compartments in the striatum—the so-called patch/striosome and matrix. Methodology/Principal Findings: In the present study, we used immunohistochemistry to investigate the effects of pretreatment with methamphetamine on the ability of a subsequent methamphetamine challenge to induce Fos protein expression in the patch and matrix compartments of the dorsolateral and dorsomedial caudate-putamen and in the ventral striatum (nucleus accumbens). Animals pretreated with methamphetamine developed robust psychomotor sensitization. A methamphetamine challenge increased the number of Fos-positive cells in all areas of the dorsal and ventral striatum. However, methamphetamine challenge induced Fos expression in more cells in the patch than in the matrix compartment in the dorsolateral and dorsomedial caudate-putamen. Furthermore, past experience with methamphetamine increased the number of methamphetamine-induced Fos positive cells in the patch compartment of the dorsal caudate putamen, but no

Formation of a morphine-conditioned place preference does not change the size of evoked potentials in the ventral hippocampus–nucleus accumbens projection

Abstract In opioid addiction, cues and contexts associated with drug reward can be powerful triggers for drug craving and relapse. The synapses linking ventral hippocampal outputs to medium spiny neurons of the accumbens may be key sites for the formation and storage of associations between place or context and reward, both drug-related and natural. To assess this, we implanted rats with electrodes in the accumbens shell to record synaptic potentials evoked by electrical stimulation of the ventral hippocampus, as well as continuous local-field-potential activity. Rats then underwent morphine-induced (10 mg/kg) conditioned-place-preference training, followed by extinction. Morphine caused an acute increase in the slope and amplitude of accumbens evoked responses, but no long-term changes were evident after conditioning or extinction of the place preference, suggesting that the formation of this type of memory does not lead to a net change in synaptic strength in the ventral hippocampal output to the accumbens. However, analysis of the local field potential revealed a marked sensitization of theta- and high-gamma-frequency activity with repeated morphine administration. This phenomenon may be linked to the behavioral changes—such as psychomotor sensitization and the development of drug craving—that are associated with chronic use of addictive drugs

Anti-relapse neurons in the infralimbic cortex of rats drive relapse-suppression by drug omission cues

Drug addiction is a chronic relapsing disorder of compulsive drug use. Studies of the neurobehavioral factors that promote drug relapse have yet to produce an effective treatment. Here we take a different approach and examine the factors that suppress – rather than promote – relapse. Adapting Pavlovian procedures to suppress operant drug response, we determined the anti-relapse action of environmental cues that signal drug omission (unavailability) in rats. Under laboratory conditions linked to compulsive drug use and heightened relapse risk, drug omission cues suppressed three major modes of relapse-promotion (drug-predictive cues, stress, and drug exposure) for cocaine and alcohol. This relapse-suppression is partially driven by omission cue-reactive neurons, which constitute small subsets of glutamatergic and GABAergic cells, in the infralimbic cortex. Future studies of such neural activity-based cellular units (neuronal ensembles/memory engram cells) for relapse-suppression can be used to identify alternate targets for addiction medicine through functional characterization of anti-relapse mechanisms

A new framework for cortico-striatal plasticity: behavioural theory meets In vitro data at the reinforcement-action interface

Operant learning requires that reinforcement signals interact with action representations at a suitable neural interface. Much evidence suggests that this occurs when phasic dopamine, acting as a reinforcement prediction error, gates plasticity at cortico-striatal synapses, and thereby changes the future likelihood of selecting the action(s) coded by striatal neurons. But this hypothesis faces serious challenges. First, cortico-striatal plasticity is inexplicably complex, depending on spike timing, dopamine level, and dopamine receptor type. Second, there is a credit assignment problem—action selection signals occur long before the consequent dopamine reinforcement signal. Third, the two types of striatal output neuron have apparently opposite effects on action selection. Whether these factors rule out the interface hypothesis and how they interact to produce reinforcement learning is unknown. We present a computational framework that addresses these challenges. We first predict the expected activity changes over an operant task for both types of action-coding striatal neuron, and show they co-operate to promote action selection in learning and compete to promote action suppression in extinction. Separately, we derive a complete model of dopamine and spike-timing dependent cortico-striatal plasticity from in vitro data. We then show this model produces the predicted activity changes necessary for learning and extinction in an operant task, a remarkable convergence of a bottom-up data-driven plasticity model with the top-down behavioural requirements of learning theory. Moreover, we show the complex dependencies of cortico-striatal plasticity are not only sufficient but necessary for learning and extinction. Validating the model, we show it can account for behavioural data describing extinction, renewal, and reacquisition, and replicate in vitro experimental data on cortico-striatal plasticity. By bridging the levels between the single synapse and behaviour, our model shows how striatum acts as the action-reinforcement interface