Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits

Background Over the last several years, it has become apparent that there are critical problems with the hypothesis that brain dopamine (DA) systems, particularly in the nucleus accumbens, directly mediate the rewarding or primary motivational characteristics of natural stimuli such as food. Hypotheses related to DA function are undergoing a substantial restructuring, such that the classic emphasis on hedonia and primary reward is giving way to diverse lines of research that focus on aspects of instrumental learning, reward prediction, incentive motivation, and behavioral activation. Objective The present review discusses dopaminergic involvement in behavioral activation and, in particular, emphasizes the effort-related functions of nucleus accumbens DA and associated forebrain circuitry. Results The effects of accumbens DA depletions on food-seeking behavior are critically dependent upon the work requirements of the task. Lever pressing schedules that have minimal work requirements are largely unaffected by accumbens DA depletions, whereas reinforcement schedules that have high work (e.g., ratio) requirements are substantially impaired by accumbens DA depletions. Moreover, interference with accumbens DA transmission exerts a powerful influence over effort-related decision making. Rats with accumbens DA depletions reallocate their instrumental behavior away from food-reinforced tasks that have high response requirements, and instead, these rats select a less-effortful type of food-seeking behavior. Conclusions Along with prefrontal cortex and the amygdala, nucleus accumbens is a component of the brain circuitry regulating effort-related functions. Studies of the brain systems regulating effort-based processes may have implications for understanding drug abuse, as well as energy-related disorders such as psychomotor slowing, fatigue, or anergia in depression

D-amphetamine and antipsychotic drug effects on latent inhibition in mice lacking dopamine D2 receptors

Drugs that induce psychosis, such as D-amphetamine (AMP), and those that alleviate it, such as antipsychotics, are suggested to exert behavioral effects via dopamine receptor D2 (D2). All antipsychotic drugs are D2 antagonists, but D2 antagonism underlies the severe and debilitating side effects of these drugs; it is therefore important to know whether D2 is necessary for their behavioral effects. Using D2-null mice (Drd2/), we first investigated whether D2 is required for AMP disruption of latent inhibition (LI). LI is a process of learning to ignore irrelevant stimuli. Disruption of LI by AMP models impaired attention and abnormal salience allocation consequent to dysregulated dopamine relevant to schizophrenia. AMP disruption of LI was seen in both wild-type (WT) and Drd2/. This was in contrast to AMP-induced locomotor hyperactivity, which was reduced in Drd2/. AMP disruption of LI was attenuated in mice lacking dopamine receptor D1 (Drd1/), suggesting that D1 may play a role in AMP disruption of LI. Further supporting this possibility, we found that D1 antagonist SKF83566 attenuated AMP disruption of LI in WT. Remarkably, both haloperidol and clozapine attenuated AMP disruption of LI in Drd2/. This demonstrates that antipsychotic drugs can attenuate AMP disruption of learning to ignore irrelevant stimuli in the absence of D2 receptors. Data suggest that D2 is not essential either for AMP to disrupt or for antipsychotic drugs to reverse AMP disruption of learning to ignore irrelevant stimuli and further that D1 merits investigation in the mediation of AMP disruption of these processes

Western diet chow consumption in rats induces striatal neuronal activation while reducing dopamine levels without affecting spatial memory in the radial arm maze

Rats fed high fat diets have been shown to be impaired in hippocampal-dependent behavioral tasks, such as spatial recognition in the Y-maze and reference memory in the Morris water maze (MWM). It is clear from previous studies, however, that motivation and reward factor into the memory deficits associated with obesity and high-fat diet consumption, and that the prefrontal cortex and striatumand neurotransmitter dopamine play important roles in cognitive performance. In this series of studies we extend our research to investigate the effect of a high fat diet on striatal neurochemistry and performance in the delayed spatial win-shift radial arm maze task, a paradigm highly reliant on dopamine-rich brain regions, such as the striatum after high fat diet consumption. Memory performance, neuronal activation and brain dopaminergic levels were compared in rats fed a “Western” (21% fat, 0.15% cholesterol) chow diet compared to normal diet (6% fat, 0.15% cholesterol)-fed controls. Twelve weeks of dietary manipulation produced an increase in weight in western diet-fed rats, but did not affect learning and performance in the delayed spatial win-shift radial arm maze task. Concurrently, there was an observed decrease in dopamine levels in the striatum and a reduction of dopamine turnover in the hippocampus in western diet-fed rats. In a separate cohort of rats Fos levels were measured after rats had been placed in a novel arena and allowed to explore freely. In normal rats, this exposure to a unique environment did not affect neuronal activation. In contrast, rats fed a western diet were found to have significantly increased Fos expression in the striatum, but not prefrontal cortex or hippocampus. Our study demonstrates that while western diet consumption in rats produces weight gain and brain neuronal and neurotransmitter changes, it did not affect performance in the delayed spatial win-shift paradigm in the radial arm maze. We conclude that modeling the cognitive decline-obesity relationship is complex with considerations, of type of memory, behavioral task and dietary intervention (fat, fat and sugar, sugar, and cafeteria diets) all adding to our overall understanding

Adaptive Coordination of Multiple Learning Strategies in Brains and Robots

International audienceEngineering approaches to machine learning (including robot learning) typically seek for the best learning algorithm for a particular problem, or a set problems. In contrast, the mammalian brain appears as a toolbox of different learning strategies, so that any newly encountered situation can be autonomously learned by an animal with a combination of existing learning strategies. For example, when facing a new navigation problem, a rat can either learn a map of the environment and then plan to find a path to its goal within this map. Alternatively, it can learn sequences of egocentric movements in response to identifiable features of the environment. For about 15 years, computational neuroscientists have searched for the mammalian brain's coordination mechanisms which enable it to find efficient, if not necessarily optimal, combinations of existing learning strategies to solve new problems. Understanding such coordination principles of multiple learning strategies could have great implications in robotics, to enable robots to autonomously determine which learning strategies are appropriate in different contexts. Here, we review some of the main neuroscience models for the coordination of learning strategies and present some of the early results obtained when applying these models to robot learning. We moreover highlight important energy costs which can be reduced with such bio-inspired solutions compared to current deep reinforcement learning approaches. We conclude by sketching a roadmap for further developing such bio-inspired hybrid learning approaches to robotics

Effects of acute administration of nicotine, amphetamine, diazepam, morphine, and ethanol on risky decision-making in rats

RATIONALE: Most individuals can accurately assess the risks and rewards associated with choice alternatives and decide accordingly; however, drug users often display maladaptive decision-making, such that choices are biased toward excessively risky options. OBJECTIVE: The purpose of this study was to investigate the effects of a range of drugs of abuse on risky decision-making. METHODS: Male Long–Evans rats were trained in the Risky Decision-Making Task, in which they chose between two levers, one which produced a small, “safe” food reward and the other which produced a large, “risky” food reward. The large reward was accompanied by the risk of a mild footshock, the probability of which increased over the course of each test session (0%, 25%, 50%, 75%, and 100%). RESULTS: Nicotine (0.6 mg/kg) and amphetamine (1.5 mg/kg) caused a significant decrease in choice of the large risky reward (decreased risk taking). Diazepam (1.0 mg/kg) caused a significant increase in choice of the large risky reward (increased risk taking), whereas morphine (3.0 mg/kg) caused only a trend toward increased choice of the large risky reward. Ethanol had no effect on choice behavior. CONCLUSIONS: These results show that acute administration of drugs of abuse can modulate risk taking in a drug-specific manner, either increasing or decreasing preference for highly rewarding, but risky, options