The Nucleus Accumbens: A Switchboard for Goal-Directed Behaviors

Reward intake optimization requires a balance between exploiting known sources of rewards and exploring for new sources. The prefrontal cortex (PFC) and associated basal ganglia circuits are likely candidates as neural structures responsible for such balance, while the hippocampus may be responsible for spatial/contextual information. Although studies have assessed interactions between hippocampus and PFC, and between hippocampus and the nucleus accumbens (NA), it is not known whether 3-way interactions among these structures vary under different behavioral conditions. Here, we investigated these interactions with multichannel recordings while rats explored an operant chamber and while they performed a learned lever-pressing task for reward in the same chamber shortly afterward. Neural firing and local field potentials in the NA core synchronized with hippocampal activity during spatial exploration, but during lever pressing they instead synchronized more strongly with the PFC. The latter is likely due to transient drive of NA neurons by bursting prefrontal activation, as in vivo intracellular recordings in anesthetized rats revealed that NA up states can transiently synchronize with spontaneous PFC activity and PFC stimulation with a bursting pattern reliably evoked up states in NA neurons. Thus, the ability to switch synchronization in a task-dependent manner indicates that the NA core can dynamically select its inputs to suit environmental demands, thereby contributing to decision-making, a function that was thought to primarily depend on the PFC

A Wasp Manipulates Neuronal Activity in the Sub-Esophageal Ganglion to Decrease the Drive for Walking in Its Cockroach Prey

BACKGROUND: The parasitoid Jewel Wasp hunts cockroaches to serve as a live food supply for its offspring. The wasp stings the cockroach in the head and delivers a cocktail of neurotoxins directly inside the prey's cerebral ganglia. Although not paralyzed, the stung cockroach becomes a living yet docile 'zombie', incapable of self-initiating spontaneous or evoked walking. We show here that such neuro-chemical manipulation can be attributed to decreased neuronal activity in a small region of the cockroach cerebral nervous system, the sub-esophageal ganglion (SEG). A decrease in descending permissive inputs from this ganglion to thoracic central pattern generators decreases the propensity for walking-related behaviors. METHODOLOGY AND PRINCIPAL FINDINGS: We have used behavioral, neuro-pharmacological and electrophysiological methods to show that: (1) Surgically removing the cockroach SEG prior to wasp stinging prolongs the duration of the sting 5-fold, suggesting that the wasp actively targets the SEG during the stinging sequence; (2) injecting a sodium channel blocker, procaine, into the SEG of non-stung cockroaches reversibly decreases spontaneous and evoked walking, suggesting that the SEG plays an important role in the up-regulation of locomotion; (3) artificial focal injection of crude milked venom into the SEG of non-stung cockroaches decreases spontaneous and evoked walking, as seen with naturally-stung cockroaches; and (4) spontaneous and evoked neuronal spiking activity in the SEG, recorded with an extracellular bipolar microelectrode, is markedly decreased in stung cockroaches versus non-stung controls. CONCLUSIONS AND SIGNIFICANCE: We have identified the neuronal substrate responsible for the venom-induced manipulation of the cockroach's drive for walking. Our data strongly support previous findings suggesting a critical and permissive role for the SEG in the regulation of locomotion in insects. By injecting a venom cocktail directly into the SEG, the parasitoid Jewel Wasp selectively manipulates the cockroach's motivation to initiate walking without interfering with other non-related behaviors

A Symbiotic Brain-Machine Interface through Value-Based Decision Making

BACKGROUND: In the development of Brain Machine Interfaces (BMIs), there is a great need to enable users to interact with changing environments during the activities of daily life. It is expected that the number and scope of the learning tasks encountered during interaction with the environment as well as the pattern of brain activity will vary over time. These conditions, in addition to neural reorganization, pose a challenge to decoding neural commands for BMIs. We have developed a new BMI framework in which a computational agent symbiotically decoded users' intended actions by utilizing both motor commands and goal information directly from the brain through a continuous Perception-Action-Reward Cycle (PARC). METHODOLOGY: The control architecture designed was based on Actor-Critic learning, which is a PARC-based reinforcement learning method. Our neurophysiology studies in rat models suggested that Nucleus Accumbens (NAcc) contained a rich representation of goal information in terms of predicting the probability of earning reward and it could be translated into an evaluative feedback for adaptation of the decoder with high precision. Simulated neural control experiments showed that the system was able to maintain high performance in decoding neural motor commands during novel tasks or in the presence of reorganization in the neural input. We then implanted a dual micro-wire array in the primary motor cortex (M1) and the NAcc of rat brain and implemented a full closed-loop system in which robot actions were decoded from the single unit activity in M1 based on an evaluative feedback that was estimated from NAcc. CONCLUSIONS: Our results suggest that adapting the BMI decoder with an evaluative feedback that is directly extracted from the brain is a possible solution to the problem of operating BMIs in changing environments with dynamic neural signals. During closed-loop control, the agent was able to solve a reaching task by capturing the action and reward interdependency in the brain

Enhanced Food Anticipatory Activity Associated with Enhanced Activation of Extrahypothalamic Neural Pathways in Serotonin2C Receptor Null Mutant Mice

The ability to entrain circadian rhythms to food availability is important for survival. Food-entrained circadian rhythms are characterized by increased locomotor activity in anticipation of food availability (food anticipatory activity). However, the molecular components and neural circuitry underlying the regulation of food anticipatory activity remain unclear. Here we show that serotonin2C receptor (5-HT2CR) null mutant mice subjected to a daytime restricted feeding schedule exhibit enhanced food anticipatory activity compared to wild-type littermates, without phenotypic differences in the impact of restricted feeding on food consumption, body weight loss, or blood glucose levels. Moreover, we show that the enhanced food anticipatory activity in 5-HT2CR null mutant mice develops independent of external light cues and persists during two days of total food deprivation, indicating that food anticipatory activity in 5-HT2CR null mutant mice reflects the locomotor output of a food-entrainable oscillator. Whereas restricted feeding induces c-fos expression to a similar extent in hypothalamic nuclei of wild-type and null mutant animals, it produces enhanced expression in the nucleus accumbens and other extrahypothalamic regions of null mutant mice relative to wild-type subjects. These data suggest that 5-HT2CRs gate food anticipatory activity through mechanisms involving extrahypothalamic neural pathways

P2 receptors are involved in the mediation of motivation-related behavior

The importance of purinergic signaling in the intact mesolimbic–mesocortical circuit of the brain of freely moving rats is reviewed. In the rat, an endogenous ADP/ATPergic tone reinforces the release of dopamine from the axon terminals in the nucleus accumbens as well as from the somatodendritic region of these neurons in the ventral tegmental area, as well as the release of glutamate, probably via P2Y1 receptor stimulation. Similar mechanisms may regulate the release of glutamate in both areas of the brain. Dopamine and glutamate determine in concert the activity of the accumbal GABAergic, medium-size spiny neurons thought to act as an interface between the limbic cortex and the extrapyramidal motor system. These neurons project to the pallidal and mesencephalic areas, thereby mediating the behavioral reaction of the animal in response to a motivation-related stimulus. There is evidence that extracellular ADP/ATP promotes goal-directed behavior, e.g., intention and feeding, via dopamine, probably via P2Y1 receptor stimulation. Accumbal P2 receptor-mediated glutamatergic mechanisms seem to counteract the dopaminergic effects on behavior. Furthermore, adaptive changes of motivation-related behavior, e.g., by chronic succession of starvation and feeding or by repeated amphetamine administration, are accompanied by changes in the expression of the P2Y1 receptor, thought to modulate the sensitivity of the animal to respond to certain stimuli

Resolving the neural circuits of anxiety

Although anxiety disorders represent a major societal problem demanding new therapeutic targets, these efforts have languished in the absence of a mechanistic understanding of this subjective emotional state. While it is impossible to know with certainty the subjective experience of a rodent, rodent models hold promise in dissecting well-conserved limbic circuits. The application of modern approaches in neuroscience has already begun to unmask the neural circuit intricacies underlying anxiety by allowing direct examination of hypotheses drawn from existing psychological concepts. This information points toward an updated conceptual model for what neural circuit perturbations could give rise to pathological anxiety and thereby provides a roadmap for future therapeutic development.National Institute of Diabetes and Digestive and Kidney Diseases (U.S.) (NIH Director’s New Innovator Award DP2-DK-102256-01)National Institute of Mental Health (U.S.) (NIH) R01-MH102441-01)JPB Foundatio

A new framework for cortico-striatal plasticity: behavioural theory meets In vitro data at the reinforcement-action interface

Operant learning requires that reinforcement signals interact with action representations at a suitable neural interface. Much evidence suggests that this occurs when phasic dopamine, acting as a reinforcement prediction error, gates plasticity at cortico-striatal synapses, and thereby changes the future likelihood of selecting the action(s) coded by striatal neurons. But this hypothesis faces serious challenges. First, cortico-striatal plasticity is inexplicably complex, depending on spike timing, dopamine level, and dopamine receptor type. Second, there is a credit assignment problem—action selection signals occur long before the consequent dopamine reinforcement signal. Third, the two types of striatal output neuron have apparently opposite effects on action selection. Whether these factors rule out the interface hypothesis and how they interact to produce reinforcement learning is unknown. We present a computational framework that addresses these challenges. We first predict the expected activity changes over an operant task for both types of action-coding striatal neuron, and show they co-operate to promote action selection in learning and compete to promote action suppression in extinction. Separately, we derive a complete model of dopamine and spike-timing dependent cortico-striatal plasticity from in vitro data. We then show this model produces the predicted activity changes necessary for learning and extinction in an operant task, a remarkable convergence of a bottom-up data-driven plasticity model with the top-down behavioural requirements of learning theory. Moreover, we show the complex dependencies of cortico-striatal plasticity are not only sufficient but necessary for learning and extinction. Validating the model, we show it can account for behavioural data describing extinction, renewal, and reacquisition, and replicate in vitro experimental data on cortico-striatal plasticity. By bridging the levels between the single synapse and behaviour, our model shows how striatum acts as the action-reinforcement interface

Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits

Background Over the last several years, it has become apparent that there are critical problems with the hypothesis that brain dopamine (DA) systems, particularly in the nucleus accumbens, directly mediate the rewarding or primary motivational characteristics of natural stimuli such as food. Hypotheses related to DA function are undergoing a substantial restructuring, such that the classic emphasis on hedonia and primary reward is giving way to diverse lines of research that focus on aspects of instrumental learning, reward prediction, incentive motivation, and behavioral activation. Objective The present review discusses dopaminergic involvement in behavioral activation and, in particular, emphasizes the effort-related functions of nucleus accumbens DA and associated forebrain circuitry. Results The effects of accumbens DA depletions on food-seeking behavior are critically dependent upon the work requirements of the task. Lever pressing schedules that have minimal work requirements are largely unaffected by accumbens DA depletions, whereas reinforcement schedules that have high work (e.g., ratio) requirements are substantially impaired by accumbens DA depletions. Moreover, interference with accumbens DA transmission exerts a powerful influence over effort-related decision making. Rats with accumbens DA depletions reallocate their instrumental behavior away from food-reinforced tasks that have high response requirements, and instead, these rats select a less-effortful type of food-seeking behavior. Conclusions Along with prefrontal cortex and the amygdala, nucleus accumbens is a component of the brain circuitry regulating effort-related functions. Studies of the brain systems regulating effort-based processes may have implications for understanding drug abuse, as well as energy-related disorders such as psychomotor slowing, fatigue, or anergia in depression

Mourning and melancholia revisited: correspondences between principles of Freudian metapsychology and empirical findings in neuropsychiatry

Freud began his career as a neurologist studying the anatomy and physiology of the nervous system, but it was his later work in psychology that would secure his place in history. This paper draws attention to consistencies between physiological processes identified by modern clinical research and psychological processes described by Freud, with a special emphasis on his famous paper on depression entitled 'Mourning and melancholia'. Inspired by neuroimaging findings in depression and deep brain stimulation for treatment resistant depression, some preliminary physiological correlates are proposed for a number of key psychoanalytic processes. Specifically, activation of the subgenual cingulate is discussed in relation to repression and the default mode network is discussed in relation to the ego. If these correlates are found to be reliable, this may have implications for the manner in which psychoanalysis is viewed by the wider psychological and psychiatric communities