The Value of Success: Acquiring Gains, Avoiding Losses, and Simply Being Successful

A large network of spatially contiguous, yet anatomically distinct regions in medial frontal cortex is involved in reward processing. Although it is clear these regions play a role in critical aspects of reward-related learning and decision-making, the individual contributions of each component remains unclear. We explored dissociations in reward processing throughout several key regions in the reward system and aimed to clarify the nature of previously observed outcome-related activity in a portion of anterior medial orbitofrontal cortex (mOFC). Specifically, we tested whether activity in anterior mOFC was related to processing successful actions, such that this region would respond similarly to rewards with and without tangible benefits, or whether this region instead encoded only quantifiable outcome values (e.g., money). Participants performed a task where they encountered monetary gains and losses (and non-gains and non-losses) during fMRI scanning. Critically, in addition to the outcomes with monetary consequences, the task included trials that provided outcomes without tangible benefits (participants were simply told that they were correct or incorrect). We found that anterior mOFC responded to all successful outcomes regardless of whether they carried tangible benefits (monetary gains and non-losses) or not (controls). These results support the hypothesis that anterior mOFC processes rewards in terms of a common currency and is capable of providing reward-based signals for everything we value, whether it be primary or secondary rewards or simply a successful experience without objectively quantifiable benefits

Markers of serotonergic function in the orbitofrontal cortex and dorsal raphé nucleus predict individual variation in spatial-discrimination serial reversal learning.

Dysfunction of the orbitofrontal cortex (OFC) impairs the ability of individuals to flexibly adapt behavior to changing stimulus-reward (S-R) contingencies. Impaired flexibility also results from interventions that alter serotonin (5-HT) and dopamine (DA) transmission in the OFC and dorsomedial striatum (DMS). However, it is unclear whether similar mechanisms underpin naturally occurring variations in behavioral flexibility. In the present study, we used a spatial-discrimination serial reversal procedure to investigate interindividual variability in behavioral flexibility in rats. We show that flexibility on this task is improved following systemic administration of the 5-HT reuptake inhibitor citalopram and by low doses of the DA reuptake inhibitor GBR12909. Rats in the upper quintile of the distribution of perseverative responses during repeated S-R reversals showed significantly reduced levels of the 5-HT metabolite, 5-hydroxy-indoleacetic acid, in the OFC. Additionally, 5-HT2A receptor binding in the OFC of mid- and high-quintile rats was significantly reduced compared with rats in the low-quintile group. These perturbations were accompanied by an increase in the expression of monoamine oxidase-A (MAO-A) and MAO-B in the lateral OFC and by a decrease in the expression of MAO-A, MAO-B, and tryptophan hydroxylase in the dorsal raphé nucleus of highly perseverative rats. We found no evidence of significant differences in markers of DA and 5-HT function in the DMS or MAO expression in the ventral tegmental area of low- vs high-perseverative rats. These findings indicate that diminished serotonergic tone in the OFC may be an endophenotype that predisposes to behavioral inflexibility and other forms of compulsive behavior.This work was supported by Medical Research Council Grants (G0701500; G0802729), a 503 Wellcome Trust Programme Grant (grant number 089589/Z/09/Z), and by a Core Award 504 from the Medical Research Council and the Wellcome Trust to the Behavioural and Clinical 505 21 Neuroscience Institute (MRC Ref G1000183; WT Ref 093875/Z/10/Z). RLB was supported 506 by a studentship from the Medical Research Council. JA was supported by a Fellowship from 507 the Swedish Research Council (350-2012-230). BJ was supported by Fellowships from the 508 AXA Research Fund and the National Health and Medical Research Council of Australia. 509 Financial support from the Fredrik and Ingrid Thuring Foundation is also acknowledged.This is the accepted manuscript. The final version is available from Nature Publishing at http://www.nature.com/npp/journal/vaop/ncurrent/full/npp2014335a.html

Temporal and effort cost decision-making in healthy individuals with subclinical psychotic symptoms

The value people attribute to rewards is influenced both by the time and the effort required to obtain them. Impairments in these computations are described in patients with schizophrenia and appear associated with negative symptom severity. This study investigated whether deficits in temporal and effort cost computations can be observed in individuals with subclinical psychotic symptoms (PS) to determine if this dysfunction is already present in a potentially pre-psychotic period. Sixty participants, divided into three groups based on the severity of PS (high, medium and low), performed two temporal discounting tasks with food and money and a concurrent schedule task, in which the effort to obtain food increased over time. We observed that in high PS participants the discounting rate appeared linear and flatter than that exhibited by participants with medium and low PS, especially with food. In the concurrent task, compared to those with low PS, participants with high PS exerted tendentially less effort to obtain snacks only when the required effort was high. Participants exerting less effort in the higher effort condition were those with higher negative symptoms. These results suggest that aberrant temporal and effort cost computations might be present in individuals with subclinical PS and therefore could represent a vulnerability marker for psychosis

Information content and reward processing in the human striatum during performance of a declarative memory task

Negative feedback can signal poor performance, but it also provides information that can help learners reach the goal of task mastery. The primary aim of this study was to test the hypothesis that the amount of information provided by negative feedback during a paired-associate learning task influences feedback-related processing in the caudate nucleus. To do this, we manipulated the number of response options: With two options, positive and negative feedback provide equal amounts of information, whereas with four options, positive feedback provides more information than does negative feedback. We found that positive and negative feedback activated the caudate similarly when there were two response options. With four options, the caudate’s response to negative feedback was reduced. A secondary goal was to investigate the link between brain-based measures of feedback-related processing and behavioral indices of learning. Analysis of the posttest measures showed that trials with positive feedback were associated with higher posttest confidence ratings. Additionally, when positive feedback was delivered, caudate activity was greater for trials with high than with low posttest confidence. This experiment demonstrated the context sensitivity of feedback processing and provided evidence that feedback processing in the striatum can contribute to the strengthening of the representations available within declarative memory

Neural Circuitry of Emotional and Cognitive Conflict Revealed through Facial Expressions

Neural systems underlying conflict processing have been well studied in the cognitive realm, but the extent to which these overlap with those underlying emotional conflict processing remains unclear. A novel adaptation of the AX Continuous Performance Task (AX-CPT), a stimulus-response incompatibility paradigm, was examined that permits close comparison of emotional and cognitive conflict conditions, through the use of affectively-valenced facial expressions as the response modality.Brain activity was monitored with functional magnetic resonance imaging (fMRI) during performance of the emotional AX-CPT. Emotional conflict was manipulated on a trial-by-trial basis, by requiring contextually pre-cued facial expressions to emotional probe stimuli (IAPS images) that were either affectively compatible (low-conflict) or incompatible (high-conflict). The emotion condition was contrasted against a matched cognitive condition that was identical in all respects, except that probe stimuli were emotionally neutral. Components of the brain cognitive control network, including dorsal anterior cingulate cortex (ACC) and lateral prefrontal cortex (PFC), showed conflict-related activation increases in both conditions, but with higher activity during emotion conditions. In contrast, emotion conflict effects were not found in regions associated with affective processing, such as rostral ACC.These activation patterns provide evidence for a domain-general neural system that is active for both emotional and cognitive conflict processing. In line with previous behavioural evidence, greatest activity in these brain regions occurred when both emotional and cognitive influences additively combined to produce increased interference

Pavlovian Reward Prediction and Receipt in Schizophrenia: Relationship to Anhedonia

Reward processing abnormalities have been implicated in the pathophysiology of negative symptoms such as anhedonia and avolition in schizophrenia. However, studies examining neural responses to reward anticipation and receipt have largely relied on instrumental tasks, which may confound reward processing abnormalities with deficits in response selection and execution. 25 chronic, medicated outpatients with schizophrenia and 20 healthy controls underwent functional magnetic resonance imaging using a Pavlovian reward prediction paradigm with no response requirements. Subjects passively viewed cues that predicted subsequent receipt of monetary reward or non-reward, and blood-oxygen-level-dependent signal was measured at the time of cue presentation and receipt. At the group level, neural responses to both reward anticipation and receipt were largely similar between groups. At the time of cue presentation, striatal anticipatory responses did not differ between patients and controls. Right anterior insula demonstrated greater activation for nonreward than reward cues in controls, and for reward than nonreward cues in patients. At the time of receipt, robust responses to receipt of reward vs. nonreward were seen in striatum, midbrain, and frontal cortex in both groups. Furthermore, both groups demonstrated responses to unexpected versus expected outcomes in cortical areas including bilateral dorsolateral prefrontal cortex. Individual difference analyses in patients revealed an association between physical anhedonia and activity in ventral striatum and ventromedial prefrontal cortex during anticipation of reward, in which greater anhedonia severity was associated with reduced activation to money versus no-money cues. In ventromedial prefrontal cortex, this relationship held among both controls and patients, suggesting a relationship between anticipatory activity and anhedonia irrespective of diagnosis. These findings suggest that in the absence of response requirements, brain responses to reward receipt are largely intact in medicated individuals with chronic schizophrenia, while reward anticipation responses in left ventral striatum are reduced in those patients with greater anhedonia severity

Neural correlates of evidence accumulation during value-based decisions revealed via simultaneous EEG-fMRI

Current computational accounts posit that, in simple binary choices, humans accumulate evidence in favour of the different alternatives before committing to a decision. Neural correlates of this accumulating activity have been found during perceptual decisions in parietal and prefrontal cortex; however the source of such activity in value-based choices remains unknown. Here we use simultaneous EEG–fMRI and computational modelling to identify EEG signals reflecting an accumulation process and demonstrate that the within- and across-trial variability in these signals explains fMRI responses in posterior-medial frontal cortex. Consistent with its role in integrating the evidence prior to reaching a decision, this region also exhibits task-dependent coupling with the ventromedial prefrontal cortex and the striatum, brain areas known to encode the subjective value of the decision alternatives. These results further endorse the proposition of an evidence accumulation process during value-based decisions in humans and implicate the posterior-medial frontal cortex in this process

Expert Financial Advice Neurobiologically “Offloads” Financial Decision-Making under Risk

BACKGROUND: Financial advice from experts is commonly sought during times of uncertainty. While the field of neuroeconomics has made considerable progress in understanding the neurobiological basis of risky decision-making, the neural mechanisms through which external information, such as advice, is integrated during decision-making are poorly understood. In the current experiment, we investigated the neurobiological basis of the influence of expert advice on financial decisions under risk. METHODOLOGY/PRINCIPAL FINDINGS: While undergoing fMRI scanning, participants made a series of financial choices between a certain payment and a lottery. Choices were made in two conditions: 1) advice from a financial expert about which choice to make was displayed (MES condition); and 2) no advice was displayed (NOM condition). Behavioral results showed a significant effect of expert advice. Specifically, probability weighting functions changed in the direction of the expert's advice. This was paralleled by neural activation patterns. Brain activations showing significant correlations with valuation (parametric modulation by value of lottery/sure win) were obtained in the absence of the expert's advice (NOM) in intraparietal sulcus, posterior cingulate cortex, cuneus, precuneus, inferior frontal gyrus and middle temporal gyrus. Notably, no significant correlations with value were obtained in the presence of advice (MES). These findings were corroborated by region of interest analyses. Neural equivalents of probability weighting functions showed significant flattening in the MES compared to the NOM condition in regions associated with probability weighting, including anterior cingulate cortex, dorsolateral PFC, thalamus, medial occipital gyrus and anterior insula. Finally, during the MES condition, significant activations in temporoparietal junction and medial PFC were obtained. CONCLUSIONS/SIGNIFICANCE: These results support the hypothesis that one effect of expert advice is to "offload" the calculation of value of decision options from the individual's brain

Led into Temptation? Rewarding Brand Logos Bias the Neural Encoding of Incidental Economic Decisions

Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI) study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness