5 research outputs found
Recommended from our members
The influence of contextual reward statistics on risk preference
Decision theories mandate that organisms should adjust their behaviour in the light of the contextual reward statistics. We tested this notion using a gambling choice task involving distinct contexts with different reward distributions. The best fitting model of subjects' behaviour indicated that the subjective values of options depended on several factors, including a baseline gambling propensity, a gambling preference dependent on reward amount, and a contextual reward adaptation factor. Combining this behavioural model with simultaneous functional magnetic resonance imaging we probed neural responses in three key regions linked to reward and value, namely ventral tegmental area/substantia nigra (VTA/SN), ventromedial prefrontal cortex (vmPFC) and ventral striatum (VST). We show that activity in the VTA/SN reflected contextual reward statistics to the extent that context affected behaviour, activity in the vmPFC represented a value difference between chosen and unchosen options while VST responses reflected a non-linear mapping between the actual objective rewards and their subjective value. The findings highlight a multifaceted basis for choice behaviour with distinct mappings between components of this behaviour and value sensitive brain regions
Recommended from our members
Decreased value-sensitivity in schizophrenia
Pathophysiology in schizophrenia has been linked to aberrant incentive salience, namely the dysfunctional processing of value linked to abnormal dopaminergic activity. In line with this, recent studies showed impaired learning of value in schizophrenia. However, how value is used to guide behaviour independently from learning, as in risky choice, has rarely been examined in this disorder. We studied value-guided choice under risk in patients with schizophrenia and in controls using a task requiring a choice between a certain monetary reward, varying trial-by-trial, and a gamble offering an equal probability of getting double this certain amount or nothing. We observed that patients compared to controls exhibited reduced sensitivity to values, implying that their choices failed to flexibly adapt to the specific values on offer. Moreover, the degree of this value sensitivity inversely correlated with aberrant salience experience, suggesting that the inability to tune choice to value may be a key element of aberrant salience in the illness. Our results help clarify the cognitive mechanisms underlying improper attribution of value in schizophrenia and may thus inform cognitive interventions aimed at reinstating value sensitivity in patients
Recommended from our members
The role of expecting feedback during decision-making under risk
Sometimes choice is followed by outcome feedback and other times it is not. It remains unknown whether humans prefer gambling when they expect feedback to be revealed. Regarding this question, decision-making theories make alternative predictions. Some theories have proposed that choice is influenced by whether one expects to be disappointed in the future. Given that feedback is sometimes disappointing, these theories predict increased aversion towards gambling when feedback is expected compared to when feedback is not expected. The opposite effect is predicted by theories of curiosity, which postulate reduction of uncertainty as an important behavioural drive. Given that feedback reduces uncertainty, these theories predict that gambling will be favoured when feedback is expected. To examine whether expecting feedback influences gambling behaviour, we recorded functional neuroimaging data while participants performed a novel decision-making task requiring to chose between a sure option and a gamble. Crucially, participants expected to receive feedback in some trials but not in other trials. Consistent with theories of curiosity, we found that expecting feedback increased gambling propensity. At the neural level, at option presentation the increased value of gambling during feedback was reflected in activity in the ventral striatum. This suggests that, together with its established role in signalling reward, the ventral striatum also processes a form of epistemic value. Our study demonstrates that gambling becomes more attractive when feedback is expected and suggests that striatal activity could signal the value of feedback information
Recommended from our members
Reference effects on decision-making elicited by previous rewards
Substantial evidence has highlighted reference effects occurring during decision-making, whereby subjective value is not calculated in absolute terms but relative to the distribution of rewards characterizing a context. Among these, within-choice effects are exerted by options simultaneously available during choice. These should be distinguished from between-choice effects, which depend on the distribution of options presented in the past. Influential theories on between-choice effects include Decision-by-Sampling, Expectation-as-Reference and Divisive Normalization. Surprisingly, previous literature has focused on each theory individually disregarding the others. Thus, similarities and differences among theories remain to be systematically examined. Here we fill this gap by offering an overview of the state-of-the-art of research about between-choice reference effects. Our comparison of alternative theories shows that, at present, none of them is able to account for the full range of empirical data. To address this, we propose a model inspired by previous perspectives and based on a logistic framework, hence called logistic model of subjective value. Predictions of the model are analysed in detail about reference effects and risky decision-making. We conclude that our proposal offers a compelling framework for interpreting the multifaceted manifestations of between-choice reference effects
Neurocomputational Accounts of Choice Variability and Affect during Decision-making
Humans exhibit surprising variability in behaviour, often making different choices under identical conditions. While the outcomes of these choices typically lead to explicit rewards that have been shown to influence subsequent affective states, less well understood is how the brain represents rewards that are intrinsically meaningful to an individual. The first part of this thesis examines the contributions of endogenous fluctuations in brain activity to behaviour. Resting-state studies suggest that ongoing endogenous fluctuations in brain activity can influence low-level perceptual and motor processes but it remains unknown whether such fluctuations also influence high-level cognitive processes including decision making. Using a novel application of real-time functional magnetic resonance imaging, I find that low pre-stimulus brain activity lead to increased occurrences of risky choice. Using computational modeling, I show that greater risk taking is explained by enhanced phasic responses to offers in a decision network. These findings demonstrate that endogenous brain activity provides a physiological basis for variability in complex behaviour. I then examine how the neuroanatomy of the brain in the form of tissue microstructure relates to risk preferences by leveraging on in vivo histology using magnetic resonance imaging. The second part of this thesis investigates how experienced events, such as rewards received following choice, are aggregated into affective states. Despite their relevance to ideas like goal-setting and well-being, little is known about the impact of intrinsic rewards on affective states and their representation in the brain. A reinforcement learning task incorporating a skilled performance component that did not influence payment was developed to examine this. Computational modeling revealed that momentary happiness depended on past extrinsic rewards and also intrinsic rewards related to the experience of successful skilled performance. Individuals for whom intrinsic rewards more strongly influence momentary happiness exhibit stronger ventromedial prefrontal cortex responses for successful skilled performance. These findings show that the ventromedial prefrontal cortex represents the subjective value of intrinsic rewards, and that computational models of mood dynamics provide a tool that can be used to measure implicit values of abstract goods and experiences