Impairments in reinforcement learning do not explain enhanced habit formation in cocaine use disorder.

RATIONALE: Drug addiction has been suggested to develop through drug-induced changes in learning and memory processes. Whilst the initiation of drug use is typically goal-directed and hedonically motivated, over time, drug-taking may develop into a stimulus-driven habit, characterised by persistent use of the drug irrespective of the consequences. Converging lines of evidence suggest that stimulant drugs facilitate the transition of goal-directed into habitual drug-taking, but their contribution to goal-directed learning is less clear. Computational modelling may provide an elegant means for elucidating changes during instrumental learning that may explain enhanced habit formation. OBJECTIVES: We used formal reinforcement learning algorithms to deconstruct the process of appetitive instrumental learning and to explore potential associations between goal-directed and habitual actions in patients with cocaine use disorder (CUD). METHODS: We re-analysed appetitive instrumental learning data in 55 healthy control volunteers and 70 CUD patients by applying a reinforcement learning model within a hierarchical Bayesian framework. We used a regression model to determine the influence of learning parameters and variations in brain structure on subsequent habit formation. RESULTS: Poor instrumental learning performance in CUD patients was largely determined by difficulties with learning from feedback, as reflected by a significantly reduced learning rate. Subsequent formation of habitual response patterns was partly explained by group status and individual variation in reinforcement sensitivity. White matter integrity within goal-directed networks was only associated with performance parameters in controls but not in CUD patients. CONCLUSIONS: Our data indicate that impairments in reinforcement learning are insufficient to account for enhanced habitual responding in CUD.This research was funded by the Medical Research Council (MR/J012084/1) and the NIHR Cambridge Biomedical Research Centre and was conducted at the NIHR Cambridge Clinical Research Facility. The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care. This research was also supported in part by a Medical Research Council (MRC) Clinical Research Infrastructure award (MR/M009041/1). R.N.C. consults for Campden Instruments and receives royalties from Cambridge Enterprise, Routledge, and Cambridge University Press. RNC’s research is supported by the UK Medical Research Council (MC_PC_17213). T.W.R. discloses consultancy with Cambridge Cognition, Lundbeck, Mundipharma and Unilever; he receives royalties for CANTAB from Cambridge Cognition and editorial honoraria from Springer Verlag and Elsevier. T.V.L., G.S. P.S.J., A.A.M. and K.D.E. declare to have no potential conflict of interest

Experimentally induced and real-world anxiety have no demonstrable effect on goal-directed behaviour.

BACKGROUND: Goal-directed control guides optimal decision-making and it is an important cognitive faculty that protects against developing habits. Previous studies have found some evidence of goal-directed deficits when healthy individuals are stressed, and in psychiatric conditions characterised by compulsive behaviours and anxiety. Here, we tested if goal-directed control is affected by state anxiety, which might explain the former results. METHODS: We carried out a causal test of this hypothesis in two experiments (between-subject N = 88; within-subject N = 50) that used the inhalation of hypercapnic gas (7.5% CO2) to induce an acute state of anxiety in healthy volunteers. In a third experiment (N = 1413), we used a correlational design to test if real-life anxiety-provoking events (panic attacks, stressful events) are associated with impaired goal-directed control. RESULTS: In the former two causal experiments, we induced a profoundly anxious state, both physiologically and psychologically, but this did not affect goal-directed performance. In the third, correlational, study, we found no evidence for an association between goal-directed control, panic attacks or stressful life eventsover and above variance accounted for by trait differences in compulsivity. CONCLUSIONS: In sum, three complementary experiments found no evidence that anxiety impairs goal-directed control in human subjects.Research was funded by a Wellcome Trust Senior Investigator Award (TW Robbins 106431/Z/14/Z) and a Sir Henry Wellcome Postdoctoral Fellowship (CM Gillan 101521/Z/12/Z). CM Gillan is supported by a fellowship from MQ: transforming mental health (MQ16IP13). AB Brühl was supported by a fellowship from the Swiss National Science Foundation (SNF PASMP3-145749). FH Hezemans is supported by a Cambridge Trust Vice-Chancellor’s Award and Fitzwilliam College scholarship and was previously supported by an Erasmus scholarship. G Savulich was funded by The Wallitt Foundation and Eton College, with support from the NIHR Cambridge Biomedical Research Centre (BRC) Mental Health theme

Inverse association between negative symptoms and body mass index in chronic schizophrenia.

BACKGROUND: We investigated whether negative symptoms, such as poor motivation or anhedonia, were associated with higher body mass index (BMI) in stable patients with schizophrenia chronically treated with antipsychotic medication. METHODS: 62 olanzapine- or clozapine-treated patients with illness duration of at least four years were selected from an international multicenter study on the characterization of negative symptoms. All participants completed the Brief Negative Symptom Scale (BNSS) and the Positive and Negative Syndrome Scale (PANSS). Bivariate correlations between BMI and negative symptoms (BNSS) were explored, as well as multiple regression analyses. We further explored the association of two principal component factors of the BNSS and BMI. Subsidiary analyses re-modeled the above using the negative symptoms subscale of the PANSS and the EMSLEY factor for negative symptoms for convergent validity. RESULTS: Lower negative symptoms (BNSS score) were associated with higher BMI (r=-0.31; p=0.015). A multiple regression analysis showed that negative symptoms (BNSS score) and age were significant predictors of BMI (p=0.037). This was mostly driven by the motivation/pleasure factor of the BNSS. Within this second factor, BMI was negatively associated with anhedonia (r=-0.254; p=0.046) and asociality (r=-0.253; p=0.048), but not avolition (r=-0.169; p=0.188). EMSLEY score was positively associated with BNSS (r=0.873, p<0.001), but negatively associated with BMI (r=-0.308; p=0.015). The association between PANSS and BMI did not reach significance (r=-224, p=0.080). CONCLUSIONS: We conclude that lower negative symptoms were associated with higher BMI (assessed using both the BNSS and EMSLEY) in chronic stable schizophrenia patients, mostly due to lower anhedonia and asociality levels

Impairments in reinforcement learning do not explain enhanced habit formation in cocaine use disorder

Abstract: Rationale: Drug addiction has been suggested to develop through drug-induced changes in learning and memory processes. Whilst the initiation of drug use is typically goal-directed and hedonically motivated, over time, drug-taking may develop into a stimulus-driven habit, characterised by persistent use of the drug irrespective of the consequences. Converging lines of evidence suggest that stimulant drugs facilitate the transition of goal-directed into habitual drug-taking, but their contribution to goal-directed learning is less clear. Computational modelling may provide an elegant means for elucidating changes during instrumental learning that may explain enhanced habit formation. Objectives: We used formal reinforcement learning algorithms to deconstruct the process of appetitive instrumental learning and to explore potential associations between goal-directed and habitual actions in patients with cocaine use disorder (CUD). Methods: We re-analysed appetitive instrumental learning data in 55 healthy control volunteers and 70 CUD patients by applying a reinforcement learning model within a hierarchical Bayesian framework. We used a regression model to determine the influence of learning parameters and variations in brain structure on subsequent habit formation. Results: Poor instrumental learning performance in CUD patients was largely determined by difficulties with learning from feedback, as reflected by a significantly reduced learning rate. Subsequent formation of habitual response patterns was partly explained by group status and individual variation in reinforcement sensitivity. White matter integrity within goal-directed networks was only associated with performance parameters in controls but not in CUD patients. Conclusions: Our data indicate that impairments in reinforcement learning are insufficient to account for enhanced habitual responding in CUD

Focusing the Neuroscience and Societal Implications of Cognitive Enhancers.

Cognitive enhancement can benefit the individual and society, but also has associated risks and ethical concerns. Cognitive-enhancing drugs are used in the treatment of neuropsychiatric disorders. Nonpharmacological strategies are also emerging, which have the potential to improve motivational deficits associated with neuropsychiatric symptoms and should be prioritized for development. The increasing lifestyle use of "smart" and other drugs indicates the desire for healthy people to improve themselves. Safety and ethical implications are discussed.Janssen/J&J, Wallitt FoundationThis is the author accepted manuscript. The final version is available from Wiley via http://dx.doi.org/10.1002/cpt.45

Valence-dependent influence of serotonin depletion on model-based choice strategy.

Human decision-making arises from both reflective and reflexive mechanisms, which underpin goal-directed and habitual behavioural control. Computationally, these two systems of behavioural control have been described by different learning algorithms, model-based and model-free learning, respectively. Here, we investigated the effect of diminished serotonin (5-hydroxytryptamine) neurotransmission using dietary tryptophan depletion (TD) in healthy volunteers on the performance of a two-stage decision-making task, which allows discrimination between model-free and model-based behavioural strategies. A novel version of the task was used, which not only examined choice balance for monetary reward but also for punishment (monetary loss). TD impaired goal-directed (model-based) behaviour in the reward condition, but promoted it under punishment. This effect on appetitive and aversive goal-directed behaviour is likely mediated by alteration of the average reward representation produced by TD, which is consistent with previous studies. Overall, the major implication of this study is that serotonin differentially affects goal-directed learning as a function of affective valence. These findings are relevant for a further understanding of psychiatric disorders associated with breakdown of goal-directed behavioural control such as obsessive-compulsive disorders or addictions.This research was funded by Wellcome Trust Grants awarded to VV (Intermediate WT Fellowship) and Programme Grant (089589/Z/09/Z) awarded to TWR, BJE, ACR, JWD and BJS. It was conducted at the Behavioural and Clinical Neuroscience Institute, which is supported by a joint award from the Medical Research Council and Wellcome Trust (G00001354). YW was supported by the Fyssen Foundation. SP is supported by Marie Curie Intra-European Fellowship (FP7-People-2012-IEF).This is the final version of the article. It first appeared from NPG via http://dx.doi.org/10.1038/mp.2015.4

Effects of naltrexone are influenced by childhood adversity during negative emotional processing in addiction recovery

Naltrexone is an opioid receptor antagonist used in the management of alcohol dependence. Although the endogenous opioid system has been implicated in emotion regulation, the effects of mu-opioid receptor blockade on brain systems underlying negative emotional processing are not clear in addiction. Individuals meeting criteria for alcohol dependence alone ($\textit{n}$=18, alcohol) and in combination with cocaine and/or opioid dependence ($\textit{n}$=21, alcohol/drugs) and healthy individuals without a history of alcohol or drug dependence ($\textit{n}$=21) were recruited. Participants were alcohol and drug abstinent before entered into this double-blind, placebo-controlled, randomized, crossover study. Functional magnetic resonance imaging was used to investigate brain response while viewing aversive and neutral images relative to baseline on 50 mg of naltrexone and placebo. We found that naltrexone modulated task-related activation in the medial prefrontal cortex and functional connectivity between the anterior cingulate cortex and the hippocampus as a function of childhood adversity (for aversive versus neutral images) in all groups. Furthermore, there was a group-by-treatment-by-condition interaction in the right amygdala, which was mainly driven by a normalization of response for aversive relative to neutral images under naltrexone in the alcohol/drugs group. We conclude that early childhood adversity is one environmental factor that influences pharmacological response to naltrexone. Pharmacotherapy with naltrexone may also have some ameliorative effects on negative emotional processing in combined alcohol and drug dependence, possibly due to alterations in endogenous opioid transmission or the kappa-opioid receptor antagonist actions of naltrexone.The authors disclosed receipt of the following financial support for the research, authorship and/or publication of this article: this article presents independent research funded by the MRC as part of their addiction initiative (Grant Number G1000018). George Savulich was funded by a grant from the Wallitt Foundation

Biased Cognition in Psychosis

The cognitive biases associated with affective disorders have been well documented and provide extensive evidence of selective abnormalities in information processing of pathology congruent information. However in psychosis, research to date has been narrower. There is ample evidence of a ‘jumping to conclusions' reasoning bias but relatively little work on pathology congruent effects on cognitive processes such as attention and interpretation, which may be the most aetiologically important biases. In contrast in emotional disorders, such as anxiety and depression, the selective processing of pathology congruent information is now clearly implicated in the cause and maintenance of the psychopathology. In this review we focus specifically on paranoia and paranoid psychosis and ask how strongly does the evidence to date support a causal or maintaining role for belief congruent information processing biases? We review the literature across three cognitive domains: attention, reasoning, and interpretation. The evidence suggests that paranoia and paranoid psychosis is associated with selective avoidance of threat, generally reduced ‘data gathering’ and negative interpretations of hallucinations that elicit distress. To date there is little evidence specifically examining selective information processing biases of the sort that might support or exacerbate the paranoid beliefs themselves. Given the potential aetiological importance of these belief congruent biases, we call for further research to investigate pathology congruent information processing in paranoia and paranoid psychosis. </jats:p