Impairments in reinforcement learning do not explain enhanced habit formation in cocaine use disorder

Abstract: Rationale: Drug addiction has been suggested to develop through drug-induced changes in learning and memory processes. Whilst the initiation of drug use is typically goal-directed and hedonically motivated, over time, drug-taking may develop into a stimulus-driven habit, characterised by persistent use of the drug irrespective of the consequences. Converging lines of evidence suggest that stimulant drugs facilitate the transition of goal-directed into habitual drug-taking, but their contribution to goal-directed learning is less clear. Computational modelling may provide an elegant means for elucidating changes during instrumental learning that may explain enhanced habit formation. Objectives: We used formal reinforcement learning algorithms to deconstruct the process of appetitive instrumental learning and to explore potential associations between goal-directed and habitual actions in patients with cocaine use disorder (CUD). Methods: We re-analysed appetitive instrumental learning data in 55 healthy control volunteers and 70 CUD patients by applying a reinforcement learning model within a hierarchical Bayesian framework. We used a regression model to determine the influence of learning parameters and variations in brain structure on subsequent habit formation. Results: Poor instrumental learning performance in CUD patients was largely determined by difficulties with learning from feedback, as reflected by a significantly reduced learning rate. Subsequent formation of habitual response patterns was partly explained by group status and individual variation in reinforcement sensitivity. White matter integrity within goal-directed networks was only associated with performance parameters in controls but not in CUD patients. Conclusions: Our data indicate that impairments in reinforcement learning are insufficient to account for enhanced habitual responding in CUD

Dopaminergic drug treatment remediates exaggerated cingulate prediction error responses in obsessive-compulsive disorder

Abstract: Rationale: Patients with obsessive-compulsive disorder (OCD) have been found to show exaggerated error responses and prediction error learning signals in a variety of EEG and fMRI tasks, with data converging on the anterior cingulate cortex as a key locus of dysfunction. Considerable evidence has linked prediction error processing to dopaminergic function. Objective: In this study, we investigate potential dopaminergic dysfunction during reward processing in the context of OCD. Methods: We studied OCD patients (n = 18) and controls (n = 18) whilst they learned probabilistic associations between abstract stimuli and monetary rewards in the fMRI scanner involving administration (on separate visits) of a dopamine receptor agonist, pramipexole 0.5 mg; a dopamine receptor antagonist, amisulpride 400 mg; and placebo. We fitted a Q-learning computational model to fMRI prediction error responses; group differences were examined in anterior cingulate and nucleus accumbens regions of interest. Results: There were no significant group, drug, or interaction effects in the number of correct choices; computational modeling suggested a marginally significant difference in learning rates between groups (p = 0.089, partial ƞ2 = 0.1). In the imaging results, there was a significant interaction of group by drug (p = 0.013, partial ƞ2 = 0.13). OCD patients showed abnormally strong cingulate signaling of prediction errors during omission of an expected reward, with unexpected reduction by both pramipexole and amisulpride (p = 0.014, partial ƞ2 = 0.26, 1-β error probability = 0.94). Exaggerated cingulate prediction error signaling to omitted reward in placebo was related to trait subjective difficulty in self-regulating behavior in OCD. Conclusions: Our data support cingulate dysfunction during reward processing in OCD, and bidirectional remediation by dopaminergic modulation, suggesting that exaggerated cingulate error signals in OCD may be of dopaminergic origin. The results help to illuminate the mechanisms through which dopamine receptor antagonists achieve therapeutic benefit in OCD. Further research is needed to disentangle the different functions of dopamine receptor agonists and antagonists during bidirectional modulation of cingulate activation

Increased ventral striatal volume in college-aged binge drinkers

BACKGROUND Binge drinking is a serious public health issue associated with cognitive, physiological, and anatomical differences from healthy individuals. No studies, however, have reported subcortical grey matter differences in this population. To address this, we compared the grey matter volumes of college-age binge drinkers and healthy controls, focusing on the ventral striatum, hippocampus and amygdala. METHOD T1-weighted images of 19 binge drinkers and 19 healthy volunteers were analyzed using voxel-based morphometry. Structural data were also covaried with Alcohol Use Disorders Identification Test (AUDIT) scores. Cluster-extent threshold and small volume corrections were both used to analyze imaging data. RESULTS Binge drinkers had significantly larger ventral striatal grey matter volumes compared to controls. There were no between group differences in hippocampal or amygdalar volume. Ventral striatal, amygdalar, and hippocampal volumes were also negatively related to AUDIT scores across groups. CONCLUSIONS Our findings stand in contrast to the lower ventral striatal volume previously observed in more severe forms of alcohol use disorders, suggesting that college-age binge drinkers may represent a distinct population from those groups. These findings may instead represent early sequelae, compensatory effects of repeated binge and withdrawal, or an endophenotypic risk factor

Adiposity is Associated with Regional Cortical Thinning

BACKGROUND: Although obesity is associated with structural changes in brain grey matter, findings have been inconsistent and the precise nature of these changes is unclear. Inconsistencies may partly be due to the use of different volumetric morphometry methods, and the inclusion of participants with comorbidities that exert independent effects on brain structure. The latter concern is particularly critical when sample sizes are modest. The purpose of the current study was to examine the relationship between cortical grey matter and body mass index (BMI), in healthy participants, excluding confounding comorbidities and using a large sample size. SUBJECTS: A total of 202 self-reported healthy volunteers were studied using surface-based morphometry, which permits the measurement of cortical thickness, surface area and cortical folding, independent of each other. RESULTS: Although increasing BMI was not associated with global cortical changes, a more precise, region-based analysis revealed significant thinning of the cortex in two areas: left lateral occipital cortex (LOC) and right ventromedial prefrontal cortex (vmPFC). An analogous region-based analysis failed to find an association between BMI and regional surface area or folding. Participants' age was also found to be negatively associated with cortical thickness of several brain regions; however, there was no overlap between the age- and BMI-related effects on cortical thinning. CONCLUSIONS: Our data suggest that the key effect of increasing BMI on cortical grey matter is a focal thinning in the left LOC and right vmPFC. Consistent implications of the latter region in reward valuation, and goal control of decision and action suggest a possible shift in these processes with increasing BMI.We thank all the participants and the staff of the Wolfson Brain Imaging Centre. This work was supported by the Bernard Wolfe Health Neuroscience Fund (NM, HZ, ISF, PCF), the Wellcome Trust (RGAG/144 to N.M, RGAG/188 to ISF, RNAG/259 to PCF) and the Medical Research Council (G0701497 to KDE).This is the final version of the article. It first appeared from Nature Publishing Group via http://dx.doi.org/10.1038/ijo.2016.42

Unidirectional relationship between heroin self-administration and impulsive decision-making in rats

Rationale: There is growing clinical evidence for a strong relationship between drug addiction and impulsivity. However, it is not fully clear whether impulsivity is a pre-existing trait or a consequence of drug abuse. Recent observations in the animal models show that pre-existing levels of impulsivity predict cocaine and nicotine seeking. Whether such relationships also exist with respect to non-stimulant drugs is largely unknown. Objective: We studied the relationship between impulsive choice and vulnerability to heroin taking and seeking. Materials and methods: Rats were selected in the delayed reward task based on individual differences in impulsive choice. Subsequently, heroin intravenous self-administration behaviour was analysed, including acquisition of heroin intake, motivation, extinction and drug- and cue-induced reinstatement. Throughout the entire experiment, changes in impulsive choice were monitored weekly. Results and discussion: High impulsivity did not predict measures of heroin taking. Moreover, high impulsive rats did not differ from low impulsive rats in extinction rates or heroin- and cue-induced reinstatement. However, both groups became more impulsive as heroin self-administration continued. During abstinence, impulsivity levels returned towards baseline (pre-heroin) levels. Our results indicate that, in contrast to psychostimulants, impulsive choice does not predict vulnerability to heroin seeking and taking. Conclusion: These data implicate that different neural mechanisms may underlie the vulnerability to opiate and psychostimulant dependence. Moreover, our data suggest that elevated impulsivity levels as observed in heroin-dependent subjects are a consequence of heroin intake rather than a pre-existing vulnerability trait. © 2011 The Author(s)

Altered orbitofrontal sulcogyral patterns in gambling disorder: a multicenter study

Gambling disorder is a serious psychiatric condition characterized by decision-making and reward processing impairments that are associated with dysfunctional brain activity in the orbitofrontal cortex (OFC). However, it remains unclear whether OFC functional abnormalities in gambling disorder are accompanied by structural abnormalities. We addressed this question by examining the organization of sulci and gyri in the OFC. This organization is in place very early and stable across life, such that OFC sulcogyral patterns (classified into Types I, II, and III) can be regarded as potential pre-morbid markers of pathological conditions. We gathered structural brain data from nine existing studies, reaching a total of 165 individuals with gambling disorder and 159 healthy controls. Our results, supported by both frequentist and Bayesian statistics, show that the distribution of OFC sulcogyral patterns is skewed in individuals with gambling disorder, with an increased prevalence of Type II pattern compared with healthy controls. Examination of gambling severity did not reveal any significant relationship between OFC sulcogyral patterns and disease severity. Altogether, our results provide evidence for a skewed distribution of OFC sulcogyral patterns in gambling disorder and suggest that pattern Type II might represent a pre-morbid structural brain marker of the disease. It will be important to investigate more closely the functional implications of these structural abnormalities in future work.Y.L. was supported by the National Natural Science Foundation of China (Grant No. 31600929) and the Fundamental Research Funds for the Central Universities (010914380002). G.S. was supported by a Veni grant from the Netherlands Organization for Scientific Research (Grant No. 016.155.218). J.J. was supported by the Academy of Finland (Grant No. 295580), the Finnish Medical Foundation, and the Finnish Foundation for Alcohol Studies. V.K. was supported by the Academy of Finland (Grant No. 256836) and the Finnish Foundation for Alcohol Studies. S.G. and H.R.S. were supported by the Danish Council for Independent Research in Social Sciences through a grant to Thomas Ramsøy (“Decision Neuroscience Project”; Grant No. 0601-01361B) and by the Lundbeck Foundation through a Grant of Excellence (“ContAct”; Grant No. R59 A5399). A.G. was supported by Deutsche Forschungsgemeinschaft (DFG) HE2597/15–1, HE2597/15–2, and DFG Graduiertenkolleg 1589/2 “Sensory Computation in Neural Systems”. N.R.-S. was supported by a research grant by the Senatsverwaltung für Gesundheit und Soziales, Berlin, Germany (Grant No. 002–2008/I B 35). C.M.R.d.L. and J.C.P. were supported by a grant from the Spanish Government (Ministerio de Economía y Competitividad, Secretaría de Estado de Investigación, Desarrollo e Innovación; Convocatoria 2017 de Proyectos I+D de Excelencia, Spain; co-funded by the Fondo Europeo de Desarrollo Regional, FEDER, European Union; Grant No. PSI2017–85488-P). J.-C. D. was supported by “LABEX ANR-11-LABEX-0042” of Université de Lyon within the program Investissements d’Avenir (ANR-11-IDEX-007) operated by the French National Research Agency and by a grant from the Fondation pour la Recherche Médicale (Grant No. DPA20140629796)

Methamphetamine withdrawal induces activation of CRF neurons in the brain stress system in parallel with an increased activity of cardiac sympathetic pathways.

Methamphetamine (METH) addiction is a major public health problem in some countries. There is evidence to suggest that METH use is associated with increased risk of developing cardiovascular problems. Here, we investigated the effects of chronic METH administration and withdrawal on the activation of the brain stress system and cardiac sympathetic pathways. Mice were treated with METH (2 mg/kg, i.p.) for 10 days and left to spontaneous withdraw for 7 days. The number of corticotrophin-releasing factor (CRF), c-Fos, and CRF/c-Fos neurons was measured by immunohistochemistry in the paraventricular nucleus of the hypothalamus (PVN) and the oval region of the bed nucleus of stria terminalis (ovBNST), two regions associated with cardiac sympathetic control. In parallel, levels of catechol-o-methyl-transferase (COMT), tyrosine hydroxylase (TH), and heat shock protein 27 (Hsp27) were measured in the heart. In the brain, chronic-METH treatment enhanced the number of c-Fos neurons and the CRF neurons with c-Fos signal (CRF+/c-Fos+) in PVN and ovBNST. METH withdrawal increased the number of CRF+neurons. In the heart, METH administration induced an increase in soluble (S)-COMT and membrane-bound (MB)-COMT without changes in phospho (p)-TH, Hsp27, or pHsp27. Similarly, METH withdrawal increased the expression of S- and MB-COMT. In contrast to chronic treatment, METH withdrawal enhanced levels of (p)TH and (p)Hsp27 in the heart. Overall, our results demonstrate that chronic METH administration and withdrawal activate the brain CRF systems associated with the heart sympathetic control and point towards a METH withdrawal induced activation of sympathetic pathways in the heart. Our findings provide further insight in the mechanism underlining the cardiovascular risk associated with METH use and proposes targets for its treatment

Markers of serotonergic function in the orbitofrontal cortex and dorsal raphé nucleus predict individual variation in spatial-discrimination serial reversal learning.

Dysfunction of the orbitofrontal cortex (OFC) impairs the ability of individuals to flexibly adapt behavior to changing stimulus-reward (S-R) contingencies. Impaired flexibility also results from interventions that alter serotonin (5-HT) and dopamine (DA) transmission in the OFC and dorsomedial striatum (DMS). However, it is unclear whether similar mechanisms underpin naturally occurring variations in behavioral flexibility. In the present study, we used a spatial-discrimination serial reversal procedure to investigate interindividual variability in behavioral flexibility in rats. We show that flexibility on this task is improved following systemic administration of the 5-HT reuptake inhibitor citalopram and by low doses of the DA reuptake inhibitor GBR12909. Rats in the upper quintile of the distribution of perseverative responses during repeated S-R reversals showed significantly reduced levels of the 5-HT metabolite, 5-hydroxy-indoleacetic acid, in the OFC. Additionally, 5-HT2A receptor binding in the OFC of mid- and high-quintile rats was significantly reduced compared with rats in the low-quintile group. These perturbations were accompanied by an increase in the expression of monoamine oxidase-A (MAO-A) and MAO-B in the lateral OFC and by a decrease in the expression of MAO-A, MAO-B, and tryptophan hydroxylase in the dorsal raphé nucleus of highly perseverative rats. We found no evidence of significant differences in markers of DA and 5-HT function in the DMS or MAO expression in the ventral tegmental area of low- vs high-perseverative rats. These findings indicate that diminished serotonergic tone in the OFC may be an endophenotype that predisposes to behavioral inflexibility and other forms of compulsive behavior.This work was supported by Medical Research Council Grants (G0701500; G0802729), a 503 Wellcome Trust Programme Grant (grant number 089589/Z/09/Z), and by a Core Award 504 from the Medical Research Council and the Wellcome Trust to the Behavioural and Clinical 505 21 Neuroscience Institute (MRC Ref G1000183; WT Ref 093875/Z/10/Z). RLB was supported 506 by a studentship from the Medical Research Council. JA was supported by a Fellowship from 507 the Swedish Research Council (350-2012-230). BJ was supported by Fellowships from the 508 AXA Research Fund and the National Health and Medical Research Council of Australia. 509 Financial support from the Fredrik and Ingrid Thuring Foundation is also acknowledged.This is the accepted manuscript. The final version is available from Nature Publishing at http://www.nature.com/npp/journal/vaop/ncurrent/full/npp2014335a.html

Naltrexone ameliorates functional network abnormalities in alcohol-dependent individuals

Naltrexone, an opioid receptor antagonist, is commonly used as a relapse prevention medication in alcohol and opiate addiction, but its efficacy and the mechanisms underpinning its clinical usefulness are not well characterized. In the current study, we examined the effects of 50-mg naltrexone compared with placebo on neural network changes associated with substance dependence in 21 alcohol and 36 poly-drug-dependent individuals compared with 36 healthy volunteers. Graph theoretic and network-based statistical analysis of resting-state functional magnetic resonance imaging (MRI) data revealed that alcohol-dependent subjects had reduced functional connectivity of a dispersed network compared with both poly-drug-dependent and healthy subjects. Higher local efficiency was observed in both patient groups, indicating clustered and segregated network topology and information processing. Naltrexone normalized heightened local efficiency of the neural network in alcohol-dependent individuals, to the same levels as healthy volunteers. Naltrexone failed to have an effect on the local efficiency in abstinent poly-substance-dependent individuals. Across groups, local efficiency was associated with substance, but no alcohol exposure implicating local efficiency as a potential premorbid risk factor in alcohol use disorders that can be ameliorated by naltrexone. These findings suggest one possible mechanism for the clinical effects of naltrexone, namely, the amelioration of disrupted network topology.The research was supported by the NIHR CRF at Imperial College Healthcare NHS Trust, the NIHR/Wellcome Trust Cambridge Research Facility and Clinical Trials Unit at Salford Royal NHS Foundation Trust. The study is supported by the North West London, Eastern and Greater Manchester NIHR Clinical Research Networks ... The following financial support was received for the research, authorship and/or publication of this article: independent research funded by the MRC as part of the addiction initiative (grant number G1000018); GSK funded the functional and structural MRI scans at Imperial College