Impairments in reinforcement learning do not explain enhanced habit formation in cocaine use disorder

Abstract: Rationale: Drug addiction has been suggested to develop through drug-induced changes in learning and memory processes. Whilst the initiation of drug use is typically goal-directed and hedonically motivated, over time, drug-taking may develop into a stimulus-driven habit, characterised by persistent use of the drug irrespective of the consequences. Converging lines of evidence suggest that stimulant drugs facilitate the transition of goal-directed into habitual drug-taking, but their contribution to goal-directed learning is less clear. Computational modelling may provide an elegant means for elucidating changes during instrumental learning that may explain enhanced habit formation. Objectives: We used formal reinforcement learning algorithms to deconstruct the process of appetitive instrumental learning and to explore potential associations between goal-directed and habitual actions in patients with cocaine use disorder (CUD). Methods: We re-analysed appetitive instrumental learning data in 55 healthy control volunteers and 70 CUD patients by applying a reinforcement learning model within a hierarchical Bayesian framework. We used a regression model to determine the influence of learning parameters and variations in brain structure on subsequent habit formation. Results: Poor instrumental learning performance in CUD patients was largely determined by difficulties with learning from feedback, as reflected by a significantly reduced learning rate. Subsequent formation of habitual response patterns was partly explained by group status and individual variation in reinforcement sensitivity. White matter integrity within goal-directed networks was only associated with performance parameters in controls but not in CUD patients. Conclusions: Our data indicate that impairments in reinforcement learning are insufficient to account for enhanced habitual responding in CUD

Increased ventral striatal volume in college-aged binge drinkers

BACKGROUND Binge drinking is a serious public health issue associated with cognitive, physiological, and anatomical differences from healthy individuals. No studies, however, have reported subcortical grey matter differences in this population. To address this, we compared the grey matter volumes of college-age binge drinkers and healthy controls, focusing on the ventral striatum, hippocampus and amygdala. METHOD T1-weighted images of 19 binge drinkers and 19 healthy volunteers were analyzed using voxel-based morphometry. Structural data were also covaried with Alcohol Use Disorders Identification Test (AUDIT) scores. Cluster-extent threshold and small volume corrections were both used to analyze imaging data. RESULTS Binge drinkers had significantly larger ventral striatal grey matter volumes compared to controls. There were no between group differences in hippocampal or amygdalar volume. Ventral striatal, amygdalar, and hippocampal volumes were also negatively related to AUDIT scores across groups. CONCLUSIONS Our findings stand in contrast to the lower ventral striatal volume previously observed in more severe forms of alcohol use disorders, suggesting that college-age binge drinkers may represent a distinct population from those groups. These findings may instead represent early sequelae, compensatory effects of repeated binge and withdrawal, or an endophenotypic risk factor

Dopaminergic drug treatment remediates exaggerated cingulate prediction error responses in obsessive-compulsive disorder

Abstract: Rationale: Patients with obsessive-compulsive disorder (OCD) have been found to show exaggerated error responses and prediction error learning signals in a variety of EEG and fMRI tasks, with data converging on the anterior cingulate cortex as a key locus of dysfunction. Considerable evidence has linked prediction error processing to dopaminergic function. Objective: In this study, we investigate potential dopaminergic dysfunction during reward processing in the context of OCD. Methods: We studied OCD patients (n = 18) and controls (n = 18) whilst they learned probabilistic associations between abstract stimuli and monetary rewards in the fMRI scanner involving administration (on separate visits) of a dopamine receptor agonist, pramipexole 0.5 mg; a dopamine receptor antagonist, amisulpride 400 mg; and placebo. We fitted a Q-learning computational model to fMRI prediction error responses; group differences were examined in anterior cingulate and nucleus accumbens regions of interest. Results: There were no significant group, drug, or interaction effects in the number of correct choices; computational modeling suggested a marginally significant difference in learning rates between groups (p = 0.089, partial ƞ2 = 0.1). In the imaging results, there was a significant interaction of group by drug (p = 0.013, partial ƞ2 = 0.13). OCD patients showed abnormally strong cingulate signaling of prediction errors during omission of an expected reward, with unexpected reduction by both pramipexole and amisulpride (p = 0.014, partial ƞ2 = 0.26, 1-β error probability = 0.94). Exaggerated cingulate prediction error signaling to omitted reward in placebo was related to trait subjective difficulty in self-regulating behavior in OCD. Conclusions: Our data support cingulate dysfunction during reward processing in OCD, and bidirectional remediation by dopaminergic modulation, suggesting that exaggerated cingulate error signals in OCD may be of dopaminergic origin. The results help to illuminate the mechanisms through which dopamine receptor antagonists achieve therapeutic benefit in OCD. Further research is needed to disentangle the different functions of dopamine receptor agonists and antagonists during bidirectional modulation of cingulate activation

Neurobehavioral consequences of chronic intrauterine opioid exposure in infants and preschool children: a systematic review and meta-analysis

<b>Background</b><p></p> It is assumed within the accumulated literature that children born of pregnant opioid dependent mothers have impaired neurobehavioral function as a consequence of chronic intrauterine opioid use.<p></p> <b>Methods</b><p></p> Quantitative and systematic review of the literature on the consequences of chronic maternal opioid use during pregnancy on neurobehavioral function of children was conducted using the Meta-analysis of Observational Studies in Epidemiology (MOOSE) and the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines. We searched Cinahl, EMBASE, PsychINFO and MEDLINE between the periods of January 1995 to January 2012.<p></p> <b>Results</b><p></p> There were only 5 studies out of the 200 identified that quantitatively reported on neurobehavioral function of children after maternal opioid use during pregnancy. All 5 were case control studies with the number of exposed subjects within the studies ranging from 33–143 and 45–85 for the controls. This meta-analysis showed no significant impairments, at a non-conservative significance level of p < 0.05, for cognitive, psychomotor or observed behavioural outcomes for chronic intra-uterine exposed infants and pre-school children compared to non-exposed infants and children. However, all domains suggested a trend to poor outcomes in infants/children of opioid using mothers. The magnitude of all possible effects was small according to Cohen’s benchmark criteria.<p></p> <b>Conclusions</b><p></p> Chronic intra-uterine opioid exposed infants and pre-school children experienced no significant impairment in neurobehavioral outcomes when compared to non-exposed peers, although in all domains there was a trend to poorer outcomes. The findings of this review are limited by the small number of studies analysed, the heterogenous populations and small numbers within the individual studies. Longitudinal studies are needed to determine if any neuropsychological impairments appear after the age of 5 years and to help investigate further the role of environmental risk factors on the effect of ‘core’ phenotypes

Unidirectional relationship between heroin self-administration and impulsive decision-making in rats

Rationale: There is growing clinical evidence for a strong relationship between drug addiction and impulsivity. However, it is not fully clear whether impulsivity is a pre-existing trait or a consequence of drug abuse. Recent observations in the animal models show that pre-existing levels of impulsivity predict cocaine and nicotine seeking. Whether such relationships also exist with respect to non-stimulant drugs is largely unknown. Objective: We studied the relationship between impulsive choice and vulnerability to heroin taking and seeking. Materials and methods: Rats were selected in the delayed reward task based on individual differences in impulsive choice. Subsequently, heroin intravenous self-administration behaviour was analysed, including acquisition of heroin intake, motivation, extinction and drug- and cue-induced reinstatement. Throughout the entire experiment, changes in impulsive choice were monitored weekly. Results and discussion: High impulsivity did not predict measures of heroin taking. Moreover, high impulsive rats did not differ from low impulsive rats in extinction rates or heroin- and cue-induced reinstatement. However, both groups became more impulsive as heroin self-administration continued. During abstinence, impulsivity levels returned towards baseline (pre-heroin) levels. Our results indicate that, in contrast to psychostimulants, impulsive choice does not predict vulnerability to heroin seeking and taking. Conclusion: These data implicate that different neural mechanisms may underlie the vulnerability to opiate and psychostimulant dependence. Moreover, our data suggest that elevated impulsivity levels as observed in heroin-dependent subjects are a consequence of heroin intake rather than a pre-existing vulnerability trait. © 2011 The Author(s)

Adiposity is Associated with Regional Cortical Thinning

BACKGROUND: Although obesity is associated with structural changes in brain grey matter, findings have been inconsistent and the precise nature of these changes is unclear. Inconsistencies may partly be due to the use of different volumetric morphometry methods, and the inclusion of participants with comorbidities that exert independent effects on brain structure. The latter concern is particularly critical when sample sizes are modest. The purpose of the current study was to examine the relationship between cortical grey matter and body mass index (BMI), in healthy participants, excluding confounding comorbidities and using a large sample size. SUBJECTS: A total of 202 self-reported healthy volunteers were studied using surface-based morphometry, which permits the measurement of cortical thickness, surface area and cortical folding, independent of each other. RESULTS: Although increasing BMI was not associated with global cortical changes, a more precise, region-based analysis revealed significant thinning of the cortex in two areas: left lateral occipital cortex (LOC) and right ventromedial prefrontal cortex (vmPFC). An analogous region-based analysis failed to find an association between BMI and regional surface area or folding. Participants' age was also found to be negatively associated with cortical thickness of several brain regions; however, there was no overlap between the age- and BMI-related effects on cortical thinning. CONCLUSIONS: Our data suggest that the key effect of increasing BMI on cortical grey matter is a focal thinning in the left LOC and right vmPFC. Consistent implications of the latter region in reward valuation, and goal control of decision and action suggest a possible shift in these processes with increasing BMI.We thank all the participants and the staff of the Wolfson Brain Imaging Centre. This work was supported by the Bernard Wolfe Health Neuroscience Fund (NM, HZ, ISF, PCF), the Wellcome Trust (RGAG/144 to N.M, RGAG/188 to ISF, RNAG/259 to PCF) and the Medical Research Council (G0701497 to KDE).This is the final version of the article. It first appeared from Nature Publishing Group via http://dx.doi.org/10.1038/ijo.2016.42

Altered orbitofrontal sulcogyral patterns in gambling disorder: a multicenter study

Gambling disorder is a serious psychiatric condition characterized by decision-making and reward processing impairments that are associated with dysfunctional brain activity in the orbitofrontal cortex (OFC). However, it remains unclear whether OFC functional abnormalities in gambling disorder are accompanied by structural abnormalities. We addressed this question by examining the organization of sulci and gyri in the OFC. This organization is in place very early and stable across life, such that OFC sulcogyral patterns (classified into Types I, II, and III) can be regarded as potential pre-morbid markers of pathological conditions. We gathered structural brain data from nine existing studies, reaching a total of 165 individuals with gambling disorder and 159 healthy controls. Our results, supported by both frequentist and Bayesian statistics, show that the distribution of OFC sulcogyral patterns is skewed in individuals with gambling disorder, with an increased prevalence of Type II pattern compared with healthy controls. Examination of gambling severity did not reveal any significant relationship between OFC sulcogyral patterns and disease severity. Altogether, our results provide evidence for a skewed distribution of OFC sulcogyral patterns in gambling disorder and suggest that pattern Type II might represent a pre-morbid structural brain marker of the disease. It will be important to investigate more closely the functional implications of these structural abnormalities in future work.Y.L. was supported by the National Natural Science Foundation of China (Grant No. 31600929) and the Fundamental Research Funds for the Central Universities (010914380002). G.S. was supported by a Veni grant from the Netherlands Organization for Scientific Research (Grant No. 016.155.218). J.J. was supported by the Academy of Finland (Grant No. 295580), the Finnish Medical Foundation, and the Finnish Foundation for Alcohol Studies. V.K. was supported by the Academy of Finland (Grant No. 256836) and the Finnish Foundation for Alcohol Studies. S.G. and H.R.S. were supported by the Danish Council for Independent Research in Social Sciences through a grant to Thomas Ramsøy (“Decision Neuroscience Project”; Grant No. 0601-01361B) and by the Lundbeck Foundation through a Grant of Excellence (“ContAct”; Grant No. R59 A5399). A.G. was supported by Deutsche Forschungsgemeinschaft (DFG) HE2597/15–1, HE2597/15–2, and DFG Graduiertenkolleg 1589/2 “Sensory Computation in Neural Systems”. N.R.-S. was supported by a research grant by the Senatsverwaltung für Gesundheit und Soziales, Berlin, Germany (Grant No. 002–2008/I B 35). C.M.R.d.L. and J.C.P. were supported by a grant from the Spanish Government (Ministerio de Economía y Competitividad, Secretaría de Estado de Investigación, Desarrollo e Innovación; Convocatoria 2017 de Proyectos I+D de Excelencia, Spain; co-funded by the Fondo Europeo de Desarrollo Regional, FEDER, European Union; Grant No. PSI2017–85488-P). J.-C. D. was supported by “LABEX ANR-11-LABEX-0042” of Université de Lyon within the program Investissements d’Avenir (ANR-11-IDEX-007) operated by the French National Research Agency and by a grant from the Fondation pour la Recherche Médicale (Grant No. DPA20140629796)

Methamphetamine withdrawal induces activation of CRF neurons in the brain stress system in parallel with an increased activity of cardiac sympathetic pathways.

Methamphetamine (METH) addiction is a major public health problem in some countries. There is evidence to suggest that METH use is associated with increased risk of developing cardiovascular problems. Here, we investigated the effects of chronic METH administration and withdrawal on the activation of the brain stress system and cardiac sympathetic pathways. Mice were treated with METH (2 mg/kg, i.p.) for 10 days and left to spontaneous withdraw for 7 days. The number of corticotrophin-releasing factor (CRF), c-Fos, and CRF/c-Fos neurons was measured by immunohistochemistry in the paraventricular nucleus of the hypothalamus (PVN) and the oval region of the bed nucleus of stria terminalis (ovBNST), two regions associated with cardiac sympathetic control. In parallel, levels of catechol-o-methyl-transferase (COMT), tyrosine hydroxylase (TH), and heat shock protein 27 (Hsp27) were measured in the heart. In the brain, chronic-METH treatment enhanced the number of c-Fos neurons and the CRF neurons with c-Fos signal (CRF+/c-Fos+) in PVN and ovBNST. METH withdrawal increased the number of CRF+neurons. In the heart, METH administration induced an increase in soluble (S)-COMT and membrane-bound (MB)-COMT without changes in phospho (p)-TH, Hsp27, or pHsp27. Similarly, METH withdrawal increased the expression of S- and MB-COMT. In contrast to chronic treatment, METH withdrawal enhanced levels of (p)TH and (p)Hsp27 in the heart. Overall, our results demonstrate that chronic METH administration and withdrawal activate the brain CRF systems associated with the heart sympathetic control and point towards a METH withdrawal induced activation of sympathetic pathways in the heart. Our findings provide further insight in the mechanism underlining the cardiovascular risk associated with METH use and proposes targets for its treatment

Markers of serotonergic function in the orbitofrontal cortex and dorsal raphé nucleus predict individual variation in spatial-discrimination serial reversal learning.

Dysfunction of the orbitofrontal cortex (OFC) impairs the ability of individuals to flexibly adapt behavior to changing stimulus-reward (S-R) contingencies. Impaired flexibility also results from interventions that alter serotonin (5-HT) and dopamine (DA) transmission in the OFC and dorsomedial striatum (DMS). However, it is unclear whether similar mechanisms underpin naturally occurring variations in behavioral flexibility. In the present study, we used a spatial-discrimination serial reversal procedure to investigate interindividual variability in behavioral flexibility in rats. We show that flexibility on this task is improved following systemic administration of the 5-HT reuptake inhibitor citalopram and by low doses of the DA reuptake inhibitor GBR12909. Rats in the upper quintile of the distribution of perseverative responses during repeated S-R reversals showed significantly reduced levels of the 5-HT metabolite, 5-hydroxy-indoleacetic acid, in the OFC. Additionally, 5-HT2A receptor binding in the OFC of mid- and high-quintile rats was significantly reduced compared with rats in the low-quintile group. These perturbations were accompanied by an increase in the expression of monoamine oxidase-A (MAO-A) and MAO-B in the lateral OFC and by a decrease in the expression of MAO-A, MAO-B, and tryptophan hydroxylase in the dorsal raphé nucleus of highly perseverative rats. We found no evidence of significant differences in markers of DA and 5-HT function in the DMS or MAO expression in the ventral tegmental area of low- vs high-perseverative rats. These findings indicate that diminished serotonergic tone in the OFC may be an endophenotype that predisposes to behavioral inflexibility and other forms of compulsive behavior.This work was supported by Medical Research Council Grants (G0701500; G0802729), a 503 Wellcome Trust Programme Grant (grant number 089589/Z/09/Z), and by a Core Award 504 from the Medical Research Council and the Wellcome Trust to the Behavioural and Clinical 505 21 Neuroscience Institute (MRC Ref G1000183; WT Ref 093875/Z/10/Z). RLB was supported 506 by a studentship from the Medical Research Council. JA was supported by a Fellowship from 507 the Swedish Research Council (350-2012-230). BJ was supported by Fellowships from the 508 AXA Research Fund and the National Health and Medical Research Council of Australia. 509 Financial support from the Fredrik and Ingrid Thuring Foundation is also acknowledged.This is the accepted manuscript. The final version is available from Nature Publishing at http://www.nature.com/npp/journal/vaop/ncurrent/full/npp2014335a.html