7 research outputs found

    Scaling prediction errors to reward variability benefits error-driven learning in humans.

    Get PDF
    Effective error-driven learning requires individuals to adapt learning to environmental reward variability. The adaptive mechanism may involve decays in learning rate across subsequent trials, as shown previously, and rescaling of reward prediction errors. The present study investigated the influence of prediction error scaling and, in particular, the consequences for learning performance. Participants explicitly predicted reward magnitudes that were drawn from different probability distributions with specific standard deviations. By fitting the data with reinforcement learning models, we found scaling of prediction errors, in addition to the learning rate decay shown previously. Importantly, the prediction error scaling was closely related to learning performance, defined as accuracy in predicting the mean of reward distributions, across individual participants. In addition, participants who scaled prediction errors relative to standard deviation also presented with more similar performance for different standard deviations, indicating that increases in standard deviation did not substantially decrease "adapters'" accuracy in predicting the means of reward distributions. However, exaggerated scaling beyond the standard deviation resulted in impaired performance. Thus efficient adaptation makes learning more robust to changing variability.This work was supported by the Wellcome Trust and the Niels Stensen Foundation.This is the final version of the article. It first appeared from the American Physiological Society via http://dx.doi.org/10.1152/jn.00483.201

    Adaptive Prediction Error Coding in the Human Midbrain and Striatum Facilitates Behavioral Adaptation and Learning Efficiency.

    Get PDF
    Effective error-driven learning benefits from scaling of prediction errors to reward variability. Such behavioral adaptation may be facilitated by neurons coding prediction errors relative to the standard deviation (SD) of reward distributions. To investigate this hypothesis, we required participants to predict the magnitude of upcoming reward drawn from distributions with different SDs. After each prediction, participants received a reward, yielding trial-by-trial prediction errors. In line with the notion of adaptive coding, BOLD response slopes in the Substantia Nigra/Ventral Tegmental Area (SN/VTA) and ventral striatum were steeper for prediction errors occurring in distributions with smaller SDs. SN/VTA adaptation was not instantaneous but developed across trials. Adaptive prediction error coding was paralleled by behavioral adaptation, as reflected by SD-dependent changes in learning rate. Crucially, increased SN/VTA and ventral striatal adaptation was related to improved task performance. These results suggest that adaptive coding facilitates behavioral adaptation and supports efficient learning.This study was supported by the Wellcome Trust (W.S., P.C.F.), Bernard Wolfe Health Neuroscience Fund (P.C.F.) and the Niels Stensen Foundation (K.M.J.D.). We thank William Stauffer, Armin Lak and Joost Haarsma for useful discussions.This is the final version of the article. It first appeared from Cell Press via http://dx.doi.org/10.1016/j.neuron.2016.04.01

    Characterizing cerebral metabolite profiles in anorexia and bulimia nervosa and their associations with habitual behavior

    Get PDF
    Funder: Cambridge Overseas Trust; doi: https://doi.org/10.13039/501100003341Funder: NIH Oxford Cambridge Scholars ProgramFunder: Holt FellowshipFunder: Bernard Wolfe Health Neuroscience FundAbstractAnorexia nervosa (AN) and bulimia nervosa (BN) are associated with altered brain structure and function, as well as increased habitual behavior. This neurobehavioral profile may implicate neurochemical changes in the pathogenesis of these illnesses. Altered glutamate, myo-inositol and N-acetyl aspartate (NAA) concentrations are reported in restrictive AN, yet whether these extend to binge-eating disorders, or relate to habitual traits in affected individuals, remains unknown. We therefore used single-voxel proton magnetic resonance spectroscopy to measure glutamate, myo-inositol, and NAA in the right inferior lateral prefrontal cortex and the right occipital cortex of 85 women [n = 22 AN (binge-eating/purging subtype; AN-BP), n = 33 BN, n = 30 controls]. To index habitual behavior, participants performed an instrumental learning task and completed the Creature of Habit Scale. Women with AN-BP, but not BN, had reduced myo-inositol and NAA concentrations relative to controls in both regions. Although patient groups had intact instrumental learning task performance, both groups reported increased routine behaviors compared to controls, and automaticity was related to reduced prefrontal glutamate and NAA participants with AN-BP. Our findings extend previous reports of reduced myo-inositol and NAA levels in restrictive AN to AN-BP, which may reflect disrupted axonal-glial signaling. Although we found inconsistent support for increased habitual behavior in AN-BP and BN, we identified preliminary associations between prefrontal metabolites and automaticity in AN-BP. These results provide further evidence of unique neurobiological profiles across binge-eating disorders.</jats:p

    Human bartonellosis: seroepidemiological and clinical features with an emphasis on data from Brazil - A review

    No full text
    Bartonellae are fastidious Gram-negative bacteria that are widespread in nature with several animal reservoirs (mainly cats, dogs, and rodents) and insect vectors (mainly fleas, sandflies, and human lice). Thirteen species or subspecies of Bartonella have been recognized as agents causing human disease, including B. bacilliformis, B. quintana, B. vinsonii berkhoffii, B. henselae, B. elizabethae, B. grahamii, B. washoensis, B. koehlerae, B. rocha-limaea, and B. tamiae. The clinical spectrum of infection includes lymphadenopathy, fever of unknown origin, endocarditis, neurological and ophthalmological syndromes, Carrion's disease, and others. This review provides updated information on clinical manifestations and seroepidemiological studies with an emphasis on data available from Brazil
    corecore