Two spatiotemporally distinct value systems shape reward-based learning in the human brain

Avoiding repeated mistakes and learning to reinforce rewarding decisions is critical for human survival and adaptive actions. Yet, the neural underpinnings of the value systems that encode different decision-outcomes remain elusive. Here coupling single-trial electroencephalography with simultaneously acquired functional magnetic resonance imaging, we uncover the spatiotemporal dynamics of two separate but interacting value systems encoding decision-outcomes. Consistent with a role in regulating alertness and switching behaviours, an early system is activated only by negative outcomes and engages arousal-related and motor-preparatory brain structures. Consistent with a role in reward-based learning, a later system differentially suppresses or activates regions of the human reward network in response to negative and positive outcomes, respectively. Following negative outcomes, the early system interacts and downregulates the late system, through a thalamic interaction with the ventral striatum. Critically, the strength of this coupling predicts participants’ switching behaviour and avoidance learning, directly implicating the thalamostriatal pathway in reward-based learning

Free Radical Exposure Creates Paler Carotenoid-Based Ornaments: A Possible Interaction in the Expression of Black and Red Traits

Oxidative stress could be a key selective force shaping the expression of colored traits produced by the primary animal pigments in integuments: carotenoids and melanins. However, the impact of oxidative stress on melanic ornaments has only recently been explored, whereas its role in the expression of carotenoid-based traits is not fully understood. An interesting study case is that of those animal species simultaneously expressing both kinds of ornaments, such as the red-legged partridge (Alectoris rufa). In this bird, individuals exposed to an exogenous source of free radicals (diquat) during their development produced larger eumelanin-based (black) plumage traits than controls. Here, we show that the same red-legged partridges exposed to diquat simultaneously developed paler carotenoid-based ornaments (red beak and eye rings), and carried lower circulating carotenoid levels as well as lower levels of some lipids involved in carotenoid transport in the bloodstream (i.e., cholesterol). Moreover, partridges treated with a hormone that stimulates eumelanin production (i.e., alpha-melanocyte-stimulating hormone) also increased blood carotenoid levels, but this effect was not mirrored in the expression of carotenoid-based traits. The redness of carotenoid-based ornaments and the size of a conspicuous eumelanic trait (the black bib) were negatively correlated in control birds, suggesting a physiological trade-off during development. These findings contradict recent studies questioning the sensitivity of carotenoids to oxidative stress. Nonetheless, the impact of free radicals on plasma carotenoids seems to be partially mediated by changes in cholesterol metabolism, and not by direct carotenoid destruction/consumption. The results highlight the capacity of oxidative stress to create multiple phenotypes during development through differential effects on carotenoids and melanins, raising questions about evolutionary constraints involved in the production of multiple ornaments by the same organism

Ecological Determinants of Highly Pathogenic Avian Influenza (H5N1) Outbreaks in Bangladesh

BACKGROUND: The agro-ecology and poultry husbandry of the south Asian and south-east Asian countries share common features, however, with noticeable differences. Hence, the ecological determinants associated with risk of highly pathogenic avian influenza (HPAI-H5N1) outbreaks are expected to differ between Bangladesh and e.g., Thailand and Vietnam. The primary aim of the current study was to establish ecological determinants associated with the risk of HPAI-H5N1 outbreaks at subdistrict level in Bangladesh. The secondary aim was to explore the performance of two different statistical modeling approaches for unmeasured spatially correlated variation. METHODOLOGY/PRINCIPAL FINDINGS: An ecological study at subdistrict level in Bangladesh was performed with 138 subdistricts with HPAI-H5N1 outbreaks during 2007-2008, and 326 subdistricts with no outbreaks. The association between ecological determinants and HPAI-H5N1 outbreaks was examined using a generalized linear mixed model. Spatial clustering of the ecological data was modeled using 1) an intrinsic conditional autoregressive (ICAR) model at subdistrict level considering their first order neighbors, and 2) a multilevel (ML) model with subdistricts nested within districts. Ecological determinants significantly associated with risk of HPAI-H5N1 outbreaks at subdistrict level were migratory birds' staging areas, river network, household density, literacy rate, poultry density, live bird markets, and highway network. Predictive risk maps were derived based on the resulting models. The resulting models indicate that the ML model absorbed some of the covariate effect of the ICAR model because of the neighbor structure implied in the two different models. CONCLUSIONS/SIGNIFICANCE: The study identified a new set of ecological determinants related to river networks, migratory birds' staging areas and literacy rate in addition to already known risk factors, and clarified that the generalized concept of free grazing duck and duck-rice cultivation interacted ecology are not significant determinants for Bangladesh. These findings will refine current understanding of the HPAI-H5N1 epidemiology in Bangladesh

The CLIMATE schools combined study: a cluster randomised controlled trial of a universal Internet-based prevention program for youth substance misuse, depression and anxiety

Background: Anxiety, depressive and substance use disorders account for three quarters of the disability attributed to mental disorders and frequently co-occur. While programs for the prevention and reduction of symptoms associated with (i) substance use and (ii) mental health disorders exist, research is yet to determine if a combined approach is more effective. This paper describes the study protocol of a cluster randomised controlled trial to evaluate the effectiveness of the CLIMATE Schools Combined intervention, a universal approach to preventing substance use and mental health problems among adolescents. Methods/design: Participants will consist of approximately 8400 students aged 13 to 14-years-old from 84 secondary schools in New South Wales, Western Australia and Queensland, Australia. The schools will be cluster randomised to one of four groups; (i) CLIMATE Schools Combined intervention; (ii) CLIMATE Schools - Substance Use; (iii) CLIMATE Schools - Mental Health, or (iv) Control (Health and Physical Education as usual). The primary outcomes of the trial will be the uptake and harmful use of alcohol and other drugs, mental health symptomatology and anxiety, depression and substance use knowledge. Secondary outcomes include substance use related harms, self-efficacy to resist peer pressure, general disability, and truancy. The link between personality and substance use will also be examined.Discussion: Compared to students who receive the universal CLIMATE Schools - Substance Use, or CLIMATE Schools - Mental Health or the Control condition (who received usual Health and Physical Education), we expect students who receive the CLIMATE Schools Combined intervention to show greater delays to the initiation of substance use, reductions in substance use and mental health symptoms, and increased substance use and mental health knowledge

A Switch in the Control of Growth of the Wing Imaginal Disks of Manduca sexta

Background: Insulin and ecdysone are the key extrinsic regulators of growth for the wing imaginal disks of insects. In vitro tissue culture studies have shown that these two growth regulators act synergistically: either factor alone stimulates only limited growth, but together they stimulate disks to grow at a rate identical to that observed in situ. It is generally thought that insulin signaling links growth to nutrition, and that starvation stops growth because it inhibits insulin secretion. At the end of larval life feeding stops but the disks continue to grow, so at that time disk growth has become uncoupled from nutrition. We sought to determine at exactly what point in development this uncoupling occurs. Methodology: Growth and cell proliferation in the wing imaginal disks and hemolymph carbohydrate concentrations were measured at various stages in the last larval instar under experimental conditions of starvation, ligation, rescue, and hormone treatment. Principal Findings: Here we show that in the last larval instar of M. sexta, the uncoupling of nutrition and growth occurs as the larva passes the critical weight. Before this time, starvation causes a decline in hemolymph glucose and trehalose and a cessation of wing imaginal disks growth, which can be rescued by injections of trehalose. After the critical weight the trehalose response to starvation disappears, and the expression of insulin becomes decoupled from nutrition. After the critical weight the wing disks loose their sensitivity to repression by juvenile hormone, and factors from the abdomen, bu

Abnormal reward prediction-error signalling in antipsychotic naive individuals with first-episode psychosis or clinical risk for psychosis.

Ongoing research suggests preliminary, though not entirely consistent, evidence of neural abnormalities in signalling prediction errors in schizophrenia. Supporting theories suggest mechanistic links between the disruption of these processes and the generation of psychotic symptoms. However, it is unknown at what stage in the pathogenesis of psychosis these impairments in prediction-error signalling develop. One major confound in prior studies is the use of medicated patients with strongly varying disease durations. Our study aims to investigate the involvement of the meso-cortico-striatal circuitry during reward prediction-error signalling in earliest stages of psychosis. We studied patients with first-episode psychosis (FEP) and help-seeking individuals at-risk for psychosis due to sub-threshold prodromal psychotic symptoms. Patients with either FEP (n = 14), or at-risk for developing psychosis (n = 30), and healthy volunteers (n = 39) performed a reinforcement learning task during fMRI scanning. ANOVA revealed significant (p < 0.05 family-wise error corrected) prediction-error signalling differences between groups in the dopaminergic midbrain and right middle frontal gyrus (dorsolateral prefrontal cortex, DLPFC). FEP patients showed disrupted reward prediction-error signalling compared to controls in both regions. At-risk patients showed intermediate activation in the midbrain that significantly differed from controls and from FEP patients, but DLPFC activation that did not differ from controls. Our study confirms that FEP patients have abnormal meso-cortical signalling of reward-prediction errors, whereas reward-prediction-error dysfunction in the at-risk patients appears to show a more nuanced pattern of activation with a degree of midbrain impairment but preserved cortical function

Neural processes mediating contextual influences on human choice behaviour

Contextual influences on choice are ubiquitous in ecological settings. Current evidence suggests that subjective values are normalized with respect to the distribution of potentially available rewards. However, how this context-sensitivity is realised in the brain remains unknown. To address this, here we examine functional magnetic resonance imaging (fMRI) data during performance of a gambling task where blocks comprise values drawn from one of two different, but partially overlapping, reward distributions or contexts. At the beginning of each block (when information about context is provided), hippocampus is activated and this response is enhanced when contextual influence on choice increases. In addition, response to value in ventral tegmental area/substantia nigra (VTA/SN) shows context-sensitivity, an effect enhanced with an increased contextual influence on choice. Finally, greater response in hippocampus at block start is associated with enhanced context sensitivity in VTA/SN. These findings suggest that context-sensitive choice is driven by a brain circuit involving hippocampus and dopaminergic midbrain

Significant loss of mitochondrial diversity within the last century due to extinction of peripheral populations in eastern gorillas

Species and populations are disappearing at an alarming rate as a direct result of human activities. Loss of genetic diversity associated with population decline directly impacts species' long-term survival. Therefore, preserving genetic diversity is of considerable conservation importance. However, to assist in conservation efforts, it is important to understand how genetic diversity is spatially distributed and how it changes due to anthropogenic pressures. In this study, we use historical museum and modern faecal samples of two critically endangered eastern gorilla taxa, Grauer's (Gorilla beringei graueri) and mountain gorillas (Gorilla beringei beringei), to directly infer temporal changes in genetic diversity within the last century. Using over 100 complete mitochondrial genomes, we observe a significant decline in haplotype and nucleotide diversity in Grauer's gorillas. By including historical samples from now extinct populations we show that this decline can be attributed to the loss of peripheral populations rather than a decrease in genetic diversity within the core range of the species. By directly quantifying genetic changes in the recent past, our study shows that human activities have severely impacted eastern gorilla genetic diversity within only four to five generations. This rapid loss calls for dedicated conservation actions, which should include preservation of the remaining peripheral populations.SCOPUS: ar.jinfo:eu-repo/semantics/publishe

Recurrent, Robust and Scalable Patterns Underlie Human Approach and Avoidance

BACKGROUND. Approach and avoidance behavior provide a means for assessing the rewarding or aversive value of stimuli, and can be quantified by a keypress procedure whereby subjects work to increase (approach), decrease (avoid), or do nothing about time of exposure to a rewarding/aversive stimulus. To investigate whether approach/avoidance behavior might be governed by quantitative principles that meet engineering criteria for lawfulness and that encode known features of reward/aversion function, we evaluated whether keypress responses toward pictures with potential motivational value produced any regular patterns, such as a trade-off between approach and avoidance, or recurrent lawful patterns as observed with prospect theory. METHODOLOGY/PRINCIPAL FINDINGS. Three sets of experiments employed this task with beautiful face images, a standardized set of affective photographs, and pictures of food during controlled states of hunger and satiety. An iterative modeling approach to data identified multiple law-like patterns, based on variables grounded in the individual. These patterns were consistent across stimulus types, robust to noise, describable by a simple power law, and scalable between individuals and groups. Patterns included: (i) a preference trade-off counterbalancing approach and avoidance, (ii) a value function linking preference intensity to uncertainty about preference, and (iii) a saturation function linking preference intensity to its standard deviation, thereby setting limits to both. CONCLUSIONS/SIGNIFICANCE. These law-like patterns were compatible with critical features of prospect theory, the matching law, and alliesthesia. Furthermore, they appeared consistent with both mean-variance and expected utility approaches to the assessment of risk. Ordering of responses across categories of stimuli demonstrated three properties thought to be relevant for preference-based choice, suggesting these patterns might be grouped together as a relative preference theory. Since variables in these patterns have been associated with reward circuitry structure and function, they may provide a method for quantitative phenotyping of normative and pathological function (e.g., psychiatric illness).National Institute on Drug Abuse (14118, 026002, 026104, DABK39-03-0098, DABK39-03-C-0098); The MGH Phenotype Genotype Project in Addiction and Mood Disorder from the Office of National Drug Control Policy - Counterdrug Technology Assessment Center; MGH Department of Radiology; the National Center for Research Resources (P41RR14075); National Institute of Neurological Disorders and Stroke (34189, 05236