Individual Differences in Reinforcement Learning: Behavioral, Electrophysiological, and Neuroimaging Correlates

During reinforcement learning, phasic modulations of activity in midbrain dopamine neurons are conveyed to the dorsal anterior cingulate Cortex (dACC) and basal ganglia (BG) and serve to guide adaptive responding. While the animal literature supports a role for the dACC in integrating reward history over time, most human electrophysiological Studies of dACC function have focused on responses to single positive and negative outcomes. The present electrophysiological study investigated the role of the dACC in probabilistic reward learning in healthy subjects using a task that required integration of reinforcement history over time. We recorded the feedback-related negativity (FRN) to reward feedback in subjects who developed a response bias toward a more frequently rewarded ("rich") stimulus ("learners") versus subjects who did not ("non-learners"). Compared to non-learners, learners showed more positive (i.e., smaller) FRNs and greater dACC activation upon receiving reward for correct identification of the rich stimulus. In addition, dACC activation and a bias to select the rich Stimulus were positively correlated. The same participants also completed a monetary incentive delay (MID) task administered during functional magnetic resonance imaging. Compared to non-learners, learners displayed stronger BG responses to reward in the MID task. These findings raise the possibility that learners in the probabilistic reinforcement task were characterized by stronger dACC and BG responses to rewarding outcomes. Furthermore, these results highlight the importance of the dACC to probabilistic reward learning in humans.Psycholog

Bone morphogenetic protein 4 signaling regulates development of the anterior visceral endoderm in the mouse embryo

The extraembryonic ectoderm (ExE) of the mouse conceptus is known to play a role in embryo patterning by signaling to the underlying epiblast and surrounding visceral endoderm. Bmp4 is one of the key ExE signaling molecules and has been recently implicated to participate in regulating development and migration of the anterior visceral endoderm (AVE). However, it remains unclear when exactly BMP4 signaling starts to regulate AVE positioning. To examine this, we have chosen to affect BMP4 function at two different time points, at embryonic day 5.25 (E5.25), thus before AVE migration, and E5.75, just after AVE migration. To this end, an RNAi technique was used, which consisted of the injection of Bmp4 dsRNA into the proamniotic cavity of the egg cylinder followed by its targeted electroporation into the ExE. This resulted in specific knockdown of Bmp4. It was found that Bmp4 RNAi at E5.25, but not at E5.75, led to an abnormal pattern of expression of the AVE marker Cerberus‐like. Thus, BMP4 signaling appears to affect the expression of Cer1 at a specific time window. This RNAi approach provides a convenient means to study spatial and temporal function of genes shortly after embryo implantation

Reduced Caudate and Nucleus Accumbens Response to Rewards in Unmedicated Subjects with Major Depressive Disorder

Objective: Major depressive disorder is characterized by impaired reward processing, possibly due to dysfunction in the basal ganglia. However, few neuroimaging studies of depression have distinguished between anticipatory and consummatory phases of reward processing. Using functional MRI (fMRI) and a task that dissociates anticipatory and consummatory phases of reward processing, the authors tested the hypothesis that individuals with major depression would show reduced reward-related responses in basal ganglia structures. Method: A monetary incentive delay task was presented to 30 unmedicated individuals with major depressive disorder and 31 healthy comparison subjects during fMRI scanning. Whole-brain analyses focused on neural responses to reward-predicting cues and rewarding outcomes (i.e., monetary gains). Secondary analyses focused on the relationship between anhedonic symptoms and basal ganglia volumes. Results: Relative to comparison subjects, participants with major depression showed significantly weaker responses to gains in the left nucleus accumbens and the caudate bilaterally. Group differences in these regions were specific to rewarding outcomes and did not generalize to neutral or negative outcomes, although relatively reduced responses to monetary penalties in the major depression group emerged in other caudate regions. By contrast, evidence for group differences during reward anticipation was weaker, although participants with major depression showed reduced activation to reward cues in a small sector of the left posterior putamen. In the major depression group, anhedonic symptoms and depression severity were associated with reduced caudate volume bilaterally. Conclusions: These results suggest that basal ganglia dysfunction in major depression may affect the consummatory phase of reward processing. Additionally, morphometric results suggest that anhedonia in major depression is related to caudate volume.Psycholog

Reduced Caudate and Nucleus Accumbens Response to Rewards in Unmedicated Subjects with Major Depressive Disorder

Objective: Major depressive disorder is characterized by impaired reward processing, possibly due to dysfunction in the basal ganglia. However, few neuroimaging studies of depression have distinguished between anticipatory and consummatory phases of reward processing. Using functional MRI (fMRI) and a task that dissociates anticipatory and consummatory phases of reward processing, the authors tested the hypothesis that individuals with major depression would show reduced reward-related responses in basal ganglia structures. Method: A monetary incentive delay task was presented to 30 unmedicated individuals with major depressive disorder and 31 healthy comparison subjects during fMRI scanning. Whole-brain analyses focused on neural responses to reward-predicting cues and rewarding outcomes (i.e., monetary gains). Secondary analyses focused on the relationship between anhedonic symptoms and basal ganglia volumes. Results: Relative to comparison subjects, participants with major depression showed significantly weaker responses to gains in the left nucleus accumbens and the caudate bilaterally. Group differences in these regions were specific to rewarding outcomes and did not generalize to neutral or negative outcomes, although relatively reduced responses to monetary penalties in the major depression group emerged in other caudate regions. By contrast, evidence for group differences during reward anticipation was weaker, although participants with major depression showed reduced activation to reward cues in a small sector of the left posterior putamen. In the major depression group, anhedonic symptoms and depression severity were associated with reduced caudate volume bilaterally. Conclusions: These results suggest that basal ganglia dysfunction in major depression may affect the consummatory phase of reward processing. Additionally, morphometric results suggest that anhedonia in major depression is related to caudate volume.Psycholog

Functional studies of signaling pathways in peri-implantation development of the mouse embryo by RNAi.

BACKGROUND: Studies of gene function in the mouse have relied mainly on gene targeting via homologous recombination. However, this approach is difficult to apply in specific windows of time, and to simultaneously knock-down multiple genes. Here we report an efficient method for dsRNA-mediated gene silencing in late cleavage-stage mouse embryos that permits examination of phenotypes at post-implantation stages. RESULTS: We show that introduction of Bmp4 dsRNA into intact blastocysts by electroporation recapitulates the genetic Bmp4 null phenotype at gastrulation. It also reveals a novel role for Bmp4 in the regulation the anterior visceral endoderm specific gene expression and its positioning. We also show that RNAi can be used to simultaneously target several genes. When applied to the three murine isoforms of Dishevelled, it leads to earlier defects than previously observed in double knock-outs. These include severe delays in post-implantation development and defects in the anterior midline and neural folds at headfold stages. CONCLUSION: Our results indicate that the BMP4 signalling pathway contributes to the development of the anterior visceral endoderm, and reveal an early functional redundancy between the products of the murine Dishevelled genes. The proposed approach constitutes a powerful tool to screen the functions of genes that govern the development of the mouse embryo.RIGHTS : This article is licensed under the BioMed Central licence at http://www.biomedcentral.com/about/license which is similar to the 'Creative Commons Attribution Licence'. In brief you may : copy, distribute, and display the work; make derivative works; or make commercial use of the work - under the following conditions: the original author must be given credit; for any reuse or distribution, it must be made clear to others what the license terms of this work are

Abscisic acid is a substrate of the ABC transporter encoded by the durable wheat disease resistance gene Lr34

The wheat Lr34res allele, coding for an ATP-binding cassette transporter, confers durable resistance against multiple fungal pathogens. The Lr34sus allele, differing from Lr34res by two critical nucleotide polymorphisms, is found in susceptible wheat cultivars. Lr34res is functionally transferrable as a transgene into all major cereals, including rice, barley, maize, and sorghum. Here, we used transcriptomics, physiology, genetics, and in vitro and in vivo transport assays to study the molecular function of Lr34. We report that Lr34res results in a constitutive induction of transcripts reminiscent of an abscisic acid (ABA)-regulated response in transgenic rice. Lr34-expressing rice was altered in biological processes that are controlled by this phytohormone, including dehydration tolerance, transpiration and seedling growth. In planta seedling and in vitro yeast accumulation assays revealed that both LR34res and LR34sus act as ABA transporters. However, whereas the LR34res protein was detected in planta the LR34sus version was not, suggesting a post-transcriptional regulatory mechanism. Our results identify ABA as a substrate of the LR34 ABC transporter. We conclude that LR34res-mediated ABA redistribution has a major effect on the transcriptional response and physiology of Lr34res-expressing plants and that ABA is a candidate molecule that contributes to Lr34res-mediated disease resistance

Brain connectivity changes in autosomal recessive Parkinson Disease: a model for the sporadic form

Biallelic genetic mutations in the Park2 and PINK1 genes are frequent causes of autosomal recessive PD. Carriers of single heterozygous mutations may manifest subtle signs of disease, thus providing a unique model of preclinical PD. One emerging hypothesis suggests that non-motor symptom of PD, such as cognitive impairment may be due to a distributed functional disruption of various neuronal circuits. Using resting-state functional MRI (RS-fMRI), we tested the hypothesis that abnormal connectivity within and between brain networks may account for the patients' cognitive status. Eight homozygous and 12 heterozygous carriers of either PINK1 or Park2 mutation and 22 healthy controls underwent RS-fMRI and cognitive assessment. RS-fMRI data underwent independent component analysis to identify five networks of interest: default-mode network, salience network, executive network, right and left fronto-parietal networks. Functional connectivity within and between each network was assessed and compared between groups. All mutation carriers were cognitively impaired, with the homozygous group reporting a more prominent impairment in visuo-spatial working memory. Changes in functional connectivity were evident within all networks between homozygous carriers and controls. Also heterozygotes reported areas of reduced connectivity when compared to controls within two networks. Additionally, increased inter-network connectivity was observed in both groups of mutation carriers, which correlated with their spatial working memory performance, and could thus be interpreted as compensatory. We conclude that both homozygous and heterozygous carriers exhibit pathophysiological changes unveiled by RS-fMRI, which can account for the presence/severity of cognitive symptom

Supplement: "Localization and broadband follow-up of the gravitational-wave transient GW150914" (2016, ApJL, 826, L13)

This Supplement provides supporting material for Abbott et al. (2016a). We briefly summarize past electromagnetic (EM) follow-up efforts as well as the organization and policy of the current EM follow-up program. We compare the four probability sky maps produced for the gravitational-wave transient GW150914, and provide additional details of the EM follow-up observations that were performed in the different bands