Reward, learning and games

The link between reward and learning has chiefly been studied scientifically in the context of reinforcement learning. This type of learning, which relies upon midbrain dopaminergic response, differs greatly from the learning valued by educators, which typically involves declarative memory formation. However, with recent insights regarding the modulation of hippocampal function by midbrain dopamine, scientific understanding of the midbrain response to reward may be becoming more relevant to education. Here, we consider the potential for our current understanding of reward to inform educational learning, and consider its implications for game-like interventions in the classroom

Neural processes mediating contextual influences on human choice behaviour

Contextual influences on choice are ubiquitous in ecological settings. Current evidence suggests that subjective values are normalized with respect to the distribution of potentially available rewards. However, how this context-sensitivity is realised in the brain remains unknown. To address this, here we examine functional magnetic resonance imaging (fMRI) data during performance of a gambling task where blocks comprise values drawn from one of two different, but partially overlapping, reward distributions or contexts. At the beginning of each block (when information about context is provided), hippocampus is activated and this response is enhanced when contextual influence on choice increases. In addition, response to value in ventral tegmental area/substantia nigra (VTA/SN) shows context-sensitivity, an effect enhanced with an increased contextual influence on choice. Finally, greater response in hippocampus at block start is associated with enhanced context sensitivity in VTA/SN. These findings suggest that context-sensitive choice is driven by a brain circuit involving hippocampus and dopaminergic midbrain

Dyadic adjustment, family coping, body image, quality of life and psychological morbidity in patients with psoriasis and their partners

Background Psoriasis is an incurable and chronic disease that includes unpredictable periods of remission and relapse requiring long-term therapy. Purpose This paper focuses on the relationship among family coping, psychological morbidity, body image, dyadic adjustment and quality of life in psoriatic patients and their partners. Method One hundred and one patients with psoriasis and 78 partners comprised the sample. They were regular users of the Dermatology Service of a Central Northern hospital in Portugal and a private dermatology clinic. Patients with psoriasis were assessed on anxiety, depression, body image, quality of life, dyadic adjustment and family coping. Partners were assessed on the same measures except body image and quality of life. Results A positive relationship among dyadic adjustment, psychological morbidity and family coping in patients and their partners was found. Also, patients with lower levels of quality of life had partners with higher levels of depressive and anxious symptoms. Better dyadic adjustment predicted family coping in the psoriatic patient. High levels of dyadic adjustment in patients and low partners’ trait anxiety predicted better dyadic adjustment in partners. Conclusion The results highlight the importance of incorporating family variables in psychological interventions in psoriasis’ care, particularly family coping and dyadic adjustment as well as the need for psychological intervention to focus both on patients and partners

Hierarchical prediction errors in midbrain and septum during social learning

Social learning is fundamental to human interactions, yet its computational and physiological mechanisms are not well understood. One prominent open question concerns the role of neuromodulatory transmitters. We combined fMRI, computational modelling, and genetics to address this question in two separate samples (N=35, N=47). Participants played a game requiring inference on an advisor's intentions whose motivation to help or mislead changed over time. Our analyses suggest that hierarchically structured belief updates about current advice validity and the adviser's trustworthiness, respectively, depend on different neuromodulatory systems. Low-level prediction errors (PEs) about advice accuracy not only activated regions known to support "theory of mind", but also the dopaminergic midbrain. Furthermore, PE responses in ventral striatum were influenced by the Met/Val polymorphism of the Catechol-O-Methyltransferase (COMT) gene. By contrast, high-level PEs ("expected uncertainty") about the adviser's fidelity activated the cholinergic septum. These findings, replicated in both samples, have important implications: They suggest that social learning rests on hierarchically related PEs encoded by midbrain and septum activity, respectively, in the same manner as other forms of learning under volatility. Furthermore, these hierarchical PEs may be broadcast by dopaminergic and cholinergic projections to induce plasticity specifically in cortical areas known to represent beliefs about others. Copyright The Authors (2017). Published by Oxford University Press

Spatiotemporal neural characterization of prediction error valence and surprise during reward learning in humans

Reward learning depends on accurate reward associations with potential choices. These associations can be attained with reinforcement learning mechanisms using a reward prediction error (RPE) signal (the difference between actual and expected rewards) for updating future reward expectations. Despite an extensive body of literature on the influence of RPE on learning, little has been done to investigate the potentially separate contributions of RPE valence (positive or negative) and surprise (absolute degree of deviation from expectations). Here, we coupled single-trial electroencephalography with simultaneously acquired fMRI, during a probabilistic reversal-learning task, to offer evidence of temporally overlapping but largely distinct spatial representations of RPE valence and surprise. Electrophysiological variability in RPE valence correlated with activity in regions of the human reward network promoting approach or avoidance learning. Electrophysiological variability in RPE surprise correlated primarily with activity in regions of the human attentional network controlling the speed of learning. Crucially, despite the largely separate spatial extend of these representations our EEG-informed fMRI approach uniquely revealed a linear superposition of the two RPE components in a smaller network encompassing visuo mnemonic and reward areas. Activity in this network was further predictive of stimulus value updating indicating a comparable contribution of both signals to reward learning

Disambiguating ventral striatum fMRI-related bold signal during reward prediction in schizophrenia

Reward detection, surprise detection and prediction-error signaling have all been proposed as roles for the ventral striatum (vStr). Previous neuroimaging studies of striatal function in schizophrenia have found attenuated neural responses to reward-related prediction errors; however, as prediction errors represent a discrepancy in mesolimbic neural activity between expected and actual events, it is critical to examine responses to both expected and unexpected rewards (URs) in conjunction with expected and UR omissions in order to clarify the nature of ventral striatal dysfunction in schizophrenia. In the present study, healthy adults and people with schizophrenia were tested with a reward-related prediction-error task during functional magnetic resonance imaging to determine whether schizophrenia is associated with altered neural responses in the vStr to rewards, surprise prediction errors or all three factors. In healthy adults, we found neural responses in the vStr were correlated more specifically with prediction errors than to surprising events or reward stimuli alone. People with schizophrenia did not display the normal differential activation between expected and URs, which was partially due to exaggerated ventral striatal responses to expected rewards (right vStr) but also included blunted responses to unexpected outcomes (left vStr). This finding shows that neural responses, which typically are elicited by surprise, can also occur to well-predicted events in schizophrenia and identifies aberrant activity in the vStr as a key node of dysfunction in the neural circuitry used to differentiate expected and unexpected feedback in schizophrenia

Mapping anhedonia onto reinforcement learning: A behavioural meta-analysis

BACKGROUND: Depression is characterised partly by blunted reactions to reward. However, tasks probing this deficiency have not distinguished insensitivity to reward from insensitivity to the prediction errors for reward that determine learning and are putatively reported by the phasic activity of dopamine neurons. We attempted to disentangle these factors with respect to anhedonia in the context of stress, Major Depressive Disorder (MDD), Bipolar Disorder (BPD) and a dopaminergic challenge. METHODS: Six behavioural datasets involving 392 experimental sessions were subjected to a model-based, Bayesian meta-analysis. Participants across all six studies performed a probabilistic reward task that used an asymmetric reinforcement schedule to assess reward learning. Healthy controls were tested under baseline conditions, stress or after receiving the dopamine D2 agonist pramipexole. In addition, participants with current or past MDD or BPD were evaluated. Reinforcement learning models isolated the contributions of variation in reward sensitivity and learning rate. RESULTS: MDD and anhedonia reduced reward sensitivity more than they affected the learning rate, while a low dose of the dopamine D2 agonist pramipexole showed the opposite pattern. Stress led to a pattern consistent with a mixed effect on reward sensitivity and learning rate. CONCLUSION: Reward-related learning reflected at least two partially separable contributions. The first related to phasic prediction error signalling, and was preferentially modulated by a low dose of the dopamine agonist pramipexole. The second related directly to reward sensitivity, and was preferentially reduced in MDD and anhedonia. Stress altered both components. Collectively, these findings highlight the contribution of model-based reinforcement learning meta-analysis for dissecting anhedonic behavior

Core neuropsychological measures for obesity and diabetes trials: Initial report.

Obesity and diabetes are known to be related to cognitive abilities. The Core Neuropsychological Measures for Obesity and Diabetes Trials Project aimed to identify the key cognitive and perceptual domains in which performance can influence treatment outcomes, including predicting, mediating, and moderating treatment outcome and to generate neuropsychological batteries comprised of well-validated, easy-to-administer tests that best measure these key domains. The ultimate goal is to facilitate inclusion of neuropsychological measures in clinical studies and trials so that we can gather more information on potential mediators of obesity and diabetes treatment outcomes. We will present the rationale for the project and three options for the neuropsychological batteries to satisfy varying time and other administration constraints. Future directions are discussed. Preprint version of the document is available at https://osf.io/preprints/nutrixiv/7jygx/