Learning Contextual Reward Expectations for Value Adaptation

Substantial evidence indicates that subjective value is adapted to the statistics of reward expected within a given temporal context. However, how these contextual expectations are learned is poorly understood. To examine such learning, we exploited a recent observation that participants performing a gambling task adjust their preferences as a function of context. We show that, in the absence of contextual cues providing reward information, an average reward expectation was learned from recent past experience. Learning dependent on contextual cues emerged when two contexts alternated at a fast rate, whereas both cue-independent and cue-dependent forms of learning were apparent when two contexts alternated at a slower rate. Motivated by these behavioral findings, we reanalyzed a previous fMRI data set to probe the neural substrates of learning contextual reward expectations. We observed a form of reward prediction error related to average reward such that, at option presentation, activity in ventral tegmental area/substantia nigra and ventral striatum correlated positively and negatively, respectively, with the actual and predicted value of options. Moreover, an inverse correlation between activity in ventral tegmental area/substantia nigra (but not striatum) and predicted option value was greater in participants showing enhanced choice adaptation to context. The findings help understanding the mechanisms underlying learning of contextual reward expectation

The Dopaminergic Midbrain Mediates an Effect of Average Reward on Pavlovian Vigor

Dopamine plays a key role in motivation. Phasic dopamine response reflects a reinforcement prediction error (RPE), whereas tonic dopamine activity is postulated to represent an average reward that mediates motivational vigor. However, it has been hard to find evidence concerning the neural encoding of average reward that is uncorrupted by influences of RPEs. We circumvented this difficulty in a novel visual search task where we measured participants' button pressing vigor in a context where information (underlying an RPE) about future average reward was provided well before the average reward itself. Despite no instrumental consequence, participants' pressing force increased for greater current average reward, consistent with a form of Pavlovian effect on motivational vigor. We recorded participants' brain activity during task performance with fMRI. Greater average reward was associated with enhanced activity in dopaminergic midbrain to a degree that correlated with the relationship between average reward and pressing vigor. Interestingly, an opposite pattern was observed in subgenual cingulate cortex, a region implicated in negative mood and motivational inhibition. These findings highlight a crucial role for dopaminergic midbrain in representing aspects of average reward and motivational vigor

Penggunaan Media Pembelajaran Pendidikan Kewarganegaraan untuk Meningkatkan Motivasi dan Hasil Belajar

The background research that the level of difficulty for students at SDN 14 Sadaniang in civic education absorbing subject matter is quite alarming.The purpose of this study to describe the use of instructional civics teaching media to improve motivation and learning outcomes in grade IV SDN 14 Sadaninag. The method used in this study was Quasi Experimental Research. These samples included 20 students. Data analysis techniques used t test. The research findings are that there are differences in student motivation and learning outcomes without the use of instructional media civics in class IV SDN 14 Sadaniang. The research findings are that motivation and student learning outcomes before using instructional media is low because of the three meetings, there are students who do not reach the KKM. While using the media after learning motivation and learning outcomes of students increased because of 3 sessions, all students reach KKM

Prior preferences beneficially influence social and non-social learning

Our personal preferences affect a broad array of social behaviors. This includes the way we learn the preferences of others, an ability that often relies on limited or ambiguous information. Here we report an egocentric influence on this type of social learning that is reflected in both performance and response times. Using computational models that combine inter-trial learning and intra-trial choice, we find transient effects of participants' preferences on the learning process, through the influence of priors, and persistent effects on the choice process. A second experiment shows that these effects generalize to non-social learning, though participants in the social learning experiment appeared to additionally benefit by using their knowledge about the popularity of certain preferences. We further find that the domain-general egocentric influences we identify can yield performance advantages in uncertain environments.People often assume that other people share their preferences, but how exactly this bias manifests itself in learning and decision-making is unclear. Here, authors show that a person's own preferences influence learning in both social and non-social situations, and that this bias improves performance

Supergravity Higgs Inflation and Shift Symmetry in Electroweak Theory

We present a model of inflation in a supergravity framework in the Einstein frame where the Higgs field of the next to minimal supersymmetric standard model (NMSSM) plays the role of the inflaton. Previous attempts which assumed non-minimal coupling to gravity failed due to a tachyonic instability of the singlet field during inflation. A canonical K\"{a}hler potential with \textit{minimal coupling} to gravity can resolve the tachyonic instability but runs into the $\eta$-problem. We suggest a model which is free of the $\eta$-problem due to an additional coupling in the K\"{a}hler potential which is allowed by the Standard Model gauge group. This induces directions in the potential which we call K-flat. For a certain value of the new coupling in the (N)MSSM, the K\"{a}hler potential is special, because it can be associated with a certain shift symmetry for the Higgs doublets, a generalization of the shift symmetry for singlets in earlier models. We find that K-flat direction has $H_u^0=-H_d^{0*}.$ This shift symmetry is broken by interactions coming from the superpotential and gauge fields. This direction fails to produce successful inflation in the MSSM but produces a viable model in the NMSSM. The model is specifically interesting in the Peccei-Quinn (PQ) limit of the NMSSM. In this limit the model can be confirmed or ruled-out not just by cosmic microwave background observations but also by axion searches.Comment: matches the published version at JCA

Effects of Noise in a Cortical Neural Model

Recently Segev et al. (Phys. Rev. E 64,2001, Phys.Rev.Let. 88, 2002) made long-term observations of spontaneous activity of in-vitro cortical networks, which differ from predictions of current models in many features. In this paper we generalize the EI cortical model introduced in a previous paper (S.Scarpetta et al. Neural Comput. 14, 2002), including intrinsic white noise and analyzing effects of noise on the spontaneous activity of the nonlinear system, in order to account for the experimental results of Segev et al.. Analytically we can distinguish different regimes of activity, depending from the model parameters. Using analytical results as a guide line, we perform simulations of the nonlinear stochastic model in two different regimes, B and C. The Power Spectrum Density (PSD) of the activity and the Inter-Event-Interval (IEI) distributions are computed, and compared with experimental results. In regime B the network shows stochastic resonance phenomena and noise induces aperiodic collective synchronous oscillations that mimic experimental observations at 0.5 mM Ca concentration. In regime C the model shows spontaneous synchronous periodic activity that mimic activity observed at 1 mM Ca concentration and the PSD shows two peaks at the 1st and 2nd harmonics in agreement with experiments at 1 mM Ca. Moreover (due to intrinsic noise and nonlinear activation function effects) the PSD shows a broad band peak at low frequency. This feature, observed experimentally, does not find explanation in the previous models. Besides we identify parametric changes (namely increase of noise or decreasing of excitatory connections) that reproduces the fading of periodicity found experimentally at long times, and we identify a way to discriminate between those two possible effects measuring experimentally the low frequency PSD.Comment: 25 pages, 10 figures, to appear in Phys. Rev.

Deep brain stimulation of the subthalamic nucleus modulates sensitivity to decision outcome value in Parkinson's disease.

Deep brain stimulation (DBS) of the subthalamic nucleus in Parkinson's disease is known to cause a subtle but important adverse impact on behaviour, with impulsivity its most widely reported manifestation. However, precisely which computational components of the decision process are modulated is not fully understood. Here we probe a number of distinct subprocesses, including temporal discount, outcome utility, instrumental learning rate, instrumental outcome sensitivity, reward-loss trade-offs, and perseveration. We tested 22 Parkinson's Disease patients both on and off subthalamic nucleus deep brain stimulation (STN-DBS), while they performed an instrumental learning task involving financial rewards and losses, and an inter-temporal choice task for financial rewards. We found that instrumental learning performance was significantly worse following stimulation, due to modulation of instrumental outcome sensitivity. Specifically, patients became less sensitive to decision values for both rewards and losses, but without any change to the learning rate or reward-loss trade-offs. However, we found no evidence that DBS modulated different components of temporal impulsivity. In conclusion, our results implicate the subthalamic nucleus in a modulation of outcome value in experience-based learning and decision-making in Parkinson's disease, suggesting a more pervasive role of the subthalamic nucleus in the control of human decision-making than previously thought.GRF gratefully acknowledges support by the German Research Council (Deutsche Forschungsgemeinschaft, KFO-219). Ray Dolan is supported by the Wellcome Trust (R.J.D., Senior Investigator Award 098362/Z/12/Z) and the the Senate of Berlin (R.J.D., Einstein Fellowship). Ben Seymour is funded by the Wellcome Trust and the National Institute of Information and Communications Technology, Japan; Peter Dayan is funded by the Gatsby Charitable Foundation

Repurposing the (super)crip: media representations of disability at the Rio 2016 Paralympic Games

Mega-events attract ever larger media audiences, and the 2016 Rio Paralympics were no exception. As audiences grow, media coverage extends to ever more varied domains, which are themselves then colonised by an increasing range of discourses. One of main discourses to develop since the early 2000s has been that of the so-called “supercrip”, one which challenges the notion of “impairment” often connected with disability by foregrounding the para-athletes’ triumph over adversity, celebrating instead their courage, grit and perseverance leading to athletic success and personal and increasingly national prestige. In this article we analyse the continuing importance of the supercrip discourse in coverage of the Rio Paralympics, but also move on to highlight its tactical alignment with other – both competing and complementary – discourses of nationalism, sexualisation, militarisation and celebritisation. We analyse textual and visual manifestations of these discourses using both Critical Discourse Analysis and Foucauldian discourse analysis. We conclude by paying particular attention to the increasing visibility of discourses which, while acknowledging the potentially positive role of the supercrip discourse in focussing on athletic success, repurpose that discourse by foregrounding instead the day-to-day experiences of belittling misrepresentation and neglect, including political neglect

Role of the initial conditions on the enhancement of the escape time in static and fluctuating potentials

We present a study of the noise driven escape of an overdamped Brownian particle moving in a cubic potential profile with a metastable state. We analyze the role of the initial conditions of the particle on the enhancement of the average escape time as a function of the noise intensity for fixed and fluctuating potentials. We observe the noise enhanced stability effect for all the initial unstable states investigated. For a fixed potential we find a peculiar initial condition $x_c$ which separates the set of the initial unstable states in two regions: those which give rise to divergences from those which show nonmonotonic behavior of the average escape time. For fluctuating potential at this particular initial condition and for low noise intensity we find large fluctuations of the average escape time.Comment: 8 pages, 6 figures. Appeared in Physica A (2003

Ketamine for Refractory Headache: A Retrospective Analysis.

BACKGROUND AND OBJECTIVES: The burden of chronic headache disorders in the United States is substantial. Some patients are treatment refractory. Ketamine, an N-methyl-D-aspartate antagonist, provides potent analgesia in subanesthetic doses in chronic pain, and limited data suggest it may alleviate headache in some patients. METHODS: We performed a retrospective study of 61 patients admitted over 3 years for 5 days of intravenous therapy that included continuous ketamine to determine responder rate and patient and ketamine infusion characteristics. Pain ratings at 2 follow-up visits were recorded. An immediate responder was a patient with decrease of 2 points or greater in the numerical rating scale (0-10) from start to final pain in the hospital. Sustained response at office visits 1 and 2 was determined based on maintaining the 2-point improvement at those visits. Patients were assessed daily for pain and adverse events (AEs). RESULTS: Forty-eight (77%) of the 61 patients were immediate responders. There were no differences regarding demographics, opioid use, or fibromyalgia between immediate responders and nonresponders. Maximum improvement occurred 4.56 days (mean) into treatment. Sustained response occurred in 40% of patients at visit 1 (mean, 38.1 days) and 39% of patients at visit 2 (mean, 101.3 days). The mean maximum ketamine rate was 65.2 ± 2.8 mg/h (0.76 mg/kg per hour). Ketamine rates did not differ between groups. Adverse events occurred equally in responders and nonresponders and were mild. CONCLUSIONS: Ketamine was associated with short-term analgesia in many refractory headache patients with tolerable adverse events. A prospective study is warranted to confirm this and elucidate responder characteristics