Midbrain Dopamine Neurons Signal Belief in Choice Accuracy during a Perceptual Decision

Central to the organization of behavior is the ability to predict the values of outcomes to guide choices. The accuracy of such predictions is honed by a teaching signal that indicates how incorrect a prediction was (“reward prediction error,” RPE). In several reinforcement learning contexts, such as Pavlovian conditioning and decisions guided by reward history, this RPE signal is provided by midbrain dopamine neurons. In many situations, however, the stimuli predictive of outcomes are perceptually ambiguous. Perceptual uncertainty is known to influence choices, but it has been unclear whether or how dopamine neurons factor it into their teaching signal. To cope with uncertainty, we extended a reinforcement learning model with a belief state about the perceptually ambiguous stimulus; this model generates an estimate of the probability of choice correctness, termed decision confidence. We show that dopamine responses in monkeys performing a perceptually ambiguous decision task comply with the model’s predictions. Consequently, dopamine responses did not simply reflect a stimulus’ average expected reward value but were predictive of the trial-to-trial fluctuations in perceptual accuracy. These confidence-dependent dopamine responses emerged prior to monkeys’ choice initiation, raising the possibility that dopamine impacts impending decisions, in addition to encoding a post-decision teaching signal. Finally, by manipulating reward size, we found that dopamine neurons reflect both the upcoming reward size and the confidence in achieving it. Together, our results show that dopamine responses convey teaching signals that are also appropriate for perceptual decisions

Cryogenic propellant management: Integration of design, performance and operational requirements

The integration of the design features of the Shuttle elements into a cryogenic propellant management system is described. The implementation and verification of the design/operational changes resulting from design deficiencies and/or element incompatibilities encountered subsequent to the critical design reviews are emphasized. Major topics include: subsystem designs to provide liquid oxygen (LO2) tank pressure stabilization, LO2 facility vent for ice prevention, liquid hydrogen (LH2) feedline high point bleed, pogo suppression on the Space Shuttle Main Engine (SSME), LO2 low level cutoff, Orbiter/engine propellant dump, and LO2 main feedline helium injection for geyser prevention

Dopamine neurons learn relative chosen value from probabilistic rewards

Economic theories posit reward probability as one of the factors defining reward value. Individuals learn the value of cues that predict probabilistic rewards from experienced reward frequencies. Building on the notion that responses of dopamine neurons increase with reward probability and expected value, we asked how dopamine neurons in monkeys acquire this value signal that may represent an economic decision variable. We found in a Pavlovian learning task that reward probability-dependent value signals arose from experienced reward frequencies. We then assessed neuronal response acquisition during choices among probabilistic rewards. Here, dopamine responses became sensitive to the value of both chosen and unchosen options. Both experiments showed also the novelty responses of dopamine neurones that decreased as learning advanced. These results show that dopamine neurons acquire predictive value signals from the frequency of experienced rewards. This flexible and fast signal reflects a specific decision variable and could update neuronal decision mechanisms

Smarter than humans: rationality reflected in primate neuronal reward signals

Rational choice, in all its definitions by various disciplines, allows agents to maximize utility. Formal axioms and simple choice designs are suitable for assessing rationality in monkeys. Their economic preferences are complete and transitive; the dopamine signal follows transitivity. Dopamine signals also satisfy first-order stochastic dominance that unequivocally defines the better option. Neurons in orbitofrontal cortex (OFC) reflect the unchanged preferences when an irrelevant option is removed from the option set, thus satisfying Arrow’s Weak Axiom of Revealed Preference (WARP) concerning the Independence of Irrelevant Alternatives (IIA). While monkeys, with their reward neurons, may not be more rational than humans, the constraints of controlled experiments seem to allow them to behave rationally within their informational, cognitive and temporal bounds

Erratum: Correction to: Comprehensive 5P framework for active aging using the ecological approach: an iterative systematic review (BMC public health (2020) 20 1 (33))

It was highlighted that the original article 1 contained a spelling mistake in the name of Hamid R. Baradaran. This was incorrectly captured as Bradaran. The original article has been updated

A Framework for Elder-Friendly Public Open Spaces from the Iranian Older Adults' perspectives : A Mixed-Method Study

Authors' contributions All of the authors have made great contributions to the research design, field survey, data collection, data analysis, and drafting of the manuscript. Funding There are no funding resources for this research. Availability of data and materials The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.Peer reviewedPostprin

Dopamine axons in dorsal striatum encode contralateral visual stimuli and choices.

The striatum plays critical roles in visually-guided decision making and receives dense axonal projections from midbrain dopamine neurons. However, the roles of striatal dopamine in visual decision making are poorly understood. We trained male and female mice to perform a visual decision task with asymmetric reward payoff, and we recorded the activity of dopamine axons innervating striatum. Dopamine axons in the dorsomedial striatum (DMS) responded to contralateral visual stimuli and contralateral rewarded actions. Neural responses to contralateral stimuli could not be explained by orienting behavior such as eye movements. Moreover, these contralateral stimulus responses persisted in sessions where the animals were instructed to not move to obtain reward, further indicating that these signals are stimulus-related. Lastly, we show that DMS dopamine signals were qualitatively different from dopamine signals in the ventral striatum, which responded to both ipsi- and contralateral stimuli, conforming to canonical prediction error signaling under sensory uncertainty. Thus, during visual decisions, DMS dopamine encodes visual stimuli and rewarded actions in a lateralized fashion, and could facilitate associations between specific visual stimuli and actions

Influence of the Ion Coordination Number on Cation Exchange Reactions with Copper Telluride Nanocrystals

Cu2-xTe nanocubes were used as starting seeds to access metal telluride nanocrystals by cation exchanges at room temperature. The coordination number of the entering cations was found to play an important role in dictating the reaction pathways. The exchanges with tetrahedrally coordinated cations (i.e. with coordination number 4), such as Cd2+ or Hg2+, yielded monocrystalline CdTe or HgTe nanocrystals with Cu2-xTe/CdTe or Cu2-xTe/HgTe Janus-like heterostructures as intermediates. The formation of Janus-like architectures was attributed to the high diffusion rate of the relatively small tetrahedrally coordinated cations, which could rapidly diffuse in the Cu2-xTe NCs and nucleate the CdTe (or HgTe) phase in a preferred region of the host structure. Also, with both Cd2+ and Hg2+ ions the exchange led to wurtzite CdTe and HgTe phases rather than the more stable zinc-blende ones, indicating that the anion framework of the starting Cu2- xTe particles could be more easily deformed to match the anion framework of the metastable wurtzite structures. As hexagonal HgTe had never been reported to date, this represents another case of metastable new phases that can only be accessed by cation exchange. On the other hand, the exchanges involving octahedrally coordinated ions (i.e. with coordination number 6), such as Pb2+ or Sn2+, yielded rock-salt polycrystalline PbTe or SnTe nanocrystals with Cu2-xTe@PbTe or Cu2-xTe@SnTe core@shell architectures at the early stages of the exchange process. In this case, the octahedrally coordinated ions are probably too large to diffuse easily through the Cu2-xTe structure: their limited diffusion rate restricts their initial reaction to the surface of the nanocrystals, where cation exchange is initiated unselectively, leading to core@shell architectures.Comment: 11 pages, 7 figures in J. Am. Chem. Soc, 13 May 201

The phasic dopamine signal maturing: from reward via behavioural activation to formal economic utility

The phasic dopamine reward prediction error response is a major brain signal underlying learning, approach and decision making. This dopamine response consists of two components that reflect, initially, stimulus detection from physical impact and, subsequenttly, reward valuation; dopamine activations by punishers reflect physical impact rather than aversiveness. The dopamine reward signal is distinct from earlier reported and recently confirmed phasic changes with behavioural activation. Optogenetic activation of dopamine neurones in monkeys causes value learning and biases economic choices. The dopamine reward signal conforms to formal economic utility and thus constitutes a utility prediction error signal. In these combined ways, the dopamine reward prediction error signal constitutes a potential neuronal substrate for the crucial economic decision variable of utility.Our work has been supported by the Wellcome Trust (095495, 106101), European Research Council (ERC, 293549), and NIH Conte Center at Caltech (P50MH094258)