Dopamine neurons learn relative chosen value from probabilistic rewards

Economic theories posit reward probability as one of the factors defining reward value. Individuals learn the value of cues that predict probabilistic rewards from experienced reward frequencies. Building on the notion that responses of dopamine neurons increase with reward probability and expected value, we asked how dopamine neurons in monkeys acquire this value signal that may represent an economic decision variable. We found in a Pavlovian learning task that reward probability-dependent value signals arose from experienced reward frequencies. We then assessed neuronal response acquisition during choices among probabilistic rewards. Here, dopamine responses became sensitive to the value of both chosen and unchosen options. Both experiments showed also the novelty responses of dopamine neurones that decreased as learning advanced. These results show that dopamine neurons acquire predictive value signals from the frequency of experienced rewards. This flexible and fast signal reflects a specific decision variable and could update neuronal decision mechanisms

Smarter than humans: rationality reflected in primate neuronal reward signals

Rational choice, in all its definitions by various disciplines, allows agents to maximize utility. Formal axioms and simple choice designs are suitable for assessing rationality in monkeys. Their economic preferences are complete and transitive; the dopamine signal follows transitivity. Dopamine signals also satisfy first-order stochastic dominance that unequivocally defines the better option. Neurons in orbitofrontal cortex (OFC) reflect the unchanged preferences when an irrelevant option is removed from the option set, thus satisfying Arrow’s Weak Axiom of Revealed Preference (WARP) concerning the Independence of Irrelevant Alternatives (IIA). While monkeys, with their reward neurons, may not be more rational than humans, the constraints of controlled experiments seem to allow them to behave rationally within their informational, cognitive and temporal bounds

The phasic dopamine signal maturing: from reward via behavioural activation to formal economic utility

The phasic dopamine reward prediction error response is a major brain signal underlying learning, approach and decision making. This dopamine response consists of two components that reflect, initially, stimulus detection from physical impact and, subsequenttly, reward valuation; dopamine activations by punishers reflect physical impact rather than aversiveness. The dopamine reward signal is distinct from earlier reported and recently confirmed phasic changes with behavioural activation. Optogenetic activation of dopamine neurones in monkeys causes value learning and biases economic choices. The dopamine reward signal conforms to formal economic utility and thus constitutes a utility prediction error signal. In these combined ways, the dopamine reward prediction error signal constitutes a potential neuronal substrate for the crucial economic decision variable of utility.Our work has been supported by the Wellcome Trust (095495, 106101), European Research Council (ERC, 293549), and NIH Conte Center at Caltech (P50MH094258)

Health Aspects of the Pre-Departure Phase of Migration

In the second article in a six-part PLoS Medicine series on Migration & Health, Brian Gushulak and Douglas MacPherson discuss the pre-departure phase of migration and the specific health risks and policy needs associated with this phase

Medicine in the Popular Press: The Influence of the Media on Perceptions of Disease

In an age of increasing globalization and discussion of the possibility of global pandemics, increasing rates of reporting of these events may influence public perception of risk. The present studies investigate the impact of high levels of media reporting on the perceptions of disease. Undergraduate psychology and medical students were asked to rate the severity, future prevalence and disease status of both frequently reported diseases (e.g. avian flu) and infrequently reported diseases (e.g. yellow fever). Participants considered diseases that occur frequently in the media to be more serious, and have higher disease status than those that infrequently occur in the media, even when the low media frequency conditions were considered objectively ‘worse’ by a separate group of participants. Estimates of severity also positively correlated with popular print media frequency in both student populations. However, we also see that the concurrent presentation of objective information about the diseases can mitigate this effect. It is clear from these data that the media can bias our perceptions of disease

Temporal rate is not a distinct perceptual metric.

yesSensory adaptation experiments have revealed the existence of ‘rate after-effects’ - adapting to a relatively fast rate makes an intermediate test rate feel slow, and adapting to a slow rate makes the same moderate test rate feel fast. The present work aims to deconstruct the concept of rate and clarify how exactly the brain processes a regular sequence of sensory signals. We ask whether rate forms a distinct perceptual metric, or whether it is simply the perceptual aggregate of the intervals between its component signals. Subjects were exposed to auditory or visual temporal rates (a ‘slow’ rate of 1.5 Hz and a ‘fast’ rate of 6 Hz), before being tested with single unfilled intervals of varying durations. Results show adapting to a given rate strongly influences the perceived duration of a single empty interval. This effect is robust across both interval reproduction and duration discrimination judgments. These findings challenge our understanding of rate perception. Specifically, they suggest that contrary to some previous assertions, the perception of sequence rate is strongly influenced by the perception of the sequence’s component duration intervals.This work was supported by a Wellcome Trust [WT097387] grant to NW

Methodology of calculation of construction and hydrodynamic parameters of a foam layer apparatus for mass-transfer processes

Промислова реалізація методу стабілізації газорідинного шару дозволяє значно розширити галузь застосування пінних апаратів і відкриває нові можливості інтенсифікації технологічних процесів з одночасним створенням маловідходних технологій. У статті встановлені основні параметри, що впливають на гідродинаміку пінних апаратів, розглянуті основні конструкції та режими роботи пінних апаратів. Виявлено зв'язок гідродинамічних параметрів. Розглянуто гідродинамічні закономірності пінного шару. Вказані фактори, що впливають на процес масообміну, як в газовій, так і в рідкій фазах. Проведений аналіз ряду досліджень показав, що перспективним напрямком інтенсифікації процесу масообміну є розробка апаратів з трифазним псевдозрідженим шаром зрошуваної насадки складних форм із сітчастих матеріалів. Отже, необхідне проведення спеціальних досліджень гідродинамічних режимів роботи апарату з сітчастою насадкою і визначенням параметрів, що впливають на швидкість переходу насадки з одного режиму в інший.Industrial implementation of the stabilization method of the gas-liquid layer can significantly expand the field of use of foaming apparatus and opens up new opportunities for intensifying technological processes with the simultaneous creation of low-waste technologies. The article establishes the basic parameters influencing the hydrodynamics of foam apparatus, considers the basic constructions and operating modes of foam apparatus. The connection of hydrodynamic parameters is revealed. The hydrodynamic laws of the foam layer are considered. The indicated factors affecting the process of mass transfer, both in the gas and in the liquid phases. The conducted analysis of a number of studies showed that the perspective direction of intensification of the mass transfer process is the development of apparatuses with a three-phase fluidized bed of an irrigated nozzle of complex forms with mesh materials

Dopamine neurons learn relative chosen value from probabilistic rewards

Economic theories posit reward probability as one of the factors defining reward value. Individuals learn the value of cues that predict probabilistic rewards from experienced reward frequencies. Building on the notion that responses of dopamine neurons increase with reward probability and expected value, we asked how dopamine neurons in monkeys acquire this value signal that may represent an economic decision variable. We found in a Pavlovian learning task that reward probability-dependent value signals arose from experienced reward frequencies. We then assessed neuronal response acquisition during choices among probabilistic rewards. Here, dopamine responses became sensitive to the value of both chosen and unchosen options. Both experiments showed also the novelty responses of dopamine neurones that decreased as learning advanced. These results show that dopamine neurons acquire predictive value signals from the frequency of experienced rewards. This flexible and fast signal reflects a specific decision variable and could update neuronal decision mechanisms