Neural Prediction Errors Reveal a Risk-Sensitive Reinforcement-Learning Process in the Human Brain

Humans and animals are exquisitely, though idiosyncratically, sensitive to risk or variance in the outcomes of their actions. Economic, psychological, and neural aspects of this are well studied when information about risk is provided explicitly. However, we must normally learn about outcomes from experience, through trial and error. Traditional models of such reinforcement learning focus on learning about the mean reward value of cues and ignore higher order moments such as variance. We used fMRI to test whether the neural correlates of human reinforcement learning are sensitive to experienced risk. Our analysis focused on anatomically delineated regions of a priori interest in the nucleus accumbens, where blood oxygenation level-dependent (BOLD) signals have been suggested as correlating with quantities derived from reinforcement learning. We first provide unbiased evidence that the raw BOLD signal in these regions corresponds closely to a reward prediction error. We then derive from this signal the learned values of cues that predict rewards of equal mean but different variance and show that these values are indeed modulated by experienced risk. Moreover, a close neurometric–psychometric coupling exists between the fluctuations of the experience-based evaluations of risky options that we measured neurally and the fluctuations in behavioral risk aversion. This suggests that risk sensitivity is integral to human learning, illuminating economic models of choice, neuroscientific models of affective learning, and the workings of the underlying neural mechanisms

Simulation of the White Dwarf -- White Dwarf galactic background in the LISA data

LISA (Laser Interferometer Space Antenna) is a proposed space mission, which will use coherent laser beams exchanged between three remote spacecraft to detect and study low-frequency cosmic gravitational radiation. In the low-part of its frequency band, the LISA strain sensitivity will be dominated by the incoherent superposition of hundreds of millions of gravitational wave signals radiated by inspiraling white-dwarf binaries present in our own galaxy. In order to estimate the magnitude of the LISA response to this background, we have simulated a synthesized population that recently appeared in the literature. We find the amplitude of the galactic white-dwarf binary background in the LISA data to be modulated in time, reaching a minimum equal to about twice that of the LISA noise for a period of about two months around the time when the Sun-LISA direction is roughly oriented towards the Autumn equinox. Since the galactic white-dwarfs background will be observed by LISA not as a stationary but rather as a cyclostationary random process with a period of one year, we summarize the theory of cyclostationary random processes and present the corresponding generalized spectral method needed to characterize such process. We find that, by measuring the generalized spectral components of the white-dwarf background, LISA will be able to infer properties of the distribution of the white-dwarfs binary systems present in our Galaxy.Comment: 14 pages and 6 figures. Submitted to Classical and Quantum Gravity (Proceedings of GWDAW9

On searches for gravitational waves from mini creation event by laser interferometric detectors

As an alternative view to the standard big bang cosmology the quasi-steady state cosmology(QSSC) argues that the universe was not created in a single great explosion; it neither had a beginning nor will it ever come to an end. The creation of new matter in the universe is a regular feature occurring through finite explosive events. Each creation event is called a mini-bang or, a mini creation event(MCE). Gravitational waves are expected to be generated due to any anisotropy present in this process of creation. Mini creation event ejecting matter in two oppositely directed jets is thus a source of gravitational waves which can in principle be detected by laser interferometric detectors. In the present work we consider the gravitational waveforms propagated by linear jets and then estimate the response of laser interferometric detectors like LIGO and LISA

Turbulence and jet-driven zonal flows: Secondary circulation in rotating fluids due to asymmetric forcing

We report on experiments and modeling on a rotating confined liquid that is forced by circumferential jets coaxial with the rotation axis, wherein system-scale secondary flows are observed to emerge. The jets are evenly divided in number between inlets and outlets and have zero net mass transport. For low forcing strengths the sign of this flow depends on the sign of a sloped end cap, which simulates a planetary β plane. For increased forcing strengths the secondary flow direction is insensitive to the slope sign, and instead appears to be dominated by an asymmetry in the forcing mechanism, namely, the difference in radial divergence between the inlet and outlet jet profiles. This asymmetry yields a net radial velocity that is affected by the Coriolis force, inducing secondary zonal flow

Developing and implementing an integrated delirium prevention system of care:a theory driven, participatory research study

Background: Delirium is a common complication for older people in hospital. Evidence suggests that delirium incidence in hospital may be reduced by about a third through a multi-component intervention targeted at known modifiable risk factors. We describe the research design and conceptual framework underpinning it that informed the development of a novel delirium prevention system of care for acute hospital wards. Particular focus of the study was on developing an implementation process aimed at embedding practice change within routine care delivery. Methods: We adopted a participatory action research approach involving staff, volunteers, and patient and carer representatives in three northern NHS Trusts in England. We employed Normalization Process Theory to explore knowledge and ward practices on delirium and delirium prevention. We established a Development Team in each Trust comprising senior and frontline staff from selected wards, and others with a potential role or interest in delirium prevention. Data collection included facilitated workshops, relevant documents/records, qualitative one-to-one interviews and focus groups with multiple stakeholders and observation of ward practices. We used grounded theory strategies in analysing and synthesising data. Results: Awareness of delirium was variable among staff with no attention on delirium prevention at any level; delirium prevention was typically neither understood nor perceived as meaningful. The busy, chaotic and challenging ward life rhythm focused primarily on diagnostics, clinical observations and treatment. Ward practices pertinent to delirium prevention were undertaken inconsistently. Staff welcomed the possibility of volunteers being engaged in delirium prevention work, but existing systems for volunteer support were viewed as a barrier. Our evolving conception of an integrated model of delirium prevention presented major implementation challenges flowing from minimal understanding of delirium prevention and securing engagement of volunteers alongside practice change. The resulting Prevention of Delirium (POD) Programme combines a multi-component delirium prevention and implementation process, incorporating systems and mechanisms to introduce and embed delirium prevention into routine ward practices. Conclusions: Although our substantive interest was in delirium prevention, the conceptual and methodological strategies pursued have implications for implementing and sustaining practice and service improvements more broadly

Universality of striped morphologies

We present a method for predicting the low-temperature behavior of spherical and Ising spin models with isotropic potentials. For the spherical model the characteristic length scales of the ground states are exactly determined but the morphology is shown to be degenerate with checkerboard patterns, stripes and more complex morphologies having identical energy. For the Ising models we show that the discretization breaks the degeneracy causing striped morphologies to be energetically favored and therefore they arise universally as ground states to potentials whose Hankel transforms have nontrivial minima.Comment: 4 pages, 4 figure

Free MHD Shear Layers In The Presence Of Rotation And Magnetic Field

We present an experimental and numerical study of hydrodynamic and magnetohydrodynamic free shear layers and their stability. We first examine the experimental measurement of globally unstable hydrodynamic shear layers in the presence of rotation, and their range of instability. These are compared to numerical simulations, which are used to explain the modification of the shear layer and thus the critical Rossby number for stability. Magnetic fields are then applied to these scenarios, and globally unstable magnetohydrodynamic shear layers generated. These too are compared to numerical simulations, showing behavior consistent with the hydrodynamic case and previously reported measurements