Risk, Unexpected Uncertainty, and Estimation Uncertainty: Bayesian Learning in Unstable Settings

Recently, evidence has emerged that humans approach learning using Bayesian updating rather than (model-free) reinforcement algorithms in a six-arm restless bandit problem. Here, we investigate what this implies for human appreciation of uncertainty. In our task, a Bayesian learner distinguishes three equally salient levels of uncertainty. First, the Bayesian perceives irreducible uncertainty or risk: even knowing the payoff probabilities of a given arm, the outcome remains uncertain. Second, there is (parameter) estimation uncertainty or ambiguity: payoff probabilities are unknown and need to be estimated. Third, the outcome probabilities of the arms change: the sudden jumps are referred to as unexpected uncertainty. We document how the three levels of uncertainty evolved during the course of our experiment and how it affected the learning rate. We then zoom in on estimation uncertainty, which has been suggested to be a driving force in exploration, in spite of evidence of widespread aversion to ambiguity. Our data corroborate the latter. We discuss neural evidence that foreshadowed the ability of humans to distinguish between the three levels of uncertainty. Finally, we investigate the boundaries of human capacity to implement Bayesian learning. We repeat the experiment with different instructions, reflecting varying levels of structural uncertainty. Under this fourth notion of uncertainty, choices were no better explained by Bayesian updating than by (model-free) reinforcement learning. Exit questionnaires revealed that participants remained unaware of the presence of unexpected uncertainty and failed to acquire the right model with which to implement Bayesian updating

Altered oscillatory brain dynamics after repeated traumatic stress

Kolassa I-T, Wienbruch C, Neuner F, et al. Altered oscillatory brain dynamics after repeated traumatic stress. BMC Psychiatry. 2007;7(1): 56.BACKGROUND: Repeated traumatic experiences, e.g. torture and war, lead to functional and structural cerebral changes, which should be detectable in cortical dynamics. Abnormal slow waves produced within circumscribed brain regions during a resting state have been associated with lesioned neural circuitry in neurological disorders and more recently also in mental illness. METHODS: Using magnetoencephalographic (MEG-based) source imaging, we mapped abnormal distributions of generators of slow waves in 97 survivors of torture and war with posttraumatic stress disorder (PTSD) in comparison to 97 controls. RESULTS: PTSD patients showed elevated production of focally generated slow waves (1-4 Hz), particularly in left temporal brain regions, with peak activities in the region of the insula. Furthermore, differential slow wave activity in right frontal areas was found in PTSD patients compared to controls. CONCLUSION: The insula, as a site of multimodal convergence, could play a key role in understanding the pathophysiology of PTSD, possibly accounting for what has been called posttraumatic alexithymia, i.e., reduced ability to identify, express and regulate emotional responses to reminders of traumatic events. Differences in activity in right frontal areas may indicate a dysfunctional PFC, which may lead to diminished extinction of conditioned fear and reduced inhibition of the amygdala

Can we improve outcomes in AF patients by early therapy?

Atrial fibrillation affects at least 1% of the population and causes marked society-wide morbidity and mortality. Current management of atrial fibrillation including antithrombotic therapy and management of concomitant conditions in all patients, rate control therapy in most patients, and rhythm control therapy in patients with severe atrial fibrillation-related symptoms can alleviate atrial fibrillation-related symptoms but can neither effectively prevent recurrent atrial fibrillation nor suppress atrial fibrillation-related complications. Hence, there is a need for better therapy of atrial fibrillation

Behavioral modeling of human choices reveals dissociable effects of physical effort and temporal delay on reward devaluation

There has been considerable interest from the fields of biology, economics, psychology, and ecology about how decision costs decrease the value of rewarding outcomes. For example, formal descriptions of how reward value changes with increasing temporal delays allow for quantifying individual decision preferences, as in animal species populating different habitats, or normal and clinical human populations. Strikingly, it remains largely unclear how humans evaluate rewards when these are tied to energetic costs, despite the surge of interest in the neural basis of effort-guided decision-making and the prevalence of disorders showing a diminished willingness to exert effort (e.g., depression). One common assumption is that effort discounts reward in a similar way to delay. Here we challenge this assumption by formally comparing competing hypotheses about effort and delay discounting. We used a design specifically optimized to compare discounting behavior for both effort and delay over a wide range of decision costs (Experiment 1). We then additionally characterized the profile of effort discounting free of model assumptions (Experiment 2). Contrary to previous reports, in both experiments effort costs devalued reward in a manner opposite to delay, with small devaluations for lower efforts, and progressively larger devaluations for higher effort-levels (concave shape). Bayesian model comparison confirmed that delay-choices were best predicted by a hyperbolic model, with the largest reward devaluations occurring at shorter delays. In contrast, an altogether different relationship was observed for effort-choices, which were best described by a model of inverse sigmoidal shape that is initially concave. Our results provide a novel characterization of human effort discounting behavior and its first dissociation from delay discounting. This enables accurate modelling of cost-benefit decisions, a prerequisite for the investigation of the neural underpinnings of effort-guided choice and for understanding the deficits in clinical disorders characterized by behavioral inactivity

A software pipeline for processing and identification of fungal ITS sequences

<p>Abstract</p> <p>Background</p> <p>Fungi from environmental samples are typically identified to species level through DNA sequencing of the nuclear ribosomal internal transcribed spacer (<it>ITS</it>) region for use in BLAST-based similarity searches in the International Nucleotide Sequence Databases. These searches are time-consuming and regularly require a significant amount of manual intervention and complementary analyses. We here present software – in the form of an identification pipeline for large sets of fungal <it>ITS </it>sequences – developed to automate the BLAST process and several additional analysis steps. The performance of the pipeline was evaluated on a dataset of 350 <it>ITS </it>sequences from fungi growing as epiphytes on building material.</p> <p>Results</p> <p>The pipeline was written in Perl and uses a local installation of NCBI-BLAST for the similarity searches of the query sequences. The variable subregion <it>ITS2 </it>of the <it>ITS </it>region is extracted from the sequences and used for additional searches of higher sensitivity. Multiple alignments of each query sequence and its closest matches are computed, and query sequences sharing at least 50% of their best matches are clustered to facilitate the evaluation of hypothetically conspecific groups. The pipeline proved to speed up the processing, as well as enhance the resolution, of the evaluation dataset considerably, and the fungi were found to belong chiefly to the <it>Ascomycota</it>, with <it>Penicillium </it>and <it>Aspergillus </it>as the two most common genera. The <it>ITS2 </it>was found to indicate a different taxonomic affiliation than did the complete <it>ITS </it>region for 10% of the query sequences, though this figure is likely to vary with the taxonomic scope of the query sequences.</p> <p>Conclusion</p> <p>The present software readily assigns large sets of fungal query sequences to their respective best matches in the international sequence databases and places them in a larger biological context. The output is highly structured to be easy to process, although it still needs to be inspected and possibly corrected for the impact of the incomplete and sometimes erroneously annotated fungal entries in these databases. The open source pipeline is available for UNIX-type platforms, and updated releases of the target database are made available biweekly. The pipeline is easily modified to operate on other molecular regions and organism groups.</p

Deep Brain Stimulation of Nucleus Accumbens Region in Alcoholism Affects Reward Processing

The influence of bilateral deep brain stimulation (DBS) of the nucleus nucleus (NAcc) on the processing of reward in a gambling paradigm was investigated using H2[15O]-PET (positron emission tomography) in a 38-year-old man treated for severe alcohol addiction. Behavioral data analysis revealed a less risky, more careful choice behavior under active DBS compared to DBS switched off. PET showed win- and loss-related activations in the paracingulate cortex, temporal poles, precuneus and hippocampus under active DBS, brain areas that have been implicated in action monitoring and behavioral control. Except for the temporal pole these activations were not seen when DBS was deactivated. These findings suggest that DBS of the NAcc may act partially by improving behavioral control

Attenuation of N2 amplitude of laser-evoked potentials by theta burst stimulation of primary somatosensory cortex

Theta burst stimulation (TBS) is a special repetitive transcranial magnetic stimulation (rTMS) paradigm, where bursts of low-intensity stimuli are applied in the theta frequency. The aim of this study was to investigate the effect of neuronavigated TBS over primary somatosensory cortex (SI) on laser-evoked potentials (LEPs) and acute pain perception induced with Tm : YAG laser stimulation. The amplitude changes of the N1, N2, and P2 components of LEPs and related subjective pain rating scores of 12 healthy subjects were analyzed prior to and following continuous TBS (cTBS), intermittent TBS (iTBS), intermediate TBS (imTBS), and sham stimulation. Our results demonstrate that all active TBS paradigms significantly diminished the amplitude of the N2 component, when the hand contralateral to the site of TBS was laser-stimulated. Sham stimulation condition had no significant effect. The subjective pain perception also decreased during the experimental sessions, but did not differ significantly from the sham stimulation condition. The main finding of our study is that TBS over SI diminished the amplitude of the N2 component evoked from the contralateral side without any significant analgesic effects. Furthermore, imTBS produced responses similar to those observed by other forms of TBS induced excitability changes in the SI

Essential Noninvasive Multimodality Neuromonitoring for the Critically Ill Patient

This article is one of ten reviews selected from the Annual Update in Intensive Care and Emergency Medicine 2020. Other selected articles can be found online at . Further information about the Annual Update in Intensive Care and Emergency Medicine is available from