Variability in the analysis of a single neuroimaging dataset by many teams

Data analysis workflows in many scientific domains have become increasingly complex and flexible. To assess the impact of this flexibility on functional magnetic resonance imaging (fMRI) results, the same dataset was independently analyzed by 70 teams, testing nine ex-ante hypotheses. The flexibility of analytic approaches is exemplified by the fact that no two teams chose identical workflows to analyze the data. This flexibility resulted in sizeable variation in hypothesis test results, even for teams whose statistical maps were highly correlated at intermediate stages of their analysis pipeline. Variation in reported results was related to several aspects of analysis methodology. Importantly, meta-analytic approaches that aggregated information across teams yielded significant consensus in activated regions across teams. Furthermore, prediction markets of researchers in the field revealed an overestimation of the likelihood of significant findings, even by researchers with direct knowledge of the dataset. Our findings show that analytic flexibility can have substantial effects on scientific conclusions, and demonstrate factors related to variability in fMRI. The results emphasize the importance of validating and sharing complex analysis workflows, and demonstrate the need for multiple analyses of the same data. Potential approaches to mitigate issues related to analytical variability are discussed

Variability in the analysis of a single neuroimaging dataset by many teams

Data analysis workflows in many scientific domains have become increasingly complex and flexible. To assess the impact of this flexibility on functional magnetic resonance imaging (fMRI) results, the same dataset was independently analyzed by 70 teams, testing nine ex-ante hypotheses. The flexibility of analytic approaches is exemplified by the fact that no two teams chose identical workflows to analyze the data. This flexibility resulted in sizeable variation in hypothesis test results, even for teams whose statistical maps were highly correlated at intermediate stages of their analysis pipeline. Variation in reported results was related to several aspects of analysis methodology. Importantly, meta-analytic approaches that aggregated information across teams yielded significant consensus in activated regions across teams. Furthermore, prediction markets of researchers in the field revealed an overestimation of the likelihood of significant findings, even by researchers with direct knowledge of the dataset. Our findings show that analytic flexibility can have substantial effects on scientific conclusions, and demonstrate factors related to variability in fMRI. The results emphasize the importance of validating and sharing complex analysis workflows, and demonstrate the need for multiple analyses of the same data. Potential approaches to mitigate issues related to analytical variability are discussed

Decision-Making with Naturalistic Options

How do humans generalise to make better decisions? Previous work has investigated this question using reward-guided decision-making tasks with low-dimensional and artificial stimuli. In this paper, we extend this work by presenting participants with a naturalistic decision-making task, in which options were images of real-world objects and the underlying reward function was based on one of their latent dimensions. Even though participants received no explicit instruction about object features, they quickly learned to do the task and generalised to unseen objects. To understand how they accomplished this, we tested a range of computational models and found that human behaviour is overall best explained by a linear model but that participants’ strategies changed during the experiment. Lastly, we showed that combining pixel-based representations extracted from convolutional neural networks with the original latent dimensions further improved our models. Taken together, our study offers new insights into human decision making under naturalistic settings

Acute psychosocial stress alters thalamic network centrality

Acute stress triggers a broad psychophysiological response that is adaptive if rapidly activated and terminated. While the brain controls the stress response, it is strongly affected by it. Previous research of stress effects on brain activation and connectivity has mainly focused on pre-defined brain regions or networks, potentially missing changes in the rest of the brain. We here investigated how both stress reactivity and stress recovery are reflected in whole-brain network topology and how changes in functional connectivity relate to other stress measures. Healthy young males (n = 67) completed the Trier Social Stress Test or a control task. From 60 min before until 105 min after stress onset, blocks of resting-state fMRI were acquired. Subjective, autonomic, and endocrine measures of the stress response were assessed throughout the experiment. Whole-brain network topology was quantified using Eigenvector centrality (EC) mapping, which detects central hubs of a network. Stress influenced subjective affect, autonomic activity, and endocrine measures. EC differences between groups as well as before and after stress exposure were found in the thalamus, due to widespread connectivity changes in the brain. Stress-driven EC increases in the thalamus were significantly correlated with subjective stress ratings and showed non-significant trends for a correlation with heart rate variability and saliva cortisol. Furthermore, increases in thalamic EC and in saliva cortisol persisted until 105 min after stress onset. We conclude that thalamic areas are central for information processing after stress exposure and may provide an interface for the stress response in the rest of the body and in the mind

A functional connectome phenotyping dataset including cognitive state and personality measures

The dataset enables exploration of higher-order cognitive faculties, self-generated mental experience, and personality features in relation to the intrinsic functional architecture of the brain. We provide multimodal magnetic resonance imaging (MRI) data and a broad set of state and trait phenotypic assessments: mind-wandering, personality traits, and cognitive abilities. Specifically, 194 healthy participants (between 20 and 75 years of age) filled out 31 questionnaires, performed 7 tasks, and reported 4 probes of in-scanner mind-wandering. The scanning session included four 15.5-min resting-state functional MRI runs using a multiband EPI sequence and a hig h-resolution structural scan using a 3D MP2RAGE sequence. This dataset constitutes one part of the MPI-Leipzig Mind-Brain-Body database