Variability in the analysis of a single neuroimaging dataset by many teams

Data analysis workflows in many scientific domains have become increasingly complex and flexible. To assess the impact of this flexibility on functional magnetic resonance imaging (fMRI) results, the same dataset was independently analyzed by 70 teams, testing nine ex-ante 1 hypotheses . The flexibility of analytic approaches is exemplified by the fact that no two teams chose identical workflows to analyze the data. This flexibility resulted in sizeable variation in hypothesis test results, even for teams whose statistical maps were highly correlated at intermediate stages of their analysis pipeline. Variation in reported results was related to several aspects of analysis methodology. Importantly, a meta-analytic approach that aggregated information across teams yielded significant consensus in activated regions across teams. Furthermore, prediction markets of researchers in the field revealed an overestimation of the likelihood of significant findings, even by researchers with direct knowledge of the dataset findings show that analytic flexibility can have substantial effects on scientific conclusions, and demonstrate factors possibly related to variability in fMRI. The results emphasize the importance of validating and sharing complex analysis workflows, and demonstrate the need for multiple analyses of the same data. Potential approaches to mitigate issues related to analytical variability are discusse

Decreasing Ventromedial Prefrontal Cortex Activity During Sequential Risk-Taking: An fMRI Investigation of the Balloon Analog Risk Task

Functional imaging studies examining the neural correlates of risk have mainly relied on paradigms involving exposure to simple chance gambles and an economic definition of risk as variance in the probability distribution over possible outcomes. However, there is little evidence that choices made during gambling tasks predict naturalistic risk-taking behaviors such as drug use, extreme sports, or even equity investing. To better understand the neural basis of naturalistic risk-taking, we scanned participants using fMRI while they completed the Balloon Analog Risk Task, an experimental measure that includes an active decision/choice component and that has been found to correlate with a number of naturalistic risk-taking behaviors. In the task, as in many naturalistic settings, escalating risk-taking occurs under uncertainty and might be experienced either as the accumulation of greater potential rewards, or as exposure to increasing possible losses (and decreasing expected value). We found that areas previously linked to risk and risk-taking (bilateral anterior insula, anterior cingulate cortex, and right dorsolateral prefrontal cortex) were activated as participants continued to inflate balloons. Interestingly, we found that ventromedial prefrontal cortex (vmPFC) activity decreased as participants further expanded balloons. In light of previous findings implicating the vmPFC in value calculation, this result suggests that escalating risk-taking in the task might be perceived as exposure to increasing possible losses (and decreasing expected value) rather than the increasing potential total reward relative to the starting point of the trial. A better understanding of how neural activity changes with risk-taking behavior in the task offers insight into the potential neural mechanisms driving naturalistic risk-taking

Brain volumetric changes in the general population following the COVID-19 outbreak and lockdown

The coronavirus disease 2019 (COVID-19) outbreak introduced unprecedented health-risks, as well as pressure on the economy, society, and psychological well-being due to the response to the outbreak. In a preregistered study, we hypothesized that the intense experience of the outbreak potentially induced stress-related brain modifications in the healthy population, not infected with the virus. We examined volumetric changes in 50 participants who underwent MRI scans before and after the COVID-19 outbreak and lockdown in Israel. Their scans were compared with those of 50 control participants who were scanned twice prior to the pandemic. Following COVID-19 outbreak and lockdown, the test group participants uniquely showed volumetric increases in bilateral amygdalae, putamen, and the anterior temporal cortices. Changes in the amygdalae diminished as time elapsed from lockdown relief, suggesting that the intense experience associated with the pandemic induced transient volumetric changes in brain regions commonly associated with stress and anxiety. The current work utilizes a rare opportunity for real-life natural experiment, showing evidence for brain plasticity following the COVID-19 global pandemic. These findings have broad implications, relevant both for the scientific community as well as the general public

Determining the effects of training duration on the behavioral expression of habitual control in humans: a multi-laboratory investigation

It has been suggested that there are two distinct and parallel mechanisms for controlling instrumental behavior in mammals: goal-directed actions and habits. To gain an understanding of how these two systems interact to control behavior, it is essential to characterize the mechanisms by which the balance between these systems is influenced by experience. Studies in rodents have shown that the amount of training governs the relative expression of these two systems: behavior is goal-directed following moderate training, but the more extensively an instrumental action is trained, the more it becomes habitual. It is less clear whether humans exhibit similar training effects on the expression of goal-directed and habitual behavior, as human studies have reported contradictory findings. To tackle these contradictory findings, we formed a consortium, where four laboratories undertook a pre-registered experimental induction of habits by manipulating the amount of training. There was no statistical evidence for a main effect of the amount of training on the formation and expression of habits. However, exploratory analyses suggest a moderating effect of the affective component of stress on the impact of training over habit expression. Participants who were lower in affective stress appeared to be initially goal-directed, but became habitual with increased training, whereas participants who were high in affective stress were already habitual even after moderate training, thereby manifesting insensitivity to overtraining effects. Our findings highlight the importance of the role of moderating variables such as individual differences in stress and anxiety when studying the experimental induction of habits in humans

Variability in the analysis of a single neuroimaging dataset by many teams

Data analysis workflows in many scientific domains have become increasingly complex and flexible. To assess the impact of this flexibility on functional magnetic resonance imaging (fMRI) results, the same dataset was independently analyzed by 70 teams, testing nine ex-ante hypotheses1. The flexibility of analytic approaches is exemplified by the fact that no two teams chose identical workflows to analyze the data. This flexibility resulted in sizeable variation in hypothesis test results, even for teams whose statistical maps were highly correlated at intermediate stages of their analysis pipeline. Variation in reported results was related to several aspects of analysis methodology. Importantly, a meta-analytic approach that aggregated information across teams yielded significant consensus in activated regions across teams. Furthermore, prediction markets of researchers in the field revealed an overestimation of the likelihood of significant findings, even by researchers with direct knowledge of the dataset2-5. Our findings show that analytic flexibility can have substantial effects on scientific conclusions, and demonstrate factors possibly related to variability in fMRI. The results emphasize the importance of validating and sharing complex analysis workflows, and demonstrate the need for multiple analyses of the same data. Potential approaches to mitigate issues related to analytical variability are discussed

Consensus-based guidance for conducting and reporting multi-analyst studies

International audienceAny large dataset can be analyzed in a number of ways, and it is possible that the use of different analysis strategies will lead to different results and conclusions. One way to assess whether the results obtained depend on the analysis strategy chosen is to employ multiple analysts and leave each of them free to follow their own approach. Here, we present consensus-based guidance for conducting and reporting such multi-analyst studies, and we discuss how broader adoption of the multi-analyst approach has the potential to strengthen the robustness of results and conclusions obtained from analyses of datasets in basic and applied research

Genotype-Phenotype Correlation in NF1: Evidence for a More Severe Phenotype Associated with Missense Mutations Affecting NF1 Codons 844–848

Neurofibromatosis type 1 (NF1), a common genetic disorder with a birth incidence of 1:2,000–3,000, is characterized by a highly variable clinical presentation. To date, only two clinically relevant intragenic genotype-phenotype correlations have been reported for NF1 missense mutations affecting p.Arg1809 and a single amino acid deletion p.Met922del. Both variants predispose to a distinct mild NF1 phenotype with neither externally visible cutaneous/plexiform neurofibromas nor other tumors. Here, we report 162 individuals (129 unrelated probands and 33 affected relatives) heterozygous for a constitutional missense mutation affecting one of five neighboring NF1 codons—Leu844, Cys845, Ala846, Leu847, and Gly848—located in the cysteine-serine-rich domain (CSRD). Collectively, these recurrent missense mutations affect ∼0.8% of unrelated NF1 mutation-positive probands in the University of Alabama at Birmingham (UAB) cohort. Major superficial plexiform neurofibromas and symptomatic spinal neurofibromas were more prevalent in these individuals compared with classic NF1-affected cohorts (both p < 0.0001). Nearly half of the individuals had symptomatic or asymptomatic optic pathway gliomas and/or skeletal abnormalities. Additionally, variants in this region seem to confer a high predisposition to develop malignancies compared with the general NF1-affected population (p = 0.0061). Our results demonstrate that these NF1 missense mutations, although located outside the GAP-related domain, may be an important risk factor for a severe presentation. A genotype-phenotype correlation at the NF1 region 844–848 exists and will be valuable in the management and genetic counseling of a significant number of individuals

Distribution and Genetic Profiles of Campylobacter in Commercial Broiler Production from Breeder to Slaughter in Thailand

Poultry and poultry products are commonly considered as the major vehicle of Campylobacter infection in humans worldwide. To reduce the number of human cases, the epidemiology of Campylobacter in poultry must be better understood. Therefore, the objective of the present study was to determine the distribution and genetic relatedness of Campylobacter in the Thai chicken production industry. During June to October 2012, entire broiler production processes (i.e., breeder flock, hatchery, broiler farm and slaughterhouse) of five broiler production chains were investigated chronologically. Representative isolates of C. jejuni from each production stage were characterized by flaA SVR sequencing and multilocus sequence typing (MLST). Amongst 311 selected isolates, 29 flaA SVR alleles and 17 sequence types (STs) were identified. The common clonal complexes (CCs) found in this study were CC-45, CC-353, CC-354 and CC-574. C. jejuni isolated from breeders were distantly related to those isolated from broilers and chicken carcasses, while C. jejuni isolates from the slaughterhouse environment and meat products were similar to those isolated from broiler flocks. Genotypic identification of C. jejuni in slaughterhouses indicated that broilers were the main source of Campylobacter contamination of chicken meat during processing. To effectively reduce Campylobacter in poultry meat products, control and prevention strategies should be aimed at both farm and slaughterhouse levels