Variability in the analysis of a single neuroimaging dataset by many teams

Data analysis workflows in many scientific domains have become increasingly complex and flexible. To assess the impact of this flexibility on functional magnetic resonance imaging (fMRI) results, the same dataset was independently analyzed by 70 teams, testing nine ex-ante hypotheses. The flexibility of analytic approaches is exemplified by the fact that no two teams chose identical workflows to analyze the data. This flexibility resulted in sizeable variation in hypothesis test results, even for teams whose statistical maps were highly correlated at intermediate stages of their analysis pipeline. Variation in reported results was related to several aspects of analysis methodology. Importantly, meta-analytic approaches that aggregated information across teams yielded significant consensus in activated regions across teams. Furthermore, prediction markets of researchers in the field revealed an overestimation of the likelihood of significant findings, even by researchers with direct knowledge of the dataset. Our findings show that analytic flexibility can have substantial effects on scientific conclusions, and demonstrate factors related to variability in fMRI. The results emphasize the importance of validating and sharing complex analysis workflows, and demonstrate the need for multiple analyses of the same data. Potential approaches to mitigate issues related to analytical variability are discussed

Variability in the analysis of a single neuroimaging dataset by many teams

Data analysis workflows in many scientific domains have become increasingly complex and flexible. To assess the impact of this flexibility on functional magnetic resonance imaging (fMRI) results, the same dataset was independently analyzed by 70 teams, testing nine ex-ante hypotheses. The flexibility of analytic approaches is exemplified by the fact that no two teams chose identical workflows to analyze the data. This flexibility resulted in sizeable variation in hypothesis test results, even for teams whose statistical maps were highly correlated at intermediate stages of their analysis pipeline. Variation in reported results was related to several aspects of analysis methodology. Importantly, meta-analytic approaches that aggregated information across teams yielded significant consensus in activated regions across teams. Furthermore, prediction markets of researchers in the field revealed an overestimation of the likelihood of significant findings, even by researchers with direct knowledge of the dataset. Our findings show that analytic flexibility can have substantial effects on scientific conclusions, and demonstrate factors related to variability in fMRI. The results emphasize the importance of validating and sharing complex analysis workflows, and demonstrate the need for multiple analyses of the same data. Potential approaches to mitigate issues related to analytical variability are discussed

Genetic factors influencing a neurobiological substrate for psychiatric disorders

A retrospective meta-analysis of magnetic resonance imaging voxel-based morphometry studies proposed that reduced gray matter volumes in the dorsal anterior cingulate and the left and right anterior insular cortex-areas that constitute hub nodes of the salience network-represent a common substrate for major psychiatric disorders. Here, we investigated the hypothesis that the common substrate serves as an intermediate phenotype to detect genetic risk variants relevant for psychiatric disease. To this end, after a data reduction step, we conducted genome-wide association studies of a combined common substrate measure in four population-based cohorts (n = 2271), followed by meta-analysis and replication in a fifth cohort (n = 865). After correction for covariates, the heritability of the common substrate was estimated at 0.50 (standard error 0.18). The top single-nucleotide polymorphism (SNP) rs17076061 was associated with the common substrate at genome-wide significance and replicated, explaining 1.2% of the common substrate variance. This SNP mapped to a locus on chromosome 5q35.2 harboring genes involved in neuronal development and regeneration. In follow-up analyses, rs17076061 was not robustly associated with psychiatric disease, and no overlap was found between the broader genetic architecture of the common substrate and genetic risk for major depressive disorder, bipolar disorder, or schizophrenia. In conclusion, our study identified that common genetic variation indeed influences the common substrate, but that these variants do not directly translate to increased disease risk. Future studies should investigate gene-by-environment interactions and employ functional imaging to understand how salience network structure translates to psychiatric disorder risk

Neural Adaptations Associated with Interlimb Transfer in a Ballistic Wrist Flexion Task

Cross education is the process whereby training of one limb gives rise to increases in the subsequent performance of its opposite counterpart. The execution of many unilateral tasks is associated with increased excitability of corticospinal projections from primary motor cortex (M1) to the opposite limb. It has been proposed that these effects are causally related. Our aim was to establish whether changes in corticospinal excitability (CSE) arising from prior training of the opposite limb determine levels of interlimb transfer. We used three vision conditions shown previously to modulate the excitability of corticospinal projections to the inactive (right) limb during wrist flexion movements performed by the training (left) limb. These were: (1) mirrored visual feedback of the training limb; (2) no visual feedback of either limb; and (3) visual feedback of the inactive limb. Training comprised 300 discrete, ballistic wrist flexion movements executed as rapidly as possible. Performance of the right limb on the same task was assessed prior to, at the mid point of, and following left limb training. There was no evidence that variations in the excitability of corticospinal projections (assessed by transcranial magnetic stimulation (TMS)) to the inactive limb were associated with, or predictive of, the extent of interlimb transfer that was expressed. There were however associations between alterations in muscle activation dynamics observed for the untrained limb, and the degree of positive transfer that arose from training of the opposite limb. The results suggest that the acute adaptations that mediate the bilateral performance gains realized through unilateral practice of this ballistic wrist flexion task are mediated by neural elements other than those within M1 that are recruited at rest by single-pulse TMS

Impact of ageing on motor control networks underlying movement selection and initiation

Available online, Journal of Clinical Neurophysiology, Abstractband, P10

Network connectivity of motor control in the ageing brain

Older individuals typically display stronger regional brain activity than younger subjects during motor performance. However, knowledge regarding age-related changes of motor network interactions between brain regions remains scarce. We here investigated the impact of ageing on the interaction of cortical areas during movement selection and initiation using dynamic causal modelling (DCM). We found that age-related psychomotor slowing was accompanied by increases in both regional activity and effective connectivity, especially for ‘core’ motor coupling targeting primary motor cortex (M1). Interestingly, younger participants within the older group showed strongest connectivity targeting M1, which steadily decreased with advancing age. Conversely, prefrontal influences on the motor system increased with advancing age, and were inversely correlated with reduced parietal influences and core motor coupling. Interestingly, higher net coupling within the prefrontal-premotor-M1 axis predicted faster psychomotor speed in ageing. Hence, as opposed to a uniform age-related decline, our findings are compatible with the idea of different age-related compensatory mechanisms, with an important role of the prefrontal cortex compensating for reduced coupling within the core motor network