Variability in the analysis of a single neuroimaging dataset by many teams

Data analysis workflows in many scientific domains have become increasingly complex and flexible. To assess the impact of this flexibility on functional magnetic resonance imaging (fMRI) results, the same dataset was independently analyzed by 70 teams, testing nine ex-ante hypotheses. The flexibility of analytic approaches is exemplified by the fact that no two teams chose identical workflows to analyze the data. This flexibility resulted in sizeable variation in hypothesis test results, even for teams whose statistical maps were highly correlated at intermediate stages of their analysis pipeline. Variation in reported results was related to several aspects of analysis methodology. Importantly, meta-analytic approaches that aggregated information across teams yielded significant consensus in activated regions across teams. Furthermore, prediction markets of researchers in the field revealed an overestimation of the likelihood of significant findings, even by researchers with direct knowledge of the dataset. Our findings show that analytic flexibility can have substantial effects on scientific conclusions, and demonstrate factors related to variability in fMRI. The results emphasize the importance of validating and sharing complex analysis workflows, and demonstrate the need for multiple analyses of the same data. Potential approaches to mitigate issues related to analytical variability are discussed

Variability in the analysis of a single neuroimaging dataset by many teams

Data analysis workflows in many scientific domains have become increasingly complex and flexible. To assess the impact of this flexibility on functional magnetic resonance imaging (fMRI) results, the same dataset was independently analyzed by 70 teams, testing nine ex-ante hypotheses. The flexibility of analytic approaches is exemplified by the fact that no two teams chose identical workflows to analyze the data. This flexibility resulted in sizeable variation in hypothesis test results, even for teams whose statistical maps were highly correlated at intermediate stages of their analysis pipeline. Variation in reported results was related to several aspects of analysis methodology. Importantly, meta-analytic approaches that aggregated information across teams yielded significant consensus in activated regions across teams. Furthermore, prediction markets of researchers in the field revealed an overestimation of the likelihood of significant findings, even by researchers with direct knowledge of the dataset. Our findings show that analytic flexibility can have substantial effects on scientific conclusions, and demonstrate factors related to variability in fMRI. The results emphasize the importance of validating and sharing complex analysis workflows, and demonstrate the need for multiple analyses of the same data. Potential approaches to mitigate issues related to analytical variability are discussed

Inhalation of the BK(Ca)-opener NS1619 attenuates right ventricular pressure and improves oxygenation in the rat monocrotaline model of pulmonary hypertension

Background: Right heart failure is a fatal consequence of chronic pulmonary hypertension (PH). The development of PH is characterized by increased proliferation of vascular cells, in particular pulmonary artery smooth muscle cells (PASMCs) and pulmonary artery endothelial cells. In the course of PH, an escalated right ventricular (RV) afterload occurs, which leads to increased perioperative morbidity and mortality. BKCa channels are ubiquitously expressed in vascular smooth muscle cells and their opening induces cell membrane hyperpolarization followed by vasodilation. Moreover, BK activation induces anti-proliferative effects in a multitude of cell types. On this basis, we hypothesized that treatment with the nebulized BK channel opener NS1619 might be a therapy option for pulmonary hypertension and tested this in rats. Methods: (1) Rats received monocrotaline injection for PH induction. Twenty-four days later, rats were anesthetized and NS1619 or the solvent was administered by inhalation. Systemic hemodynamic parameters, RV hemodynamic parameters, and blood gas analyses were measured before as well as 30 and 120 minutes after inhalation. (2) Rat PASMCs were stimulated with PDGF-BB in the presence and absence of NS1619. AKT, ERK1 and ERK2 activation were investigated by western blot analyses, and relative cell number was determined 48 hours after stimulation. Results: Inhalation of a 12 µM and 100 µM NS1619 solution significantly reduced RV pressure without affecting systemic arterial pressure. Blood gas analyses demonstrated significantly reduced carbon dioxide and improved oxygenation in NS1619-treated animals pointing towards a considerable pulmonary shunt-reducing effect. In PASMC’s, NS1619 (100 µM) significantly attenuated PASMC proliferation by a pathway independent of AKT and ERK1/2 activation. Conclusion: NS1619 inhalation reduces RV pressure and improves oxygen supply and its application inhibits PASMC proliferation in vitro. Hence, BK opening might be a novel option for the treatment of pulmonary hypertension