The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline

This crowdsourced project introduces a collaborative approach to improving the reproducibility of scientific research, in which findings are replicated in qualified independent laboratories before (rather than after) they are published. Our goal is to establish a non-adversarial replication process with highly informative final results. To illustrate the Pre-Publication Independent Replication (PPIR) approach, 25 research groups conducted replications of all ten moral judgment effects which the last author and his collaborators had “in the pipeline” as of August 2014. Six findings replicated according to all replication criteria, one finding replicated but with a significantly smaller effect size than the original, one finding replicated consistently in the original culture but not outside of it, and two findings failed to find support. In total, 40% of the original findings failed at least one major replication criterion. Potential ways to implement and incentivize pre-publication independent replication on a large scale are discussed

Data from a pre-publication independent replication initiative examining ten moral judgement effects

We present the data from a crowdsourced project seeking to replicate findings in independent laboratories before (rather than after) they are published. In this Pre-Publication Independent Replication (PPIR) initiative, 25 research groups attempted to replicate 10 moral judgment effects from a single laboratory's research pipeline of unpublished findings. The 10 effects were investigated using online/lab surveys containing psychological manipulations (vignettes) followed by questionnaires. Results revealed a mix of reliable, unreliable, and culturally moderated findings. Unlike any previous replication project, this dataset includes the data from not only the replications but also from the original studies, creating a unique corpus that researchers can use to better understand reproducibility and irreproducibility in science

Observation of WWWWWW Production in pppp Collisions at s\sqrt s =13 TeV with the ATLAS Detector

International audienceThis Letter reports the observation of $WWW$ production and a measurement of its cross section using 139 fb$^{-1}$ of proton-proton collision data recorded at a center-of-mass energy of 13 TeV by the ATLAS detector at the Large Hadron Collider. Events with two same-sign leptons (electrons or muons) and at least two jets, as well as events with three charged leptons, are selected. A multivariate technique is then used to discriminate between signal and background events. Events from $WWW$ production are observed with a significance of 8.0 standard deviations, where the expectation is 5.4 standard deviations. The inclusive $WWW$ production cross section is measured to be $820 \pm 100\,\text{(stat)} \pm 80\,\text{(syst)}$ fb, approximately 2.6 standard deviations from the predicted cross section of $511 \pm 18$ fb calculated at next-to-leading-order QCD and leading-order electroweak accuracy

Observation of WWWWWW Production in pppp Collisions at s\sqrt s =13 TeV with the ATLAS Detector

International audienceThis Letter reports the observation of $WWW$ production and a measurement of its cross section using 139 fb$^{-1}$ of proton-proton collision data recorded at a center-of-mass energy of 13 TeV by the ATLAS detector at the Large Hadron Collider. Events with two same-sign leptons (electrons or muons) and at least two jets, as well as events with three charged leptons, are selected. A multivariate technique is then used to discriminate between signal and background events. Events from $WWW$ production are observed with a significance of 8.0 standard deviations, where the expectation is 5.4 standard deviations. The inclusive $WWW$ production cross section is measured to be $820 \pm 100\,\text{(stat)} \pm 80\,\text{(syst)}$ fb, approximately 2.6 standard deviations from the predicted cross section of $511 \pm 18$ fb calculated at next-to-leading-order QCD and leading-order electroweak accuracy

Observation of WWWWWW Production in pppp Collisions at s\sqrt s =13 TeV with the ATLAS Detector

International audienceThis Letter reports the observation of $WWW$ production and a measurement of its cross section using 139 fb$^{-1}$ of proton-proton collision data recorded at a center-of-mass energy of 13 TeV by the ATLAS detector at the Large Hadron Collider. Events with two same-sign leptons (electrons or muons) and at least two jets, as well as events with three charged leptons, are selected. A multivariate technique is then used to discriminate between signal and background events. Events from $WWW$ production are observed with a significance of 8.0 standard deviations, where the expectation is 5.4 standard deviations. The inclusive $WWW$ production cross section is measured to be $820 \pm 100\,\text{(stat)} \pm 80\,\text{(syst)}$ fb, approximately 2.6 standard deviations from the predicted cross section of $511 \pm 18$ fb calculated at next-to-leading-order QCD and leading-order electroweak accuracy

Observation of WWWWWW Production in pppp Collisions at s\sqrt s =13 TeV with the ATLAS Detector

International audienceThis Letter reports the observation of $WWW$ production and a measurement of its cross section using 139 fb$^{-1}$ of proton-proton collision data recorded at a center-of-mass energy of 13 TeV by the ATLAS detector at the Large Hadron Collider. Events with two same-sign leptons (electrons or muons) and at least two jets, as well as events with three charged leptons, are selected. A multivariate technique is then used to discriminate between signal and background events. Events from $WWW$ production are observed with a significance of 8.0 standard deviations, where the expectation is 5.4 standard deviations. The inclusive $WWW$ production cross section is measured to be $820 \pm 100\,\text{(stat)} \pm 80\,\text{(syst)}$ fb, approximately 2.6 standard deviations from the predicted cross section of $511 \pm 18$ fb calculated at next-to-leading-order QCD and leading-order electroweak accuracy

Observation of WWWWWW Production in pppp Collisions at s\sqrt s =13 TeV with the ATLAS Detector

International audienceThis Letter reports the observation of $WWW$ production and a measurement of its cross section using 139 fb$^{-1}$ of proton-proton collision data recorded at a center-of-mass energy of 13 TeV by the ATLAS detector at the Large Hadron Collider. Events with two same-sign leptons (electrons or muons) and at least two jets, as well as events with three charged leptons, are selected. A multivariate technique is then used to discriminate between signal and background events. Events from $WWW$ production are observed with a significance of 8.0 standard deviations, where the expectation is 5.4 standard deviations. The inclusive $WWW$ production cross section is measured to be $820 \pm 100\,\text{(stat)} \pm 80\,\text{(syst)}$ fb, approximately 2.6 standard deviations from the predicted cross section of $511 \pm 18$ fb calculated at next-to-leading-order QCD and leading-order electroweak accuracy

Observation of WWWWWW Production in pppp Collisions at s\sqrt s =13 TeV with the ATLAS Detector

International audienceThis Letter reports the observation of $WWW$ production and a measurement of its cross section using 139 fb$^{-1}$ of proton-proton collision data recorded at a center-of-mass energy of 13 TeV by the ATLAS detector at the Large Hadron Collider. Events with two same-sign leptons (electrons or muons) and at least two jets, as well as events with three charged leptons, are selected. A multivariate technique is then used to discriminate between signal and background events. Events from $WWW$ production are observed with a significance of 8.0 standard deviations, where the expectation is 5.4 standard deviations. The inclusive $WWW$ production cross section is measured to be $820 \pm 100\,\text{(stat)} \pm 80\,\text{(syst)}$ fb, approximately 2.6 standard deviations from the predicted cross section of $511 \pm 18$ fb calculated at next-to-leading-order QCD and leading-order electroweak accuracy

Observation of WWW Production in pp Collisions at p=13 TeV with the ATLAS Detector ffi s

This Letter reports the observation of WWW production and a measurement of its cross section using 139  fb^{-1} of proton-proton collision data recorded at a center-of-mass energy of 13 TeV by the ATLAS detector at the Large Hadron Collider. Events with two same-sign leptons (electrons or muons) and at least two jets, as well as events with three charged leptons, are selected. A multivariate technique is then used to discriminate between signal and background events. Events from WWW production are observed with a significance of 8.0 standard deviations, where the expectation is 5.4 standard deviations. The inclusive WWW production cross section is measured to be 820±100 (stat)±80 (syst)  fb, approximately 2.6 standard deviations from the predicted cross section of 511±18  fb calculated at next-to-leading-order QCD and leading-order electroweak accuracy

Observation of WWWWWW Production in pppp Collisions at s\sqrt s =13 TeV with the ATLAS Detector

International audienceThis Letter reports the observation of $WWW$ production and a measurement of its cross section using 139 fb$^{-1}$ of proton-proton collision data recorded at a center-of-mass energy of 13 TeV by the ATLAS detector at the Large Hadron Collider. Events with two same-sign leptons (electrons or muons) and at least two jets, as well as events with three charged leptons, are selected. A multivariate technique is then used to discriminate between signal and background events. Events from $WWW$ production are observed with a significance of 8.0 standard deviations, where the expectation is 5.4 standard deviations. The inclusive $WWW$ production cross section is measured to be $820 \pm 100\,\text{(stat)} \pm 80\,\text{(syst)}$ fb, approximately 2.6 standard deviations from the predicted cross section of $511 \pm 18$ fb calculated at next-to-leading-order QCD and leading-order electroweak accuracy