Many Labs 2: Investigating Variation in Replicability Across Samples and Settings

We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,305 participants from 36 countries and territories. Using the conventional criterion of statistical significance (p < .05), we found that 15 (54%) of the replications provided evidence of a statistically significant effect in the same direction as the original finding. With a strict significance criterion (p < .0001), 14 (50%) of the replications still provided such evidence, a reflection of the extremely highpowered design. Seven (25%) of the replications yielded effect sizes larger than the original ones, and 21 (75%) yielded effect sizes smaller than the original ones. The median comparable Cohen’s ds were 0.60 for the original findings and 0.15 for the replications. The effect sizes were small (< 0.20) in 16 of the replications (57%), and 9 effects (32%) were in the direction opposite the direction of the original effect. Across settings, the Q statistic indicated significant heterogeneity in 11 (39%) of the replication effects, and most of those were among the findings with the largest overall effect sizes; only 1 effect that was near zero in the aggregate showed significant heterogeneity according to this measure. Only 1 effect had a tau value greater than .20, an indication of moderate heterogeneity. Eight others had tau values near or slightly above .10, an indication of slight heterogeneity. Moderation tests indicated that very little heterogeneity was attributable to the order in which the tasks were performed or whether the tasks were administered in lab versus online. Exploratory comparisons revealed little heterogeneity between Western, educated, industrialized, rich, and democratic (WEIRD) cultures and less WEIRD cultures (i.e., cultures with relatively high and low WEIRDness scores, respectively). Cumulatively, variability in the observed effect sizes was attributable more to the effect being studied than to the sample or setting in which it was studied.UCR::Vicerrectoría de Investigación::Unidades de Investigación::Ciencias Sociales::Instituto de Investigaciones Psicológicas (IIP

Many Labs 2: Investigating Variation in Replicability Across Samples and Settings

We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,305 participants from 36 countries and territories. Using the conventional criterion of statistical significance (p &lt; .05), we found that 15 (54%) of the replications provided evidence of a statistically significant effect in the same direction as the original finding. With a strict significance criterion (p &lt; .0001), 14 (50%) of the replications still provided such evidence, a reflection of the extremely high-powered design. Seven (25%) of the replications yielded effect sizes larger than the original ones, and 21 (75%) yielded effect sizes smaller than the original ones. The median comparable Cohen’s ds were 0.60 for the original findings and 0.15 for the replications. The effect sizes were small (&lt; 0.20) in 16 of the replications (57%), and 9 effects (32%) were in the direction opposite the direction of the original effect. Across settings, the Q statistic indicated significant heterogeneity in 11 (39%) of the replication effects, and most of those were among the findings with the largest overall effect sizes; only 1 effect that was near zero in the aggregate showed significant heterogeneity according to this measure. Only 1 effect had a tau value greater than .20, an indication of moderate heterogeneity. Eight others had tau values near or slightly above .10, an indication of slight heterogeneity. Moderation tests indicated that very little heterogeneity was attributable to the order in which the tasks were performed or whether the tasks were administered in lab versus online. Exploratory comparisons revealed little heterogeneity between Western, educated, industrialized, rich, and democratic (WEIRD) cultures and less WEIRD cultures (i.e., cultures with relatively high and low WEIRDness scores, respectively). Cumulatively, variability in the observed effect sizes was attributable more to the effect being studied than to the sample or setting in which it was studied

Many Labs 2: Investigating Variation in Replicability Across Samples and Settings

We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,305 participants from 36 countries and territories. Using the conventional criterion of statistical significance (p &lt; .05), we found that 15 (54%) of the replications provided evidence of a statistically significant effect in the same direction as the original finding. With a strict significance criterion (p &lt; .0001), 14 (50%) of the replications still provided such evidence, a reflection of the extremely high-powered design. Seven (25%) of the replications yielded effect sizes larger than the original ones, and 21 (75%) yielded effect sizes smaller than the original ones. The median comparable Cohen’s ds were 0.60 for the original findings and 0.15 for the replications. The effect sizes were small (&lt; 0.20) in 16 of the replications (57%), and 9 effects (32%) were in the direction opposite the direction of the original effect. Across settings, the Q statistic indicated significant heterogeneity in 11 (39%) of the replication effects, and most of those were among the findings with the largest overall effect sizes; only 1 effect that was near zero in the aggregate showed significant heterogeneity according to this measure. Only 1 effect had a tau value greater than .20, an indication of moderate heterogeneity. Eight others had tau values near or slightly above .10, an indication of slight heterogeneity. Moderation tests indicated that very little heterogeneity was attributable to the order in which the tasks were performed or whether the tasks were administered in lab versus online. Exploratory comparisons revealed little heterogeneity between Western, educated, industrialized, rich, and democratic (WEIRD) cultures and less WEIRD cultures (i.e., cultures with relatively high and low WEIRDness scores, respectively). Cumulatively, variability in the observed effect sizes was attributable more to the effect being studied than to the sample or setting in which it was studied

Search for heavy Majorana neutrinos in e±e±\mathrm{ e^\pm e^\pm }+ jets and e±μ±\mathrm{ e^\pm \mu^\pm }+ jets events in proton-proton collisions at s=\sqrt{s} = 8 TeV

A search is performed for heavy Majorana neutrinos (N) decaying into a W boson and a lepton using the CMS detector at the Large Hadron Collider. A signature of two jets and either two same sign electrons or a same sign electron-muon pair is searched for using 19.7 fb$^{-1}$ of data collected during 2012 in proton-proton collisions at a centre-of-mass energy of 8 TeV. The data are found to be consistent with the expected standard model (SM) background and, in the context of a Type-1 seesaw mechanism, upper limits are set on the cross section times branching fraction for production of heavy Majorana neutrinos in the mass range between 40 and 500 GeV. The results are additionally interpreted as limits on the mixing between the heavy Majorana neutrinos and the SM neutrinos. In the mass range considered, the upper limits range between 0.00015-0.72 for $| \mathrm{V_{eN}} |^2$ and 6.6 $\times$ 10$^{-5}$-0.47 for $| \mathrm{V_{eN}} \mathrm{V^{*}_{\mu N}} |^2 / ( | \mathrm{V_{eN}} |^2 + | \mathrm{V_{\mu N}} |^2 )$, where $\mathrm{V_{\ell N}}$ is the mixing element describing the mixing of the heavy neutrino with the SM neutrino of flavour $\ell$. These limits are the most restrictive direct limits for heavy Majorana neutrino masses above 200 GeV.A search is performed for heavy Majorana neutrinos (N) decaying into a W boson and a lepton using the CMS detector at the Large Hadron Collider. A signature of two jets and either two same sign electrons or a same sign electron-muon pair is searched for using 19.7 fb$^{−1}$ of data collected during 2012 in proton-proton collisions at a centre-of-mass energy of 8 TeV. The data are found to be consistent with the expected standard model (SM) background and, in the context of a Type-1 seesaw mechanism, upper limits are set on the cross section times branching fraction for production of heavy Majorana neutrinos in the mass range between 40 and 500 GeV. The results are additionally interpreted as limits on the mixing between the heavy Majorana neutrinos and the SM neutrinos. In the mass range considered, the upper limits range between 0.00015–0.72 for |V$_{eN}$|$^{2}$ and 6.6 × 10$^{−5}$−0.47 for |V$_{eN}$ V$_{μN}^{∗}$ |$^{2}$/(|V$_{eN}$|$^{2}$ + |V$_{μN}$|$^{2}$), where V$_{ℓN}$ is the mixing element describing the mixing of the heavy neutrino with the SM neutrino of flavour ℓ. These limits are the most restrictive direct limits for heavy Majorana neutrino masses above 200 GeV.A search is performed for heavy Majorana neutrinos (N) decaying into a W boson and a lepton using the CMS detector at the Large Hadron Collider. A signature of two jets and either two same sign electrons or a same sign electron-muon pair is searched for using 19.7 inverse femtobarns of data collected during 2012 in proton-proton collisions at a centre-of-mass energy of 8 TeV. The data are found to be consistent with the expected standard model (SM) background and, in the context of a Type-1 seesaw mechanism, upper limits are set on the cross section times branching fraction for production of heavy Majorana neutrinos in the mass range between 40 and 500 GeV. The results are additionally interpreted as limits on the mixing between the heavy Majorana neutrinos and the SM neutrinos. In the mass range considered, the upper limits range between 0.00015 - 0.72 for |V[eN]|^2 and 6.6E-5 - 0.47 for |V[eN] V*[muN]|^2 / ( |V[eN]|^2 + |V[muN]|^2 ), where V[lN] is the mixing element describing the mixing of the heavy neutrino with the SM neutrino of flavour l. These limits are the most restrictive direct limits for heavy Majorana neutrino masses above 200 GeV

Search for heavy Majorana neutrinos in e±^{±}e±^{±}+ jets and e±^{±} μ±\mu^{±}+ jets events in proton-proton collisions at s=8 \sqrt{s}=8 TeV

A search is performed for heavy Majorana neutrinos (N) decaying into a W boson and a lepton using the CMS detector at the Large Hadron Collider. A signature of two jets and either two same sign electrons or a same sign electron-muon pair is searched for using 19.7 fb$^{−1}$ of data collected during 2012 in proton-proton collisions at a centre-of-mass energy of 8 TeV. The data are found to be consistent with the expected standard model (SM) background and, in the context of a Type-1 seesaw mechanism, upper limits are set on the cross section times branching fraction for production of heavy Majorana neutrinos in the mass range between 40 and 500 GeV. The results are additionally interpreted as limits on the mixing between the heavy Majorana neutrinos and the SM neutrinos. In the mass range considered, the upper limits range between 0.00015–0.72 for |V$_{eN}$|$^{2}$ and 6.6 × 10$^{−5}$−0.47 for |V$_{eN}$ V$_{μN}^{∗}$ |$^{2}$/(|V$_{eN}$|$^{2}$ + |V$_{μN}$|$^{2}$), where V$_{ℓN}$ is the mixing element describing the mixing of the heavy neutrino with the SM neutrino of flavour ℓ. These limits are the most restrictive direct limits for heavy Majorana neutrino masses above 200 GeV

Search for lepton flavour violating decays of heavy resonances and quantum black holes to an e-mu pair in proton-proton collisions at sqrt(s) = 8 TeV

A search for narrow resonances decaying to an electron and a muon is presented. The e-mu mass spectrum is also investigated for non-resonant contributions from the production of quantum black holes (QBHs). The analysis is performed using data corresponding to an integrated luminosity of 19.7 inverse-femtobarns collected in proton-proton collisions at a centre-of-mass energy of 8 TeV with the CMS detector at the LHC. With no evidence for physics beyond the standard model in the invariant mass spectrum of selected e-mu pairs, upper limits are set at 95% confidence level on the product of cross section and branching fraction for signals arising in theories with charged lepton flavour violation. In the search for narrow resonances, the resonant production of a tau sneutrino in R-parity violating supersymmetry is considered. The tau sneutrino is excluded for masses below 1.28 TeV for couplings lambda[132] = lambda[231] = lambda'[311] = 0.01, and below 2.30 TeV for lambda[132] = lambda[231] = 0.07 and lambda'[311] = 0.11. These are the most stringent limits to date from direct searches at high-energy colliders. In addition, the resonance searches are interpreted in terms of a model with heavy partners of the Z boson and the photon. In a framework of TeV-scale quantum gravity based on a renormalization of Newton's constant, the search for non-resonant contributions to the e-mu mass spectrum excludes QBH production below a threshold mass M[th] of 1.99 TeV. In models that invoke extra dimensions, the bounds range from 2.36 TeV for one extra dimension to 3.63 TeV for six extra dimensions. This is the first search for QBHs decaying into the e-mu final state