The pipeline project:Pre-publication independent replications of a single laboratory's research pipeline

This crowdsourced project introduces a collaborative approach to improving the reproducibility of scientific research, in which findings are replicated in qualified independent laboratories before (rather than after) they are published. Our goal is to establish a non-adversarial replication process with highly informative final results. To illustrate the Pre-Publication Independent Replication (PPIR) approach, 25 research groups conducted replications of all ten moral judgment effects which the last author and his collaborators had "in the pipeline" as of August 2014. Six findings replicated according to all replication criteria, one finding replicated but with a significantly smaller effect size than the original, one finding replicated consistently in the original culture but not outside of it, and two findings failed to find support. In total, 40% of the original findings failed at least one major replication criterion. Potential ways to implement and incentivize pre-publication independent replication on a large scale are discussed. (C) 2015 The Authors. Published by Elsevier Inc.</p

The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline

This crowdsourced project introduces a collaborative approach to improving the reproducibility of scientific research, in which findings are replicated in qualified independent laboratories before (rather than after) they are published. Our goal is to establish a non-adversarial replication process with highly informative final results. To illustrate the Pre-Publication Independent Replication (PPIR) approach, 25 research groups conducted replications of all ten moral judgment effects which the last author and his collaborators had “in the pipeline” as of August 2014. Six findings replicated according to all replication criteria, one finding replicated but with a significantly smaller effect size than the original, one finding replicated consistently in the original culture but not outside of it, and two findings failed to find support. In total, 40% of the original findings failed at least one major replication criterion. Potential ways to implement and incentivize pre-publication independent replication on a large scale are discussed

Data from a pre-publication independent replication initiative examining ten moral judgement effects

We present the data from a crowdsourced project seeking to replicate findings in independent laboratories before (rather than after) they are published. In this Pre-Publication Independent Replication (PPIR) initiative, 25 research groups attempted to replicate 10 moral judgment effects from a single laboratory's research pipeline of unpublished findings. The 10 effects were investigated using online/lab surveys containing psychological manipulations (vignettes) followed by questionnaires. Results revealed a mix of reliable, unreliable, and culturally moderated findings. Unlike any previous replication project, this dataset includes the data from not only the replications but also from the original studies, creating a unique corpus that researchers can use to better understand reproducibility and irreproducibility in science

Crowdsourcing hypothesis tests: Making transparent how design choices shape research results

To what extent are research results influenced by subjective decisions that scientists make as they design studies? Fifteen research teams independently designed studies to answer fiveoriginal research questions related to moral judgments, negotiations, and implicit cognition. Participants from two separate large samples (total N > 15,000) were then randomly assigned to complete one version of each study. Effect sizes varied dramatically across different sets of materials designed to test the same hypothesis: materials from different teams renderedstatistically significant effects in opposite directions for four out of five hypotheses, with the narrowest range in estimates being d = -0.37 to +0.26. Meta-analysis and a Bayesian perspective on the results revealed overall support for two hypotheses, and a lack of support for three hypotheses. Overall, practically none of the variability in effect sizes was attributable to the skill of the research team in designing materials, while considerable variability was attributable to the hypothesis being tested. In a forecasting survey, predictions of other scientists were significantly correlated with study results, both across and within hypotheses. Crowdsourced testing of research hypotheses helps reveal the true consistency of empirical support for a scientific claim.</div

The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline

© 2015 The Authors This crowdsourced project introduces a collaborative approach to improving the reproducibility of scientific research, in which findings are replicated in qualified independent laboratories before (rather than after) they are published. Our goal is to establish a non-adversarial replication process with highly informative final results. To illustrate the Pre-Publication Independent Replication (PPIR) approach, 25 research groups conducted replications of all ten moral judgment effects which the last author and his collaborators had âin the pipelineâ as of August 2014. Six findings replicated according to all replication criteria, one finding replicated but with a significantly smaller effect size than the original, one finding replicated consistently in the original culture but not outside of it, and two findings failed to find support. In total, 40% of the original findings failed at least one major replication criterion. Potential ways to implement and incentivize pre-publication independent replication on a large scale are discussed.Link_to_subscribed_fulltex

Data from a pre-publication independent replication initiative examining ten moral judgement effects

We present the data from a crowdsourced project seeking to replicate findings in independent laboratories before (rather than after) they are published. In this Pre-Publication Independent Replication (PPIR) initiative, 25 research groups attempted to replicate 10 moral judgment effects from a single laboratory's research pipeline of unpublished findings. The 10 effects were investigated using online/lab surveys containing psychological manipulations (vignettes) followed by questionnaires. Results revealed a mix of reliable, unreliable, and culturally moderated findings. Unlike any previous replication project, this dataset includes the data from not only the replications but also from the original studies, creating a unique corpus that researchers can use to better understand reproducibility and irreproducibility in science.Link_to_subscribed_fulltex

The Association Between Familial Risk and Brain Abnormalities Is Disease Specific: An ENIGMA-Relatives Study of Schizophrenia and Bipolar Disorder

Background: Schizophrenia and bipolar disorder share genetic liability, and some structural brain abnormalities are common to both conditions. First-degree relatives of patients with schizophrenia (FDRs-SZ) show similar brain abnormalities to patients, albeit with smaller effect sizes. Imaging findings in first-degree relatives of patients with bipolar disorder (FDRs-BD) have been inconsistent in the past, but recent studies report regionally greater volumes compared with control subjects. Methods: We performed a meta-analysis of global and subcortical brain measures of 6008 individuals (1228 FDRs-SZ, 852 FDRs-BD, 2246 control subjects, 1016 patients with schizophrenia, 666 patients with bipolar disorder) from 34 schizophrenia and/or bipolar disorder family cohorts with standardized methods. Analyses were repeated with a correction for intracranial volume (ICV) and for the presence of any psychopathology in the relatives and control subjects. Results: FDRs-BD had significantly larger ICV (d = +0.16, q <.05 corrected), whereas FDRs-SZ showed smaller thalamic volumes than control subjects (d = −0.12, q <.05 corrected). ICV explained the enlargements in the brain measures in FDRs-BD. In FDRs-SZ, after correction for ICV, total brain, cortical gray matter, cerebral white matter, cerebellar gray and white matter, and thalamus volumes were significantly smaller; the cortex was thinner (d < −0.09, q <.05 corrected); and third ventricle was larger (d = +0.15, q <.05 corrected). The findings were not explained by psychopathology in the relatives or control subjects. Conclusions: Despite shared genetic liability, FDRs-SZ and FDRs-BD show a differential pattern of structural brain abnormalities, specifically a divergent effect in ICV. This may imply that the neurodevelopmental trajectories leading to brain anomalies in schizophrenia or bipolar disorder are distinct

Retrospective assessment of liver cell proliferation via PCNA : a comparison with tritiated thymidine

Cell proliferation (S phase response) in archival liver tissues of partially hepatectomized rats was determined via proliferating cell nuclear antigen (PCNA) immunohistochemistry. These results were compared with the S phase response assessed previously in the same tissues via tritiated thymidine (Tdr) autoradiography. The effect of prolonged tissue fixation on PCNA immunohistochemistry was compared in two studies: study A, the liver was fixed for a maximum of 7 days and then embedded in paraffin and stored for not, vert, similar 18 months, while in study B, the liver was fixed in formalin for 7 years and then embedded in paraffin and stored for not, vert, similar 18 months until sectioning and immunostaining. PCNA immunostaining was successful in the liver sections of both studies, irrespective of the length of formalin fixation. Furthermore, the S phase labeling indices (LI) determined via PCNA and Tdr were comparable, although not identical, in the two studies. Therefore, use of PCNA immunohistochemistry should allow retrospective staining of rodent tissues for the assessment of cell proliferative activity in formalin-fixed organs from previously conducted toxicity and carcinogenicity studies

Inhibition of Toxic Shock Syndrome-Associated Staphylococcus aureus by Probiotic Lactobacilli

ABSTRACT Staphylococcus aureus is a human pathogen with many infections originating on mucosal surfaces. One common group of S. aureus is the USA200 (CC30) clonal group, which produces toxic shock syndrome toxin-1 (TSST-1). Many USA200 infections occur on mucosal surfaces, particularly in the vagina and gastrointestinal tract. This allows these organisms to cause cases of menstrual TSS and enterocolitis. The current study examined the ability of two lactobacilli, Lactobacillus acidophilus strain LA-14 and Lacticaseibacillus rhamnosus strain HN001, for their ability to inhibit the growth of TSST-1 positive S. aureus, the production of TSST-1, and the ability of TSST-1 to induce pro-inflammatory chemokines from human vaginal epithelial cells (HVECs). In competition growth experiments, L. rhamnosus did not affect the growth of TSS S. aureus but did inhibit the production of TSST-1; this effect was partially due to acidification of the growth medium. L. acidophilus was both bactericidal and prevented the production of TSST-1 by S. aureus. This effect appeared to be partially due to acidification of the growth medium, production of H2O2, and production of other antibacterial molecules. When both organisms were incubated with S. aureus, the effect of L. acidophilus LA-14 dominated. In in vitro experiments with HVECs, neither lactobacillus induced significant production of the chemokine interleukin-8, whereas TSST-1 did induce production of the chemokine. When the lactobacilli were incubated with HVECs in the presence of TSST-1, the lactobacilli reduced chemokine production. These data suggest that these two bacteria in probiotics could reduce the incidence of menstrual and enterocolitis-associated TSS. IMPORTANCE Toxic shock syndrome (TSS) Staphylococcus aureus commonly colonize mucosal surfaces, giving them the ability to cause TSS through the action of TSS toxin-1 (TSST-1). This study examined the ability of two probiotic lactobacilli to inhibit S. aureus growth and TSST-1 production, and the reduction of pro-inflammatory chemokine production by TSST-1. Lacticaseibacillus rhamnosus strain HN001 inhibited TSST-1 production due to acid production but did not affect S. aureus growth. Lactobacillus acidophilus strain LA-14 was bactericidal against S. aureus, partially due to acid and H2O2 production, and consequently also inhibited TSST-1 production. Neither lactobacillus induced the production of pro-inflammatory chemokines by human vaginal epithelial cells, and both inhibited chemokine production by TSST-1. These data suggest that the two probiotics could reduce the incidence of mucosa-associated TSS, including menstrual TSS and cases originating as enterocolitis