Data from a pre-publication independent replication initiative examining ten moral judgement effects

We present the data from a crowdsourced project seeking to replicate findings in independent laboratories before (rather than after) they are published. In this Pre-Publication Independent Replication (PPIR) initiative, 25 research groups attempted to replicate 10 moral judgment effects from a single laboratory's research pipeline of unpublished findings. The 10 effects were investigated using online/lab surveys containing psychological manipulations (vignettes) followed by questionnaires. Results revealed a mix of reliable, unreliable, and culturally moderated findings. Unlike any previous replication project, this dataset includes the data from not only the replications but also from the original studies, creating a unique corpus that researchers can use to better understand reproducibility and irreproducibility in science

The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline

This crowdsourced project introduces a collaborative approach to improving the reproducibility of scientific research, in which findings are replicated in qualified independent laboratories before (rather than after) they are published. Our goal is to establish a non-adversarial replication process with highly informative final results. To illustrate the Pre-Publication Independent Replication (PPIR) approach, 25 research groups conducted replications of all ten moral judgment effects which the last author and his collaborators had “in the pipeline” as of August 2014. Six findings replicated according to all replication criteria, one finding replicated but with a significantly smaller effect size than the original, one finding replicated consistently in the original culture but not outside of it, and two findings failed to find support. In total, 40% of the original findings failed at least one major replication criterion. Potential ways to implement and incentivize pre-publication independent replication on a large scale are discussed

Large-scale discovery of novel genetic causes of developmental disorders

Despite three decades of successful, predominantly phenotype-driven discovery of the genetic causes of monogenic disorders1, up to half of children with severe developmental disorders of probable genetic origin remain without a genetic diagnosis. Particularly challenging are those disorders rare enough to have eluded recognition as a discrete clinical entity, those with highly variable clinical manifestations, and those that are difficult to distinguish from other, very similar, disorders. Here we demonstrate the power of using an unbiased genotype-driven approach2 to identify subsets of patients with similar disorders. By studying 1,133 children with severe, undiagnosed developmental disorders, and their parents, using a combination of exome sequencing3,4,5,6,7,8,9,10,11 and array-based detection of chromosomal rearrangements, we discovered 12 novel genes associated with developmental disorders. These newly implicated genes increase by 10% (from 28% to 31%) the proportion of children that could be diagnosed. Clustering of missense mutations in six of these newly implicated genes suggests that normal development is being perturbed by an activating or dominant-negative mechanism. Our findings demonstrate the value of adopting a comprehensive strategy, both genome-wide and nationwide, to elucidate the underlying causes of rare genetic disorders

Measurement repeatability of tibial tuberosity-trochlear groove offset distance in red fox (Vulpes vulpes) cadavers

Abstract OBJECTIVE: To describe CT image reconstruction criteria for measurement of the tibial tuberosity-trochlear groove (TT-TG) offset distance, evaluate intra- and inter-reconstruction repeatability, and identify key sources of error in the measurement technique, as determined in vulpine hind limbs. ANIMALS: 12 red fox (Vulpes vulpes) cadavers. PROCEDURES: CT images of each hind limb in intact cadavers were obtained; at 1-week intervals, 3 reconstructions were performed that were based on 1 plane passing through the centers of the femoral head and medial condyle and parallel to the caudal femoral condyles, 1 plane aligned with the femoral trochlea, and a third orthogonal plane. Randomized and anonymized reconstructions were assessed for TT-TG offset distance with a single-image technique by 1 observer, and inter-reconstruction repeatability and intra- and inter-reconstruction measurement repeatability were assessed via the repeatability coefficient and intraclass correlation coefficient. RESULTS: Multiplanar reconstructions of hind limb images were repeatedly made to within a few degrees of each other. Intra- and inter-reconstruction repeatability for TT-TG offset distance measurement was good. Repeatability was most affected by accurate identification of the tibial tuberosity and femoral trochlea landmarks. CONCLUSIONS AND CLINICAL RELEVANCE: Results obtained from vulpine hind limb CT images indicated that reconstructions can be made with a high degree of repeatability when based on strictly defined and applied criteria. The TT-TG offset distance has potential as an objective assessment of alignment of the distal portion of the quadriceps mechanism; its use as an aid in case selection for corrective femoral osteotomy among dogs with medial patellar luxation warrants investigation. PMID: 23718657 [PubMed - indexed for MEDLINE