Lessons learned and recommendations for data coordination in collaborative research: The CSER consortium experience

Integrating data across heterogeneous research environments is a key challenge in multi-site, collaborative research projects. While it is important to allow for natural variation in data collection protocols across research sites, it is also important to achieve interoperability between datasets in order to reap the full benefits of collaborative work. However, there are few standards to guide the data coordination process from project conception to completion. In this paper, we describe the experiences of the Clinical Sequence Evidence-Generating Research (CSER) consortium Data Coordinating Center (DCC), which coordinated harmonized survey and genomic sequencing data from seven clinical research sites from 2020 to 2022. Using input from multiple consortium working groups and from CSER leadership, we first identify 14 lessons learned from CSER in the categories of communication, harmonization, informatics, compliance, and analytics. We then distill these lessons learned into 11 recommendations for future research consortia in the areas of planning, communication, informatics, and analytics. We recommend that planning and budgeting for data coordination activities occur as early as possible during consortium conceptualization and development to minimize downstream complications. We also find that clear, reciprocal, and continuous communication between consortium stakeholders and the DCC is equally important to maintaining a secure and centralized informatics ecosystem for pooling data. Finally, we discuss the importance of actively interrogating current approaches to data governance, particularly for research studies that straddle the research-clinical divide

The Clinical Sequencing Evidence-Generating Research Consortium: Integrating Genomic Sequencing in Diverse and Medically Underserved Populations

The Clinical Sequencing Evidence-Generating Research (CSER) consortium, now in its second funding cycle, is investigating the effectiveness of integrating genomic (exome or genome) sequencing into the clinical care of diverse and medically underserved individuals in a variety of healthcare settings and disease states. The consortium comprises a coordinating center, six funded extramural clinical projects, and an ongoing National Human Genome Research Institute (NHGRI) intramural project. Collectively, these projects aim to enroll and sequence over 6,100 participants in four years. At least 60% of participants will be of non-European ancestry or from underserved settings, with the goal of diversifying the populations that are providing an evidence base for genomic medicine. Five of the six clinical projects are enrolling pediatric patients with various phenotypes. One of these five projects is also enrolling couples whose fetus has a structural anomaly, and the sixth project is enrolling adults at risk for hereditary cancer. The ongoing NHGRI intramural project has enrolled primarily healthy adults. Goals of the consortium include assessing the clinical utility of genomic sequencing, exploring medical follow up and cascade testing of relatives, and evaluating patient-provider-laboratory level interactions that influence the use of this technology. The findings from the CSER consortium will offer patients, healthcare systems, and policymakers a clearer understanding of the opportunities and challenges of providing genomic medicine in diverse populations and settings, and contribute evidence toward developing best practices for the delivery of clinically useful and cost-effective genomic sequencing in diverse healthcare settings

Reproducibility in the absence of selective reporting : An illustration from large-scale brain asymmetry research

Altres ajuts: Max Planck Society (Germany).The problem of poor reproducibility of scientific findings has received much attention over recent years, in a variety of fields including psychology and neuroscience. The problem has been partly attributed to publication bias and unwanted practices such as p-hacking. Low statistical power in individual studies is also understood to be an important factor. In a recent multisite collaborative study, we mapped brain anatomical left-right asymmetries for regional measures of surface area and cortical thickness, in 99 MRI datasets from around the world, for a total of over 17,000 participants. In the present study, we revisited these hemispheric effects from the perspective of reproducibility. Within each dataset, we considered that an effect had been reproduced when it matched the meta-analytic effect from the 98 other datasets, in terms of effect direction and significance threshold. In this sense, the results within each dataset were viewed as coming from separate studies in an "ideal publishing environment," that is, free from selective reporting and p hacking. We found an average reproducibility rate of 63.2% (SD = 22.9%, min = 22.2%, max = 97.0%). As expected, reproducibility was higher for larger effects and in larger datasets. Reproducibility was not obviously related to the age of participants, scanner field strength, FreeSurfer software version, cortical regional measurement reliability, or regional size. These findings constitute an empirical illustration of reproducibility in the absence of publication bias or p hacking, when assessing realistic biological effects in heterogeneous neuroscience data, and given typically-used sample sizes