NCBI's Virus Discovery Hackathon:Engaging Research Communities to Identify Cloud Infrastructure Requirements

A wealth of viral data sits untapped in publicly available metagenomic data sets when it might be extracted to create a usable index for the virological research community. We hypothesized that work of this complexity and scale could be done in a hackathon setting. Ten teams comprised of over 40 participants from six countries, assembled to create a crowd-sourced set of analysis and processing pipelines for a complex biological data set in a three-day event on the San Diego State University campus starting 9 January 2019. Prior to the hackathon, 141,676 metagenomic data sets from the National Center for Biotechnology Information (NCBI) Sequence Read Archive (SRA) were pre-assembled into contiguous assemblies (contigs) by NCBI staff. During the hackathon, a subset consisting of 2953 SRA data sets (approximately 55 million contigs) was selected, which were further filtered for a minimal length of 1 kb. This resulted in 4.2 million (Mio) contigs, which were aligned using BLAST against all known virus genomes, phylogenetically clustered and assigned metadata. Out of the 4.2 Mio contigs, 360,000 contigs were labeled with domains and an additional subset containing 4400 contigs was screened for virus or virus-like genes. The work yielded valuable insights into both SRA data and the cloud infrastructure required to support such efforts, revealing analysis bottlenecks and possible workarounds thereof. Mainly: (i) Conservative assemblies of SRA data improves initial analysis steps; (ii) existing bioinformatic software with weak multithreading/multicore support can be elevated by wrapper scripts to use all cores within a computing node; (iii) redesigning existing bioinformatic algorithms for a cloud infrastructure to facilitate its use for a wider audience; and (iv) a cloud infrastructure allows a diverse group of researchers to collaborate effectively. The scientific findings will be extended during a follow-up event. Here, we present the applied workflows, initial results, and lessons learned from the hackathon

Viruses Ubiquity and Diversity in Atacama Desert Endolithic Communities

Viruses are key players in the environment, and recent metagenomic studies have revealed their diversity and genetic complexity. Despite progress in understanding the ecology of viruses in extreme environments, viruses’ dynamics and functional roles in dryland ecosystems, which cover about 45% of the Earth’s land surfaces, remain largely unexplored. This study characterizes virus sequences in the metagenomes of endolithic (within rock) microbial communities ubiquitously found in hyper-arid deserts. Taxonomic classification and network construction revealed the presence of novel and diverse viruses in communities inhabiting calcite, gypsum, and ignimbrite rocks. Viral genome maps show a high level of protein diversity within and across endolithic communities and the presence of virus-encoded auxiliary metabolic genes. Phage-host relationships were predicted by matching tRNA, CRISPR spacer, and protein sequences in the viral and microbial metagenomes. Primary producers and heterotrophic bacteria were found to be putative hosts to some viruses. Intriguingly, viral diversity was not correlated with microbial diversity across rock substrates