Decision-Making in Research Tasks with Sequential Testing

Background: In a recent controversial essay, published by JPA Ioannidis in PLoS Medicine, it has been argued that in some research fields, most of the published findings are false. Based on theoretical reasoning it can be shown that small effect sizes, error-prone tests, low priors of the tested hypotheses and biases in the evaluation and publication of research findings increase the fraction of false positives. These findings raise concerns about the reliability of research. However, they are based on a very simple scenario of scientific research, where single tests are used to evaluate independent hypotheses. Methodology/Principal Findings: In this study, we present computer simulations and experimental approaches for analyzing more realistic scenarios. In these scenarios, research tasks are solved sequentially, i.e. subsequent tests can be chosen depending on previous results. We investigate simple sequential testing and scenarios where only a selected subset of results can be published and used for future rounds of test choice. Results from computer simulations indicate that for the tasks analyzed in this study, the fraction of false among the positive findings declines over several rounds of testing if the most informative tests are performed. Our experiments show that human subjects frequently perform the most informative tests, leading to a decline of false positives as expected from the simulations. Conclusions/Significance: For the research tasks studied here, findings tend to become more reliable over time. We also find that the performance in those experimental settings where not all performed tests could be published turned out to be surprisingly inefficient. Our results may help optimize existing procedures used in the practice of scientific research and provide guidance for the development of novel forms of scholarly communication.Engineering and Applied SciencesPsycholog

A European multicentre evaluation of detection and typing methods for human enteroviruses and parechoviruses using RNA transcripts

Polymerase chain reaction (PCR) detection has become the gold standard for diagnosis and typing of enterovirus (EV) and human parechovirus (HPeV) infections. Its effectiveness depends critically on using the appropriate sample types and high assay sensitivity as viral loads in cerebrospinal fluid samples from meningitis and sepsis clinical presentation can be extremely low. This study evaluated the sensitivity and specificity of currently used commercial and in-house diagnostic and typing assays. Accurately quantified RNA transcript controls were distributed to 27 diagnostic and 12 reference laboratories in 17 European countries for blinded testing. Transcripts represented the four human EV species (EV-A71, echovirus 30, coxsackie A virus 21, and EV-D68), HPeV3, and specificity controls. Reported results from 48 in-house and 15 commercial assays showed 98% detection frequencies of high copy (1000 RNA copies/5 mu L) transcripts. In-house assays showed significantly greater detection frequencies of the low copy (10 copies/5 mu L) EV and HPeV transcripts (81% and 86%, respectively) compared with commercial assays (56%, 50%; P = 7 x 10(-5)). EV-specific PCRs showed low cross-reactivity with human rhinovirus C (3 of 42 tests) and infrequent positivity in the negative control (2 of 63 tests). Most or all high copy EV and HPeV controls were successfully typed (88%, 100%) by reference laboratories, but showed reduced effectiveness for low copy controls (41%, 67%). Stabilized RNA transcripts provide an effective, logistically simple and inexpensive reagent for evaluation of diagnostic assay performance. The study provides reassurance of the performance of the many in-house assay formats used across Europe. However, it identified often substantially reduced sensitivities of commercial assays often used as point-of-care tests.Peer reviewe

A European multicentre evaluation of detection and typing methods for human enteroviruses and parechoviruses using RNA transcripts

Polymerase chain reaction (PCR) detection has become the gold standard for diagnosis and typing of enterovirus (EV) and human parechovirus (HPeV) infections. Its effectiveness depends critically on using the appropriate sample types and high assay sensitivity as viral loads in cerebrospinal fluid samples from meningitis and sepsis clinical presentation can be extremely low. This study evaluated the sensitivity and specificity of currently used commercial and in-house diagnostic and typing assays. Accurately quantified RNA transcript controls were distributed to 27 diagnostic and 12 reference laboratories in 17 European countries for blinded testing. Transcripts represented the four human EV species (EV-A71, echovirus 30, coxsackie A virus 21, and EV-D68), HPeV3, and specificity controls. Reported results from 48 in-house and 15 commercial assays showed 98% detection frequencies of high copy (1000 RNA copies/5 mu L) transcripts. In-house assays showed significantly greater detection frequencies of the low copy (10 copies/5 mu L) EV and HPeV transcripts (81% and 86%, respectively) compared with commercial assays (56%, 50%; P = 7 x 10(-5)). EV-specific PCRs showed low cross-reactivity with human rhinovirus C (3 of 42 tests) and infrequent positivity in the negative control (2 of 63 tests). Most or all high copy EV and HPeV controls were successfully typed (88%, 100%) by reference laboratories, but showed reduced effectiveness for low copy controls (41%, 67%). Stabilized RNA transcripts provide an effective, logistically simple and inexpensive reagent for evaluation of diagnostic assay performance. The study provides reassurance of the performance of the many in-house assay formats used across Europe. However, it identified often substantially reduced sensitivities of commercial assays often used as point-of-care tests

Multiple novel prostate cancer susceptibility signals identified by fine-mapping of known risk loci among Europeans

Genome-wide association studies (GWAS) have identified numerous common prostate cancer (PrCa) susceptibility loci. We have fine-mapped 64 GWAS regions known at the conclusion of the iCOGS study using large-scale genotyping and imputation in 25 723 PrCa cases and 26 274 controls of European ancestry. We detected evidence for multiple independent signals at 16 regions, 12 of which contained additional newly identified significant associations. A single signal comprising a spectrum of correlated variation was observed at 39 regions; 35 of which are now described by a novel more significantly associated lead SNP, while the originally reported variant remained as the lead SNP only in 4 regions. We also confirmed two association signals in Europeans that had been previously reported only in East-Asian GWAS. Based on statistical evidence and linkage disequilibrium (LD) structure, we have curated and narrowed down the list of the most likely candidate causal variants for each region. Functional annotation using data from ENCODE filtered for PrCa cell lines and eQTL analysis demonstrated significant enrichment for overlap with bio-features within this set. By incorporating the novel risk variants identified here alongside the refined data for existing association signals, we estimate that these loci now explain ∼38.9% of the familial relative risk of PrCa, an 8.9% improvement over the previously reported GWAS tag SNPs. This suggests that a significant fraction of the heritability of PrCa may have been hidden during the discovery phase of GWAS, in particular due to the presence of multiple independent signals within the same regio

Geographical and temporal distribution of SARS-CoV-2 clades in the WHO European Region, January to June 2020

We show the distribution of SARS-CoV-2 genetic clades over time and between countries and outline potential genomic surveillance objectives. We applied three available genomic nomenclature systems for SARS-CoV-2 to all sequence data from the WHO European Region available during the COVID-19 pandemic until 10 July 2020. We highlight the importance of real-time sequencing and data dissemination in a pandemic situation. We provide a comparison of the nomenclatures and lay a foundation for future European genomic surveillance of SARS-CoV-2.Peer reviewe

The impact of viral mutations on recognition by SARS-CoV-2 specific T cells.

We identify amino acid variants within dominant SARS-CoV-2 T cell epitopes by interrogating global sequence data. Several variants within nucleocapsid and ORF3a epitopes have arisen independently in multiple lineages and result in loss of recognition by epitope-specific T cells assessed by IFN-γ and cytotoxic killing assays. Complete loss of T cell responsiveness was seen due to Q213K in the A∗01:01-restricted CD8+ ORF3a epitope FTSDYYQLY207-215; due to P13L, P13S, and P13T in the B∗27:05-restricted CD8+ nucleocapsid epitope QRNAPRITF9-17; and due to T362I and P365S in the A∗03:01/A∗11:01-restricted CD8+ nucleocapsid epitope KTFPPTEPK361-369. CD8+ T cell lines unable to recognize variant epitopes have diverse T cell receptor repertoires. These data demonstrate the potential for T cell evasion and highlight the need for ongoing surveillance for variants capable of escaping T cell as well as humoral immunity.This work is supported by the UK Medical Research Council (MRC); Chinese Academy of Medical Sciences(CAMS) Innovation Fund for Medical Sciences (CIFMS), China; National Institute for Health Research (NIHR)Oxford Biomedical Research Centre, and UK Researchand Innovation (UKRI)/NIHR through the UK Coro-navirus Immunology Consortium (UK-CIC). Sequencing of SARS-CoV-2 samples and collation of data wasundertaken by the COG-UK CONSORTIUM. COG-UK is supported by funding from the Medical ResearchCouncil (MRC) part of UK Research & Innovation (UKRI),the National Institute of Health Research (NIHR),and Genome Research Limited, operating as the Wellcome Sanger Institute. T.I.d.S. is supported by a Well-come Trust Intermediate Clinical Fellowship (110058/Z/15/Z). L.T. is supported by the Wellcome Trust(grant number 205228/Z/16/Z) and by theUniversity of Liverpool Centre for Excellence in Infectious DiseaseResearch (CEIDR). S.D. is funded by an NIHR GlobalResearch Professorship (NIHR300791). L.T. and S.C.M.are also supported by the U.S. Food and Drug Administration Medical Countermeasures Initiative contract75F40120C00085 and the National Institute for Health Research Health Protection Research Unit (HPRU) inEmerging and Zoonotic Infections (NIHR200907) at University of Liverpool inpartnership with Public HealthEngland (PHE), in collaboration with Liverpool School of Tropical Medicine and the University of Oxford.L.T. is based at the University of Liverpool. M.D.P. is funded by the NIHR Sheffield Biomedical ResearchCentre (BRC – IS-BRC-1215-20017). ISARIC4C is supported by the MRC (grant no MC_PC_19059). J.C.K.is a Wellcome Investigator (WT204969/Z/16/Z) and supported by NIHR Oxford Biomedical Research Centreand CIFMS. The views expressed are those of the authors and not necessarily those of the NIHR or MRC

Assessing transmissibility of SARS-CoV-2 lineage B.1.1.7 in England

The SARS-CoV-2 lineage B.1.1.7, designated variant of concern (VOC) 202012/01 by Public Health England1, was first identified in the UK in late summer to early autumn 20202. Whole-genome SARS-CoV-2 sequence data collected from community-based diagnostic testing for COVID-19 show an extremely rapid expansion of the B.1.1.7 lineage during autumn 2020, suggesting that it has a selective advantage. Here we show that changes in VOC frequency inferred from genetic data correspond closely to changes inferred by S gene target failures (SGTF) in community-based diagnostic PCR testing. Analysis of trends in SGTF and non-SGTF case numbers in local areas across England shows that B.1.1.7 has higher transmissibility than non-VOC lineages, even if it has a different latent period or generation time. The SGTF data indicate a transient shift in the age composition of reported cases, with cases of B.1.1.7 including a larger share of under 20-year-olds than non-VOC cases. We estimated time-varying reproduction numbers for B.1.1.7 and co-circulating lineages using SGTF and genomic data. The best-supported models did not indicate a substantial difference in VOC transmissibility among different age groups, but all analyses agreed that B.1.1.7 has a substantial transmission advantage over other lineages, with a 50% to 100% higher reproduction number

Recurrent SARS-CoV-2 mutations in immunodeficient patients

Long-term severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infections in immunodeficient patients are an important source of variation for the virus but are understudied. Many case studies have been published which describe one or a small number of long-term infected individuals but no study has combined these sequences into a cohesive dataset. This work aims to rectify this and study the genomics of this patient group through a combination of literature searches as well as identifying new case series directly from the COVID-19 Genomics UK (COG-UK) dataset. The spike gene receptor-binding domain and N-terminal domain (NTD) were identified as mutation hotspots. Numerous mutations associated with variants of concern were observed to emerge recurrently. Additionally a mutation in the envelope gene, T30I was determined to be the second most frequent recurrently occurring mutation arising in persistent infections. A high proportion of recurrent mutations in immunodeficient individuals are associated with ACE2 affinity, immune escape, or viral packaging optimisation.There is an apparent selective pressure for mutations that aid cell–cell transmission within the host or persistence which are often different from mutations that aid inter-host transmission, although the fact that multiple recurrent de novo mutations are considered defining for variants of concern strongly indicates that this potential source of novel variants should not be discounted. © The Author(s) 2022. Published by Oxford University Press

SARS-CoV-2 lineage dynamics in England from September to November 2021: high diversity of Delta sub-lineages and increased transmissibility of AY.4.2

Background: Since the emergence of SARS-CoV-2, evolutionary pressure has driven large increases in the transmissibility of the virus. However, with increasing levels of immunity through vaccination and natural infection the evolutionary pressure will switch towards immune escape. Genomic surveillance in regions of high immunity is crucial in detecting emerging variants that can more successfully navigate the immune landscape. Methods: We present phylogenetic relationships and lineage dynamics within England (a country with high levels of immunity), as inferred from a random community sample of individuals who provided a self-administered throat and nose swab for rt-PCR testing as part of the REal-time Assessment of Community Transmission-1 (REACT-1) study. During round 14 (9 September–27 September 2021) and 15 (19 October–5 November 2021) lineages were determined for 1322 positive individuals, with 27.1% of those which reported their symptom status reporting no symptoms in the previous month. Results: We identified 44 unique lineages, all of which were Delta or Delta sub-lineages, and found a reduction in their mutation rate over the study period. The proportion of the Delta sub-lineage AY.4.2 was increasing, with a reproduction number 15% (95% CI 8–23%) greater than the most prevalent lineage, AY.4. Further, AY.4.2 was less associated with the most predictive COVID-19 symptoms (p = 0.029) and had a reduced mutation rate (p = 0.050). Both AY.4.2 and AY.4 were found to be geographically clustered in September but this was no longer the case by late October/early November, with only the lineage AY.6 exhibiting clustering towards the South of England. Conclusions: As SARS-CoV-2 moves towards endemicity and new variants emerge, genomic data obtained from random community samples can augment routine surveillance data without the potential biases introduced due to higher sampling rates of symptomatic individuals. © 2022, The Author(s)

Genomic reconstruction of the SARS-CoV-2 epidemic in England.

The evolution of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) virus leads to new variants that warrant timely epidemiological characterization. Here we use the dense genomic surveillance data generated by the COVID-19 Genomics UK Consortium to reconstruct the dynamics of 71 different lineages in each of 315 English local authorities between September 2020 and June 2021. This analysis reveals a series of subepidemics that peaked in early autumn 2020, followed by a jump in transmissibility of the B.1.1.7/Alpha lineage. The Alpha variant grew when other lineages declined during the second national lockdown and regionally tiered restrictions between November and December 2020. A third more stringent national lockdown suppressed the Alpha variant and eliminated nearly all other lineages in early 2021. Yet a series of variants (most of which contained the spike E484K mutation) defied these trends and persisted at moderately increasing proportions. However, by accounting for sustained introductions, we found that the transmissibility of these variants is unlikely to have exceeded the transmissibility of the Alpha variant. Finally, B.1.617.2/Delta was repeatedly introduced in England and grew rapidly in early summer 2021, constituting approximately 98% of sampled SARS-CoV-2 genomes on 26 June 2021