Evaluation of the methodological quality of studies of the performance of diagnostic tests for bovine tuberculosis using QUADAS

There has been little assessment of the methodological quality of studies measuring the performance (sensitivity and/or specificity) of diagnostic tests for animal diseases. In a systematic review, 190 studies of tests for bovine tuberculosis (bTB) in cattle (published 1934-2009) were assessed by at least one of 18 reviewers using the QUADAS (Quality Assessment of Diagnostic Accuracy Studies) checklist adapted for animal disease tests. VETQUADAS (VQ) included items measuring clarity in reporting (n = 3), internal validity (n = 9) and external validity (n = 2). A similar pattern for compliance was observed in studies of different diagnostic test types. Compliance significantly improved with year of publication for all items measuring clarity in reporting and external validity but only improved in four of the nine items measuring internal validity (p < 0.05). 107 references, of which 83 had performance data eligible for inclusion in a meta-analysis were reviewed by two reviewers. In these references, agreement between reviewers' responses was 71% for compliance, 32% for unsure and 29% for non-compliance. Mean compliance with reporting items was 2, 5.2 for internal validity and 1.5 for external validity. The index test result was described in sufficient detail in 80.1% of studies and was interpreted without knowledge of the reference standard test result in only 33.1%. Loss to follow-up was adequately explained in only 31.1% of studies. The prevalence of deficiencies observed may be due to inadequate reporting but may also reflect lack of attention to methodological issues that could bias the results of diagnostic test performance estimates. QUADAS was a useful tool for assessing and comparing the quality of studies measuring the performance of diagnostic tests but might be improved further by including explicit assessment of population sampling strategy.The SE3238 project “Meta-analysis of diagnostic tests and modelling to identify appropriate testing strategies to reduce M. bovis infection in GB herds” was funded by the UK Department for Environment, Food and Rural Affairs (Defra).http://www.elsevier.com/locate/prevetmedam2018Veterinary Tropical Disease

Meta-analyses of the sensitivity and specificity of ante-mortem and post-mortem diagnostic tests for bovine tuberculosis in the UK and Ireland

Publication history: Accepted - 26 February 2017; Published online - 6th March 2017.Bovine Tuberculosis (bTB) in cattle is a global health problem and eradication of the disease requires accu-rate estimates of diagnostic test performance to optimize their efficiency. The objective of this study was,through statistical meta-analyses, to obtain estimates of sensitivity (Se) and specificity (Sp), for 14 differ-ent ante-mortem and post-mortem diagnostic tests for bTB in cattle. Using data from a systematic reviewof the scientific literature (published 1934–2009) diagnostic Se and Sp were estimated using Bayesianlogistic regression models adjusting for confounding factors. Random effect terms were used to accountfor unexplained heterogeneity. Parameters in the models were implemented using Markov Chain MonteCarlo (MCMC), and posterior distributions for the diagnostic parameters with adjustment for covariates(confounding factors) were obtained using the inverse logit function. Estimates for Se and/or Sp of thetuberculin skin tests and the IFN- blood test were compared with estimates published 2010–2015.Median Se for the single intradermal comparative cervical tuberculin skin (SICCT) test (standard inter-pretation) was 0.50 and Bayesian credible intervals (CrI) were wide (95% CrI 0.26, 0.78). Median Sp forthe SICCT test was 1.00 (95% CrI 0.99, 1.00). Estimates for the IFN- blood test Bovine Purified ProteinDerivative (PPD)-Avian PPD and Early Secreted Antigen target 6 and Culture Filtrate Protein 10 (ESAT-6/CFP10) ESAT6/CFP10 were 0.67 (95% CrI 0.49, 0.82) and 0.78 (95% CrI 0.60, 0.90) respectively for Se,and 0.98 (95% CrI 0.96, 0.99) and 0.99 (95% CrI 0.99, 1.00) for Sp. The study provides an overview of theaccuracy of a range of contemporary diagnostic tests for bTB in cattle. Better understanding of diagnostictest performance is essential for the design of effective control strategies and their evaluation.The SE3238 project “Meta-analysis of diagnostic tests and modelling to identify appropriate testing strategies to reduce M. bovis infection in GB herds” was funded by the UK Department for Envi-ronment, Food and Rural Affairs (Defra)

Whole-genome sequencing reveals host factors underlying critical COVID-19

Critical COVID-19 is caused by immune-mediated inflammatory lung injury. Host genetic variation influences the development of illness requiring critical care1 or hospitalization2–4 after infection with SARS-CoV-2. The GenOMICC (Genetics of Mortality in Critical Care) study enables the comparison of genomes from individuals who are critically ill with those of population controls to find underlying disease mechanisms. Here we use whole-genome sequencing in 7,491 critically ill individuals compared with 48,400 controls to discover and replicate 23 independent variants that significantly predispose to critical COVID-19. We identify 16 new independent associations, including variants within genes that are involved in interferon signalling (IL10RB and PLSCR1), leucocyte differentiation (BCL11A) and blood-type antigen secretor status (FUT2). Using transcriptome-wide association and colocalization to infer the effect of gene expression on disease severity, we find evidence that implicates multiple genes—including reduced expression of a membrane flippase (ATP11A), and increased expression of a mucin (MUC1)—in critical disease. Mendelian randomization provides evidence in support of causal roles for myeloid cell adhesion molecules (SELE, ICAM5 and CD209) and the coagulation factor F8, all of which are potentially druggable targets. Our results are broadly consistent with a multi-component model of COVID-19 pathophysiology, in which at least two distinct mechanisms can predispose to life-threatening disease: failure to control viral replication; or an enhanced tendency towards pulmonary inflammation and intravascular coagulation. We show that comparison between cases of critical illness and population controls is highly efficient for the detection of therapeutically relevant mechanisms of disease

Whole-genome sequencing reveals host factors underlying critical COVID-19

Critical COVID-19 is caused by immune-mediated inflammatory lung injury. Host genetic variation influences the development of illness requiring critical care1 or hospitalization2,3,4 after infection with SARS-CoV-2. The GenOMICC (Genetics of Mortality in Critical Care) study enables the comparison of genomes from individuals who are critically ill with those of population controls to find underlying disease mechanisms. Here we use whole-genome sequencing in 7,491 critically ill individuals compared with 48,400 controls to discover and replicate 23 independent variants that significantly predispose to critical COVID-19. We identify 16 new independent associations, including variants within genes that are involved in interferon signalling (IL10RB and PLSCR1), leucocyte differentiation (BCL11A) and blood-type antigen secretor status (FUT2). Using transcriptome-wide association and colocalization to infer the effect of gene expression on disease severity, we find evidence that implicates multiple genes—including reduced expression of a membrane flippase (ATP11A), and increased expression of a mucin (MUC1)—in critical disease. Mendelian randomization provides evidence in support of causal roles for myeloid cell adhesion molecules (SELE, ICAM5 and CD209) and the coagulation factor F8, all of which are potentially druggable targets. Our results are broadly consistent with a multi-component model of COVID-19 pathophysiology, in which at least two distinct mechanisms can predispose to life-threatening disease: failure to control viral replication; or an enhanced tendency towards pulmonary inflammation and intravascular coagulation. We show that comparison between cases of critical illness and population controls is highly efficient for the detection of therapeutically relevant mechanisms of disease

Estimation of the relative sensitivity of the comparative tuberculin skin test in tuberculous cattle herds subjected to depopulation

Bovine tuberculosis (bTB) is one of the most serious economic animal health problems affecting the cattle industry in Great Britain (GB), with incidence in cattle herds increasing since the mid-1980s. The single intradermal comparative cervical tuberculin (SICCT) test is the primary screening test in the bTB surveillance and control programme in GB and Ireland. The sensitivity (ability to detect infected cattle) of this test is central to the efficacy of the current testing regime, but most previous studies that have estimated test sensitivity (relative to the number of slaughtered cattle with visible lesions [VL] and/or positive culture results) lacked post-mortem data for SICCT test-negative cattle. The slaughter of entire herds (“whole herd slaughters” or “depopulations”) that are infected by bTB are occasionally conducted in GB as a last-resort control measure to resolve intractable bTB herd breakdowns. These provide additional post-mortem data for SICCT test-negative cattle, allowing a rare opportunity to calculate the animal-level sensitivity of the test relative to the total number of SICCT test-positive and negative VL animals identified post-mortem (rSe). In this study, data were analysed from 16 whole herd slaughters (748 SICCT test-positive and 1031 SICCT test-negative cattle) conducted in GB between 1988 and 2010, using a Bayesian hierarchical model. The overall rSe estimate of the SICCT test at the severe interpretation was 85% (95% credible interval [CI]: 78–91%), and at standard interpretation was 81% (95% CI: 70–89%). These estimates are more robust than those previously reported in GB due to inclusion of post-mortem data from SICCT test-negative cattle

Estimating the Hidden Burden of Bovine Tuberculosis in Great Britain

<div><p>The number of cattle herds placed under movement restrictions in Great Britain (GB) due to the suspected presence of bovine tuberculosis (bTB) has progressively increased over the past 25 years despite an intensive and costly test-and-slaughter control program. Around 38% of herds that clear movement restrictions experience a recurrent incident (breakdown) within 24 months, suggesting that infection may be persisting within herds. Reactivity to tuberculin, the basis of diagnostic testing, is dependent on the time from infection. Thus, testing efficiency varies between outbreaks, depending on weight of transmission and cannot be directly estimated. In this paper, we use Approximate Bayesian Computation (ABC) to parameterize two within-herd transmission models within a rigorous inferential framework. Previous within-herd models of bTB have relied on ad-hoc methods of parameterization and used a single model structure (SORI) where animals are assumed to become detectable by testing before they become infectious. We study such a conventional within-herd model of bTB and an alternative model, motivated by recent animal challenge studies, where there is no period of epidemiological latency before animals become infectious (SOR). Under both models we estimate that cattle-to-cattle transmission rates are non-linearly density dependent. The basic reproductive ratio for our conventional within-herd model, estimated for scenarios with no statutory controls, increases from 1.5 (0.26–4.9; 95% CI) in a herd of 30 cattle up to 4.9 (0.99–14.0) in a herd of 400. Under this model we estimate that 50% (33–67) of recurrent breakdowns in Britain can be attributed to infection missed by tuberculin testing. However this figure falls to 24% (11–42) of recurrent breakdowns under our alternative model. Under both models the estimated extrinsic force of infection increases with the burden of missed infection. Hence, improved herd-level testing is unlikely to reduce recurrence unless this extrinsic infectious pressure is simultaneously addressed.</p> </div

Model parameters.

<p>Model parameters.</p

Prior assumptions.

<p>Prior assumptions.</p

Impact of herd-level interventions on probability of recurrence within 24 months.

<p>Change in the probability of a herd experiencing a recurrent breakdown after application of a ‘perfect’ test (left column) or perfect isolation (right column). The perfect test is assumed to have 100% sensitivity and specificity and no occult period. Perfect isolation corresponds to setting the extrinsic infectious pressure to zero at the end of a breakdown (). Plotted values correspond to the average % difference in the probability of recurrence relative to the fitted SORI (Panel <b>A</b>) and SOR models (Panel <b>B</b>). Separate series are plotted for herds in PTI 1 (lime green circles), 2 (magenta squares) & 4 (sky blue diamonds). Predictive distributions illustrating the variability in these point (mean) estimates are presented in supplementary <a href="http://www.ploscompbiol.org/article/info:doi/10.1371/journal.pcbi.1002730#pcbi.1002730.s014" target="_blank">figure <b>S13</b></a>.</p