Evaluation of the methodological quality of studies of the performance of diagnostic tests for bovine tuberculosis using QUADAS

There has been little assessment of the methodological quality of studies measuring the performance (sensitivity and/or specificity) of diagnostic tests for animal diseases. In a systematic review, 190 studies of tests for bovine tuberculosis (bTB) in cattle (published 1934-2009) were assessed by at least one of 18 reviewers using the QUADAS (Quality Assessment of Diagnostic Accuracy Studies) checklist adapted for animal disease tests. VETQUADAS (VQ) included items measuring clarity in reporting (n = 3), internal validity (n = 9) and external validity (n = 2). A similar pattern for compliance was observed in studies of different diagnostic test types. Compliance significantly improved with year of publication for all items measuring clarity in reporting and external validity but only improved in four of the nine items measuring internal validity (p < 0.05). 107 references, of which 83 had performance data eligible for inclusion in a meta-analysis were reviewed by two reviewers. In these references, agreement between reviewers' responses was 71% for compliance, 32% for unsure and 29% for non-compliance. Mean compliance with reporting items was 2, 5.2 for internal validity and 1.5 for external validity. The index test result was described in sufficient detail in 80.1% of studies and was interpreted without knowledge of the reference standard test result in only 33.1%. Loss to follow-up was adequately explained in only 31.1% of studies. The prevalence of deficiencies observed may be due to inadequate reporting but may also reflect lack of attention to methodological issues that could bias the results of diagnostic test performance estimates. QUADAS was a useful tool for assessing and comparing the quality of studies measuring the performance of diagnostic tests but might be improved further by including explicit assessment of population sampling strategy.The SE3238 project “Meta-analysis of diagnostic tests and modelling to identify appropriate testing strategies to reduce M. bovis infection in GB herds” was funded by the UK Department for Environment, Food and Rural Affairs (Defra).http://www.elsevier.com/locate/prevetmedam2018Veterinary Tropical Disease

Meta-analyses of the sensitivity and specificity of ante-mortem and post-mortem diagnostic tests for bovine tuberculosis in the UK and Ireland

Publication history: Accepted - 26 February 2017; Published online - 6th March 2017.Bovine Tuberculosis (bTB) in cattle is a global health problem and eradication of the disease requires accu-rate estimates of diagnostic test performance to optimize their efficiency. The objective of this study was,through statistical meta-analyses, to obtain estimates of sensitivity (Se) and specificity (Sp), for 14 differ-ent ante-mortem and post-mortem diagnostic tests for bTB in cattle. Using data from a systematic reviewof the scientific literature (published 1934–2009) diagnostic Se and Sp were estimated using Bayesianlogistic regression models adjusting for confounding factors. Random effect terms were used to accountfor unexplained heterogeneity. Parameters in the models were implemented using Markov Chain MonteCarlo (MCMC), and posterior distributions for the diagnostic parameters with adjustment for covariates(confounding factors) were obtained using the inverse logit function. Estimates for Se and/or Sp of thetuberculin skin tests and the IFN- blood test were compared with estimates published 2010–2015.Median Se for the single intradermal comparative cervical tuberculin skin (SICCT) test (standard inter-pretation) was 0.50 and Bayesian credible intervals (CrI) were wide (95% CrI 0.26, 0.78). Median Sp forthe SICCT test was 1.00 (95% CrI 0.99, 1.00). Estimates for the IFN- blood test Bovine Purified ProteinDerivative (PPD)-Avian PPD and Early Secreted Antigen target 6 and Culture Filtrate Protein 10 (ESAT-6/CFP10) ESAT6/CFP10 were 0.67 (95% CrI 0.49, 0.82) and 0.78 (95% CrI 0.60, 0.90) respectively for Se,and 0.98 (95% CrI 0.96, 0.99) and 0.99 (95% CrI 0.99, 1.00) for Sp. The study provides an overview of theaccuracy of a range of contemporary diagnostic tests for bTB in cattle. Better understanding of diagnostictest performance is essential for the design of effective control strategies and their evaluation.The SE3238 project “Meta-analysis of diagnostic tests and modelling to identify appropriate testing strategies to reduce M. bovis infection in GB herds” was funded by the UK Department for Envi-ronment, Food and Rural Affairs (Defra)

Evidence for genetic variance in resistance to tuberculosis in Great Britain and Irish Holstein-Friesian populations

peer-reviewedBackground: Here, we jointly summarise scientific evidence for genetic variation in resistance to infection with Mycobacterium bovis, the primary agent of bovine tuberculosis (TB), provided by two recent and separate studies of Holstein-Friesian dairy cow populations in Great Britain (GB) and Ireland. Methods: The studies quantified genetic variation within archived data from field and abattoir surveillance control programmes within each country. These data included results from the single intradermal comparative tuberculin test (SICTT), abattoir inspection for TB lesions and laboratory confirmation of disease status. Threshold animal models were used to estimate variance components for responsiveness to the SICTT and abattoir confirmed M. bovis infection. The link functions between the observed 0/1 scale and the liability scale were the complementary log-log in the GB, and logit link function in the Irish population. Results and discussion: The estimated heritability of susceptibility to TB, as judged by responsiveness to the SICTT, was 0.16 (0.012) and 0.14 (0.025) in the GB and Irish populations, respectively. For abattoir or laboratory confirmation of infection, estimates were 0.18 (0.044) and 0.18 (0.041) from the GB and the Irish populations, respectively. Conclusions: Estimates were all significantly different from zero and indicate that exploitable variation exists among GB and Irish Holstein Friesian dairy cows for resistance to TB. Epidemiological analysis suggests that factors such as variation in exposure or imperfect sensitivity and specificity would have resulted in underestimation of the true values

Estimation of the relative sensitivity of the comparative tuberculin skin test in tuberculous cattle herds subjected to depopulation

Bovine tuberculosis (bTB) is one of the most serious economic animal health problems affecting the cattle industry in Great Britain (GB), with incidence in cattle herds increasing since the mid-1980s. The single intradermal comparative cervical tuberculin (SICCT) test is the primary screening test in the bTB surveillance and control programme in GB and Ireland. The sensitivity (ability to detect infected cattle) of this test is central to the efficacy of the current testing regime, but most previous studies that have estimated test sensitivity (relative to the number of slaughtered cattle with visible lesions [VL] and/or positive culture results) lacked post-mortem data for SICCT test-negative cattle. The slaughter of entire herds (“whole herd slaughters” or “depopulations”) that are infected by bTB are occasionally conducted in GB as a last-resort control measure to resolve intractable bTB herd breakdowns. These provide additional post-mortem data for SICCT test-negative cattle, allowing a rare opportunity to calculate the animal-level sensitivity of the test relative to the total number of SICCT test-positive and negative VL animals identified post-mortem (rSe). In this study, data were analysed from 16 whole herd slaughters (748 SICCT test-positive and 1031 SICCT test-negative cattle) conducted in GB between 1988 and 2010, using a Bayesian hierarchical model. The overall rSe estimate of the SICCT test at the severe interpretation was 85% (95% credible interval [CI]: 78–91%), and at standard interpretation was 81% (95% CI: 70–89%). These estimates are more robust than those previously reported in GB due to inclusion of post-mortem data from SICCT test-negative cattle

Odds Ratios and 95% credible intervals– relative to a baseline of survey-only core areas–for prolongation in the different treatment areas in the periods during and after the culling; adjusted for breakdown confirmation status.

<p>Results are further stratified into core and buffer zones.</p

Odds Ratios (ORs) and 95% credible intervals (in parentheses) of recurrence for the nuisance variables in the recurrent breakdown analyses.

<p>The OR for breakdown history is defined relative to having no breakdowns in the previous three years; the OR for the maximum herd size is per unit log-increase in herd size, and likewise for the total number of reactors. Models are fitted to each follow-up period (12, 24 and 36 months) separately.</p

Odds Ratios and 95% credible intervals (in parentheses)–relative to a baseline of survey-only core areas–for recurrence in the different treatment areas in the periods during and after the culling; adjusted for herd size, number of reactors, and breakdown history in the previous three years.

<p>Models are fitted to each follow-up period (12, 24 and 36 months) separately. Results are further stratified into core and buffer zones.</p

Numbers of cases (recurrent) and controls (non-recurrent), and the proportion recurrent, for the different treatment areas aggregated across the core and buffer zones and stratified by follow-up.

<p>Numbers of cases (recurrent) and controls (non-recurrent), and the proportion recurrent, for the different treatment areas aggregated across the core and buffer zones and stratified by follow-up.</p