Assessment of the usefulness of a diagnostic test: A survey of patient preference for diagnostic techniques in the evaluation of intestinal inflammation

BACKGROUND: In order to assess the usefulness of radiolabeled white cell scanning in the diagnosis of intestinal inflammation, subjects were asked to rank several dimensions of preference for white cell scanning in relation to other diagnostic tests. Two groups were surveyed: one known to have inflammatory bowel disease and the second not familiar in most cases with the tests. Subjects were asked to rank preference for each of seven tests: radiolabeled white cell scan, colonoscopy, barium enema, sigmoidoscopy, enteroclysis, stool analysis and laparotomy for the diagnosis of IBD and impressions of discomfort, embarrassment, inconvenience and danger related to each test. Mean rank scores were calculated, test ranks compared within groups and significance determined by the Wilcoxon rank test. RESULTS: Significant differences were seen in overall preference for white cell scan over barium enema and colonoscopy (p < 0.01) in both survey groups. Perceived discomfort and embarrassment demonstrated similar rankings. CONCLUSION: This patient preference combined with the reported accuracy of white cell scanning further establishes the usefulness of this means of IBD diagnosis

Chapter 8: Meta-analysis of Test Performance When There is a “Gold Standard”

Synthesizing information on test performance metrics such as sensitivity, specificity, predictive values and likelihood ratios is often an important part of a systematic review of a medical test. Because many metrics of test performance are of interest, the meta-analysis of medical tests is more complex than the meta-analysis of interventions or associations. Sometimes, a helpful way to summarize medical test studies is to provide a “summary point”, a summary sensitivity and a summary specificity. Other times, when the sensitivity or specificity estimates vary widely or when the test threshold varies, it is more helpful to synthesize data using a “summary line” that describes how the average sensitivity changes with the average specificity. Choosing the most helpful summary is subjective, and in some cases both summaries provide meaningful and complementary information. Because sensitivity and specificity are not independent across studies, the meta-analysis of medical tests is fundamentaly a multivariate problem, and should be addressed with multivariate methods. More complex analyses are needed if studies report results at multiple thresholds for positive tests. At the same time, quantitative analyses are used to explore and explain any observed dissimilarity (heterogeneity) in the results of the examined studies. This can be performed in the context of proper (multivariate) meta-regressions

Chapter 5: Assessing Risk of Bias as a Domain of Quality in Medical Test Studies

Assessing methodological quality is a necessary activity for any systematic review, including those evaluating the evidence for studies of medical test performance. Judging the overall quality of an individual study involves examining the size of the study, the direction and degree of findings, the relevance of the study, and the risk of bias in the form of systematic error, internal validity, and other study limitations. In this chapter of the Methods Guide for Medical Test Reviews, we focus on the evaluation of risk of bias in the form of systematic error in an individual study as a distinctly important component of quality in studies of medical test performance, specifically in the context of estimating test performance (sensitivity and specificity). We make the following recommendations to systematic reviewers: 1) When assessing study limitations that are relevant to the test under evaluation, reviewers should select validated criteria that examine the risk of systematic error, 2) categorizing the risk of bias for individual studies as “low,” “medium,” or “high” is a useful way to proceed, and 3) methods for determining an overall categorization for the study limitations should be established a priori and documented clearly

Chapter 1: Introduction to the Methods Guide for Medical Test Reviews

Evaluation of medical tests presents challenges distinct from those involved in the evaluation of therapies; in particular, the very great importance of context and the dearth of comprehensive RCTs aimed at comparing the clinical outcomes of different tests and test strategies. Available guidance provides some suggestions: 1) Use of the PICOTS typology for clarifying the context relevant to the review, and 2) use of an organizing framework for classifying the types of medical test evaluation studies and their relationship to potential key questions. However, there is a diversity of recommendations for reviewers of medical tests and a proliferation of concepts, terms, and methods. As a contribution to the field, this Methods Guide for Medical Test Reviews seeks to provide practical guidance for achieving the goals of clarity, consistency, tractability, and usefulness

Bias in the physical examination of patients with lumbar radiculopathy

<p>Abstract</p> <p>Background</p> <p>No prior studies have examined systematic bias in the musculoskeletal physical examination. The objective of this study was to assess the effects of bias due to prior knowledge of lumbar spine magnetic resonance imaging findings (MRI) on perceived diagnostic accuracy of the physical examination for lumbar radiculopathy.</p> <p>Methods</p> <p>This was a cross-sectional comparison of the performance characteristics of the physical examination with blinding to MRI results (the 'independent group') with performance in the situation where the physical examination was not blinded to MRI results (the 'non-independent group'). The reference standard was the final diagnostic impression of nerve root impingement by the examining physician. Subjects were recruited from a hospital-based outpatient specialty spine clinic. All adults age 18 and older presenting with lower extremity radiating pain of duration ≤ 12 weeks were evaluated for participation. 154 consecutively recruited subjects with lumbar disk herniation confirmed by lumbar spine MRI were included in this study. Sensitivities and specificities with 95% confidence intervals were calculated in the independent and non-independent groups for the four components of the radiculopathy examination: 1) provocative testing, 2) motor strength testing, 3) pinprick sensory testing, and 4) deep tendon reflex testing.</p> <p>Results</p> <p>The perceived sensitivity of sensory testing was higher with prior knowledge of MRI results (20% vs. 36%; p = 0.05). Sensitivities and specificities for exam components otherwise showed no statistically significant differences between groups.</p> <p>Conclusions</p> <p>Prior knowledge of lumbar MRI results may introduce bias into the pinprick sensory testing component of the physical examination for lumbar radiculopathy. No statistically significant effect of bias was seen for other components of the physical examination. The effect of bias due to prior knowledge of lumbar MRI results should be considered when an isolated sensory deficit on examination is used in medical decision-making. Further studies of bias should include surgical clinic populations and other common diagnoses including shoulder, knee and hip pathology.</p

Estimation of proteinuria as a predictor of complications of pre-eclampsia: a systematic review

Background Proteinuria is one of the essential criteria for the clinical diagnosis of pre-eclampsia. Increasing levels of proteinuria is considered to be associated with adverse maternal and fetal outcomes. We aim to determine the accuracy with which the amount of proteinuria predicts maternal and fetal complications in women with pre-eclampsia by systematic quantitative review of test accuracy studies. Methods We conducted electronic searches in MEDLINE (1951 to 2007), EMBASE (1980 to 2007), the Cochrane Library (2007) and the MEDION database to identify relevant articles and hand-search of selected specialist journals and reference lists of articles. There were no language restrictions for any of these searches. Two reviewers independently selected those articles in which the accuracy of proteinuria estimate was evaluated to predict maternal and fetal complications of pre-eclampsia. Data were extracted on study characteristics, quality and accuracy to construct 2 × 2 tables with maternal and fetal complications as reference standards. Results Sixteen primary articles with a total of 6749 women met the selection criteria with levels of proteinuria estimated by urine dipstick, 24-hour urine proteinuria or urine protein:creatinine ratio as a predictor of complications of pre-eclampsia. All 10 studies predicting maternal outcomes showed that proteinuria is a poor predictor of maternal complications in women with pre-eclampsia. Seventeen studies used laboratory analysis and eight studies bedside analysis to assess the accuracy of proteinuria in predicting fetal and neonatal complications. Summary likelihood ratios of positive and negative tests for the threshold level of 5 g/24 h were 2.0 (95% CI 1.5, 2.7) and 0.53 (95% CI 0.27, 1) for stillbirths, 1.5 (95% CI 0.94, 2.4) and 0.73 (95% CI 0.39, 1.4) for neonatal deaths and 1.5 (95% 1, 2) and 0.78 (95% 0.64, 0.95) for Neonatal Intensive Care Unit admission. Conclusion Measure of proteinuria is a poor predictor of either maternal or fetal complications in women with pre-eclampsia

Direct susceptibility testing for multi drug resistant tuberculosis: A meta-analysis

<p>Abstract</p> <p>Background</p> <p>One of the challenges facing the tuberculosis (TB) control programmes in resource-limited settings is lack of rapid techniques for detection of drug resistant TB, particularly multi drug resistant tuberculosis (MDR TB). Results obtained with the conventional indirect susceptibility testing methods come too late to influence a timely decision on patient management. More rapid tests directly applied on sputum samples are needed. This study compared the sensitivity, specificity and time to results of four direct drug susceptibility testing tests with the conventional indirect testing for detection of resistance to rifampicin and isoniazid in <it>M. tuberculosis</it>. The four direct tests included two in-house phenotypic assays – Nitrate Reductase Assay (NRA) and Microscopic Observation Drug Susceptibility (MODS), and two commercially available tests – Genotype^®MTBDR and Genotype^®MTBDR<it>plus </it>(Hain Life Sciences, Nehren, Germany).</p> <p>Methods</p> <p>A literature review and meta-analysis of study reports was performed. The Meta-Disc software was used to analyse the reports and tests for sensitivity, specificity, and area under the summary receiver operating characteristic (sROC) curves. Heterogeneity in accuracy estimates was tested with the Spearman correlation coefficient and Chi-square.</p> <p>Results</p> <p>Eighteen direct DST reports were analysed: NRA – 4, MODS- 6, Genotype MTBDR^®– 3 and Genotype^®MTBDR<it>plus </it>– 5. The pooled sensitivity and specificity for detection of resistance to rifampicin were 99% and 100% with NRA, 96% and 96% with MODS, 99% and 98% with Genotype^®MTBDR, and 99% and 99% with the new Genotype^®MTBDR<it>plus</it>, respectively. For isoniazid it was 94% and 100% for NRA, 92% and 96% for MODS, 71% and 100% for Genotype^®MTBDR, and 96% and 100% with the Genotype^®MTBDR<it>plus</it>, respectively. The area under the summary receiver operating characteristic (sROC) curves was in ranges of 0.98 to 1.00 for all the four tests. Molecular tests were completed in 1 – 2 days and also the phenotypic assays were much more rapid than conventional testing.</p> <p>Conclusion</p> <p>Direct testing of rifampicin and isoniazid resistance in <it>M. tuberculosis </it>was found to be highly sensitive and specific, and allows prompt detection of MDR TB.</p

Optimizing imaging in suspected appendicitis (OPTIMAP-study): A multicenter diagnostic accuracy study of MRI in patients with suspected acute appendicitis. Study Protocol

<p>Abstract</p> <p>Background</p> <p>In patients with clinically suspected appendicitis, imaging is needed to substantiate the clinical diagnosis. Imaging accuracy of ultrasonography (US) is suboptimal, while the most accurate technique (CT) is associated with cancer related deaths through exposure to ionizing radiation. MRI is a potential replacement, without associated ionizing radiation and no need for contrast medium administration. If MRI is proven to be sufficiently accurate, it could be introduced in the diagnostic pathway of patients with suspected appendicitis, increasing diagnostic accuracy and improving clinical outcomes, without the risk of radiation induced cancer or iodinated contrast medium-related drawbacks. The multicenter OPTIMAP study was designed to estimate the diagnostic accuracy of MRI in patients with suspected acute appendicitis in the general population.</p> <p>Methods/Design</p> <p>Eligible for this study are consecutive patients presenting with clinically suspected appendicitis at the emergency department in six centers. All patients will undergo imaging according to the Dutch guideline for acute appendicitis: initial ultrasonography in all and subsequent CT whenever US does not confirm acute appendicitis. Then MRI is performed in all patients, but the results are not used for patient management. A final diagnosis assigned by an expert panel, based on all available information including 3-months follow-up, except MRI findings, is used as the reference standard in estimating accuracy. We will calculate the sensitivity, specificity, predictive values and inter-observer agreement of MRI, and aim to include 230 patients. Patient acceptance and total imaging costs will also be evaluated.</p> <p>Discussion</p> <p>If MRI is found to be sufficiently accurate, it could replace CT in some or all patients. This will limit or obviate the ionizing radiation exposure associated risk of cancer induction and contrast medium induced nephropathy with CT, preventing the burden and the direct and indirect costs associated with treatment. Based on the high intrinsic contrast resolution of MRI, one might envision higher accuracy rates for MRI than for CT. If so, MRI could further decrease the number of unnecessary appendectomies and the number of missed appendicitis cases.</p> <p>Trial registration</p> <p><b>NTR2148</b></p

Computed tomography for the diagnosis of lumbar spinal pathology in adult patients with low back pain or sciatica: a diagnostic systematic review

Aim: In low back pain if serious pathology is suspected diagnostic imaging could be performed. One of the imaging techniques available for this purpose is computed tomography (