Guidance for the design and reporting of studies evaluating the clinical performance of tests for present or past SARS-CoV-2 infection

Testing for SARS-CoV-2 infection is key in managing the current pandemic. More than 1700 preprints and peer reviewed journal articles evaluating tests for SARS-CoV-2 infection have been published as of January 2021. However, evaluations of these studies have identified many methodological issues, leading to a high risk of bias and difficulties applying the results in practice. Better guidance is urgently needed on the conduct and interpretation of these studies. This article outlines the principles for defining the intended purpose of the test; study population selection; reference standard, test timing; and other critical considerations for the design, reporting, and interpretation of diagnostic accuracy studies. The implementation and accuracy of SARS-CoV-2 tests have major implications for individuals and communities, balancing the potential consequences of continued infection against the need for public health measures, such as the restriction of movements and social activities. Decision making in the current pandemic requires a clear understanding of the clinical performance and limitations of testing. This article provides guidance to assist researchers design robust diagnostic accuracy studies, assist publishers and peer reviewers to assess such studies, and support clinicians and policy makers in their evaluation of the evidence on SARS-CoV-2 testing for clinical and public health decisions. The guidance aims to ensure that studies evaluating the diagnostic accuracy of SARS-CoV-2 tests are conducted as rigorously as possible, in an efficient and timely way

Chapter 4: Effective Search Strategies for Systematic Reviews of Medical Tests

This article discusses techniques that are appropriate when developing search strategies for systematic reviews of medical tests. This includes general advice for searching for systematic reviews and issues specific to systematic reviews of medical tests. Diagnostic search filters are currently not sufficiently developed for use when searching for systematic reviews. Instead, authors should construct a highly sensitive search strategy that uses both controlled vocabulary and text words. A comprehensive search should include multiple databases and sources of grey literature. A list of subject-specific databases is included in this article

Natriuretic peptide vs. clinical information for diagnosis of left ventricular systolic dysfunction in primary care

<p>Abstract</p> <p>Background</p> <p>Screening of primary care patients at risk for left ventricular systolic dysfunction by a simple blood-test might reduce referral rates for echocardiography. Whether or not natriuretic peptide testing is a useful and cost-effective diagnostic instrument in primary care settings, however, is still a matter of debate.</p> <p>Methods</p> <p>N-terminal pro-brain natriuretic peptide (NT-proBNP) levels, clinical information, and echocardiographic data of left ventricular systolic function were collected in 542 family practice patients with at least one cardiovascular risk factor. We determined the diagnostic power of the NT-proBNP assessment in ruling out left ventricular systolic dysfunction and compared it to a risk score derived from a logistic regression model of easily acquired clinical information.</p> <p>Results</p> <p>23 of 542 patients showed left ventricular systolic dysfunction. Both NT-proBNP and the clinical risk score consisting of dyspnea at exertion and ankle swelling, coronary artery disease and diuretic treatment showed excellent diagnostic power for ruling out left ventricular systolic dysfunction. AUC of NT-proBNP was 0.83 (95% CI, 0.75 to 0.92) with a sensitivity of 0.91 (95% CI, 0.71 to 0.98) and a specificity of 0.46 (95% CI, 0.41 to 0.50). AUC of the clinical risk score was 0.85 (95% CI, 0.79 to 0.91) with a sensitivity of 0.91 (95% CI, 0.71 to 0.98) and a specificity of 0.64 (95% CI, 0.59 to 0.67). 148 misclassifications using NT-proBNP and 55 using the clinical risk score revealed a significant difference (McNemar test; p < 0.001) that was based on the higher specificity of the clinical risk score.</p> <p>Conclusion</p> <p>The evaluation of clinical information is at least as effective as NT-proBNP testing in ruling out left ventricular systolic dysfunction in family practice patients at risk. If these results are confirmed in larger cohorts and in different samples, family physicians should be encouraged to rely on the diagnostic power of the clinical information from their patients.</p

The systematic guideline review: method, rationale, and test on chronic heart failure

Background: Evidence-based guidelines have the potential to improve healthcare. However, their de-novo-development requires substantial resources-especially for complex conditions, and adaptation may be biased by contextually influenced recommendations in source guidelines. In this paper we describe a new approach to guideline development-the systematic guideline review method (SGR), and its application in the development of an evidence-based guideline for family physicians on chronic heart failure (CHF). Methods: A systematic search for guidelines was carried out. Evidence-based guidelines on CHF management in adults in ambulatory care published in English or German between the years 2000 and 2004 were included. Guidelines on acute or right heart failure were excluded. Eligibility was assessed by two reviewers, methodological quality of selected guidelines was appraised using the AGREE instrument, and a framework of relevant clinical questions for diagnostics and treatment was derived. Data were extracted into evidence tables, systematically compared by means of a consistency analysis and synthesized in a preliminary draft. Most relevant primary sources were re-assessed to verify the cited evidence. Evidence and recommendations were summarized in a draft guideline. Results: Of 16 included guidelines five were of good quality. A total of 35 recommendations were systematically compared: 25/35 were consistent, 9/35 inconsistent, and 1/35 un-rateable (derived from a single guideline). Of the 25 consistencies, 14 were based on consensus, seven on evidence and four differed in grading. Major inconsistencies were found in 3/9 of the inconsistent recommendations. We re-evaluated the evidence for 17 recommendations (evidence-based, differing evidence levels and minor inconsistencies) - the majority was congruent. Incongruity was found where the stated evidence could not be verified in the cited primary sources, or where the evaluation in the source guidelines focused on treatment benefits and underestimated the risks. The draft guideline was completed in 8.5 man-months. The main limitation to this study was the lack of a second reviewer. Conclusion: The systematic guideline review including framework development, consistency analysis and validation is an effective, valid, and resource saving-approach to the development of evidence-based guidelines

Cereal Domestication and Evolution of Branching: Evidence for Soft Selection in the Tb1 Orthologue of Pearl Millet (Pennisetum glaucum [L.] R. Br.)

BACKGROUND: During the Neolithic revolution, early farmers altered plant development to domesticate crops. Similar traits were often selected independently in different wild species; yet the genetic basis of this parallel phenotypic evolution remains elusive. Plant architecture ranks among these target traits composing the domestication syndrome. We focused on the reduction of branching which occurred in several cereals, an adaptation known to rely on the major gene Teosinte-branched1 (Tb1) in maize. We investigate the role of the Tb1 orthologue (Pgtb1) in the domestication of pearl millet (Pennisetum glaucum), an African outcrossing cereal. METHODOLOGY/PRINCIPAL FINDINGS: Gene cloning, expression profiling, QTL mapping and molecular evolution analysis were combined in a comparative approach between pearl millet and maize. Our results in pearl millet support a role for PgTb1 in domestication despite important differences in the genetic basis of branching adaptation in that species compared to maize (e.g. weaker effects of PgTb1). Genetic maps suggest this pattern to be consistent in other cereals with reduced branching (e.g. sorghum, foxtail millet). Moreover, although the adaptive sites underlying domestication were not formerly identified, signatures of selection pointed to putative regulatory regions upstream of both Tb1 orthologues in maize and pearl millet. However, the signature of human selection in the pearl millet Tb1 is much weaker in pearl millet than in maize. CONCLUSIONS/SIGNIFICANCE: Our results suggest that some level of parallel evolution involved at least regions directly upstream of Tb1 for the domestication of pearl millet and maize. This was unanticipated given the multigenic basis of domestication traits and the divergence of wild progenitor species for over 30 million years prior to human selection. We also hypothesized that regular introgression of domestic pearl millet phenotypes by genes from the wild gene pool could explain why the selective sweep in pearl millet is softer than in maize

An alternative to the hand searching gold standard: validating methodological search filters using relative recall

BACKGROUND: Search filters or hedges play an important role in evidence-based medicine but their development depends on the availability of a "gold standard" – a reference standard against which to establish the performance of the filter. We demonstrate the feasibility of using relative recall of included studies from multiple systematic reviews to validate methodological search filters as an alternative to validation against a gold standard formed through hand searching. METHODS: We identified 105 Cochrane reviews that used the Highly Sensitive Search Strategy (HSSS), included randomized or quasi-randomized controlled trials, and reported their included studies. We measured the ability of two published and one novel variant of the HSSS to retrieve the MEDLINE-index studies included in these reviews. RESULTS: The systematic reviews were comprehensive in their searches. 72% of included primary studies were indexed in MEDLINE. Relative recall of the three strategies ranged from .98 to .91 across all reviews and more comprehensive strategies showed higher recall. CONCLUSION: An approach using relative recall instead of a hand searching gold standard proved feasible and produced recall figures that were congruent with previously published figures for the HSSS. This technique would permit validation of a methodological filter using a collection of approximately 100 studies of the chosen design drawn from the included studies of multiple systematic reviews that used comprehensive search strategies

Evaluation of sub-acute changes in cardiac function after cisplatin-based combination chemotherapy for testicular cancer

Long-term cardiovascular morbidity is increasingly observed in chemotherapy-treated testicular cancer survivors, but little is known of early sub-clinical changes in cardiac function. We prospectively evaluated cardiac function in testicular cancer patients by echocardiography. Systolic (Wall Motion Score Index) and diastolic (E/A-ratio and Tissue Velocity Imaging (TVI)) parameters, and serum levels of N-Terminal pro-Brain Natriuretic Peptide (NT-proBNP) were assessed before the start of chemotherapy and 1 year later. Echocardiography data were compared with an age-matched group of healthy controls. Forty-two patients treated with bleomycin, etoposide and cisplatin were evaluated (median age 27 years, range 18–50). Systolic function and E/A-ratio did not change, whereas the median TVI decreased (12.0 vs 10.0 cms−1; P=0.002). Median levels of NT-proBNP increased (5 vs 18 pmoll−1, P=0.034). Compared with controls, TVI before the start of chemotherapy was not significantly different. In conclusion, we found that at a median of 10 months after cisplatin-based treatment for testicular cancer, TVI decreased significantly, indicating a deterioration of diastolic cardiac function. Serum levels of NT-proBNP increased. The prognostic significance of these changes for future cardiovascular morbidity is not clear

Optimizing fluid management in patients with acute decompensated heart failure (ADHF): the emerging role of combined measurement of body hydration status and brain natriuretic peptide (BNP) levels

The study tests the hypothesis that in patients admitted with acutely decompensated heart failure (ADHF), achievement of adequate body hydration status with intensive medical therapy, modulated by combined bioelectrical vectorial impedance analysis (BIVA) and B-type natriuretic peptide (BNP) measurement, may contribute to optimize the timing of patient’s discharge and to improve clinical outcomes. Three hundred patients admitted for ADHF underwent serial BIVA and BNP measurement. Therapy was titrated to reach a BNP value of <250 pg/ml, whenever possible. Patients were categorized as early responders (rapid BNP fall below 250 pg/ml); late responders (slow BNP fall below 250 pg/ml, after aggressive therapy); and non-responders (BNP persistently >250 pg/ml). Worsening of renal function (WRF) was evaluated during hospitalization. Death and rehospitalization were monitored with a 6-month follow-up. BNP value on discharge of ≤250 pg/ml led to a 25% event rate within 6 months (Group A: 17.4%; Group B: 21%, Chi2; n.s.), whereas a value >250 pg/ml (Group C) was associated with a far higher percentage (37%). At discharge, body hydration was 73.8 ± 3.2% in the total population and 73.2 ± 2.1, 73.5 ± 2.8, 74.1 ± 3.6% in the three groups, respectively. WRF was observed in 22.3% of the total. WRF occurred in 22% in Group A, 32% in Group B, and 20% in Group C (P = n.s.). Our study confirms the hypothesis that combined BNP/BIVA sequential measurements help to achieve adequate fluid balance status in patients with ADHF and can be used to drive a “tailored therapy,” allowing clinicians to identify high-risk patients and possibly to reduce the incidence of complications secondary to fluid management strategies