Meta-DiSc 2.0:a web application for meta-analysis of diagnostic test accuracy data

BACKGROUND: Diagnostic evidence of the accuracy of a test for identifying a target condition of interest can be estimated using systematic approaches following standardized methodologies. Statistical methods for the meta-analysis of diagnostic test accuracy (DTA) studies are relatively complex, presenting a challenge for reviewers without extensive statistical expertise. In 2006, we developed Meta-DiSc, a free user-friendly software to perform test accuracy meta-analysis. This statistical program is now widely used for performing DTA meta-analyses. We aimed to build a new version of the Meta-DiSc software to include statistical methods based on hierarchical models and an enhanced web-based interface to improve user experience. RESULTS: In this article, we present the updated version, Meta-DiSc 2.0, a web-based application developed using the R Shiny package. This new version implements recommended state-of-the-art statistical models to overcome the limitations of the statistical approaches included in the previous version. Meta-DiSc 2.0 performs statistical analyses of DTA reviews using a bivariate random effects model. The application offers a thorough analysis of heterogeneity, calculating logit variance estimates of sensitivity and specificity, the bivariate I-squared, the area of the 95% prediction ellipse, and the median odds ratios for sensitivity and specificity, and facilitating subgroup and meta-regression analyses. Furthermore, univariate random effects models can be applied to meta-analyses with few studies or with non-convergent bivariate models. The application interface has an intuitive design set out in four main menus: file upload; graphical description (forest and ROC plane plots); meta-analysis (pooling of sensitivity and specificity, estimation of likelihood ratios and diagnostic odds ratio, sROC curve); and summary of findings (impact of test through downstream consequences in a hypothetical population with a given prevalence). All computational algorithms have been validated in several real datasets by comparing results obtained with STATA/SAS and MetaDTA packages. CONCLUSION: We have developed and validated an updated version of the Meta-DiSc software that is more accessible and statistically sound. The web application is freely available at www.metadisc.es

Basal procalcitonin, C-reactive protein, interleukin-6, and presepsin for prediction of mortality in critically ill septic patients: a systematic review and meta-analysis

Biomarkers; Mortality; SepsisBiomarcadores; Mortalidad; SepsisBiomarcadors; Mortalitat; SèpsiaBackground Numerous biomarkers have been proposed for diagnosis, therapeutic, and prognosis in sepsis. Previous evaluations of the value of biomarkers for predicting mortality due to this life-threatening condition fail to address the complexity of this condition and the risk of bias associated with prognostic studies. We evaluate the predictive performance of four of these biomarkers in the prognosis of mortality through a methodologically sound evaluation. Methods We conducted a systematic review a systematic review and meta-analysis to determine, in critically ill adults with sepsis, whether procalcitonin (PCT), C-reactive protein (CRP), interleukin-6 (IL-6), and presepsin (sCD14) are independent prognostic factors for mortality. We searched MEDLINE, EMBASE, and the Cochrane Central Register of Controlled Trials up to March 2023. Only Phase-2 confirmatory prognostic factor studies among critically ill septic adults were included. Random effects meta-analyses pooled the prognostic association estimates. Results We included 60 studies (15,681 patients) with 99 biomarker assessments. Quality of the statistical analysis and reporting domains using the QUIPS tool showed high risk of bias in > 60% assessments. The biomarker measurement as a continuous variable in models adjusted by key covariates (age and severity score) for predicting mortality at 28–30 days showed a null or near to null association for basal PCT (pooled OR = 0.99, 95% CI = 0.99–1.003), CRP (OR = 1.01, 95% CI = 0.87 to 1.17), and IL-6 (OR = 1.02, 95% CI = 1.01–1.03) and sCD14 (pooled HR = 1.003, 95% CI = 1.000 to 1.006). Additional meta-analyses accounting for other prognostic covariates had similarly null findings. Conclusion Baseline, isolated measurement of PCT, CRP, IL-6, and sCD14 has not been shown to help predict mortality in critically ill patients with sepsis. The role of these biomarkers should be evaluated in new studies where the patient selection would be standardized and the measurement of biomarker results.Instituto de Salud Carlos III, Spain and European Union (“Fondo Europeo de Desarrollo Regional, Una manera de hacer Europa”), grant number [PI 19/0048]

Mini-Mental State Examination (MMSE) for the detection of Alzheimer's disease and other dementias in people with mild cognitive impairment (MCI).

BACKGROUND: Dementia is a progressive global cognitive impairment syndrome. In 2010, more than 35 million people worldwide were estimated to be living with dementia. Some people with mild cognitive impairment (MCI) will progress to dementia but others remain stable or recover full function. There is great interest in finding good predictors of dementia in people with MCI. The Mini-Mental State Examination (MMSE) is the best-known and the most often used short screening tool for providing an overall measure of cognitive impairment in clinical, research and community settings. OBJECTIVES: To determine the diagnostic accuracy of the MMSE at various thresholds for detecting individuals with baseline MCI who would clinically convert to dementia in general, Alzheimer's disease dementia or other forms of dementia at follow-up. SEARCH METHODS: We searched ALOIS (Cochrane Dementia and Cognitive Improvement Specialized Register of diagnostic and intervention studies (inception to May 2014); MEDLINE (OvidSP) (1946 to May 2014); EMBASE (OvidSP) (1980 to May 2014); BIOSIS (Web of Science) (inception to May 2014); Web of Science Core Collection, including the Conference Proceedings Citation Index (ISI Web of Science) (inception to May 2014); PsycINFO (OvidSP) (inception to May 2014), and LILACS (BIREME) (1982 to May 2014). We also searched specialized sources of diagnostic test accuracy studies and reviews, most recently in May 2014: MEDION (Universities of Maastricht and Leuven, www.mediondatabase.nl), DARE (Database of Abstracts of Reviews of Effects, via the Cochrane Library), HTA Database (Health Technology Assessment Database, via the Cochrane Library), and ARIF (University of Birmingham, UK, www.arif.bham.ac.uk). No language or date restrictions were applied to the electronic searches and methodological filters were not used as a method to restrict the search overall so as to maximize sensitivity. We also checked reference lists of relevant studies and reviews, tracked citations in Scopus and Science Citation Index, used searches of known relevant studies in PubMed to track related articles, and contacted research groups conducting work on MMSE for dementia diagnosis to try to locate possibly relevant but unpublished data. SELECTION CRITERIA: We considered longitudinal studies in which results of the MMSE administered to MCI participants at baseline were obtained and the reference standard was obtained by follow-up over time. We included participants recruited and clinically classified as individuals with MCI under Petersen and revised Petersen criteria, Matthews criteria, or a Clinical Dementia Rating = 0.5. We used acceptable and commonly used reference standards for dementia in general, Alzheimer's dementia, Lewy body dementia, vascular dementia and frontotemporal dementia. DATA COLLECTION AND ANALYSIS: We screened all titles generated by the electronic database searches. Two review authors independently assessed the abstracts of all potentially relevant studies. We assessed the identified full papers for eligibility and extracted data to create two by two tables for dementia in general and other dementias. Two authors independently performed quality assessment using the QUADAS-2 tool. Due to high heterogeneity and scarcity of data, we derived estimates of sensitivity at fixed values of specificity from the model we fitted to produce the summary receiver operating characteristic curve. MAIN RESULTS: In this review, we included 11 heterogeneous studies with a total number of 1569 MCI patients followed for conversion to dementia. Four studies assessed the role of baseline scores of the MMSE in conversion from MCI to all-cause dementia and eight studies assessed this test in conversion from MCI to Alzheimer´s disease dementia. Only one study provided information about the MMSE and conversion from MCI to vascular dementia. For conversion from MCI to dementia in general, the accuracy of baseline MMSE scores ranged from sensitivities of 23% to 76% and specificities from 40% to 94%. In relationship to conversion from MCI to Alzheimer's disease dementia, the accuracy of baseline MMSE scores ranged from sensitivities of 27% to 89% and specificities from 32% to 90%. Only one study provided information about conversion from MCI to vascular dementia, presenting a sensitivity of 36% and a specificity of 80% with an incidence of vascular dementia of 6.2%. Although we had planned to explore possible sources of heterogeneity, this was not undertaken due to the scarcity of studies included in our analysis. AUTHORS' CONCLUSIONS: Our review did not find evidence supporting a substantial role of MMSE as a stand-alone single-administration test in the identification of MCI patients who could develop dementia. Clinicians could prefer to request additional and extensive tests to be sure about the management of these patients. An important aspect to assess in future updates is if conversion to dementia from MCI stages could be predicted better by MMSE changes over time instead of single measurements. It is also important to assess if a set of tests, rather than an isolated one, may be more successful in predicting conversion from MCI to dementia

Current methods for development of rapid reviews about diagnostic tests: an international survey

Background Rapid reviews (RRs) have emerged as an efficient alternative to time-consuming systematic reviews—they can help meet the demand for accelerated evidence synthesis to inform decision-making in healthcare. The synthesis of diagnostic evidence has important methodological challenges. Here, we performed an international survey to identify the current practice of producing RRs for diagnostic tests. Methods We developed and administered an online survey inviting institutions that perform RRs of diagnostic tests from all over the world. Results All participants (N = 25) reported the implementation of one or more methods to define the scope of the RR; however, only one strategy (defining a structured question) was used by ≥90% of participants. All participants used at least one methodological shortcut including the use of a previous review as a starting point (92%) and the use of limits on the search (96%). Parallelization and automation of review tasks were not extensively used (48 and 20%, respectively). Conclusion Our survey indicates a greater use of shortcuts and limits for conducting diagnostic test RRs versus the results of a recent scoping review analyzing published RRs. Several shortcuts are used without knowing how their implementation affects the results of the evidence synthesis in the setting of diagnostic test reviews. Thus, a structured evaluation of the challenges and implications of the adoption of these RR methods is warranted

How to develop rapid reviews of diagnostic tests according to experts: A qualitative exploration of researcher views

Background: Rapid reviews (RRs) have been used to provide timely evidence for policymakers, health providers, and the public in several healthcare scenarios, most recently during the coronavirus disease 2019 pandemic. Despite the essential role of diagnosis in clinical management, data about how to perform RRs of diagnostic tests are scarce. We aimed to explore the views and perceptions of experts in evidence synthesis and diagnostic evidence about the value of methods used to accelerate the review process. Methods: We performed semistructured interviews with a purposive sample of experts in evidence synthesis and diagnostic evidence. We carried out the interviews in English between July and December 2021. Initial reading and coding of the transcripts were performed using NVIVO qualitative data analysis software. Results: Of a total of 23 invited experts, 16 (70%) responded. We interviewed all 16 participants representing key roles in evidence synthesis. We identified 14 recurring themes including the review question, characteristics of the review team, and use of automation, as the topics with the highest number of quotes. Some participants considered several methodological “shortcuts” to be ineffective or risky, such as automating quality appraisal, using only one reviewer for diagnostic data extraction and only performing descriptive analysis. The introduction of limits might depend on whether the test being assessed is a new test, the availability of alternative tests, the needs of providers and patients, and the availability of high‐quality systematic reviews. Conclusions: Our findings suggest that organizational strategies (e.g., defining the review question, availability of a highly experienced team) may have a role in conducting RRs of diagnostic tests. Several methodological shortcuts were considered inadequate for accelerating the review process, though they need to be assessed in well‐designed studies. Improved reporting of RRs would support evidence‐based decision‐making and help users of RRs understand their limitations

Effectiveness of Screening and Treatment Approaches for Schistosomiasis and Strongyloidiasis in Newly-Arrived Migrants from Endemic Countries in the EU/EEA: A Systematic Review

We aimed to evaluate the evidence on screening and treatment for two parasitic infections—schistosomiasis and strongyloidiasis—among migrants from endemic countries arriving in the European Union and European Economic Area (EU/EEA). We conducted a systematic search of multiple databases to identify systematic reviews and meta-analyses published between 1 January 1993 and 30 May 2016 presenting evidence on diagnostic and treatment efficacy and cost-effectiveness. We conducted additional systematic search for individual studies published between 2010 and 2017. We assessed the methodological quality of reviews and studies using the AMSTAR, Newcastle–Ottawa Scale and QUADAS-II tools. Study synthesis and assessment of the certainty of the evidence was performed using GRADE (Grading of Recommendations Assessment, Development and Evaluation) approach. We included 28 systematic reviews and individual studies in this review. The GRADE certainty of evidence was low for the effectiveness of screening techniques and moderate to high for treatment efficacy. Antibody-detecting serological tests are the most effective screening tests for detection of both schistosomiasis and strongyloidiasis in low-endemicity settings, because they have higher sensitivity than conventional parasitological methods. Short courses of praziquantel and ivermectin were safe and highly effective and cost-effective in treating schistosomiasis and strongyloidiasis, respectively. Economic modelling suggests presumptive single-dose treatment of strongyloidiasis with ivermectin for all migrants is likely cost-effective, but feasibility of this strategy has yet to be demonstrated in clinical studies. The evidence supports screening and treatment for schistosomiasis and strongyloidiasis in migrants from endemic countries, to reduce morbidity and mortality

Occurrence and transmission potential of asymptomatic and presymptomatic SARS-CoV-2 infections : update of a living systematic review and meta-analysis

Funding: This study was funded by the Swiss National Science Foundation http://www.snf.ch/en (NL: 320030_176233); the European Union Horizon 2020 research and innovation programme https://ec.europa.eu/programmes/horizon2020/en (NL: 101003688); the Swiss government excellence scholarship https://www.sbfi.admin.ch/sbfi/en/home/education/scholarships-and-grants/swiss-government-excellence-scholarships.html (DBG: 2019.0774) and the Swiss School of Public Health Global P3HS stipend https://ssphplus.ch/en/ (DBG).Background : Debate about the level of asymptomatic Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) infection continues. The amount of evidence is increasing and study designs have changed over time. We updated a living systematic review to address 3 questions: (1) Among people who become infected with SARS-CoV-2, what proportion does not experience symptoms at all during their infection? (2) What is the infectiousness of asymptomatic and presymptomatic, compared with symptomatic, SARS-CoV-2 infection? (3) What proportion of SARS-CoV-2 transmission in a population is accounted for by people who are asymptomatic or presymptomatic? Methods and findings : The protocol was first published on 1 April 2020 and last updated on 18 June 2021. We searched PubMed, Embase, bioRxiv, and medRxiv, aggregated in a database of SARS-CoV-2 literature, most recently on 6 July 2021. Studies of people with PCR-diagnosed SARS-CoV-2, which documented symptom status at the beginning and end of follow-up, or mathematical modelling studies were included. Studies restricted to people already diagnosed, of single individuals or families, or without sufficient follow-up were excluded. One reviewer extracted data and a second verified the extraction, with disagreement resolved by discussion or a third reviewer. Risk of bias in empirical studies was assessed with a bespoke checklist and modelling studies with a published checklist. All data syntheses were done using random effects models. Review question (1): We included 130 studies. Heterogeneity was high so we did not estimate a mean proportion of asymptomatic infections overall (interquartile range (IQR) 14% to 50%, prediction interval 2% to 90%), or in 84 studies based on screening of defined populations (IQR 20% to 65%, prediction interval 4% to 94%). In 46 studies based on contact or outbreak investigations, the summary proportion asymptomatic was 19% (95% confidence interval (CI) 15% to 25%, prediction interval 2% to 70%). (2) The secondary attack rate in contacts of people with asymptomatic infection compared with symptomatic infection was 0.32 (95% CI 0.16 to 0.64, prediction interval 0.11 to 0.95, 8 studies). (3) In 13 modelling studies fit to data, the proportion of all SARS-CoV-2 transmission from presymptomatic individuals was higher than from asymptomatic individuals. Limitations of the evidence include high heterogeneity and high risks of selection and information bias in studies that were not designed to measure persistently asymptomatic infection, and limited information about variants of concern or in people who have been vaccinated. Conclusions : Based on studies published up to July 2021, most SARS-CoV-2 infections were not persistently asymptomatic, and asymptomatic infections were less infectious than symptomatic infections. Summary estimates from meta-analysis may be misleading when variability between studies is extreme and prediction intervals should be presented. Future studies should determine the asymptomatic proportion of SARS-CoV-2 infections caused by variants of concern and in people with immunity following vaccination or previous infection. Without prospective longitudinal studies with methods that minimise selection and measurement biases, further updates with the study types included in this living systematic review are unlikely to be able to provide a reliable summary estimate of the proportion of asymptomatic infections caused by SARS-CoV-2. Review protocol : Open Science Framework (https://osf.io/9ewys/)Publisher PDFPeer reviewe

Rapid reviews of medical tests used many similar methods to systematic reviews but key items were rarely reported: a scoping review.

BACKGROUND Rapid reviews provide an efficient alternative to standard systematic reviews in response to a high priority or urgent need. Although rapid reviews of interventions have been extensively evaluated, little is known about the characteristics of rapid reviews of diagnostic evidence. STUDY DESIGN AND SETTING We performed a scoping review for rapid reviews of medical tests published from 2013 to 2018. We extracted information on review characteristics and methods used to assess the evidence. RESULTS We identified 191 rapid reviews. All reviews were developed within a short time (less than 12 months) and were relatively concise (less than 10 pages). The reviews involved multiple index tests (44%), multiple outcomes (88%), and several test applications (29%). Well-known methodological tailoring strategies were infrequently used. Although reporting of several key features was limited, we found that, in general, rapid reviews have similar characteristics to broader knowledge syntheses. CONCLUSION Our scoping review is the first to describe the characteristics and methods of rapid reviews of diagnostic evidence. Future research should identify the most appropriate methods for performing rapid reviews of medical tests. Standards for reporting of rapid reviews are needed

Effectiveness of Screening and Treatment Approaches for Schistosomiasis and Strongyloidiasis in Newly-Arrived Migrants from Endemic Countries in the EU/EEA : A Systematic Review

We aimed to evaluate the evidence on screening and treatment for two parasitic infections-schistosomiasis and strongyloidiasis-among migrants from endemic countries arriving in the European Union and European Economic Area (EU/EEA). We conducted a systematic search of multiple databases to identify systematic reviews and meta-analyses published between 1 January 1993 and 30 May 2016 presenting evidence on diagnostic and treatment efficacy and cost-effectiveness. We conducted additional systematic search for individual studies published between 2010 and 2017. We assessed the methodological quality of reviews and studies using the AMSTAR, Newcastle-Ottawa Scale and QUADAS-II tools. Study synthesis and assessment of the certainty of the evidence was performed using GRADE (Grading of Recommendations Assessment, Development and Evaluation) approach. We included 28 systematic reviews and individual studies in this review. The GRADE certainty of evidence was low for the effectiveness of screening techniques and moderate to high for treatment efficacy. Antibody-detecting serological tests are the most effective screening tests for detection of both schistosomiasis and strongyloidiasis in low-endemicity settings, because they have higher sensitivity than conventional parasitological methods. Short courses of praziquantel and ivermectin were safe and highly effective and cost-effective in treating schistosomiasis and strongyloidiasis, respectively. Economic modelling suggests presumptive single-dose treatment of strongyloidiasis with ivermectin for all migrants is likely cost-effective, but feasibility of this strategy has yet to be demonstrated in clinical studies. The evidence supports screening and treatment for schistosomiasis and strongyloidiasis in migrants from endemic countries, to reduce morbidity and mortality