Analysis of COVID-19 Guideline Quality and Change of Recommendations: A Systematic Review.

Background Hundreds of coronavirus disease 2019 (COVID-19) clinical practice guidelines (CPGs) and expert consensus statements have been developed and published since the outbreak of the epidemic. However, these CPGs are of widely variable quality. So, this review is aimed at systematically evaluating the methodological and reporting qualities of COVID-19 CPGs, exploring factors that may influence their quality, and analyzing the change of recommendations in CPGs with evidence published. Methods We searched five electronic databases and five websites from 1 January to 31 December 2020 to retrieve all COVID-19 CPGs. The assessment of the methodological and reporting qualities of CPGs was performed using the AGREE II instrument and RIGHT checklist. Recommendations and evidence used to make recommendations in the CPGs regarding some treatments for COVID-19 (remdesivir, glucocorticoids, hydroxychloroquine/chloroquine, interferon, and lopinavir-ritonavir) were also systematically assessed. And the statistical inference was performed to identify factors associated with the quality of CPGs. Results We included a total of 92 COVID-19 CPGs developed by 19 countries. Overall, the RIGHT checklist reporting rate of COVID-19 CPGs was 33.0%, and the AGREE II domain score was 30.4%. The overall methodological and reporting qualities of COVID-19 CPGs gradually improved during the year 2020. Factors associated with high methodological and reporting qualities included the evidence-based development process, management of conflicts of interest, and use of established rating systems to assess the quality of evidence and strength of recommendations. The recommendations of only seven (7.6%) CPGs were informed by a systematic review of evidence, and these seven CPGs have relatively high methodological and reporting qualities, in which six of them fully meet the Institute of Medicine (IOM) criteria of guidelines. Besides, a rapid advice CPG developed by the World Health Organization (WHO) of the seven CPGs got the highest overall scores in methodological (72.8%) and reporting qualities (83.8%). Many CPGs covered the same clinical questions (it refers to the clinical questions on the effectiveness of treatments of remdesivir, glucocorticoids, hydroxychloroquine/chloroquine, interferon, and lopinavir-ritonavir in COVID-19 patients) and were published by different countries or organizations. Although randomized controlled trials and systematic reviews on the effectiveness of treatments of remdesivir, glucocorticoids, hydroxychloroquine/chloroquine, interferon, and lopinavir-ritonavir for patients with COVID-19 have been published, the recommendations on those treatments still varied greatly across COVID-19 CPGs published in different countries or regions, which may suggest that the CPGs do not make sufficient use of the latest evidence. Conclusions Both the methodological and reporting qualities of COVID-19 CPGs increased over time, but there is still room for further improvement. The lack of effective use of available evidence and management of conflicts of interest were the main reasons for the low quality of the CPGs. The use of formal rating systems for the quality of evidence and strength of recommendations may help to improve the quality of CPGs in the context of the COVID-19 pandemic. During the pandemic, we suggest developing a living guideline of which recommendations are supported by a systematic review for it can facilitate the timely translation of the latest research findings to clinical practice. We also suggest that CPG developers should register the guidelines in a registration platform at the beginning for it can reduce duplication development of guidelines on the same clinical question, increase the transparency of the development process, and promote cooperation among guideline developers all over the world. Since the International Practice Guideline Registry Platform has been created, developers could register guidelines prospectively and internationally on this platform

Consistency of recommendations and methodological quality of guidelines for the diagnosis and treatment of COVID-19

Objective: Since the beginning of the COVID-19 epidemic, a large number of guidelines on diagnosis and treatment of COVID-19 have been developed, but the quality of those guidelines and the consistency of recommendations are unclear. The objective of this study is to evaluate the quality of the diagnosis and treatment guidelines on COVID-19 and analyze the consistency of the recommendations of these guidelines. Methods: We searched for guidelines on diagnosis and/or treatment of COVID-19 through PubMed, CBM, CNKI, and WanFang Data, from January 1, 2020 to August 31, 2020. In addition, we also searched official websites of the US CDC, European CDC and WHO, and some guideline collection databases. We included diagnosis and/or treatment guidelines for COVID-19, including rapid advice guidelines and interim guidelines. Two trained researchers independently extracted data and four trained researchers evaluated the quality of the guidelines using the AGREE II instruments. We extracted information on the basic characteristics of the guidelines, guideline development process, and the recommendations. We described the consistency of the direction of recommendations for treatment and diagnosis of COVID-19 across the included guidelines. Results: A total of 37 guidelines were included. Most included guidelines were assessed as low quality, with only one of the six domains of AGREE II (clarity of presentation) having a mean score above 50%. The mean scores of three domains (stakeholder involvement, the rigor of development and applicability) were all below 30%. The recommendations on diagnosis and treatment were to some extent consistent between the included guidelines. Computed tomography (CT), X-rays, lung ultrasound, RT-PCR, and routine blood tests were the most commonly recommended methods for COVID-19 diagnosis. Thirty guidelines were on the treatment of COVID-19. The recommended forms of treatment included supportive care, antiviral therapy, glucocorticoid therapy, antibiotics, immunoglobulin, extracorporeal membrane oxygenation (ECMO), convalescent plasma, and psychotherapy. Conclusions: The methodological quality of currently available diagnosis and treatment guidelines for COVID-19 is low. The diagnosis and treatment recommendations between the included guidelines are highly consistent. The main diagnostic methods for COVID-19 are RT-PCR and CT, with ultrasound as a potential diagnostic tool. As there is no effective treatment against COVID-19 yet, supportive therapy is at the moment the most important treatment option