Epidemiology characteristics, methodological assessment and reporting of statistical analysis of network meta-analyses in the field of cancer

Because of the methodological complexity of network meta-analyses (NMAs), NMAs may be more vulnerable to methodological risks than conventional pair-wise meta-analysis. Our study aims to investigate epidemiology characteristics, conduction of literature search, methodological quality and reporting of statistical analysis process in the field of cancer based on PRISMA extension statement and modified AMSTAR checklist. We identified and included 102 NMAs in the field of cancer. 61 NMAs were conducted using a Bayesian framework. Of them, more than half of NMAs did not report assessment of convergence (60.66%). Inconsistency was assessed in 27.87% of NMAs. Assessment of heterogeneity in traditional meta-analyses was more common (42.62%) than in NMAs (6.56%). Most of NMAs did not report assessment of similarity (86.89%) and did not used GRADE tool to assess quality of evidence (95.08%). 43 NMAs were adjusted indirect comparisons, the methods used were described in 53.49% NMAs. Only 4.65% NMAs described the details of handling of multi group trials and 6.98% described the methods of similarity assessment. The median total AMSTAR-score was 8.00 (IQR: 6.00-8.25). Methodological quality and reporting of statistical analysis did not substantially differ by selected general characteristics. Overall, the quality of NMAs in the field of cancer was generally acceptable

Measuring organisational readiness for patient engagement (MORE) : an international online Delphi consensus study

Date of Acceptance: 28/01/2015. © 2015 Oostendorp et al.; licensee BioMed Central. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise statedWidespread implementation of patient engagement by organisations and clinical teams is not a reality yet. The aim of this study is to develop a measure of organisational readiness for patient engagement designed to monitor and facilitate a healthcare organisation’s willingness and ability to effectively implement patient engagement in healthcarePeer reviewedFinal Published versio

Evidence summaries: the evolution of a rapid review approach

<p>Abstract</p> <p>Background</p> <p>Rapid reviews have emerged as a streamlined approach to synthesizing evidence - typically for informing emergent decisions faced by decision makers in health care settings. Although there is growing use of rapid review 'methods', and proliferation of rapid review products, there is a dearth of published literature on rapid review methodology. This paper outlines our experience with rapidly producing, publishing and disseminating evidence summaries in the context of our Knowledge to Action (KTA) research program.</p> <p>Methods</p> <p>The KTA research program is a two-year project designed to develop and assess the impact of a regional knowledge infrastructure that supports evidence-informed decision making by regional managers and stakeholders. As part of this program, we have developed evidence summaries - our form of rapid review - which have come to be a flagship component of this project. Our eight-step approach for producing evidence summaries has been developed iteratively, based on evidence (where available), experience and knowledge user feedback. The aim of our evidence summary approach is to deliver quality evidence that is both timely and user-friendly.</p> <p>Results</p> <p>From November 2009 to March 2011 we have produced 11 evidence summaries on a diverse range of questions identified by our knowledge users. Topic areas have included questions of clinical effectiveness to questions on health systems and/or health services. Knowledge users have reported evidence summaries to be of high value in informing their decisions and initiatives. We continue to experiment with incorporating more of the established methods of systematic reviews, while maintaining our capacity to deliver a final product in a timely manner.</p> <p>Conclusions</p> <p>The evolution of the KTA rapid review evidence summaries has been a positive one. We have developed an approach that appears to be addressing a need by knowledge users for timely, user-friendly, and trustworthy evidence and have transparently reported these methods here for the wider rapid review and scientific community.</p

Effectiveness of early intervention programs for parents of preterm infants: a meta-review of systematic reviews

Background: Various intervention programs exist for parents of preterm babies and some systematic reviews (SRs) have synthesised the evidence of their effectiveness. These reviews are, however, limited to specific interventions, components, or outcomes, and a comprehensive evidence base is lacking. The aim of this meta-review was to appraise and meta-synthesise the evidence from existing SRs to provide a comprehensive evidence base on the effectiveness of interventions for parents of preterm infants on parental and infant outcomes. Methods: We conducted a comprehensive search of the following databases to identify relevant SRs: Cochrane library, Web of science, EMBASE, CINAHL, British Nursing Index, PsycINFO, Medline, ScienceDirect, Scopus, IBSS, DOAJ, ERIC, EPPI-Centre, PROSPERO, WHO Library. Additional searches were conducted using authors’ institutional libraries, Google Scholar, and the reference lists of identified reviews. Identified articles were screened in two stages against an inclusion criteria with titles and abstracts screened first followed by full-text screening. Selected SRs were appraised using the AMSTAR tool. Extracted data using a predesigned tool were synthesised narratively examining the direction of impact on outcomes. Results: We found 11 SRs eligible for inclusion that synthesised a total of 343 quantitative primary studies. The average quality of the SRs was ‘medium’. Thirty four interventions were reported across the SRs with considerable heterogeneity in the structural framework and the targeted outcomes that included maternal-infant dyadic, maternal/parental, and infant outcomes. Among all interventions, Kangaroo Care (KC) showed the most frequent positive impact across outcomes (n = 19) followed by Mother Infant Transaction Program (MITP) (n = 14). Other interventions with most consistent positive impact on infant outcomes were Modified-Mother Infant Transaction Program (M-MITP) (n = 6), Infant Health and Development Program (IHDP) (n = 5) and Creating Opportunities for Parent Empowerment (COPE) (n = 5). Overall, interventions with both home and facility based components showed the most frequent positive impact across outcomes. Conclusions: Neonatal care policy and planning for preterm babies should consider the implementation of interventions with most positive impact on outcomes. The heterogeneity in interventions and outcomes calls for the development and implementation of an integrated program for parents of preterm infants with a clearly defined global set of parental and infant outcomes

Introducing EMMIE: An evidence rating scale to encourage mixed-method crime prevention synthesis reviews

Objectives This short report describes the need for, and the development of, a coding system to distil the quality and coverage of systematic reviews of the evidence relating to crime prevention interventions. The starting point for the coding system concerns the evidence needs of policymakers and practitioners. Methods The coding scheme (EMMIE) proposed builds on previous scales that have been developed to assess the probity, coverage and utility of evidence both in health and criminal justice. It also draws on the principles of realist synthesis and review. Results The proposed EMMIE scale identifies five dimensions to which systematic reviews intended to inform crime prevention should speak. These are the Effect of intervention, the identification of the causal Mechanism(s) through which interventions are intended to work, the factors that Moderate their impact, the articulation of practical Implementation issues, and the Economic costs of intervention

OMERACT Filter 2.1: Elaboration of the Conceptual Framework for Outcome Measurement in Health Intervention Studies

Objective: The Outcome Measures in Rheumatology (OMERACT) Filter 2.0 framework was developed in 2014 to aid core outcome set development by describing the full universe of “measurable aspects of health conditions” from which core domains can be selected. This paper provides elaborations and updated concepts (OMERACT Filter 2.1). Methods: At OMERACT 2018, we discussed challenges in the framework application caused by unclear or ambiguous wording and terms and incompletely developed concepts. Results: The updated OMERACT Filter 2.1 framework makes benefits and harms explicit, clarifies concepts, and improves naming of various terms. Conclusion: We expect that the Filter 2.1 framework will improve the process of core set development

Selecting and implementing overview methods: implications from five exemplar overviews

This is the final version of the article. Available from BioMed Central via the DOI in this record.Background Overviews of systematic reviews are an increasingly popular method of evidence synthesis; there is a lack of clear guidance for completing overviews and a number of methodological challenges. At the UK Cochrane Symposium 2016, methodological challenges of five overviews were explored. Using data from these five overviews, practical implications to support methodological decision making of authors writing protocols for future overviews are proposed. Methods Methods, and their justification, from the five exemplar overviews were tabulated and compared with areas of debate identified within current literature. Key methodological challenges and implications for development of overview protocols were generated and synthesised into a list, discussed and refined until there was consensus. Results Methodological features of three Cochrane overviews, one overview of diagnostic test accuracy and one mixed methods overview have been summarised. Methods of selection of reviews and data extraction were similar. Either the AMSTAR or ROBIS tool was used to assess quality of included reviews. The GRADE approach was most commonly used to assess quality of evidence within the reviews. Eight key methodological challenges were identified from the exemplar overviews. There was good agreement between our findings and emerging areas of debate within a recent published synthesis. Implications for development of protocols for future overviews were identified. Conclusions Overviews are a relatively new methodological innovation, and there are currently substantial variations in the methodological approaches used within different overviews. There are considerable methodological challenges for which optimal solutions are not necessarily yet known. Lessons learnt from five exemplar overviews highlight a number of methodological decisions which may be beneficial to consider during the development of an overview protocol.The overview conducted by Pollock [19] was supported by a project grant from the Chief Scientist Office of the Scottish Government. The overview conducted by McClurg [21] was supported by a project grant by the Physiotherapy Research Foundation. The overview by Hunt [22] was supported as part of doctoral programme funding by the National Institute for Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care South West Peninsula (PenCLAHRC). The overview conducted by Estcourt [20] was supported by an NIHR Cochrane Programme Grant for the Safe and Appropriate Use of Blood Components. The overview conducted by Brunton [23] was commissioned by the Department of Health as part of an ongoing programme of work on health policy research synthesis. Alex Pollock is employed by the Nursing, Midwifery and Allied Health Professions (NMAHP) Research Unit, which is supported by the Chief Scientist Office of the Scottish Government. Pauline Campbell is supported by the Chief Nurses Office of the Scottish Government

Epidemiology, Quality and Reporting Characteristics of Systematic Reviews of Traditional Chinese Medicine Interventions Published in Chinese Journals

Systematic reviews (SRs) of TCM have become increasingly popular in China and have been published in large numbers. This review provides the first examination of epidemiological characteristics of these SRs as well as compliance with the PRISMA and AMSTAR guidelines.To examine epidemiological and reporting characteristics as well as methodological quality of SRs of TCM published in Chinese journals.Four Chinese databases were searched (CBM, CSJD, CJFD and Wanfang Database) for SRs of TCM, from inception through Dec 2009. Data were extracted into Excel spreadsheets. The PRISMA and AMSTAR checklists were used to assess reporting characteristics and methodological quality, respectively.A total of 369 SRs were identified, most (97.6%) of which used the terms systematic review or meta-analysis in the title. None of the reviews had been updated. Half (49.8%) were written by clinicians and nearly half (47.7%) were reported in specialty journals. The impact factors of 45.8% of the journals published in were zero. The most commonly treated conditions were diseases of the circulatory and digestive disease. Funding sources were not reported for any reviews. Most (68.8%) reported information about quality assessment, while less than half (43.6%) reported assessing for publication bias. Statistical mistakes appeared in one-third (29.3%) of reviews and most (91.9%) did not report on conflict of interest.While many SRs of TCM interventions have been published in Chinese journals, the quality of these reviews is troubling. As a potential key source of information for clinicians and researchers, not only were many of these reviews incomplete, some contained mistakes or were misleading. Focusing on improving the quality of SRs of TCM, rather than continuing to publish them in great quantity, is urgently needed in order to increase the value of these studies