Improving the use of research evidence in guideline development: 9. Grading evidence and recommendations

BACKGROUND: The World Health Organization (WHO), like many other organisations around the world, has recognised the need to use more rigorous processes to ensure that health care recommendations are informed by the best available research evidence. This is the ninth of a series of 16 reviews that have been prepared as background for advice from the WHO Advisory Committee on Health Research to WHO on how to achieve this. OBJECTIVES: We reviewed the literature on grading evidence and recommendations in guidelines. METHODS: We searched PubMed and three databases of methodological studies for existing systematic reviews and relevant methodological research. We did not conduct a full systematic review ourselves. Our conclusions are based on the available evidence, consideration of what WHO and other organisations are doing and logical arguments. KEY QUESTIONS AND ANSWERS: Should WHO grade the quality of evidence and the strength of recommendations? • Users of recommendations need to know how much confidence they can place in the underlying evidence and the recommendations. The degree of confidence depends on a number of factors and requires complex judgments. These judgments should be made explicitly in WHO recommendations. A systematic and explicit approach to making judgments about the quality of evidence and the strength of recommendations can help to prevent errors, facilitate critical appraisal of these judgments, and can help to improve communication of this information. What criteria should be used to grade evidence and recommendations? • Both the quality of evidence and the strength of recommendations should be graded. The criteria used to grade the strength of recommendations should include the quality of the underlying evidence, but should not be limited to that. • The approach to grading should be one that has wide international support and is suitable for a wide range of different types of recommendations. The Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach, which is currently suggested in the Guidelines for WHO Guidelines, is being used by an increasing number of other organizations internationally. It should be used more consistently by WHO. Further developments of this approach should ensure its wide applicability. Should WHO use the same grading system for all of its recommendations? • Although there are arguments for and against using the same grading system across a wide range of different types of recommendations, WHO should use a uniform grading system to prevent confusion for developers and users of recommendations

Improving the use of research evidence in guideline development: 1. Guidelines for guidelines

BACKGROUND: The World Health Organization (WHO), like many other organisations around the world, has recognised the need to use more rigorous processes to ensure that health care recommendations are informed by the best available research evidence. This is the first of a series of 16 reviews that have been prepared as background for advice from the WHO Advisory Committee on Health Research to WHO on how to achieve this. OBJECTIVES: We reviewed the literature on guidelines for the development of guidelines. METHODS: We searched PubMed and three databases of methodological studies for existing systematic reviews and relevant methodological research. We did not conduct systematic reviews ourselves. Our conclusions are based on the available evidence, consideration of what WHO and other organisations are doing and logical arguments. KEY QUESTIONS AND ANSWERS: We found no experimental research that compared different formats of guidelines for guidelines or studies that compared different components of guidelines for guidelines. However, there are many examples, surveys and other observational studies that compared the impact of different guideline development documents on guideline quality. WHAT HAVE OTHER ORGANIZATIONS DONE TO DEVELOP GUIDELINES FOR GUIDELINES FROM WHICH WHO CAN LEARN? • Establish a credible, independent committee that evaluates existing methods for developing guidelines or that updates existing ones. • Obtain feedback and approval from various stakeholders during the development process of guidelines for guidelines. • Develop a detailed source document (manual) that guideline developers can use as reference material. WHAT SHOULD BE THE KEY COMPONENTS OF WHO GUIDELINES FOR GUIDELINES? • Guidelines for guidelines should include information and instructions about the following components: 1) Priority setting; 2) Group composition and consultations; 3) Declaration and avoidance of conflicts of interest; 4) Group processes; 5) Identification of important outcomes; 6) Explicit definition of the questions and eligibility criteria ; 7) Type of study designs for different questions; 8) Identification of evidence; 9) Synthesis and presentation of evidence; 10) Specification and integration of values; 11) Making judgments about desirable and undesirable effects; 12) Taking account of equity; 13) Grading evidence and recommendations; 14) Taking account of costs; 15) Adaptation, applicability, transferability of guidelines; 16) Structure of reports; 17) Methods of peer review; 18) Planned methods of dissemination & implementation; 19) Evaluation of the guidelines. WHAT HAVE OTHER ORGANIZATIONS DONE TO IMPLEMENT GUIDELINES FOR GUIDELINES FROM WHICH WHO CAN LEARN? • Obtain buy-in from regions and country level representatives for guidelines for guidelines before dissemination of a revised version. • Disseminate the guidelines for guidelines widely and make them available (e.g. on the Internet). • Develop examples of guidelines that guideline developers can use as models when applying the guidelines for guidelines. • Ensure training sessions for those responsible for developing guidelines. • Continue to monitor the methodological literature on guideline development

Institutional capacity for health systems research in East and Central African schools of public health: knowledge translation and effective communication

BACKGROUND: Local health systems research (HSR) provides policymakers and practitioners with contextual, evidence-based solutions to health problems. However, producers and users of HSR rarely understand the complexities of the context within which each operates, leading to the “know–do” gap. Universities are well placed to conduct knowledge translation (KT) integrating research production with uptake. The HEALTH Alliance Africa Hub, a consortium of seven schools of public health (SPHs) in East and Central Africa, was formed to build capacity in HSR. This paper presents information on the capacity of the various SPHs to conduct KT activities. METHODS: In 2011, each member of the Africa Hub undertook an institutional HSR capacity assessment using a context-adapted and modified self-assessment tool. KT capacity was measured by several indicators including the presence of a KT strategy, an organizational structure to support KT activities, KT skills, and institutional links with stakeholders and media. Respondents rated their opinions on the various indicators using a 5-point Likert scale. Averages across all respondents for each school were calculated. Thereafter, each school held a results validation workshop. RESULTS: A total of 123 respondents from all seven SPHs participated. Only one school had a clear KT strategy; more commonly, research was disseminated at scientific conferences and workshops. While most respondents perceived their SPH as having strong institutional ties with organizations interested in HSR as well as strong institutional leadership, the organizational structures required to support KT activities were absent. Furthermore, individual researchers indicated that they had little time or skills to conduct KT. Additionally, institutional and individual links with policymakers and media were reported as weak. CONCLUSIONS: Few SPHs in Africa have a clear KT strategy. Strengthening the weak KT capacity of the SPHs requires working with institutional leadership to develop KT strategies designed to guide organizational structure and development of networks with both the media and policymakers to improve research uptake.DFI

Evidence for Health I: Producing evidence for improving health and reducing inequities

10.1186/s12961-016-0087-2Health Research Policy and Systems1411

Evidence for Health II: Overcoming barriers to using evidence in policy and practice

10.1186/s12961-016-0086-3Health Research Policy and Systems1411

Evidence for Health III: Making evidence-informed decisions that integrate values and context

10.1186/s12961-016-0085-4Health Research Policy and Systems1411