What guidance are researchers given on how to present network meta-analyses to end-users such as policymakers and clinicians? A systematic review

© 2014 Sullivan et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.Introduction: Network meta-analyses (NMAs) are complex methodological approaches that may be challenging for non-technical end-users, such as policymakers and clinicians, to understand. Consideration should be given to identifying optimal approaches to presenting NMAs that help clarify analyses. It is unclear what guidance researchers currently have on how to present and tailor NMAs to different end-users. Methods: A systematic review of NMA guidelines was conducted to identify guidance on how to present NMAs. Electronic databases and supplementary sources were searched for NMA guidelines. Presentation format details related to sample formats, target audiences, data sources, analysis methods and results were extracted and frequencies tabulated. Guideline quality was assessed following criteria developed for clinical practice guidelines. Results: Seven guidelines were included. Current guidelines focus on how to conduct NMAs but provide limited guidance to researchers on how to best present analyses to different end-users. None of the guidelines provided reporting templates. Few guidelines provided advice on tailoring presentations to different end-users, such as policymakers. Available guidance on presentation formats focused on evidence networks, characteristics of individual trials, comparisons between direct and indirect estimates and assumptions of heterogeneity and/or inconsistency. Some guidelines also provided examples of figures and tables that could be used to present information. Conclusions: Limited guidance exists for researchers on how best to present NMAs in an accessible format, especially for non-technical end-users such as policymakers and clinicians. NMA guidelines may require further integration with end-users' needs, when NMAs are used to support healthcare policy and practice decisions. Developing presentation formats that enhance understanding and accessibility of NMAs could also enhance the transparency and legitimacy of decisions informed by NMAs.The Canadian Institute of Health Research (CIHR) Drug Safety and Effectiveness Network (Funding reference number – 116573)

Evidence-informed health policy: are we beginning to get there at last

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited

Participants\u27 perceptions of a knowledge-brokering strategy to facilitate evidence-informed policy-making in Fiji

BACKGROUND: Evidence-informed policy-making (EIPM) is optimal when evidence-producers (researchers) and policy developers work collaboratively to ensure the production and use of the best available evidence. This paper examined participants’ perceptions of knowledge-brokering strategies used in the TROPIC (Translational Research in Obesity Prevention in Communities) project to facilitate the use of obesity-related evidence in policy development in Fiji. METHOD: Knowledge-brokers delivered a 12-18 month programme comprising workshops targeting EIPM skills and practical support for developing evidence-informed policy briefs to reduce obesity. The programme was tailored to each of the six participating organizations. Knowledge-brokering strategies included negotiating topics that were aligned to the goals of individual organizations, monitoring and evaluating time-management skills, accommodating other organizational and individual priorities, delivering practical sessions on use of appropriate research tools and supporting individual writing of policy briefs. Two qualitative methods were used to examine individuals’ perceptions of skills obtained, opportunities afforded by the TROPIC project, facilitators and inhibiters to planned policy brief development and suggestions for improved programme delivery. Forty-nine participants completed an electronic word table and then participated in a semi-structured interview. An independent interviewer conducted structured interviews with a high-ranking officer in each organization to examine their perceptions of TROPIC engagement strategies. Data were analyzed descriptively and thematically, with the first author and another experienced qualitative researcher analyzing data sets separately, and then combining analyses. RESULTS: Many participants believed that they had increased their skills in acquiring, assessing, adapting and applying evidence, writing policy briefs and presenting evidence-based arguments to higher levels. Many participants preferred one-to-one meetings to group activities to ensure early resolution of developing issues and to refine policy briefs. Perceived barriers to EIPM were lack of knowledge about data sources, inadequate time to develop evidence-informed briefs, and insufficient resources for accessing and managing evidence. CONCLUSION: An innovative knowledge-brokering approach utilizing skill development and mentorship facilitated individual EIPM skills and policy brief development. The TROPIC model could stimulate evidence-based policy action relating to obesity prevention and other policy areas in other Pacific countries and elsewhere

Knowledge in process? Exploring barriers between epidemiological research and local health policy development

The Redes de Trueque (RT) thrived during the economic crisis of 2001 – 2002 in Argentina and still stand out as one of the largest Complementary Currency System in the world. These local exchange networks reach a large scale during times of severe economic distress, but as large non-state initiatives, they pose a governance problem. Four types of governance systems were structured within the Argentine RT, of varying degrees of sustainability: a) loosely regulated market systems, b) hierarchies, c) associational regional networks, and d) local communities. Based on a four dimensional analytical framework, this paper discusses the rules of governance and sustainability of the governance systems in the RT. It found that some became more sustainable than others in terms of achieving combinations of scale and organisational modes

Contribution mapping: a method for mapping the contribution of research to enhance its impact.

Background: At a time of growing emphasis on both the use of research and accountability, it is important for research funders, researchers and other stakeholders to monitor and evaluate the extent to which research contributes to better action for health, and find ways to enhance the likelihood that beneficial contributions are realized. Past attempts to assess research 'impact' struggle with operationalizing 'impact', identifying the users of research and attributing impact to research projects as source. In this article we describe Contribution Mapping, a novel approach to research monitoring and evaluation that aims to assess contributions instead of impacts. The approach focuses on processes and actors and systematically assesses anticipatory efforts that aim to enhance contributions, so-called alignment efforts. The approach is designed to be useful for both accountability purposes and for assisting in better employing research to contribute to better action for health.Methods: Contribution Mapping is inspired by a perspective from social studies of science on how research and knowledge utilization processes evolve. For each research project that is assessed, a three-phase process map is developed that includes the main actors, activities and alignment efforts during research formulation, production and knowledge extension (e.g. dissemination and utilization). The approach focuses on the actors involved in, or interacting with, a research project (the linked actors) and the most likely influential users, who are referred to as potential key users. In the first stage, the investigators of the assessed project are interviewed to develop a preliminary version of the process map and first estimation of research-related contributions. In the second stage, potential key-users and other informants are interviewed to trace, explore and triangulate possible contributions. In the third stage, the presence and role of alignment efforts is analyzed and the preliminary results are shared with relevant stakeholders for feedback and validation. After inconsistencies are clarified or described, the results are shared with stakeholders for learning, improvement and accountability purposes.Conclusion: Contribution Mapping provides an interesting alternative to existing methods that aim to assess research impact. The method is expected to be useful for research monitoring, single case studies, comparing multiple cases and indicating how research can better be employed to contribute to better action for health. © 2012 Kok and Schuit; licensee BioMed Central Ltd

Knowledge brokering between researchers and policymakers in Fiji to develop policies to reduce obesity: a process evaluation

The importance of using research evidence in decision making at the policy level has been increasingly recognized. However, knowledge brokering to engage researchers and policymakers in government and non-government organizations is challenging. This paper describes and evaluates the knowledge exchange processes employed by the Translational Research on Obesity Prevention in Communities (TROPIC) project that was conducted from July 2009 to April 2012 in Fiji. TROPIC aimed to enhance: the evidence-informed decision making skills of policy developers; and awareness and utilization of local and other obesity-related evidence to develop policies that could potentially improve the nation&rsquo;s food and physical activity environments. The specific research question was: Can a knowledge brokering approach advance evidence-informed policy development to improve eating and physical activity environments in Fiji. <br /

Building the Field of Health Policy and Systems Research: An Agenda for Action

In the final article in a series addressing the current challenges and opportunities for the development of Health Policy and Systems Research (HPSR), Sara Bennett and colleagues lay out an agenda for action moving forward

Improving the use of research evidence in guideline development: 15. Disseminating and implementing guidelines

BACKGROUND: The World Health Organization (WHO), like many other organisations around the world, has recognised the need to use more rigorous processes to ensure that health care recommendations are informed by the best available research evidence. This is the 15(th )of a series of 16 reviews that have been prepared as background for advice from the WHO Advisory Committee on Health Research to WHO on how to achieve this. OBJECTIVES: In this review we address strategies for the implementation of recommendations in health care. METHODS: We examined overviews of systematic reviews of interventions to improve health care delivery and health care systems prepared by the Cochrane Effective Practice and Organisation of Care (EPOC) group. We also conducted searches using PubMed and three databases of methodological studies for existing systematic reviews and relevant methodological research. We did not conduct systematic reviews ourselves. Our conclusions are based on the available evidence, consideration of what WHO and other organisations are doing and logical arguments. KEY QUESTIONS AND ANSWERS: What should WHO do to disseminate and facilitate the uptake of recommendations? • WHO should choose strategies to implement their guidelines from among those which have been evaluated positively in the published literature on implementation research • Because the evidence base is weak and modest to moderate effects, at best, can be anticipated, WHO should promote rigorous evaluations of implementation strategies. What should be done at headquarters, by regional offices and in countries? • Adaptation and implementation of WHO guidelines should be done locally, at the national or sub-national level. • WHO headquarters and regional offices should support the development and evaluation of implementation strategies by local authorities

Aligning research to meet policy objectives for migrant families: an example from Canada

<p>Abstract</p> <p>Background</p> <p>'Evidence-based policy making' for immigrants is a complicated undertaking. In striving toward this goal, federal Canadian partners created the <it>Metropolis Project </it>in 1995 to optimize a two-way transfer of knowledge (researchers – policy makers) within five Canadian Centres of Excellence focused on migrants newly arrived in Canada. Most recently, <it>Metropolis </it>federal partners, including the Public Health Agency of Canada, defined one of six research priority areas as, immigrant 'families, children, and youth'. In order to build on previous work in the partnership, we sought to determine what has been studied within this research-policy partnership about immigrant 'families, children, and youth' since its inception.</p> <p>Methods</p> <p>Annual reports and working papers produced in the five Centres of Excellence between 1996–2006 were culled. Data on academic works were extracted, results coded according to eleven stated federal policy priority themes, and analyzed descriptively.</p> <p>Results</p> <p>139 academic works were reviewed. All federal priority themes, but few specific policy questions were addressed. The greatest volume of policy relevant works were identified for <it>Services </it>(n = 42) and <it>Education and Cultural Identity </it>(n = 39) priority themes.</p> <p>Conclusion</p> <p>Research conducted within the last 10 years is available to inform certain, not all, federal policy questions. Greater specificity in federal priorities can be expected to more clearly direct future research within this policy-research partnership.</p

Institutional capacity for health systems research in East and Central African Schools of Public Health: strengthening human and financial resources

BACKGROUND: Despite its importance in providing evidence for health-related policy and decision-making, an insufficient amount of health systems research (HSR) is conducted in low-income countries (LICs). Schools of public health (SPHs) are key stakeholders in HSR. This paper, one in a series of four, examines human and financial resources capacities, policies and organizational support for HSR in seven Africa Hub SPHs in East and Central Africa. METHODS: Capacity assessment done included document analysis to establish staff numbers, qualifications and publications; self-assessment using a tool developed to capture individual perceptions on the capacity for HSR and institutional dialogues. Key informant interviews (KIIs) were held with Deans from each SPH and Ministry of Health and non-governmental officials, focusing on perceptions on capacity of SPHs to engage in HSR, access to funding, and organizational support for HSR. RESULTS: A total of 123 people participated in the self-assessment and 73 KIIs were conducted. Except for the National University of Rwanda and the University of Nairobi SPH, most respondents expressed confidence in the adequacy of staffing levels and HSR-related skills at their SPH. However, most of the researchers operate at individual level with low outputs. The average number of HSR-related publications was only <1 to 3 per staff member over a 6-year period with most of the publications in international journals. There is dependency on external funding for HSR, except for Rwanda, where there was little government funding. We also found that officials from the Ministries of Health often formulate policy based on data generated through ad hoc technical reviews and consultancies, despite their questionable quality. CONCLUSIONS: There exists adequate skilled staff for HSR in the SPHs. However, HSR conducted by individuals, fuelled by Ministries’ of Health tendency to engage individual researchers, undermines institutional capacity. This study underscores the need to form effective multidisciplinary teams to enhance research of immediate and local relevance. Capacity strengthening in the SPH needs to focus on knowledge translation and communication of findings to relevant audiences. Advocacy is needed to influence respective governments to allocate adequate funding for HSR to avoid donor dependency that distorts local research agenda.DFI