SUPPORT Tools for evidence-informed health Policymaking (STP) 13: Preparing and using policy briefs to support evidence-informed policymaking

This article is part of a series written for people responsible for making decisions about health policies and programmes and for those who support these decision makers

Jurisdictional scans in policy making: A critical interpretive synthesis

Jurisdictional scans are used as governmental decisionmaking tools to understand how problems have been framed in other jurisdictions, to compare and evaluate options based on action taken in other jurisdictions, and to identify implementation considerations. Though widely used, their methodologies are poorly described and associated benefits and limitations are poorly articulated

SUPPORT Tools for evidence-informed health Policymaking (STP)

This article is the Introduction to a series written for people responsible for making decisions about health policies and programmes and for those who support these decision makers

A scoping review about conference objectives and evaluative practices: how do we get more out of them?

Large multi-day conferences have often been criticized as ineffective ways to improve social outcomes and to influence policy or practice. Unfortunately, many conference evaluations have also been inadequate in determining the impact of a conference on its associated social sector, with little evidence gathered or analyzed to substantiate or refute these criticisms. The aim of this scoping review is to investigate and report stakeholders’ objectives for planning or participating in large multi-day conferences and how these objectives are being evaluated. We conducted a scoping review supplemented by a small number of key informant interviews. Eight bibliographic databases were systematically searched to identify papers describing conference objectives and/or evaluations. We developed a conference evaluation framework based on theoretical models and empirical findings, which structured the descriptive synthesis of the data. We identified 3,073 potential papers for review, of which 44 were included in this study. Our evaluation framework connects five key elements in planning a conference and its evaluation (number in brackets refers to number of themes identified): conference objectives (8), purpose of evaluation (7), evaluation methods (5), indicators of success (9) and theories/models (8). Further analysis of indicators of success identified three categories of indicators with differing scopes (i.e. immediate, prospective or follow-up) as well as empirical links between the purpose of evaluations and these indicators. Conference objectives and evaluations were largely correlated with the type of conference (i.e. academic, political/governmental or business) but diverse overall. While much can be done to improve the quality and usefulness of conference evaluations, there are innovative assessments that are currently being utilized by some conferences and warrant further investigation. This review provides conference evaluators and organizers a simple resource to improve their own assessments by highlighting and categorizing potential objectives and evaluation strategies

SUPPORT Tools for evidence-informed health Policymaking (STP) 14: Organising and using policy dialogues to support evidence-informed policymaking

This article is part of a series written for people responsible for making decisions about health policies and programmes and for those who support these decision makers

Guidance for Evidence-Informed Policies about Health Systems: Linking Guidance Development to Policy Development

In the second paper in a three-part series on health systems guidance, John Lavis and colleagues explore the challenge of linking guidance development and policy development at global and national levels

Evaluating deliberative dialogues focussed on healthy public policy

Background: Deliberative dialogues have recently captured attention in the public health policy arena because they have the potential to address several key factors that influence the use of research evidence in policymaking. We conducted an evaluation of three deliberative dialogues convened in Canada by the National Collaborating Centre for Healthy Public Policy in order to learn more about deliberative dialogues focussed on healthy public policy. Methods: The evaluation included a formative assessment of participants’ views about and experiences with ten key design features of the dialogues, and a summative assessment of participants’ intention to use research evidence of the type that was discussed at the dialogue. We surveyed participants immediately after each dialogue was completed and again six months later. We analyzed the ratings using descriptive statistics and the written comments by conducting a thematic analysis. Results: A total of 31 individuals participated in the three deliberative dialogues that we evaluated. The response rate was 94% (N = 29; policymakers (n = 9), stakeholders (n = 18), researchers (n = 2)) for the initial survey and 56% (n = 14) for the follow-up. All 10 of the design features that we examined as part of the formative evaluation were rated favourably by all participant groups. The findings of the summative evaluation demonstrated a mean behavioural intention score of 5.8 on a scale from 1 (strongly disagree) to 7 (strongly agree). Conclusion: Our findings reinforce the promise of deliberative dialogues as a strategy for supporting evidence-informed public health policies. Additional work is needed to understand more about which design elements work in which situations and for different issues, and whether intention to use research evidence is a suitable substitute for measuring actual behaviour change

SUPPORT Tools for evidence-informed health Policymaking (STP) 7: Finding systematic reviews

This article is part of a series written for people responsible for making decisions about health policies and programmes and for those who support these decision makers

The global stock of research evidence relevant to health systems policymaking

Background: Policymakers and stakeholders need immediate access to many types of research evidence to make informed decisions about the full range of questions that may arise regarding health systems. Methods: We examined all types of research evidence about governance, financial and delivery arrangements, and implementation strategies within health systems contained in Health Systems Evidence (HSE) (http://www.healthsystemsevidence.org). The research evidence types include evidence briefs for policy, overviews of systematic reviews, systematic reviews of effects, systematic reviews addressing other questions, systematic reviews in progress, systematic reviews being planned, economic evaluations, and health reform and health system descriptions. Specifically, we describe their distribution across health system topics and domains, trends in their production over time, availability of supplemental content in various languages, and the extent to which they focus on low- and middle-income countries (LMICs), as well as (for systematic reviews) their methodological quality and the availability of user-friendly summaries. Results: As of July 2013, HSE contained 2,629 systematic reviews of effects (of which 501 are Cochrane reviews), 614 systematic reviews addressing other questions, 283 systematic reviews in progress, 186 systematic reviews being planned, 140 review-derived products (evidence briefs and overviews of systematic reviews), 1,669 economic evaluations, 1,092 health reform descriptions, and 209 health system descriptions. Most systematic reviews address topics related to delivery arrangements (n = 2,663) or implementation strategies (n = 1,653) with far fewer addressing financial (n = 241) or governance arrangements (n = 231). In addition, 2,928 systematic reviews have been quality appraised with moderate AMSTAR ratings found for reviews addressing governance (5.6/11), financial (5.9/11), and delivery (6.3/11) arrangements and implementation strategies (6.5/11); 1,075 systematic reviews have no independently produced user-friendly summary and only 737 systematic reviews have an LMIC focus. Literature searches for half of the systematic reviews (n = 1,584, 49%) were conducted within the last five years. Conclusions: Greater effort needs to focus on assessing whether the current distribution of systematic reviews corresponds to policymakers’ and stakeholders’ priorities, updating systematic reviews, increasing the quality of systematic reviews, and focusing on LMICs

Health systems and policy research evidence in health policy making in Israel: what are researchers’ practices in transferring knowledge to policy makers?

Background: Ensuring the use of research evidence in health system management and policy decisions is an important challenge in this century. Knowledge transfer and exchange (KTE) has emerged as a paradigm to address the challenges and start closing the ‘know-do’ gap. This area of work is gaining momentum in most developed countries, yet, to date, no work has been performed in Israel within this area. The purpose of this study was to identify which KTE activities health systems and policy researchers in Israel have undertaken. Methods: A cross-sectional web-based survey of researchers who have conducted health systems and policy research in Israel was developed. The survey consisted of a demographics section, quantitative scales, and open-ended questions. The survey was sent to all health systems and policy researchers in Israel (n = 125). Results: The study response rate (28%) was relatively low as compared to other studies in the same field (range of 42% to 88%). Our survey found that more than a third of the health systems and policy researchers in Israel reported that they were frequently or always involved in the following KTE activities: interactions with target audience through the research process (i.e., during developing a research question or executing the research; 35% to 42%) or through formal or informal meetings during conferences, workshops, or conversations (40%). Less than half of the health systems and policy researchers in Israel are engaged in bridging activities aimed to facilitate target audiences to use research. Conclusions: This is a fairly new area in Israel and therefore the level of engagement of researchers in KTE activities is not very high. The low response rates could be because KTE is a new field in Israel and minimal KTE initiatives have been undertaken. It is preferable to have higher response rates, yet, after several initiatives, this was the outcome. While the findings are relevant, they may not reflect the total population of health system and policy researchers in Israel. Health system and policy researchers in Israel need to be introduced to the benefits and potential advantages of KTE in an organized and systematic way