Evidence-informed health policy: are we beginning to get there at last

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited

Looking for interaction: quantitative measurement of research utilization by Dutch local health officials

Background: In the Netherlands, local authorities are required by law to develop local health memoranda, based on epidemiological analyses. The purpose of this study was to assess the actual use of these epidemiological reports by municipal health officials and associated factors that affect this use.Method: Based on a conceptual framework, we designed a questionnaire in which we operationalized instrumental, conceptual, and symbolic use, the interaction between researchers and local health officials, and four clusters of barriers in this interaction process. We conducted an internet survey among 155 Dutch local health officials representing 35% of all Dutch municipalities. By means of multiple regression analyses, we gained insight into the related factors for each of the three types of research utilization.Results: The results show that local health officials use epidemiological research more often in a conceptual than an instrumental or symbolic way. This can be explained by the complexity of the local policy process which is often linked to policies in other areas, and the various policy actors involved. Conceptual use was statistically associated with a presentation given by the epidemiologist during the policy process, the presence of obstructions regarding the report's accessibility, and the local official's personal belief systems and interests originating from different professional values and responsibilities. Instrumental and symbolic use increased with the involvement of local officials in the research process.Conclusions: The results of this study provide a partial solution to understanding and influencing research utilization. The quantitative approach underpins earlier qualitative findings on this topic. The outcomes suggest that RPHS epidemiologists can use different strategies to improve research utilization. 'Blurring the boundaries', and the enhancement of interfaces between epidemiologists and local health officials, like direct interactions into each other's work processes, is expected to create better possibilities for optimizing research use

Knowledge translation research in population health: establishing a collaborative research agenda

<p>Abstract</p> <p>Background</p> <p>Despite the increasing mobilization of researchers and funding organizations around knowledge translation (KT) in Canada and elsewhere, many questions have been only partially answered, particularly in the field of population health. This article presents the results of a systematic process to draw out possible avenues of collaboration for researchers, practitioners and decision-makers who work in the area of KT. The main objective was to establish a research agenda on knowledge translation in population health.</p> <p>Methods</p> <p>Using the Concept Mapping approach, the research team wanted to identify priority themes for the development of research on KT in population health. Mapping is based on multivariate statistical analyses (multidimensional scaling and hierarchical cluster analysis) in which statements produced during a brainstorming session are grouped in weighted clusters. The final maps are a visual representation of the priority themes of research on KT. Especially designed for facilitating consensus in the understanding and organization of various concepts, the Concept Mapping method proved suitable for achieving this objective.</p> <p>Results</p> <p>The maps were produced by 19 participants from university settings, and from institutions within the health and social services network. Three main perspectives emerge from this operation: (1) The evaluation of the effectiveness of KT efforts is one of the main research priorities; (2) The importance of taking into consideration user contexts in any KT effort; (3) The challenges related to sharing power for decision-making and action-taking among various stakeholder groups. These perspectives open up avenues of collaboration for stakeholders who are involved in research on KT. Besides these three main perspectives, the concept maps reveal three other trends which should be emphasized.</p> <p>Conclusion</p> <p>The Concept Mapping process reported in this article aimed to provoke collective reflection on the research questions that should be studied, in order to foster coherence in research activities in the field of population health. Based on this, it is appropriate to continue to support the development of research projects in KT and the formation of research teams in this field. Research on KT must lead to concrete outcomes within communities that are interested in the question.</p

A pragmatic cluster randomised trial evaluating three implementation interventions

Background Implementation research is concerned with bridging the gap between evidence and practice through the study of methods to promote the uptake of research into routine practice. Good quality evidence has been summarised into guideline recommendations to show that peri-operative fasting times could be considerably shorter than patients currently experience. The objective of this trial was to evaluate the effectiveness of three strategies for the implementation of recommendations about peri-operative fasting. Methods A pragmatic cluster randomised trial underpinned by the PARIHS framework was conducted during 2006 to 2009 with a national sample of UK hospitals using time series with mixed methods process evaluation and cost analysis. Hospitals were randomised to one of three interventions: standard dissemination (SD) of a guideline package, SD plus a web-based resource championed by an opinion leader, and SD plus plan-do-study-act (PDSA). The primary outcome was duration of fluid fast prior to induction of anaesthesia. Secondary outcomes included duration of food fast, patients' experiences, and stakeholders' experiences of implementation, including influences. ANOVA was used to test differences over time and interventions. Results Nineteen acute NHS hospitals participated. Across timepoints, 3,505 duration of fasting observations were recorded. No significant effect of the interventions was observed for either fluid or food fasting times. The effect size was 0.33 for the web-based intervention compared to SD alone for the change in fluid fasting and was 0.12 for PDSA compared to SD alone. The process evaluation showed different types of impact, including changes to practices, policies, and attitudes. A rich picture of the implementation challenges emerged, including inter-professional tensions and a lack of clarity for decision-making authority and responsibility. Conclusions This was a large, complex study and one of the first national randomised controlled trials conducted within acute care in implementation research. The evidence base for fasting practice was accepted by those participating in this study and the messages from it simple; however, implementation and practical challenges influenced the interventions' impact. A set of conditions for implementation emerges from the findings of this study, which are presented as theoretically transferable propositions that have international relevance. Trial registration ISRCTN18046709 - Peri-operative Implementation Study Evaluation (POISE

Knowledge in process? Exploring barriers between epidemiological research and local health policy development

The Redes de Trueque (RT) thrived during the economic crisis of 2001 – 2002 in Argentina and still stand out as one of the largest Complementary Currency System in the world. These local exchange networks reach a large scale during times of severe economic distress, but as large non-state initiatives, they pose a governance problem. Four types of governance systems were structured within the Argentine RT, of varying degrees of sustainability: a) loosely regulated market systems, b) hierarchies, c) associational regional networks, and d) local communities. Based on a four dimensional analytical framework, this paper discusses the rules of governance and sustainability of the governance systems in the RT. It found that some became more sustainable than others in terms of achieving combinations of scale and organisational modes

Conclusion: Reflecting on Studying Evidence Use from a Public Policy Perspective

This final chapter reflects on the insights provided by the case studies that constitute this volume, focussing on the key questions which informed the broader research programme from which the cases arise: what does it mean to use evidence effectively to inform health policymaking?; and how do political and institutional factors shape the specific forms of evidence use that arise in different contexts? It discusses the circumstances in which instrumental or strategic uses of evidence were seen; as well as synthesising insights about the ways in which political contestation, the framing and construction of policy problems and their solutions, and different institutional arrangements for policy delivery shape evidence use in different policy contexts. The chapter concludes by considering future areas of research in this field to provide further insights into the use of evidence for health policymaking from a public policy perspective

Identifying Trustworthy Experts: How Do Policymakers Find and Assess Public Health Researchers Worth Consulting or Collaborating With?

This paper reports data from semi-structured interviews on how 26 Australian civil servants, ministers and ministerial advisors find and evaluate researchers with whom they wish to consult or collaborate. Policymakers valued researchers who had credibility across the three attributes seen as contributing to trustworthiness: competence (an exemplary academic reputation complemented by pragmatism, understanding of government processes, and effective collaboration and communication skills); integrity (independence, “authenticity”, and faithful reporting of research); and benevolence (commitment to the policy reform agenda). The emphases given to these assessment criteria appeared to be shaped in part by policymakers' roles and the type and phase of policy development in which they were engaged. Policymakers are encouraged to reassess their methods for engaging researchers and to maximise information flow and support in these relationships. Researchers who wish to influence policy are advised to develop relationships across the policy community, but also to engage in other complementary strategies for promoting research-informed policy, including the strategic use of mass media

The use of evidence in public governmental reports on health policy: an analysis of 17 Norwegian official reports (NOU)

<p>Abstract</p> <p>Background</p> <p>Governments increasingly require policy documents to be evidence-based. This paper analyses the use of scientific evidence in such documents by reviewing reports from government-appointed committees in Norway to assess the committees' handling of questions of effect.</p> <p>Methods</p> <p>This study uses the 'Index of Scientific Quality' (ISQ) to analyse all Norwegian official reports (NOUs) that were: (1) published by the Norwegian Ministry of Health and Care Services during 1994-1998 (N = 20); and (2) concerned with questions of effect either because these were included in the mandate or as a result of the committee's interpretation of the mandate. The ISQ is based on scientific criteria common in all research concerning questions of effect. The primary outcome measure is an ISQ score on a five-point scale.</p> <p>Results</p> <p>Three reports were excluded because their mandates, or the committees' interpretations of them, did not address questions of effect. For the remaining 17 NOUs in our study, overall ISQ scores were low for systematic literature search and for explicit validation of research. Two reports had an average score of three or higher, while scores for five other reports were not far behind. How committees assessed the relevant factors was often unclear.</p> <p>Conclusion</p> <p>The reports' evaluations of health evidence in relation to questions of effect lacked transparency and, overall, showed little use of systematic processes. A systematic, explicit and transparent approach, following the standards laid down in the ISQ, may help generate the evidence-based decision-making that Norway, the UK, the EU and the WHO desire and seek. However, policy-makers may find the ISQ criteria for assessing the scientific quality of a report too narrow to adequately inform policy-making.</p

Ministries of Health and the Stewardship of Health Evidence

This chapter describes how Ministries of Health have been mandated to act as stewards of populations’ health according to the World Health Organization. We argue that this mandate extends to them having (at least partial) responsibility for ensuring relevant evidence informs policy decisions. Yet this requires consideration of the evidence advisory systems serving Ministry needs, particularly whether or how such systems work to provide relevant information in a timely manner to key decision points in the policy process. Insights from our six cases are presented to illustrate the structural and practical differences which exist between evidence advisory systems and how, at certain times, key health decisions may in fact lie outside ministerial authority. These divergent experiences highlight a range of analytical challenges when considering the provision of evidence to inform health decisions from an institutional perspective