Assessing Health Research and Innovation Impact: Evolution of a Framework and Tools in Alberta, Canada

Publicly funded research and innovation (R&I) organizations around the world are facing increasing demands to demonstrate the impacts of their investments. In most cases, these demands are shifting from academically based outputs to impacts that benefit society. Funders and other organizations are grappling to understand and demonstrate how their investments and activities are achieving impact. This is compounded with challenges that are inherent to impact assessment, such as having an agreed understanding of impact, the time lag from research to impact, establishing attribution and contribution, and consideration of diverse stakeholder needs and values. In response, many organizations are implementing frameworks and using web-based tools to track and assess academic and societal impact. This conceptual analysis begins with an overview of international research impact frameworks and emerging tools that are used by an increasing number of public R&I funders to demonstrate the value of their investments. From concept to real-world, this paper illustrates how one organization, Alberta Innovates, used the Canadian Academy of Health Sciences (CAHS) impact framework to guide implementation of its fit-for-purpose impact framework with an agnostic international six-block protocol. The implementation of the impact framework at Alberta Innovates is also supported by adopting emerging web-based tools. Drawing on the lessons learned from this continuous organizational endeavor to assess and measure R&I impact, we present preliminary plans for developing an impact strategy for Alberta Innovates that can be applied across sectors, including energy, environment and agriculture, and may possibly be adopted by other international funders

Impacto da pesquisa em saúde nos avanços de conhecimento, construção de capacidades de pesquisa e políticas informadas por evidências : um estudo de caso sobre a morbimortalidade materna no Brasil

Sistemas nacionais de pesquisa em saúde buscam gerar conhecimentos de qualidade para manter e promover a saúde da população. Este estudo visou analisar o impacto das pesquisas sobre morbimortalidade materna financiadas pelo Ministério de Saúde do Brasil e instituições parceiras, nas dimensões: avanços no conhecimento, construção de capacidade de pesquisa e tomada de decisão informada, da matriz da Canadian Academy of Health Sciences. DESENHO DO ESTUDO E LOCAL: Estudo descritivo baseado em dados secundários, realizado em universidade pública. MÉTODOS: A dimensão avanços no conhecimento foi estimada pelas publicações dos coordenadores de pesquisa e índice h. Dados sobre a capacidade de pesquisa foram obtidos no sistema de informação do Ministério da Saúde. A dimensão tomada de decisão informada foi analisada pelas citações nos documentos da Rede Cegonha. RESULTADOS: Foram investidos R$21,6 milhões de reais em 128 pesquisas sobre morbimortalidade materna entre 2002 e 2010. Nesse período, os coordenadores das pesquisas publicaram 174 artigos, resultando no índice h de 35, mostrando progressos na dimensão avanços no conhecimento. Na dimensão capacidade de pesquisa, foi constatado o treinamento de 71 estudantes (graduação e pós-graduação). Na dimensão tomada de decisão informada, o progresso foi modesto: 73,5$ 21.6 million were invested in 128 maternal mortality/morbidity projects. Over this period, the principal investigators published 174 articles, resulting in an h-index of 35, thus showing progress in the advancing in knowledge dimension. Within the research capacity-building dimension, training of 71 students (undergraduate/postgraduate) was observed. Progress in the informing decision-making dimension was modest: 73.5% of the 117 citations in the Stork Network documents were institutional documents and norms. One of the projects funded, the 2006/7 National Demography and Health Survey, was cited in program documents. CONCLUSION: Impacts were shown in the advancing in knowledge and research capacity-building dimensions. The health research system needs to incorporate research for evidence-informed policies

Translating evidence into practice: the role of health research funders

BACKGROUND: A growing body of work on knowledge translation (KT) reveals significant gaps between what is known to improve health, and what is done to improve health. The literature and practice also suggest that KT has the potential to narrow those gaps, leading to more evidence-informed healthcare. In response, Canadian health research funders and agencies have made KT a priority. This article describes how one funding agency determined its KT role and in the process developed a model that other agencies could use when considering KT programs. DISCUSSION: While ‘excellence’ is an important criterion by which to evaluate and fund health research, it alone does not ensure relevance to societal health priorities. There is increased demand for return on investments in health research in the form of societal and health system benefits. Canadian health research funding agencies are responding to these demands by emphasizing relevance as a funding criterion and supporting researchers and research users to use the evidence generated. Based on recommendations from the literature, an environmental scan, broad circulation of an iterative discussion paper, and an expert working group process, our agency developed a plan to maximize our role in KT. Key to the process was development of a model comprising five key functional areas that together create the conditions for effective KT: advancing KT science; building KT capacity; managing KT projects; funding KT activities; and advocating for KT. Observations made during the planning process of relevance to the KT enterprise are: the importance of delineating KT and communications, and information and knowledge; determining responsibility for KT; supporting implementation and evaluation; and promoting the message that both research and KT take time to realize results. SUMMARY: Challenges exist in fulfilling expectations that research evidence results in beneficial impacts for society. However, health agencies are well placed to help maximize the use of evidence in health practice and policy. We propose five key functional areas of KT for health agencies, and encourage partnerships and discussion to advance the field

From "retailers" to health care providers: Transforming the role of community pharmacists in chronic disease management

© 2015. Community pharmacists are the third largest healthcare professional group in the world after physicians and nurses. Despite their considerable training, community pharmacists are the only health professionals who are not primarily rewarded for delivering health care and hence are under-utilized as public health professionals. An emerging consensus among academics, professional organizations, and policymakers is that community pharmacists, who work outside of hospital settings, should adopt an expanded role in order to contribute to the safe, effective, and efficient use of drugs-particularly when caring for people with multiple chronic conditions. Community pharmacists could help to improve health by reducing drug-related adverse events and promoting better medication adherence, which in turn may help in reducing unnecessary provider visits, hospitalizations, and readmissions while strengthening integrated primary care delivery across the health system. This paper reviews recent strategies to expand the role of community pharmacists in Australia, Canada, England, the Netherlands, Scotland, and the United States. The developments achieved or under way in these countries carry lessons for policymakers world-wide, where progress thus far in expanding the role of community pharmacists has been more limited. Future policies should focus on effectively integrating community pharmacists into primary care; developing a shared vision for different levels of pharmacist services; and devising new incentive mechanisms for improving quality and outcomes

"'Academic' is a dirty word": intended impact pathways of an emerging academic health centre in tropical regional Australia

Background: The Tropical Australian Academic Health Centre (TAAHC) is being established in northern Queensland across a vast rural geography. The study aim is to identify intended impact pathways and beneficiaries of TAAHC as well as experienced and anticipated challenges. Methodology: The study is an empirical case study nested within a comparative multi‐case study on academic health centres (AHCs). Data were collected from documents, observation, and interviews with 24 health system and university stakeholders. Intended impact pathways were identified abductively from analysis of aspirations and challenges. Results: Aspirations of TAAHC reflect an ultimate aim to improve the health of the northern Queensland population. Challenges were trust and communication, understanding value and return on investment, health system receptiveness to building a research culture, prioritising and influencing the research agenda, and structure of the health system. Discussion: The study identifies three interdependent transitions that comprise the main intended impact pathway in TAAHC. Stakeholders expected TAAHC to effect health systems change and improvement rather than drive discovery‐oriented academic research associated with AHCs elsewhere. Conclusion: The findings contribute to the empirical evidence base on the role of AHCs internationally and to ongoing initiatives to establish and resource AHCs in Australia

Sistema d’avaluació de la recerca en salut: avaluació responsable

Recerca sanitària; PERIS; SARISInvestigación sanitaria; PERIS; SARISHealth research; PERIS; SARISEn aquest document es presenta el model d’avaluació de la recerca del sistema d’avaluació de la recerca i innovació en salut (SARIS), sense incloure els aspectes de la innovació. El SARIS és l’instrument estratègic de la Direcció General de Recerca i Innovació en Salut (DGRIS) per al desenvolupament, seguiment i avaluació del Pla estratègic de recerca i innovació en salut (PERIS) 2016-20. L’objectiu primari del SARIS és avaluar la recerca en salut que es promou en el marc del PERIS 2016-2020 durant el seu desplegament. Els objectius secundaris són: 1) retre comptes i 2) millorar l’impacte a través de dos subobjectius (2a, l’anàlisi per millorar i 2b, la implicació –engagement– dels actors en assolir més i millor impacte en salut)

Rethinking Policy ‘Impact’:Four Models of Research-Policy Relations

Abstract Political scientists are increasingly exhorted to ensure their research has policy ‘impact’, most notably via Research Excellence Framework (REF) impact case studies, and ‘pathways to impact’ statements in UK Research Council funding applications. Yet the assumptions underpinning these frameworks often fail to reflect available evidence and theories. Notions of ‘impact’, ‘engagement’ and ‘knowledge exchange’ are typically premised on simplistic, linear models of the policy process, according to which policy-makers are keen to ‘utilise’ expertise to produce more ‘effective’ policies. Such accounts overlook the rich body of literature in political science, policy studies, and sociology of knowledge, which offer more complex and nuanced accounts. Drawing on this wider literature, this paper sets out four different approaches to theorising the relationship: (1) knowledge shapes policy; (2) politics shapes knowledge; (3) co-production; and (4) autonomous spheres. We consider what each of these four approaches suggests about approaches to incentivising and measuring research impact