Implementation science protocol for a participatory, theory-informed implementation research programme in the context of health system strengthening in sub-Saharan Africa (ASSET-ImplementER).

Objectives ASSET (Health System Strengthening in sub-Saharan Africa) is a health system strengthening (HSS) programme involving eight work-packages (ie, a research study that addresses a specific need for HSS) that aims to develop solutions that support high-quality care. Here we present the protocol for the implementation science (IS) theme within ASSET (ASSET-ImplmentER) that aims to understand what HSS interventions work, for whom and how, and how IS methodologies can be adapted to improve the HSS interventions within resource-poor contexts. Settings Publicly funded health facilities in rural and urban areas in in Ethiopia, South Africa, Sierra Leone, and Zimbabwe. Participants Research staff including principal investigators, coinvestigators, field staff, PhD students, and research assistants. Interventions Work-packages use a mixed-methods effectiveness–effectiveness hybrid designs. At the end of the pre-implementation phase, a workshop is held whereby the IS theme, jointly with ASSET work-packages apply IS determinant frameworks to research findings to identify factors that influence the effectiveness of delivering evidence-informed care. Determinants are used to select a set of HSS interventions for further evaluation, where work-packages also theorise selective mechanisms. In the piloting and rolling implementation phase, work-packages pilot the HSS interventions. An iterative process then begins involving evaluation, reflection and adaptation. Throughout this phase, IS determinant frameworks are applied to monitor and identify barriers/enablers to implementation. Selective mechanisms of action are also investigated. Implementation outcomes are evaluated using qualitative and quantitative methods. The psychometric properties of outcome measures including acceptability, appropriateness and feasibility are also evaluated. In a final workshop, work-packages come together, to reflect and explore the utility of the selected IS methods and provide suggestions for future use. Structured templates are used to organise and analyse common and heterogeneous patterns across work-packages. Qualitative data are analysed using thematic analysis and quantitative data are analysed using means and proportions. Conclusions We use a novel combination of IS methods at a programmatic level to facilitate comparisons of determinants and mechanisms that influence the effectiveness of HSS interventions in achieving implementation outcomes across different contexts. The study also contributes conceptual development and clarification at the underdeveloped interface of IS, HSS and global health

Using Policy Labs as a process to bring evidence closer to public policymaking: a guide to one approach

While robust evidence is one ingredient in the policymaking process, it is by no means the only one. Engaging with policymakers and the policymaking process requires collaborative working models, navigating through the experiences, values and perspectives of policymakers and other stakeholders, as well as communicating evidence in an accessible manner. As a response to these requirements, over recent years there has been proliferation of activities that engage producers of evidence (specifically, academics), policymakers, practitioners, and the public in policy formulation, implementation and evaluation. In this article, we describe one engagement approach for facilitating research evidence uptake into policy and practice—an activity called a ‘Policy Lab’—as conducted by the team at The Policy Institute at King’s College London on numerous policy challenges over the past four years. Drawing on our experience in running 15 Policy Labs between January 2015 and September 2019, we (a) provide a guide to how we have run Policy Labs, while sharing our learning on what has worked best in conducting them and (b) demonstrate how these labs can contribute to bringing evidence closer to policymaking, by comparing their characteristics to enablers for doing so identified in the literature. While this approach to Policy Labs is not the only one of its kind, we suggest that these types of Labs manifest characteristics identified in previous studies for influencing the policymaking process; namely: providing a forum for open, honest conversations around a policy topic; creating new networks, collaborations and partnerships between academics and policymakers; synthesising available evidence on a policy topic in a robust and accessible format; and providing timely access to evidence relevant to a policy issue. We recognise the limitations of measuring and evaluating how these Labs change policy in the long-term and recommend viewing the Policy Lab as part of a process for engaging evidence and policymaking and not an isolated activity. This process serves to build a coalition through participation of diverse communities (thereby establishing ‘trust’), work on the language and presentation of evidence (thereby enabling effective ‘translation’ of evidence) and engage policymakers early to respond when policy windows emerge (thereby taking into account ‘timing’ for creating policy action)

A global call for action to include gender in research impact assessment

Global investment in biomedical research has grown significantly over the last decades, reaching approximately a quarter of a trillion US dollars in 2010. However, not all of this investment is distributed evenly by gender. It follows, arguably, that scarce research resources may not be optimally invested (by either not supporting the best science or by failing to investigate topics that benefit women and men equitably). Women across the world tend to be significantly underrepresented in research both as researchers and research participants, receive less research funding, and appear less frequently than men as authors on research publications. There is also some evidence that women are relatively disadvantaged as the beneficiaries of research, in terms of its health, societal, and economic impacts. Historical gender biases may have created a path dependency that means that the research system and the impacts of research are biased towards male researchers and male beneficiaries, making it inherently difficult (though not impossible) to eliminate gender bias. In this commentary, we – a group of scholars and practitioners from Africa, America, Asia, and Europe– argue that gender-sensitive research impact assessment could become a force for good in moving science policy and practice towards gender equity. Research impact assessment is the multidisciplinary field of scientific inquiry that examines the research process to maximise scientific, societal, and economic returns on investment in research. It encompasses many theoretical and methodological approaches that can be used to investigate gender bias and recommend actions for change to maximise research impact. We offer a set of recommendations to research funders, research institutions, and research evaluators who conduct impact assessment on how to include and strengthen analysis of gender equity in research impact assessment and issue a global call for action

Understanding the structure of a country's health service providers for defence health engagement

There are a variety of structural and systems frameworks for describing the building blocks of country's public health and health systems. In this paper, we propose a conceptual framework for a holistic view of a country's health service providers in order to inform the plan for Defence Health Engagement activities with partner countries. This includes all potential government ministries involved in healthcare provision, the independent, private sector and the non-government organisation/charity sector. The framework provides a visualisation to support the analysis of a country's health services providers. We propose that recognising and analysing the different contributions of all these national health providers is essential for understanding the wider political economy of a nation's health systems. This can inform a plan of Defence Health Engagement for capacity building in crisis response, development and health systems strengthening

Factors influencing procurement behaviour and decision-making: an exploratory qualitative study in a UK healthcare provider

Background: In 2016 the UK Department of Health and Social Care published the results of a comprehensive review of efficiency in hospitals, identifying “unwarranted variation” in procurement (or purchasing) practices for materials, supplies and devices. Addressing this variation in materials and supplies procurement practice has been identified as particularly important for creating efficiencies in health service delivery. However, little is known about the behaviour and experiences of front-line individuals who make these procurement decisions, which has implications for the development of strategies to improve efficiency. The objective of this study is to improve understanding of the factors influencing procurement behaviour and decisions among requisitioners who use an internal electronic procurement portal for medical supplies and equipment, and identify areas where efficiency could be improved. Methods: Qualitative semi-structured individual interview study, following approximately 70 h of exploratory observations on site. The study context was a large London National Health Service (NHS) healthcare provider (the Trust), where we focussed primarily on purchases managed by a large hospital. Participants were drawn from requisitioners from multiple directorates across the Trust (n = 15; of these n = 2 clinical staff members, n = 13 non-clinical). Results: Four factors stood out in our analysis as directly affecting procurement decisions: (1) a high level of variation in electronic purchasing and inventory management procedures throughout the Trust, (ii) an inaccurate and cumbersome search facility on the internal electronic procurement platform, exacerbated by poor IT skills training and support (iii) an inefficient purchase approvals system and (iv) multiple working sites and cluttered environments. We observed that these factors led requisitioners to employ a variety of strategies or so-called ‘workarounds’ to overcome the challenges they encountered, including stockpiling, relying on internal and supplier relationships, by-passing procedures to save time, purchasing outside existing agreements to save cost, and (re) delegating purchasing responsibilities among requisitioner staff - which both addressed and created difficulties. Conclusions: Working with the assumption that staff ‘workarounds’ indicate where main issues lie, we offer four possible explanations to why they occur: (a) to maintain services and prepare for future care requirements, (b) to save on costs for the organisation, (c) to develop skills and development in purchasing and (d) to break silos and work collaboratively. These four explanations help provide initial starting points for improving efficiencies in health supplies’ procurement processes.Policy Analysi

Systems approaches to healthcare systems design and care delivery: An overview of the literature

The healthcare sector is facing significant challenges that require a systems approach, resulting in a rapid growth in the application of systems approaches in healthcare since the beginning of the 21st century. Consequently, healthcare practitioners and policymakers now desire to understand the evidence-base for the approach, but little evidence of the kind desired exists. This paper is a first step in conducting a narrative review of the application of systems approaches in healthcare based on a systematic review of the academic and grey literature. First, the emergence of the approach in healthcare is explored. Second, specific examples of applications of systems approaches in healthcare are examined to identify any missing elements in current practice. Third, fourteen reviews of the approach in healthcare published in the last ten years are analysed. The results suggest that the use of the approach in healthcare will most likely continue to increase, however, significant work remains for the design and systems community to demonstrate the effectiveness of systems approaches, specifically in providing convincing measures of impact on patient and service outcomes.Multi Actor SystemsPolicy AnalysisApplied Ergonomics and Desig

Purchasing high-cost medical devices and equipment in hospitals: A systematic review

Objectives To systematically review academic literature for studies on any processes, procedures, methods or approaches to purchasing high-cost medical devices and equipment within hospitals in high-income countries. Methods On 13 August 2020, we searched the following from inception: Cost-Effectiveness Analysis Registry, EconLit and ProQuest Dissertations & Theses A&I via ProQuest, Embase, MEDLINE, and MEDLINE in Process via Ovid SP, Google and Google Scholar, Health Management and Policy Database via Ovid SP, IEEE Xplore Digital Library, International HTA Database, NHS EED via CRD Web, Science Citation Index-Expanded, Conference Proceedings Citation Index-Science, and Emerging Sources Citation Index via Web of Science, Scopus, and Zetoc conference search. Studies were included if they described the approach to purchasing (also known as procurement or acquisition) of high-cost medical devices and/or equipment conducted within hospitals in high-income countries between 2000 and 2020. Studies were screened, data extracted and results summarised in tables under themes identified. Results Of 9437 records, 24 were included, based in 12 different countries and covering equipment types including surgical robots, medical imaging equipment, defibrillators and orthopaedic implants. We found heterogeneity in methods and approaches; including descriptions of processes taking place within or across hospitals (n=14), out of which three reported cost savings; empirical studies in which hospital records or participant data were analysed (n=8), and evaluations or pilots of proposed purchasing processes (n=2). Studies emphasise the importance of balancing technical, financial, safety and clinical requirements for device selection through multidisciplinary involvement (especially clinical engineers and clinicians) in decision-making, and the potential of increasing evidence-based purchasing decisions using approaches such as hospital-based health technology assessments, ergonomics and device 'user trials'. Conclusions We highlight the need for more empirical work that evaluates purchasing approaches or interventions, and greater specificity in study reporting (eg, equipment type, evaluation outcomes) to build the evidence base required to influence policy and practice for medical equipment purchasing. Protocol registration This review was registered in Open Science Framework: Shokraneh F, Hinrichs-Krapels S, Chalkidou A et al. Purchasing high-cost medical equipment in hospitals in OECD countries: A systematic review. Open Science Framework 2021; doi:10.17605/OSF.IO/GTXN8. Available at: https://osf.io/gtxn8/ (accessed 12 February 2022).Policy Analysi

Harnessing the PRECISE network as a platform to strengthen global capacity for maternal and child health research in sub-Saharan Africa

It is widely acknowledged across the global health sector that research programmes need to be designed and implemented in a way that maximise opportunities for strengthening local capacity. This paper examines how the United Kingdom Research and Innovation (UKRI) Grand Challenges Research Fund (GCRF) funded PRECISE (PREgnancy Care Integrating translational Science, Everywhere) Network has been established as a platform to strengthen global capacity for research focused on the improvement of maternal, fetal and newborn health in sub-Saharan Africa.Best practice principles outlined in an ESSENCE on Health Research report have been considered in relation to the PRECISE Network capacity-building activities described in this paper. These activities are described at the individual, programmatic and institutional levels, and successes, challenges and recommendations for future work are outlined.The paper concludes that the PRECISE leadership have an opportunity to review and refresh activity plans for capacity building at this stage in the project to build on achievements to date

ISRIA statement: ten-point guidelines for an effective process of research impact assessment

As governments, funding agencies and research organisations worldwide seek to maximise both the financial and non-financial returns on investment in research, the way the research process is organised and funded is becoming increasingly under scrutiny. There are growing demands and aspirations to measure research impact (beyond academic publications), to understand how science works, and to optimise its societal and economic impact. In response, a multidisciplinary practice called research impact assessment is rapidly developing. Given that the practice is still in its formative stage, systematised recommendations or accepted standards for practitioners (such as funders and those responsible for managing research projects) across countries or disciplines to guide research impact assessment are not yet available. In this statement, we propose initial guidelines for a rigorous and effective process of research impact assessment applicable to all research disciplines and oriented towards practice. This statement systematises expert knowledge and practitioner experience from designing and delivering the International School on Research Impact Assessment (ISRIA). It brings together insights from over 450 experts and practitioners from 34 countries, who participated in the school during its 5-year run (from 2013 to 2017) and shares a set of core values from the school’s learning programme. These insights are distilled into ten-point guidelines, which relate to (1) context, (2) purpose, (3) stakeholders’ needs, (4) stakeholder engagement, (5) conceptual frameworks, (6) methods and data sources, (7) indicators and metrics, (8) ethics and conflicts of interest, (9) communication, and (10) community of practice. The guidelines can help practitioners improve and standardise the process of research impact assessment, but they are by no means exhaustive and require evaluation and continuous improvement. The prima facie effectiveness of the guidelines is based on the systematised expert and practitioner knowledge of the school’s faculty and participants derived from their practical experience and research evidence. The current knowledge base has gaps in terms of the geographical and scientific discipline as well as stakeholder coverage and representation. The guidelines can be further strengthened through evaluation and continuous improvement by the global research impact assessment community

ISRIA statement: ten-point guidelines for an effective process of research impact assessment

As governments, funding agencies and research organisations worldwide seek to maximise both the financial and non-financial returns on investment in research, the way the research process is organised and funded is becoming increasingly under scrutiny. There are growing demands and aspirations to measure research impact (beyond academic publications), to understand how science works, and to optimise its societal and economic impact. In response, a multidisciplinary practice called research impact assessment is rapidly developing. Given that the practice is still in its formative stage, systematised recommendations or accepted standards for practitioners (such as funders and those responsible for managing research projects) across countries or disciplines to guide research impact assessment are not yet available. In this statement, we propose initial guidelines for a rigorous and effective process of research impact assessment applicable to all research disciplines and oriented towards practice. This statement systematises expert knowledge and practitioner experience from designing and delivering the International School on Research Impact Assessment (ISRIA). It brings together insights from over 450 experts and practitioners from 34 countries, who participated in the school during its 5-year run (from 2013 to 2017) and shares a set of core values from the school’s learning programme. These insights are distilled into ten-point guidelines, which relate to (1) context, (2) purpose, (3) stakeholders’ needs, (4) stakeholder engagement, (5) conceptual frameworks, (6) methods and data sources, (7) indicators and metrics, (8) ethics and conflicts of interest, (9) communication, and (10) community of practice. The guidelines can help practitioners improve and standardise the process of research impact assessment, but they are by no means exhaustive and require evaluation and continuous improvement. The prima facie effectiveness of the guidelines is based on the systematised expert and practitioner knowledge of the school’s faculty and participants derived from their practical experience and research evidence. The current knowledge base has gaps in terms of the geographical and scientific discipline as well as stakeholder coverage and representation. The guidelines can be further strengthened through evaluation and continuous improvement by the global research impact assessment community