Welcome to Implementation Science

Implementation research is the scientific study of methods to promote the systematic uptake of research findings and other evidence-based practices into routine practice, and, hence, to improve the quality and effectiveness of health services and care. This relatively new field includes the study of influences on healthcare professional and organisational behaviour. Implementation Science will encompass all aspects of research in this field, in clinical, community and policy contexts. This online journal will provide a unique platform for this type of research and will publish a broad range of articles – study protocols, debate, theoretical and conceptual articles, rigorous evaluations of the process of change, and articles on methodology and rigorously developed tools – that will enhance the development and refinement of implementation research. No one discipline, research design, or paradigm will be favoured. Implementation Science looks forward to receiving manuscripts that facilitate the continued development of the field, and contribute to healthcare policy and practice

Evaluating the successful implementation of evidence into practice using the PARiHS framework : theoretical and practical challenges

Background The PARiHS framework (Promoting Action on Research Implementation in Health Services) has proved to be a useful practical and conceptual heuristic for many researchers and practitioners in framing their research or knowledge translation endeavours. However, as a conceptual framework it still remains untested and therefore its contribution to the overall development and testing of theory in the field of implementation science is largely unquantified. Discussion This being the case, the paper provides an integrated summary of our conceptual and theoretical thinking so far and introduces a typology (derived from social policy analysis) used to distinguish between the terms conceptual framework, theory and model – important definitional and conceptual issues in trying to refine theoretical and methodological approaches to knowledge translation. Secondly, the paper describes the next phase of our work, in particular concentrating on the conceptual thinking and mapping that has led to the generation of the hypothesis that the PARiHS framework is best utilised as a two-stage process: as a preliminary (diagnostic and evaluative) measure of the elements and sub-elements of evidence (E) and context (C), and then using the aggregated data from these measures to determine the most appropriate facilitation method. The exact nature of the intervention is thus determined by the specific actors in the specific context at a specific time and place. In the process of refining this next phase of our work, we have had to consider the wider issues around the use of theories to inform and shape our research activity; the ongoing challenges of developing robust and sensitive measures; facilitation as an intervention for getting research into practice; and finally to note how the current debates around evidence into practice are adopting wider notions that fit innovations more generally. Summary The paper concludes by suggesting that the future direction of the work on the PARiHS framework is to develop a two-stage diagnostic and evaluative approach, where the intervention is shaped and moulded by the information gathered about the specific situation and from participating stakeholders. In order to expedite the generation of new evidence and testing of emerging theories, we suggest the formation of an international research implementation science collaborative that can systematically collect and analyse experiences of using and testing the PARiHS framework and similar conceptual and theoretical approaches. We also recommend further refinement of the definitions around conceptual framework, theory, and model, suggesting a wider discussion that embraces multiple epistemological and ontological perspectives

Translating clinical training into practice in complex mental health systems: Toward opening the 'Black Box' of implementation

<p>Abstract</p> <p>Background</p> <p>Implementing clinical training in a complex health care system is challenging. This report describes two successive trainings programs in one Veterans Affairs healthcare network and the lessons we drew from their success and failures. The first training experience led us to appreciate the value of careful implementation planning while the second suggested that use of an external facilitator might be an especially effective implementation component. We also describe a third training intervention in which we expect to more rigorously test our hypothesis regarding the value of external facilitation.</p> <p>Results</p> <p>Our experiences appear to be consonant with the implementation model proposed by Fixsen. In this paper we offer a modified version of the Fixsen model with separate components related to training and implementation.</p> <p>Conclusion</p> <p>This report further reinforces what others have noted, namely that educational interventions intended to change clinical practice should employ a multilevel approach if patients are to truly benefit from new skills gained by clinicians. We utilize an implementation research model to illustrate how the aims of the second intervention were realized and sustained over the 12-month follow-up period, and to suggest directions for future implementation research. The present report attests to the validity of, and contributes to, the emerging literature on implementation research.</p

How can the practice nurse be more involved in the care of the chronically ill? The perspectives of GPs, patients and practice nurses

BACKGROUND: A well established "midlevel" of patient care, such as nurse practitioners and/or physician assistants, exits in many countries like the US, Canada, and Australia. In Germany, however there is only one kind of profession assisting the physician in practices, the practice nurse. Little is known about the present involvement of practice nurses in patients' care in Germany and about the attitudes of GPs, assistants and patients concerning an increased involvement. The aim of our study was to get qualitative information on the extent to which practice nurses are currently involved in the treatment of patients and about possibilities of increased involvement as well as on barriers of increased involvement. METHODS: We performed qualitative, semi-structured interviews with 20 GPs, 20 practice nurses and 20 patients in the Heidelberg area. The interviews were digitally recorded, transcribed and content-analysed with ATLAS.ti. RESULTS: Practice nurses are only marginally involved in the treatment of patients. GPs as well as patients were very sceptical about increased involvement in care. Patients were sceptical about nurses' professional background and feared a worsening of the patient doctor relationship. GPs also complained about the nurses' deficient education concerning medical knowledge. They feared a lack of time as well as a missing reimbursement for the efforts of an increased involvement. Practice nurses were mostly willing to be more involved, regarding it as an appreciation of their role. Important barriers were lack of time, overload with administrative work, and a lack of professional knowledge. CONCLUSION: Practice nurses were only little involved in patient care. GPs were more sceptical than patients regarding an increased involvement. One possible area, accepted by all interviewed groups, was patient education as for instance dietary counselling. New treatment approaches as the chronic care model will require a team approach which currently only marginally exists in the German health care system. Better medical education of practice nurses is indispensable, but GPs also have to accept that they cannot fulfil the requirement of future care alone

Is the involvement of opinion leaders in the implementation of research findings a feasible strategy?

BACKGROUND: There is only limited empirical evidence about the effectiveness of opinion leaders as health care change agents. AIM: To test the feasibility of identifying, and the characteristics of, opinion leaders using a sociometric instrument and a self-designating instrument in different professional groups within the UK National Health Service. DESIGN: Postal questionnaire survey. SETTING AND PARTICIPANTS: All general practitioners, practice nurses and practice managers in two regions of Scotland. All physicians and surgeons (junior hospital doctors and consultants) and medical and surgical nursing staff in two district general hospitals and one teaching hospital in Scotland, as well as all Scottish obstetric and gynaecology, and oncology consultants. RESULTS: Using the sociometric instrument, the extent of social networks and potential coverage of the study population in primary and secondary care was highly idiosyncratic. In contrast, relatively complex networks with good coverage rates were observed in both national specialty groups. Identified opinion leaders were more likely to have the expected characteristics of opinion leaders identified from diffusion and social influence theories. Moreover, opinion leaders appeared to be condition-specific. The self-designating instrument identified more opinion leaders, but it was not possible to estimate the extent and structure of social networks or likely coverage by opinion leaders. There was poor agreement in the responses to the sociometric and self-designating instruments. CONCLUSION: The feasibility of identifying opinion leaders using an off-the-shelf sociometric instrument is variable across different professional groups and settings within the NHS. Whilst it is possible to identify opinion leaders using a self-designating instrument, the effectiveness of such opinion leaders has not been rigorously tested in health care settings. Opinion leaders appear to be monomorphic (different leaders for different issues). Recruitment of opinion leaders is unlikely to be an effective general strategy across all settings and professional groups; the more specialised the group, the more opinion leaders may be a useful strategy

Quantitative data management in quality improvement collaboratives

<p>Abstract</p> <p>Background</p> <p>Collaborative approaches in quality improvement have been promoted since the introduction of the Breakthrough method. The effectiveness of this method is inconclusive and further independent evaluation of the method has been called for. For any evaluation to succeed, data collection on interventions performed within the collaborative and outcomes of those interventions is crucial. Getting enough data from Quality Improvement Collaboratives (QICs) for evaluation purposes, however, has proved to be difficult. This paper provides a retrospective analysis on the process of data management in a Dutch Quality Improvement Collaborative. From this analysis general failure and success factors are identified.</p> <p>Discussion</p> <p>This paper discusses complications and dilemma's observed in the set-up of data management for QICs. An overview is presented of signals that were picked up by the data management team. These signals were used to improve the strategies for data management during the program and have, as far as possible, been translated into practical solutions that have been successfully implemented.</p> <p>The recommendations coming from this study are:</p> <p>From our experience it is clear that quality improvement programs deviate from experimental research in many ways. It is not only impossible, but also undesirable to control processes and standardize data streams. QIC's need to be clear of data protocols that do not allow for change. It is therefore minimally important that when quantitative results are gathered, these results are accompanied by qualitative results that can be used to correctly interpret them.</p> <p>Monitoring and data acquisition interfere with routine. This makes a database collecting data in a QIC an intervention in itself. It is very important to be aware of this in reporting the results. Using existing databases when possible can overcome some of these problems but is often not possible given the change objective of QICs.</p> <p>Introducing a standardized spreadsheet to the teams is a very practical and helpful tool in collecting standardized data within a QIC. It is vital that the spreadsheets are handed out before baseline measurements start.</p

Opening the black box of quality improvement collaboratives: an Actor-Network theory approach

<p>Abstract</p> <p>Background</p> <p>Quality improvement collaboratives are often labeled as black boxes because effect studies usually do not describe exactly how the results were obtained. In this article we propose a way of opening such a black box, by taking up a dynamic perspective based on Actor-Network Theory. We thereby analyze how the problematisation process and the measurement practices are constructed. Findings from this analysis may have consequences for future evaluation studies of collaboratives.</p> <p>Methods</p> <p>In an ethnographic design we probed two projects within a larger quality improvement collaborative on long term mental health care and care for the intellectually disabled. Ethnographic observations were made at nine national conferences. Furthermore we conducted six case studies involving participating teams. Additionally, we interviewed the two program leaders of the overall projects.</p> <p>Results</p> <p>In one project the problematisation seemed to undergo a shift of focus away from the one suggested by the project leaders. In the other we observed multiple roles of the measurement instrument used. The instrument did not only measure effects of the improvement actions but also changed these actions and affected the actors involved.</p> <p>Conclusions</p> <p>Effectiveness statistics ideally should be complemented with an analysis of the construction of the collaborative and the improvement practices. Effect studies of collaboratives could benefit from a mixed methods research design that combines quantitative and qualitative methods.</p

Factors influencing success in quality-improvement collaboratives: development and psychometric testing of an instrument

Contains fulltext : 88630.pdf (publisher's version ) (Open Access)ABSTRACT: BACKGROUND: To increase the effectiveness of quality-improvement collaboratives (QICs), it is important to explore factors that potentially influence their outcomes. For this purpose, we have developed and tested the psychometric properties of an instrument that aims to identify the features that may enhance the quality and impact of collaborative quality-improvement approaches. The instrument can be used as a measurement instrument to retrospectively collect information about perceived determinants of success. In addition, it can be prospectively applied as a checklist to guide initiators, facilitators, and participants of QICs, with information about how to perform or participate in a collaborative with theoretically optimal chances of success. Such information can be used to improve collaboratives. METHODS: We developed an instrument with content validity based on literature and the opinions of QIC experts. We collected data from 144 healthcare professionals in 44 multidisciplinary improvement teams participating in two QICs and used exploratory factor analysis to assess the construct validity. We used Cronbach's alpha to ascertain the internal consistency. RESULTS: The 50-item instrument we developed reflected expert-opinion-based determinants of success in a QIC. We deleted nine items after item reduction. On the basis of the factor analysis results, one item was dropped, which resulted in a 40-item questionnaire. Exploratory factor analysis showed that a three-factor model provided the best fit. The components were labeled 'sufficient expert team support', 'effective multidisciplinary teamwork', and 'helpful collaborative processes'. Internal consistency reliability was excellent (alphas between .85 and .89). CONCLUSIONS: This newly developed instrument seems a promising tool for providing healthcare workers and policy makers with useful information about determinants of success in QICs. The psychometric properties of the instrument are satisfactory and warrant application either as an objective measure or as a checklist

Barriers to implementation of a computerized decision support system for depression: an observational report on lessons learned in "real world" clinical settings

<p>Abstract</p> <p>Background</p> <p>Despite wide promotion, clinical practice guidelines have had limited effect in changing physician behavior. Effective implementation strategies to date have included: multifaceted interventions involving audit and feedback, local consensus processes, marketing; reminder systems, either manual or computerized; and interactive educational meetings. In addition, there is now growing evidence that contextual factors affecting implementation must be addressed such as organizational support (leadership procedures and resources) for the change and strategies to implement and maintain new systems.</p> <p>Methods</p> <p>To examine the feasibility and effectiveness of implementation of a computerized decision support system for depression (CDSS-D) in routine public mental health care in Texas, fifteen study clinicians (thirteen physicians and two advanced nurse practitioners) participated across five sites, accruing over 300 outpatient visits on 168 patients.</p> <p>Results</p> <p>Issues regarding computer literacy and hardware/software requirements were identified as initial barriers. Clinicians also reported concerns about negative impact on workflow and the potential need for duplication during the transition from paper to electronic systems of medical record keeping.</p> <p>Conclusion</p> <p>The following narrative report based on observations obtained during the initial testing and use of a CDSS-D in clinical settings further emphasizes the importance of taking into account organizational factors when planning implementation of evidence-based guidelines or decision support within a system.</p

From theory to practice: improving the impact of health services research

BACKGROUND: While significant strides have been made in health research, the incorporation of research evidence into healthcare decision-making has been marginal. The purpose of this paper is to provide an overview of how the utility of health services research can be improved through the use of theory. Integrating theory into health services research can improve research methodology and encourage stronger collaboration with decision-makers. DISCUSSION: Recognizing the importance of theory calls for new expectations in the practice of health services research. These include: the formation of interdisciplinary research teams; broadening the training for those who will practice health services research; and supportive organizational conditions that promote collaboration between researchers and decision makers. Further, funding bodies can provide a significant role in guiding and supporting the use of theory in the practice of health services research. SUMMARY: Institutions and researchers should incorporate the use of theory if health services research is to fulfill its potential for improving the delivery of health care