Evaluating the successful implementation of evidence into practice using the PARiHS framework : theoretical and practical challenges

Background The PARiHS framework (Promoting Action on Research Implementation in Health Services) has proved to be a useful practical and conceptual heuristic for many researchers and practitioners in framing their research or knowledge translation endeavours. However, as a conceptual framework it still remains untested and therefore its contribution to the overall development and testing of theory in the field of implementation science is largely unquantified. Discussion This being the case, the paper provides an integrated summary of our conceptual and theoretical thinking so far and introduces a typology (derived from social policy analysis) used to distinguish between the terms conceptual framework, theory and model – important definitional and conceptual issues in trying to refine theoretical and methodological approaches to knowledge translation. Secondly, the paper describes the next phase of our work, in particular concentrating on the conceptual thinking and mapping that has led to the generation of the hypothesis that the PARiHS framework is best utilised as a two-stage process: as a preliminary (diagnostic and evaluative) measure of the elements and sub-elements of evidence (E) and context (C), and then using the aggregated data from these measures to determine the most appropriate facilitation method. The exact nature of the intervention is thus determined by the specific actors in the specific context at a specific time and place. In the process of refining this next phase of our work, we have had to consider the wider issues around the use of theories to inform and shape our research activity; the ongoing challenges of developing robust and sensitive measures; facilitation as an intervention for getting research into practice; and finally to note how the current debates around evidence into practice are adopting wider notions that fit innovations more generally. Summary The paper concludes by suggesting that the future direction of the work on the PARiHS framework is to develop a two-stage diagnostic and evaluative approach, where the intervention is shaped and moulded by the information gathered about the specific situation and from participating stakeholders. In order to expedite the generation of new evidence and testing of emerging theories, we suggest the formation of an international research implementation science collaborative that can systematically collect and analyse experiences of using and testing the PARiHS framework and similar conceptual and theoretical approaches. We also recommend further refinement of the definitions around conceptual framework, theory, and model, suggesting a wider discussion that embraces multiple epistemological and ontological perspectives

Do self-reported intentions predict clinicians behaviour: a systematic review.

Background: Implementation research is the scientific study of methods to promote the systematic uptake of clinical research findings into routine clinical practice. Several interventions have been shown to be effective in changing health care professionals' behaviour, but heterogeneity within interventions, targeted behaviours, and study settings make generalisation difficult. Therefore, it is necessary to identify the 'active ingredients' in professional behaviour change strategies. Theories of human behaviour that feature an individual's "intention" to do something as the most immediate predictor of their behaviour have proved to be useful in non-clinical populations. As clinical practice is a form of human behaviour such theories may offer a basis for developing a scientific rationale for the choice of intervention to use in the implementation of new practice. The aim of this review was to explore the relationship between intention and behaviour in clinicians and how this compares to the intention-behaviour relationship in studies of non-clinicians. Methods: We searched: PsycINFO, MEDLINE, EMBASE, CINAHL, Cochrane Central Register of Controlled Trials, Science/Social science citation index, Current contents (social & behavioural med/clinical med), ISI conference proceedings, and Index to Theses. The reference lists of all included papers were checked manually. Studies were eligible for inclusion if they had: examined a clinical behaviour within a clinical context, included measures of both intention and behaviour, measured behaviour after intention, and explored this relationship quantitatively. All titles and abstracts retrieved by electronic searching were screened independently by two reviewers, with disagreements resolved by discussion. Discussion: Ten studies were found that examined the relationship between intention and clinical behaviours in 1623 health professionals. The proportion of variance in behaviour explained by intention was of a similar magnitude to that found in the literature relating to non-health professionals. This was more consistently the case for studies in which intention-behaviour correspondence was good and behaviour was self-reported. Though firm conclusions are limited by a smaller literature, our findings are consistent with that of the non-health professional literature. This review, viewed in the context of the larger populations of studies, provides encouragement for the contention that there is a predictable relationship between the intentions of a health professional and their subsequent behaviour. However, there remain significant methodological challenges

Evidence and argument in policymaking: development of workplace smoking legislation

<p>Abstract</p> <p>Background</p> <p>We sought to identify factors that affect the passage of public health legislation by examining the use of arguments, particularly arguments presenting research evidence, in legislative debates regarding workplace smoking restrictions.</p> <p>Methods</p> <p>We conducted a case-study based content analysis of legislative materials used in the development of six state workplace smoking laws, including written and spoken testimony and the text of proposed and passed bills and amendments. We coded testimony given before legislators for arguments used, and identified the institutional affiliations of presenters and their position on the legislation. We compared patterns in the arguments made in testimony to the relative strength of each state's final legislation.</p> <p>Results</p> <p>Greater discussion of scientific evidence within testimony given was associated with the passage of workplace smoking legislation that provided greater protection for public health, regardless of whether supporters outnumbered opponents or vice versa.</p> <p>Conclusion</p> <p>Our findings suggest that an emphasis on scientific discourse, relative to other arguments made in legislative testimony, might help produce political outcomes that favor public health.</p

A pragmatic cluster randomised trial evaluating three implementation interventions

Background Implementation research is concerned with bridging the gap between evidence and practice through the study of methods to promote the uptake of research into routine practice. Good quality evidence has been summarised into guideline recommendations to show that peri-operative fasting times could be considerably shorter than patients currently experience. The objective of this trial was to evaluate the effectiveness of three strategies for the implementation of recommendations about peri-operative fasting. Methods A pragmatic cluster randomised trial underpinned by the PARIHS framework was conducted during 2006 to 2009 with a national sample of UK hospitals using time series with mixed methods process evaluation and cost analysis. Hospitals were randomised to one of three interventions: standard dissemination (SD) of a guideline package, SD plus a web-based resource championed by an opinion leader, and SD plus plan-do-study-act (PDSA). The primary outcome was duration of fluid fast prior to induction of anaesthesia. Secondary outcomes included duration of food fast, patients' experiences, and stakeholders' experiences of implementation, including influences. ANOVA was used to test differences over time and interventions. Results Nineteen acute NHS hospitals participated. Across timepoints, 3,505 duration of fasting observations were recorded. No significant effect of the interventions was observed for either fluid or food fasting times. The effect size was 0.33 for the web-based intervention compared to SD alone for the change in fluid fasting and was 0.12 for PDSA compared to SD alone. The process evaluation showed different types of impact, including changes to practices, policies, and attitudes. A rich picture of the implementation challenges emerged, including inter-professional tensions and a lack of clarity for decision-making authority and responsibility. Conclusions This was a large, complex study and one of the first national randomised controlled trials conducted within acute care in implementation research. The evidence base for fasting practice was accepted by those participating in this study and the messages from it simple; however, implementation and practical challenges influenced the interventions' impact. A set of conditions for implementation emerges from the findings of this study, which are presented as theoretically transferable propositions that have international relevance. Trial registration ISRCTN18046709 - Peri-operative Implementation Study Evaluation (POISE

Interventions aimed at increasing research use in nursing: a systematic review

<p>Abstract</p> <p>Background</p> <p>There has been considerable interest recently in developing and evaluating interventions to increase research use by clinicians. However, most work has focused on medical practices; and nursing is not well represented in existing systematic reviews. The purpose of this article is to report findings from a systematic review of interventions aimed at increasing research use in nursing.</p> <p>Objective</p> <p>To assess the evidence on interventions aimed at increasing research use in nursing.</p> <p>Methods</p> <p>A systematic review of research use in nursing was conducted using databases (Medline, CINAHL, Healthstar, ERIC, Cochrane Central Register of Controlled Trials, and Psychinfo), grey literature, ancestry searching (Cochrane Database of Systematic Reviews), key informants, and manual searching of journals. Randomized controlled trials and controlled before- and after-studies were included if they included nurses, if the intervention was explicitly aimed at increasing research use or evidence-based practice, and if there was an explicit outcome to research use. Methodological quality was assessed using pre-existing tools. Data on interventions and outcomes were extracted and categorized using a pre-established taxonomy.</p> <p>Results</p> <p>Over 8,000 titles were screened. Three randomized controlled trials and one controlled before- and after-study met the inclusion criteria. The methodological quality of included studies was generally low. Three investigators evaluated single interventions. The most common intervention was education. Investigators measured research use using a combination of surveys (three studies) and compliance with guidelines (one study). Researcher-led educational meetings were ineffective in two studies. Educational meetings led by a local opinion leader (one study) and the formation of multidisciplinary committees (one study) were both effective at increasing research use.</p> <p>Conclusion</p> <p>Little is known about how to increase research use in nursing, and the evidence to support or refute specific interventions is inconclusive. To advance the field, we recommend that investigators: (1) use theoretically informed interventions to increase research use, (2) measure research use longitudinally using theoretically informed and psychometrically sound measures of research use, as well as, measuring patient outcomes relevant to the intervention, and (3) use more robust and methodologically sound study designs to evaluate interventions. If investigators aim to establish a link between using research and improved patient outcomes they must first identify those interventions that are effective at increasing research use.</p

Study protocol for the translating research in elder care (TREC): building context – an organizational monitoring program in long-term care project (project one)

<p>Abstract</p> <p>Background</p> <p>While there is a growing awareness of the importance of organizational context (or the work environment/setting) to successful knowledge translation, and successful knowledge translation to better patient, provider (staff), and system outcomes, little empirical evidence supports these assumptions. Further, little is known about the factors that enhance knowledge translation and better outcomes in residential long-term care facilities, where care has been shown to be suboptimal. The project described in this protocol is one of the two main projects of the larger five-year Translating Research in Elder Care (TREC) program.</p> <p>Aims</p> <p>The purpose of this project is to establish the magnitude of the effect of organizational context on knowledge translation, and subsequently on resident, staff (unregulated, regulated, and managerial) and system outcomes in long-term care facilities in the three Canadian Prairie Provinces (Alberta, Saskatchewan, Manitoba).</p> <p>Methods/Design</p> <p>This study protocol describes the details of a multi-level – including provinces, regions, facilities, units within facilities, and individuals who receive care (residents) or work (staff) in facilities – and longitudinal (five-year) research project. A stratified random sample of 36 residential long-term care facilities (30 urban and 6 rural) from the Canadian Prairie Provinces will comprise the sample. Caregivers and care managers within these facilities will be asked to complete the TREC survey – a suite of survey instruments designed to assess organizational context and related factors hypothesized to be important to successful knowledge translation and to achieving better resident, staff, and system outcomes. Facility and unit level data will be collected using standardized data collection forms, and resident outcomes using the Resident Assessment Instrument-Minimum Data Set version 2.0 instrument. A variety of analytic techniques will be employed including descriptive analyses, psychometric analyses, multi-level modeling, and mixed-method analyses.</p> <p>Discussion</p> <p>Three key challenging areas associated with conducting this project are discussed: sampling, participant recruitment, and sample retention; survey administration (with unregulated caregivers); and the provision of a stable set of study definitions to guide the project.</p

Infant feeding counselling in Uganda in a changing environment with focus on the general population and HIV-positive mothers - a mixed method approach

<p>Abstract</p> <p>Background</p> <p>Health workers' counselling practices are essential to improve infant feeding practices. This paper will assess how infant feeding counselling was done and experienced by counsellors and mothers in Eastern Uganda in the context of previous guidelines. This has implications for implementation of the new infant feeding guidelines from 2009.</p> <p>Methods</p> <p>This paper combines qualitative and quantitative data from Mbale District in Eastern Uganda. Data was collected from 2003 to 2005 in a mixed methods approach. This includes: key-informant interviews among eighteen health workers in the public hospital, health clinics and non-governmental organisations working with people living with HIV, fifteen focus group discussions in the general population and among clients from an HIV clinic, two cross-sectional surveys including 727 mothers from the general population and 235 HIV-positive mothers.</p> <p>Results</p> <p>The counselling sessions were often improvised. Health workers frequently had pragmatic approaches to infant feeding as many clients struggled with poverty, stigma and non-disclosure of HIV. The feasibility of the infant feeding recommendations was perceived as challenging among health workers, both for HIV-positive mothers and in the general population. Group counselling with large groups was common in the public health service. Some extra infant feeding teaching capacities were mobilised for care-takers of undernourished children. A tendency to simplify messages giving one-sided information was seen. Different health workers presented contradicting simplified perspectives in some cases. Outdated training was a common concern with many health workers not being given courses or seminars on infant feeding since professional graduation. Other problems were minimal staffing, lack of resources, and programs being started and subsequently stopped abruptly. Many of the HIV-counsellors in the non-governmental organisations got extended training in counselling which seemed to be beneficial.</p> <p>Conclusions</p> <p>Health workers were faced with challenges related to workload, resources, scientific updating, and also a need to adjust to frequent changes in programs, recommendations and guidelines. The clients were faced with difficult choices, poverty, lack of education and stigma. Feasibility of the recommendations was a major concern. Systematic approaches to update health workers should be a priority.</p

Minimising treatment-associated risks in systemic cancer therapy

Aim of the review To review the consequences of drug-related problems (DRP) in systemic cancer therapy and identify specific contributions of the pharmacist to minimise treatment-associated risks. Method Searches in PubMed, Embase and the Cochrane Library were conducted. Bibliographies of retrieved articles were examined for additional references. Only papers in English between 1980 and 2007 were included. Results In systemic cancer therapy there is an enormous potential for DRP due to the high toxicity and the complexity of most therapeutic regimens. The most frequently reported DRP can be classified into adverse effects, drug–drug interactions, medication errors, and non-adherence. Pharmacists have enhanced efforts to assure quality and safety in systemic cancer therapy together with other health care providers. In consequence, oncology pharmacy has evolved as a novel specialist discipline. The endeavour to merge and co-ordinate individual activities and services of the pharmacist has led to pharmaceutical care concepts which aim at offering novel solutions to the various DRP. Conclusion Pharmaceutical care for cancer patients should be developed within research projects and integrated into disease management programs in order to ensure broad implementation

Fever, hyperglycaemia and swallowing dysfunction management in acute stroke: A cluster randomised controlled trial of knowledge transfer

Background: Hyperglycaemia, fever, and swallowing dysfunction are poorly managed in the admission phase of acute stroke, and patient outcomes are compromised. Use of evidence-based guidelines could improve care but have not been effectively implemented. Our study aims to develop and trial an intervention based on multidisciplinary team-building to improve management of fever, hyperglycaemia, and swallowing dysfunction in patients following acute stroke. Methods and design: Metropolitan acute stroke units (ASUs) located in New South Wales, Australia will be stratified by service category (A or B) and, within strata, by baseline patient recruitment numbers (high or low) in this prospective, multicentre, single-blind, cluster randomised controlled trial (CRCT). ASUs then will be randomised independently to either intervention or control groups. ASUs allocated to the intervention group will receive: unit-based workshops to identify local barriers and enablers; a standardised core education program; evidence-based clinical treatment protocols; and ongoing engagement of local staff. Control group ASUs will receive only an abridged version of the National Clinical Guidelines for Acute Stroke Management. The following outcome measures will be collected at 90 days post-hospital admission: patient death, disability (modified Rankin Score); dependency (Barthel Index) and Health Status (SF-36). Additional measures include: performance of swallowing screening within 24 hours of admission; glycaemic control and temperature control. Discussion: This is a unique study of research transfer in acute stroke. Providing optimal inpatient care during the admission phase is essential if we are to combat the rising incidence of debilitating stroke. Our CRCT will also allow us to test interventions focussed on multidisciplinary ASU teams rather than individual disciplines, an imperative of modern hospital services

Information transfer: what do decision makers want and need from researchers?

<p>Abstract</p> <p>Purpose</p> <p>The purpose of this study was to undertake a systematic assessment of the need for research-based information by decision-makers working in community-based organizations. It is part of a more comprehensive knowledge transfer and exchange strategy that seeks to understand both the content required and the format/methods by which such information should be presented.</p> <p>Methods</p> <p>This was a cross-sectional telephone survey. Questions covered current practices, research use, and demographic information, as well as preferences for receiving research information. Three types of organizations participated: Children's Treatment Centres of Ontario (CTCs); Ontario Community Care Access Centres (CCACs); and District Health Councils (DHCs). The analysis used descriptive statistics and analyses of variance (ANOVA) to describe and explore variations across organizations.</p> <p>Results</p> <p>The participation rate was 70%. The highest perception of barriers to the use of research information was reported by the CCAC respondents, followed by CTCs and DHCs. The CTCs and DHCs reported greater use of research evidence in planning decisions as compared to the CCACs. Four sources of information transfer were consistently identified. These were websites, health-related research journals, electronic mail, and conferences and workshops. Preferred formats for receiving information were executive summaries, abstracts, and original articles.</p> <p>Conclusion</p> <p>There were a number of similarities across organization type with respect to perceived barriers to research transfer, as well as the types of activities the organizations engaged in to promote research use in decision-making. These findings support the importance of developing interactive, collaborative knowledge transfer strategies, as well as the need to foster relationships with health care decision-makers, practitioners and policymakers.</p