NorthStar, a support tool for the design and evaluation of quality improvement interventions in healthcare

Background: The Research-Based Education and Quality Improvement (ReBEQI) European partnership aims to establish a framework and provide practical tools for the selection, implementation, and evaluation of quality improvement (QI) interventions. We describe the development and preliminary evaluation of the software tool NorthStar, a major product of the ReBEQI project. Methods: We focused the content of NorthStar on the design and evaluation of QI interventions. A lead individual from the ReBEQI group drafted each section, and at least two other group members reviewed it. The content is based on published literature, as well as material developed by the ReBEQI group. We developed the software in both a Microsoft Windows HTML help system version and a web-based version. In a preliminary evaluation, we surveyed 33 potential users about the acceptability and perceived utility of NorthStar. Results: NorthStar consists of 18 sections covering the design and evaluation of QI interventions. The major focus of the intervention design sections is on how to identify determinants of practice (factors affecting practice patterns), while the major focus of the intervention evaluation sections is on how to design a cluster randomised trial. The two versions of the software can be transferred by email or CD, and are available for download from the internet. The software offers easy navigation and various functions to access the content. Potential users (55% response rate) reported above-moderate levels of confidence in carrying out QI research related tasks if using NorthStar, particularly when developing a protocol for a cluster randomised trial Conclusion: NorthStar is an integrated, accessible, practical, and acceptable tool to assist developers and evaluators of QI interventions

Technology for large-scale translation of clinical practice guidelines : a pilot study of the performance of a hybrid human and computer-assisted approach

Background: The construction of EBMPracticeNet, a national electronic point-of-care information platform in Belgium, was initiated in 2011 to optimize quality of care by promoting evidence-based decision-making. The project involved, among other tasks, the translation of 940 EBM Guidelines of Duodecim Medical Publications from English into Dutch and French. Considering the scale of the translation process, it was decided to make use of computer-aided translation performed by certificated translators with limited expertise in medical translation. Our consortium used a hybrid approach, involving a human translator supported by a translation memory (using SDL Trados Studio), terminology recognition (using SDL Multiterm termbases) from medical termbases and support from online machine translation. This has resulted in a validated translation memory which is now in use for the translation of new and updated guidelines. Objective: The objective of this study was to evaluate the performance of the hybrid human and computer-assisted approach in comparison with translation unsupported by translation memory and terminology recognition. A comparison was also made with the translation efficiency of an expert medical translator. Methods: We conducted a pilot trial in which two sets of 30 new and 30 updated guidelines were randomized to one of three groups. Comparable guidelines were translated (a) by certificated junior translators without medical specialization using the hybrid method (b) by an experienced medical translator without this support and (c) by the same junior translators without the support of the validated translation memory. A medical proofreader who was blinded for the translation procedure, evaluated the translated guidelines for acceptability and adequacy. Translation speed was measured by recording translation and post-editing time. The Human Translation Edit Rate was calculated as a metric to evaluate the quality of the translation. A further evaluation was made of translation acceptability and adequacy. Results: The average number of words per guideline was 1,195 and the mean total translation time was 100.2 min/1,000 words. No meaningful differences were found in the translation speed for new guidelines. The translation of updated guidelines was 59 min/1,000 words faster (95% CI 2-115; P=.044) in the computer-aided group. Revisions due to terminology accounted for one third of the overall revisions by the medical proofreader. Conclusions: Use of the hybrid human and computer-aided translation by a non-expert translator makes the translation of updates of clinical practice guidelines faster and cheaper because of the benefits of translation memory. For the translation of new guidelines there was no apparent benefit in comparison with the efficiency of translation unsupported by translation memory (whether by an expert or non-expert translator

Collaborating with front-line healthcare professionals: the clinical and cost effectiveness of a theory based approach to the implementation of a national guideline

Background Clinical guidelines are an integral part of healthcare. Whilst much progress has been made in ensuring that guidelines are well developed and disseminated, the gap between routine clinical practice and current guidelines often remains wide. A key reason for this gap is that implementation of guidelines typically requires a change in the behaviour of healthcare professionals – but the behaviour change component is often overlooked. We adopted the Theoretical Domains Framework Implementation (TDFI) approach for supporting behaviour change required for the uptake of a national patient safety guideline to reduce the risk of feeding through misplaced nasogastric tubes. Methods The TDFI approach was used in a pre-post study in three NHS hospitals with a fourth acting as a control (with usual care and no TDFI). The target behavior identified for change was to increase the use of pH testing as the first line method for checking the position of a nasogastric tube. Repeat audits were undertaken in each hospital following intervention implementation. We used Zou’s modified Poisson regression approach with robust standard errors to estimate risk ratios for the use of pH testing. The projected return on investment (ROI) was also calculated. Results Following intervention implementation, the use of pH first line increased significantly across intervention hospitals [risk ratio (95% CI) ranged from 3.1 (1.14 to8.43) p < .05, to 8.14 (3.06 to21.67) p < .001] compared to the control hospital, which remained unchanged [risk ratio (CI) = .77 (.47-1.26) p = .296]. The estimated savings and costs in the first year were £2.56 million and £1.41 respectively, giving an ROI of 82%, and this was projected to increase to 270% over five years. Conclusion The TDFI approach improved the uptake of a patient safety guideline across three hospitals. The TDFI approach is clinically and cost effective in comparison to the usual practice

Designing theoretically-informed implementation interventions

Clinical and health services research is continually producing new findings that may contribute to effective and efficient patient care. However, the transfer of research findings into practice is unpredictable and can be a slow and haphazard process. Ideally, the choice of implementation strategies would be based upon evidence from randomised controlled trials or systematic reviews of a given implementation strategy. Unfortunately, reviews of implementation strategies consistently report effectiveness some, but not all of the time; possible causes of this variation are seldom reported or measured by the investigators in the original studies. Thus, any attempts to extrapolate from study settings to the real world are hampered by a lack of understanding of the effects of key elements of individuals, interventions, and the settings in which they were trialled. The explicit use of theory offers a way of addressing these issues and has a number of advantages, such as providing: a generalisable framework within which to represent the dimensions that implementation studies address, a process by which to inform the development and delivery of interventions, a guide when evaluating, and a way to allow for an exploration of potential causal mechanisms. However, the use of theory in designing implementation interventions is methodologically challenging for a number of reasons, including choosing between theories and faithfully translating theoretical constructs into interventions. The explicit use of theory offers potential advantages in terms of facilitating a better understanding of the generalisability and replicability of implementation interventions. However, this is a relatively unexplored methodological area

Mental imagery of positive and neutral memories: A fMRI study comparing field perspective imagery to observer perspective imagery

Imagery perspective can influence what information is recalled, processing style, and emotionality; however, the understanding of possible mechanisms mediating these observed differences is still limited. We aimed to examine differences between memory recall from a field perspective and observer perspective at the neurobiological level, in order to improve our understanding of what is underlying the observed differences at the behavioral level. We conducted a fMRI study in healthy individuals, comparing imagery perspectives during recall of neutral and positive autobiographical memories. Behavioral results revealed field perspective imagery of positive memories, as compared to observer perspective, to be associated with more positive feelings afterwards. At the neurobiological level, contrasting observer perspective to field perspective imagery was associated with greater activity, or less decrease relative to the control visual search task, in the right precuneus and in the right temporoparietal junction (TPJ). Greater activity in the right TPJ during an observer perspective as compared to field perspective could reflect performing a greater shift of perspective and mental state during observer perspective imagery than field perspective imagery. Differential activity in the precuneus may reflect that during observer perspective imagery individuals are more likely to engage in (self-) evaluative processing and visuospatial processing. Our findings contribute to a growing understanding of how imagery perspective can influence the type of information that is recalled and the intensity of the emotional response. Observer perspective imagery may not automatically reduce emotional intensity but this could depend on how the imagined situation is evaluated in relation to the self-concept

The cost-effectiveness of quality improvement projects: a conceptual framework, checklist and online tool for considering the costs and consequences of implementation based quality improvement

In resource constrained systems, decision makers should be concerned with the efficiency of implementing improvement techniques and technologies. Accordingly, they should consider both the costs and effectiveness of implementation as well as the cost-effectiveness of the innovation to be implemented. An approach to doing this effectively is encapsulated in the ‘policy cost-effectiveness’ approach. This paper outlines some of the theoretical and practical challenges to assessing policy cost-effectiveness (the cost-effectiveness of implementation projects). A checklist and associated (freely available) online application are also presented to help services develop more cost-effective implementation strategies

From theory to 'measurement' in complex interventions: methodological lessons from the development of an e-health normalisation instrument

&lt;b&gt;Background&lt;/b&gt; Although empirical and theoretical understanding of processes of implementation in health care is advancing, translation of theory into structured measures that capture the complex interplay between interventions, individuals and context remain limited. This paper aimed to (1) describe the process and outcome of a project to develop a theory-based instrument for measuring implementation processes relating to e-health interventions; and (2) identify key issues and methodological challenges for advancing work in this field.&lt;p&gt;&lt;/p&gt; &lt;b&gt;Methods&lt;/b&gt; A 30-item instrument (Technology Adoption Readiness Scale (TARS)) for measuring normalisation processes in the context of e-health service interventions was developed on the basis on Normalization Process Theory (NPT). NPT focuses on how new practices become routinely embedded within social contexts. The instrument was pre-tested in two health care settings in which e-health (electronic facilitation of healthcare decision-making and practice) was used by health care professionals.&lt;p&gt;&lt;/p&gt; &lt;b&gt;Results&lt;/b&gt; The developed instrument was pre-tested in two professional samples (N = 46; N = 231). Ratings of items representing normalisation 'processes' were significantly related to staff members' perceptions of whether or not e-health had become 'routine'. Key methodological challenges are discussed in relation to: translating multi-component theoretical constructs into simple questions; developing and choosing appropriate outcome measures; conducting multiple-stakeholder assessments; instrument and question framing; and more general issues for instrument development in practice contexts.&lt;p&gt;&lt;/p&gt; &lt;b&gt;Conclusions&lt;/b&gt; To develop theory-derived measures of implementation process for progressing research in this field, four key recommendations are made relating to (1) greater attention to underlying theoretical assumptions and extent of translation work required; (2) the need for appropriate but flexible approaches to outcomes measurement; (3) representation of multiple perspectives and collaborative nature of work; and (4) emphasis on generic measurement approaches that can be flexibly tailored to particular contexts of study

Clinical practice guidelines: towards better quality guidelines and increased international collaboration

Item does not contain fulltex