Practice Feedback Interventions: 15 Suggestions for Optimizing Effectiveness

Electronic practice data are increasingly being used to provide feedback to encourage practice improvement. However, evidence suggests that despite decades of experience, the effects of such interventions vary greatly and are not improving over time. Guidance on providing more effective feedback does exist, but it is distributed across a wide range of disciplines and theoretical perspectives. Through expert interviews; systematic reviews; and experience with providing, evaluating, and receiving practice feedback, 15 suggestions that are believed to be associated with effective feedback interventions have been identified. These suggestions are intended to provide practical guidance to quality improvement professionals, information technology developers, educators, administrators, and practitioners who receive such interventions. Designing interventions with these suggestions in mind should improve their effect, and studying the mechanisms underlying these suggestions will advance a stagnant literature

AIMD - A validated, simplified framework of interventions to promote and integrate evidence into health practices, systems, and policies

Background: Proliferation of terms describing the science of effectively promoting and supporting the use of research evidence in healthcare policy and practice has hampered understanding and development of the field. To address this, an international Terminology Working Group developed and published a simplified framework of interventions to promote and integrate evidence into health practices, systems, and policies. This paper presents results of validation work and a second international workgroup meeting, culminating in the updated AIMD framework [Aims, Ingredients, Mechanism, Delivery]. Methods: Framework validity was evaluated against terminology schemas (n = 51); primary studies (n = 37); and reporting guidelines (n = 10). Framework components were independently categorized as fully represented, partly represented, or absent by two researchers. Opportunities to refine the framework were systematically recorded. A meeting of the expanded international Terminology Working Group updated the framework by reviewing and deliberating upon validation findings and refinement proposals. Results: There was variation in representativeness of the components across the three types of literature, in particular for the component 'causal mechanisms'. Analysis of primary studies revealed that representativeness of this concept lowered from 92 to 68% if only explicit, rather than explicit and non-explicit references to causal mechanisms were included. All components were very well represented in reporting guidelines, however the level of description of these was lower than in other types of literature. Twelve opportunities were identified to improve the framework, 9 of which were operationalized at the meeting. The updated AIMD framework comprises four components: (1) Aims: what do you want your intervention to achieve and for whom? (2) Ingredients: what comprises the intervention? (3) Mechanisms: how do you propose the intervention will work? and (4) Delivery: how will you deliver the intervention? Conclusions: The draft simplified framework was validated with reference to a wide range of relevant literature and improvements have enhanced useability. The AIMD framework could aid in the promotion of evidence into practice, remove barriers to understanding how interventions work, enhance communication of interventions and support knowledge synthesis. Future work needs to focus on developing and testing resources and educational initiatives to optimize use of the AIMD framework in collaboration with relevant end-user groups

No more 'business as usual' with audit and feedback interventions: towards an agenda for a reinvigorated intervention

Background: Audit and feedback interventions in healthcare have been found to be effective, but there has been little progress with respect to understanding their mechanisms of action or identifying their key ‘active ingredients.’ Discussion: Given the increasing use of audit and feedback to improve quality of care, it is imperative to focus further research on understanding how and when it works best. In this paper, we argue that continuing the ‘business as usual’ approach to evaluating two-arm trials of audit and feedback interventions against usual care for common problems and settings is unlikely to contribute new generalizable findings. Future audit and feedback trials should incorporate evidence- and theory-based best practices, and address known gaps in the literature. Summary: We offer an agenda for high-priority research topics for implementation researchers that focuses on reviewing best practices for designing audit and feedback interventions to optimize effectiveness

Development of an intervention to improve appropriate polypharmacy in older people in primary care using a theory-based method

BACKGROUND: It is advocated that interventions to improve clinical practice should be developed using a systematic approach and intervention development methods should be reported. However, previous interventions aimed at ensuring that older people receive appropriate polypharmacy have lacked details on their development. This study formed part of a multiphase research project which aimed to develop an intervention to improve appropriate polypharmacy in older people in primary care. METHODS: The target behaviours for the intervention were prescribing and dispensing of appropriate polypharmacy to older patients by general practitioners (GPs) and community pharmacists. Intervention development followed a systematic approach, including previous mapping of behaviour change techniques (BCTs) to key domains from the Theoretical Domains Framework that were perceived by GPs and pharmacists to influence the target behaviours. Draft interventions were developed to operationalise selected BCTs through team discussion. Selection of an intervention for feasibility testing was guided by a subset of the APEASE (Affordability, Practicability, Effectiveness/cost-effectiveness, Acceptability, Side-effects/safety, Equity) criteria. RESULTS: Three draft interventions comprising selected BCTs were developed, targeting patients, pharmacists and GPs, respectively. Following assessment of each intervention using a subset of the APEASE criteria (affordability, practicability, acceptability), the GP-targeted intervention was selected for feasibility testing. This intervention will involve a demonstration of the behaviour and will be delivered as an online video. The video demonstrating how GPs can prescribe appropriate polypharmacy during a typical consultation with an older patient will also demonstrate salience of consequences (feedback emphasising the positive outcomes of performing the behaviour). Action plans and prompts/cues will be used as complementary intervention components. The intervention is designed to facilitate the prescribing of appropriate polypharmacy in routine practice. CONCLUSION: A GP-targeted intervention to improve appropriate polypharmacy in older people has been developed using a systematic approach. Intervention content has been specified using an established taxonomy of BCTs and selected to maximise feasibility. The results of a future feasibility study will help to determine if the theory-based intervention requires further refinement before progressing to a larger scale randomised evaluation

A guide to using the Theoretical Domains Framework of behaviour change to investigate implementation problems

Background: Implementing new practices requires changes in the behaviour of relevant actors, and this is facilitated by understanding of the determinants of current and desired behaviours. The Theoretical Domains Framework (TDF) was developed by a collaboration of behavioural scientists and implementation researchers who identified theories relevant to implementation and grouped constructs from these theories into domains. The collaboration aimed to provide a comprehensive, theory-informed approach to identify determinants of behaviour. The first version was published in 2005, and a subsequent version following a validation exercise was published in 2012. This guide offers practical guidance for those who wish to apply the TDF to assess implementation problems and support intervention design. It presents a brief rationale for using a theoretical approach to investigate and address implementation problems, summarises the TDF and its development, and describes how to apply the TDF to achieve implementation objectives. Examples from the implementation research literature are presented to illustrate relevant methods and practical considerations. Methods: Researchers from Canada, the UK and Australia attended a 3-day meeting in December 2012 to build an international collaboration among researchers and decision-makers interested in the advancing use of the TDF. The participants were experienced in using the TDF to assess implementation problems, design interventions, and/or understand change processes. This guide is an output of the meeting and also draws on the a uthors' collective experience. Examples from the implementation research literature judged by authors to be representative of specific applications of the TDF are included in this guide. Results: We explain and illustrate methods, with a focus on qualitative approaches, for selecting and specifying target behaviours key to implementation, selecting the study design, deciding the sampling strategy, developing study materials, collecting and analysing data, and reporting findings of TDF-based studies. Areas for development include methods for triangulating data, e.g. from interviews, questionnaires and observation and methods for designing interventions based on TDF-based problem analysis. Conclusions: We offer this guide to the implementation community to assist in the application of the TDF to achieve implementation objectives. Benefits of using the TDF include the provision of a theoretical basis for implementation studies, good coverage of potential reasons for slow diffusion of evidence into practice and a method for progressing from theory-based investigation to intervention

Changing behaviour 'more or less'-do theories of behaviour inform strategies for implementation and de-implementation? A critical interpretive synthesis

BACKGROUND: Implementing evidence-based care requires healthcare practitioners to do less of some things (de-implementation) and more of others (implementation). Variations in effectiveness of behaviour change interventions may result from failure to consider a distinction between approaches by which behaviour increases and decreases in frequency. The distinction is not well represented in methods for designing interventions. This review aimed to identify whether there is a theoretical rationale to support this distinction. METHODS: Using Critical Interpretative Synthesis, this conceptual review included papers from a broad range of fields (biology, psychology, education, business) likely to report approaches for increasing or decreasing behaviour. Articles were identified from databases using search terms related to theory and behaviour change. Articles reporting changes in frequency of behaviour and explicit use of theory were included. Data extracted were direction of behaviour change, how theory was operationalised, and theory-based recommendations for behaviour change. Analyses of extracted data were conducted iteratively and involved inductive coding and critical exploration of ideas and purposive sampling of additional papers to explore theoretical concepts in greater detail. RESULTS: Critical analysis of 66 papers and their theoretical sources identified three key findings: (1) 9 of the 15 behavioural theories identified do not distinguish between implementation and de-implementation (5 theories were applied to only implementation or de-implementation, not both); (2) a common strategy for decreasing frequency was substituting one behaviour with another. No theoretical basis for this strategy was articulated, nor were methods proposed for selecting appropriate substitute behaviours; (3) Operant Learning Theory makes an explicit distinction between techniques for increasing and decreasing frequency. DISCUSSION: Behavioural theories provide little insight into the distinction between implementation and de-implementation. Operant Learning Theory identified different strategies for implementation and de-implementation, but these strategies may not be acceptable in health systems. Additionally, if behaviour substitution is an approach for de-implementation, further investigation may inform methods or rationale for selecting the substitute behaviour

Identifying models of delivery, care domains and quality indicators relevant to palliative day services: a scoping review protoco

Abstract Background With an ageing population and increasing numbers of people with life-limiting illness, there is a growing demand for palliative day services. There is a need to measure and demonstrate the quality of these services, but there is currently little agreement on which aspects of care should be used to do this. The aim of the scoping review will be to map the extent, range and nature of the evidence around models of delivery, care domains and existing quality indicators used to evaluate palliative day services. Methods Electronic databases (MEDLINE, EMBASE, CINAHL, PsycINFO, Cochrane Central Register of Controlled Trials) will be searched for evidence using consensus development methods; randomised or quasi-randomised controlled trials; mixed methods; and prospective, longitudinal or retrospective case-control studies to develop or test quality indicators for evaluating palliative care within non-residential settings, including day hospices and community or primary care settings. At least two researchers will independently conduct all searches, study selection and data abstraction procedures. Meta-analyses and statistical methods of synthesis are not planned as part of the review. Results will be reported using numerical counts, including number of indicators in each care domain and by using qualitative approach to describe important indicator characteristics. A conceptual model will also be developed to summarise the impact of different aspects of quality in a palliative day service context. Methodological quality relating to indicator development will be assessed using the Appraisal of Indicators through Research and Evaluation (AIRE) tool. Overall strength of evidence will be assessed using the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) system. Final decisions on quality assessment will be made via consensus between review authors. Discussion Identifying, developing and implementing evidence-based quality indicators is critical to the evaluation and continued improvement of palliative care. Review findings will be used to support clinicians and policymakers make decisions on which quality indicators are most appropriate for evaluating day services at the patient and service level, and to identify areas for further research

Persuading from the Start:Participatory Development of Sustainable Persuasive Data-Driven Technologies in Healthcare

Data-driven technologies can persuade humans to optimize their behavior and context based on objective data. However, current data-driven technologies have limited persuasive powers, because of a misfit between technology, end-users and context. Neglecting end-users in the development process contributes to this misfit and to limited engagement with the to-be-developed technology. This threatens sustainable (long-term) implementation. Therefore, this paper demonstrates how a bottom-up participatory development approach can improve the persuasive design of data-driven technologies and simultaneously increase engagement of end-users to foster sustainable implementation. This is done by describing part of the development of an Audit &amp; Feedback system for healthcare workers at a Dutch regional general hospital. The system intends to contribute to reducing antimicrobial resistance. The rationale for, questions asked at and results of a questionnaire and two focus groups are described.</p

SHIRAZ: an automated histology image annotation system for zebrafish phenomics

Histological characterization is used in clinical and research contexts as a highly sensitive method for detecting the morphological features of disease and abnormal gene function. Histology has recently been accepted as a phenotyping method for the forthcoming Zebrafish Phenome Project, a large-scale community effort to characterize the morphological, physiological, and behavioral phenotypes resulting from the mutations in all known genes in the zebrafish genome. In support of this project, we present a novel content-based image retrieval system for the automated annotation of images containing histological abnormalities in the developing eye of the larval zebrafish