What do we know about how to do audit and feedback? Pitfalls in applying evidence from a systematic review

BACKGROUND: Improving the quality of health care requires a range of evidence-based activities. Audit and feedback is commonly used as a quality improvement tool in the UK National Health Service [NHS]. We set out to assess whether current guidance and systematic review evidence can sufficiently inform practical decisions about how to use audit and feedback to improve quality of care. METHODS: We selected an important chronic disease encountered in primary care: diabetes mellitus. We identified recommendations from National Institute for Clinical Excellence (NICE) guidance on conducting audit and generated questions which would be relevant to any attempt to operationalise audit and feedback in a healthcare service setting. We explored the extent to which a systematic review of audit and feedback could provide practical guidance about whether audit and feedback should be used to improve quality of diabetes care and, if so, how audit and feedback could be optimised. RESULTS: National guidance suggests the importance of securing the right organisational conditions and processes. Review evidence suggests that audit and feedback can be effective in changing healthcare professional practice. However, the available evidence says relatively little about the detail of how to use audit and feedback most efficiently. CONCLUSION: Audit and feedback will continue to be an unreliable approach to quality improvement until we learn how and when it works best. Conceptualising audit and feedback within a theoretical framework offers a way forward

The development and application of audit criteria for assessing knowledge exchange plans in health research grant applications.

Background: Research funders expect evidence of end user engagement and impact plans in research proposals. Drawing upon existing frameworks, we developed audit criteria to help researchers and their institutions assess the knowledge exchange plans of health research proposals. Findings: Criteria clustered around five themes: problem definition; involvement of research users; public and patient engagement; dissemination and implementation; and planning, management and evaluation of knowledge exchange. We applied these to a sample of grant applications from one research institution in the United Kingdom to demonstrate feasibility. Conclusion: Our criteria may be useful as a tool for researcher self-assessment and for research institutions to assess the quality of knowledge exchange plans and identify areas for systematic improvement

Estimated pre-morbid IQ effects on cognitive and functional outcomes in Alzheimer disease: a longitudinal study in a treated cohort

Abstract Background Cognitive reserve is thought to influence the degree of neuropathology needed for diagnosis of Alzheimer disease (AD). Cognitive reserve can be operationally defined as the hypothesized capacity of the mature adult brain to sustain the effects of disease or injury without manifesting clinical symptoms of AD, but sufficient to cause clinical dementia in an individual possessing less cognitive reserve. Its effect on the subsequent course of AD is less clear. Pre-morbid IQ is a useful measure of cognitive reserve. Methods We studied 659 consecutive patients with AD at a tertiary referral memory clinic. Patients were assessed on six cognitive tests at baseline. Activities of Daily Living (ADL) were measured on the Instrumental Activities of Daily Living (IADL) scale and Physical Self-Maintenance Scale (PSMS). The National Adult Reading Test (NART) was used to estimate pre-morbid IQ. Patients were followed up after starting a cholinesterase inhibitor over 78 weeks. Mixed general linear models estimated the effects of NART on cognition and ADL. Results Three hundred and fifty-five patients had NART scored with a mean estimated pre-morbid IQ of 104.7 (standard deviation 18.5). NART increased overall cognitive ability by 2.7% for every 10 IQ points (p Conclusion Our data support the hypothesis that cognitive reserve continues to have a limited influence on cognition after AD has been diagnosed and thus, indirectly, has an impact on ADL.</p

An innovative telemedicine knowledge translation program to improve quality of care in intensive care units: protocol for a cluster randomized pragmatic trial

Abstract Background There are challenges to timely adoption of, and ongoing adherence to, evidence-based practices known to improve patient care in the intensive care unit (ICU). Quality improvement initiatives using a collaborative network approach may increase the use of such practices. Our objective is to evaluate the effectiveness of a novel knowledge translation program for increasing the proportion of patients who appropriately receive the following six evidence-based care practices: venous thromboembolism prophylaxis; ventilator-associated pneumonia prevention; spontaneous breathing trials; catheter-related bloodstream infection prevention; decubitus ulcer prevention; and early enteral nutrition. Methods and design We will conduct a pragmatic cluster randomized active control trial in 15 community ICUs and one academic ICU in Ontario, Canada. The intervention is a multifaceted videoconferenced educational and problem-solving forum to organize knowledge translation strategies, including comparative audit and feedback, educational sessions from content experts, and dissemination of algorithms. Fifteen individual ICUs (clusters) will be randomized to receive quality improvement interventions targeting one of the best practices during each of six study phases. Each phase lasts four months during the first study year and three months during the second. At the end of each study phase, ICUs are assigned to an intervention for a best practice not yet received according to a random schedule. The primary analysis will use patient-level process-of-care data to measure the intervention's effect on rates of adoption and adherence of each best practice in the targeted ICU clusters versus controls. Discussion This study design evaluates a new system for knowledge translation and quality improvement across six common ICU problems. All participating ICUs receive quality improvement initiatives during every study phase, improving buy-in. This study design could be considered for other quality improvement interventions and in other care settings. Trial Registration This trial is registered with http://www.clinicaltrials.gov (ID #: NCT00332982

Are GPs adequately equipped with the knowledge for educating and counseling of families with ADHD children?

<p>Abstract</p> <p>Background</p> <p>Attention deficit hyperactivity disorder is one of the most common child psychiatry disorders. General physicians (GP), as primary care providers, can have an important role in screening and treatment of ADHD. This study aimed to survey GPs' knowledge, attitude, and their views of their role in the screening, diagnosing and managing children with ADHD.</p> <p>Methods</p> <p>Six hundred and sixty five general physicians in Shiraz, Iran, answered a self-reported questionnaire on ADHD. The questionnaire consisted of questions regarding socio-demographic characteristics such as age, the duration of practice as a GP, marital status, general knowledge about ADHD, and the management of ADHD.</p> <p>Results</p> <p>Less than half of them believed that they have adequate knowledge and information about this disorder. They usually do not like to be the primary care providers for children with ADHD. The majority of them prefer to refer the children to related specialists, mostly psychiatrists or psychologists. More than one third of them believed that sugar is a cause of ADHD. Only 6.6% of them reported that ADHD persists for the whole life. Their knowledge about methylphenidate is reasonable.</p> <p>Conclusions</p> <p>As many other countries worldwide, the knowledge of GPs about ADHD should be improved. They do not asses and manage children with probable ADHD by themselves without referring to related professionals. They do not opt for the use of methylphenidate.</p

To what extent can behaviour change techniques be identified within an adaptable implementation package for primary care? A prospective directed content analysis

Interpreting evaluations of complex interventions can be difficult without sufficient description of key intervention content. We aimed to develop an implementation package for primary care which could be delivered using typically available resources and could be adapted to target determinants of behaviour for each of four quality indicators: diabetes control, blood pressure control, anticoagulation for atrial fibrillation and risky prescribing. We describe the development and prospective verification of behaviour change techniques (BCTs) embedded within the adaptable implementation packages

Improving the normalization of complex interventions: measure development based on normalization process theory (NoMAD): study protocol

&lt;b&gt;Background&lt;/b&gt; Understanding implementation processes is key to ensuring that complex interventions in healthcare are taken up in practice and thus maximize intended benefits for service provision and (ultimately) care to patients. Normalization Process Theory (NPT) provides a framework for understanding how a new intervention becomes part of normal practice. This study aims to develop and validate simple generic tools derived from NPT, to be used to improve the implementation of complex healthcare interventions.&lt;p&gt;&lt;/p&gt; &lt;b&gt;Objectives&lt;/b&gt; The objectives of this study are to: develop a set of NPT-based measures and formatively evaluate their use for identifying implementation problems and monitoring progress; conduct preliminary evaluation of these measures across a range of interventions and contexts, and identify factors that affect this process; explore the utility of these measures for predicting outcomes; and develop an online users’ manual for the measures.&lt;p&gt;&lt;/p&gt; &lt;b&gt;Methods&lt;/b&gt; A combination of qualitative (workshops, item development, user feedback, cognitive interviews) and quantitative (survey) methods will be used to develop NPT measures, and test the utility of the measures in six healthcare intervention settings.&lt;p&gt;&lt;/p&gt; &lt;b&gt;Discussion&lt;/b&gt; The measures developed in the study will be available for use by those involved in planning, implementing, and evaluating complex interventions in healthcare and have the potential to enhance the chances of their implementation, leading to sustained changes in working practices

How do hospitals respond to feedback about blood transfusion practice? A multiple case study investigation

National clinical audits play key roles in improving care and driving system-wide change. However, effects of audit and feedback depend upon both reach (e.g. relevant staff receiving the feedback) and response (e.g. staff regulating their behaviour accordingly). This study aimed to investigate which hospital staff initially receive feedback and formulate a response, how feedback is disseminated within hospitals, and how responses are enacted (including barriers and enablers to enactment). Using a multiple case study approach, we purposively sampled four UK hospitals for variation in infrastructure and resources. We conducted semi-structured interviews with staff from transfusion-related roles and observed Hospital Transfusion Committee meetings. Interviews and analysis were based on the Theoretical Domains Framework of behaviour change. We coded interview transcripts into theoretical domains, then inductively identified themes within each domain to identify barriers and enablers. We also analysed data to identify which staff currently receive feedback and how dissemination is managed within the hospital. Members of the hospital's transfusion team initially received feedback in all cases, and were primarily responsible for disseminating and responding, facilitated through the Hospital Transfusion Committee. At each hospital, key individuals involved in prescribing transfusions reported never having received feedback from a national audit. Whether audits were discussed and actions explicitly agreed in Committee meetings varied between hospitals. Key enablers of action across all cases included clear lines of responsibility and strategies to remind staff about recommendations. Barriers included difficulties disseminating to relevant staff and needing to amend feedback to make it appropriate for local use. Appropriate responses by hospital staff to feedback about blood transfusion practice depend upon supportive infrastructures and role clarity. Hospitals could benefit from support to disseminate feedback systematically, particularly to frontline staff involved in the behaviours being audited, and practical tools to support strategic decision-making (e.g. action-planning around local response to feedback)

Identifying factors likely to influence compliance with diagnostic imaging guideline recommendations for spine disorders among chiropractors in North America: a focus group study using the Theoretical Domains Framework

Background: The Theoretical Domains Framework (TDF) was developed to investigate determinants of specific clinical behaviors and inform the design of interventions to change professional behavior. This framework was used to explore the beliefs of chiropractors in an American Provider Network and two Canadian provinces about their adherence to evidence-based recommendations for spine radiography for uncomplicated back pain. The primary objective of the study was to identify chiropractors’ beliefs about managing uncomplicated back pain without xrays and to explore barriers and facilitators to implementing evidence-based recommendations on lumbar spine xrays. A secondary objective was to compare chiropractors in the United States and Canada on their beliefs regarding the use of spine x-rays. Methods: Six focus groups exploring beliefs about managing back pain without x-rays were conducted with a purposive sample. The interview guide was based upon the TDF. Focus groups were digitally recorded, transcribed verbatim, and analyzed by two independent assessors using thematic content analysis based on the TDF. Results: Five domains were identified as likely relevant. Key beliefs within these domains included the following: conflicting comments about the potential consequences of not ordering x-rays (risk of missing a pathology, avoiding adverse treatment effects, risks of litigation, determining the treatment plan, and using x-ray-driven techniques contrasted with perceived benefits of minimizing patient radiation exposure and reducing costs; beliefs about consequences); beliefs regarding professional autonomy, professional credibility, lack of standardization, and agreement with guidelines widely varied (social/professional role & identity); the influence of formal training, colleagues, and patients also appeared to be important factors (social influences); conflicting comments regarding levels of confidence and comfort in managing patients without x-rays (belief about capabilities); and guideline awareness and agreements (knowledge). Conclusions: Chiropractors’ use of diagnostic imaging appears to be influenced by a number of factors. Five key domains may be important considering the presence of conflicting beliefs, evidence of strong beliefs likely to impact the behavior of interest, and high frequency of beliefs. The results will inform the development of a theorybased survey to help identify potential targets for behavioral-change strategies

A cluster randomised controlled trial of educational prompts in diabetes care: study protocol

<p>Abstract</p> <p>Background</p> <p>Laboratory services have a central role in supporting screening, diagnosis, and management of patients. The increase in chronic disease management in primary care for conditions such as diabetes mellitus requires regular monitoring of patients' biochemical parameters. This process offers a route for improving the quality of care that patients receive by using test results as a vehicle for delivering educational messages as well as the test result itself.</p> <p>Aim</p> <p>To develop and evaluate the effectiveness of a quality improvement initiative to improve the care of patients with diabetes using test report reminders.</p> <p>Design</p> <p>A programme of four cluster randomised controlled trials within one population of general practices.</p> <p>Participants</p> <p>General practices in Newcastle-upon-Tyne, UK.</p> <p>Intervention</p> <p>Brief educational messages added to paper and electronic general practice laboratory test reports introduced over two phases. Phase One messages, attached to Haemoglobin A1c (HbA1c) reports, targeted glycaemic and cholesterol control. Phase Two messages, attached to albumin:creatinine ratio (ACR) reports, targeted blood pressure (BP) control and foot inspection.</p> <p>Outcomes</p> <p>General practice mean levels of HbA1c and cholesterol (Phase One) and diastolic and systolic BP and proportions of patients having undergone foot inspections (Phase Two); number of tests requested.</p> <p>Trial registration</p> <p>Current Controlled Trial ISRCTN2186314.</p