From theory to 'measurement' in complex interventions: methodological lessons from the development of an e-health normalisation instrument

<b>Background</b> Although empirical and theoretical understanding of processes of implementation in health care is advancing, translation of theory into structured measures that capture the complex interplay between interventions, individuals and context remain limited. This paper aimed to (1) describe the process and outcome of a project to develop a theory-based instrument for measuring implementation processes relating to e-health interventions; and (2) identify key issues and methodological challenges for advancing work in this field.<p></p> <b>Methods</b> A 30-item instrument (Technology Adoption Readiness Scale (TARS)) for measuring normalisation processes in the context of e-health service interventions was developed on the basis on Normalization Process Theory (NPT). NPT focuses on how new practices become routinely embedded within social contexts. The instrument was pre-tested in two health care settings in which e-health (electronic facilitation of healthcare decision-making and practice) was used by health care professionals.<p></p> <b>Results</b> The developed instrument was pre-tested in two professional samples (N = 46; N = 231). Ratings of items representing normalisation 'processes' were significantly related to staff members' perceptions of whether or not e-health had become 'routine'. Key methodological challenges are discussed in relation to: translating multi-component theoretical constructs into simple questions; developing and choosing appropriate outcome measures; conducting multiple-stakeholder assessments; instrument and question framing; and more general issues for instrument development in practice contexts.<p></p> <b>Conclusions</b> To develop theory-derived measures of implementation process for progressing research in this field, four key recommendations are made relating to (1) greater attention to underlying theoretical assumptions and extent of translation work required; (2) the need for appropriate but flexible approaches to outcomes measurement; (3) representation of multiple perspectives and collaborative nature of work; and (4) emphasis on generic measurement approaches that can be flexibly tailored to particular contexts of study

How people with chronic illnesses view their care in general practice: a qualitative study

The document attached has been archived with permission from the editor of the Medical Journal of Australia. An external link to the publisher’s copy is included.Objectives: To explore the perceptions of patients with chronic conditions about the nature and quality of their care in general practice. Design: Qualitative study using focus group methods conducted 1 June to 30 November 2002. Participants and setting: 76 consumers in 12 focus groups in New South Wales and South Australia. Main outcome measures: Recurring issues and themes on care received in general practice. Results: Three groups of priorities emerged. One centred on the quality of doctors, including technical competence, interpersonal skills, time for the patient in the consultation and continuity of care. A second concerned the role of patients and consumer organisations, with patients wanting (i) recognition of their knowledge about their condition and self-management, and (ii) for GPs to develop closer links with consumer organisations and inform patients about them. The third focused on the practice team and the importance of practice nurses and receptionists. Conclusion: GPs should consider the amount of time they spend with chronically ill patients, and their interpersonal skills and understanding of patients’ needs. They need to be better informed about the benefits of patient self-management and consumer organisations, and to incorporate them into their care. They also need to review how their practice nurses and receptionists can maximise the care of patients.Fernando A Infante, Judith G Proudfoot, Gawaine Powell Davies, Tanya K Bubner, Chris H Holton, Justin J Beilby and Mark F Harri

Does a joint development and dissemination of multidisciplinary guidelines improve prescribing behaviour: a pre/post study with concurrent control group and a randomised trial

BACKGROUND: It is difficult to keep control over prescribing behaviour in general practices. The purpose of this study was to assess the effects of a dissemination strategy of multidisciplinary guidelines on the volume of drug prescribing. METHODS: The study included two designs, a quasi-experimental pre/post study with concurrent control group and a random sample of GPs within the intervention group. The intervention area with 53 GPs was compared with a control group of 54 randomly selected GPs in the south and centre of the Netherlands. Additionally, a randomisation was executed in the intervention group to create two arms with 27 GPs who were more intensively involved in the development of the guideline and 26 GPs in the control group. A multidisciplinary committee developed prescription guidelines. Subsequently these guidelines were disseminated to all GPs in the intervention region. Additional effects were studied in the subgroup trial in which GPs were invited to be more intensively involved in the guideline development procedure. The guidelines contained 14 recommendations on antibiotics, asthma/COPD drugs and cholesterol drugs The main outcome measures were prescription data of a three-year period (one year before and 2 years after guideline dissemination) and proportion of change according to recommendations. RESULTS: Significant short-term improvements were seen for one recommendation: mupirocin. Long-term changes were found for cholesterol drug prescriptions. No additional changes were seen for the randomised controlled study in the subgroup. GPs did not take up the invitation for involvement. CONCLUSION: Disseminating multidisciplinary guidelines that were developed within a region, has no clear effect on prescribing behaviour even though GPs and specialists were involved more intensively in their development. Apparently, more effort is needed to bring about change

Undergraduate teaching in geriatric medicine: mapping the British Geriatrics Society undergraduate curriculum to Tomorrow's Doctors 2009

Introduction: in 2008, the British Geriatrics Society (BGS) developed the Recommended Undergraduate Curriculum in Geriatric Medicine. This was subsequently mapped to the second edition of Tomorrows' Doctors (TD2, 2003). Following the publication of the third edition of Tomorrow's Doctors in 2009 (TD3), the mapping exercise was repeated to verify the extent to which the updated General Medical Council recommendations supported teaching in ageing and geriatric medicine. Method: we analysed TD3 and identified 48 aspects of its general guidance that were relevant to the teaching of medicine for older people. We then mapped these to the 2009 BGS curriculum. Results: the BGS curriculum was supported in full by TD3. However, learning outcomes relating to the interpretation and conduct of research in TD3 had no corresponding outcomes in the BGS curriculum. Conclusion: the BGS curriculum for medical undergraduates continues to provide a specific and complete list of learning objectives, all of which could help to operationalise the general statements made in TD3 with relation to ageing and geriatric medicine. Learning outcomes in research in frail older patients have been added following this mapping exercise

Rationale, design and conduct of a comprehensive evaluation of a primary care based intervention to improve the quality of life of osteoarthritis patients. The PraxArt-project: a cluster randomized controlled trial [ISRCTN87252339]

BACKGROUND: Osteoarthritis (OA) has a high prevalence in primary care. Conservative, guideline orientated approaches aiming at improving pain treatment and increasing physical activity, have been proven to be effective in several contexts outside the primary care setting, as for instance the Arthritis Self management Programs (ASMPs). But it remains unclear if these comprehensive evidence based approaches can improve patients' quality of life if they are provided in a primary care setting. METHODS/DESIGN: PraxArt is a cluster randomised controlled trial with GPs as the unit of randomisation. The aim of the study is to evaluate the impact of a comprehensive evidence based medical education of GPs on individual care and patients' quality of life. 75 GPs were randomised either to intervention group I or II or to a control group. Each GP will include 15 patients suffering from osteoarthritis according to the criteria of ACR. In intervention group I GPs will receive medical education and patient education leaflets including a physical exercise program. In intervention group II the same is provided, but in addition a practice nurse will be trained to monitor via monthly telephone calls adherence to GPs prescriptions and advices and ask about increasing pain and possible side effects of medication. In the control group no intervention will be applied at all. Main outcome measurement for patients' QoL is the GERMAN-AIMS2-SF questionnaire. In addition data about patients' satisfaction (using a modified EUROPEP-tool), medication, health care utilization, comorbidity, physical activity and depression (using PHQ-9) will be retrieved. Measurements (pre data collection) will take place in months I-III, starting in June 2005. Post data collection will be performed after 6 months. DISCUSSION: Despite the high prevalence and increasing incidence, comprehensive and evidence based treatment approaches for OA in a primary care setting are neither established nor evaluated in Germany. If the evaluation of the presented approach reveals a clear benefit it is planned to provide this GP-centred interventions on a much larger scale

Collaborating with front-line healthcare professionals: the clinical and cost effectiveness of a theory based approach to the implementation of a national guideline

Background Clinical guidelines are an integral part of healthcare. Whilst much progress has been made in ensuring that guidelines are well developed and disseminated, the gap between routine clinical practice and current guidelines often remains wide. A key reason for this gap is that implementation of guidelines typically requires a change in the behaviour of healthcare professionals – but the behaviour change component is often overlooked. We adopted the Theoretical Domains Framework Implementation (TDFI) approach for supporting behaviour change required for the uptake of a national patient safety guideline to reduce the risk of feeding through misplaced nasogastric tubes. Methods The TDFI approach was used in a pre-post study in three NHS hospitals with a fourth acting as a control (with usual care and no TDFI). The target behavior identified for change was to increase the use of pH testing as the first line method for checking the position of a nasogastric tube. Repeat audits were undertaken in each hospital following intervention implementation. We used Zou’s modified Poisson regression approach with robust standard errors to estimate risk ratios for the use of pH testing. The projected return on investment (ROI) was also calculated. Results Following intervention implementation, the use of pH first line increased significantly across intervention hospitals [risk ratio (95% CI) ranged from 3.1 (1.14 to8.43) p < .05, to 8.14 (3.06 to21.67) p < .001] compared to the control hospital, which remained unchanged [risk ratio (CI) = .77 (.47-1.26) p = .296]. The estimated savings and costs in the first year were £2.56 million and £1.41 respectively, giving an ROI of 82%, and this was projected to increase to 270% over five years. Conclusion The TDFI approach improved the uptake of a patient safety guideline across three hospitals. The TDFI approach is clinically and cost effective in comparison to the usual practice

Implementation of an evidence-based guideline on fluid resuscitation: lessons learnt for future guidelines

There is little experience with the nationwide implementation of an evidence-based pediatric guideline on first-choice fluid for resuscitation in hypovolemia. We investigated fluid prescribing behavior at (1) guideline development, (2) after guideline development, and (3) after active implementation and identified potential barriers and facilitators for guideline implementation. In order to minimize costs and to optimize implementation effect, we continuously developed and adjusted implementation strategies according to identified barriers. Implementation success was evaluated using questionnaires, pharmaceutical data, and data from medical records. The most remarkable change occurred after guideline development and dissemination: Normal saline use by neonatologists increased from 22-89% to 100% and by pediatric intensivists from 43-71% to 88-100%, and synthetic colloid use by pediatric intensivists declined from 29-43% to 0-13% with a reduction in albumin use by neonatologists from 11-44% to 0%. After active guideline implementation, most of specialist's management behavior was according to the guideline. Stakeholders involved in the developmental process are of great importance in disseminating recommendations before active implementation. Therefore, to successfully implement guidelines and reduce costs of active implementation, any guideline development should consider implementation right from the beginning. Implementation strategies should target identified barriers and will therefore always be guideline specifi

High workload and job stress are associated with lower practice performance in general practice: an observational study in 239 general practices in the Netherlands

Contains fulltext : 80493.pdf (publisher's version ) (Open Access)BACKGROUND: The impact of high physician workload and job stress on quality and outcomes of healthcare delivery is not clear. Our study explored whether high workload and job stress were associated with lower performance in general practices in the Netherlands. METHODS: Secondary analysis of data from 239 general practices, collected in practice visits between 2003 to 2006 in the Netherlands using a comprehensive set of measures of practice management. Data were collected by a practice visitor, a trained non-physician observer using patients questionnaires, doctors and staff. For this study we selected five measures of practice performance as outcomes and six measures of GP workload and job stress as predictors. A total of 79 indicators were used out of the 303 available indicators. Random coefficient regression models were applied to examine associations. RESULTS AND DISCUSSION: Workload and job stress are associated with practice performance.Workload: Working more hours as a GP was associated with more positive patient experiences of accessibility and availability (b = 0.16). After list size adjustment, practices with more GP-time per patient scored higher on GP care (b = 0.45). When GPs provided more than 20 hours per week per 1000 patients, patients scored over 80% on the Europep questionnaire for quality of GP care.Job stress: High GP job stress was associated with lower accessibility and availability (b = 0.21) and insufficient practice management (b = 0.25). Higher GP commitment and more satisfaction with the job was associated with more prevention and disease management (b = 0.35). CONCLUSION: Providing more time in the practice, and more time per patient and experiencing less job stress are all associated with perceptions by patients of better care and better practice performance. Workload and job stress should be assessed by using list size adjusted data in order to realise better quality of care. Organisational development using this kind of data feedback could benefit both patients and GP

Identifying factors likely to influence compliance with diagnostic imaging guideline recommendations for spine disorders among chiropractors in North America: a focus group study using the Theoretical Domains Framework

Background: The Theoretical Domains Framework (TDF) was developed to investigate determinants of specific clinical behaviors and inform the design of interventions to change professional behavior. This framework was used to explore the beliefs of chiropractors in an American Provider Network and two Canadian provinces about their adherence to evidence-based recommendations for spine radiography for uncomplicated back pain. The primary objective of the study was to identify chiropractors’ beliefs about managing uncomplicated back pain without xrays and to explore barriers and facilitators to implementing evidence-based recommendations on lumbar spine xrays. A secondary objective was to compare chiropractors in the United States and Canada on their beliefs regarding the use of spine x-rays. Methods: Six focus groups exploring beliefs about managing back pain without x-rays were conducted with a purposive sample. The interview guide was based upon the TDF. Focus groups were digitally recorded, transcribed verbatim, and analyzed by two independent assessors using thematic content analysis based on the TDF. Results: Five domains were identified as likely relevant. Key beliefs within these domains included the following: conflicting comments about the potential consequences of not ordering x-rays (risk of missing a pathology, avoiding adverse treatment effects, risks of litigation, determining the treatment plan, and using x-ray-driven techniques contrasted with perceived benefits of minimizing patient radiation exposure and reducing costs; beliefs about consequences); beliefs regarding professional autonomy, professional credibility, lack of standardization, and agreement with guidelines widely varied (social/professional role & identity); the influence of formal training, colleagues, and patients also appeared to be important factors (social influences); conflicting comments regarding levels of confidence and comfort in managing patients without x-rays (belief about capabilities); and guideline awareness and agreements (knowledge). Conclusions: Chiropractors’ use of diagnostic imaging appears to be influenced by a number of factors. Five key domains may be important considering the presence of conflicting beliefs, evidence of strong beliefs likely to impact the behavior of interest, and high frequency of beliefs. The results will inform the development of a theorybased survey to help identify potential targets for behavioral-change strategies

Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science

Abstract Background Many interventions found to be effective in health services research studies fail to translate into meaningful patient care outcomes across multiple contexts. Health services researchers recognize the need to evaluate not only summative outcomes but also formative outcomes to assess the extent to which implementation is effective in a specific setting, prolongs sustainability, and promotes dissemination into other settings. Many implementation theories have been published to help promote effective implementation. However, they overlap considerably in the constructs included in individual theories, and a comparison of theories reveals that each is missing important constructs included in other theories. In addition, terminology and definitions are not consistent across theories. We describe the Consolidated Framework For Implementation Research (CFIR) that offers an overarching typology to promote implementation theory development and verification about what works where and why across multiple contexts. Methods We used a snowball sampling approach to identify published theories that were evaluated to identify constructs based on strength of conceptual or empirical support for influence on implementation, consistency in definitions, alignment with our own findings, and potential for measurement. We combined constructs across published theories that had different labels but were redundant or overlapping in definition, and we parsed apart constructs that conflated underlying concepts. Results The CFIR is composed of five major domains: intervention characteristics, outer setting, inner setting, characteristics of the individuals involved, and the process of implementation. Eight constructs were identified related to the intervention (e.g., evidence strength and quality), four constructs were identified related to outer setting (e.g., patient needs and resources), 12 constructs were identified related to inner setting (e.g., culture, leadership engagement), five constructs were identified related to individual characteristics, and eight constructs were identified related to process (e.g., plan, evaluate, and reflect). We present explicit definitions for each construct. Conclusion The CFIR provides a pragmatic structure for approaching complex, interacting, multi-level, and transient states of constructs in the real world by embracing, consolidating, and unifying key constructs from published implementation theories. It can be used to guide formative evaluations and build the implementation knowledge base across multiple studies and settings.http://deepblue.lib.umich.edu/bitstream/2027.42/78272/1/1748-5908-4-50.xmlhttp://deepblue.lib.umich.edu/bitstream/2027.42/78272/2/1748-5908-4-50-S1.PDFhttp://deepblue.lib.umich.edu/bitstream/2027.42/78272/3/1748-5908-4-50-S3.PDFhttp://deepblue.lib.umich.edu/bitstream/2027.42/78272/4/1748-5908-4-50-S4.PDFhttp://deepblue.lib.umich.edu/bitstream/2027.42/78272/5/1748-5908-4-50.pdfhttp://deepblue.lib.umich.edu/bitstream/2027.42/78272/6/1748-5908-4-50-S2.PDFPeer Reviewe