Validity and usefulness of members reports of implementation progress in a quality improvement initiative: findings from the Team Check-up Tool (TCT)

<p>Abstract</p> <p>Background</p> <p>Team-based interventions are effective for improving safety and quality of healthcare. However, contextual factors, such as team functioning, leadership, and organizational support, can vary significantly across teams and affect the level of implementation success. Yet, the science for measuring context is immature. The goal of this study is to validate measures from a short instrument tailored to track dynamic context and progress for a team-based quality improvement (QI) intervention.</p> <p>Methods</p> <p>Design: Secondary cross-sectional and longitudinal analysis of data from a clustered randomized controlled trial (RCT) of a team-based quality improvement intervention to reduce central line-associated bloodstream infection (CLABSI) rates in intensive care units (ICUs).</p> <p>Setting: Forty-six ICUs located within 35 faith-based, not-for-profit community hospitals across 12 states in the U.S.</p> <p>Population: Team members participating in an ICU-based QI intervention.</p> <p>Measures: The primary measure is the Team Check-up Tool (TCT), an original instrument that assesses context and progress of a team-based QI intervention. The TCT is administered monthly. Validation measures include CLABSI rate, Team Functioning Survey (TFS) and Practice Environment Scale (PES) from the Nursing Work Index.</p> <p>Analysis: Temporal stability, responsiveness and validity of the TCT.</p> <p>Results</p> <p>We found evidence supporting the temporal stability, construct validity, and responsiveness of TCT measures of intervention activities, perceived group-level behaviors, and barriers to team progress.</p> <p>Conclusions</p> <p>The TCT demonstrates good measurement reliability, validity, and responsiveness. By having more validated measures on implementation context, researchers can more readily conduct rigorous studies to identify contextual variables linked to key intervention and patient outcomes and strengthen the evidence base on successful spread of efficacious team-based interventions. QI teams participating in an intervention should also find data from a validated tool useful for identifying opportunities to improve their own implementation.</p

Making soft intelligence hard: a multi-site qualitative study of challenges relating to voice about safety concerns.

BACKGROUND: Healthcare organisations often fail to harvest and make use of the 'soft intelligence' about safety and quality concerns held by their own personnel. We aimed to examine the role of formal channels in encouraging or inhibiting employee voice about concerns. METHODS: Qualitative study involving personnel from three academic hospitals in two countries. Interviews were conducted with 165 participants from a wide range of occupational and professional backgrounds, including senior leaders and those from the sharp end of care. Data analysis was based on the constant comparative method. RESULTS: Leaders reported that they valued employee voice; they identified formal organisational channels as a key route for the expression of concerns by employees. Formal channels and processes were designed to ensure fairness, account for all available evidence and achieve appropriate resolution. When processed through these formal systems, concerns were destined to become evidenced, formal and tractable to organisational intervention. But the way these systems operated meant that some concerns were never voiced. Participants were anxious about having to process their suspicions and concerns into hard evidentiary facts, and they feared being drawn into official procedures designed to allocate consequence. Anxiety about evidence and process was particularly relevant when the intelligence was especially 'soft'-feelings or intuitions that were difficult to resolve into a coherent, compelling reconstruction of an incident or concern. Efforts to make soft intelligence hard thus risked creating 'forbidden knowledge': dangerous to know or share. CONCLUSIONS: The legal and bureaucratic considerations that govern formal channels for the voicing of concerns may, perversely, inhibit staff from speaking up. Leaders responsible for quality and safety should consider complementing formal mechanisms with alternative, informal opportunities for listening to concerns

Validity and reliability of Turkish version of "Hospital Survey on Patient Safety Culture" and perception of patient safety in public hospitals in Turkey

<p>Abstract</p> <p>Background</p> <p>The Hospital Survey on Patient Safety Culture (HSOPS) is used to assess safety culture in many countries. Accordingly, the questionnaire has been translated into Turkish for the study of patient safety culture in Turkish hospitals. The aim of this study is threefold: to determine the validity and reliability of the translated form of HSOPS, to evaluate physicians' and nurses' perceptions of patient safety in Turkish public hospitals, and to compare finding with U.S. hospital settings.</p> <p>Methods</p> <p>Physicians and nurses working in all public hospitals in Konya, a large city in Turkey, were asked to complete a self-administrated patient safety culture survey (n = 309). Data collection was carried out using the Turkish version of HSOPS, developed by Agency for Healthcare Research and Quality (AHRQ). Data were summarized as percentages, means, and SD values. Factor analysis, correlation coefficient, Cronbach's alpha, ANOVA, and t tests were employed in statistical analyses. Items on patient safety were categorized into 10 factors. Factor loadings and internal consistencies of dimension items were high.</p> <p>Results</p> <p>Most of the scores related to dimensions, and the overall patient safety score (44%) were lower than the benchmark score. "Teamwork within hospital units" received the highest score (70%), and the lowest score belonged to the "frequency of events reported" (15%). The study revealed that more than three quarters of the physicians and nurses were not reporting errors.</p> <p>Conclusion</p> <p>The Turkish version of HSOPS was found to be valid and reliable in determining patient safety culture. This tool will be helpful in tracking improvements and in heightening awareness on patient safety culture in Turkey.</p

Developing and implementing an integrated delirium prevention system of care:a theory driven, participatory research study

Background: Delirium is a common complication for older people in hospital. Evidence suggests that delirium incidence in hospital may be reduced by about a third through a multi-component intervention targeted at known modifiable risk factors. We describe the research design and conceptual framework underpinning it that informed the development of a novel delirium prevention system of care for acute hospital wards. Particular focus of the study was on developing an implementation process aimed at embedding practice change within routine care delivery. Methods: We adopted a participatory action research approach involving staff, volunteers, and patient and carer representatives in three northern NHS Trusts in England. We employed Normalization Process Theory to explore knowledge and ward practices on delirium and delirium prevention. We established a Development Team in each Trust comprising senior and frontline staff from selected wards, and others with a potential role or interest in delirium prevention. Data collection included facilitated workshops, relevant documents/records, qualitative one-to-one interviews and focus groups with multiple stakeholders and observation of ward practices. We used grounded theory strategies in analysing and synthesising data. Results: Awareness of delirium was variable among staff with no attention on delirium prevention at any level; delirium prevention was typically neither understood nor perceived as meaningful. The busy, chaotic and challenging ward life rhythm focused primarily on diagnostics, clinical observations and treatment. Ward practices pertinent to delirium prevention were undertaken inconsistently. Staff welcomed the possibility of volunteers being engaged in delirium prevention work, but existing systems for volunteer support were viewed as a barrier. Our evolving conception of an integrated model of delirium prevention presented major implementation challenges flowing from minimal understanding of delirium prevention and securing engagement of volunteers alongside practice change. The resulting Prevention of Delirium (POD) Programme combines a multi-component delirium prevention and implementation process, incorporating systems and mechanisms to introduce and embed delirium prevention into routine ward practices. Conclusions: Although our substantive interest was in delirium prevention, the conceptual and methodological strategies pursued have implications for implementing and sustaining practice and service improvements more broadly

Patient safety culture lives in departments and wards: Multilevel partitioning of variance in patient safety culture

<p>Abstract</p> <p>Background</p> <p>Aim of study was to document 1) that patient safety culture scores vary considerably by hospital department and ward, and 2) that much of the variation is across the lowest level organizational units: the wards. Setting of study: 500-bed Norwegian university hospital, September-December 2006.</p> <p>Methods</p> <p>Data collected from 1400 staff by (the Norwegian version of) the generic version of the Safety Attitudes Questionnaire (SAQ Short Form 2006). Multilevel analysis by MLwiN version 1.10.</p> <p>Results</p> <p>Considerable parts of the score variations were at the ward and department levels. More organization level variation was seen at the ward level than at the department level.</p> <p>Conclusions</p> <p>Patient safety culture improvement efforts should not be limited to all-hospital interventions or interventions aimed at entire departments, but include involvement at the ward level, selectively aimed at low-scoring wards. Patient safety culture should be studied as closely to the patient as possible. There may be such a thing as "hospital safety culture" and the variance across hospital departments indicates the existence of department safety cultures. However, neglecting the study of patient safety culture at the ward level will mask important local variations. Safety culture research and improvement should not stop at the lowest formal level of the hospital (wards, out-patient clinics, ERs), but proceed to collect and analyze data on the micro-units within them.</p

Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science

Abstract Background Many interventions found to be effective in health services research studies fail to translate into meaningful patient care outcomes across multiple contexts. Health services researchers recognize the need to evaluate not only summative outcomes but also formative outcomes to assess the extent to which implementation is effective in a specific setting, prolongs sustainability, and promotes dissemination into other settings. Many implementation theories have been published to help promote effective implementation. However, they overlap considerably in the constructs included in individual theories, and a comparison of theories reveals that each is missing important constructs included in other theories. In addition, terminology and definitions are not consistent across theories. We describe the Consolidated Framework For Implementation Research (CFIR) that offers an overarching typology to promote implementation theory development and verification about what works where and why across multiple contexts. Methods We used a snowball sampling approach to identify published theories that were evaluated to identify constructs based on strength of conceptual or empirical support for influence on implementation, consistency in definitions, alignment with our own findings, and potential for measurement. We combined constructs across published theories that had different labels but were redundant or overlapping in definition, and we parsed apart constructs that conflated underlying concepts. Results The CFIR is composed of five major domains: intervention characteristics, outer setting, inner setting, characteristics of the individuals involved, and the process of implementation. Eight constructs were identified related to the intervention (e.g., evidence strength and quality), four constructs were identified related to outer setting (e.g., patient needs and resources), 12 constructs were identified related to inner setting (e.g., culture, leadership engagement), five constructs were identified related to individual characteristics, and eight constructs were identified related to process (e.g., plan, evaluate, and reflect). We present explicit definitions for each construct. Conclusion The CFIR provides a pragmatic structure for approaching complex, interacting, multi-level, and transient states of constructs in the real world by embracing, consolidating, and unifying key constructs from published implementation theories. It can be used to guide formative evaluations and build the implementation knowledge base across multiple studies and settings.http://deepblue.lib.umich.edu/bitstream/2027.42/78272/1/1748-5908-4-50.xmlhttp://deepblue.lib.umich.edu/bitstream/2027.42/78272/2/1748-5908-4-50-S1.PDFhttp://deepblue.lib.umich.edu/bitstream/2027.42/78272/3/1748-5908-4-50-S3.PDFhttp://deepblue.lib.umich.edu/bitstream/2027.42/78272/4/1748-5908-4-50-S4.PDFhttp://deepblue.lib.umich.edu/bitstream/2027.42/78272/5/1748-5908-4-50.pdfhttp://deepblue.lib.umich.edu/bitstream/2027.42/78272/6/1748-5908-4-50-S2.PDFPeer Reviewe

Systematic review of safety checklists for use by medical care teams in acute hospital settings - limited evidence of effectiveness

<p>Abstract</p> <p>Background</p> <p>Patient safety is a fundamental component of good quality health care. Checklists have been proposed as a method of improving patient safety. This systematic review, asked "In acute hospital settings, would the use of safety checklists applied by medical care teams, compared to not using checklists, improve patient safety?"</p> <p>Methods</p> <p>We searched the Cochrane Library, MEDLINE, CINAHL, and EMBASE for randomised controlled trials published in English before September 2009. Studies were selected and appraised by two reviewers independently in consultation with colleagues, using inclusion, exclusion and appraisal criteria established a priori.</p> <p>Results</p> <p>Nine cohort studies with historical controls studies from four hospital care settings were included-intensive care unit, emergency department, surgery, and acute care. The studies used a variety of designs of safety checklists, and implemented them in different ways, however most incorporated an educational component to teach the staff how to use the checklist. The studies assessed outcomes occurring a few weeks to a maximum of 12 months post-implementation, and these outcomes were diverse.</p> <p>The studies were generally of low to moderate quality and of low levels of evidence, with all but one of the studies containing a high risk of bias.</p> <p>The results of these studies suggest some improvements in patient safety arising from use of safety checklists, but these were not consistent across all studies or for all outcomes. Some studies showed no difference in outcomes between checklist use and standard care without a checklist. Due to the variations in setting, checklist design, educational training given, and outcomes measured, it was unfeasible to accurately summarise any trends across all studies.</p> <p>Conclusions</p> <p>The included studies suggest some benefits of using safety checklists to improve protocol adherence and patient safety, but due to the risk of bias in these studies, their results should be interpreted with caution. More high quality and studies, are needed to enable confident conclusions about the effectiveness of safety checklists in acute hospital settings.</p

The SQUIRE (Standards for QUality Improvement Reporting Excellence) guidelines for quality improvement reporting: explanation and elaboration

As the science of quality improvement in health care advances, the importance of sharing its accomplishments through the published literature increases. Current reporting of improvement work in health care varies widely in both content and quality. It is against this backdrop that a group of stakeholders from a variety of disciplines has created the Standards for QUality Improvement Reporting Excellence, which we refer to as the SQUIRE publication guidelines or SQUIRE statement. The SQUIRE statement consists of a checklist of 19 items that authors need to consider when writing articles that describe formal studies of quality improvement. Most of the items in the checklist are common to all scientific reporting, but virtually all of them have been modified to reflect the unique nature of medical improvement work