Psychometric test of the Team Climate Inventory-short version investigated in Dutch quality improvement teams

Abstract BACKGROUND: Although some studies have used the Team Climate Inventory within teams working in health care settings, none of these included quality improvement teams. The aim of our study is to investigate the psychometric properties of the 14-item version of the Team Climate Inventory in healthcare quality improvement teams participating in a Dutch quality collaborative. METHODS: This study included quality improvement teams participating in the Care for Better improvement program for home care, care for the handicapped and the elderly in the Netherlands between 2006 and 2008. As part of a larger evaluation study 270 written questionnaires from team members were collected at baseline and 139 questionnaires at end measurement. Confirmatory factor analyses, reliability, Pearson correlations and paired samples t-tests were conducted to investigate construct validity, reliability, predictive validity and temporal stability. RESULTS: Confirmatory factor analyses revealed the expected four-factor structure and good fit indices. For the four subscales--vision, participative safety, task orientation and support for innovation--acceptable Cronbach's alpha coefficients and high inter-item correlations were found. The four subscales all proved significant predictors of perceived team effectiveness, with participatory safety being the best predictor. As expected the four subscales were found to be stable over time; i.e. without significant changes between baseline and end measurement. CONCLUSION: The psychometric properties of the Dutch version of the TCI-14 are satisfactory. Together these results show that the TCI-14 is a useful instrument to assess to what extent aspects of team climate influence perceived team effectiveness of quality improvement teams

Toward Innovative, Cost-Effective, and Systemic Solutions to Improve Outcomes and Well-Being of Military Families Affected by Autism Spectrum Disorder

The burdens faced by military families who have a child with autism are unique. The usual challenges of securing diagnostic, treatment, and educational services are compounded by life circumstances that include the anxieties of war, frequent relocation and separation, and a demand structure that emphasizes mission readiness and service. Recently established military autism-specific health care benefits set the stage for community-viable and cost-effective solutions that can achieve better outcomes for children and greater well-being for families. Here we argue for implementation of evidence-based solutions focused on reducing age of diagnosis and improving access to early intervention, as well as establishment of a tiered menu of services, individualized to the child and family, that fit with the military ethos and system of health care. Absence of this new model of care could compromise the utility and sustainability of the autism-specific benefit

Does accreditation stimulate change? A study of the impact of the accreditation process on Canadian healthcare organizations

<p>Abstract</p> <p>Background</p> <p>One way to improve quality and safety in healthcare organizations (HCOs) is through accreditation. Accreditation is a rigorous external evaluation process that comprises self-assessment against a given set of standards, an on-site survey followed by a report with or without recommendations, and the award or refusal of accreditation status. This study evaluates how the accreditation process helps introduce organizational changes that enhance the quality and safety of care.</p> <p>Methods</p> <p>We used an embedded multiple case study design to explore organizational characteristics and identify changes linked to the accreditation process. We employed a theoretical framework to analyze various elements and for each case, we interviewed top managers, conducted focus groups with staff directly involved in the accreditation process, and analyzed self-assessment reports, accreditation reports and other case-related documents.</p> <p>Results</p> <p>The context in which accreditation took place, including the organizational context, influenced the type of change dynamics that occurred in HCOs. Furthermore, while accreditation itself was not necessarily the element that initiated change, the accreditation process was a highly effective tool for (i) accelerating integration and stimulating a spirit of cooperation in newly merged HCOs; (ii) helping to introduce continuous quality improvement programs to newly accredited or not-yet-accredited organizations; (iii) creating new leadership for quality improvement initiatives; (iv) increasing social capital by giving staff the opportunity to develop relationships; and (v) fostering links between HCOs and other stakeholders. The study also found that HCOs' motivation to introduce accreditation-related changes dwindled over time.</p> <p>Conclusions</p> <p>We conclude that the accreditation process is an effective leitmotiv for the introduction of change but is nonetheless subject to a learning cycle and a learning curve. Institutions invest greatly to conform to the first accreditation visit and reap the greatest benefits in the next three accreditation cycles (3 to 10 years after initial accreditation). After 10 years, however, institutions begin to find accreditation less challenging. To maximize the benefits of the accreditation process, HCOs and accrediting bodies must seek ways to take full advantage of each stage of the accreditation process over time.</p

The efficiency and effectiveness of utilizing diagrams in interviews: an assessment of participatory diagramming and graphic elicitation

Abstract Background This paper focuses on measuring the efficiency and effectiveness of two diagramming methods employed in key informant interviews with clinicians and health care administrators. The two methods are 'participatory diagramming', where the respondent creates a diagram that assists in their communication of answers, and 'graphic elicitation', where a researcher-prepared diagram is used to stimulate data collection. Methods These two diagramming methods were applied in key informant interviews and their value in efficiently and effectively gathering data was assessed based on quantitative measures and qualitative observations. Results Assessment of the two diagramming methods suggests that participatory diagramming is an efficient method for collecting data in graphic form, but may not generate the depth of verbal response that many qualitative researchers seek. In contrast, graphic elicitation was more intuitive, better understood and preferred by most respondents, and often provided more contemplative verbal responses, however this was achieved at the expense of more interview time. Conclusion Diagramming methods are important for eliciting interview data that are often difficult to obtain through traditional verbal exchanges. Subject to the methodological limitations of the study, our findings suggest that while participatory diagramming and graphic elicitation have specific strengths and weaknesses, their combined use can provide complementary information that would not likely occur with the application of only one diagramming method. The methodological insights gained by examining the efficiency and effectiveness of these diagramming methods in our study should be helpful to other researchers considering their incorporation into qualitative research designs

Evaluation of the impact of interdisciplinarity in cancer care

<p>Abstract</p> <p>Background</p> <p>Teamwork is a key component of the health care renewal strategy emphasized in Quebec, elsewhere in Canada and in other countries to enhance the quality of oncology services. While this innovation would appear beneficial in theory, empirical evidences of its impact are limited. Current efforts in Quebec to encourage the development of local interdisciplinary teams in all hospitals offer a unique opportunity to assess the anticipated benefits. These teams working in hospital outpatient clinics are responsible for treatment, follow-up and patient support. The study objective is to assess the impact of interdisciplinarity on cancer patients and health professionals.</p> <p>Methods/Design</p> <p>This is a quasi-experimental study with three comparison groups distinguished by intensity of interdisciplinarity: strong, moderate and weak. The study will use a random sample of 12 local teams in Quebec, stratified by intensity of interdisciplinarity. The instrument to measure the intensity of the interdisciplinarity, developed in collaboration with experts, encompasses five dimensions referring to aspects of team structure and process. Self-administered questionnaires will be used to measure the impact of interdisciplinarity on patients (health care utilization, continuity of care and cancer services responsiveness) and on professionals (professional well-being, assessment of teamwork and perception of teamwork climate). Approximately 100 health professionals working on the selected teams and 2000 patients will be recruited. Statistical analyses will include descriptive statistics and comparative analysis of the impact observed according to the strata of interdisciplinarity. Fixed and random multivariate statistical models (multilevel analyses) will also be used.</p> <p>Discussion</p> <p>This study will pinpoint to what extent interdisciplinarity is linked to quality of care and meets the complex and varied needs of cancer patients. It will ascertain to what extent interdisciplinary teamwork facilitated the work of professionals. Such findings are important given the growing prevalence of cancer and the importance of attracting and retaining health professionals to work with cancer patients.</p

Validity and usefulness of members reports of implementation progress in a quality improvement initiative: findings from the Team Check-up Tool (TCT)

<p>Abstract</p> <p>Background</p> <p>Team-based interventions are effective for improving safety and quality of healthcare. However, contextual factors, such as team functioning, leadership, and organizational support, can vary significantly across teams and affect the level of implementation success. Yet, the science for measuring context is immature. The goal of this study is to validate measures from a short instrument tailored to track dynamic context and progress for a team-based quality improvement (QI) intervention.</p> <p>Methods</p> <p>Design: Secondary cross-sectional and longitudinal analysis of data from a clustered randomized controlled trial (RCT) of a team-based quality improvement intervention to reduce central line-associated bloodstream infection (CLABSI) rates in intensive care units (ICUs).</p> <p>Setting: Forty-six ICUs located within 35 faith-based, not-for-profit community hospitals across 12 states in the U.S.</p> <p>Population: Team members participating in an ICU-based QI intervention.</p> <p>Measures: The primary measure is the Team Check-up Tool (TCT), an original instrument that assesses context and progress of a team-based QI intervention. The TCT is administered monthly. Validation measures include CLABSI rate, Team Functioning Survey (TFS) and Practice Environment Scale (PES) from the Nursing Work Index.</p> <p>Analysis: Temporal stability, responsiveness and validity of the TCT.</p> <p>Results</p> <p>We found evidence supporting the temporal stability, construct validity, and responsiveness of TCT measures of intervention activities, perceived group-level behaviors, and barriers to team progress.</p> <p>Conclusions</p> <p>The TCT demonstrates good measurement reliability, validity, and responsiveness. By having more validated measures on implementation context, researchers can more readily conduct rigorous studies to identify contextual variables linked to key intervention and patient outcomes and strengthen the evidence base on successful spread of efficacious team-based interventions. QI teams participating in an intervention should also find data from a validated tool useful for identifying opportunities to improve their own implementation.</p

Organizational impact of evidence-informed decision making training initiatives : a case study comparison of two approaches

Background The impact of efforts by healthcare organizations to enhance the use of evidence to improve organizational processes through training programs has seldom been assessed. We therefore endeavored to assess whether and how the training of mid- and senior-level healthcare managers could lead to organizational change. Methods We conducted a theory-driven evaluation of the organizational impact of healthcare leaders’ participation in two training programs using a logic model based on Nonaka’s theory of knowledge conversion. We analyzed six case studies nested within the two programs using three embedded units of analysis (individual, group and organization). Interviews were conducted during intensive one-week data collection site visits. A total of 84 people were interviewed. Results We found that the impact of training could primarily be felt in trainees’ immediate work environments. The conversion of attitudes was found to be easier to achieve than the conversion of skills. Our results show that, although socialization and externalization were common in all cases, a lack of combination impeded the conversion of skills. We also identified several individual, organizational and program design factors that facilitated and/or impeded the dissemination of the attitudes and skills gained by trainees to other organizational members. Conclusions Our theory-driven evaluation showed that factors before, during and after training can influence the extent of skills and knowledge transfer. Our evaluation went further than previous research by revealing the influence—both positive and negative—of specific organizational factors on extending the impact of training programs

Patient Care Teams in treatment of diabetes and chronic heart failure in primary care: an observational networks study

Contains fulltext : 97203.pdf (publisher's version ) (Open Access)ABSTRACT: BACKGROUND: Patient care teams have an important role in providing medical care to patients with chronic disease, but insight into how to improve their performance is limited. Two potentially relevant determinants are the presence of a central care provider with a coordinating role and an active role of the patient in the network of care providers. In this study, we aimed to develop and test measures of these factors related to the network of care providers of an individual patient. METHODS: We performed an observational study in patients with type 2 diabetes or chronic heart failure, who were recruited from three primary care practices in The Netherlands. The study focused on medical treatment, advice on physical activity, and disease monitoring. We used patient questionnaires and chart review to measure connections between the patient and care providers, and a written survey among care providers to measure their connections. Data on clinical performance were extracted from the medical records. We used network analysis to compute degree centrality coefficients for the patient and to identify the most central health professional in each network. A range of other network characteristics were computed including network centralization, density, size, diversity of disciplines, and overlap among activity-specific networks. Differences across the two chronic conditions and associations with disease monitoring were explored. RESULTS: Approximately 50% of the invited patients participated. Participation rates of health professionals were close to 100%. We identified 63 networks of 25 patients: 22 for medical treatment, 16 for physical exercise advice, and 25 for disease monitoring. General practitioners (GPs) were the most central care providers for the three clinical activities in both chronic conditions. The GP's degree centrality coefficient varied substantially, and higher scores seemed to be associated with receiving more comprehensive disease monitoring. The degree centrality coefficient of patients also varied substantially but did not seem to be associated with disease monitoring. CONCLUSIONS: Our method can be used to measure connections between care providers of an individual patient, and to examine the association between specific network parameters and healthcare received. Further research is needed to refine the measurement method and to test the association of specific network parameters with quality and outcomes of healthcare

Conservation of resources theory and research use in health systems

<p>Abstract</p> <p>Background</p> <p>Health systems face challenges in using research evidence to improve policy and practice. These challenges are particularly evident in small and poorly resourced health systems, which are often in locations (in Canada and globally) with poorer health status. Although organizational resources have been acknowledged as important in understanding research use resource theories have not been a focus of knowledge translation (KT) research. What resources, broadly defined, are required for KT and how does their presence or absence influence research use?</p> <p>In this paper, we consider conservation of resources (COR) theory as a theoretical basis for understanding the capacity to use research evidence in health systems. Three components of COR theory are examined in the context of KT. First, resources are required for research uptake. Second, threat of resource loss fosters resistance to research use. Third, resources can be optimized, even in resource-challenged environments, to build capacity for KT.</p> <p>Methods</p> <p>A scan of the KT literature examined organizational resources needed for research use. A multiple case study approach examined the three components of COR theory outlined above. The multiple case study consisted of a document review and key informant interviews with research team members, including government decision-makers and health practitioners through a retrospective analysis of four previously conducted applied health research studies in a resource-challenged region.</p> <p>Results</p> <p>The literature scan identified organizational resources that influence research use. The multiple case study supported these findings, contributed to the development of a taxonomy of organizational resources, and revealed how fears concerning resource loss can affect research use. Some resources were found to compensate for other resource deficits. Resource needs differed at various stages in the research use process.</p> <p>Conclusions</p> <p>COR theory contributes to understanding the role of resources in research use, resistance to research use, and potential strategies to enhance research use. Resources (and a lack of them) may account for the observed disparities in research uptake across health systems. This paper offers a theoretical foundation to guide further examination of the COR-KT ideas and necessary supports for research use in resource-challenged environments.</p

Knowledge transfer & exchange through social networks: building foundations for a community of practice within tobacco control

BACKGROUND: Health services and population health innovations advance when knowledge transfer and exchange (KTE) occurs among researchers, practitioners, policy-makers and consumers using high-quality evidence. However, few KTE models have been evaluated in practice. Communities of practice (CoP) – voluntary, self-organizing, and focused groups of individuals and organizations – may provide one option. This paper outlines an approach to lay the foundation for a CoP within the area of Web-assisted tobacco interventions (WATI). The objectives of the study were to provide a data-driven foundation to inform decisions about organizing a CoP within the geographically diverse, multi-disciplinary WATI group using evaluation and social network methodologies. METHODS: A single-group design was employed using a survey of expectations, knowledge, and interpersonal WATI-related relationships administered prior to a meeting of the WATI group followed by a 3-week post-meeting Web survey to assess short-term impact on learning and networking outcomes. RESULTS: Twenty-three of 27 WATI attendees (85%) from diverse disciplinary and practice backgrounds completed the baseline survey, with 21 (91%) of those participants completing the three-week follow-up. Participants had modest expectations of the meeting at baseline. A social network map produced from the data illustrated a centralized, yet sparse network comprising of interdisciplinary teams with little trans-sectoral collaboration. Three-week follow-up survey results showed that participants had made new network connections and had actively engaged in KTE activities with WATI members outside their original network. CONCLUSION: Data illustrating both the shape and size of the WATI network as well as member's interests and commitment to KTE, when shared and used to frame action steps, can positively influence the motivation to collaborate and create communities of practice. Guiding KTE planning through blending data and theory can create more informed transdisciplinary and trans-sectoral collaboration environments