Assessing Organizational Readiness for Depression Care Quality Improvement: Relative Commitment and Implementation Capability

Background: Depression is a major cause of morbidity and cost in primary care patient populations. Successful depression improvement models, however, are complex. Based on organizational readiness theory, a practice’s commitment to change and its capability to carry out the change are both important predictors of initiating improvement. We empirically explored the links between relative commitment (i.e., the intention to move forward within the following year) and implementation capability. Methods: The DIAMOND initiative administered organizational surveys to medical and quality improvement leaders from each of 83 primary care practices in Minnesota. Surveys preceded initiation of activities directed at implementation of a collaborative care model for improving depression care. To assess implementation capability, we developed composites of survey items for five types of organizational factors postulated to be collaborative care barriers and facilitators. To assess relative commitment for each practice, we averaged leader ratings on an identical survey question assessing practice priorities. We used multivariable regression analyses to assess the extent to which implementation capability predicted relative commitment. We explored whether relative commitment or implementation capability measures were associated with earlier initiation of DIAMOND improvements. Results: All five implementation capability measures independently predicted practice leaders’ relative commitment to improving depression care in the following year. These included the following: quality improvement culture and attitudes (p = 0.003), depression culture and attitudes (p \u3c0.001), prior depression quality improvement activities (p \u3c0.001), advanced access and tracking capabilities (p = 0.03), and depression collaborative care features in place (p = 0.03). Higher relative commitment (p = 0.002) and prior depression quality improvement activities appeared to be associated with earlier participation in the DIAMOND initiative. Conclusions: The study supports the concept of organizational readiness to improve quality of care and the use of practice leader surveys to assess it. Practice leaders’ relative commitment to depression care improvement may be a useful measure of the likelihood that a practice is ready to initiate evidence-based depression care changes. A comprehensive organizational assessment of implementation capability for depression care improvement may identify specific barriers or facilitators to readiness that require targeted attention from implementers

Identifying continuous quality improvement publications: what makes an improvement intervention ‘CQI’?

Background: The term continuous quality improvement (CQI) is often used to refer to a method for improving care, but no consensus statement exists on the definition of CQI. Evidence reviews are critical for advancing science, and depend on reliable definitions for article selection. Methods: As a preliminary step towards improving CQI evidence reviews, this study aimed to use expert panel methods to identify key CQI definitional features and develop and test a screening instrument for reliably identifying articles with the key features. We used a previously published method to identify 106 articles meeting the general definition of a quality improvement intervention (QII) from 9427 electronically identified articles from PubMed. Two raters then applied a six-item CQI screen to the 106 articles. Results: Per cent agreement ranged from 55.7% to 75.5% for the six items, and reviewer-adjusted intra-class correlation ranged from 0.43 to 0.62. ‘Feedback of systematically collected data’ was the most common feature (64%), followed by being at least ‘somewhat’ adapted to local conditions (61%), feedback at meetings involving participant leaders (46%), using an iterative development process (40%), being at least ‘somewhat’ data driven (34%), and using a recognised change method (28%). All six features were present in 14.2% of QII articles. Conclusions: We conclude that CQI features can be extracted from QII articles with reasonable reliability, but only a small proportion of QII articles include all features. Further consensus development is needed to support meaningful use of the term CQI for scientific communication

Identifying quality improvement intervention publications - A comparison of electronic search strategies

Abstract Background The evidence base for quality improvement (QI) interventions is expanding rapidly. The diversity of the initiatives and the inconsistency in labeling these as QI interventions makes it challenging for researchers, policymakers, and QI practitioners to access the literature systematically and to identify relevant publications. Methods We evaluated search strategies developed for MEDLINE (Ovid) and PubMed based on free text words, Medical subject headings (MeSH), QI intervention components, continuous quality improvement (CQI) methods, and combinations of the strategies. Three sets of pertinent QI intervention publications were used for validation. Two independent expert reviewers screened publications for relevance. We compared the yield, recall rate, and precision of the search strategies for the identification of QI publications and for a subset of empirical studies on effects of QI interventions. Results The search yields ranged from 2,221 to 216,167 publications. Mean recall rates for reference publications ranged from 5% to 53% for strategies with yields of 50,000 publications or fewer. The 'best case' strategy, a simple text word search with high face validity ('quality' AND 'improv*' AND 'intervention*') identified 44%, 24%, and 62% of influential intervention articles selected by Agency for Healthcare Research and Quality (AHRQ) experts, a set of exemplar articles provided by members of the Standards for Quality Improvement Reporting Excellence (SQUIRE) group, and a sample from the Cochrane Effective Practice and Organization of Care Group (EPOC) register of studies, respectively. We applied the search strategy to a PubMed search for articles published in 10 pertinent journals in a three-year period which retrieved 183 publications. Among these, 67% were deemed relevant to QI by at least one of two independent raters. Forty percent were classified as empirical studies reporting on a QI intervention. Conclusions The presented search terms and operating characteristics can be used to guide the identification of QI intervention publications. Even with extensive iterative development, we achieved only moderate recall rates of reference publications. Consensus development on QI reporting and initiatives to develop QI-relevant MeSH terms are urgently needed

Elusive search for effective provider interventions: a systematic review of provider interventions to increase adherence to evidence-based treatment for depression

Abstract Background Depression is a common mental health disorder for which clinical practice guidelines have been developed. Prior systematic reviews have identified complex organizational interventions, such as collaborative care, as effective for guideline implementation; yet, many healthcare delivery organizations are interested in less resource-intensive methods to increase provider adherence to guidelines and guideline-concordant practices. The objective of this systematic review was to assess the effectiveness of healthcare provider interventions that aim to increase adherence to evidence-based treatment of depression in routine clinical practice. Methods We searched five databases through August 2017 using a comprehensive search strategy to identify English-language randomized controlled trials (RCTs) in the quality improvement, implementation science, and behavior change literature that evaluated outpatient provider interventions, in the absence of practice redesign efforts, to increase adherence to treatment guidelines or guideline-concordant practices for depression. We used meta-analysis to summarize odds ratios, standardized mean differences, and incidence rate ratios, and assessed quality of evidence (QoE) using the GRADE approach. Results Twenty-two RCTs promoting adherence to clinical practice guidelines or guideline-concordant practices met inclusion criteria. Studies evaluated diverse provider interventions, including distributing guidelines to providers, education/training such as academic detailing, and combinations of education with other components such as targeting implementation barriers. Results were heterogeneous and analyses comparing provider interventions with usual clinical practice did not indicate a statistically significant difference in guideline adherence across studies. There was some evidence that provider interventions improved individual outcomes such as medication prescribing and indirect comparisons indicated more complex provider interventions may be associated with more favorable outcomes. We did not identify types of provider interventions that were consistently associated with improvements across indicators of adherence and across studies. Effects on patients’ health in these RCTs were inconsistent across studies and outcomes. Conclusions Existing RCTs describe a range of provider interventions to increase adherence to depression guidelines. Low QoE and lack of replication of specific intervention strategies across studies limited conclusions that can be drawn from the existing research. Continued efforts are needed to identify successful strategies to maximize the impact of provider interventions on increasing adherence to evidence-based treatment for depression. Trial registration PROSPERO record CRD42017060460 on 3/29/1

Additional file 1: of Elusive search for effective provider interventions: a systematic review of provider interventions to increase adherence to evidence-based treatment for depression

Appendix A: Search strategy. Appendix B: Critical appraisal ratings using the Cochrane Risk of Bias tool and the QI-MQCS. Appendix C: Detailed quality of evidence and summary of findings. (DOCX 707 kb