VA residential substance use disorder treatment program providers’ perceptions of facilitators and barriers to performance on pre-admission processes

Abstract Background In the U.S. Department of Veterans Affairs (VA), residential treatment programs are an important part of the continuum of care for patients with a substance use disorder (SUD). However, a limited number of program-specific measures to identify quality gaps in SUD residential programs exist. This study aimed to: (1) Develop metrics for two pre-admission processes: Wait Time and Engagement While Waiting, and (2) Interview program management and staff about program structures and processes that may contribute to performance on these metrics. The first aim sought to supplement the VA’s existing facility-level performance metrics with SUD program-level metrics in order to identify high-value targets for quality improvement. The second aim recognized that not all key processes are reflected in the administrative data, and even when they are, new insight may be gained from viewing these data in the context of day-to-day clinical practice. Methods VA administrative data from fiscal year 2012 were used to calculate pre-admission metrics for 97 programs (63 SUD Residential Rehabilitation Treatment Programs (SUD RRTPs); 34 Mental Health Residential Rehabilitation Treatment Programs (MH RRTPs) with a SUD track). Interviews were then conducted with management and front-line staff to learn what factors may have contributed to high or low performance, relative to the national average for their program type. We hypothesized that speaking directly to residential program staff may reveal innovative practices, areas for improvement, and factors that may explain system-wide variability in performance. Results Average wait time for admission was 16 days (SUD RRTPs: 17 days; MH RRTPs with a SUD track: 11 days), with 60% of Veterans waiting longer than 7 days. For these Veterans, engagement while waiting occurred in an average of 54% of the waiting weeks (range 3–100% across programs). Fifty-nine interviews representing 44 programs revealed factors perceived to potentially impact performance in these domains. Efficient screening processes, effective patient flow, and available beds were perceived to facilitate shorter wait times, while lack of beds, poor staffing levels, and lengths of stay of existing patients were thought to lengthen wait times. Accessible outpatient services, strong patient outreach, and strong encouragement of pre-admission outpatient treatment emerged as facilitators of engagement while waiting; poor staffing levels, socioeconomic barriers, and low patient motivation were viewed as barriers. Conclusions Metrics for pre-admission processes can be helpful for monitoring residential SUD treatment programs. Interviewing program management and staff about drivers of performance metrics can play a complementary role by identifying innovative and other strong practices, as well as high-value targets for quality improvement. Key facilitators of high-performing facilities may offer programs with lower performance useful strategies to improve specific pre-admission processes

Validation of the treatment identification strategy of the HEDIS addiction quality measures: concordance with medical record review

<p>Abstract</p> <p>Background</p> <p>Strategies to accurately identify the occurrence of specific health care events in administrative data is central to many quality improvement and research efforts. Many health care quality measures have treatment identification strategies based on diagnosis and procedure codes - an approach that is inexpensive and feasible but usually of unknown validity. In this study, we examined if the diagnosis/procedure code combinations used in the 2006 HEDIS Initiation and Engagement quality measures to identify instances of addiction treatment have high concordance with documentation of addiction treatment in clinical progress notes.</p> <p>Methods</p> <p>Four type of records were randomly sampled from VHA electronic medical data: (a) Outpatient records from a substance use disorder (SUD) specialty clinic with a HEDIS-qualified substance use disorder (SUD) diagnosis/CPT code combination (n = 700), (b) Outpatient records from a non-SUD setting with a HEDIS-qualified SUD diagnosis/CPT code combination (n = 592), (c) Specialty SUD Inpatient/residential records that included a SUD diagnosis (n = 700), and (d) Non-SUD specialty Inpatient/residential records that included a SUD diagnosis (n = 700). Clinical progress notes for the sampled records were extracted and two raters classified each as documenting or not documenting addiction treatment. Rates of concordance between the HEDIS addiction treatment identification strategy and the raters' judgments were calculated for each record type.</p> <p>Results</p> <p>Within SUD outpatient clinics and SUD inpatient specialty units, 92% and 98% of sampled records had chart evidence of addiction treatment. Of outpatient encounters with a qualifying diagnosis/procedure code combination outside of SUD clinics, 63% had chart evidence of addiction treatment. Within non-SUD specialty inpatient units, only 46% of sampled records had chart evidence of addiction treatment.</p> <p>Conclusions</p> <p>For records generated in SUD specialty settings, the HEDIS strategy of identifying SUD treatment with diagnosis and procedure codes has a high concordance with chart review. The concordance rate outside of SUD specialty settings is much lower and highly variable between facilities. Therefore, some patients may be counted as meeting the 2006 HEDIS Initiation and Engagement criteria without having received the specified amount (or any) addiction treatment.</p