Early Detection of Poor Adherers to Statins: Applying Individualized Surveillance to Pay for Performance

Background: Medication nonadherence costs $300 billion annually in the US. Medicare Advantage plans have a financial incentive to increase medication adherence among members because the Centers for Medicare and Medicaid Services (CMS) now awards substantive bonus payments to such plans, based in part on population adherence to chronic medications. We sought to build an individualized surveillance model that detects early which beneficiaries will fall below the CMS adherence threshold. Methods: This was a retrospective study of over 210,000 beneficiaries initiating statins, in a database of private insurance claims, from 2008-2011. A logistic regression model was constructed to use statin adherence from initiation to day 90 to predict beneficiaries who would not meet the CMS measure of proportion of days covered 0.8 or above, from day 91 to 365. The model controlled for 15 additional characteristics. In a sensitivity analysis, we varied the number of days of adherence data used for prediction. Results: Lower adherence in the first 90 days was the strongest predictor of one-year nonadherence, with an odds ratio of 25.0 (95% confidence interval 23.7-26.5) for poor adherence at one year. The model had an area under the receiver operating characteristic curve of 0.80. Sensitivity analysis revealed that predictions of comparable accuracy could be made only 40 days after statin initiation. When members with 30-day supplies for their first statin fill had predictions made at 40 days, and members with 90-day supplies for their first fill had predictions made at 100 days, poor adherence could be predicted with 86% positive predictive value. Conclusions: To preserve their Medicare Star ratings, plan managers should identify or develop effective programs to improve adherence. An individualized surveillance approach can be used to target members who would most benefit, recognizing the tradeoff between improved model performance over time and the advantage of earlier detection

Using email reminders to engage physicians in an Internet-based CME intervention

BACKGROUND: Engaging practicing physicians in educational strategies that reinforce guideline adoption and improve the quality of healthcare may be difficult. Push technologies such as email offer new opportunities to engage physicians in online educational reinforcing strategies. The objectives are to investigate 1) the effectiveness of email announcements in engaging recruited community-based primary care physicians in an online guideline reinforcement strategy designed to promote Chlamydia screening, 2) the characteristics of physicians who respond to email announcements, as well as 3) how quickly and when they respond to email announcements. METHODS: Over a 45-week period, 445 recruited physicians received up to 33 email contacts announcing and reminding them of an online women's health guideline reinforcing CME activity. Participation was defined as physician log-on at least once to the website. Data were analyzed to determine participation, to compare characteristics of participants with recruited physicians who did not participate, and to determine at what point and when participants logged on. RESULTS: Of 445 recruited physicians with accurate email addresses, 47.2% logged on and completed at least one module. There were no significant differences by age, race, or specialty between participants and non-participants. Female physicians, US medical graduates and MDs had higher participation rates than male physicians, international medical graduates and DOs. Physicians with higher baseline screening rates were significantly more likely to log on to the course. The first 10 emails were the most effective in engaging community-based physicians to complete the intervention. Physicians were more likely to log on in the afternoon and evening and on Monday or Thursday. CONCLUSIONS: Email course reminders may enhance recruitment of physicians to interventions designed to reinforce guideline adoption; physicians' response to email reminders may vary by gender, degree, and country of medical training. Repetition of email communications contributes to physician online participation

Designing tailored Web-based instruction to improve practicing physicians\u27 chlamydial screening rates

OBJECTIVE: To design an individualized Web-based continuing medical education (CME) program to improve practicing physicians\u27 chlamydial screening rates. DESCRIPTION: Often unrecognized and untreated, chlamydial infections in young women may cause pelvic inflammatory disease, infertility, and ectopic pregnancy and facilitate the acquisition of HIV. The National Committee for Quality Assurance in 2001 reported chlamydia screening rates to be 23.6% for 16-20-year-olds and 18.3% for 21-26-year-olds. In a collaborative project an academic medical center and a large national managed care organization have developed four tailored Web-based modules for primary care physicians with the goal of improving rates of screening for chlamydia. Each module includes: (1) individual office chlamydial screening rates; (2) interactive cases with real-time comparison of answers with those of peers; (3) a toolbox of office support materials, including patient education materials and guideline summaries; and (4) real-time tailoring of the Web pages based on physicians\u27 interactions with module. Readiness to change and barriers impeding change are assessed during interaction with the module and multiple pathways are created in real time for each physician. Physicians\u27 perceptions of the prevalence of chlamydia in their patient populations and the rate of sexual activity among adolescent girls are also assessed. These variables have been correlated in other studies with low rates of chlamydial screening. Inaccurate perceptions of these variables are considered to constitute a precontemplative stage of change. Specific messages are designed to facilitate increased awareness of chlamydia prevalence, level of sexual activity, and the consequences of failure to screen. For physicians who are aware of the nature and scope of the problems related to chlamydia, messages are tailored to assist them in reducing barriers to screening. A randomized trial of a national sample of primary care physicians is being conducted to determine the effectiveness of this intervention in improving physicians\u27 chlamydial screening rates in sexually active women 16-26 years of age. DISCUSSION: While the Internet offers an educational distribution system accessible to practicing physicians, most CME online programs are text-based and infrequently interactive or guideline-based. It is unlikely that these programs have broad impact on physicians\u27 practice patterns. Neither the broad capacities of Web technologies nor the evidence of effective methods for influencing physicians\u27 practice patterns has influenced the design of most CME programs. The innovative course described above provides individual office feedback on performance, compares physicians\u27 responses with those of their peers, gathers responses to determine physicians\u27 readiness to change practices, and provides branching pathways on-the-fly individualized to these responses. The module format is easily adapted to other diseases, able to be linked in an automated fashion to administrative data files, and relatively low in cost to support

The art and science of chart review

BACKGROUND: Explicit chart review was an integral part of an ongoing national cooperative project, Using Achievable Benchmarks of Care to Improve Quality of Care for Outpatients with Depression, conducted by a large managed care organization (MCO) and an academic medical center. Many investigators overlook the complexities involved in obtaining high-quality data. Given a scarcity of advice in the quality improvement (QI) literature on how to conduct chart review, the process of chart review was examined and specific techniques for improving data quality were proposed. METHODS: The abstraction tool was developed and tested in a prepilot phase; perhaps the greatest problem detected was abstractor assumption and interpretation. The need for a clear distinction between symptoms of depression or anxiety and physician diagnosis of major depression or anxiety disorder also became apparent. In designing the variables for the chart review module, four key aspects were considered: classification, format, definition, and presentation. For example, issues in format include use of free-text versus numeric variables, categoric variables, and medication variables (which can be especially challenging for abstraction projects). Quantitative measures of reliability and validity were used to improve and maintain the quality of chart review data. Measuring reliability and validity offers assistance with development of the chart review tool, continuous maintenance of data quality throughout the production phase of chart review, and final documentation of data quality. For projects that require ongoing abstraction of large numbers of clinical records, data quality may be monitored with control charts and the principles of statistical process control. RESULTS: The chart review module, which contained 140 variables, was built using MedQuest software, a suite of tools designed for customized data collection. The overall interrater reliability increased from 80% in the prepilot phase to greater than 96% in the final phase (which included three abstractors and 465 unique charts). The mean time per chart was calculated for each abstractor, and the maximum value was 13.7 +/- 13 minutes. CONCLUSIONS: In general, chart review is more difficult than it appears on the surface. It is also project specific, making a cookbook approach difficult. Many factors, such as imprecisely worded research questions, vague specification of variables, poorly designed abstraction tools, inappropriate interpretation by abstractors, and poor or missing recording of data in the chart, may compromise data quality