An evaluation of data quality in Canada’s Continuing Care Reporting System (CCRS): secondary analyses of Ontario data submitted between 1996 and 2011

Abstract Background Evidence informed decision making in health policy development and clinical practice depends on the availability of valid and reliable data. The introduction of interRAI assessment systems in many countries has provided valuable new information that can be used to support case mix based payment systems, quality monitoring, outcome measurement and care planning. The Continuing Care Reporting System (CCRS) managed by the Canadian Institute for Health Information has served as a data repository supporting national implementation of the Resident Assessment Instrument (RAI 2.0) in Canada for more than 15 years. The present paper aims to evaluate data quality for the CCRS using an approach that may be generalizable to comparable data holdings internationally. Methods Data from the RAI 2.0 implementation in Complex Continuing Care (CCC) hospitals/units and Long Term Care (LTC) homes in Ontario were analyzed using various statistical techniques that provide evidence for trends in validity, reliability, and population attributes. Time series comparisons included evaluations of scale reliability, patterns of associations between items and scales that provide evidence about convergent validity, and measures of changes in population characteristics over time. Results Data quality with respect to reliability, validity, completeness and freedom from logical coding errors was consistently high for the CCRS in both CCC and LTC settings. The addition of logic checks further improved data quality in both settings. The only notable change of concern was a substantial inflation in the percentage of long term care home residents qualifying for the Special Rehabilitation level of the Resource Utilization Groups (RUG-III) case mix system after the adoption of that system as part of the payment system for LTC. Conclusions The CCRS provides a robust, high quality data source that may be used to inform policy, clinical practice and service delivery in Ontario. Only one area of concern was noted, and the statistical techniques employed here may be readily used to target organizations with data quality problems in that (or any other) area. There was also evidence that data quality was good in both CCC and LTC settings from the outset of implementation, meaning data may be used from the entire time series. The methods employed here may continue to be used to monitor data quality in this province over time and they provide a benchmark for comparisons with other jurisdictions implementing the RAI 2.0 in similar populations.http://deepblue.lib.umich.edu/bitstream/2027.42/112338/1/12911_2012_Article_635.pd

Pilot study of an interactive voice response system to improve medication refill compliance

<p>Abstract</p> <p>Background</p> <p>Sub-optimal adherence to prescribed medications is well documented. Barriers to medication adherence include medication side effects, cost, and forgetting to take or refill medications. Interactive Voice Response (IVR) systems show promise as a tool for reminding individuals to take or refill medications. This pilot study evaluated the feasibility and acceptability of using an IVR system for prescription refill and daily medication reminders. We tested two novel features: personalized, medication-specific reminder messages and communication via voice recognition.</p> <p>Methods</p> <p>Patients enrolled in a study of electronic prescribing and medication management in Quebec, Canada who were taking chronic disease-related drugs were eligible to participate. Consenting patients had their demographic, telephone, and medication information transferred to an IVR system, which telephoned patients to remind them to take mediations and/or refill their prescriptions. Facilitators and barriers of the IVR system use and acceptability of the IVR system were assessed through a structured survey and open-ended questions administered by telephone interview.</p> <p>Results</p> <p>Of the 528 eligible patients who were contacted, 237 refused and 291 consented; 99 participants had started the pilot study when it was terminated because of physician and participant complaints. Thirty-eight participants completed the follow-up interview. The majority found the IVR system's voice acceptable, and did not have problems setting up the time and location of reminder calls. However, many participants experienced technical problems when called for reminders, such as incorrect time of calls and voice recognition difficulties. In addition, most participants had already refilled their prescriptions when they received the reminder calls, reporting that they did not have difficulties remembering to refill prescriptions on their own. Also, participants were not receptive to speaking to an automated voice system.</p> <p>Conclusion</p> <p>IVR systems designed to improve medication compliance must address key technical and performance issues and target those individuals with reported memory difficulties or complex medication regimens in order to improve the utility of the system. Future research should also identify characteristics of medication users who are more likely to be receptive to IVR technology.</p