Did changing primary care delivery models change performance? A population based study using health administrative data

<p>Abstract</p> <p>Background</p> <p>Primary care reform in Ontario, Canada started with the introduction of new enrollment models, the two largest of which are Family Health Networks (FHNs), a capitation-based model, and Family Health Groups (FHGs), a blended fee-for-service model. The purpose of this study was to evaluate differences in performance between FHNs and FHGs and to compare performance before and after physicians joined these new primary care groups.</p> <p>Methods</p> <p>This study used Ontario administrative claims data to compare performance measures in FHGs and FHNs. The study population included physicians who belonged to a FHN or FHG for at least two years. Patients were included in the analyses if they enrolled with a physician in the two years after the physician joined a FHN or FHG, and also if they saw the physician in a two year period prior to the physician joining a FHN or FHG. Performance was derived from the administrative data, and included measures of preventive screening for cancer (breast, cervical, colorectal) and chronic disease management (diabetes, heart failure, asthma).</p> <p>Results</p> <p>Performance measures did not vary consistently between models. In some cases, performance approached current benchmarks (Pap smears, mammograms). In other cases it was improving in relation to previous measures (colorectal cancer screening). There were no changes in screening for cervical cancer or breast cancer after joining either a FHN or FHG. Colorectal cancer screening increased in both FHNs and FHGs. After enrolling in either a FHG or a FHN, prescribing performance measures for diabetes care improved. However, annual eye examinations decreased for younger people with diabetes after joining a FHG or FHN. There were no changes in performance measures for heart failure management or asthma care after enrolling in either a FHG or FHN.</p> <p>Conclusions</p> <p>Some improvements in preventive screening and diabetes management which were seen amongst people after they enrolled may be attributed to incentive payments offered to physicians within FHGs and FHNs. However, these primary care delivery models need to be compared with other delivery models and fee for service practices in order to describe more specifically what aspects of model delivery and incentives affect care.</p

An administrative data validation study of the accuracy of algorithms for identifying rheumatoid arthritis: the influence of the reference standard on algorithm performance

BACKGROUND: We have previously validated administrative data algorithms to identify patients with rheumatoid arthritis (RA) using rheumatology clinic records as the reference standard. Here we reassessed the accuracy of the algorithms using primary care records as the reference standard. METHODS: We performed a retrospective chart abstraction study using a random sample of 7500 adult patients under the care of 83 family physicians contributing to the Electronic Medical Record Administrative data Linked Database (EMRALD) in Ontario, Canada. Using physician-reported diagnoses as the reference standard, we computed and compared the sensitivity, specificity, and predictive values for over 100 administrative data algorithms for RA case ascertainment. RESULTS: We identified 69 patients with RA for a lifetime RA prevalence of 0.9%. All algorithms had excellent specificity (>97%). However, sensitivity varied (75-90%) among physician billing algorithms. Despite the low prevalence of RA, most algorithms had adequate positive predictive value (PPV; 51-83%). The algorithm of “[1 hospitalization RA diagnosis code] or [3 physician RA diagnosis codes with ≥1 by a specialist over 2 years]” had a sensitivity of 78% (95% CI 69–88), specificity of 100% (95% CI 100–100), PPV of 78% (95% CI 69–88) and NPV of 100% (95% CI 100–100). CONCLUSIONS: Administrative data algorithms for detecting RA patients achieved a high degree of accuracy amongst the general population. However, results varied slightly from our previous report, which can be attributed to differences in the reference standards with respect to disease prevalence, spectrum of disease, and type of comparator group

Tracking family medicine graduates. Where do they go, what services do they provide and whom do they see?

<p>Abstract</p> <p>Background</p> <p>There are continued concerns over an adequate supply of family physicians (FPs) practicing in Canada. While most resource planning has focused on intake into postgraduate education, less information is available on what postgraduate medical training yields. We therefore undertook a study of Family Medicine (FM) graduates from the University of Toronto (U of T) to determine the type of information for physician resource planning that may come from tracking FM graduates using health administrative data. This study compared three cohorts of FM graduates over a 10 year period of time and it also compared FM graduates to all Ontario practicing FPs in 2005/06. The objectives for tracking the three cohorts of FM graduates were to: 1) describe where FM graduates practice in the province 2) examine the impact of a policy introduced to influence the distribution of new FM graduates in the province 3) describe the services provided by FM graduates and 4) compare workload measures. The objectives for the comparison of FM graduates to all practicing FPs in 2005/06 were to: 1) describe the patient population served by FM graduates, 2) compare workload of FM graduates to all practicing FPs.</p> <p>Methods</p> <p>The study cohort consisted of all U of T FM postgraduate trainees who started and completed their training between 1993 and 2003. This study was a descriptive record linkage study whereby postgraduate information for FM graduates was linked to provincial health administrative data. Comprehensiveness of care indicators and workload measures based on administrative data where determined for the study cohort.</p> <p>Results</p> <p>From 1993 to 2003 there were 857 University of Toronto FM graduates. While the majority of U of T FM graduates practice in Toronto or the surrounding Greater Toronto Area, there are FM graduates from U of T practicing in every region in Ontario, Canada. The proportion of FM graduates undertaking further emergency training had doubled from 3.6% to 7.8%. From 1993 to 2003, a higher proportion of the most recent FM graduates did hospital visits, emergency room care and a lower proportion undertook home visits. Male FM graduates appear to have had higher workloads compared with female FM graduates, though the difference between them was decreasing over time. A 1997 policy initiative to discount fees paid to new FPs practicing in areas deemed over supplied did result in a decrease in the proportion of FM graduates practicing in metropolitan areas.</p> <p>Conclusions</p> <p>We were able to profile the practices of FM graduates using existing and routinely collected population-based health administrative data. Further work tracking FM graduates could be helpful for physician resource forecasting and in examining the impact of policies on family medicine practice.</p

Depression and mental health visits to physicians--a prospective records-based study

Previous studies of access to care for depression have been based on cross-sectional surveys of self-reported use of mental health service use. As the recall of use may be differentially biased by mood states, inferences about how well persons with depression are accessing services in comparison to other groups may be misleading. Accordingly, we estimated the magnitude of the depression-use associations in relation to key covariates based on prospective records of mental health visits to physicians. The sample, N=23,063, of persons 12 years and older, was drawn from the 1996/97 Ontario Health Survey and linked to their administrative mental health care records 24 months forward in time. We found that depression-use associations were in the expected direction but similar in magnitude to associations for gender and education unlike previous self-reported use surveys. Female gender was positively related to the use of a primary care physician but negatively related to seeing a psychiatrist as opposed to a primary care physician. Those who had attained higher levels of education were more likely to be seen by physicians than those with lower education levels. The meaning behind these findings bears further study as it may have implications for primary care reform and the design of future studies of access.Mental health services utilization Depression Recall bias Prospective studies Canada

Assessing methods for measurement of clinical outcomes and quality of care in primary care practices

<p>Abstract</p> <p>Purpose</p> <p>To evaluate the appropriateness of potential data sources for the population of performance indicators for primary care (PC) practices.</p> <p>Methods</p> <p>This project was a cross sectional study of 7 multidisciplinary primary care teams in Ontario, Canada. Practices were recruited and 5-7 physicians per practice agreed to participate in the study. Patients of participating physicians (20-30) were recruited sequentially as they presented to attend a visit. Data collection included patient, provider and practice surveys, chart abstraction and linkage to administrative data sets. Matched pairs analysis was used to examine the differences in the observed results for each indicator obtained using multiple data sources.</p> <p>Results</p> <p>Seven teams, 41 physicians, 94 associated staff and 998 patients were recruited. The survey response rate was 81% for patients, 93% for physicians and 83% for associated staff. Chart audits were successfully completed on all but 1 patient and linkage to administrative data was successful for all subjects. There were significant differences noted between the data collection methods for many measures. No single method of data collection was best for all outcomes. For most measures of technical quality of care chart audit was the most accurate method of data collection. Patient surveys were more accurate for immunizations, chronic disease advice/information dispensed, some general health promotion items and possibly for medication use. Administrative data appears useful for indicators including chronic disease diagnosis and osteoporosis/ breast screening.</p> <p>Conclusions</p> <p>Multiple data collection methods are required for a comprehensive assessment of performance in primary care practices. The choice of which methods are best for any one particular study or quality improvement initiative requires careful consideration of the biases that each method might introduce into the results. In this study, both patients and providers were willing to participate in and consent to, the collection and linkage of information from multiple sources that would be required for such assessments.</p