Examining intra-rater and inter-rater response agreement: A medical chart abstraction study of a community-based asthma care program

<p>Abstract</p> <p>Background</p> <p>To assess the intra- and inter-rater agreement of chart abstractors from multiple sites involved in the evaluation of an Asthma Care Program (ACP).</p> <p>Methods</p> <p>For intra-rater agreement, 110 charts randomly selected from 1,433 patients enrolled in the ACP across eight Ontario communities were re-abstracted by 10 abstractors. For inter-rater agreement, data abstractors reviewed a set of eight fictitious charts. Data abstraction involved information pertaining to six categories: physical assessment, asthma control, spirometry, asthma education, referral visits, and medication side effects. Percentage agreement and the kappa statistic (κ) were used to measure agreement. Sensitivity and specificity estimates were calculated comparing results from all raters against the gold standard.</p> <p>Results</p> <p>Intra-rater re-abstraction yielded an overall kappa of 0.81. Kappa values for the chart abstraction categories were: physical assessment (κ 0.84), asthma control (κ 0.83), spirometry (κ 0.84), asthma education (κ 0.72), referral visits (κ 0.59) and medication side effects (κ 0.51). Inter-rater abstraction of the fictitious charts produced an overall kappa of 0.75, sensitivity of 0.91 and specificity of 0.89. Abstractors demonstrated agreement for physical assessment (κ 0.88, sensitivity and specificity 0.95), asthma control (κ 0.68, sensitivity 0.89, specificity 0.85), referral visits (κ 0.77, sensitivity 0.88, specificity 0.95), and asthma education (κ 0.49, sensitivity 0.87, specificity 0.77).</p> <p>Conclusion</p> <p>Though collected by multiple abstractors, the results show high sensitivity and specificity and substantial to excellent inter- and intra-rater agreement, assuring confidence in the use of chart abstraction for evaluating the ACP.</p

German ambulatory care physicians' perspectives on clinical guidelines – a national survey

BACKGROUND: There has been little systematic research about the extent to which German physicians accept or reject the concept and practice of a) clinical practice guidelines (CPG) and b) evidence based medicine (EBM) The aim of this study was to investigate German office-based physicians' perspective on CPGs and EBM and their application in medical practice. METHODS: Structured national telephone survey of ambulatory care physicians, four thematic blocks with 21 questions (5 point Likert scale). 511 office-based general practitioners and specialists. Main outcome measures were the application of Clinical Practice Guidelines in daily practice, preference for sources of guidelines and degree of knowledge and acceptance of EBM. In the data analysis Pearson's correlation coefficient was used for explorative analysis of correlations. The comparison of groups was performed by Student's t-test. Chi(2 )test was used to investigate distribution of two or more categorical variables. RESULTS: Of the total study population 55.3% of physicians reported already using guidelines in the treatment of patients. Physicians in group practices (GrP) as well as general practitioners (GP) agreed significantly more with the usefulness of guidelines as a basis for patient care than doctors in single practices (SP) or specialists (S) (Student's t-test mean GP 2.57, S 2.84, p < 0.01; mean GrP 2.55, SP 2.80, p < 0.05). 33.1% of the participants demonstrated a strong rejection to the application of guidelines in patient care. Acceptance of guidelines from a governmental institution was substantially lower than from physician networks or medical societies (36.2% vs. 53.4% vs. 62.0%). 73.8% of doctors interpret EBM as a combination of scientific research and individual medical knowledge; 80% regard EBM as the best basis for patient care. CONCLUSION: Despite a majority of physicians accepting and applying CPGs a large group remains that is critical and opposed to the utilization of CPGs in daily practice and to the concept of EBM in general. Doctors in single practice and specialists appear to be more critical than physicians in group practices and GPs. Future research is needed to evaluate the willingness to acquire necessary knowledge and skills for the promotion and routine application of CPGs

Cardiac rehabilitation in Austria: long term health-related quality of life outcomes

<p>Abstract</p> <p>Background</p> <p>The goal of cardiac rehabilitation programs is not only to prolong life but also to improve physical functioning, symptoms, well-being, and health-related quality of life (HRQL). The aim of this study was to document the long-term effect of a 1-month inpatient cardiac rehabilitation intervention on HRQL in Austria.</p> <p>Methods</p> <p>Patients (N = 487, 64.7% male, age 60.9 ± 12.5 SD years) after myocardial infarction, with or without percutaneous interventions, coronary artery bypass grafting or valve surgery underwent inpatient cardiac rehabilitation and were included in this long-term observational study (two years follow-up). HRQL was measured with both the MacNew Heart Disease Quality of Life Instrument [MacNew] and EuroQoL-5D [EQ-5D].</p> <p>Results</p> <p>All MacNew scale scores improved significantly (p < 0.001) and exceeded the minimal important difference (0.5 MacNew points) by the end of rehabilitation. Although all MacNew scale scores deteriorated significantly over the two year follow-up period (p < .001), all MacNew scale scores still remained significantly higher than the pre-rehabilitation values. The mean improvement after two years in the MacNew social scale exceeded the minimal important difference while MacNew scale scores greater than the minimal important difference were reported by 40-49% of the patients.</p> <p>Two years after rehabilitation the mean improvement in the EQ-5D Visual Analogue Scale score was not significant with no significant change in the proportion of patients reporting problems at this time.</p> <p>Conclusion</p> <p>These findings provide a first indication that two years following inpatient cardiac rehabilitation in Austria, the long-term improvements in HRQL are statistically significant and clinically relevant for almost 50% of the patients. Future controlled randomized trials comparing different cardiac rehabilitation programs are needed.</p

Adherence to yoga and exercise interventions in a 6-month clinical trial

<p>Abstract</p> <p>Background</p> <p>To determine factors that predict adherence to a mind-body intervention in a randomized trial.</p> <p>Design</p> <p>We analyzed adherence data from a 3-arm trial involving 135 generally healthy seniors 65–85 years of age randomized to a 6-month intervention consisting of: an Iyengar yoga class with home practice, an exercise class with home practice, or a wait-list control group. Outcome measures included cognitive function, mood, fatigue, anxiety, health-related quality of life, and physical measures. Adherence to the intervention was obtained by class attendance and biweekly home practice logs.</p> <p>Results</p> <p>The drop-out rate was 13%. Among the completers of the two active interventions, average yoga class attendance was 77% and home practice occurred 64% of all days. Average exercise class attendance was 69% and home exercise occurred 54% of all days. There were no clear effects of adherence on the significant study outcomes (quality of life and physical measures). Class attendance was significantly correlated with baseline measures of depression, fatigue, and physical components of health-related quality of life. Significant differences in baseline measures were also found between study completers and drop-outs in the active interventions. Adherence was not related to age, gender, or education level.</p> <p>Conclusion</p> <p>Healthy seniors have good attendance at classes with a physically active intervention. Home practice takes place over half of the time. Decreased adherence to a potentially beneficial intervention has the potential to decrease the effect of the intervention in a clinical trial because subjects who might sustain the greatest benefit will receive a lower dose of the intervention and subjects with higher adherence rates may be functioning closer to maximum ability before the intervention. Strategies to maximize adherence among subjects at greater risk for low adherence will be important for future trials, especially complementary treatments requiring greater effort than simple pill-taking.</p

Placebo Adherence and Its Association with Morbidity and Mortality in the Studies of Left Ventricular Dysfunction

A provocative finding from several double-blind clinical trials has been the association between greater adherence to placebo study medication and better health outcomes. We used data from the Studies of Left Ventricular Dysfunction (SOLVD) Treatment Trial (SOLVD-TT) and the SOLVD Prevention Trial (SOLVD-PT) to examine whether such associations could be validated and to examine several sources of bias and potential confounding. Survival analytic methods were used to estimate the association between placebo adherence and several health outcomes, employing a number of modeling techniques to test for the existence of alternative explanations for the association. Higher adherence was defined as having taken ≥75% of prescribed study medication. Higher placebo adherence was associated with improved overall survival in both SOLVD-TT and SOLVD-PT [hazard ratio (HR) = 0.52, 95% confidence interval (CI): 0.35 to 0.79 and HR = 0.52, 95%CI: 0.38 to 0.71, respectively]. Associations were similar for fatal or non-fatal cardiovascular or coronary heart disease events. Adjustment for both modifiable and non-modifiable cardiac risk factors (including age, gender, diabetes, blood pressure, smoking, weight, alcohol use, and levels of education) had minimal effect on the strength of the association. Little evidence of bias was found as an explanation for this relationship. In these two trials, better adherence to placebo was associated with markedly superior health outcomes, including total in-study mortality and incident cardiovascular events. No important confounders were identified. These data suggest there may exist strong but unrecognized determinants of health outcomes for which placebo adherence is a marker

A structured registration program can be validly used for quality assessment in general practice

ABSTRACT: BACKGROUND: Patient information, medical history, clinical outcomes and demographic information, can be registered in different ways in registration programs. For evaluation of diabetes care, data can easily be extracted from a structured registration program (SRP). The usability of data from this source depends on the agreement of this data with that of the usual data registration in the electronic medical record (EMR). Aim of the study was to determine the comparability of data from an EMR and from an SRP, to determine whether the use of SRP data for quality assessment is justified in general practice. METHODS: We obtained 196 records of diabetes mellitus patients in a sample of general practices in the Netherlands. We compared the agreement between the two programs in terms of laboratory and non-laboratory parameters. Agreement was determined by defining accordance between the programs in absent and present registrations, accordance between values of registrations, and whether the differences found in values were also a clinically relevant difference. RESULTS: No differences were found in the occurrence of registration (absent/present) in the SRP and EMR for all the laboratory parameters. Smoking behaviour, weight and eye examination were registered significantly more often in the SRP than in the EMR. In the EMR, blood pressure was registered significantly more often than in the SRP. Data registered in the EMR and in the SRP had a similar clinical meaning for all parameters (laboratory and non-laboratory). CONCLUSIONS: Laboratory parameters showed good agreement and non-laboratory acceptable agreement of the SRP with the EMR. Data from a structured registration program can be used validly for research purposes and quality assessment in general practice

Comparative quantification of health risks: Conceptual framework and methodological issues

Reliable and comparable analysis of risks to health is key for preventing disease and injury. Causal attribution of morbidity and mortality to risk factors has traditionally been conducted in the context of methodological traditions of individual risk factors, often in a limited number of settings, restricting comparability. In this paper, we discuss the conceptual and methodological issues for quantifying the population health effects of individual or groups of risk factors in various levels of causality using knowledge from different scientific disciplines. The issues include: comparing the burden of disease due to the observed exposure distribution in a population with the burden from a hypothetical distribution or series of distributions, rather than a single reference level such as non-exposed; considering the multiple stages in the causal network of interactions among risk factor(s) and disease outcome to allow making inferences about some combinations of risk factors for which epidemiological studies have not been conducted, including the joint effects of multiple risk factors; calculating the health loss due to risk factor(s) as a time-indexed "stream" of disease burden due to a time-indexed "stream" of exposure, including consideration of discounting; and the sources of uncertainty

Antipsychotic drug use and community-acquired pneumonia

Antipsychotics are generally distinguished as atypical and typical agents, which are indicated in the treatment of acute and chronic psychoses and other psy