Examining intra-rater and inter-rater response agreement: A medical chart abstraction study of a community-based asthma care program

<p>Abstract</p> <p>Background</p> <p>To assess the intra- and inter-rater agreement of chart abstractors from multiple sites involved in the evaluation of an Asthma Care Program (ACP).</p> <p>Methods</p> <p>For intra-rater agreement, 110 charts randomly selected from 1,433 patients enrolled in the ACP across eight Ontario communities were re-abstracted by 10 abstractors. For inter-rater agreement, data abstractors reviewed a set of eight fictitious charts. Data abstraction involved information pertaining to six categories: physical assessment, asthma control, spirometry, asthma education, referral visits, and medication side effects. Percentage agreement and the kappa statistic (κ) were used to measure agreement. Sensitivity and specificity estimates were calculated comparing results from all raters against the gold standard.</p> <p>Results</p> <p>Intra-rater re-abstraction yielded an overall kappa of 0.81. Kappa values for the chart abstraction categories were: physical assessment (κ 0.84), asthma control (κ 0.83), spirometry (κ 0.84), asthma education (κ 0.72), referral visits (κ 0.59) and medication side effects (κ 0.51). Inter-rater abstraction of the fictitious charts produced an overall kappa of 0.75, sensitivity of 0.91 and specificity of 0.89. Abstractors demonstrated agreement for physical assessment (κ 0.88, sensitivity and specificity 0.95), asthma control (κ 0.68, sensitivity 0.89, specificity 0.85), referral visits (κ 0.77, sensitivity 0.88, specificity 0.95), and asthma education (κ 0.49, sensitivity 0.87, specificity 0.77).</p> <p>Conclusion</p> <p>Though collected by multiple abstractors, the results show high sensitivity and specificity and substantial to excellent inter- and intra-rater agreement, assuring confidence in the use of chart abstraction for evaluating the ACP.</p

Chronic pain among homeless persons: characteristics, treatment, and barriers to management

<p>Abstract</p> <p>Background</p> <p>Little information is available on the problem of chronic pain among homeless individuals. This study aimed to describe the characteristics of and treatments for chronic pain, barriers to pain management, concurrent medical conditions, and substance use among a representative sample of homeless single adult shelter users who experience chronic pain in Toronto, Canada.</p> <p>Methods</p> <p>Participants were randomly selected at shelters for single homeless adults between September 2007 and February 2008 and screened for chronic pain, defined as having pain in the body for ≥ 3 months or receiving treatment for pain that started ≥ 3 months ago. Cross-sectional surveys obtained information on demographic characteristics, characteristics of and treatments for chronic pain, barriers to pain management, concurrent medical conditions, and substance use. Whenever possible, participants' physicians were also interviewed.</p> <p>Results</p> <p>Among 152 homeless participants who experienced chronic pain, 11 (8%) were classified as Chronic Pain Grade I (low disability-low intensity), 47 (32%) as Grade II (low disability-high intensity), 34 (23%) as Grade III (high disability-moderately limiting), and 54 (37%) as Grade IV (high disability-severely limiting). The most common self-reported barriers to pain management were stress of shelter life, inability to afford prescription medications, and poor sleeping conditions. Participants reported using over-the-counter medications (48%), street drugs (46%), prescribed medications (43%), and alcohol (29%) to treat their pain. Of the 61 interviewed physicians, only 51% reported treating the patient's pain. The most common physician-reported difficulties with pain management were reluctance to prescribe narcotics due to the patient's history of substance abuse, psychiatric comorbidities, frequently missed appointments, and difficulty getting the patient to take medications correctly.</p> <p>Conclusions</p> <p>Clinicians who provide healthcare for homeless people should screen for chronic pain and discuss barriers to effective pain management with their patients.</p

Examining intra-rater and inter-rater response agreement: A medical chart abstraction study of a community-based asthma care program-0

Ard.<p><b>Copyright information:</b></p><p>Taken from "Examining intra-rater and inter-rater response agreement: A medical chart abstraction study of a community-based asthma care program"</p><p>http://www.biomedcentral.com/1471-2288/8/29</p><p>BMC Medical Research Methodology 2008;8():29-29.</p><p>Published online 9 May 2008</p><p>PMCID:PMC2396663.</p><p></p