Reliability of the interRAI suite of assessment instruments: a 12-country study of an integrated health information system

<p>Abstract</p> <p>Background</p> <p>A multi-domain suite of instruments has been developed by the interRAI research collaborative to support assessment and care planning in mental health, aged care and disability services. Each assessment instrument comprises items common to other instruments and specialized items exclusive to that instrument. This study examined the reliability of the items from five instruments supporting home care, long term care, mental health, palliative care and post-acute care.</p> <p>Methods</p> <p>Paired assessments on 783 individuals across 12 nations were completed within 72 hours of each other by trained assessors who were blinded to the others' assessment. Reliability was tested using weighted kappa coefficients.</p> <p>Results</p> <p>The overall kappa mean value for 161 items which are common to 2 or more instruments was 0.75. The kappa mean value for specialized items varied among instruments from 0.63 to 0.73. Over 60% of items scored greater than 0.70.</p> <p>Conclusion</p> <p>The vast majority of items exceeded standard cut-offs for acceptable reliability, with only modest variation among instruments. The overall performance of these instruments showed that the interRAI suite has substantial reliability according to conventional cut-offs for interpreting the kappa statistic. The results indicate that interRAI items retain reliability when used across care settings, paving the way for cross domain application of the instruments as part of an integrated health information system.</p

Sharing clinical information across care settings: the birth of an integrated assessment system

Background: Population ageing, the emergence of chronic illness, and the shift away from institutional care challenge conventional approaches to assessment systems which traditionally are problem and setting specific

Temporal and Geographic variation in the validity and internal consistency of the Nursing Home Resident Assessment Minimum Data Set 2.0

<p>Abstract</p> <p>Background</p> <p>The Minimum Data Set (MDS) for nursing home resident assessment has been required in all U.S. nursing homes since 1990 and has been universally computerized since 1998. Initially intended to structure clinical care planning, uses of the MDS expanded to include policy applications such as case-mix reimbursement, quality monitoring and research. The purpose of this paper is to summarize a series of analyses examining the internal consistency and predictive validity of the MDS data as used in the "real world" in all U.S. nursing homes between 1999 and 2007.</p> <p>Methods</p> <p>We used person level linked MDS and Medicare denominator and all institutional claim files including inpatient (hospital and skilled nursing facilities) for all Medicare fee-for-service beneficiaries entering U.S. nursing homes during the period 1999 to 2007. We calculated the sensitivity and positive predictive value (PPV) of diagnoses taken from Medicare hospital claims and from the MDS among all new admissions from hospitals to nursing homes and the internal consistency (alpha reliability) of pairs of items within the MDS that logically should be related. We also tested the internal consistency of commonly used MDS based multi-item scales and examined the predictive validity of an MDS based severity measure viz. one year survival. Finally, we examined the correspondence of the MDS discharge record to hospitalizations and deaths seen in Medicare claims, and the completeness of MDS assessments upon skilled nursing facility (SNF) admission.</p> <p>Results</p> <p>Each year there were some 800,000 new admissions directly from hospital to US nursing homes and some 900,000 uninterrupted SNF stays. Comparing Medicare enrollment records and claims with MDS records revealed reasonably good correspondence that improved over time (by 2006 only 3% of deaths had no MDS discharge record, only 5% of SNF stays had no MDS, but over 20% of MDS discharges indicating hospitalization had no associated Medicare claim). The PPV and sensitivity levels of Medicare hospital diagnoses and MDS based diagnoses were between .6 and .7 for major diagnoses like CHF, hypertension, diabetes. Internal consistency, as measured by PPV, of the MDS ADL items with other MDS items measuring impairments and symptoms exceeded .9. The Activities of Daily Living (ADL) long form summary scale achieved an alpha inter-consistency level exceeding .85 and multi-item scale alpha levels of .65 were achieved for well being and mood, and .55 for behavior, levels that were sustained even after stratification by ADL and cognition. The Changes in Health, End-stage disease and Symptoms and Signs (CHESS) index, a summary measure of frailty was highly predictive of one year survival.</p> <p>Conclusion</p> <p>The MDS demonstrates a reasonable level of consistency both in terms of how well MDS diagnoses correspond to hospital discharge diagnoses and in terms of the internal consistency of functioning and behavioral items. The level of alpha reliability and validity demonstrated by the scales suggest that the data can be useful for research and policy analysis. However, while improving, the MDS discharge tracking record should still not be used to indicate Medicare hospitalizations or mortality. It will be important to monitor the performance of the MDS 3.0 with respect to consistency, reliability and validity now that it has replaced version 2.0, using these results as a baseline that should be exceeded.</p

Risk adjustment methods for Home Care Quality Indicators (HCQIs) based on the minimum data set for home care

BACKGROUND: There has been increasing interest in enhancing accountability in health care. As such, several methods have been developed to compare the quality of home care services. These comparisons can be problematic if client populations vary across providers and no adjustment is made to account for these differences. The current paper explores the effects of risk adjustment for a set of home care quality indicators (HCQIs) based on the Minimum Data Set for Home Care (MDS-HC). METHODS: A total of 22 home care providers in Ontario and the Winnipeg Regional Health Authority (WRHA) in Manitoba, Canada, gathered data on their clients using the MDS-HC. These assessment data were used to generate HCQIs for each agency and for the two regions. Three types of risk adjustment methods were contrasted: a) client covariates only; b) client covariates plus an "Agency Intake Profile" (AIP) to adjust for ascertainment and selection bias by the agency; and c) client covariates plus the intake Case Mix Index (CMI). RESULTS: The mean age and gender distribution in the two populations was very similar. Across the 19 risk-adjusted HCQIs, Ontario CCACs had a significantly higher AIP adjustment value for eight HCQIs, indicating a greater propensity to trigger on these quality issues on admission. On average, Ontario had unadjusted rates that were 0.3% higher than the WRHA. Following risk adjustment with the AIP covariate, Ontario rates were, on average, 1.5% lower than the WRHA. In the WRHA, individual agencies were likely to experience a decline in their standing, whereby they were more likely to be ranked among the worst performers following risk adjustment. The opposite was true for sites in Ontario. CONCLUSIONS: Risk adjustment is essential when comparing quality of care across providers when home care agencies provide services to populations with different characteristics. While such adjustment had a relatively small effect for the two regions, it did substantially affect the ranking of many individual home care providers

The Method for Assigning Priority Levels (MAPLe): A new decision-support system for allocating home care resources

<p>Abstract</p> <p>Background</p> <p>Home care plays a vital role in many health care systems, but there is evidence that appropriate targeting strategies must be used to allocate limited home care resources effectively. The aim of the present study was to develop and validate a methodology for prioritizing access to community and facility-based services for home care clients.</p> <p>Methods</p> <p>Canadian and international data based on the Resident Assessment Instrument – Home Care (RAI-HC) were analyzed to identify predictors for nursing home placement, caregiver distress and for being rated as requiring alternative placement to improve outlook.</p> <p>Results</p> <p>The Method for Assigning Priority Levels (MAPLe) algorithm was a strong predictor of all three outcomes in the derivation sample. The algorithm was validated with additional data from five other countries, three other provinces, and an Ontario sample obtained after the use of the RAI-HC was mandated.</p> <p>Conclusion</p> <p>The MAPLe algorithm provides a psychometrically sound decision-support tool that may be used to inform choices related to allocation of home care resources and prioritization of clients needing community or facility-based services.</p

The resident assessment instrument-mental health (RAI-MH): Inter-rater reliability and convergent validity

An important challenge facing behavioral health services is the lack of good quality, clinically relevant data at the individual level. The article describes a multinational research effort to develop a comprehensive, multidisciplinary mental health assessment system for use with adults in facilities providing acute, long-stay, forensic, and geriatric services. The Resident Assessment Instrument-Mental Health (RAI-MH) comprehensively assesses psychiatric, social, environmental, and medical issues at intake, emphasizing patient functioning. Data from the RAI-MH are intended to support care planning, quality improvement, outcome measurement, and case mix-based payment systems. The article provides the first set of evidence on the reliability and validity of the RAI-MH.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/45775/1/11414_2005_Article_BF02287348.pd

Subtle genetic changes enhance virulence of methicillin resistant and sensitive Staphylococcus aureus

<p>Abstract</p> <p>Background</p> <p>Community acquired (CA) methicillin-resistant <it>Staphylococcus aureus </it>(MRSA) increasingly causes disease worldwide. USA300 has emerged as the predominant clone causing superficial and invasive infections in children and adults in the USA. Epidemiological studies suggest that USA300 is more virulent than other CA-MRSA. The genetic determinants that render virulence and dominance to USA300 remain unclear.</p> <p>Results</p> <p>We sequenced the genomes of two pediatric USA300 isolates: one CA-MRSA and one CA-methicillin susceptible (MSSA), isolated at Texas Children's Hospital in Houston. DNA sequencing was performed by Sanger dideoxy whole genome shotgun (WGS) and 454 Life Sciences pyrosequencing strategies. The sequence of the USA300 MRSA strain was rigorously annotated. In USA300-MRSA 2658 chromosomal open reading frames were predicted and 3.1 and 27 kilobase (kb) plasmids were identified. USA300-MSSA contained a 20 kb plasmid with some homology to the 27 kb plasmid found in USA300-MRSA. Two regions found in US300-MRSA were absent in USA300-MSSA. One of these carried the arginine deiminase operon that appears to have been acquired from <it>S. epidermidis</it>. The USA300 sequence was aligned with other sequenced <it>S. aureus </it>genomes and regions unique to USA300 MRSA were identified.</p> <p>Conclusion</p> <p>USA300-MRSA is highly similar to other MRSA strains based on whole genome alignments and gene content, indicating that the differences in pathogenesis are due to subtle changes rather than to large-scale acquisition of virulence factor genes. The USA300 Houston isolate differs from another sequenced USA300 strain isolate, derived from a patient in San Francisco, in plasmid content and a number of sequence polymorphisms. Such differences will provide new insights into the evolution of pathogens.</p

Predicting mortality of residents at admission to nursing home: A longitudinal cohort study

<p>Abstract</p> <p>Background</p> <p>An increasing numbers of deaths occur in nursing homes. Knowledge of the course of development over the years in death rates and predictors of mortality is important for officials responsible for organizing care to be able to ensure that staff is knowledgeable in the areas of care needed. The aim of this study was to investigate the time from residents' admission to Icelandic nursing homes to death and the predictive power of demographic variables, health status (health stability, pain, depression and cognitive performance) and functional profile (ADL and social engagement) for 3-year mortality in yearly cohorts from 1996-2006.</p> <p>Methods</p> <p>The samples consisted of residents (N = 2206) admitted to nursing homes in Iceland in 1996-2006, who were assessed once at baseline with a Minimum Data Set (MDS) within 90 days of their admittance to the nursing home. The follow-up time for survival of each cohort was 36 months from admission. Based on Kaplan-Meier analysis (log rank test) and non-parametric correlation analyses (Spearman's rho), variables associated with survival time with a p-value < 0.05 were entered into a multivariate Cox regression model.</p> <p>Results</p> <p>The median survival time was 31 months, and no significant difference was detected in the mortality rate between cohorts. Age, gender (HR 1.52), place admitted from (HR 1.27), ADL functioning (HR 1.33-1.80), health stability (HR 1.61-16.12) and ability to engage in social activities (HR 1.51-1.65) were significant predictors of mortality. A total of 28.8% of residents died within a year, 43.4% within two years and 53.1% of the residents died within 3 years.</p> <p>Conclusion</p> <p>It is noteworthy that despite financial constraints, the mortality rate did not change over the study period. Health stability was a strong predictor of mortality, in addition to ADL performance. Considering these variables is thus valuable when deciding on the type of service an elderly person needs. The mortality rate showed that more than 50% died within 3 years, and almost a third of the residents may have needed palliative care within a year of admission. Considering the short survival time from admission, it seems relevant that staff is trained in providing palliative care as much as restorative care.</p

The Resident Assessment Instrument-Minimum Data Set 2.0 quality indicators: a systematic review

BackgroundThe Resident Assessment Instrument-Minimum Data Set (RAI-MDS) 2.0 is designed to collect the minimum amount of data to guide care planning and monitoring for residents in long-term care settings. These data have been used to compute indicators of care quality. Use of the quality indicators to inform quality improvement initiatives is contingent upon the validity and reliability of the indicators. The purpose of this review was to systematically examine published and grey research reports in order to assess the state of the science regarding the validity and reliability of the RAI-MDS 2.0 Quality Indicators (QIs).MethodsWe systematically reviewed the evidence for the validity and reliability of the RAI-MDS 2.0 QIs. A comprehensive literature search identified relevant original research published, in English, prior to December 2008. Fourteen articles and one report examining the validity and/or reliability of the RAI-MDS 2.0 QIs were included.ResultsThe studies fell into two broad categories, those that examined individual quality indicators and those that examined multiple indicators. All studies were conducted in the United States and included from one to a total of 209 facilities. The number of residents included in the studies ranged from 109 to 5758. One study conducted under research conditions examined 38 chronic care QIs, of which strong evidence for the validity of 12 of the QIs was found. In response to these findings, the 12 QIs were recommended for public reporting purposes. However, a number of observational studies (n=13), conducted in &quot;real world&quot; conditions, have tested the validity and/or reliability of individual QIs, with mixed results. Ten QIs have been studied in this manner, including falls, depression, depression without treatment, urinary incontinence, urinary tract infections, weight loss, bedfast, restraint, pressure ulcer, and pain. These studies have revealed the potential for systematic bias in reporting, with under-reporting of some indicators and over-reporting of others.ConclusionEvidence for the reliability and validity of the RAI-MDS QIs remains inconclusive. The QIs provide a useful tool for quality monitoring and to inform quality improvement programs and initiatives. However, caution should be exercised when interpreting the QI results and other sources of evidence of the quality of care processes should be considered in conjunction with QI results.<br /

Measurement of the inclusive and dijet cross-sections of b-jets in pp collisions at sqrt(s) = 7 TeV with the ATLAS detector

The inclusive and dijet production cross-sections have been measured for jets containing b-hadrons (b-jets) in proton-proton collisions at a centre-of-mass energy of sqrt(s) = 7 TeV, using the ATLAS detector at the LHC. The measurements use data corresponding to an integrated luminosity of 34 pb^-1. The b-jets are identified using either a lifetime-based method, where secondary decay vertices of b-hadrons in jets are reconstructed using information from the tracking detectors, or a muon-based method where the presence of a muon is used to identify semileptonic decays of b-hadrons inside jets. The inclusive b-jet cross-section is measured as a function of transverse momentum in the range 20 < pT < 400 GeV and rapidity in the range |y| < 2.1. The bbbar-dijet cross-section is measured as a function of the dijet invariant mass in the range 110 < m_jj < 760 GeV, the azimuthal angle difference between the two jets and the angular variable chi in two dijet mass regions. The results are compared with next-to-leading-order QCD predictions. Good agreement is observed between the measured cross-sections and the predictions obtained using POWHEG + Pythia. MC@NLO + Herwig shows good agreement with the measured bbbar-dijet cross-section. However, it does not reproduce the measured inclusive cross-section well, particularly for central b-jets with large transverse momenta.Comment: 10 pages plus author list (21 pages total), 8 figures, 1 table, final version published in European Physical Journal