Inter-rater agreement and reliability of the COSMIN (COnsensus-based Standards for the selection of health status Measurement Instruments) Checklist

<p>Abstract</p> <p>Background</p> <p>The COSMIN checklist is a tool for evaluating the methodological quality of studies on measurement properties of health-related patient-reported outcomes. The aim of this study is to determine the inter-rater agreement and reliability of each item score of the COSMIN checklist (n = 114).</p> <p>Methods</p> <p>75 articles evaluating measurement properties were randomly selected from the bibliographic database compiled by the Patient-Reported Outcome Measurement Group, Oxford, UK. Raters were asked to assess the methodological quality of three articles, using the COSMIN checklist. In a one-way design, percentage agreement and intraclass kappa coefficients or quadratic-weighted kappa coefficients were calculated for each item.</p> <p>Results</p> <p>88 raters participated. Of the 75 selected articles, 26 articles were rated by four to six participants, and 49 by two or three participants. Overall, percentage agreement was appropriate (68% was above 80% agreement), and the kappa coefficients for the COSMIN items were low (61% was below 0.40, 6% was above 0.75). Reasons for low inter-rater agreement were need for subjective judgement, and accustom to different standards, terminology and definitions.</p> <p>Conclusions</p> <p>Results indicated that raters often choose the same response option, but that it is difficult on item level to distinguish between articles. When using the COSMIN checklist in a systematic review, we recommend getting some training and experience, completing it by two independent raters, and reaching consensus on one final rating. Instructions for using the checklist are improved.</p

Changes in symptom clusters in patients undergoing radiation therapy

The goals of the study were to determine the occurrence rates for and the severity of symptoms at the middle, end, and 1 month after the completion of radiation therapy (RT), to determine the number and types of symptom clusters at these three time points, and to evaluate for changes over time in these symptom clusters. Symptom occurrence and severity were evaluated using the Memorial Symptom Assessment Scale (MSAS) in a sample of patients (n = 160) who underwent RT for breast or prostate cancer. At each time point, an exploratory factor analysis was done to determine the number of symptom clusters (i.e., symptom factors) based on the MSAS symptom severity ratings. The majority of the patients were male and married with a mean age of 61.1 years. The five symptoms with the highest occurrence rates across all three time points were lack of energy, pain, difficulty sleeping, feeling drowsy, and sweats. Although the number of symptoms and the specific symptoms within each symptom cluster were not identical across the three time points, three relatively similar symptom clusters (i.e., “mood-cognitive” symptom cluster, “sickness-behavior” symptom cluster, “treatment-related”, or “pain” symptom cluster) were identified in this sample. The internal consistency coefficients for the mood-cognitive symptom cluster and sickness-behavior symptom cluster were adequate at ≥0.68. Three relatively stable symptom clusters were found across RT. The majority of the symptom cluster severity scores were significantly higher in patients with breast cancer compared to patients with prostate cancer

Hepatic profile analyses of tipranavir in Phase II and III clinical trials

<p>Abstract</p> <p>Background</p> <p>The risk and course of serum transaminase elevations (TEs) and clinical hepatic serious adverse event (SAE) development in ritonavir-boosted tipranavir (TPV/r) 500/200 mg BID recipients, who also received additional combination antiretroviral treatment agents in clinical trials (TPV/r-based cART), was determined.</p> <p>Methods</p> <p>Aggregated transaminase and hepatic SAE data through 96 weeks of TPV/r-based cART from five Phase IIb/III trials were analyzed. Patients were categorized by the presence or absence of underlying liver disease (+LD or -LD). Kaplan-Meier (K-M) probability estimates for time-to-first US National Institutes of Health, Division of AIDS (DAIDS) Grade 3/4 TE and clinical hepatic SAE were determined and clinical actions/outcomes evaluated. Risk factors for DAIDS Grade 3/4 TE were identified through multivariate Cox regression statistical modeling.</p> <p>Results</p> <p>Grade 3/4 TEs occurred in 144/1299 (11.1%) patients; 123/144 (85%) of these were asymptomatic; 84% of these patients only temporarily interrupted treatment or continued, with transaminase levels returning to Grade ≤ 2. At 96 weeks of study treatment, the incidence of Grade 3/4 TEs was higher among the +LD (16.8%) than among the -LD (10.1%) patients. K-M analysis revealed an incremental risk for developing DAIDS Grade 3/4 TEs; risk was greatest through 24 weeks (6.1%), and decreasing thereafter (>24-48 weeks: 3.4%, >48 weeks-72 weeks: 2.0%, >72-96 weeks: 2.2%), and higher in +LD than -LD patients at each 24-week interval. Treatment with TPV/r, co-infection with hepatitis B and/or C, DAIDS grade >1 TE and CD4⁺> 200 cells/mm³at baseline were found to be independent risk factors for development of DAIDS Grade 3/4 TE; the hazard ratios (HR) were 2.8, 2.0, 2.1 and 1.5, respectively. Four of the 144 (2.7%) patients with Grade 3/4 TEs developed hepatic SAEs; overall, 14/1299 (1.1%) patients had hepatic SAEs including six with hepatic failure (0.5%). The K-M risk of developing hepatic SAEs through 96 weeks was 1.4%; highest risk was observed during the first 24 weeks and decreased thereafter; the risk was similar between +LD and -LD patients for the first 24 weeks (0.6% and 0.5%, respectively) and was higher for +LD patients, thereafter.</p> <p>Conclusion</p> <p>Through 96 weeks of TPV/r-based cART, DAIDS Grade 3/4 TEs and hepatic SAEs occurred in approximately 11% and 1% of TPV/r patients, respectively; most (84%) had no significant clinical implications and were managed without permanent treatment discontinuation. Among the 14 patients with hepatic SAE, 6 experienced hepatic failure (0.5%); these patients had profound immunosuppression and the rate appears higher among hepatitis co-infected patients. The overall probability of experiencing a hepatic SAE in this patient cohort was 1.4% through 96 weeks of treatment. Independent risk factors for DAIDS Grade 3/4 TEs include TPV/r treatment, co-infection with hepatitis B and/or C, DAIDS grade >1 TE and CD4⁺> 200 cells/mm³at baseline.</p> <p>Trial registration</p> <p>US-NIH Trial registration number: NCT00144170</p

Rationale and design: telepsychology service delivery for depressed elderly veterans

<p>Abstract</p> <p>Background</p> <p>Older adults who live in rural areas experience significant disparities in health status and access to mental health care. "Telepsychology," (also referred to as "telepsychiatry," or "telemental health") represents a potential strategy towards addressing this longstanding problem. Older adults may benefit from telepsychology due to its: (1) utility to address existing problematic access to care for rural residents; (2) capacity to reduce stigma associated with traditional mental health care; and (3) utility to overcome significant age-related problems in ambulation and transportation. Moreover, preliminary evidence indicates that telepsychiatry programs are often less expensive for patients, and reduce travel time, travel costs, and time off from work. Thus, telepsychology may provide a cost-efficient solution to access-to-care problems in rural areas.</p> <p>Methods</p> <p>We describe an ongoing four-year prospective, randomized clinical trial comparing the effectiveness of an empirically supported treatment for major depressive disorder, Behavioral Activation, delivered either via in-home videoconferencing technology ("Telepsychology") or traditional face-to-face services ("Same-Room"). Our hypothesis is that in-homeTelepsychology service delivery will be equally effective as the traditional mode (Same-Room). Two-hundred twenty-four (224) male and female elderly participants will be administered protocol-driven individual Behavioral Activation therapy for depression over an 8-week period; and subjects will be followed for 12-months to ascertain longer-term effects of the treatment on three outcomes domains: (1) clinical outcomes (symptom severity, social functioning); (2) process variables (patient satisfaction, treatment credibility, attendance, adherence, dropout); and (3) economic outcomes (cost and resource use).</p> <p>Discussion</p> <p>Results from the proposed study will provide important insight into whether telepsychology service delivery is as effective as the traditional mode of service delivery, defined in terms of clinical, process, and economic outcomes, for elderly patients with depression residing in rural areas without adequate access to mental health services.</p> <p>Trial registration</p> <p>National Institutes of Health Clinical Trials Registry (ClinicalTrials.gov identifier# NCT00324701).</p

α-Synuclein Genetic Variants Predict Faster Motor Symptom Progression in Idiopathic Parkinson Disease

Currently, there are no reported genetic predictors of motor symptom progression in Parkinson’s disease (PD). In familial PD, disease severity is associated with higher α-synuclein (SNCA) expression levels, and in postmortem studies expression varies with SNCA genetic variants. Furthermore, SNCA is a well-known risk factor for PD occurrence. We recruited Parkinson’s patients from the communities of three central California counties to investigate the influence of SNCA genetic variants on motor symptom progression in idiopathic PD. We repeatedly assessed this cohort of patients over an average of 5.1 years for motor symptom changes employing the Unified Parkinson’s Disease Rating Scale (UPDRS). Of 363 population-based incident PD cases diagnosed less than 3 years from baseline assessment, 242 cases were successfully re-contacted and 233 were re-examined at least once. Of subjects lost to follow-up, 69% were due to death. Adjusting for covariates, risk of faster decline of motor function as measured by annual increase in motor UPDRS exam score was increased 4-fold in carriers of the REP1 263bp promoter variant (OR 4.03, 95%CI:1.57–10.4). Our data also suggest a contribution to increased risk by the G-allele for rs356165 (OR 1.66; 95%CI:0.96–2.88), and we observed a strong trend across categories when both genetic variants were considered (p for trend  = 0.002). Our population-based study has demonstrated that SNCA variants are strong predictors of faster motor decline in idiopathic PD. SNCA may be a promising target for therapies and may help identify patients who will benefit most from early interventions. This is the first study to link SNCA to motor symptom decline in a longitudinal progression study

Towards standardized measurement of adverse events in spine surgery: conceptual model and pilot evaluation

BACKGROUND: Independent of efficacy, information on safety of surgical procedures is essential for informed choices. We seek to develop standardized methodology for describing the safety of spinal operations and apply these methods to study lumbar surgery. We present a conceptual model for evaluating the safety of spine surgery and describe development of tools to measure principal components of this model: (1) specifying outcome by explicit criteria for adverse event definition, mode of ascertainment, cause, severity, or preventability, and (2) quantitatively measuring predictors such as patient factors, comorbidity, severity of degenerative spine disease, and invasiveness of spine surgery. METHODS: We created operational definitions for 176 adverse occurrences and established multiple mechanisms for reporting them. We developed new methods to quantify the severity of adverse occurrences, degeneration of lumbar spine, and invasiveness of spinal procedures. Using kappa statistics and intra-class correlation coefficients, we assessed agreement for the following: four reviewers independently coding etiology, preventability, and severity for 141 adverse occurrences, two observers coding lumbar spine degenerative changes in 10 selected cases, and two researchers coding invasiveness of surgery for 50 initial cases. RESULTS: During the first six months of prospective surveillance, rigorous daily medical record reviews identified 92.6% of the adverse occurrences we recorded, and voluntary reports by providers identified 38.5% (surgeons reported 18.3%, inpatient rounding team reported 23.1%, and conferences discussed 6.1%). Trained observers had fair agreement in classifying etiology of 141 adverse occurrences into 18 categories (kappa = 0.35), but agreement was substantial (kappa ≥ 0.61) for 4 specific categories: technical error, failure in communication, systems failure, and no error. Preventability assessment had moderate agreement (mean weighted kappa = 0.44). Adverse occurrence severity rating had fair agreement (mean weighted kappa = 0.33) when using a scale based on the JCAHO Sentinel Event Policy, but agreement was substantial for severity ratings on a new 11-point numerical severity scale (ICC = 0.74). There was excellent inter-rater agreement for a lumbar degenerative disease severity score (ICC = 0.98) and an index of surgery invasiveness (ICC = 0.99). CONCLUSION: Composite measures of disease severity and surgery invasiveness may allow development of risk-adjusted predictive models for adverse events in spine surgery. Standard measures of adverse events and risk adjustment may also facilitate post-marketing surveillance of spinal devices, effectiveness research, and quality improvement

A New Troodontid Theropod, Talos sampsoni gen. et sp. nov., from the Upper Cretaceous Western Interior Basin of North America

Troodontids are a predominantly small-bodied group of feathered theropod dinosaurs notable for their close evolutionary relationship with Avialae. Despite a diverse Asian representation with remarkable growth in recent years, the North American record of the clade remains poor, with only one controversial species--Troodon formosus--presently known from substantial skeletal remains.Here we report a gracile new troodontid theropod--Talos sampsoni gen. et sp. nov.--from the Upper Cretaceous Kaiparowits Formation, Utah, USA, representing one of the most complete troodontid skeletons described from North America to date. Histological assessment of the holotype specimen indicates that the adult body size of Talos was notably smaller than that of the contemporary genus Troodon. Phylogenetic analysis recovers Talos as a member of a derived, latest Cretaceous subclade, minimally containing Troodon, Saurornithoides, and Zanabazar. MicroCT scans reveal extreme pathological remodeling on pedal phalanx II-1 of the holotype specimen likely resulting from physical trauma and subsequent infectious processes.Talos sampsoni adds to the singularity of the Kaiparowits Formation dinosaur fauna, which is represented by at least 10 previously unrecognized species including the recently named ceratopsids Utahceratops and Kosmoceratops, the hadrosaurine Gryposaurus monumentensis, the tyrannosaurid Teratophoneus, and the oviraptorosaurian Hagryphus. The presence of a distinct troodontid taxon in the Kaiparowits Formation supports the hypothesis that late Campanian dinosaurs of the Western Interior Basin exhibited restricted geographic ranges and suggests that the taxonomic diversity of Late Cretaceous troodontids from North America is currently underestimated. An apparent traumatic injury to the foot of Talos with evidence of subsequent healing sheds new light on the paleobiology of deinonychosaurians by bolstering functional interpretations of prey grappling and/or intraspecific combat for the second pedal digit, and supporting trackway evidence indicating a minimal role in weight bearing