A Reliability-Generalization Study of Journal Peer Reviews: A Multilevel Meta-Analysis of Inter-Rater Reliability and Its Determinants

Background: This paper presents the first meta-analysis for the inter-rater reliability (IRR) of journal peer reviews. IRR is defined as the extent to which two or more independent reviews of the same scientific document agree. Methodology/Principal Findings: Altogether, 70 reliability coefficients (Cohen’s Kappa, intra-class correlation [ICC], and Pearson product-moment correlation [r]) from 48 studies were taken into account in the meta-analysis. The studies were based on a total of 19,443 manuscripts; on average, each study had a sample size of 311 manuscripts (minimum: 28, maximum: 1983). The results of the meta-analysis confirmed the findings of the narrative literature reviews published to date: The level of IRR (mean ICC/r 2 =.34, mean Cohen’s Kappa =.17) was low. To explain the study-to-study variation of the IRR coefficients, meta-regression analyses were calculated using seven covariates. Two covariates that emerged in the metaregression analyses as statistically significant to gain an approximate homogeneity of the intra-class correlations indicated that, firstly, the more manuscripts that a study is based on, the smaller the reported IRR coefficients are. Secondly, if the information of the rating system for reviewers was reported in a study, then this was associated with a smaller IRR coefficient than if the information was not conveyed. Conclusions/Significance: Studies that report a high level of IRR are to be considered less credible than those with a low level o

A Review on the Oral Health Impacts of Acculturation

The impact of acculturation on systemic health has been extensively investigated and is regarded as an important explanatory factor for health disparity. However, information is limited and fragmented on the oral health implications of acculturation. This study aimed to review the current evidence on the oral health impact of acculturation. Papers were retrieved from five electronic databases. Twenty-seven studies were included in this review. Their scientific quality was rated and key findings were summarized. Seventeen studies investigated the impacts of acculturation on the utilization of dental services; among them, 16 reported positive associations between at least one acculturation indicator and use of dental services. All 15 studies relating acculturation to oral diseases (dental caries and periodontal disease) suggested better oral health among acculturated individuals. Evidence is lacking to support that better oral health of acculturated immigrants is attributable to their improved dental attendance. Further researches involving other oral health behaviors and diseases and incorporating refined acculturation scales are needed. Prospective studies will facilitate the understanding on the trajectory of immigrants’ oral health along the acculturation continuum

Staying well after depression: trial design and protocol

<p>Abstract</p> <p>Background</p> <p>Depression is often a chronic relapsing condition, with relapse rates of 50-80% in those who have been depressed before. This is particularly problematic for those who become suicidal when depressed since habitual recurrence of suicidal thoughts increases likelihood of further acute suicidal episodes. Therefore the question how to prevent relapse is of particular urgency in this group.</p> <p>Methods/Design</p> <p>This trial compares Mindfulness-Based Cognitive Therapy (MBCT), a novel form of treatment combining mindfulness meditation and cognitive therapy for depression, with both Cognitive Psycho-Education (CPE), an equally plausible cognitive treatment but without meditation, and treatment as usual (TAU). It will test whether MBCT reduces the risk of relapse in recurrently depressed patients and the incidence of suicidal symptoms in those with a history of suicidality who do relapse. It recruits participants, screens them by telephone for main inclusion and exclusion criteria and, if they are eligible, invites them to a pre-treatment session to assess eligibility in more detail. This trial allocates eligible participants at random between MBCT and TAU, CPE and TAU, and TAU alone in a ratio of 2:2:1, stratified by presence of suicidal ideation or behaviour and current anti-depressant use. We aim to recruit sufficient participants to allow for retention of 300 following attrition. We deliver both active treatments in groups meeting for two hours every week for eight weeks. We shall estimate effects on rates of relapse and suicidal symptoms over 12 months following treatment and assess clinical status immediately after treatment, and three, six, nine and twelve months thereafter.</p> <p>Discussion</p> <p>This will be the first trial of MBCT to investigate whether MCBT is effective in preventing relapse to depression when compared with a control psychological treatment of equal plausibility; and to explore the use of MBCT for the most severe recurrent depression - that in people who become suicidal when depressed.</p> <p>Trial Registration</p> <p>Current Controlled Trials: ISRCTN97185214.</p

Challenges Using Extrapolated Family-level Macroinvertebrate Metrics in Moderately Disturbed Tropical Streams: a Case-study From Belize

Family-level biotic metrics were originally designed to rapidly assess gross organic pollution effects, but came to be regarded as general measures of stream degradation. Improvements in water quality in developed countries have reignited debate about the limitations of family-level taxonomy to detect subtle change, and is resulting in a shift back towards generic and species-level analysis to assess smaller effects. Although the scale of pollution characterizing past condition of streams in developed countries persists in many developing regions, some areas are still considered to be only moderately disturbed. We sampled streams in Belize to investigate the ability of family-level macroinvertebrate metrics to detect change in stream catchments where less than 30% of forest had been cleared. Where disturbance did not co-vary with natural gradients of change, and in areas characterized by low intensity activities, none of the metrics tested detected significant change, despite evidence of environmental impacts. We highlight the need for further research to clarify the response of metrics to disturbance over a broader study area that allows replication for confounding sources of natural variation. We also recommend research to develop more detailed understanding of the taxonomy and ecology of Neotropical macroinvertebrates to improve the robustness of metric use

Zen meditation, Length of Telomeres, and the Role of Experiential Avoidance and Compassion

Mindfulness refers to an awareness that emerges by intentionally focusing on the present experience in a nonjudgmental or evaluative manner. Evidence regarding its efficacy has been increasing exponentially, and recent research suggests that the practice of meditation is associated with longer leukocyte telomere length. However, the psychological mechanisms underlying this potential relationship are unknown. We examined the telomere lengths of a group of 20 Zen meditation experts and another 20 healthy matched comparison participants who had not previously meditated. We also measured multiple psychological variables related to meditation practice. Genomic DNA was extracted for telomere measurement using a Life Length proprietary program. High-throughput quantitative fluorescence in situ hybridization (HT-Q-FISH) was used to measure the telomere length distribution and the median telomere length (MTL). The meditators group had a longer MTL (p = 0.005) and a lower percentage of short telomeres in individual cells (p = 0.007) than those in the comparison group. To determine which of the psychological variables contributed more to telomere maintenance, two regression analyses were conducted. In the first model, which applied to the MTL, the following three factors were significant: age, absence of experiential avoidance, and Common Humanity subscale of the Self Compassion Scale. Similarly, in the model that examined the percentage of short telomeres, the same factors were significant: age, absence of experiential avoidance, and Common Humanity subscale of the Self Compassion Scale. Although limited by a small sample size, these results suggest that the absence of experiential avoidance of negative emotions and thoughts is integral to the connection between meditation and telomeres