Many Labs 2: Investigating Variation in Replicability Across Samples and Settings

We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,305 participants from 36 countries and territories. Using the conventional criterion of statistical significance (p < .05), we found that 15 (54%) of the replications provided evidence of a statistically significant effect in the same direction as the original finding. With a strict significance criterion (p < .0001), 14 (50%) of the replications still provided such evidence, a reflection of the extremely highpowered design. Seven (25%) of the replications yielded effect sizes larger than the original ones, and 21 (75%) yielded effect sizes smaller than the original ones. The median comparable Cohen’s ds were 0.60 for the original findings and 0.15 for the replications. The effect sizes were small (< 0.20) in 16 of the replications (57%), and 9 effects (32%) were in the direction opposite the direction of the original effect. Across settings, the Q statistic indicated significant heterogeneity in 11 (39%) of the replication effects, and most of those were among the findings with the largest overall effect sizes; only 1 effect that was near zero in the aggregate showed significant heterogeneity according to this measure. Only 1 effect had a tau value greater than .20, an indication of moderate heterogeneity. Eight others had tau values near or slightly above .10, an indication of slight heterogeneity. Moderation tests indicated that very little heterogeneity was attributable to the order in which the tasks were performed or whether the tasks were administered in lab versus online. Exploratory comparisons revealed little heterogeneity between Western, educated, industrialized, rich, and democratic (WEIRD) cultures and less WEIRD cultures (i.e., cultures with relatively high and low WEIRDness scores, respectively). Cumulatively, variability in the observed effect sizes was attributable more to the effect being studied than to the sample or setting in which it was studied.UCR::Vicerrectoría de Investigación::Unidades de Investigación::Ciencias Sociales::Instituto de Investigaciones Psicológicas (IIP

Anxiety, depression and impaired health-related quality of life are therapeutic challenges in patients with multiple sclerosis

Anxiety, depression and impaired health-related quality of life (HRQoL) are commonly reported in patients with multiple sclerosis (MS) and are of great interest for therapeutic approaches. Based on regional differences a quantitative assessment of these factors in comparison to the general population, and the consideration of demographic cofactors, would be useful when designing specific interventions. We adopted such an approach in a German cohort of MS patients. Anxiety, depression (HADS) and HRQoL (SF-36) were measured in 49 consecutive outpatients with MS and compared to age- and gender-adjusted control groups (n=1330 for HADS; n=5087 for SF-36) extracted from German National Health Surveys. Patients with MS showed significantly increased levels of anxiety and depression as well as decreased HRQoL with the exception of mental health; the effect sizes ranged from 0.39 (depression) to 1.06 (physical functioning). As could be expected, MS patients with relapsing-remitting clinical course had better physical functioning than patients with secondary progressive MS. There were strong relations between anxiety and depression (r=0.54; P less than 0.01), and between neurological impairment (EDSS) and physical functioning (r=-0.80; P less than 0.001) as well as depression (r=0.48; P less than 0.05). This investigation of MS patients confirms the prevalence and impact of anxiety, depression and most of the HRQoL dimensions in MS patients and provides evidence for the usefulness of a quantitative comparison to a region-specific general population as a starting point for therapeutic approaches

Mental Illness 2010; volume 2:e5 Anxiety, depression and

impaired health-related quality of life are therapeutic challenges in patients with multiple sclerosi