Many Labs 2: Investigating Variation in Replicability Across Samples and Settings

We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,305 participants from 36 countries and territories. Using the conventional criterion of statistical significance (p < .05), we found that 15 (54%) of the replications provided evidence of a statistically significant effect in the same direction as the original finding. With a strict significance criterion (p < .0001), 14 (50%) of the replications still provided such evidence, a reflection of the extremely high-powered design. Seven (25%) of the replications yielded effect sizes larger than the original ones, and 21 (75%) yielded effect sizes smaller than the original ones. The median comparable Cohen’s ds were 0.60 for the original findings and 0.15 for the replications. The effect sizes were small (< 0.20) in 16 of the replications (57%), and 9 effects (32%) were in the direction opposite the direction of the original effect. Across settings, the Q statistic indicated significant heterogeneity in 11 (39%) of the replication effects, and most of those were among the findings with the largest overall effect sizes; only 1 effect that was near zero in the aggregate showed significant heterogeneity according to this measure. Only 1 effect had a tau value greater than .20, an indication of moderate heterogeneity. Eight others had tau values near or slightly above .10, an indication of slight heterogeneity. Moderation tests indicated that very little heterogeneity was attributable to the order in which the tasks were performed or whether the tasks were administered in lab versus online. Exploratory comparisons revealed little heterogeneity between Western, educated, industrialized, rich, and democratic (WEIRD) cultures and less WEIRD cultures (i.e., cultures with relatively high and low WEIRDness scores, respectively). Cumulatively, variability in the observed effect sizes was attributable more to the effect being studied than to the sample or setting in which it was studied

Many Labs 2: Investigating Variation in Replicability Across Samples and Settings

We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,305 participants from 36 countries and territories. Using the conventional criterion of statistical significance (p < .05), we found that 15 (54%) of the replications provided evidence of a statistically significant effect in the same direction as the original finding. With a strict significance criterion (p < .0001), 14 (50%) of the replications still provided such evidence, a reflection of the extremely high-powered design. Seven (25%) of the replications yielded effect sizes larger than the original ones, and 21 (75%) yielded effect sizes smaller than the original ones. The median comparable Cohen’s ds were 0.60 for the original findings and 0.15 for the replications. The effect sizes were small (< 0.20) in 16 of the replications (57%), and 9 effects (32%) were in the direction opposite the direction of the original effect. Across settings, the Q statistic indicated significant heterogeneity in 11 (39%) of the replication effects, and most of those were among the findings with the largest overall effect sizes; only 1 effect that was near zero in the aggregate showed significant heterogeneity according to this measure. Only 1 effect had a tau value greater than .20, an indication of moderate heterogeneity. Eight others had tau values near or slightly above .10, an indication of slight heterogeneity. Moderation tests indicated that very little heterogeneity was attributable to the order in which the tasks were performed or whether the tasks were administered in lab versus online. Exploratory comparisons revealed little heterogeneity between Western, educated, industrialized, rich, and democratic (WEIRD) cultures and less WEIRD cultures (i.e., cultures with relatively high and low WEIRDness scores, respectively). Cumulatively, variability in the observed effect sizes was attributable more to the effect being studied than to the sample or setting in which it was studied

Many Labs 2: Investigating Variation in Replicability Across Samples and Settings

We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,305 participants from 36 countries and territories. Using the conventional criterion of statistical significance (p < .05), we found that 15 (54%) of the replications provided evidence of a statistically significant effect in the same direction as the original finding. With a strict significance criterion (p < .0001), 14 (50%) of the replications still provided such evidence, a reflection of the extremely high-powered design. Seven (25%) of the replications yielded effect sizes larger than the original ones, and 21 (75%) yielded effect sizes smaller than the original ones. The median comparable Cohen’s ds were 0.60 for the original findings and 0.15 for the replications. The effect sizes were small (< 0.20) in 16 of the replications (57%), and 9 effects (32%) were in the direction opposite the direction of the original effect. Across settings, the Q statistic indicated significant heterogeneity in 11 (39%) of the replication effects, and most of those were among the findings with the largest overall effect sizes; only 1 effect that was near zero in the aggregate showed significant heterogeneity according to this measure. Only 1 effect had a tau value greater than .20, an indication of moderate heterogeneity. Eight others had tau values near or slightly above .10, an indication of slight heterogeneity. Moderation tests indicated that very little heterogeneity was attributable to the order in which the tasks were performed or whether the tasks were administered in lab versus online. Exploratory comparisons revealed little heterogeneity between Western, educated, industrialized, rich, and democratic (WEIRD) cultures and less WEIRD cultures (i.e., cultures with relatively high and low WEIRDness scores, respectively). Cumulatively, variability in the observed effect sizes was attributable more to the effect being studied than to the sample or setting in which it was studied

Intravenous immunoglobulin treatment for mild Guillain-Barré syndrome. An international observational study

Objective: To compare the disease course in patients with mild Guillain-Barré syndrome (GBS) who were treated with intravenous immunoglobulin (IVIg) or supportive care only. Methods: We selected patients from the prospective observational International GBS Outcome Study (IGOS) who were able to walk independently at study entry (mild GBS), treated with one IVIg course or supportive care. The primary endpoint was the GBS disability score four weeks after study entry, assessed by multivariable ordinal regression analysis. Results: Of 188 eligible patients, 148 (79%) were treated with IVIg and 40 (21%) with supportive care. The IVIg group was more disabled at baseline. IVIg treatment was not associated with lower GBS disability scores at 4 weeks (adjusted OR (aOR) 1.62, 95% CI 0.63 to 4.13). Nearly all secondary endpoints showed no benefit from IVIg, although the time to regain full muscle strength was shorter (28 vs 56 days, p=0.03) and reported pain at 26 weeks was lower (n=26/121, 22% vs n=12/30, 40%, p=0.04) in the IVIg treated patients. In the subanalysis with persistent mild GBS in the first 2 weeks, the aOR for a lower GBS disability score at 4 weeks was 2.32 (95% CI 0.76 to 7.13). At 1 year, 40% of all patients had residual symptoms. Conclusion: In patients with mild GBS, one course of IVIg did not improve the overall disease course. The certainty of this conclusion is limited by confounding factors, selection bias and wide confidence limits. Residual symptoms were often present after one year, indicating the need for better treatments in mild GBS

Next-generation ARIA care pathways for rhinitis and asthma: a model for multimorbid chronic diseases

Abstract Background In all societies, the burden and cost of allergic and chronic respiratory diseases are increasing rapidly. Most economies are struggling to deliver modern health care effectively. There is a need to support the transformation of the health care system into integrated care with organizational health literacy. Main body As an example for chronic disease care, MASK (Mobile Airways Sentinel NetworK), a new project of the ARIA (Allergic Rhinitis and its Impact on Asthma) initiative, and POLLAR (Impact of Air POLLution on Asthma and Rhinitis, EIT Health), in collaboration with professional and patient organizations in the field of allergy and airway diseases, are proposing real-life ICPs centred around the patient with rhinitis, and using mHealth to monitor environmental exposure. Three aspects of care pathways are being developed: (i) Patient participation, health literacy and self-care through technology-assisted “patient activation”, (ii) Implementation of care pathways by pharmacists and (iii) Next-generation guidelines assessing the recommendations of GRADE guidelines in rhinitis and asthma using real-world evidence (RWE) obtained through mobile technology. The EU and global political agendas are of great importance in supporting the digital transformation of health and care, and MASK has been recognized by DG Santé as a Good Practice in the field of digitally-enabled, integrated, person-centred care. Conclusion In 20 years, ARIA has considerably evolved from the first multimorbidity guideline in respiratory diseases to the digital transformation of health and care with a strong political involvement

Next-generation ARIA care pathways for rhinitis and asthma: a model for multimorbid chronic diseases

Abstract Background In all societies, the burden and cost of allergic and chronic respiratory diseases are increasing rapidly. Most economies are struggling to deliver modern health care effectively. There is a need to support the transformation of the health care system into integrated care with organizational health literacy. Main body As an example for chronic disease care, MASK (Mobile Airways Sentinel NetworK), a new project of the ARIA (Allergic Rhinitis and its Impact on Asthma) initiative, and POLLAR (Impact of Air POLLution on Asthma and Rhinitis, EIT Health), in collaboration with professional and patient organizations in the field of allergy and airway diseases, are proposing real-life ICPs centred around the patient with rhinitis, and using mHealth to monitor environmental exposure. Three aspects of care pathways are being developed: (i) Patient participation, health literacy and self-care through technology-assisted “patient activation”, (ii) Implementation of care pathways by pharmacists and (iii) Next-generation guidelines assessing the recommendations of GRADE guidelines in rhinitis and asthma using real-world evidence (RWE) obtained through mobile technology. The EU and global political agendas are of great importance in supporting the digital transformation of health and care, and MASK has been recognized by DG Santé as a Good Practice in the field of digitally-enabled, integrated, person-centred care. Conclusion In 20 years, ARIA has considerably evolved from the first multimorbidity guideline in respiratory diseases to the digital transformation of health and care with a strong political involvement