Crowdsourcing hypothesis tests: making transparent how design choices shape research results

To what extent are research results influenced by subjective decisions that scientists make as they design studies? Fifteen research teams independently designed studies to answer five original research questions related to moral judgments, negotiations, and implicit cognition. Participants from 2 separate large samples (total N > 15,000) were then randomly assigned to complete 1 version of each study. Effect sizes varied dramatically across different sets of materials designed to test the same hypothesis: Materials from different teams rendered statistically significant effects in opposite directions for 4 of 5 hypotheses, with the narrowest range in estimates being d = -0.37 to + 0.26. Meta-analysis and a Bayesian perspective on the results revealed overall support for 2 hypotheses and a lack of support for 3 hypotheses. Overall, practically none of the variability in effect sizes was attributable to the skill of the research team in designing materials, whereas considerable variability was attributable to the hypothesis being tested. In a forecasting survey, predictions of other scientists were significantly correlated with study results, both across and within hypotheses. Crowdsourced testing of research hypotheses helps reveal the true consistency of empirical support for a scientific claim.info:eu-repo/semantics/submittedVersio

A European research agenda for somatic symptom disorders, bodily distress disorders, and functional disorders: Results of an estimate-talk-estimate delphi expert study

Background: Somatic Symptom Disorders (SSD), Bodily Distress Disorders (BDD) and functional disorders (FD) are associated with high medical and societal costs and pose a substantial challenge to the population and health policy of Europe. To meet this challenge, a specific research agenda is needed as one of the cornerstones of sustainable mental health research and health policy for SSD, BDD, and FD in Europe. Aim: To identify the main challenges and research priorities concerning SSD, BDD, and FD from a European perspective. Methods: Delphi study conducted from July 2016 until October 2017 in 3 rounds with 3 workshop meetings and 3 online surveys, involving 75 experts and 21 European countries. EURONET-SOMA and the European Association of Psychosomatic Medicine (EAPM) hosted the meetings. Results: Eight research priorities were identified: (1) Assessment of diagnostic profiles relevant to course and treatment outcome. (2) Development and evaluation of new, effective interventions. (3) Validation studies on questionnaires or semi-structured interviews that assess chronic medical conditions in this context. (4) Research into patients preferences for diagnosis and treatment. (5) Development of new methodologic designs to identify and explore mediators and moderators of clinical course and treatment outcomes (6). Translational research exploring how psychological and somatic symptoms develop from somatic conditions and biological and behavioral pathogenic factors. (7) Development of new, effective interventions to personalize treatment. (8) Implementation studies of treatment interventions in different settings, such as primary care, occupational care, general hospital and specialty mental health settings. The general public and policymakers will benefit from the development of new, effective, personalized interventions for SSD, BDD, and FD, that will be enhanced by translational research, as well as from the outcomes of research into patient involvement, GP-patient communication, consultation-liaison models and implementation. Conclusion: Funding for this research agenda, targeting these challenges in coordinated research networks such as EURONET-SOMA and EAPM, and systematically allocating resources by policymakers to this critical area in mental and physical well-being is urgently needed to improve efficacy and impact for diagnosis and treatment of SSD, BDD, and FD across Europe