Crowdsourcing hypothesis tests: Making transparent how design choices shape research results

To what extent are research results influenced by subjective decisions that scientists make as they design studies? Fifteen research teams independently designed studies to answer fiveoriginal research questions related to moral judgments, negotiations, and implicit cognition. Participants from two separate large samples (total N > 15,000) were then randomly assigned to complete one version of each study. Effect sizes varied dramatically across different sets of materials designed to test the same hypothesis: materials from different teams renderedstatistically significant effects in opposite directions for four out of five hypotheses, with the narrowest range in estimates being d = -0.37 to +0.26. Meta-analysis and a Bayesian perspective on the results revealed overall support for two hypotheses, and a lack of support for three hypotheses. Overall, practically none of the variability in effect sizes was attributable to the skill of the research team in designing materials, while considerable variability was attributable to the hypothesis being tested. In a forecasting survey, predictions of other scientists were significantly correlated with study results, both across and within hypotheses. Crowdsourced testing of research hypotheses helps reveal the true consistency of empirical support for a scientific claim.</div

GALAD Score Detects Early-Stage Hepatocellular Carcinoma in a European Cohort of Chronic Hepatitis B and C Patients

Despite vaccination programs and direct antiviral treatments, the incidence of virus-related hepatocellular carcinoma (HCC) remains high, while ultrasound-based detection rates for early-stage HCC is continuously low. To address this insufficiency, we set out to characterize whether the GALAD score, which incorporates gender, age, and serum levels of AFP, AFP isoform L3 (AFP-L3), and des-gamma-carboxy-prothrombin (DCP), can improve early-stage HCC detection in a Caucasian HBV/HCV cohort. In a retrospective German single-center study, 182 patients with HBV, 223 with HCV and 168 with other etiology (OE) of chronic liver disease (CLD) were enrolled. HCC was confirmed in 52 HBV, 84 HCV and 60 OE CLD patients. The diagnostic performance of the single biomarkers in HCC detection was compared to the GALAD model. At initial diagnosis, most patients were at (very) early BCLC 0 (n = 14/7%) or A (n = 56/29%) or intermediate stage BCLC B (n = 93/47%) HCC in all three subgroups. In the BCLC 0/A cohort, GALAD exhibited an AUC of 0.94 discriminating HCC from non-HCC, surpassing AFP (AUC 0.86), AFP-L3 (AUC 0.83) and DCP (AUC 0.83). In the HBV population, GALAD achieved an AUC of 0.96, in HCV an AUC of 0.98 and in OE an AUC of 0.99, clearly superior to the biomarkers alone. Furthermore, in HCV patients GALAD showed a significantly higher specificity (89%) versus AFP (64%) alone. In chronic viral hepatitis, the GALAD model showed superior performance in detection of early-stage HCC, while exhibiting higher specificity in HCV patients compared to AFP alone. We conclude that the GALAD score shows potential for HCC surveillance in Caucasian HBV/HCV patients.</jats:p