Manipulating the alpha level cannot cure significance testing

We argue that making accept/reject decisions on scientific hypotheses, including a recent call for changing the canonical alpha level from p = 0.05 to p = 0.005, is deleterious for the finding of new discoveries and the progress of science. Given that blanket and variable alpha levels both are problematic, it is sensible to dispense with significance testing altogether. There are alternatives that address study design and sample size much more directly than significance testing does; but none of the statistical tools should be taken as the new magic method giving clear-cut mechanical answers. Inference should not be based on single studies at all, but on cumulative evidence from multiple independent studies. When evaluating the strength of the evidence, we should consider, for example, auxiliary assumptions, the strength of the experimental design, and implications for applications. To boil all this down to a binary decision based on a p-value threshold of 0.05, 0.01, 0.005, or anything else, is not acceptable

A Multi-Lab Test of the Facial Feedback Hypothesis by the Many Smiles Collaboration

Following theories of emotional embodiment, the facial feedback hypothesis suggests that individuals’ subjective experiences of emotion are influenced by their facial expressions. However, evidence for this hypothesis has been mixed. We thus formed a global adversarial collaboration and carried out a preregistered, multicentre study designed to specify and test the conditions that should most reliably produce facial feedback effects. Data from n = 3,878 participants spanning 19 countries indicated that a facial mimicry and voluntary facial action task could both amplify and initiate feelings of happiness. However, evidence of facial feedback effects was less conclusive when facial feedback was manipulated unobtrusively via a pen-in-mouth task

A multi-lab test of the facial feedback hypothesis by the Many Smiles Collaboration

Following theories of emotional embodiment, the facial feedback hypothesis suggests that individuals' subjective experiences of emotion are influenced by their facial expressions. However, evidence for this hypothesis has been mixed. We thus formed a global adversarial collaboration and carried out a preregistered, multicentre study designed to specify and test the conditions that should most reliably produce facial feedback effects. Data from n = 3,878 participants spanning 19 countries indicated that a facial mimicry and voluntary facial action task could both amplify and initiate feelings of happiness. However, evidence of facial feedback effects was less conclusive when facial feedback was manipulated unobtrusively via a pen-in-mouth task

DTT - Divertor Tokamak Test facility: A testbed for DEMO

The effective treatment of the heat and power exhaust is a critical issue in the road map to the realization of the fusion energy. In order to provide possible, reliable, well assessed and on-time answers to DEMO, the Divertor Tokamak Test facility (DTT) has been conceived and projected to be carried out and operated within the European strategy in fusion technology. This paper, based on the invited plenary talk at the 31st virtual SOFT Conference 2020, provides an overview of the DTT scientific proposal, which is deeply illustrated in the 2019 DTT Interim Design Report

DTT - Divertor Tokamak Test facility - Interim Design Report

The “Divertor Tokamak Test facility, DTT” is a milestone along the international program aimed at demonstrating – in the second half of this century – the feasibility of obtaining to commercial electricity from controlled thermonuclear fusion. DTT is a Tokamak conceived and designed in Italy with a broad international vision. The construction will be carried out in the ENEA Frascati site, mainly supported by national funds, complemented by EUROfusion and European incentive schemes for innovative investments. The project team includes more than 180 high-standard researchers from ENEA, CREATE, CNR, INFN, RFX and various universities. The volume, entitled DTT Interim Design Report (“Green Book” from the colour of the cover), briefly describes the status of the project, the planning of the design future activities and its organizational structure. The publication of the Green Book also provides an occasion for thorough discussions in the fusion community and a broad international collaboration on the DTT challenge

Crowdsourcing hypothesis tests: Making transparent how design choices shape research results

To what extent are research results influenced by subjective decisions that scientists make as they design studies? Fifteen research teams independently designed studies to answer fiveoriginal research questions related to moral judgments, negotiations, and implicit cognition. Participants from two separate large samples (total N > 15,000) were then randomly assigned to complete one version of each study. Effect sizes varied dramatically across different sets of materials designed to test the same hypothesis: materials from different teams renderedstatistically significant effects in opposite directions for four out of five hypotheses, with the narrowest range in estimates being d = -0.37 to +0.26. Meta-analysis and a Bayesian perspective on the results revealed overall support for two hypotheses, and a lack of support for three hypotheses. Overall, practically none of the variability in effect sizes was attributable to the skill of the research team in designing materials, while considerable variability was attributable to the hypothesis being tested. In a forecasting survey, predictions of other scientists were significantly correlated with study results, both across and within hypotheses. Crowdsourced testing of research hypotheses helps reveal the true consistency of empirical support for a scientific claim.</div

More Than Smell - COVID-19 Is Associated With Severe Impairment of Smell,Taste, and Chemesthesis

Recent anecdotal and scientific reports have provided evidence of a link between COVID-19 and chemosensory impairments, such as anosmia. However, these reports have downplayed or failed to distinguish potential effects on taste, ignored chemesthesis, and generally lacked quantitative measurements. Here, we report the development, implementation, and initial results of a multilingual, international questionnaire to assess self-reported quantity and quality of perception in 3 distinct chemosensory modalities (smell, taste, and chemesthesis) before and during COVID-19. In the first 11 days after questionnaire launch, 4039 participants (2913 women, 1118 men, and 8 others, aged 19-79) reported a COVID-19 diagnosis either via laboratory tests or clinical assessment. Importantly, smell, taste, and chemesthetic function were each significantly reduced compared to their status before the disease. Difference scores (maximum possible change +/- 100) revealed a mean reduction of smell (-79.7 +/- 28.7, mean +/- standard deviation), taste (-69.0 +/- 32.6), and chemesthetic (-37.3 +/- 36.2) function during COVID-19. Qualitative changes in olfactory ability (parosmia and phantosmia) were relatively rare and correlated with smell loss. Importantly, perceived nasal obstruction did not account for smell loss. Furthermore, chemosensory impairments were similar between participants in the laboratory test and clinical assessment groups. These results show that COVID-19-associated chemosensory impairment is not limited to smell but also affects taste and chemesthesis.The multimodal impact of COVID-19 and the lack of perceived nasal obstruction suggest that severe acute respiratory syndrome coronavirus strain 2 (SARS-CoV-2) infection may disrupt sensory-neural mechanisms

Changes in social norms during the early stages of the COVID-19 pandemic across 43 countries

Data availability: The data generated in this study have been deposited in the Open Science Framework (https://doi.org/10.17605/OSF.IO/STKFR). Non-experimental data included in our datasets (i.e., intensity of government response to COVID-19 is the Stringency Index, COVID-19 deaths and cases per million) are taken from the Oxford COVID−19 Government Response Tracker [22 Hale, T. et al. A global panel database of pandemic policies (Oxford COVID−19 Government Response Tracker). Nat. Human Behav. https://doi.org/10.1038/s41562-021-01079-8 (2021).] and Our World in Data [38 Ritchie, H. et al. Coronavirus Pandemic (COVID-19). Our World in Data. https://ourworldindata.org/coronavirus (2020).] (downloaded November 2020). Wave 0 data are from [3 Gelfand, M. J. et al. Differences between tight and loose cultures: a 33-nation study. Science 332, 1100–1104 (2011).[ and Wave 1 data are from [5 Eriksson, K. et al. Perceptions of the appropriate response to norm violation in 57 societies. Nat. Commun. 12, 1481 (2021).].Code availability: The survey and analysis code are available at the Open Science Framework (https://doi.org/10.17605/OSF.IO/STKFR).Supplementary information is available online at: https://www.nature.com/articles/s41467-024-44999-5#Sec40 .The emergence of COVID-19 dramatically changed social behavior across societies and contexts. Here we study whether social norms also changed. Specifically, we study this question for cultural tightness (the degree to which societies generally have strong norms), specific social norms (e.g. stealing, hand washing), and norms about enforcement, using survey data from 30,431 respondents in 43 countries recorded before and in the early stages following the emergence of COVID-19. Using variation in disease intensity, we shed light on the mechanisms predicting changes in social norm measures. We find evidence that, after the emergence of the COVID-19 pandemic, hand washing norms increased while tightness and punishing frequency slightly decreased but observe no evidence for a robust change in most other norms. Thus, at least in the short term, our findings suggest that cultures are largely stable to pandemic threats except in those norms, hand washing in this case, that are perceived to be directly relevant to dealing with the collective threat.Knut and Wallenberg Grant “How do human norms form and change?” 2016.0167. (G.An.). The Swedish Research Council grant “Norms & Risk: Do social norms help dealing with collective threats” 2021-06271 (G.An.). Ministero dell’Istruzione dell’Università e della Ricerca, PRIN 2017, prot. 20178TRM3F (D.B.). Universidad de Los Andes, Fondo Vicerrectoría de Investigaciones (J.-C.C.). Ministry of Innovation and Technology of Hungary, National Research, Development and Innovation Fund NKFIH-OTKA K135963 (M.F.). Grant 23-061770 S of the Czech Science Foundation (M.H. and S.G.). RVO: 68081740 of the Institute of Psychology, Czech Academy of Sciences (M.H. and S.G.). RA Science Committee, research project N.20TTSH-070 (A.Gr. and N.Khac.). Open University of Israel, 511687 (R.N.). HSE University Basic Research Program (E.O.). Project BASIC (PID2022-141802NB-I00) funded by MCIN/AEI/10.13039/501100011033 and by “ERDF A way of making Europe” (A.Sá.). US Army Research Office Grant W911NF-19-1-910281 (B.S.). Netherlands Organisation for Scientific Research, 019.183SG.001 (E.S.). Netherlands Organisation for Scientific Research, VI.Veni.201 G.013 (E.S.). European Commission, Horizon 2020-ID 870827 (E.S.). UKRI Grant “Secret Power” No. EP/X02170X/1 awarded under the European Commission’s “European Research Council - STG” Scheme (G.A.T.)