Crowdsourcing hypothesis tests: Making transparent how design choices shape research results

To what extent are research results influenced by subjective decisions that scientists make as they design studies? Fifteen research teams independently designed studies to answer fiveoriginal research questions related to moral judgments, negotiations, and implicit cognition. Participants from two separate large samples (total N > 15,000) were then randomly assigned to complete one version of each study. Effect sizes varied dramatically across different sets of materials designed to test the same hypothesis: materials from different teams renderedstatistically significant effects in opposite directions for four out of five hypotheses, with the narrowest range in estimates being d = -0.37 to +0.26. Meta-analysis and a Bayesian perspective on the results revealed overall support for two hypotheses, and a lack of support for three hypotheses. Overall, practically none of the variability in effect sizes was attributable to the skill of the research team in designing materials, while considerable variability was attributable to the hypothesis being tested. In a forecasting survey, predictions of other scientists were significantly correlated with study results, both across and within hypotheses. Crowdsourced testing of research hypotheses helps reveal the true consistency of empirical support for a scientific claim.</div

A global experiment on motivating social distancing during the COVID-19 pandemic

Finding communication strategies that effectively motivate social distancing continues to be a global public health priority during the COVID-19 pandemic. This cross-country, preregistered experiment (n = 25,718 from 89 countries) tested hypotheses concerning generalizable positive and negative outcomes of social distancing messages that promoted personal agency and reflective choices (i.e., an autonomy-supportive message) or were restrictive and shaming (i.e., a controlling message) compared with no message at all. Results partially supported experimental hypotheses in that the controlling message increased controlled motivation (a poorly internalized form of motivation relying on shame, guilt, and fear of social consequences) relative to no message. On the other hand, the autonomy-supportive message lowered feelings of defiance compared with the controlling message, but the controlling message did not differ from receiving no message at all. Unexpectedly, messages did not influence autonomous motivation (a highly internalized form of motivation relying on one’s core values) or behavioral intentions. Results supported hypothesized associations between people’s existing autonomous and controlled motivations and self-reported behavioral intentions to engage in social distancing. Controlled motivation was associated with more defiance and less long-term behavioral intention to engage in social distancing, whereas autonomous motivation was associated with less defiance and more short- and long-term intentions to social distance. Overall, this work highlights the potential harm of using shaming and pressuring language in public health communication, with implications for the current and future global health challenges

Religiosity and Spirituality as Predictors of Subjectively Perceived Happiness in University Students in Slovakia

Several research projects discuss the existence of weak to moderately strong positive relation between religiosity/spirituality on the one hand and subjective well-being, life satisfaction or quality of life on the other hand (see Kelley & Miller, 2007). Variables related to religiosity and spirituality of a person may be perceived in two ways: as protective factors of attaining subjective well-being or as barriers limiting its attainment. The objective of this study is verification of mutual relationship between the indicators of religiosity and spirituality with regard to subjectively perceived happiness and verification of predictive strength of these indicators with regard to subjective happiness. The sample of research participants consisted of 194 university students aged 18 to 26. The research used 4 tools: The Expressions of Spirituality Inventory-Revised (MacDonald, 2000), The Salience in Religious Commitment Scale (Roof & Perkins, 1975), Subjective Happiness Scale (Lyubomirsky & Lepper, 1999) and The Oxford Happiness Questionnaire (Hills & Argyle, 2002). Using multiple hierarchical linear regression (stepwise), we obtained 2 dimensions of spirituality as significant predictors of subjective happiness – Existential Well-Being and Experiential/Phenomenological Dimension. Demographic data and confession types were not proved as predictors of happiness

Moral orientation from the psychological perspective -- an aspect of moral reasoning

The issue of morality does not represent a dominant topic of the current psychological research, although the interest of predominantly social psychologist in understanding the processes that are behind reasoning of people with respect to moral issues and explaining moral or immoral behaviour can not be denied. The submitted study presents a brief introduction of basic psychological concepts dealing with morality emphasizing the specific notion of moral orientation. The orientation to justice or to care when solving moral dilemmas is known in literature under the term the moral orientation. Gilligan can see the cause of differences in moral orientation in gender differences acquired during the process of socialization. A psychological approach provides many useful explanation of how thinking of people with respect to moral issues is pursued. The actual psychology of morality is mainly based on cognitivistic theories coming out of conceptions of Piaget and Kohlberg. They interconnected approaches isolated and focused on intentions by that time and emphasized importance of a constitutional conditioning of moral judgment. The attention was aimed to judgment processes having an adequate level of cognitive development as an indispensable (even if not sufficient) condition. An important contribution of cognitivists is based also on a rich professional discussion that they invoked. Supporters of cognitivistic scheme “neokohlbergians” or its criticisers revise and amend the basic Kohlberg`s model in such aspects as relativizing of a primary role of cognitions as a sole aspect of the moral decision making, emphasize the significance of concept, situations, type of solved dilemma, influence of conventions, point out the differences in solving hypothetical dilemmas and dilemmas of everyday life etc

Risk and protective factors for (internet) gaming disorder : A meta-analysis of pre-COVID studies

This large-scale meta-analysis aimed to provide the most comprehensive synthesis to date of the available evidence from the pre-COVID period on risk and protective factors for (internet) gaming disorder (as defined in the DSM-5 or ICD-11) across all studied populations. The risk/protective factors included demographic characteristics, psychological, psychopathological, social, and gaming-related factors. In total, we have included 1586 effects from 253 different studies, summarizing data from 210557 participants. Apart from estimating these predictive associations and relevant moderating effects, we implemented state-of-the-art adjustments for publication bias, psychometric artifacts, and other forms of bias arising from the publication process. Additionally, we carried out an in-depth assessment of the quality of underlying evidence by examining indications of selective reporting, statistical inconsistencies, the typical power of utilized study designs to detect theoretically relevant effects, and performed various sensitivity analyses. The available evidence suggests the existence of numerous moderately strong and highly heterogeneous risk factors (e.g., male gender, depression, impulsivity, anxiety, stress, gaming time, escape motivation, or excessive use of social networks) but only a few empirically robust protective factors (self-esteem, intelligence, life satisfaction, and education; all having markedly smaller effect sizes). We discuss the theoretical implications of our results for prominent theoretical models of gaming disorder and for the existing and future prevention strategies. The impact of various examined biasing factors on the available evidence seemed to be modest, yet we identified shortcomings in the measurement and reporting practices.peerReviewe

Novel Insights into the Effect of Hyperforin and Photodynamic Therapy with Hypericin on Chosen Angiogenic Factors in Colorectal Micro-Tumors Created on Chorioallantoic Membrane

Photodynamic therapy with hypericin (HY-PDT) and hyperforin (HP) could be treatment modalities for colorectal cancer (CRC), but evidence of their effect on angiogenic factors in CRC is missing. Convenient experimental model utilization is essential for angiogenesis research. Therefore, not only 2D cell models, but also 3D cell models and micro-tumors were used and compared. The micro-tumor extent and interconnection with the chorioallantoic membrane (CAM) was determined by histological analyses. The presence of proliferating cells and HY penetration into the tumor mass were detected by fluorescence microscopy. The metabolic activity status was assessed by an colorimetric assay for assessing cell metabolic activity (MTT assay) and HY accumulation was determined by flow cytometry. Pro-angiogenic factor expression was determined by Western blot and quantitative real-time polymerase chain reaction (RT-qPCR). We confirmed the cytotoxic effect of HY-PDT and HP and showed that their effect is influenced by structural characteristics of the experimental model. We have pioneered a method for analyzing the effect of HP and cellular targeted HY-PDT on pro-angiogenic factor expression in CRC micro-tumors. Despite the inhibitory effect of HY-PDT and HP on CRC, the increased expression of some pro-angiogenic factors was observed. We also showed that CRC experimental micro-tumors created on quail CAM could be utilized for analyses of gene and protein expression

To which world regions does the valence-dominance model of social perception apply?

Over the past 10 years, Oosterhof and Todorov’s valence–dominance model has emerged as the most prominent account of how people evaluate faces on social dimensions. In this model, two dimensions (valence and dominance) underpin social judgements of faces. Because this model has primarily been developed and tested in Western regions, it is unclear whether these findings apply to other regions. We addressed this question by replicating Oosterhof and Todorov’s methodology across 11 world regions, 41 countries and 11,570 participants. When we used Oosterhof and Todorov’s original analysis strategy, the valence–dominance model generalized across regions. When we used an alternative methodology to allow for correlated dimensions, we observed much less generalization. Collectively, these results suggest that, while the valence–dominance model generalizes very well across regions when dimensions are forced to be orthogonal, regional differences are revealed when we use different extraction methods and correlate and rotate the dimension reduction solution

To Which World Regions Does the Valence-Dominance Model of Social Perception Apply?

Over the past 10 years, Oosterhof and Todorov’s valence–dominance model has emerged as the most prominent account of how people evaluate faces on social dimensions. In this model, two dimensions (valence and dominance) underpin social judgements of faces. Because this model has primarily been developed and tested in Western regions, it is unclear whether these findings apply to other regions. We addressed this question by replicating Oosterhof and Todorov’s methodology across 11 world regions, 41 countries and 11,570 participants. When we used Oosterhof and Todorov’s original analysis strategy, the valence–dominance model generalized across regions. When we used an alternative methodology to allow for correlated dimensions, we observed much less generalization. Collectively, these results suggest that, while the valence–dominance model generalizes very well across regions when dimensions are forced to be orthogonal, regional differences are revealed when we use different extraction methods and correlate and rotate the dimension reduction solution

Crowdsourcing hypothesis tests: making transparent how design choices shape research results

To what extent are research results influenced by subjective decisions that scientists make as they design studies? Fifteen research teams independently designed studies to answer five original research questions related to moral judgments, negotiations, and implicit cognition. Participants from two separate large samples (total N > 15,000) were then randomly assigned to complete one version of each study. Effect sizes varied dramatically across different sets of materials designed to test the same hypothesis: materials from different teams rendered statistically significant effects in opposite directions for four out of five hypotheses, with the narrowest range in estimates being d = -0.37 to +0.26. Meta-analysis and a Bayesian perspective on the results revealed overall support for two hypotheses, and a lack of support for three hypotheses. Overall, practically none of the variability in effect sizes was attributable to the skill of the research team in designing materials, while considerable variability was attributable to the hypothesis being tested. In a forecasting survey, predictions of other scientists were significantly correlated with study results, both across and within hypotheses. Crowdsourced testing of research hypotheses helps reveal the true consistency of empirical support for a scientific claim