Are Small Effects the Indispensable Foundation for a Cumulative Psychological Science? A Reply to Götz et al. (2022)

In the January 2022 issue of Perspectives, Götz et al. argued that small effects are “the indispensable foundation for a cumulative psychological science.” They supported their argument by claiming that (a) psychology, like genetics, consists of complex phenomena explained by additive small effects; (b) psychological-research culture rewards large effects, which means small effects are being ignored; and (c) small effects become meaningful at scale and over time. We rebut these claims with three objections: First, the analogy between genetics and psychology is misleading; second, p values are the main currency for publication in psychology, meaning that any biases in the literature are (currently) caused by pressure to publish statistically significant results and not large effects; and third, claims regarding small effects as important and consequential must be supported by empirical evidence or, at least, a falsifiable line of reasoning. If accepted uncritically, we believe the arguments of Götz et al. could be used as a blanket justification for the importance of any and all “small” effects, thereby undermining best practices in effect-size interpretation. We end with guidance on evaluating effect sizes in relative, not absolute, terms

You ≠ Me: Individual differences in the structure of social cognition

This study investigated the structure of social cognition, and how it is influenced by personality; specifically, how various socio-cognitive capabilities, and the pattern of inter-relationships and co-dependencies among them differ between divergent personality styles. To measure social cognition, a large non-clinical sample (n = 290) undertook an extensive battery of self-report and performance-based measures of visual perspective taking, imitative tendencies, affective empathy, interoceptive accuracy, emotion regulation, and state affectivity. These same individuals then completed the Personality Styles and Disorders Inventory. Latent Profile Analysis revealed two dissociable personality profiles that exhibited contrasting cognitive and affective dispositions, and multivariate analyses indicated further that these profiles differed on measures of social cognition; individuals characterised by a flexible and adaptive personality profile expressed higher action orientation (emotion regulation) compared to those showing more inflexible tendencies, along with better visual perspective taking, superior interoceptive accuracy, less imitative tendencies, and lower personal distress and negativity. These characteristics point towards more efficient self-other distinction, and to higher cognitive control more generally. Moreover, low-level cognitive mechanisms served to mediate other higher level socio-emotional capabilities. Together, these findings elucidate the cognitive and affective underpinnings of individual differences in social behaviour, providing a data-driven model that should guide future research in this area

A registered report survey of open research practices in psychology departments in the UK and Ireland

YesOpen research practices seek to enhance the transparency and reproducibility of research. Whilst there is evidence of increased uptake in these practices, such as study preregistration and open data, facilitated by new infrastructure and policies, little research has assessed general uptake of such practices across psychology university researchers. The current study estimates psychologists’ level of engagement in open research practices across universities in the United Kingdom and Ireland, while also assessing possible explanatory factors that may impact their engagement. Data were collected from 602 psychology researchers in the UK and Ireland on the extent to which they have implemented various practices (e.g., use of preprints, preregistration, open data, open materials). Here we present the summarised descriptive results, as well as considering differences between various categories of researcher (e.g., career stage, subdiscipline, methodology), and examining the relationship between researcher’s practices and their self-reported capability, opportunity, and motivation (COM-B) to engage in open research practices. Results show that while there is considerable variability in engagement of open research practices, differences across career stage and subdiscipline of psychology are small by comparison. We observed consistent differences according to respondent’s research methodology and based on the presence of institutional support for open research. COM-B dimensions were collectively significant predictors of engagement in open research, with automatic motivation emerging as a consistently strong predictor. We discuss these findings, outline some of the challenges experienced in this study, and offer suggestions and recommendations for future research. Estimating the prevalence of responsible research practices is important to assess sustained behaviour change in research reform, tailor educational training initiatives, and to understand potential factors that might impact engagement.Research funding: Aston University. Article funding: Open access funding provided by IReL

The replication crisis has led to positive structural, procedural, and community changes

The emergence of large-scale replication projects yielding successful rates substantially lower than expected caused the behavioural, cognitive, and social sciences to experience a so-called ‘replication crisis’. In this Perspective, we reframe this ‘crisis’ through the lens of a credibility revolution, focusing on positive structural, procedural and community-driven changes. Second, we outline a path to expand ongoing advances and improvements. The credibility revolution has been an impetus to several substantive changes which will have a positive, long-term impact on our research environment.Social decision makin

Embedding open and reproducible science into teaching: A bank of lesson plans and resources

Recently, there has been a growing emphasis on embedding open and reproducible approaches into research. One essential step in accomplishing this larger goal is to embed such practices into undergraduate and postgraduate research training. However, this often requires substantial time and resources to implement. Also, while many pedagogical resources are regularly developed for this purpose, they are not often openly and actively shared with the wider community. The creation and public sharing of open educational resources is useful for educators who wish to embed open scholarship and reproducibility into their teaching and learning. In this article, we describe and openly share a bank of teaching resources and lesson plans on the broad topics of open scholarship, open science, replication, and reproducibility that can be integrated into taught courses, to support educators and instructors. These resources were created as part of the Society for the Improvement of Psychological Science (SIPS) hackathon at the 2021 Annual Conference, and we detail this collaborative process in the article. By sharing these open pedagogical resources, we aim to reduce the labour required to develop and implement open scholarship content to further the open scholarship and open educational materials movement

Two photons into \pi^0\pi^0

We perform a theoretical study based on dispersion relations of the reaction \gamma\gamma\to \pi^0\pi^0 emphasizing the low energy region. We discuss how the f_0(980) signal emerges in \gamma\gamma\to \pi\pi within the dispersive approach and how this fixes to a large extent the phase of the isoscalar S-wave \gamma\gamma\to \pi\pi amplitude above the K\bar{K} threshold. This allows us to make sharper predictions for the cross section at lower energies and our results could then be used to distinguish between different \pi\pi isoscalar S-wave parameterizations with the advent of new precise data on \gamma\gamma\to\pi^0\pi^0. We compare our dispersive approach with an updated calculation employing Unitary Chiral Perturbation Theory (U\chiPT). We also pay special attention to the role played by the \sigma resonance in \gamma\gamma\to\pi\pi and calculate its coupling and width to gamma\gamma, for which we obtain \Gamma(\sigma\to\gamma\gamma)=(1.68\pm 0.15) KeV.Comment: 31 pages, 9 figure

Towards resolution of the enigmas of P-wave meson spectroscopy

The mass spectrum of P-wave mesons is considered in a nonrelativistic constituent quark model. The results show the common mass degeneracy of the isovector and isodoublet states of the scalar and tensor meson nonets, and do not exclude the possibility of a similar degeneracy of the same states of the axial-vector and pseudovector nonets. Current experimental hadronic and \tau -decay data suggest, however, a different scenario leading to the a_1 meson mass \simeq 1190 MeV and the K_{1A}-K_{1B} mixing angle \simeq (37\pm 3)^o. Possible s\bar{s} states of the four nonets are also discussed.Comment: 22 pages, LaTe

Teaching open and reproducible scholarship: a critical review of the evidence base for current pedagogical methods and their outcomes.

YesIn recent years, the scientific community has called for improvements in the credibility, robustness and reproducibility of research, characterized by increased interest and promotion of open and transparent research practices. While progress has been positive, there is a lack of consideration about how this approach can be embedded into undergraduate and postgraduate research training. Specifically, a critical overview of the literature which investigates how integrating open and reproducible science may influence student outcomes is needed. In this paper, we provide the first critical review of literature surrounding the integration of open and reproducible scholarship into teaching and learning and its associated outcomes in students. Our review highlighted how embedding open and reproducible scholarship appears to be associated with (i) students' scientific literacies (i.e. students' understanding of open research, consumption of science and the development of transferable skills); (ii) student engagement (i.e. motivation and engagement with learning, collaboration and engagement in open research) and (iii) students' attitudes towards science (i.e. trust in science and confidence in research findings). However, our review also identified a need for more robust and rigorous methods within pedagogical research, including more interventional and experimental evaluations of teaching practice. We discuss implications for teaching and learning scholarship.UKRI/ESRC rapid call grant, ealth Research Board Applying Researchinto Policy and Practice Fellowship, John Templeton Foundation (grant ID: 62631), Northern Ireland Department for the Economy Research Studentshi