The “Goldilocks Zone”: (Too) many confidence intervals in tests of mediation just exclude zero

Questionable research practices (QRPs) can occur whenever one result is favored over another, and tests of mediation are no exception. Given mediation's ubiquity and importance to both theory and practice, QRPs in tests of mediation pose a serious threat to the advancement of psychology. We investigate this issue through the introduction of a straightforward means of detecting the presence and magnitude of QRPs in tests of mediation and validate this methodology with a series of sensitivity tests and simulations. We then apply this method to 2,569 tests of mediation published in five leading psychology journals in 2018 and 2019. We find that despite most hypothesized tests of mediation being likely underpowered, most (76%) were nevertheless supported. Furthermore, confidence intervals (CIs) that just barely exclude zero are 3.6 to 4.4 times as prevalent as those CIs that just barely include zero. We also find a number of study- and test-level factors, such as whether the test of mediation was hypothesized, explain both whether the CI excluded zero (odds ratio [OR] = 17.87, p < .001) as well as the CI's proximity to zero (b = .27, p < .001). In addition, other factors, most notably sample size, do predict the CI's proximity to zero (γ = .00, p < .001), but surprisingly do not predict the CI's exclusion of zero (OR = .99, p = .803). We conclude with actionable QRP curtailment strategies so that both, academics and practitioners, can have greater and well-founded confidence in tests of mediation in psychological research

Channeled Autonomy: The Joint Effects of Autonomy and Feedback on Team Performance Through Organizational Goal Clarity

Past research suggests that autonomy has highly variable effects on team performance, and that one explanation for this pattern of findings is that autonomous teams fall into a state of disorder where they lack clarity regarding the goals of the broader organization. Following this perspective, the authors develop a model proposing that performance feedback coupled with high autonomy enables teams to have greater clarity of the organization???s goals, which in turn increases team performance. This model was tested on 110 teams in a defense industry manufacturing firm in South Korea using mediated-moderation techniques. Results indicate that highly autonomous teams that receive a high degree of performance feedback outperform other teams because of their heightened level of organizational goal clarity. In contrast, highly autonomous teams that receive low levels of feedback perform at the lowest levels compared to other teams because of a lack of organizational goal clarity. The authors discuss the implications of these findings for theory, research, and practice.clos