Justify your alpha

Benjamin et al. proposed changing the conventional “statistical significance” threshold (i.e.,the alpha level) from p ≤ .05 to p ≤ .005 for all novel claims with relatively low prior odds. They provided two arguments for why lowering the significance threshold would “immediately improve the reproducibility of scientific research.” First, a p-value near .05provides weak evidence for the alternative hypothesis. Second, under certain assumptions, an alpha of .05 leads to high false positive report probabilities (FPRP2 ; the probability that a significant finding is a false positive

Apolipoprotein E genotype does not moderate the associations of depressive symptoms, neuroticism and allostatic load with cognitive ability and cognitive aging in the Lothian Birth Cohort 1936

<div><p>Objectives</p><p>In this replication-and-extension study, we tested whether depressive symptoms, neuroticism, and allostatic load (multisystem physiological dysregulation) were related to lower baseline cognitive ability and greater subsequent cognitive decline in older adults, and whether these relationships were moderated by the E4 allele of the apolipoprotein E (<i>APOE</i>) gene. We also tested whether allostatic load mediated the relationships between neuroticism and cognitive outcomes.</p><p>Methods</p><p>We used data from the Lothian Birth Cohort 1936 (<i>n</i> at Waves 1–3: 1,028 [<i>M</i> age = 69.5 y]; 820 [<i>M</i> duration since Wave 1 = 2.98 y]; 659 [<i>M</i> duration since Wave 1 = 6.74 y]). We fitted latent growth curve models of general cognitive ability (modeled using five cognitive tests) with groups of <i>APOE</i> E4 non-carriers and carriers. In separate models, depressive symptoms, neuroticism, and allostatic load predicted baseline cognitive ability and subsequent cognitive decline. In addition, models tested whether allostatic load mediated relationships between neuroticism and cognitive outcomes.</p><p>Results</p><p>Baseline cognitive ability had small-to-moderate negative associations with depressive symptoms (<i>β</i> range = -0.20 to -0.17), neuroticism (<i>β</i> range = -0.27 to -0.23), and allostatic load (<i>β</i> range = -0.11 to 0.09). Greater cognitive decline was linked to baseline allostatic load (<i>β</i> range = -0.98 to -0.83) and depressive symptoms (<i>β</i> range = -1.00 to -0.88). However, <i>APOE</i> E4 allele possession did not moderate the relationships of depressive symptoms, neuroticism and allostatic load with cognitive ability and cognitive decline. Additionally, the associations of neuroticism with cognitive ability and cognitive decline were not mediated through allostatic load.</p><p>Conclusions</p><p>Our results suggest that <i>APOE</i> E4 status does not moderate the relationships of depressive symptoms, neuroticism, and allostatic load with cognitive ability and cognitive decline in healthy older adults. The most notable positive finding in the current research was the strong association between allostatic load and cognitive decline.</p></div

Justify your alpha

In response to recommendations to redefine statistical significance to p ≤ .005, we propose that researchers should transparently report and justify all choices they make when designing a study, including the alpha level

UoE REproducible Psychological Science

Welcome to the home of REPS, a group for REproducible Psychological Science at the University of Edinburgh. During term-time, we will meet fortnightly on Mondays at 2:00pm-3:00pm in room S38, 7 George Square