When and Why to Replicate:As Easy as 1, 2, 3?

The crisis of confidence in psychology has prompted vigorous and persistent debate in the scientific community concerning the veracity of the findings of psychological experiments. This discussion has led to changes in psychology's approach to research, and several new initiatives have been developed, many with the aim of improving our findings. One key advancement is the marked increase in the number of replication studies conducted. We argue that while it is important to conduct replications as part of regular research protocol, it is neither efficient nor useful to replicate results at random. We recommend adopting a methodical approach toward the selection of replication targets to maximize the impact of the outcomes of those replications, and minimize waste of scarce resources. In the current study, we demonstrate how a Bayesian re-analysis of existing research findings followed by a simple qualitative assessment process can drive the selection of the best candidate article for replication.</p

Weekly reports for R.V. Polarstern expedition PS103 (2016-12-16 - 2017-02-03, Cape Town - Punta Arenas), German and English version

Priming is arguably one of the key phenomena in contemporary social psychology. Recent retractions and failed replication attempts have led to a division in the field between proponents and skeptics and have reinforced the importance of confirming certain priming effects through replication. In this study, we describe the results of 2 preregistered replication attempts of 1 experiment by Förster and Denzler (2012). In both experiments, participants first processed letters either globally or locally, then were tested using a typicality rating task. Bayes factor hypothesis tests were conducted for both experiments: Experiment 1(N = 100) yielded an indecisive Bayes factor of 1.38, indicating that the in-lab data are 1.38 times more likely to have occurred under the null hypothesis than under the alternative. Experiment 2 (N = 908) yielded a Bayes factor of 10.84, indicating strong support for the null hypothesis that global priming does not affect participants' mean typicality ratings. The failure to replicate this priming effect challenges existing support for the GLOMOsys model

Rethinking Remdesivir for COVID-19: A Bayesian Reanalysis of Trial Findings

BackgroundFollowing testing in clinical trials, the use of remdesivir for treatment of COVID-19 has been authorized for use in parts of the world, including the USA and Europe. Early authorizations were largely based on results from two clinical trials. A third study published by Wang et al. was underpowered and deemed inconclusive. Although regulators have shown an interest in interpreting the Wang et al. study, under a frequentist framework it is difficult to determine if the non-significant finding was caused by a lack of power or by the absence of an effect. Bayesian hypothesis testing does allow for quantification of evidence in favor of the absence of an effect.FindingsResults of our Bayesian reanalysis of the three trials show ambiguous evidence for the primary outcome of clinical improvement and moderate evidence against the secondary outcome of decreased mortality rate. Additional analyses of three studies published after initial marketing approval support these findings.ConclusionsWe recommend that regulatory bodies take all available evidence into account for endorsement decisions. A Bayesian approach can be beneficial, in particular in case of statistically non-significant results. This is especially pressing when limited clinical efficacy data is available

The Effect of Preregistration on Trust in Empirical Research Findings:Results of a Registered Report

The crisis of confidence has undermined the trust that researchers place in the findings of their peers. In order to increase trust in research, initiatives such as preregistration have been suggested, which aim to prevent various questionable research practices. As it stands, however, no empirical evidence exists that preregistration does increase perceptions of trust. The picture may be complicated by a researcher's familiarity with the author of the study, regardless of the preregistration status of the research. This registered report presents an empirical assessment of the extent to which preregistration increases the trust of 209 active academics in the reported outcomes, and how familiarity with another researcher influences that trust. Contrary to our expectations, we report ambiguous Bayes factors and conclude that we do not have strong evidence towards answering our research questions. Our findings are presented along with evidence that our manipulations were ineffective for many participants, leading to the exclusion of 68% of complete datasets, and an underpowered design as a consequence. We discuss other limitations and confounds which may explain why the findings of the study deviate from a previously conducted pilot study. We reflect on the benefits of using the registered report submission format in light of our results. The OSF page for this registered report and its pilot can be found here: http://dx.doi.org/10.17605/OSF.IO/B3K75

Penalty Corner Routines in Elite Women’s Indoor Field Hockey: Prediction of Outcomes based on Tactical Decisions

Indoor hockey is a highly competitive international sport, yet no research to date has investigated the key actions within this sport. As with outdoor field hockey, penalty corners represent one of the most likely situations in which goals can be scored. All 36 matches of the round-robin phase of the 2010-2011 England Hockey League Women’s Premier Division ‘Super Sixes’ competition were analysed with the purpose of establishing which factors can predict the scoring of a goal using Binary Logistic Regression analysis. Seventy two (22.6%) of the 319 observed penalty corners resulted in a goal. The strongest predictor of scoring a goal was taking the penalty corner from the goalkeeper’s right. Based on the odds ratio (OR), the odds of the attacking team scoring were 2.27 (CI = 1.41 - 3.65) times higher with penalty corners taken from the goalkeeper’s right as opposed to the left. Additionally, if the goalkeeper decided to rush to the edge of the circle, the odds of the attacking team failing to score were 2.19 (CI = 1.18 - 4.08) times higher compared to when the goalkeeper remained near the goal line. These results suggest that strategic decisions from the players and coaches have an important part to play in the success of penalty corners. Future research should investigate the impact of goalkeepers’ movement and further examine the technical and tactical intricacies of penalty corners

The Process of Replication Target Selection in Psychology: What to Consider?

Increased execution of replication studies contributes to the effort to restore credibility of empirical research. However, a second generation of problems arises: the number of potential replication targets is at a serious mismatch with available resources. Given limited resources, replication target selection should be well justified, systematic, and transparently communicated. At present the discussion on what to consider when selecting a replication target is limited to theoretical discussion, self-reported justifications, and a few formalized suggestions. In this Registered Report, we proposed a study involving the scientific community to create a list of considerations for consultation when selecting a replication target in psychology. We employed a modified Delphi approach. First, we constructed a preliminary list of considerations. Second, we surveyed psychologists who previously selected a replication target with regards to their considerations. Third, we incorporated the results into the preliminary list of considerations and sent the updated list to a group of individuals knowledgeable about concerns regarding replication target selection. Over the course of several rounds, we established consensus regarding what to consider when selecting a replication target

Assessment of natural resource conditions in and adjacent to Dry Tortugas National Park

This project characterized and assessed the condition of coastal water resources in the Dry Tortugas National Park (DRTO) located in the Florida Keys. The goal of the assessment was to: (1) identify the state of knowledge of natural resources that exist within the DRTO, (2) summarize the state of knowledge about natural and anthropogenic stressors and threats that affected these resources, and (3) describe strategies being implemented by DRTO managers to meet their resource management goals. The park, located in the Straits of Florida 113 km (70 miles) west of Key West, is relatively small (269 square kilometers) with seven small islands and extensive shallow water coral reefs. Significant natural resources within DRTO include coastal and oceanic waters, coral reefs, reef fisheries, seagrass beds, and sea turtle and bird nesting habitats. This report focuses on marine natural resources identified by DRTO resource managers and researchers as being vitally important to the Tortugas region and the wider South Florida ecosystem. Selected marine resources included physical resources (geology, oceanography, and water quality) and biological resources (coral reef and hardbottom benthic assemblages, seagrass and algal communities, reef fishes and macro invertebrates, and wildlife [sea turtles and sea-birds]). In the past few decades, some of these resources have deteriorated because of natural and anthropogenic factors that are local and global in scale. To meet mandated goals (Chapter 1), resource managers need information on: (1) the types and condition of natural and cultural resources that occur within the park and (2) the stressors and threats that can affect those resources. This report synthesizes and summarizes information on: (1) the status of marine natural resources occurring at DRTO; and (2) types of stressors and threats currently affecting those resources at the DRTO. Based on published information, the assessment suggests that marine resources at DRTO and its surrounding region are affected by several stressors, many of which act synergistically. Of the nine resource components assessed, one resource category – water quality – received an ecological condition ranking of "Good"; two components – the nonliving portion of coral reef and hardbottom and reef fishes – received a rating of "Caution"; and two components – the biotic components of coral reef and hardbottom substrates and sea turtles – received a rating of "Significant concern" (Table E-1). Seagrass and algal communities and seabirds were unrated for ecological condition because the available information was inadequate. The stressor category of tropical storms was the dominant and most prevalent stressor in the Tortugas region; it affected all of the resource components assessed in this report. Commercial and recreational fishing were also dominant stressors and affected 78% of the resource components assessed. The most stressed resource was the biotic component of coral reef and hardbottom resources, which was affected by 76% of the stressors. Water quality was the least affected; it was negatively affected by 12% of stressors. The systematic assessment of marine natural resources and stressors in the Tortugas region pointed to several gaps in the information. For example, of the nine marine resource components reviewed in this report, the living component of coral reefs and hardbottom resources had the best rated information with 25% of stressor categories rated "Good" for information richness. In contrast, the there was a paucity of information for seagrass and algal communities and sea birds resource components

Measurements of branching fraction ratios and CP-asymmetries in suppressed B^- -> D(-> K^+ pi^-)K^- and B^- -> D(-> K^+ pi^-)pi^- decays

We report the first reconstruction in hadron collisions of the suppressed decays B^- -> D(-> K^+ pi^-)K^- and B^- -> D(-> K^+ pi^-)pi^-, sensitive to the CKM phase gamma, using data from 7 fb^-1 of integrated luminosity collected by the CDF II detector at the Tevatron collider. We reconstruct a signal for the B^- -> D(-> K^+ pi^-)K^- suppressed mode with a significance of 3.2 standard deviations, and measure the ratios of the suppressed to favored branching fractions R(K) = [22.0 \pm 8.6(stat)\pm 2.6(syst)]\times 10^-3, R^+(K) = [42.6\pm 13.7(stat)\pm 2.8(syst)]\times 10^-3, R^-(K)= [3.8\pm 10.3(stat)\pm 2.7(syst]\times 10^-3, as well as the direct CP-violating asymmetry A(K) = -0.82\pm 0.44(stat)\pm 0.09(syst) of this mode. Corresponding quantities for B^- -> D(-> K^+ pi^-)pi^- decay are also reported.Comment: 8 pages, 1 figure, accepted by Phys.Rev.D Rapid Communications for Publicatio