Keeping them honest: Promises reduce cheating in adolescents

People frequently engage in dishonest behavior at a cost to others, and it is therefore beneficial to study interventions promoting honest behavior. We implemented a novel intervention that gave participants a choice to promise to be truthful or not to promise. To measure cheating behavior, we developed a novel variant of the mind game—the dice‐box game—as well as a child‐friendly sender–receiver game. Across three studies with adolescents aged 10 to 14 years (N = 640) from schools in India, we found that promises systematically lowered cheating rates compared with no‐promise control conditions. Adolescents who sent truthful messages in the sender–receiver game cheated less in the dice‐box game and promises reduced cheating in both tasks (Study 1). Promises in the dice‐box game remained effective when negative externalities (Study 2) or incentives for competition (Study 3) were added. A joint analysis of data from all three studies revealed demographic variables that influenced cheating. Our findings confirm that promises have a strong, binding effect on behavior and can be an effective intervention to reduce cheating

Examining the generalizability of research findings from archival data

This initiative examined systematically the extent to which a large set of archival research findings generalizes across contexts. We repeated the key analyses for 29 original strategic management effects in the same context (direct reproduction) as well as in 52 novel time periods and geographies; 45% of the reproductions returned results matching the original reports together with 55% of tests in different spans of years and 40% of tests in novel geographies. Some original findings were associated with multiple new tests. Reproducibility was the best predictor of generalizability-for the findings that proved directly reproducible, 84% emerged in other available time periods and 57% emerged in other geographies. Overall, only limited empirical evidence emerged for context sensitivity. In a forecasting survey, independent scientists were able to anticipate which effects would find support in tests in new samples

Probing intermediates in the activation cycle of [NiFe] hydrogenase by infrared spectroscopy: the Ni-SIr state and its light sensitivity

The [NiFe] hydrogenase from the sulphate-reducing bacterium Desulfovibrio vulgaris Miyazaki F is reversibly inhibited in the presence of molecular oxygen. A key intermediate in the reactivation process, Ni-SIr, provides the link between fully oxidized (Ni-A, Ni-B) and active (Ni-SIa, Ni-C and Ni-R) forms of hydrogenase. In this work Ni-SIr was found to be light-sensitive (T ≤ 110 K), similar to the active Ni-C and the CO-inhibited states. Transition to the final photoproduct state (Ni-SL) was shown to involve an additional transient light-induced state (Ni-SI1961). Rapid scan kinetic infrared measurements provided activation energies for the transition from Ni-SL to Ni-SIr in protonated as well as in deuterated samples. The inhibitor CO was found not to react with the active site of the Ni-SL state. The wavelength dependence of the Ni-SIr photoconversion was examined in the range between 410 and 680 nm. Light-induced effects were associated with a nickel-centred electronic transition, possibly involving a change in the spin state of nickel (Ni2+). In addition, at T ≤ 40 K the CN− stretching vibrations of Ni-SL were found to be dependent on the colour of the monochromatic light used to irradiate the species, suggesting a change in the interaction of the hydrogen-bonding network of the surrounding amino acids. A possible mechanism for the photochemical process, involving displacement of the oxygen-based ligand, is discussed

Creative destruction in science

Drawing on the concept of a gale of creative destruction in a capitalistic economy, we argue that initiatives to assess the robustness of findings in the organizational literature should aim to simultaneously test competing ideas operating in the same theoretical space. In other words, replication efforts should seek not just to support or question the original findings, but also to replace them with revised, stronger theories with greater explanatory power. Achieving this will typically require adding new measures, conditions, and subject populations to research designs, in order to carry out conceptual tests of multiple theories in addition to directly replicating the original findings. To illustrate the value of the creative destruction approach for theory pruning in organizational scholarship, we describe recent replication initiatives re-examining culture and work morality, working parents\u2019 reasoning about day care options, and gender discrimination in hiring decisions. Significance statement It is becoming increasingly clear that many, if not most, published research findings across scientific fields are not readily replicable when the same method is repeated. Although extremely valuable, failed replications risk leaving a theoretical void\u2014 reducing confidence the original theoretical prediction is true, but not replacing it with positive evidence in favor of an alternative theory. We introduce the creative destruction approach to replication, which combines theory pruning methods from the field of management with emerging best practices from the open science movement, with the aim of making replications as generative as possible. In effect, we advocate for a Replication 2.0 movement in which the goal shifts from checking on the reliability of past findings to actively engaging in competitive theory testing and theory building. Scientific transparency statement The materials, code, and data for this article are posted publicly on the Open Science Framework, with links provided in the article

Examining the generalizability of research findings from archival data

This initiative examined systematically the extent to which a large set of archival research findings generalizes across contexts. We repeated the key analyses for 29 original strategic management effects in the same context (direct reproduction) as well as in 52 novel time periods and geographies; 45% of the reproductions returned results matching the original reports together with 55% of tests in different spans of years and 40% of tests in novel geographies. Some original findings were associated with multiple new tests. Reproducibility was the best predictor of generalizability—for the findings that proved directly reproducible, 84% emerged in other available time periods and 57% emerged in other geographies. Overall, only limited empirical evidence emerged for context sensitivity. In a forecasting survey, independent scientists were able to anticipate which effects would find support in tests in new samples

Crowdsourcing hypothesis tests: Making transparent how design choices shape research results

To what extent are research results influenced by subjective decisions that scientists make as they design studies? Fifteen research teams independently designed studies to answer fiveoriginal research questions related to moral judgments, negotiations, and implicit cognition. Participants from two separate large samples (total N > 15,000) were then randomly assigned to complete one version of each study. Effect sizes varied dramatically across different sets of materials designed to test the same hypothesis: materials from different teams renderedstatistically significant effects in opposite directions for four out of five hypotheses, with the narrowest range in estimates being d = -0.37 to +0.26. Meta-analysis and a Bayesian perspective on the results revealed overall support for two hypotheses, and a lack of support for three hypotheses. Overall, practically none of the variability in effect sizes was attributable to the skill of the research team in designing materials, while considerable variability was attributable to the hypothesis being tested. In a forecasting survey, predictions of other scientists were significantly correlated with study results, both across and within hypotheses. Crowdsourced testing of research hypotheses helps reveal the true consistency of empirical support for a scientific claim.</div