Crowdsourcing hypothesis tests: Making transparent how design choices shape research results

To what extent are research results influenced by subjective decisions that scientists make as they design studies? Fifteen research teams independently designed studies to answer fiveoriginal research questions related to moral judgments, negotiations, and implicit cognition. Participants from two separate large samples (total N > 15,000) were then randomly assigned to complete one version of each study. Effect sizes varied dramatically across different sets of materials designed to test the same hypothesis: materials from different teams renderedstatistically significant effects in opposite directions for four out of five hypotheses, with the narrowest range in estimates being d = -0.37 to +0.26. Meta-analysis and a Bayesian perspective on the results revealed overall support for two hypotheses, and a lack of support for three hypotheses. Overall, practically none of the variability in effect sizes was attributable to the skill of the research team in designing materials, while considerable variability was attributable to the hypothesis being tested. In a forecasting survey, predictions of other scientists were significantly correlated with study results, both across and within hypotheses. Crowdsourced testing of research hypotheses helps reveal the true consistency of empirical support for a scientific claim.</div

Empathic nonverbal behavior increases ratings of both warmth and competence in a medical context

In medicine, it is critical that clinicians demonstrate both empathy (perceived as warmth) and competence. Perceptions of these qualities are often intuitive and are based on nonverbal behavior. Emphasizing both warmth and competence may prove problematic, however, because there is evidence that they are inversely related in other settings. We hypothesize that perceptions of physician competence will instead be positively correlated with perceptions of physician warmth and empathy, potentially due to changing conceptions of the physician’s role. We test this hypothesis in an analog medical context using a large online sample, manipulating physician nonverbal behaviors suggested to communicate empathy (e.g. eye contact) and competence (the physician’s white coat). Participants rated physicians displaying empathic nonverbal behavior as more empathic, warm, and more competent than physicians displaying unempathic nonverbal behavior, adjusting for mood. We found no warmth/competence tradeoff and, additionally, no significant effects of the white coat. Further, compared with male participants, female participants perceived physicians displaying unempathic nonverbal behavior as less empathic. Given the significant consequences of clinician empathy, it is important for clinicians to learn how nonverbal behavior contributes to perceptions of warmth, and use it as another tool to improve their patients’ emotional and physical health

Example photo stimuli (scene 3).

<p>Examples of still photograph stimuli used in the experiment depicting a male or female physician displaying empathic or unempathic nonverbal behaviors either wearing or not wearing a white coat.</p

Perceptions of physician nonverbal behavior.

<p>Physicians displaying empathic nonverbal behaviors are perceived as more warm, empathic, <i>and</i> more competent than physicians displaying unempathic nonverbal behaviors. Error bars represent 95% CI of the mean.</p

Relation among participant ratings of empathy, warmth, and competence.

<p>A) Correlations among the three ratings. B) Principal component weightings of the three ratings on two components using varimax rotation.</p