The association between exaggeration in health related science news and academic press releases: retrospective observational study

Objective To identify the source (press releases or news) of distortions, exaggerations, or changes to the main conclusions drawn from research that could potentially influence a reader’s health related behaviour. Design Retrospective quantitative content analysis. Setting Journal articles, press releases, and related news, with accompanying simulations. Sample Press releases (n=462) on biomedical and health related science issued by 20 leading UK universities in 2011, alongside their associated peer reviewed research papers and news stories (n=668). Main outcome measures Advice to readers to change behaviour, causal statements drawn from correlational research, and inference to humans from animal research that went beyond those in the associated peer reviewed papers. Results 40% (95% confidence interval 33% to 46%) of the press releases contained exaggerated advice, 33% (26% to 40%) contained exaggerated causal claims, and 36% (28% to 46%) contained exaggerated inference to humans from animal research. When press releases contained such exaggeration, 58% (95% confidence interval 48% to 68%), 81% (70% to 93%), and 86% (77% to 95%) of news stories, respectively, contained similar exaggeration, compared with exaggeration rates of 17% (10% to 24%), 18% (9% to 27%), and 10% (0% to 19%) in news when the press releases were not exaggerated. Odds ratios for each category of analysis were 6.5 (95% confidence interval 3.5 to 12), 20 (7.6 to 51), and 56 (15 to 211). At the same time, there was little evidence that exaggeration in press releases increased the uptake of news. Conclusions Exaggeration in news is strongly associated with exaggeration in press releases. Improving the accuracy of academic press releases could represent a key opportunity for reducing misleading health related news

How readers understand causal and correlational expressions used in news headlines

[Correction Notice: An Erratum for this article was reported in Vol 23(1) of Journal of Experimental Psychology: Applied (see record 2016-59631-001). In the article, the fourth author was inadvertently omitted from the advance online version. Also, the second paragraph of the author note should have included the following: “Amy Barrington contributed to the design and data collection for Experiments 2 and 3. We thank the following undergraduate students for contributions to Experiment 1 and pilot work leading up to the project: Laura Benjamin, Cecily Donnelly, Cameron Dunlop, Rebecca Emerson, Rose Fisher, Laura Jones, Olivia Manship, Hannah McCarthy, Naomi Scott, Eliza Walwyn-Jones, Leanne Whelan, and Joe Wilton.” All versions of this article have been corrected.] Science-related news stories can have a profound impact on how the public make decisions. The current study presents 4 experiments that examine how participants understand scientific expressions used in news headlines. The expressions concerned causal and correlational relationships between variables (e.g., “being breast fed makes children behave better”). Participants rated or ranked headlines according to the extent that one variable caused the other. Our results suggest that participants differentiate between 3 distinct categories of relationship: direct cause statements (e.g., “makes,” “increases”), which were interpreted as the most causal; can cause statements (e.g., “can make,” “can increase”); and moderate cause statements (e.g., “might cause,” “linked,” “associated with”), but do not consistently distinguish within the last group despite the logical distinction between cause and association. On the basis of this evidence, we make recommendations for appropriately communicating cause and effect in news headlines

Transformation priming helps to disambiguate sudden changes of sensory inputs

Retinal input is riddled with abrupt transients due to self-motion, changes in illumination, object-motion, etc. Our visual system must correctly interpret each of these changes to keep visual perception consistent and sensitive. This poses an enormous challenge, as many transients are highly ambiguous in that they are consistent with many alternative physical transformations. Here we investigated inter-trial effects in three situations with sudden and ambiguous transients, each presenting two alternative appearances (rotation-reversing structure-from-motion, polarity-reversing shape-from-shading, and streaming-bouncing object collisions). In every situation, we observed priming of transformations as the outcome perceived in earlier trials tended to repeat in subsequent trials and this repetition was contingent on perceptual experience. The observed priming was specific to transformations and did not originate in priming of perceptual states preceding a transient. Moreover, transformation priming was independent of attention and specific to low level stimulus attributes. In summary, we show how “transformation priors” and experience-driven updating of such priors helps to disambiguate sudden changes of sensory inputs. We discuss how dynamic transformation priors can be instantiated as “transition energies” in an “energy landscape” model of the visual perception

The association between exaggeration in health related science news and academic press releases: retrospective observational study

Objective To identify the source (press releases or news) of distortions, exaggerations, or changes to the main conclusions drawn from research that could potentially influence a reader’s health related behaviour. Design Retrospective quantitative content analysis. Setting Journal articles, press releases, and related news, with accompanying simulations. Sample Press releases (n=462) on biomedical and health related science issued by 20 leading UK universities in 2011, alongside their associated peer reviewed research papers and news stories (n=668). Main outcome measures Advice to readers to change behaviour, causal statements drawn from correlational research, and inference to humans from animal research that went beyond those in the associated peer reviewed papers. Results 40% (95% confidence interval 33% to 46%) of the press releases contained exaggerated advice, 33% (26% to 40%) contained exaggerated causal claims, and 36% (28% to 46%) contained exaggerated inference to humans from animal research. When press releases contained such exaggeration, 58% (95% confidence interval 48% to 68%), 81% (70% to 93%), and 86% (77% to 95%) of news stories, respectively, contained similar exaggeration, compared with exaggeration rates of 17% (10% to 24%), 18% (9% to 27%), and 10% (0% to 19%) in news when the press releases were not exaggerated. Odds ratios for each category of analysis were 6.5 (95% confidence interval 3.5 to 12), 20 (7.6 to 51), and 56 (15 to 211). At the same time, there was little evidence that exaggeration in press releases increased the uptake of news. Conclusions Exaggeration in news is strongly associated with exaggeration in press releases. Improving the accuracy of academic press releases could represent a key opportunity for reducing misleading health related news

Exaggerations and Caveats in Press Releases and Health-Related Science News.

Exaggerated or simplistic news is often blamed for adversely influencing public health. However, recent findings suggested many exaggerations were already present in university press releases, which scientists approve. Surprisingly, these exaggerations were not associated with more news coverage. Here we test whether these two controversial results also arise in press releases from prominent science and medical journals. We then investigate the influence of mitigating caveats in press releases, to test assumptions that caveats harm news interest or are ignored.Using quantitative content analysis, we analyzed press releases (N = 534) on biomedical and health-related science issued by leading peer-reviewed journals. We similarly analysed the associated peer-reviewed papers (N = 534) and news stories (N = 582). Main outcome measures were advice to readers and causal statements drawn from correlational research. Exaggerations in press releases predicted exaggerations in news (odds ratios 2.4 and 10.9, 95% CIs 1.3 to 4.5 and 3.9 to 30.1) but were not associated with increased news coverage, consistent with previous findings. Combining datasets from universities and journals (996 press releases, 1250 news), we found that when caveats appeared in press releases there was no reduction in journalistic uptake, but there was a clear increase in caveats in news (odds ratios 9.6 and 9.5 for caveats for advice and causal claims, CIs 4.1 to 24.3 and 6.0 to 15.2). The main study limitation is its retrospective correlational nature.For health and science news directly inspired by press releases, the main source of both exaggerations and caveats appears to be the press release itself. However we find no evidence that exaggerations increase, or caveats decrease, the likelihood of news coverage. These findings should be encouraging for press officers and scientists who wish to minimise exaggeration and include caveats in their press releases

Association between press release and news exaggeration.

<p>The proportions of news with exaggerated advice (A), or causal statements from correlational research (B) were higher when the associated press releases (PR) contained such exaggeration (N for Advice, PR = 247, news = 411; causal claims, PR = 164, news = 237). Error bars are 95% confidence intervals. See <a href="http://www.plosone.org/article/info:doi/10.1371/journal.pone.0168217#pone.0168217.t001" target="_blank">Table 1</a> for odds ratios. Partial results for non-human studies are in supporting information because low N meant this analysis could not be performed.</p

Press release caveats, news uptake and caveats in news.

<p>(A) News uptake for press releases (PRs) with and without caveats for explicit advice. (B) News uptake for PRs with and without caveats for causal claims. (C) Association between caveats for explicit advice in the PR and caveats for explicit advice in resulting news articles. (D) Association between caveats for causal claims in the PR and caveats for causal claims in resulting news articles. All error bars are bootstrapped 95% confidence intervals.</p

No Effect of press release exaggeration on news uptake.

<p>The proportion of press releases (PRs) that have resulting news articles when the press releases do not contain exaggerations (left bars) compared to when they do (right bars) for analyses of advice (A) and causal claims from correlation (B). Error bars are bootstrapped 95% confidence intervals. See <a href="http://www.plosone.org/article/info:doi/10.1371/journal.pone.0168217#pone.0168217.t001" target="_blank">Table 1</a> for odds ratios. Note that full analysis for non-human studies could not be performed because only one exaggerated press release had associated news.</p

Press release justifications, news uptake and justifications in news.

<p>(A) News uptake for press releases (PRs) with and without justifications for explicit advice. (B) News uptake for PRs with and without justifications for statements of relationship. (C) Association between justifications for explicit advice in the PR and justifications for explicit advice in resulting news articles. (D) Association between justifications for statements of relationship in the PR and justifications for statements of relationship in resulting news articles. All error bars are bootstrapped 95% confidence intervals.</p

Summary of key results.

<p>Summary of key results.</p