Examining exaggerated claims in science communication

This thesis is concerned with investigating the exaggeration of health-related research in the media. Typically, research findings published in peer reviewed journals are transmitted to the news via press releases created by universities and journal press offices. Research has shown that exaggeration of key aspects of the research relevant to the health-related behaviour of readers is often exaggerated in the news. Observational research has shown that the presence of exaggeration in press releases is related to exaggeration in the news (Sumner et al., 2014). Firstly, I report my largely successful replication of this key study using more recent retrospective observational data. I show that discourse on openness in animal research and exaggeration of findings is linked to positive changes in science reporting. The study in chapter three compares data collected before versus after the release of Sumner et al. (2014) to detect any change the reporting of research findings following the release of this high profile paper. Between the sample periods, exaggeration in press releases had reduced, suggesting that press officers had become more cautious in their reporting of research findings. Chapter four describes a randomised controlled trial which directly modified the output of press offices to observe whether press release content had a direct effect on news. A high level of condition non-adherance meant that this “per protocol” comparison was not possible. An “as treated” analysis demonstrated the same relationship between press releases and news articles as in the replication in chapter two, and the conparison in chapter three

Causal claims about correlations reduced in press releases following academic study of health news

Background: Exaggerations in health news were previously found to strongly associate with similar exaggerations in press releases. Moreover such exaggerations did not appear to attract more news. Here we assess whether press release practice changed after these reported findings; simply drawing attention to the issue may be insufficient for practical change, given the challenges of media environments. Methods: We assessed whether rates of causal over-statement in press releases based on correlational data were lower following a seminal paper on the topic, compared to an equivalent baseline period in the preceding year. Results: We found that over-statements in press releases reduced from 28% (95% confidence interval = 16% to 45%) in 2014 to 13% (95% confidence interval = 6% to 25%) in 2015. A corresponding numerical reduction in exaggerations in news was not significant. The association between over-statements in news and press releases remained strong. Conclusions: Press release over-statements were less frequent following publication of Sumner et al. (2014), indicating that press release practice is malleable. However, this is correlational evidence and the reduction may be due to other factors

Securing By Design

This article investigates how modern neo-liberal states are 'securing by design' harnessing design to new technologies in order to produce security, safety, and protection. We take a critical view toward 'securing by design' and the policy agendas it produces of 'designing out insecurity' and 'designing in protection' because securing by design strategies rely upon inadequate conceptualisations of security, technology, and design and inadequate understandings of their relationships to produce inadequate 'security solutions' to readymade 'security problems'. This critique leads us to propose a new research agenda we call Redesigning Security. A Redesigning Security Approach begins from a recognition that the achievement of security is more often than not illusive, which means that the desire for security is itself problematic. Rather than encouraging the design of 'security solutions' a securing by design a Redesigning Security Approach explores how we might insecure securing by design. By acknowledging and then moving beyond the new security studies insight that security often produces insecurity, our approach uses design as a vehicle through which to raise questions about security problems and security solutions by collaborating with political and critical design practitioners to design concrete material objects that themselves embody questions about traditional security and about traditional design practices that use technology to depoliticise how technology is deployed by states and corporations to make us 'safe'

Disclosure of study funding and author conflicts of interest in press releases and the news: A retrospective content analysis with two cohorts

Objectives To examine how often study funding and author conflicts of interest are stated in science and health press releases and in corresponding news; and whether disclosure in press releases is associated with disclosure in news. Second, to specifically examine disclosure rates in industry-funded studies. Design Retrospective content analysis with two cohorts. Setting Press releases about health, psychology or neuroscience research from research universities and journals from 2011 (n=996) and 2015 (n=254) and their associated news stories (n=1250 and 578). Primary outcome measure Mention of study funding and author conflicts of interest. Results In our 2011 cohort, funding was reported in 94% (934/996) of journal articles, 29% (284/996) of press releases and 9% (112/1250) of news. The corresponding figures for 2015 were: 84% (214/254), 52% (131/254) and 10% (58/578). A similar pattern was seen for the industry funding subset. If the press release reported study funding, news was more likely to: 22% if in the press release versus 7% if not in the press release (2011), relative risk (RR) 3.1 (95% CI 2.1 to 4.3); for 2015, corresponding figures were 16% versus 2%, RR 6.8 (95% CI 2.2 to 17). In journal articles, 27% and 22% reported a conflict of interest, while less than 2% of press releases or news ever mentioned these. Conclusions Press releases and associated news did not frequently state funding sources or conflicts of interest. Funding information in press releases was associated with such information in news. Given converging evidence that news draws on press release content, including statements of funding and conflicts of interest in press releases may lead to increased reporting in news

The association between exaggeration in health-related science news and academic press releases: a replication study

Background: Exaggerations in health news were previously found to strongly associate with similar exaggerations in press releases. Moreover, such press release exaggerations did not appear to attract more news. Methods: Here we tested the replicability of these findings in a new cohort of news and press releases based on research in UK universities in 2014 and 2015. Press releases and news were compared to their associated peer-reviewed articles to define exaggeration in advice, causal claims and human inference from non-human studies. Results: We found that the association between news and press releases did not replicate for advice exaggeration, while this association did replicate for causal claims and human inference from non-human studies. There was no evidence for higher news uptake for exaggerated press releases, consistent with previous results. Base exaggeration rates were lower for human inference from non-human studies, possibly reflecting the Concordat on Openness on Animal Research in the UK. Conclusions: Overall, the picture remains that the strength of news statements is normally associated with the strength of press release statements, and without evidence that exaggerated statements get significantly more news

Caveats in science-based news stories communicate caution without lowering interest

Science stories in the media are strongly linked to changes in health-related behavior. Science writers (including journalists, press officers, and researchers) must therefore frame their stories to communicate scientific caution without disrupting coherence and disengaging the reader. In this study we investigate whether caveats (“Further research is needed to validate the results”) satisfy this dual requirement. In four experiments participants read news reports with and without caveats. In Experiments 1 to 3, participants judged how cautious or confident researchers were, and how interesting or comprehensible they found the reports. News reports with caveats were judged as more cautious that those without, but levels of reader interest and comprehensibility were unaffected. In a fourth experiment, we created a mock newsroom and recruited journalism students to make judgments about which press releases should be published. Here, neither caveats nor the introduction of qualifying expressions in headlines had an effect on judgments of newsworthiness, consistent with Experiments 1 to 3. The reasons participants gave for rejecting a press release rarely referred to the caveat. Our results therefore suggest that science writers should include caveats in news reporting and that they can do so without fear of disengaging their readers or losing news uptak

Claims of causality in health news: a randomised trial

Background Misleading news claims can be detrimental to public health. We aimed to improve the alignment between causal claims and evidence, without losing news interest (counter to assumptions that news is not interested in communicating caution). Methods We tested two interventions in press releases, which are the main sources for science and health news: (a) aligning the headlines and main causal claims with the underlying evidence (strong for experimental, cautious for correlational) and (b) inserting explicit statements/caveats about inferring causality. The ‘participants’ were press releases on health-related topics (N = 312; control = 89, claim alignment = 64, causality statement = 79, both = 80) from nine press offices (journals, universities, funders). Outcomes were news content (headlines, causal claims, caveats) in English-language international and national media (newspapers, websites, broadcast; N = 2257), news uptake (% press releases gaining news coverage) and feasibility (% press releases implementing cautious statements). Results News headlines showed better alignment to evidence when press releases were aligned (intention-to-treat analysis (ITT) 56% vs 52%, OR = 1.2 to 1.9; as-treated analysis (AT) 60% vs 32%, OR = 1.3 to 4.4). News claims also followed press releases, significant only for AT (ITT 62% vs 60%, OR = 0.7 to 1.6; AT, 67% vs 39%, OR = 1.4 to 5.7). The same was true for causality statements/caveats (ITT 15% vs 10%, OR = 0.9 to 2.6; AT 20% vs 0%, OR 16 to 156). There was no evidence of lost news uptake for press releases with aligned headlines and claims (ITT 55% vs 55%, OR = 0.7 to 1.3, AT 58% vs 60%, OR = 0.7 to 1.7), or causality statements/caveats (ITT 53% vs 56%, OR = 0.8 to 1.0, AT 66% vs 52%, OR = 1.3 to 2.7). Feasibility was demonstrated by a spontaneous increase in cautious headlines, claims and caveats in press releases compared to the pre-trial period (OR = 1.01 to 2.6, 1.3 to 3.4, 1.1 to 26, respectively). Conclusions News claims—even headlines—can become better aligned with evidence. Cautious claims and explicit caveats about correlational findings may penetrate into news without harming news interest. Findings from AT analysis are correlational and may not imply cause, although here the linking mechanism between press releases and news is known. ITT analysis was insensitive due to spontaneous adoption of interventions across conditions

Expert quotes and exaggeration in health news: a retrospective quantitative content analysis

Background This research is an investigation into the role of expert quotes in health news, specifically whether news articles containing a quote from an independent expert are less often exaggerated than articles without such a quote. Methods Retrospective quantitative content analysis of journal articles, press releases, and associated news articles was performed. The investigated sample are press releases on peer-reviewed health research and the associated research articles and news stories. Our sample consisted of 462 press releases and 668 news articles from the UK (2011) and 129 press releases and 185 news articles from The Netherlands (2015). We hand-coded all journal articles, press releases and news articles for correlational claims, using a well-tested codebook. The main outcome measures are types of sources that were quoted and exaggeration of correlational claims. We used counts, 2x2 tables and odds ratios to assess the relationship between presence of quotes and exaggeration of the causal claim. Results Overall, 99.1% of the UK press releases and 84.5% of the Dutch press releases contain at least one quote. For the associated news articles these percentages are: 88.6% in the UK and 69.7% in the Netherlands. Authors of the study are most often quoted and only 7.5% of UK and 7.0% of Dutch news articles contained a new quote by an expert source, i.e. one not provided by the press release. The relative odds that an article without an external expert quote contains an exaggeration of causality is 2.6. Conclusions The number of articles containing a quote from an independent expert is low, but articles that cite an external expert do contain less exaggeration

Strontium Isotope Stratigraphy: Case Studies of Upper Carboniferous and Lower Permian Successions from Southeast Utah and Northeast Nevada

Strontium Isotope Stratigraphy (SIS) is a valuable tool in correlating sedimentary sequences. Whole rock, conodonts and brachiopods can be studied. Here, conodonts and some whole rock samples were analyzed. Samples were dissolved, and strontium isotope compositions were analyzed using a thermal ionization mass spectrometer. The Early Permian interval exhibits a well-known 87Sr/86Sr secular trend, herein called the McArthur curve, that could provide well-constrained correlations in combination with detailed biostratigraphy. Three Upper Carboniferous to Lower Permian sites were studied, including Valley of the Gods in SE Utah, Carlin Canyon in north-central Nevada and the Rockland section in northeast Nevada. Results for the lower Cutler beds of SE Utah showed all four limestone units within an otherwise red-bed succession tested as latest Carboniferous, and the CPB was interpolated to occur just below the Cedar Mesa Sandstone. In Carlin Canyon, base-Artinskian conodont samples from the Buckskin Mountain Formation showed lower 87Sr/86Sr ratios than whole rock samples. However, all samples were more radiogenic than the expected base-Artinskian value. Rockland samples from the Pequop Formation were considerably more radiogenic than the expected values for the base-Kungurian, in contrast to results from Sakmarian to lower Artinskian strata in the same section, which generally yielded expected values. The variability in SIS results from these three studies necessitated an in-depth review of the McArthur curve. It was found that most North American data had higher 87Sr/86Sr values when compared with published data from Russia and China. This discrepancy was particularly apparent in data from mid-Artinskian to latest Kungurian. Potential reasons for this discrepancy include diagenetic overprint, basin isolation, and reduced mixing caused by the closure of the Uralian Seaway and the Artinskian Warming Event. More studies are needed in order to understand the cause fully. A new LOESS curve was developed to represent the combination of data from this study with previous published data. It was then proposed that two LOESS curves, one for North American data and one for Chinese and Russian data, best represented the regional differences in strontium isotopic signatures. Overall, this study highlights that Lower Permian 87Sr/86Sr values show significant variability, necessitating cautious application