Stakeholder views on publication bias in health services research

Objectives: While the presence of publication bias in clinical research is well documented, little is known about its role in the reporting of health services research. This paper explores stakeholder perceptions and experiences with regard to the role of publication and related biases in quantitative research relating to the quality, accessibility and organization of health services. Methods: We present findings from semi-structured interviews with those responsible for the funding, publishing and/or conduct of quantitative health services research, primarily in the UK. Additional data collection includes interviews with health care decision makers as ‘end users’ of health services research, and a focus group with patient and service user representatives. The final sample comprised 24 interviews and eight focus group participants. Results: Many study participants felt unable to say with any degree of certainty whether publication bias represents a significant problem in quantitative health services research. Participants drew broad contrasts between externally funded and peer reviewed research on the one hand, and end user funded quality improvement projects on the other, with the latter perceived as more vulnerable to selective publication and author over-claiming. Multiple study objectives, and a general acceptance of ‘mess and noise’ in the data and its interpretation was seen to reduce the importance attached to replicable estimates of effect sizes in health services research. The relative absence of external scrutiny, either from manufacturers of interventions or health system decision makers, added to this general sense of ‘low stakes’ of health services research. As a result, while many participants advocated study pre-registration and using protocols to pre-identify outcomes, others saw this as an unwarranted imposition. Conclusions: This study finds that incentives towards publication and related bias are likely to be present, but not to the same degree as in clinical research. In health services research, these were seen as being offset by other forms of ‘novelty’ bias in the reporting and publishing of research findings

Assessment of publication bias and outcome reporting bias in systematic reviews of health services and delivery research:A meta-epidemiological study

Strategies to identify and mitigate publication bias and outcome reporting bias are frequently adopted in systematic reviews of clinical interventions but it is not clear how often these are applied in systematic reviews relating to quantitative health services and delivery research (HSDR). We examined whether these biases are mentioned and/or otherwise assessed in HSDR systematic reviews, and evaluated associating factors to inform future practice. We randomly selected 200 quantitative HSDR systematic reviews published in the English language from 2007-2017 from the Health Systems Evidence database (www.healthsystemsevidence.org). We extracted data on factors that may influence whether or not authors mention and/or assess publication bias or outcome reporting bias. We found that 43% (n = 85) of the reviews mentioned publication bias and 10% (n = 19) formally assessed it. Outcome reporting bias was mentioned and assessed in 17% (n = 34) of all the systematic reviews. Insufficient number of studies, heterogeneity and lack of pre-registered protocols were the most commonly reported impediments to assessing the biases. In multivariable logistic regression models, both mentioning and formal assessment of publication bias were associated with: inclusion of a meta-analysis; being a review of intervention rather than association studies; higher journal impact factor, and; reporting the use of systematic review guidelines. Assessment of outcome reporting bias was associated with: being an intervention review; authors reporting the use of Grading of Recommendations, Assessment, Development and Evaluations (GRADE), and; inclusion of only controlled trials. Publication bias and outcome reporting bias are infrequently assessed in HSDR systematic reviews. This may reflect the inherent heterogeneity of HSDR evidence and different methodological approaches to synthesising the evidence, lack of awareness of such biases, limits of current tools and lack of pre-registered study protocols for assessing such biases. Strategies to help raise awareness of the biases, and methods to minimise their occurrence and mitigate their impacts on HSDR systematic reviews, are needed

A temperate palaeodiversity peak in Mesozoic dinosaurs and evidence for Late Cretaceous geographical partitioning

Aim  Modern biodiversity peaks in the tropics and declines poleward, a pattern that is potentially driven by climate. Although this latitudinal biodiversity gradient (LBG) also characterizes the marine invertebrate fossil record, distributions of ancient terrestrial faunas are poorly understood. This study utilizes data on the dinosaur fossil record to examine spatial patterns in terrestrial biodiversity throughout the Mesozoic.\ud Location  We compiled data on fossil occurrences across the globe.\ud Methods  We compiled a comprehensive dataset of Mesozoic dinosaur genera (738), including birds. Following the utilization of sampling standardization techniques to mediate for the uneven sampling of the fossil record, we constructed latitudinal patterns of biodiversity from this dataset.\ud Results  The dominant group of Mesozoic terrestrial vertebrates did not conform to the modern LBG. Instead, dinosaur diversity was highest at temperate palaeolatitudes throughout the 160 million year span of dinosaurian evolutionary history. Latitudinal diversity correlates strongly with the distribution of land area. Late Cretaceous sauropods and ornithischians exhibit disparate LBGs.\ud Main conclusions  The continuity of the palaeotemperate peak in dinosaur diversity indicates a diminished role for climate on the Mesozoic LBG; instead, dinosaur diversity may have been driven by the amount of land area among latitudinal belts. There is no evidence that the tropics acted as a cradle for dinosaur diversity. Geographical partitioning among major clades of herbivorous dinosaurs in the Late Cretaceous may result from the advanced stages of continental fragmentation and/or differing responses to increasing latitudinal climatic zonation. Our results suggest that the modern-day LBG on land was only established 30 million years ago, following a significant post-Eocene recalibration, potentially related to increased seasonality

The apparent exponential radiation of Phanerozoic land vertebrates is an artefact of spatial sampling biases

There is no consensus about how terrestrial biodiversity was assembled through deep time, and in particular whether it has risen exponentially over the Phanerozoic. Using a database of 60 859 fossil occurrences, we show that the spatial extent of the worldwide terrestrial tetrapod fossil record itself expands exponentially through the Phanerozoic. Changes in spatial sampling explain up to 67% of the change in known fossil species counts, and these changes are decoupled from variation in habitable land area that existed through time. Spatial sampling therefore represents a real and profound sampling bias that cannot be explained as redundancy. To address this bias, we estimate terrestrial tetrapod diversity for palaeogeographical regions of approximately equal size. We find that regional-scale diversity was constrained over timespans of tens to hundreds of millions of years, and similar patterns are recovered for major subgroups, such as dinosaurs, mammals and squamates. Although the Cretaceous/Palaeogene mass extinction catalysed an abrupt two- to three-fold increase in regional diversity 66 million years ago, no further increases occurred, and recent levels of regional diversity do not exceed those of the Palaeogene. These results parallel those recovered in analyses of local community-level richness. Taken together, our findings strongly contradict past studies that suggested unbounded diversity increases at local and regional scales over the last 100 million years

Replicate high-density rat genome oligonucleotide microarrays reveal hundreds of regulated genes in the dorsal root ganglion after peripheral nerve injury.

BACKGROUND: Rat oligonucleotide microarrays were used to detect changes in gene expression in the dorsal root ganglion (DRG) 3 days following sciatic nerve transection (axotomy). Two comparisons were made using two sets of triplicate microarrays, naïve versus naïve and naïve versus axotomy. RESULTS: Microarray variability was assessed using the naïve versus naïve comparison. These results support use of a P < 0.05 significance threshold for detecting regulated genes, despite the large number of hypothesis tests required. For the naïve versus axotomy comparison, a 2-fold cut off alone led to an estimated error rate of 16%; combining a >1.5-fold expression change and P < 0.05 significance reduced the estimated error to 5%. The 2-fold cut off identified 178 genes while the combined >1.5-fold and P < 0.05 criteria generated 240 putatively regulated genes, which we have listed. Many of these have not been described as regulated in the DRG by axotomy. Northern blot, quantitative slot blots and in situ hybridization verified the expression of 24 transcripts. These data showed an 83% concordance rate with the arrays; most mismatches represent genes with low expression levels reflecting limits of array sensitivity. A significant correlation was found between actual mRNA differences and relative changes between microarrays (r(2 )= 0.8567). Temporal patterns of individual genes regulation varied. CONCLUSIONS: We identify parameters for microarray analysis which reduce error while identifying many putatively regulated genes. Functional classification of these genes suggest reorganization of cell structural components, activation of genes expressed by immune and inflammatory cells and down-regulation of genes involved in neurotransmission

Possibilities for pedagogy in Further Education: Harnessing the abundance of literacy

In this report, it is argued that the most salient factor in the contemporary communicative landscape is the sheer abundance and diversity of possibilities for literacy, and that the extent and nature of students' communicative resources is a central issue in education. The text outlines the conceptual underpinnings of the Literacies for Learning in Further Education project in a social view of literacy, and the associated research design, methodology and analytical framework. It elaborates on the notion of the abundance of literacies in students' everyday lives, and on the potential for harnessing these as resources for the enhancement of learning. It provides case studies of changes in practice that have been undertaken by further education staff in order to draw upon students' everyday literacy practices on Travel and Tourism and Multimedia courses. It ends with some of the broad implications for conceptualising learning that arise from researching through the lens of literacy practices

Cord compression defined by MRI is the driving factor behind the decision to operate in Degenerative Cervical Myelopathy despite poor correlation with disease severity.

OBJECTIVES:The mainstay treatment for Degenerative Cervical Myelopathy (DCM) is surgical decompression. Not all cases, however, are suitable for surgery. Recent international guidelines advise surgery for moderate to severe disease as well as progressive mild disease. The goal of this study was to examine the factors in current practice that drive the decision to operate in DCM. STUDY DESIGN:Retrospective cohort study. METHODS:1 year of cervical spine MRI scans (N = 1123) were reviewed to identify patients with DCM with sufficient clinical documentation (N = 39). Variables at surgical assessment were recorded: age, sex, clinical signs and symptoms of DCM, disease severity, and quantitative MRI measures of cord compression. Bivariate correlations were used to compare each variable with the decision to offer the patient an operation. Subsequent multivariable analysis incorporated all significant bivariate correlations. RESULTS:Of the 39 patients identified, 25 (64%) were offered an operation. The decision to operate was significantly associated with narrower non-pathological canal and cord diameters as well as cord compression ratio, explaining 50% of the variance. In a multivariable model, only cord compression ratio was significant (p = 0.017). Examination findings, symptoms, functional disability, disease severity, disease progression, and demographic factors were all non-significant. CONCLUSIONS:Cord compression emerged as the main factor in surgical decision-making prior to the publication of recent guidelines. Newly identified predictors of post-operative outcome were not significantly associated with decision to operate

Publication and related bias in quantitative health services & delivery research : systematic reviews, case studies, inception cohorts and informant interviews

Background Bias in the publication and reporting of research findings (referred to as publication and related bias here) poses a major threat in evidence synthesis and evidence-based decision-making. Although this bias has been well documented in clinical research, little is known about its occurrence and magnitude in health services and delivery research. Objectives To obtain empirical evidence on publication and related bias in quantitative health services and delivery research; to examine current practice in detecting/mitigating this bias in health services and delivery research systematic reviews; and to explore stakeholders’ perception and experiences concerning such bias. Methods The project included five distinct but interrelated work packages. Work package 1 was a systematic review of empirical and methodological studies. Work package 2 involved a survey (meta-epidemiological study) of randomly selected systematic reviews of health services and delivery research topics (n = 200) to evaluate current practice in the assessment of publication and outcome reporting bias during evidence synthesis. Work package 3 included four case studies to explore the applicability of statistical methods for detecting such bias in health services and delivery research. In work package 4 we followed up four cohorts of health services and delivery research studies (total n = 300) to ascertain their publication status, and examined whether publication status was associated with statistical significance or perceived ‘positivity’ of study findings. Work package 5 involved key informant interviews with diverse health services and delivery research stakeholders (n = 24), and a focus group discussion with patient and service user representatives (n = 8). Results We identified only four studies that set out to investigate publication and related bias in health services and delivery research in work package 1. Three of these studies focused on health informatics research and one concerned health economics. All four studies reported evidence of the existence of this bias, but had methodological weaknesses. We also identified three health services and delivery research systematic reviews in which findings were compared between published and grey/unpublished literature. These reviews found that the quality and volume of evidence and effect estimates sometimes differed significantly between published and unpublished literature. Work package 2 showed low prevalence of considering/assessing publication (43%) and outcome reporting (17%) bias in health services and delivery research systematic reviews. The prevalence was lower among reviews of associations than among reviews of interventions. The case studies in work package 3 highlighted limitations in current methods for detecting these biases due to heterogeneity and potential confounders. Follow-up of health services and delivery research cohorts in work package 4 showed positive association between publication status and having statistically significant or positive findings. Diverse views concerning publication and related bias and insights into how features of health services and delivery research might influence its occurrence were uncovered through the interviews with health services and delivery research stakeholders and focus group discussion conducted in work package 5. Conclusions This study provided prima facie evidence on publication and related bias in quantitative health services and delivery research. This bias does appear to exist, but its prevalence and impact may vary depending on study characteristics, such as study design, and motivation for conducting the evaluation. Emphasis on methodological novelty and focus beyond summative assessments may mitigate/lessen the risk of such bias in health services and delivery research. Methodological and epistemological diversity in health services and delivery research and changing landscape in research publication need to be considered when interpreting the evidence. Collection of further empirical evidence and exploration of optimal health services and delivery research practice are required

Reported outcomes in transsphenoidal surgery for pituitary adenomas: a systematic review

PURPOSE: Transsphenoidal surgery is an established treatment for pituitary adenomas. We examined outcomes and time points following transsphenoidal surgery for pituitary adenoma to identify reporting heterogeneity within the literature. METHODS: A systematic review of studies that reported outcomes for transsphenoidal surgery for pituitary adenoma 1990–2021 were examined. The protocol was registered a priori and adhered to the PRISMA statement. Studies in English with > 10 patients (prospective) or > 500 patients (retrospective) were included. RESULTS: 178 studies comprising 427,659 patients were included. 91 studies reported 2 or more adenoma pathologies within the same study; 53 studies reported a single pathology. The most common adenomas reported were growth hormone-secreting (n = 106), non-functioning (n = 101), and ACTH-secreting (n = 95); 27 studies did not state a pathology. Surgical complications were the most reported outcome (n = 116, 65%). Other domains included endocrine (n = 104, 58%), extent of resection (n = 81, 46%), ophthalmic (n = 66, 37%), recurrence (n = 49, 28%), quality of life (n = 25, 19%); and nasal (n = 18, 10%). Defined follow up time points were most reported for endocrine (n = 56, 31%), extent of resection (n = 39, 22%), and recurrence (n = 28, 17%). There was heterogeneity in the follow up reported for all outcomes at different time points: discharge (n = 9),  1 year (n = 69). CONCLUSION: Outcomes and follow up reported for transsphenoidal surgical resection of pituitary adenoma are heterogenous over the last 30 years. This study highlights the necessity to develop a robust, consensus-based, minimum, core outcome set. The next step is to develop a Delphi survey of essential outcomes, followed by a consensus meeting of interdisciplinary experts. Patient representatives should also be included. An agreed core outcome set will enable homogeneous reporting and meaningful research synthesis, ultimately improving patient care

Reported baseline variables in transsphenoidal surgery for pituitary adenoma over a 30 year period: a systematic review

Purpose: Heterogeneous reporting in baseline variables in patients undergoing transsphenoidal resection of pituitary adenoma precludes meaningful meta-analysis. We therefore examined trends in reported baseline variables, and degree of heterogeneity of reported variables in 30 years of literature. Methods: A systematic review of PubMed and Embase was conducted on studies that reported outcomes for transsphenoidal surgery for pituitary adenoma 1990–2021. The protocol was registered a priori and adhered to the PRISMA statement. Full-text studies in English with &gt; 10 patients (prospective), &gt; 500 patients (retrospective), or randomised trials were included. Results: 178 studies were included, comprising 427,659 patients: 52 retrospective (29%); 118 prospective (66%); 9 randomised controlled trials (5%). The majority of studies were published in the last 10 years (71%) and originated from North America (38%). Most studies described patient demographics, such as age (165 studies, 93%) and sex (164 studies, 92%). Ethnicity (24%) and co-morbidities (25%) were less frequently reported. Clinical baseline variables included endocrine (60%), ophthalmic (34%), nasal (7%), and cognitive (5%). Preoperative radiological variables were described in 132 studies (74%). MRI alone was the most utilised imaging modality (67%). Further specific radiological baseline variables included: tumour diameter (52 studies, 39%); tumour volume (28 studies, 21%); cavernous sinus invasion (53 studies, 40%); Wilson Hardy grade (25 studies, 19%); Knosp grade (36 studies, 27%). Conclusions: There is heterogeneity in the reporting of baseline variables in patients undergoing transsphenoidal surgery for pituitary adenoma. This review supports the need to develop a common data element to facilitate meaningful comparative research, trial design, and reduce research inefficiency