Justification of research using systematic reviews continues to be inconsistent in clinical health science:A systematic review and meta-analysis of meta-research studies

BACKGROUND: Redundancy is an unethical, unscientific, and costly challenge in clinical health research. There is a high risk of redundancy when existing evidence is not used to justify the research question when a new study is initiated. Therefore, the aim of this study was to synthesize meta-research studies evaluating if and how authors of clinical health research studies use systematic reviews when initiating a new study. METHODS: Seven electronic bibliographic databases were searched (final search June 2021). Meta-research studies assessing the use of systematic reviews when justifying new clinical health studies were included. Screening and data extraction were performed by two reviewers independently. The primary outcome was defined as the percentage of original studies within the included meta-research studies using systematic reviews of previous studies to justify a new study. Results were synthesized narratively and quantitatively using a random-effects meta-analysis. The protocol has been registered in Open Science Framework (https://osf.io/nw7ch/). RESULTS: Twenty-one meta-research studies were included, representing 3,621 original studies or protocols. Nineteen of the 21 studies were included in the meta-analysis. The included studies represented different disciplines and exhibited wide variability both in how the use of previous systematic reviews was assessed, and in how this was reported. The use of systematic reviews to justify new studies varied from 16% to 87%. The mean percentage of original studies using systematic reviews to justify their study was 42% (95% CI: 36% to 48%). CONCLUSION: Justification of new studies in clinical health research using systematic reviews is highly variable, and fewer than half of new clinical studies in health science were justified using a systematic review. Research redundancy is a challenge for clinical health researchers, as well as for funders, ethics committees, and journals

Systematic reviews are rarely used to contextualise new results-a systematic review and meta-analysis of meta-research studies

BACKGROUND: Results of new studies should be interpreted in the context of what is already known to compare results and build the state of the science. This systematic review and meta-analysis aimed to identify and synthesise results from meta-research studies examining if original studies within health use systematic reviews to place their results in the context of earlier, similar studies. METHODS: We searched MEDLINE (OVID), EMBASE (OVID), and the Cochrane Methodology Register for meta-research studies reporting the use of systematic reviews to place results of original clinical studies in the context of existing studies. The primary outcome was the percentage of original studies included in the meta-research studies using systematic reviews or meta-analyses placing new results in the context of existing studies. Two reviewers independently performed screening and data extraction. Data were synthesised using narrative synthesis and a random-effects meta-analysis was performed to estimate the mean proportion of original studies placing their results in the context of earlier studies. The protocol was registered in Open Science Framework. RESULTS: We included 15 meta-research studies, representing 1724 original studies. The mean percentage of original studies within these meta-research studies placing their results in the context of existing studies was 30.7% (95% CI [23.8%, 37.6%], I(2)=87.4%). Only one of the meta-research studies integrated results in a meta-analysis, while four integrated their results within a systematic review; the remaining cited or referred to a systematic review. The results of this systematic review are characterised by a high degree of heterogeneity and should be interpreted cautiously. CONCLUSION: Our systematic review demonstrates a low rate of and great variability in using systematic reviews to place new results in the context of existing studies. On average, one third of the original studies contextualised their results. Improvement is still needed in researchers’ use of prior research systematically and transparently—also known as the use of an evidence-based research approach, to contribute to the accumulation of new evidence on which future studies should be based. SYSTEMATIC REVIEW REGISTRATION: Open Science registration number https://osf.io/8gkzu/ SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s13643-022-02062-8

Challenges in Australian policy processes for disinvestment from existing, ineffective health care practices

Background Internationally, many health care interventions were diffused prior to the standard use of assessments of safety, effectiveness and cost-effectiveness. Disinvestment from ineffective or inappropriately applied practices is a growing priority for health care systems for reasons of improved quality of care and sustainability of resource allocation. In this paper we examine key challenges for disinvestment from these interventions and explore potential policy-related avenues to advance a disinvestment agenda. Results We examine five key challenges in the area of policy driven disinvestment: 1) lack of resources to support disinvestment policy mechanisms; 2) lack of reliable administrative mechanisms to identify and prioritise technologies and/or practices with uncertain clinical and cost-effectiveness; 3) political, clinical and social challenges to removing an established technology or practice; 4) lack of published studies with evidence demonstrating that existing technologies/practices provide little or no benefit (highlighting complexity of design) and; 5) inadequate resources to support a research agenda to advance disinvestment methods. Partnerships are required to involve government, professional colleges and relevant stakeholder groups to put disinvestment on the agenda. Such partnerships could foster awareness raising, collaboration and improved health outcome data generation and reporting. Dedicated funds and distinct processes could be established within the Medical Services Advisory Committee and Pharmaceutical Benefits Advisory Committee to, a) identify technologies and practices for which there is relative uncertainty that could be the basis for disinvestment analysis, and b) conduct disinvestment assessments of selected item(s) to address existing practices in an analogous manner to the current focus on new and emerging technology. Finally, dedicated funding and cross-disciplinary collaboration is necessary to build health services and policy research capacity, with a focus on advancing disinvestment research methodologies and decision support tools. Conclusion The potential over-utilisation of less than effective clinical practices and the potential under-utilisation of effective clinical practices not only result in less than optimal care but also fragmented, inefficient and unsustainable resource allocation. Systematic policy approaches to disinvestment will improve equity, efficiency, quality and safety of care, as well as sustainability of resource allocation.Adam G Elshaug, Janet E Hiller, Sean R Tunis and John R Mos

Identifying the need for good practices in Health Technology Assessment : summary of the ISPOR HTA Council Working Group Report on Good Practices in HTA

The systematic use of evidence to inform healthcare decisions, particularly health technology assessment (HTA), has gained increased recognition. HTA has become a standard policy tool for informing decision makers who must manage the entry and use of pharmaceuticals, medical devices, and other technologies (including complex interventions) within health systems, for example, through reimbursement and pricing. Despite increasing attention to HTA activities, there has been no attempt to comprehensively synthesize good practices or emerging good practices to support populationbased decision-making in recent years. After the identification of some good practices through the release of the ISPOR Guidelines Index in 2013, the ISPOR HTA Council identified a need to more thoroughly review existing guidance. The purpose of this effort was to create a basis for capacity building, education, and improved consistency in approaches to HTA-informed decision-making. Our findings suggest that although many good practices have been developed in areas of assessment and some other key aspects of defining HTA processes, there are also many areas where good practices are lacking. This includes good practices in defining the organizational aspects of HTA, the use of deliberative processes, and measuring the impact of HTA. The extent to which these good practices are used and applied by HTA bodies is beyond the scope of this report, but may be of interest to future researchers

Epithelial-immune cell interplay in primary Sjogren syndrome salivary gland pathogenesis

In primary Sjogren syndrome (pSS), the function of the salivary glands is often considerably reduced. Multiple innate immune pathways are likely dysregulated in the salivary gland epithelium in pSS, including the nuclear factor-kappa B pathway, the inflammasome and interferon signalling. The ductal cells of the salivary gland in pSS are characteristically surrounded by a CD4(+) T cell-rich and B cell-rich infiltrate, implying a degree of communication between epithelial cells and immune cells. B cell infiltrates within the ducts can initiate the development of lymphoepithelial lesions, including basal ductal cell hyperplasia. Vice versa, the epithelium provides chronic activation signals to the glandular B cell fraction. This continuous stimulation might ultimately drive the development of mucosa-associated lymphoid tissue lymphoma. This Review discusses changes in the cells of the salivary gland epithelium in pSS (including acinar, ductal and progenitor cells), and the proposed interplay of these cells with environmental stimuli and the immune system. Current therapeutic options are insufficient to address both lymphocytic infiltration and salivary gland dysfunction. Successful rescue of salivary gland function in pSS will probably demand a multimodal therapeutic approach and an appreciation of the complicity of the salivary gland epithelium in the development of pSS. Salivary gland dysfunction is an important characteristic of primary Sjogren syndrome (pSS). In this Review, the authors discuss various epithelial abnormalities in pSS and the mechanisms by which epithelial cell-immune cell interactions contribute to disease development and progression