Challenges in evaluating surgical innovation

Research on surgical interventions is associated with several methodological and practical challenges of which few, if any, apply only to surgery. However, surgical evaluation is especially demanding because many of these challenges coincide. In this report, the second of three on surgical innovation and evaluation, we discuss obstacles related to the study design of randomised controlled trials and non-randomised studies assessing surgical interventions. We also describe the issues related to the nature of surgical procedures—for example, their complexity, surgeon-related factors, and the range of outcomes. Although difficult, surgical evaluation is achievable and necessary. Solutions tailored to surgical research and a framework for generating evidence on which to base surgical practice are essential.The Balliol Colloquium has been supported by Ethicon UK with unrestricted educational grants and by the National Institute of Health Research Health Technology Assessment Programme. The Balliol Colloquium was administratively and financially supported by the Nuffield Department of Surgery at the University of Oxford and the Department of Surgery at McGill University. JAC holds a Medical Research Council UK special training fellowship. The University of Aberdeen’s Health Services Research Unit is core funded by the Chief Scientist Offi ce of the Scottish Government Health Directorates. IB is supported by a grant from the Société Française de Rhumatologie and Lavoisier Program (Ministère des Aff aires Etrangères et Européennes). PLE is a DPhil Candidate in Evidence-Based Health Care at Oxford University

Changes in evidence for studies assessing interventions for COVID-19 reported in preprints: meta-research study

Background The increasing use of preprints to disseminate evidence on the effect of interventions for the coronavirus disease 2019 (COVID-19) can lead to multiple evidence sources for a single study, which may differ in the reported evidence. We aim to describe the proportion of evidence on the effect of interventions for COVID-19 from preprints and journal articles and map changes in evidence between and within different sources reporting on the same study. Methods Meta-research study. We screened the Cochrane living systematic review and network meta-analysis (COVID-NMA) database to identify all preprints and journal articles on all studies assessing interventions for COVID-19 published up to 15 August 2020. We compared all evidence sources (i.e., preprint and associated journal article) and the first and latest versions of preprints for each study to identify changes in two evidence components: study results (e.g., numeric change in hazard ratio, odds ratio, event rate, or change in p value > or < 0.05 in any outcome) and abstract conclusions (classified as positive, negative or neutral regarding the intervention effect, and as reporting uncertainty in the findings or not). Changes in study results were further classified as important changes if they (1) represented a change in any effect estimate by ≥ 10% and/or (2) led to a change in the p value crossing the threshold of 0.05. Results We identified 556 studies. In total, 338 (61%) had been reported in a preprint: 66 (20%) of these had an associated journal article (median time to publication 76 days [interquartile range (IQR) 55–106]) and 91 (27%) had > 1 preprint version. A total of 139 studies (25% of the overall sample) were reported in multiple evidence sources or versions of the same source: for 63 (45%), there was a change in at least one evidence component between or within sources (42 [30%] had a change in study results, and in 29 [21%] the change was classified as important; 33 [24%] had a change in the abstract conclusion). For studies with both a preprint and an article, a median of 29% (IQR 14–50) of total citations were attributed to the preprint instead of the article. Conclusions Results on the effect of interventions for COVID-19 are often reported in multiple evidence sources or source versions for a single study. Evidence is not stable between and within evidence sources. Real-time linkage of all sources per study could help to keep systematic reviews up-to-date

Magnetic field and pressure effects on charge density wave, superconducting, and magnetic states in Lu5_5Ir4_4Si10_{10} and Er5_5Ir4_4Si10_{10}

We have studied the charge-density-wave (CDW) state for the superconducting Lu$_5$Ir$_4$Si$_{10}$ and the antiferromagnetic Er$_5$Ir$_4$Si$_{10}$ as variables of temperature, magnetic field, and hydrostatic pressure. For Lu$_5$Ir$_4$Si$_{10}$, the application of pressure strongly suppresses the CDW phase but weakly enhances the superconducting phase. For Er$_5$Ir$_4$Si$_{10}$, the incommensurate CDW state is pressure independent and the commensurate CDW state strongly depends on the pressure, whereas the antiferromagnetic ordering is slightly depressed by applying pressure. In addition, Er$_5$Ir$_4$Si$_{10}$ shows negative magnetoresistance at low temperatures, compared with the positive magnetoresistance of Lu$_5$Ir$_4$Si$_{10}$.Comment: 12 pages, including 6 figure

The study of the mercury cycle in polar regions: An international study in Ny-Alesund, Svalbard

Mercury (Hg) is a toxic pollutant and it can be strongly accumulated in the food chain, especially in Polar Regions. This paper presents a part of the work that has been on-going for 3-4 years in Ny-Alesund, Svalbard within the frame of an international collaboration. In Ny-Alesund in spring 2003, the atmospheric chemistry of mercury has been studied so as to better understand the formation of oxidized mercury species in the atmosphere that could be deposited onto snow surfaces. The role of snow as a potential source of mercury to the atmosphere or as a sink has also been approached to better understand the behavior of this metal. Chemical and biological processes seem to play a major role in Hg storage in snow. When melting, snow could be a major source of Hg into the various ecosystems and this toxin could therefore be accumulated into the food chain

Applicability and generalisability of the results of systematic reviews to public health practice and policy: a systematic review

<p>Abstract</p> <p>Background</p> <p>The purpose of the study was to evaluate systematic reviews of research into two public health priorities, tobacco consumption and HIV infection, in terms of the reporting of data related to the applicability of trial results (i.e., whether the results of a trial can be reasonably applied or generalized to a definable group of patients in a particular setting in routine practice, also called external validity or generalisability).</p> <p>Methods</p> <p>All systematic reviews of interventions aimed at reducing or stopping tobacco use and treating or preventing HIV infection published in the Cochrane database of systematic reviews and in journals indexed in MEDLINE between January 1997 and December 2007 were selected. We used a standardized data abstraction form to extract data related to applicability in terms of the context of the trial, (country, centres, settings), participants (recruitment, inclusion and exclusion criteria, baseline characteristics of participants such as age, sex, ethnicity, coexisting diseases or co-morbidities, and socioeconomic status), treatment (duration, intensity/dose of treatment, timing and delivery format), and the outcomes assessment from selected reviews.</p> <p>Results</p> <p>A total of 98 systematic reviews were selected (57 Cochrane reviews and 41 non-Cochrane reviews); 49 evaluated interventions aimed at reducing or stopping tobacco use and 49 treating or preventing HIV infection. The setting of the individual studies was reported in 45 (46%) of the systematic reviews, the number of centres in 21 (21%), and the country where the trial took place in 62 (63%). Inclusion and exclusion criteria of the included studies were reported in 16 (16%) and 13 (13%) of the reviews, respectively. Baseline characteristics of participants in the included studies were described in 59 (60%) of the reviews. These characteristics concerned age in about half of the reviews, sex in 46 (47%), and ethnicity in 9 (9%).</p> <p>Applicability of results was discussed in 13 (13%) of the systematic reviews. The reporting was better in systematic reviews by the Cochrane Collaboration than by non-Cochrane groups.</p> <p>Conclusions</p> <p>Our study highlighted the lack of consideration of applicability of results in systematic reviews of research into 2 public health priorities: tobacco consumption and HIV infection.</p

Geographical Representativeness of Published and Ongoing Randomized Controlled Trials. The Example of: Tobacco Consumption and HIV Infection

BACKGROUND: The challenge for evidence-based healthcare is to reduce mortality and the burden of diseases. This study aimed to compare where research is conducted to where research is needed for 2 public health priorities: tobacco consumption and HIV infection. METHODS: We identified randomized controlled trials (RCTs) included in Cochrane systematic reviews published between 1997 and 2007 and registered ongoing RCTs identified in January 2009 through the World Health Organization's International Clinical Trials Registry Platform (WHO-ICTRP) evaluating interventions aimed at reducing or stopping tobacco use and treating or preventing HIV infection. We used the WHO and World Bank reports to classify the countries by income level, as well as map the global burden of disease and mortality attributable to tobacco use and HIV infection to the countries where the trials performed. RESULTS: We evaluated 740 RCTs included in systematic reviews and 346 ongoing RCTs. For tobacco use, 4% of RCTs included in systematic reviews and 2% of ongoing trials were performed in low- and middle-income countries, even though these countries represented 70% of the mortality related to tobacco use. For HIV infection, 31% of RCTs included in systematic reviews and 33% of ongoing trials were performed in low- and middle-income countries, even though these countries represented 99% of the mortality related to HIV infection. CONCLUSIONS: Our results highlight an important underrepresentation of low- and middle-income countries in currently available evidence (RCTs included in systematic reviews) and awaiting evidence (registered ongoing RCTs) for reducing or stopping tobacco use and treating or preventing HIV infection

Sources of Pre-Analytical Variations in Yield of DNA Extracted from Blood Samples: Analysis of 50,000 DNA Samples in EPIC

The European Prospective Investigation into Cancer and nutrition (EPIC) is a long-term, multi-centric prospective study in Europe investigating the relationships between cancer and nutrition. This study has served as a basis for a number of Genome-Wide Association Studies (GWAS) and other types of genetic analyses. Over a period of 5 years, 52,256 EPIC DNA samples have been extracted using an automated DNA extraction platform. Here we have evaluated the pre-analytical factors affecting DNA yield, including anthropometric, epidemiological and technical factors such as center of subject recruitment, age, gender, body-mass index, disease case or control status, tobacco consumption, number of aliquots of buffy coat used for DNA extraction, extraction machine or procedure, DNA quantification method, degree of haemolysis and variations in the timing of sample processing. We show that the largest significant variations in DNA yield were observed with degree of haemolysis and with center of subject recruitment. Age, gender, body-mass index, cancer case or control status and tobacco consumption also significantly impacted DNA yield. Feedback from laboratories which have analyzed DNA with different SNP genotyping technologies demonstrate that the vast majority of samples (approximately 88%) performed adequately in different types of assays. To our knowledge this study is the largest to date to evaluate the sources of pre-analytical variations in DNA extracted from peripheral leucocytes. The results provide a strong evidence-based rationale for standardized recommendations on blood collection and processing protocols for large-scale genetic studies

Circulating Osteopontin and Prediction of Hepatocellular Carcinoma Development in a Large European Population.

We previously identified osteopontin (OPN) as a promising marker for the early detection of hepatocellular carcinoma (HCC). In this study, we investigated the association between prediagnostic circulating OPN levels and HCC incidence in a large population-based cohort. A nested case-control study was conducted within the European Prospective Investigation into Cancer and Nutrition (EPIC) cohort. During a mean follow-up of 4.8 years, 100 HCC cases were identified. Each case was matched to two controls and OPN levels were measured in baseline plasma samples. Viral hepatitis, liver function, and α-fetoprotein (AFP) tests were also conducted. Conditional logistic regression models were used to calculate multivariable odds ratio (OR) and 95% confidence intervals (95% CI) for OPN levels in relation to HCC. Receiver operating characteristics curves were constructed to determine the discriminatory accuracy of OPN alone or in combination with other liver biomarkers in the prediction of HCC. OPN levels were positively associated with HCC risk (per 10% increment, ORmultivariable = 1.30; 95% CI, 1.14-1.48). The association was stronger among cases diagnosed within 2 years of follow-up. Adding liver function tests to OPN improved the discriminatory performance for subjects who developed HCC (AUC = 0.86). For cases diagnosed within 2 years, the combination of OPN and AFP was best able to predict HCC risk (AUC = 0.88). The best predictive model for HCC in this low-risk population is OPN in combination with liver function tests. Within 2 years of diagnosis, the combination of OPN and AFP best predicted HCC development, suggesting that measuring OPN and AFP could identify high-risk groups independently of a liver disease diagnosis. Cancer Prev Res; 9(9); 758-65. ©2016 AACR.This work was supported by NIH R01 CA120719 to LB and by the French National Cancer Institute (Institut National du Cancer; INCA) grant number 2009-139 to MJ. The coordination of EPIC is financially supported by the European Commission (DG-SANCO); and the International Agency for Research on Cancer. The national cohorts are supported by Danish Cancer Society (Denmark); Ligue Contre le Cancer; Institut Gustave Roussy; Mutuelle Générale de l’Education Nationale; and Institut National de la Santé et de la Recherche Médicale (INSERM) (France); Deutsche Krebshilfe, Deutsches Krebsforschungszentrum (DKFZ); and Federal Ministry of Education and Research (Germany); Hellenic Health Foundation (Greece); Italian Association for Research on Cancer (AIRC); National Research Council; and AIRE-ONLUS Ragusa, AVIS Ragusa, Sicilian Government (Italy); Dutch Ministry of Public Health, Welfare and Sports (VWS); Netherlands Cancer Registry (NKR); LK Research Funds; Dutch Prevention Funds; Dutch ZON (Zorg Onderzoek Nederland); World Cancer Research Fund (WCRF); and Statistics Netherlands (the Netherlands); European Research Council (ERC) (grant number ERC-2009-AdG 232997) and Nordforsk; and Nordic Center of Excellence Programme on Food, Nutrition and Health (Norway); Health Research Fund (FIS); Regional Governments of Andalucía, Asturias, Basque Country, Murcia (No. 6236) and Navarra; and ISCIII RETIC (RD06/0020) (Spain); Swedish Cancer Society; Swedish Scientific Council; and Regional Government of Skåne and Västerbotten (Sweden); Cancer Research UK; Medical Research Council; Stroke Association; British Heart Foundation; Department of Health; Food Standards Agency; and Wellcome Trust (UK). Reagents for the hepatitis infection determinations were kindly provided by Abbott Diagnostics Division, Lyon, France.This is the author accepted manuscript. The final version is available from the American Association for Cancer Research via http://dx.doi.org/10.1158/1940-6207.CAPR-15-043

Sources of Pre-Analytical Variations in Yield of DNA Extracted from Blood Samples: Analysis of 50,000 DNA Samples in EPIC

The European Prospective Investigation into Cancer and nutrition (EPIC) is a long-term, multi-centric prospective study in Europe investigating the relationships between cancer and nutrition. This study has served as a basis for a number of Genome-Wide Association Studies (GWAS) and other types of genetic analyses. Over a period of 5 years, 52,256 EPIC DNA samples have been extracted using an automated DNA extraction platform. Here we have evaluated the pre-analytical factors affecting DNA yield, including anthropometric, epidemiological and technical factors such as center of subject recruitment, age, gender, body-mass index, disease case or control status, tobacco consumption, number of aliquots of buffy coat used for DNA extraction, extraction machine or procedure, DNA quantification method, degree of haemolysis and variations in the timing of sample processing. We show that the largest significant variations in DNA yield were observed with degree of haemolysis and with center of subject recruitment. Age, gender, body-mass index, cancer case or control status and tobacco consumption also significantly impacted DNA yield. Feedback from laboratories which have analyzed DNA with different SNP genotyping technologies demonstrate that the vast majority of samples (approximately 88%) performed adequately in different types of assays. To our knowledge this study is the largest to date to evaluate the sources of pre-analytical variations in DNA extracted from peripheral leucocytes. The results provide a strong evidence-based rationale for standardized recommendations on blood collection and processing protocols for large-scale genetic studies

Association between pre-diagnostic circulating vitamin D concentration and risk of colorectal cancer in European populations:a nested case-control study

Objective To examine the association between pre-diagnostic circulating vitamin D concentration, dietary intake of vitamin D and calcium, and the risk of colorectal cancer in European populations