Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe

qFibrosis: A fully-quantitative innovative method incorporating histological features to facilitate accurate fibrosis scoring in animal model and chronic hepatitis B patients

Background & Aims: There is increasing need for accurate assessment of liver fibrosis/cirrhosis. We aimed to develop qFibrosis, a fully-automated assessment method combining quantification of histopathological architectural features, to address unmet needs in core biopsy evaluation of fibrosis in chronic hepatitis B (CHB) patients. Methods: qFibrosis was established as a combined index based on 87 parameters of architectural features. Images acquired from 25 Thioacetamide-treated rat samples and 162 CHB core biopsies were used to train and test qFibrosis and to demonstrate its reproducibility. qFibrosis scoring was analyzed employing Metavir and Ishak fibrosis staging as standard references, and collagen proportionate area (CPA) measurement for comparison. Results: qFibrosis faithfully and reliably recapitulates Metavir fibrosis scores, as it can identify differences between all stages in both animal samples (p <0.001) and human biopsies (p <0.05). It is robust to sampling size, allowing for discrimination of different stages in samples of different sizes (area under the curve (AUC): 0.93–0.99 for animal samples: 1–16 mm[superscript 2]; AUC: 0.84–0.97 for biopsies: 10–44 mm in length). qFibrosis can significantly predict staging underestimation in suboptimal biopsies (<15 mm) and under- and over-scoring by different pathologists (p <0.001). qFibrosis can also differentiate between Ishak stages 5 and 6 (AUC: 0.73, p = 0.008), suggesting the possibility of monitoring intra-stage cirrhosis changes. Best of all, qFibrosis demonstrates superior performance to CPA on all counts. Conclusions: qFibrosis can improve fibrosis scoring accuracy and throughput, thus allowing for reproducible and reliable analysis of efficacies of anti-fibrotic therapies in clinical research and practice.Janssen Pharmaceutical Ltd.Singapore-MIT Alliance for Research and Technolog

Immunocompromised patients with acute respiratory distress syndrome : Secondary analysis of the LUNG SAFE database

The aim of this study was to describe data on epidemiology, ventilatory management, and outcome of acute respiratory distress syndrome (ARDS) in immunocompromised patients. Methods: We performed a post hoc analysis on the cohort of immunocompromised patients enrolled in the Large Observational Study to Understand the Global Impact of Severe Acute Respiratory Failure (LUNG SAFE) study. The LUNG SAFE study was an international, prospective study including hypoxemic patients in 459 ICUs from 50 countries across 5 continents. Results: Of 2813 patients with ARDS, 584 (20.8%) were immunocompromised, 38.9% of whom had an unspecified cause. Pneumonia, nonpulmonary sepsis, and noncardiogenic shock were their most common risk factors for ARDS. Hospital mortality was higher in immunocompromised than in immunocompetent patients (52.4% vs 36.2%; p < 0.0001), despite similar severity of ARDS. Decisions regarding limiting life-sustaining measures were significantly more frequent in immunocompromised patients (27.1% vs 18.6%; p < 0.0001). Use of noninvasive ventilation (NIV) as first-line treatment was higher in immunocompromised patients (20.9% vs 15.9%; p = 0.0048), and immunodeficiency remained independently associated with the use of NIV after adjustment for confounders. Forty-eight percent of the patients treated with NIV were intubated, and their mortality was not different from that of the patients invasively ventilated ab initio. Conclusions: Immunosuppression is frequent in patients with ARDS, and infections are the main risk factors for ARDS in these immunocompromised patients. Their management differs from that of immunocompetent patients, particularly the greater use of NIV as first-line ventilation strategy. Compared with immunocompetent subjects, they have higher mortality regardless of ARDS severity as well as a higher frequency of limitation of life-sustaining measures. Nonetheless, nearly half of these patients survive to hospital discharge. Trial registration: ClinicalTrials.gov, NCT02010073. Registered on 12 December 2013

Critical care usage after major gastrointestinal and liver surgery: a prospective, multicentre observational study

Background: Patient selection for critical care admission must balance patient safety with optimal resource allocation. This study aimed to determine the relationship between critical care admission, and postoperative mortality after abdominal surgery. Methods: This prespecified secondary analysis of a multicentre, prospective, observational study included consecutive patients enrolled in the DISCOVER study from UK and Republic of Ireland undergoing major gastrointestinal and liver surgery between October and December 2014. The primary outcome was 30-day mortality. Multivariate logistic regression was used to explore associations between critical care admission (planned and unplanned) and mortality, and inter-centre variation in critical care admission after emergency laparotomy. Results: Of 4529 patients included, 37.8% (n=1713) underwent planned critical care admissions from theatre. Some 3.1% (n=86/2816) admitted to ward-level care subsequently underwent unplanned critical care admission. Overall 30-day mortality was 2.9% (n=133/4519), and the risk-adjusted association between 30-day mortality and critical care admission was higher in unplanned [odds ratio (OR): 8.65, 95% confidence interval (CI): 3.51–19.97) than planned admissions (OR: 2.32, 95% CI: 1.43–3.85). Some 26.7% of patients (n=1210/4529) underwent emergency laparotomies. After adjustment, 49.3% (95% CI: 46.8–51.9%, P&lt;0.001) were predicted to have planned critical care admissions, with 7% (n=10/145) of centres outside the 95% CI. Conclusions: After risk adjustment, no 30-day survival benefit was identified for either planned or unplanned postoperative admissions to critical care within this cohort. This likely represents appropriate admission of the highest-risk patients. Planned admissions in selected, intermediate-risk patients may present a strategy to mitigate the risk of unplanned admission. Substantial inter-centre variation exists in planned critical care admissions after emergency laparotomies

Critical care usage after major gastrointestinal and liver surgery: a prospective, multicentre observational study

Background Patient selection for critical care admission must balance patient safety with optimal resource allocation. This study aimed to determine the relationship between critical care admission, and postoperative mortality after abdominal surgery. Methods This prespecified secondary analysis of a multicentre, prospective, observational study included consecutive patients enrolled in the DISCOVER study from UK and Republic of Ireland undergoing major gastrointestinal and liver surgery between October and December 2014. The primary outcome was 30-day mortality. Multivariate logistic regression was used to explore associations between critical care admission (planned and unplanned) and mortality, and inter-centre variation in critical care admission after emergency laparotomy. Results Of 4529 patients included, 37.8% (n=1713) underwent planned critical care admissions from theatre. Some 3.1% (n=86/2816) admitted to ward-level care subsequently underwent unplanned critical care admission. Overall 30-day mortality was 2.9% (n=133/4519), and the risk-adjusted association between 30-day mortality and critical care admission was higher in unplanned [odds ratio (OR): 8.65, 95% confidence interval (CI): 3.51–19.97) than planned admissions (OR: 2.32, 95% CI: 1.43–3.85). Some 26.7% of patients (n=1210/4529) underwent emergency laparotomies. After adjustment, 49.3% (95% CI: 46.8–51.9%, P<0.001) were predicted to have planned critical care admissions, with 7% (n=10/145) of centres outside the 95% CI. Conclusions After risk adjustment, no 30-day survival benefit was identified for either planned or unplanned postoperative admissions to critical care within this cohort. This likely represents appropriate admission of the highest-risk patients. Planned admissions in selected, intermediate-risk patients may present a strategy to mitigate the risk of unplanned admission. Substantial inter-centre variation exists in planned critical care admissions after emergency laparotomies

Body mass index and complications following major gastrointestinal surgery: A prospective, international cohort study and meta-analysis

Aim Previous studies reported conflicting evidence on the effects of obesity on outcomes after gastrointestinal surgery. The aims of this study were to explore the relationship of obesity with major postoperative complications in an international cohort and to present a metaanalysis of all available prospective data. Methods This prospective, multicentre study included adults undergoing both elective and emergency gastrointestinal resection, reversal of stoma or formation of stoma. The primary end-point was 30-day major complications (Clavien–Dindo Grades III–V). A systematic search was undertaken for studies assessing the relationship between obesity and major complications after gastrointestinal surgery. Individual patient meta-analysis was used to analyse pooled results. Results This study included 2519 patients across 127 centres, of whom 560 (22.2%) were obese. Unadjusted major complication rates were lower in obese vs normal weight patients (13.0% vs 16.2%, respectively), but this did not reach statistical significance (P = 0.863) on multivariate analysis for patients having surgery for either malignant or benign conditions. Individual patient meta-analysis demonstrated that obese patients undergoing surgery formalignancy were at increased risk of major complications (OR 2.10, 95% CI 1.49–2.96, P < 0.001), whereas obese patients undergoing surgery for benign indications were at decreased risk (OR 0.59, 95% CI 0.46–0.75, P < 0.001) compared to normal weight patients. Conclusions In our international data, obesity was not found to be associated with major complications following gastrointestinal surgery. Meta-analysis of available prospective data made a novel finding of obesity being associated with different outcomes depending on whether patients were undergoing surgery for benign or malignant disease

Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical science. © The Author(s) 2019. Published by Oxford University Press