Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe

The impact of reporting magnetic resonance imaging incidental findings in the Canadian alliance for healthy hearts and minds cohort

Background In the Canadian Alliance for Healthy Hearts and Minds (CAHHM) cohort, participants underwent magnetic resonance imaging (MRI) of the brain, heart, and abdomen, that generated incidental findings (IFs). The approach to managing these unexpected results remain a complex issue. Our objectives were to describe the CAHHM policy for the management of IFs, to understand the impact of disclosing IFs to healthy research participants, and to reflect on the ethical obligations of researchers in future MRI studies. Methods Between 2013 and 2019, 8252 participants (mean age 58 ± 9 years, 54% women) were recruited with a follow-up questionnaire administered to 909 participants (40% response rate) at 1-year. The CAHHM policy followed a restricted approach, whereby routine feedback on IFs was not provided. Only IFs of severe structural abnormalities were reported. Results Severe structural abnormalities occurred in 8.3% (95% confidence interval 7.7–8.9%) of participants, with the highest proportions found in the brain (4.2%) and abdomen (3.1%). The majority of participants (97%) informed of an IF reported no change in quality of life, with 3% of participants reporting that the knowledge of an IF negatively impacted their quality of life. Furthermore, 50% reported increased stress in learning about an IF, and in 95%, the discovery of an IF did not adversely impact his/her life insurance policy. Most participants (90%) would enrol in the study again and perceived the MRI scan to be beneficial, regardless of whether they were informed of IFs. While the implications of a restricted approach to IF management was perceived to be mostly positive, a degree of diagnostic misconception was present amongst participants, indicating the importance of a more thorough consent process to support participant autonomy. Conclusion The management of IFs from research MRI scans remain a challenging issue, as participants may experience stress and a reduced quality of life when IFs are disclosed. The restricted approach to IF management in CAHHM demonstrated a fair fulfillment of the overarching ethical principles of respect for autonomy, concern for wellbeing, and justice. The approach outlined in the CAHHM policy may serve as a framework for future research studies. Clinical trial registration https://clinicaltrials.gov/ct2/show/NCT02220582 .Medicine, Faculty ofNon UBCPopulation and Public Health (SPPH), School ofReviewedFacultyResearche

Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical science. © The Author(s) 2019. Published by Oxford University Press

Pancreatic surgery outcomes: multicentre prospective snapshot study in 67 countries

Background: Pancreatic surgery remains associated with high morbidity rates. Although postoperative mortality appears to have improved with specialization, the outcomes reported in the literature reflect the activity of highly specialized centres. The aim of this study was to evaluate the outcomes following pancreatic surgery worldwide.Methods: This was an international, prospective, multicentre, cross-sectional snapshot study of consecutive patients undergoing pancreatic operations worldwide in a 3-month interval in 2021. The primary outcome was postoperative mortality within 90 days of surgery. Multivariable logistic regression was used to explore relationships with Human Development Index (HDI) and other parameters.Results: A total of 4223 patients from 67 countries were analysed. A complication of any severity was detected in 68.7 percent of patients (2901 of 4223). Major complication rates (Clavien-Dindo grade at least IIIa) were 24, 18, and 27 percent, and mortality rates were 10, 5, and 5 per cent in low-to-middle-, high-, and very high-HDI countries respectively. The 90-day postoperative mortality rate was 5.4 per cent (229 of 4223) overall, but was significantly higher in the low-to-middle-HDI group (adjusted OR 2.88, 95 per cent c.i. 1.80 to 4.48). The overall failure-to-rescue rate was 21 percent; however, it was 41 per cent in low-to-middle-compared with 19 per cent in very high-HDI countries.Conclusion: Excess mortality in low-to-middle-HDI countries could be attributable to failure to rescue of patients from severe complications. The authors call for a collaborative response from international and regional associations of pancreatic surgeons to address management related to death from postoperative complications to tackle the global disparities in the outcomes of pancreatic surgery (NCT04652271; ISRCTN95140761)