Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe

Review of solar energetic particle models

Solar Energetic Particle (SEP) events are interesting from a scientific perspective as they are the product of a broad set of physical processes from the corona out through the extent of the heliosphere, and provide insight into processes of particle acceleration and transport that are widely applicable in astrophysics. From the operations perspective, SEP events pose a radiation hazard for aviation, electronics in space, and human space exploration, in particular for missions outside of the Earth’s protective magnetosphere including to the Moon and Mars. Thus, it is critical to improve the scientific understanding of SEP events and use this understanding to develop and improve SEP forecasting capabilities to support operations. Many SEP models exist or are in development using a wide variety of approaches and with differing goals. These include computationally intensive physics-based models, fast and light empirical models, machine learning-based models, and mixed-model approaches. The aim of this paper is to summarize all of the SEP models currently developed in the scientific community, including a description of model approach, inputs and outputs, free parameters, and any published validations or comparisons with data.</p

Functional and quality of life outcomes of localised prostate cancer treatments (prostate testing for cancer and treatment [ProtecT] study)

Objective To investigate the functional and quality of life (QoL) outcomes of treatments for localised prostate cancer and inform treatment decision-making. Patients and Methods Men aged 50–69 years diagnosed with localised prostate cancer by prostate-specific antigen testing and biopsies at nine UK centres in the Prostate Testing for Cancer and Treatment (ProtecT) trial were randomised to, or chose one of, three treatments. Of 2565 participants, 1135 men received active monitoring (AM), 750 a radical prostatectomy (RP), 603 external-beam radiotherapy (EBRT) with concurrent androgen-deprivation therapy (ADT) and 77 low-dose-rate brachytherapy (BT, not a randomised treatment). Patient-reported outcome measures (PROMs) completed annually for 6 years were analysed by initial treatment and censored for subsequent treatments. Mixed effects models were adjusted for baseline characteristics using propensity scores. Results Treatment-received analyses revealed different impacts of treatments over 6 years. Men remaining on AM experienced gradual declines in sexual and urinary function with age (e.g., increases in erectile dysfunction from 35% of men at baseline to 53% at 6 years and nocturia similarly from 20% to 38%). Radical treatment impacts were immediate and continued over 6 years. After RP, 95% of men reported erectile dysfunction persisting for 85% at 6 years, and after EBRT this was reported by 69% and 74%, respectively (P < 0.001 compared with AM). After RP, 36% of men reported urinary leakage requiring at least 1 pad/day, persisting for 20% at 6 years, compared with no change in men receiving EBRT or AM (P < 0.001). Worse bowel function and bother (e.g., bloody stools 6% at 6 years and faecal incontinence 10%) was experienced by men after EBRT than after RP or AM (P < 0.001) with lesser effects after BT. No treatment affected mental or physical QoL. Conclusion Treatment decision-making for localised prostate cancer can be informed by these 6-year functional and QoL outcomes