Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe

Factors Associated with Revision Surgery after Internal Fixation of Hip Fractures

Background: Femoral neck fractures are associated with high rates of revision surgery after management with internal fixation. Using data from the Fixation using Alternative Implants for the Treatment of Hip fractures (FAITH) trial evaluating methods of internal fixation in patients with femoral neck fractures, we investigated associations between baseline and surgical factors and the need for revision surgery to promote healing, relieve pain, treat infection or improve function over 24 months postsurgery. Additionally, we investigated factors associated with (1) hardware removal and (2) implant exchange from cancellous screws (CS) or sliding hip screw (SHS) to total hip arthroplasty, hemiarthroplasty, or another internal fixation device. Methods: We identified 15 potential factors a priori that may be associated with revision surgery, 7 with hardware removal, and 14 with implant exchange. We used multivariable Cox proportional hazards analyses in our investigation. Results: Factors associated with increased risk of revision surgery included: female sex, [hazard ratio (HR) 1.79, 95% confidence interval (CI) 1.25-2.50; P = 0.001], higher body mass index (fo

Study protocol for FUTURES: Testing a web-based reproductive health education program for adolescent and young adult males with sickle cell disease.

Individuals with sickle cell disease are increasingly surviving into adulthood, many of whom have interest in future biological parenthood. Reproductive health knowledge is low among adolescent and young adult males and their caregivers. Their understanding of these topics is needed to optimize their reproductive health outcomes. As such, through collaboration with a community advisory board (adolescents and young adults with sickle cell disease and mothers of adolescent and young adult males with sickle cell disease) and digital design team, we developed a web-based sickle cell disease-focused reproductive health program entitled FUTURES to address these knowledge gaps. For phase I of this two phase feasibility and acceptability study, adolescent and young adult males and their caregivers will complete a pre- and post-program reproductive health knowledge and attitudes questionnaire to assess change in knowledge. In phase II, after learning about fertility testing as part of the FUTURES curriculum, adolescent and young adult male participants are given the option to pursue testing. The two-phase study aims to: 1) develop and test the feasibility, acceptability, and efficacy of a reproductive health web-based educational program at increasing reproductive health knowledge in male adolescent and young adult males with sickle cell disease and their caregivers, and 2) assess feasibility of fertility testing. The long-term goal is to improve reproductive and psychosocial outcomes among adolescent and young adult males with sickle cell disease

Fracture fixation in the operative management of hip fractures (FAITH): an international, multicentre, randomised controlled trial

Background Reoperation rates are high after surgery for hip fractures. We investigated the effect of a sliding hip screw versus cancellous screws on the risk of reoperation and other key outcomes. Methods For this international, multicentre, allocation concealed randomised controlled trial, we enrolled patients aged 50 years or older with a low-energy hip fracture requiring fracture fixation from 81 clinical centres in eight countries. Patients were assigned by minimisation with a centralised computer system to receive a single large-diameter screw with a side-plate (sliding hip screw) or the present standard of care, multiple small-diameter cancellous screws. Surgeons and patients were not blinded but the data analyst, while doing the analyses, remained blinded to treatment groups. The primary outcome was hip reoperation within 24 months after initial surgery to promote fracture healing, relieve pain, treat infection, or improve function. Analyses followed the intention-to-treat principle. This study was registered with ClinicalTrials.gov, number NCT00761813. Findings Between Mar

Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical science. © The Author(s) 2019. Published by Oxford University Press