Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe

Transplantid.net: A Pilot Crowdsourced, Living, Online Library of Resources for the Teaching and Practice of Transplant Infectious Diseases

The field of transplant infectious diseases is rapidly evolving, presenting a challenge for clinical practice and trainee education. Here we describe the construction of transplantid.net, a free online library, crowdsourced and continuously updated for the dual purpose of point-of-care evidence-based management and teaching

International collaboration to assess the risk of Guillain Barre Syndrome following Influenza A (H1N1) 2009 monovalent vaccines

<p>Background: The global spread of the 2009 novel pandemic influenza A (H1N1) virus led to the accelerated production and distribution of monovalent 2009 Influenza A (H1N1) vaccines (pH1N1). This pandemic provided the opportunity to evaluate the risk of Guillain-Barre syndrome (GBS), which has been an influenza vaccine safety concern since the swine flu pandemic of 1976, using a common protocol among high and middle-income countries. The primary objective of this project was to demonstrate the feasibility and utility of global collaboration in the assessment of vaccine safety, including countries both with and without an established infrastructure for vaccine active safety surveillance. A second objective, included a priori, was to assess the risk of GBS following pH1N1 vaccination.</p><p>Methods: The primary analysis used the self-controlled case series (SCCS) design to estimate the relative incidence (RI) of GBS in the 42 days following vaccination with pH1N1 vaccine in a pooled analysis across databases and in analysis using a meta-analytic approach.</p><p>Results: We found a relative incidence of GBS of 2.42(95% CI 1.58-3.72) in the 42 days following exposure to pH1N1 vaccine in analysis of pooled data and 2.09(95% CI 1.28-3.42) using the meta-analytic approach.</p><p>Conclusions: This study demonstrates that international collaboration to evaluate serious outcomes using a common protocol is feasible. The significance and consistency of our findings support a conclusion of an association between 2009 H1N1 vaccination and GBS. Given the rarity of the event the relative incidence found does not provide evidence in contradiction to international recommendations for the continued use of influenza vaccines. (C) 2013 Elsevier Ltd. All rights reserved.</p>