Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe

Mateo Santos and the Documentary of Occupation: Cine Social in the Spanish Anarchist Revolution

Examines Santos\u27s 1936 documentary Reportaje del movimiento revolucionario en Barcelona, the first film made about the Spanish Civil War. Tripathi compares Santos\u27s film made for, by, and about working-class people to The Spanish Earth, noting briefly how intended audience (local versus international) affects each film\u27s tone, commentary, and visual imagery

Documents of Revolution: Literacy, Translation and Internationalism in the Spanish Civil War

In “Documents of Revolution” I compare various non-fiction prose genres with incipient journalistic media, including scrapbooks, photographs, films and radio poems, to explore the new internationalisms that emerged during the Spanish Civil War. Many studies of the war have prioritized visiting authors and their experience of travelling Spain. By contrast, I show how local critics, writers, and poets, such as the anarchist filmmaker Mateo Santos, the memoirist María Teresa León, and the poet Miguel Hernández, were crucial intermediaries between Spanish working-class oral cultures and foreign visiting authors, such as George Orwell, Nancy Cunard, Langston Hughes and Nicolás Guillén. I describe three modes of relation between intellectual elites and the working class: occupying, broadcasting, and archiving. By reading for the living internationalism of the working-class, I unearth various internationalisms (anarchist, Black Hispanophone, and feminist-humanitarian) that have not received due attention. These overlapping networks and diasporas ensured that the revolutionary and multimedia documentary poetics of the war disseminated far beyond Spain’s borders

Endoscopic retrograde cholangiopancreatography outcomes in inflammatory bowel disease patients: a 12-year analysis of a national database.

BACKGROUND: Despite inflammatory bowel disease\u27s (IBD) association with hepatobiliary disorders and the use of endoscopic retrograde cholangiopancreatography (ERCP) for both diagnostic and therapeutic evaluation of these diseases, it remains a poorly studied area within the literature. The purpose of this study is to examine the effect of IBD on the occurrence of adverse events (AE) pertaining to ERCP. METHODS: This project utilized the National Inpatient Sample (NIS) database, the largest inpatient database in the USA. All patients 18 years or older with and without IBD undergoing ERCP were identified from 2008 to 2019. Post-ERCP AEs were analyzed using multivariate logistic or linear regression controlling for age, race, and existing comorbidities using the Charlson comorbidity index (CCI). RESULTS: There was no difference in post-ERCP pancreatitis (PEP) or mortality. IBD patients were also found to have a lower risk of bleeding and decreased length of stay (LOS) despite adjustment for comorbidities. They also underwent less sphincterotomies when compared to the non-IBD cohort. Subgroup analysis between ulcerative colitis (UC) and Crohn\u27s disease (CD) did not find any significant differences in outcomes. CONCLUSION: To our knowledge, this is the largest study to date evaluating ERCP outcomes in IBD patients. After adjustment of co-variates, there was no difference in the occurrence of PEP, infections, and perforation. IBD patients were less likely to experience post-ERCP bleeding and mortality and had shorter LOS which may be due to the decreased frequency of sphincterotomy in this population

Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical science. © The Author(s) 2019. Published by Oxford University Press