Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe

Local Resistance in Early Medieval Chinese Historiography and the Problem of Religious Overinterpretation

Official Chinese historiography is a treasure trove of information on local resistance to the centralised empire in early medieval China (third to sixth century). Sinologists specialised in the study of Chinese religions commonly reconstruct the religious history of the era by interpreting some of these data. In the process, however, the primary purpose of the historiography of local resistance is often overlooked, and historical interpretation easily becomes ‘overinterpretation’—that is, ‘fabricating false intensity’ and ‘seeing intensity everywhere’, as French historian Paul Veyne proposed to define the term. Focusing on a cluster of historical anecdotes collected in the standard histories of the four centuries under consideration, this study discusses the supposedly ‘religious’ nature of some of the data they contain

Chances and challenges of creating a research information platform for the Berlin University Alliance

Extended abstract presented at the CRIS2022 conference in Dubrovnik.-- Event programme available at https://cris2022.srce.hr/#section-program17 slides.-- Presentation delivered within the session "The evolving CRIS landscape"This paper describes some of the challenges we face while developing a research information platform for the Berlin University Alliance (BUA). Since its founding in 2018, the BUA has put its focus on promoting the networking of researchers and their research activities and connecting many research groups within the clusters of excellence as well as beyond. The platform aims at presenting structured, transparent, categorized, and linked information about researchers and their research activities to improve the discoverability of expertise, connect researchers to their work across disciplines and boundaries, and facilitate new research collaborations. The platform is established using the open-source, web-based VIVO software, which uses semantic web techniques to connect research outputs, organizations, people, things, and research activities