6 research outputs found

    Large expert-curated database for benchmarking document similarity detection in biomedical literature search

    Get PDF
    Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe

    The Sarmatian Review, Vol. 25, No. 3

    No full text
    Contents: "SR Index"; Zdzisław Krasnodębski, "The Past and Present Ends of History"; "BOOKS"; Roger Cooke, "Stalin and His Hangmen (review)"; Joseph A. Kotarba, "Spanish Carlism and Polish Nationalism" (review); Patricia A. Gajda, "When Eagles Die" (review); Agnieszka Gutthy, "Bacacay" (review); Michael (Michał) Zioło, "The Only Known Picture of God" (excerpts); Sutherland Edwards, "The Polish Captivity" (chapters 1 and 2); "Announcements and Notes"; "About the Authors"; "Thank You Note

    The Sarmatian Review, Vol. 25, No. 2

    No full text
    Contents: "In Siberian Prisons", Simon Tokarzewski; "BOOKS BOOKS and Periodicals Received"; "Mission and Poetry: Adam Miciewicz in Europe", (review) Harry Louis Roddy, Jr; "The Revenge of History: Russian Strategic Initiative in the Twenty-First Century", By Aleksandr Sergeevich Panarin (review by Sally Boss); "The Eastern Orthodox civilization in the globalized world", By Aleksandr Sergeevich Panarin (reviewed by Sally Boss); Dariusz Skórczewski, "An anthology of Polish poetry in diaspora, 1939–1999"; "The Pulaski Legion in the American Revolution", by Francis Casimir Kajencki (review by James R Thompson); "Shut Up Shut Down", Poems By Mark Nowak (review Danusha V. Goska); "Journey from Innocence", By Anna R. Dadlez (review Patricia A. Gajda); "A note on Wisława Szymborska’s “The Tarsier” (“Tarsjusz”)"Ela Rossmiller; "Letters"; "Announcements and Notes"; "The Sarmatian Review Index"; "About the Authors"; Thank you note

    The Sarmatian Review, Vol. 23, No. 3

    No full text
    Contents: "SARMATIAN REVIEW INDEX"; James R. Thompson, “Born Under a Lucky Star” (review); "BOOKS"; Adam Asnyk, “Over the Depths: First Sonnet” translated by Alex Kurczaba; Patricia A. Gajda, “Russia in the Twentieth Century” (review); Anna Czarnowus, “Through the Poet’s Eye” (review); Danusha Goska, “Regions of the Great Heresy” (review); Adam Fitas, “Spory o krytykȩ literacką w Dwudziestoleciu” (review); Joanna Nižyńska, “Selected Poems” (review); Joseph A. Kotarba, “Political Borders and Cross-Border Identities” (review); Theresa Kurk McGinley, “World War II through Polish Eyes” (review); Maria Szonert-Binienda, “Lying Down WithDogs” (review); "Poems" by Kevin Hannan; "OUR TAKE: Writing Counterhistory in Non- Germanic Central Europe"; Zofia Ptaśnik, "Death by a Thousand Cuts" (sixth and final installment); "About the Authors

    The Sarmatian Review, Vol. 26, No. 3

    No full text
    Contents: "Our Take"; "SR Index"; Dariusz Skórczewski, "Modern Polish Literature Through a Postcolonial Lens: The Case of Paweł Huelle’s Castorp"; "BOOKS"; James R. Thompson, "Rising ’44: The Battle for Warsaw" (review); Patricia A. Gajda, "The Exile Mission: The Polish Political Diaspora and the Polish Americans, 1939–1956" (review); Piotr Wrobel, "The Massacre at Jedwabne, July 10, 1941: Before, During, and After" (review); James E. Bjork, "Religion and the Rise of Nationalism: A Profile of an East-Central European City" (review); Bogdan Czaykowski, "Polskie wizje Europy w XIX i XX wieku" (review); Jonathan Z. Ludwig, "Polish Encounters, Russian Identity" (review); Agata Brajerska-Mazur, "Warsaw Tales 2006: New Europe Writers’ Ink" (review); Mary Ann Furno, "Encounters: Philosophy of History after Postmodernism" (review); Louis E. Van Norman, "Poland: The Knight Among Nations" (SR partial reprints); "About the Authors

    Large expert-curated database for benchmarking document similarity detection in biomedical literature search

    No full text
    corecore