Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe

Masyarakat Belajar

-2

Masyarakat belajar

xx.277 hlm. : - ; 21 cm

Educational research and policy : how do they relate

ix, 297 p. : 23 cm

The International encyclopedia of education

Volume IXix, 5582 hlm ; 24 c

Analyse de facteurs héréditaires et de milieu déterminant la réussite scolaire par l'étude de jumeaux élevés ensemble

Husen Torsten. Analyse de facteurs héréditaires et de milieu déterminant la réussite scolaire par l'étude de jumeaux élevés ensemble. In: Bulletin de psychologie, tome 20 n°257, 1967. pp. 772-781

Recrutement élargi et niveau des connaissances dans les classes terminales

Widened recruitment and general level of knowledge in secondary top forms. — On the basis of the report on the IEA project which concluded that the general level of learning results, as observed in high schools in 12 countries, was falling down, the author points out that not only open systems do not show the lowest success levels, but they do promote an equal school attendance according to socio-occupa- tional categories, as well as a levelling of the pupils' occupational expectations.A partir du rapport du projet IEA qui concluait à une baisse du niveau des résultats globaux de l'enseignement dispensé dans les lycées de 12 pays, l'auteur constate que non seulement les systèmes les plus ouverts n'ont pas les rendements les plus faibles, mais qu'ils favorisent l'égalisation de la fréquentation scolaire par catégorie socio-professionnelle et celle des aspirations des élèves quant à leur emploi futur.Reclutamiento ensanchado y nivel de los conocimientos en las closes terminales. — Desde el informe del proyecto IEA que concluia por una baja del nivel de los resultados globales de la enseñanza distribuida en los Institutos de segunda enseñanza de 12 países, el autor comprueba que no solo los sistemas los más abiertos no obtienen los resultados los más bajos, pero que favorecen el igualamiento de la frecuentación escolar por categoria socio-profesional y la de las aspiraciones de los alumnos en cuanto a su futuro empleo.Husen Torsten. Recrutement élargi et niveau des connaissances dans les classes terminales. In: Revue française de pédagogie, volume 31, 1975. pp. 34-41

The International Encyclopedia of Education

ix, 6244 P. 23cm