Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe

Scientific and technical factors affecting the setting of Salmonella criteria for raw poultry: a global perspective

Concerns about foodborne salmonellosis have led many countries to introduce microbiological criteria for certain food products. If such criteria are not well-grounded in science, they could be an unjustified obstacle to trade. Raw poultry products are an important part of the global food market. Import and export ambiguities and regulatory confusion resulting from different Salmonella requirements were the impetus for convening an international group of scientific experts from 16 countries to discuss the scientific and technical issues that affect the setting of a microbiological criterion for Salmonella contamination of raw chicken. A particular concern for the group was the use of criteria implying a zero tolerance for Salmonella and suggesting complete absence of the pathogen. The notion can be interpreted differently by various stakeholders and was considered inappropriate because there is neither an effective means of eliminating Salmonella from raw poultry nor any practical method for verifying its absence. Therefore, it may be more useful at present to set food safety metrics that involve reductions in hazard levels. Such terms as "zero tolerance" or "absence of a microbe" in relation to raw poultry should be avoided unless defined and explained by international agreement. Risk assessment provides a more meaningful approach than a zero tolerance philosophy, and new metrics, such as performance objectives that are linked to human health outcomes, should be utilized throughout the food chain to help define risk and identify ways to reduce adverse effects on public healt

National survey for Salmonella in pigs, cattle and sheep at slaughter in Great Britain (1999-2000).

AIMS: The objective of these surveys was to estimate the prevalence of faecal carriage of Salmonella in healthy pigs, cattle and sheep at slaughter, and of pig carcase contamination with Salmonella. These data can be used as a baseline against which future change in Salmonella prevalence in these species at slaughter can be monitored. METHODS AND RESULTS: In this first randomized National Survey for faecal carriage of Salmonella in slaughter pigs, cattle and sheep in Great Britain, 2509 pigs, 891 cattle and 973 sheep were sampled in 34 pig abattoirs and 117 red meat abattoirs in England, Scotland and Wales. Carriage of Salmonella in 25 g caecal contents was identified in 578 (23.0% pigs) but in only 134 (5.3%) of carcase swabs. The predominant Salmonella serovars found in both types of sample were S. Typhimurium (11.1% caeca, 2.1% carcases) and S. Derby (6.3% caeca, 1.6% carcases). The main definitive phage types (DT) of S. Typhimurium found were DT104 (21.9% of caecal S. Typhimurium isolates), DT193 (18.7%), untypable strains (17.6%), DT208 (13.3%) and U302 (13.3%). Three isolates of S. Enteritidis (PTs 13A and 4) and one enrofloxacin-resistant S. Choleraesuis were also isolated. A positive 'meat-juice ELISA' was obtained from 15.2% of pigs at 40% optical density (O.D.) cut-off level and 35.7% at 10% cut-off. There was poor correlation between positive ELISA results or carcase contamination and the caecal carriage of Salmonella. The ratio of carcase contamination to caecal carriage rates was highest in abattoirs from the midland region of England and in smaller abattoirs. In cattle and sheep 1 g samples of rectal faeces were tested. Two isolates (i.e. 0.2%) were recovered from cattle, one each of S. Typhimurium, DT193 and DT12. One sheep sample (0.1%) contained a Salmonella, S. Typhimurium DT41. In a small subsidiary validation exercise using 25 g of rectal faeces from 174 cattle samples, three (1.7%) isolates of Salmonella (S. Typhimurium DT104, S. Agama, S. Derby) were found. CONCLUSIONS: The carriage rate of Salmonella in prime slaughter cattle and sheep in Great Britain was very low compared with pigs. This suggests that future control measures should be focused on reduction of Salmonella infection on pig farms and minimizing contamination of carcases at slaughter. SIGNIFICANCE AND IMPACT OF THE STUDY: This work has set baseline figures for Salmonella carriage in these species slaughtered for human consumption in Great Britain. These figures were collected in a representative way, which enables them to be used for monitoring trends and setting control targets