Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe

Global burden and strength of evidence for 88 risk factors in 204 countries and 811 subnational locations, 1990–2021: a systematic analysis for the Global Burden of Disease Study 2021

Background: Understanding the health consequences associated with exposure to risk factors is necessary to inform public health policy and practice. To systematically quantify the contributions of risk factor exposures to specific health outcomes, the Global Burden of Diseases, Injuries, and Risk Factors Study (GBD) 2021 aims to provide comprehensive estimates of exposure levels, relative health risks, and attributable burden of disease for 88 risk factors in 204 countries and territories and 811 subnational locations, from 1990 to 2021. Methods: The GBD 2021 risk factor analysis used data from 54 561 total distinct sources to produce epidemiological estimates for 88 risk factors and their associated health outcomes for a total of 631 risk–outcome pairs. Pairs were included on the basis of data-driven determination of a risk–outcome association. Age-sex-location-year-specific estimates were generated at global, regional, and national levels. Our approach followed the comparative risk assessment framework predicated on a causal web of hierarchically organised, potentially combinative, modifiable risks. Relative risks (RRs) of a given outcome occurring as a function of risk factor exposure were estimated separately for each risk–outcome pair, and summary exposure values (SEVs), representing risk-weighted exposure prevalence, and theoretical minimum risk exposure levels (TMRELs) were estimated for each risk factor. These estimates were used to calculate the population attributable fraction (PAF; ie, the proportional change in health risk that would occur if exposure to a risk factor were reduced to the TMREL). The product of PAFs and disease burden associated with a given outcome, measured in disability-adjusted life-years (DALYs), yielded measures of attributable burden (ie, the proportion of total disease burden attributable to a particular risk factor or combination of risk factors). Adjustments for mediation were applied to account for relationships involving risk factors that act indirectly on outcomes via intermediate risks. Attributable burden estimates were stratified by Socio-demographic Index (SDI) quintile and presented as counts, age-standardised rates, and rankings. To complement estimates of RR and attributable burden, newly developed burden of proof risk function (BPRF) methods were applied to yield supplementary, conservative interpretations of risk–outcome associations based on the consistency of underlying evidence, accounting for unexplained heterogeneity between input data from different studies. Estimates reported represent the mean value across 500 draws from the estimate's distribution, with 95% uncertainty intervals (UIs) calculated as the 2·5th and 97·5th percentile values across the draws. Findings: Among the specific risk factors analysed for this study, particulate matter air pollution was the leading contributor to the global disease burden in 2021, contributing 8·0% (95% UI 6·7–9·4) of total DALYs, followed by high systolic blood pressure (SBP; 7·8% [6·4–9·2]), smoking (5·7% [4·7–6·8]), low birthweight and short gestation (5·6% [4·8–6·3]), and high fasting plasma glucose (FPG; 5·4% [4·8–6·0]). For younger demographics (ie, those aged 0–4 years and 5–14 years), risks such as low birthweight and short gestation and unsafe water, sanitation, and handwashing (WaSH) were among the leading risk factors, while for older age groups, metabolic risks such as high SBP, high body-mass index (BMI), high FPG, and high LDL cholesterol had a greater impact. From 2000 to 2021, there was an observable shift in global health challenges, marked by a decline in the number of all-age DALYs broadly attributable to behavioural risks (decrease of 20·7% [13·9–27·7]) and environmental and occupational risks (decrease of 22·0% [15·5–28·8]), coupled with a 49·4% (42·3–56·9) increase in DALYs attributable to metabolic risks, all reflecting ageing populations and changing lifestyles on a global scale. Age-standardised global DALY rates attributable to high BMI and high FPG rose considerably (15·7% [9·9–21·7] for high BMI and 7·9% [3·3–12·9] for high FPG) over this period, with exposure to these risks increasing annually at rates of 1·8% (1·6–1·9) for high BMI and 1·3% (1·1–1·5) for high FPG. By contrast, the global risk-attributable burden and exposure to many other risk factors declined, notably for risks such as child growth failure and unsafe water source, with age-standardised attributable DALYs decreasing by 71·5% (64·4–78·8) for child growth failure and 66·3% (60·2–72·0) for unsafe water source. We separated risk factors into three groups according to trajectory over time: those with a decreasing attributable burden, due largely to declining risk exposure (eg, diet high in trans-fat and household air pollution) but also to proportionally smaller child and youth populations (eg, child and maternal malnutrition); those for which the burden increased moderately in spite of declining risk exposure, due largely to population ageing (eg, smoking); and those for which the burden increased considerably due to both increasing risk exposure and population ageing (eg, ambient particulate matter air pollution, high BMI, high FPG, and high SBP). Interpretation: Substantial progress has been made in reducing the global disease burden attributable to a range of risk factors, particularly those related to maternal and child health, WaSH, and household air pollution. Maintaining efforts to minimise the impact of these risk factors, especially in low SDI locations, is necessary to sustain progress. Successes in moderating the smoking-related burden by reducing risk exposure highlight the need to advance policies that reduce exposure to other leading risk factors such as ambient particulate matter air pollution and high SBP. Troubling increases in high FPG, high BMI, and other risk factors related to obesity and metabolic syndrome indicate an urgent need to identify and implement interventions

Osteochondral Autograft: Proceedings of the International Consensus Meeting on Cartilage Repair of the Ankle

Background: Treatment guidelines for cartilage lesions of the talus have been based on both low quality and low levels of evidence. Therefore, an international consensus group of experts was convened to collaboratively advance toward consensus opinions on key topics regarding cartilage lesions of the talus. The purpose of this consensus article is to explain the process and delineate the consensus statements derived from this consensus meeting on the use of “osteochondral autograft” for osteochondral lesions of the talus. Methods: Seventy-five international experts in cartilage repair of the ankle representing 25 countries and 1 territory were convened and participated in a process based on the Delphi method of achieving consensus. Questions and statements were drafted within 11 working groups focusing on specific topics within cartilage repair of the ankle, after which a comprehensive literature review was performed and the available evidence for each statement was graded. Discussion and debate occurred in cases where statements were not agreed upon in unanimous fashion within the working groups. A final vote was then held, and the strength of consensus was characterized as follows: consensus, 51% to 74%; strong consensus, 75% to 99%; and unanimous, 100%. Results: A total of 14 statements on osteochondral autograft reached consensus during the 2017 International Consensus Meeting on Cartilage Repair of the Ankle. Two achieved unanimous support, 11 reached strong consensus (greater than 75% agreement), and 1 achieved consensus. All statements reached at least 67% agreement. Conclusions: This international consensus derived from leaders in the field will assist clinicians with osteochondral autograft as a treatment strategy for osteochondral lesions of the talus

Adaptation of the Wound Healing Questionnaire universal-reporter outcome measure for use in global surgery trials (TALON-1 study): mixed-methods study and Rasch analysis

BackgroundThe Bluebelle Wound Healing Questionnaire (WHQ) is a universal-reporter outcome measure developed in the UK for remote detection of surgical-site infection after abdominal surgery. This study aimed to explore cross-cultural equivalence, acceptability, and content validity of the WHQ for use across low- and middle-income countries, and to make recommendations for its adaptation.MethodsThis was a mixed-methods study within a trial (SWAT) embedded in an international randomized trial, conducted according to best practice guidelines, and co-produced with community and patient partners (TALON-1). Structured interviews and focus groups were used to gather data regarding cross-cultural, cross-contextual equivalence of the individual items and scale, and conduct a translatability assessment. Translation was completed into five languages in accordance with Mapi recommendations. Next, data from a prospective cohort (SWAT) were interpreted using Rasch analysis to explore scaling and measurement properties of the WHQ. Finally, qualitative and quantitative data were triangulated using a modified, exploratory, instrumental design model.ResultsIn the qualitative phase, 10 structured interviews and six focus groups took place with a total of 47 investigators across six countries. Themes related to comprehension, response mapping, retrieval, and judgement were identified with rich cross-cultural insights. In the quantitative phase, an exploratory Rasch model was fitted to data from 537 patients (369 excluding extremes). Owing to the number of extreme (floor) values, the overall level of power was low. The single WHQ scale satisfied tests of unidimensionality, indicating validity of the ordinal total WHQ score. There was significant overall model misfit of five items (5, 9, 14, 15, 16) and local dependency in 11 item pairs. The person separation index was estimated as 0.48 suggesting weak discrimination between classes, whereas Cronbach's α was high at 0.86. Triangulation of qualitative data with the Rasch analysis supported recommendations for cross-cultural adaptation of the WHQ items 1 (redness), 3 (clear fluid), 7 (deep wound opening), 10 (pain), 11 (fever), 15 (antibiotics), 16 (debridement), 18 (drainage), and 19 (reoperation). Changes to three item response categories (1, not at all; 2, a little; 3, a lot) were adopted for symptom items 1 to 10, and two categories (0, no; 1, yes) for item 11 (fever).ConclusionThis study made recommendations for cross-cultural adaptation of the WHQ for use in global surgical research and practice, using co-produced mixed-methods data from three continents. Translations are now available for implementation into remote wound assessment pathways