Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe

Quantitative MDCT assessment of binder effects after pelvic ring disruptions using segmented pelvic haematoma volumes and multiplanar caliper measurements.

OBJECTIVE: To assess effects of pelvic binders for different instability grades using quantitative multidetector computed tomography (MDCT) parameters including segmented pelvic haematoma volumes and multiplanar caliper measurements. METHODS: CT examinations of 49 patients with binders and 49 controls performed from January 2008-June 2016, and matched 1:1 for Tile instability grade and Pennal/Young-Burgess force vector, were compared for differences in pubic symphysis and sacroiliac displacement using caliper measurements in three orthogonal planes. Pelvic haematoma volumes (ml) were derived using semi-automated seeded region-growing segmentation. Median caliper measurements and volumes were compared using the Mann-Whitney U test, and correlations assessed with Pearson\u27s correlation coefficient. Relevant caliper measurement cutoffs were established using ROC analysis. RESULTS: Rotationally unstable (Tile B) patients with binders showed significant decreases in sacroiliac diastasis (2.7 mm vs. 4.5 mm; p=0.003) and haematoma volumes (135 ml vs. 295 ml; p=0.008). Globally unstable (Tile C) binder patients showed decreased sacroiliac diastasis (4.7 mm vs. 6.4 mm, p=0.04), without significant difference in haematoma volumes (284 ml vs. 234 ml, p=0.34). Four Tile C patients with binders demonstrated over-reduction resulting in pubic body over-ride. CONCLUSION: Rotationally unstable patients with binders have significantly less sacroiliac diastasis versus controls, corresponding with significantly lower haematoma volumes. KEY POINTS: • Haematoma segmentation and multiplanar caliper measurements provide new insights into binder effects. • Binder reduction corresponds with decreased pelvic haematoma volume in rotationally unstable injuries. • Discrimination between rotational and global instability is important for management. • Several caliper measurement cut-offs discriminate between rotationally and globally unstable injuries. • Pubic symphysis over-ride is suggestive of binder over-reduction in globally unstable injuries

Determination of Radiographic Healing: An Assessment of Consistency Using RUST and Modified RUST in Metadiaphyseal Fractures

Copyright © 2015 Wolters Kluwer Health, Inc. All rights reserved. Objective: To determine the reliability of the Radiographic Union Scale for Tibia (RUST) score and a new modified RUST score in quantifying healing and to define a value for radiographic union in a large series of metadiaphyseal fractures treated with plates or intramedullary nails. Design: Healing was evaluated using 2 methods: (1) evaluation of interrater agreement in a series of radiographs and (2) analysis of prospectively gathered data from 2 previous large multicenter trials to define thresholds for radiographic union. Intervention: Part 1: 12 orthopedic trauma surgeons evaluated a series of radiographs of 27 distal femur fractures treated with either plate or retrograde nail fixation at various stages of healing in random order using a modified RUST score. For each radiographic set, the reviewer indicated if the fracture was radiographically healed. Part 2: The radiographic results of 2 multicenter randomized trials comparing plate versus nail fixation of 81 distal femur and 46 proximal tibia fractures were reviewed. Orthopaedic surgeons at 24 trauma centers scored radiographs at 3, 6, and 12 months postoperatively using the modified RUST score above. Additionally, investigators indicated if the fracture was healed or not healed. Main Outcome Measures: The intraclass correlation coefficient (ICC) with 95% confidence intervals was determined for each cortex, the standard and modified RUST score, and the assignment of union for part 1 data. The RUST and modified RUST that defined union were determined for both parts of the study. Results: ICC: The modified RUST score demonstrated slightly higher ICCs than the standard RUST (0.68 vs. 0.63). Nails had substantial agreement, whereas plates had moderate agreement using both modified and standard RUST (0.74 and 0.67 vs. 0.59 and 0.53). Union: The average standard and modified RUST at union among all fractures was 8.5 and 11.4. Nails had higher standard and modified RUST scores than plates at union. The ICC for union was 0.53 (nails: 0.58; plates: 0.51), which indicates moderate agreement. However, the majority of reviewers assigned union for a standard RUST of 9 and a modified RUST of 11, and \u3e90% considered a score of 10 on the RUST and 13 on the modified RUST united. Conclusions: The ICC for the modified RUST is slightly higher than the standard RUST in metadiaphyseal fractures and had substantial agreement. The ICC for the assessment of union was moderate agreement; however, definite union would be 10 and 13 with over 90% of reviewers assigning union. These are the first data-driven estimates of radiographic union for these scores.

Secondary Bony Defects after Soft Tissue Reconstruction in Limb-Threatening Lower Extremity Injuries: Does the Approach to Flap Elevation Matter?

BACKGROUND:  Limb-threatening lower extremity injuries often require secondary bone grafting after soft tissue reconstruction. We hypothesized that there would be fewer wound complications when performing secondary bone grafting via a remote surgical approach rather than direct flap elevation. METHODS:  A retrospective cohort study was performed at a single Level 1 trauma center comparing complications after secondary bone grafting in patients who had undergone previous soft tissue reconstruction after open tibia fractures between 2006 and 2020. Comparing bone grafting via a remote surgical incision versus direct flap elevation, we evaluated wound dehiscence requiring return to the operating room as the primary outcome. Secondary outcomes were deep infection and delayed amputation. RESULTS:  We identified 129 patients (mean age: 40 years, 82% male) with 159 secondary bone grafting procedures. Secondary bone grafting was performed via a remote surgical approach in 54% ( CONCLUSION:  Direct flap elevation for secondary bone grafting after soft tissue reconstruction for open tibia fractures did not result in more complications than bone grafting via a remote surgical approach. These findings should reassure surgeons to allow other clinical factors to influence the surgical approach for bone grafting

AO Patient Outcomes Center: Design, Implementation, and Evaluation of a Software Application for the Collection of Patient-Reported Outcome Measures in Orthopedic Outpatient Clinics.

BACKGROUND: Patient-reported outcomes are increasingly utilized in routine orthopedic clinical care. Computer adaptive tests (CATs) from the Patient-Reported Outcomes Measurement Information System (PROMIS) offer a brief and precise assessment that is well suited for collection within busy clinical environments. However, software apps that support the administration and scoring of CATs, provide immediate access to patient-reported outcome (PRO) scores, and minimize clinician burden are not widely available. OBJECTIVE: Our objective was to design, implement, and test the feasibility and usability of a Web-based system for collecting CATs in orthopedic clinics. METHODS: AO Patient Outcomes Center (AOPOC) was subjected to 2 rounds of testing. Alpha testing was conducted in 3 orthopedic clinics to evaluate ease of use and feasibility of integration in clinics. Patients completed an assessment of PROMIS CATs and a usability survey. Clinicians participated in a brief semistructured interview. Beta-phase testing evaluated system performance through load testing and usability of the updated version of AOPOC. In both rounds of testing, user satisfaction, bugs, change requests, and performance of PROMIS CATs were captured. RESULTS: Patient feedback supported the ease of use in completing an assessment in AOPOC. Across both phases of testing, clinicians rated AOPOC as easy to use but noted difficulties in integrating a Web-based software application within their clinics. PROMIS CATs performed well; the default assessment of 2 CATs was completed quickly (mean 9.5 items) with a satisfactory range of measurement. CONCLUSION: AOPOC was demonstrated to be an easy-to-learn and easy-to-use software application for patients and clinicians that can be integrated into orthopedic clinical care. The workflow disruption in integrating any type of PRO collection must be addressed if patients\u27 voices are to be better integrated in clinical care

Is the timing of fixation associated with fracture-related infection among tibial plateau fracture patients with compartment syndrome? A multicenter retrospective cohort study of 729 patients.

BACKGROUND: Tibial plateau fractures with an ipsilateral compartment syndrome are a clinical challenge with limited guidance regarding the best time to perform open reduction and internal fixation (ORIF) relative to fasciotomy wound closure. This study aimed to determine if the risk of fracture-related infection (FRI) differs based on the timing of tibial plateau ORIF relative to closure of ipsilateral fasciotomy wounds. METHODS: A retrospective cohort study identified patients with tibial plateau fractures and an ipsilateral compartment syndrome treated with 4-compartment fasciotomy at 22 US trauma centers from 2009 to 2019. The primary outcome measure was FRI requiring operative debridement after ORIF. The ORIF timing relative to fasciotomy closure was categorized as ORIF before, at the same time as, or after fasciotomy closure. Bayesian hierarchical regression models with a neutral prior were used to determine the association between timing of ORIF and infection. The posterior probability of treatment benefit for ORIF was also determined for the three timings of ORIF relative to fasciotomy closure. RESULTS: Of the 729 patients who underwent ORIF of their tibial plateau fracture, 143 (19.6%) subsequently developed a FRI requiring operative treatment. Patients sustaining infections were: 21.0% of those with ORIF before (43 of 205), 15.9% at the same time as (37 of 232), and 21.6% after fasciotomy wound closure (63 of 292). ORIF at the same time as fasciotomy closure demonstrated a 91% probability of being superior to before closure (RR, 0.75; 95% CrI, 0.38 to 1.10). ORIF after fasciotomy closure had a lower likelihood (45%) of a superior outcome than before closure (RR, 1.02; 95% CrI; 0.64 to 1.39). CONCLUSION: Data from this multicenter cohort confirms previous reports of a high FRI risk in patients with a tibial plateau fracture and ipsilateral compartment syndrome. Our results suggest that ORIF at the time of fasciotomy closure has the highest probability of treatment benefit, but that infection was common with all three timings of ORIF in this difficult clinical situation

Is the timing of fixation associated with fracture-related infection among tibial plateau fracture patients with compartment syndrome? A multicenter retrospective cohort study of 729 patients.

BACKGROUND: Tibial plateau fractures with an ipsilateral compartment syndrome are a clinical challenge with limited guidance regarding the best time to perform open reduction and internal fixation (ORIF) relative to fasciotomy wound closure. This study aimed to determine if the risk of fracture-related infection (FRI) differs based on the timing of tibial plateau ORIF relative to closure of ipsilateral fasciotomy wounds. METHODS: A retrospective cohort study identified patients with tibial plateau fractures and an ipsilateral compartment syndrome treated with 4-compartment fasciotomy at 22 US trauma centers from 2009 to 2019. The primary outcome measure was FRI requiring operative debridement after ORIF. The ORIF timing relative to fasciotomy closure was categorized as ORIF before, at the same time as, or after fasciotomy closure. Bayesian hierarchical regression models with a neutral prior were used to determine the association between timing of ORIF and infection. The posterior probability of treatment benefit for ORIF was also determined for the three timings of ORIF relative to fasciotomy closure. RESULTS: Of the 729 patients who underwent ORIF of their tibial plateau fracture, 143 (19.6%) subsequently developed a FRI requiring operative treatment. Patients sustaining infections were: 21.0% of those with ORIF before (43 of 205), 15.9% at the same time as (37 of 232), and 21.6% after fasciotomy wound closure (63 of 292). ORIF at the same time as fasciotomy closure demonstrated a 91% probability of being superior to before closure (RR, 0.75; 95% CrI, 0.38 to 1.10). ORIF after fasciotomy closure had a lower likelihood (45%) of a superior outcome than before closure (RR, 1.02; 95% CrI; 0.64 to 1.39). CONCLUSION: Data from this multicenter cohort confirms previous reports of a high FRI risk in patients with a tibial plateau fracture and ipsilateral compartment syndrome. Our results suggest that ORIF at the time of fasciotomy closure has the highest probability of treatment benefit, but that infection was common with all three timings of ORIF in this difficult clinical situation