Deep Learning-Based Natural Language Processing in Radiology:The Impact of Report Complexity, Disease Prevalence, Dataset Size, and Algorithm Type on Model Performance

In radiology, natural language processing (NLP) allows the extraction of valuable information from radiology reports. It can be used for various downstream tasks such as quality improvement, epidemiological research, and monitoring guideline adherence. Class imbalance, variation in dataset size, variation in report complexity, and algorithm type all influence NLP performance but have not yet been systematically and interrelatedly evaluated. In this study, we investigate these factors on the performance of four types [a fully connected neural network (Dense), a long short-term memory recurrent neural network (LSTM), a convolutional neural network (CNN), and a Bidirectional Encoder Representations from Transformers (BERT)] of deep learning-based NLP. Two datasets consisting of radiologist-annotated reports of both trauma radiographs (n = 2469) and chest radiographs and computer tomography (CT) studies (n = 2255) were split into training sets (80%) and testing sets (20%). The training data was used as a source to train all four model types in 84 experiments (Fracture-data) and 45 experiments (Chest-data) with variation in size and prevalence. The performance was evaluated on sensitivity, specificity, positive predictive value, negative predictive value, area under the curve, and F score. After the NLP of radiology reports, all four model-architectures demonstrated high performance with metrics up to > 0.90. CNN, LSTM, and Dense were outperformed by the BERT algorithm because of its stable results despite variation in training size and prevalence. Awareness of variation in prevalence is warranted because it impacts sensitivity and specificity in opposite directions. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s10916-021-01761-4

Match-derived relative pitch area changes the physical and team tactical performance of elite soccer players in small-sided soccer games

Small-sided games (SSGs) are used in training sessions to prepare for full-sized matches. For the same number of players, smaller pitch sizes result in decreased physical performance and shorter interpersonal distances. A relative pitch area derived from the full-sized match results in larger pitch sizes and this may increase the fit between SSGs and full-sized matches. This study aimed to investigate SSGs with a traditional small pitch and a match-derived relative pitch area in youth elite soccer players. Four age categories (under-13, under-15, under-17 and under-19) played 4 vs. 4 plus goalkeepers on a small (40x30m, 120m(2) relative pitch area) and large pitch (68x47m, 320m(2) relative pitch area). The number of games per age category ranged 15-30. Positional data (LPM-system) were collected to determine physical (total distance covered, high intensity distance and number of sprints) and team tactical (inter-team distance, LPW-ratio, surface area, stretch indices, goalkeeper-defender distance) performance measures and tactical variability. On a large pitch, physical performance significantly increased, inter-team and intra-team distances were significantly larger and tactical variability of intra-team distance measures significantly increased. The match-derived relative pitch area is an important training manipulation and leads to changes in physical and tactical performance 4 vs. 4 plus goalkeepers.</p

Surgical Site Infections at Donor and Recipient Sites in Patients with Iliac Crest Harvesting For Autologous Bone Grafting - A Pilot Evaluation

Surgeons harvest the iliac crest for bone grafting. The epidemiology of surgical site infections (SSI) associated with this procedure at the donor, or recipient site, is unknown. We perform a retrospective pilot evaluation of adult patients undergoing first-time orthopedic surgery at the Balgrist University Hospital between 2014-2019. We excluded patients with infection at the index surgery, diabetic foot surgeries, superficial SSIs, and revision surgeries. We included 20,088 episodes of primary orthopedic surgery, of which 467 with iliac crest bone sampling (467/20,088; 2%). Only two iliac sites (2/467; 0.4%) become infected. In contrast, surgeries with iliac crest sampling yielded more SSIs at the recipient site than those without (1.9% vs. 0.8%; χ2-test; p<0.01). These patients equally revealed more co-morbidities such as a longer duration of surgery (median 127 vs. 79 minutes), when compared to the general orthopedic population. In multivariate logistic regression analysis with the outcome “ SSI at the recipient site”, the iliac harvesting was independently associated with deep SSIs requiring surgical revision (odds ratio 2.1; 95% confidence interval 1.1-4.2). In our pilot evaluation with 20,088 primary orthopedic surgeries, the SSI risk of the iliac harvest site was low. In contrast, surgeries with supplementary iliac crest harvesting revealed a higher SSI risk than the general orthopedic population, potentially due to a mix of local independent risks of grafting together with a prolonged surgery time. Keywords : Autologous bone grafting; Deep surgical site infections; Epidemiology; Iliac crest harvesting; Revision surger

Histopathological growth patterns of neuroendocrine tumor liver metastases

Histopathological growth patterns (HGPs) of liver metastases represent a potential biomarker for prognosis after resection. They have never been studied in neuroendocrine tumor liver metastases (NETLM). This study evaluated if distinct HGPs can be observed in resected NETLM and if they have prognostic value. Sixty-three patients who underwent resection of NETLM between 01–01-2001 and 31–12-2021 were retrospectively included. HGPs were scored on Haematoxylin&amp;Eosin slides using light microscopy, distinguishing desmoplastic- (dHGP), pushing- (pHGP) and replacement HGP (rHGP). Average HGP scores were calculated per patient. Each patient was classified according to predominant HGP. Overall and Disease-Free Survival (OS and DFS) were evaluated through Kaplan–Meier analysis and Cox regression. Eighteen patients had predominant dHGP (29%), 33 had predominant pHGP (52%) and 11 had predominant rHGP (17%). One patient had mixed HGP (2%). Five-year OS was 76% (95%CI: 66–87%) for the overall cohort. Five-year OS was 92% (95%CI: 77–100%) for dHGP, was 73% (95%CI: 59–91%) for pHGP, 50% (95%CI: 25–100%) for rHGP. Five-year DFS was 39% (95%CI: 19–83%) for dHGP, 44% (95%CI: 27–71%) for rHGP and 50% (95%CI: 23–100%) for pHGP. There was no significant association between HGP and OS or DFS in multivariable analysis. Distinct HGPs could be identified in NETLM. In patients who underwent resection of NETLM, no association was found between HGPs and postoperative survival. Half of the patients with NETLM have a predominant pushing growth pattern, which is a rare growth pattern in liver metastases from breast and colorectal cancer.</p

Characterizing and predicting person-specific, day-to-day, fluctuations in walking behavior

Despite the positive health effect of physical activity, one third of the world's population is estimated to be insufficiently active. Prior research has mainly investigated physical activity on an aggregate level over short periods of time, e.g., during 3 to 7 days at baseline and a few months later, post-intervention. To develop effective interventions, we need a better understanding of the temporal dynamics of physical activity. We proposed here an approach to studying walking behavior at "high-resolution" and by capturing the idiographic and day-to-day changes in walking behavior. We analyzed daily step count among 151 young adults with overweight or obesity who had worn an accelerometer for an average of 226 days (~25,000 observations). We then used a recursive partitioning algorithm to characterize patterns of change, here sudden behavioral gains and losses, over the course of the study. These behavioral gains or losses were defined as a 30% increase or reduction in steps relative to each participants' median level of steps lasting at least 7 days. After the identification of gains and losses, fluctuation intensity in steps from each participant's individual time series was computed with a dynamic complexity algorithm to identify potential early warning signals of sudden gains or losses. Results revealed that walking behavior change exhibits discontinuous changes that can be described as sudden gains and losses. On average, participants experienced six sudden gains or losses over the study. We also observed a significant and positive association between critical fluctuations in walking behavior, a form of early warning signals, and the subsequent occurrence of sudden behavioral losses in the next days. Altogether, this study suggests that walking behavior could be well understood under a dynamic paradigm. Results also provide support for the development of "just-in-time adaptive" behavioral interventions based on the detection of early warning signals for sudden behavioral losses

Self-perception but not peer reputation of bullying victimization is associated with non-clinical psychotic experiences in adolescents

Background Bullying victimization may be linked to psychosis but only self-report measures of victimization have been used so far. This study aimed (a) to investigate the differential associations of peer-nominated versus self-reported victim status with non-clinical psychotic experiences in a sample of young adolescents, and (b) to examine whether different types of self-reported victimization predict non-clinical psychotic experiences in these adolescents. Method A combination of standard self-report and peer nomination procedures was used to assess victimization. The sample (n = 724) was divided into four groups (exclusively self-reported victims, self- and peer-reported victims, exclusively peer-reported victims, and non-victims) to test for a group effect on non-clinical psychotic experiences. The relationship between types of victimization and non-clinical psychotic experiences was examined by a regression analysis. Results Self-reported victims, along with self- and peer-reported victims, scored higher than peer-reported victims and non-victims on non-clinical psychotic experiences. Self-reports of direct relational, indirect relational and physical victimization significantly improved the prediction of non-clinical psychotic experiences whereas verbal and possession-directed victimization had no significant predictive value. Conclusions The relationship between victimization and non-clinical psychotic experiences is only present for self-reported victimization, possibly indicative of an interpretation bias. The observed discrepancy between self-report and peer-report highlights the importance of implementing a combination of both measures for future research. Copyright © Cambridge University Press 2012