A systematic review of natural language processing applied to radiology reports

NLP has a significant role in advancing healthcare and has been found to be key in extracting structured information from radiology reports. Understanding recent developments in NLP application to radiology is of significance but recent reviews on this are limited. This study systematically assesses recent literature in NLP applied to radiology reports. Our automated literature search yields 4,799 results using automated filtering, metadata enriching steps and citation search combined with manual review. Our analysis is based on 21 variables including radiology characteristics, NLP methodology, performance, study, and clinical application characteristics. We present a comprehensive analysis of the 164 publications retrieved with each categorised into one of 6 clinical application categories. Deep learning use increases but conventional machine learning approaches are still prevalent. Deep learning remains challenged when data is scarce and there is little evidence of adoption into clinical practice. Despite 17% of studies reporting greater than 0.85 F1 scores, it is hard to comparatively evaluate these approaches given that most of them use different datasets. Only 14 studies made their data and 15 their code available with 10 externally validating results. Automated understanding of clinical narratives of the radiology reports has the potential to enhance the healthcare process but reproducibility and explainability of models are important if the domain is to move applications into clinical use. More could be done to share code enabling validation of methods on different institutional data and to reduce heterogeneity in reporting of study properties allowing inter-study comparisons. Our results have significance for researchers providing a systematic synthesis of existing work to build on, identify gaps, opportunities for collaboration and avoid duplication

Integrating Radiology and Hospital Information Systems: The Advantage of Shared Data

Conference PaperBiomedical Informatic

MACHINE LEARNING APPROACHES ALONG THE RADIOLOGY VALUE CHAIN – RETHINKING VALUE PROPOSITIONS

Radiology is experiencing an increased interest in machine learning with its ability to use a large amount of available data. However, it remains unclear how and to what extent machine learning will affect radiology businesses. Conducting a systematic literature review and expert interviews, we compile the opportunities and challenges of machine learning along the radiology value chain to discuss their implications for the radiology business. Machine learning can improve diagnostic quality by reducing human errors, accurately analysing large amounts of data, quantifying reports, and integrating data. Hence, it strengthens radiology businesses seeking product or service leadership. Machine learning fosters efficiency by automating accompanying activities such as generating study protocols or reports, avoiding duplicate work due to low image quality, and supporting radiologists. These efficiency improvements advance the operational excellence strategy. By providing personnel and proactive medical solutions beyond the radiology silo, machine learning supports a customer intimacy strategy. However, the opportunities face challenges that are technical (i.e., lack of data, weak labelling, and generalisation), legal (i.e., regulatory approval and privacy laws), and persuasive (i.e., radiologists’ resistance and patients’ distrust). Our findings shed light on the strategic positioning of radiology businesses, contributing to academic discourse and practical decision-making

A Review on Explainable Artificial Intelligence for Healthcare: Why, How, and When?

Artificial intelligence (AI) models are increasingly finding applications in the field of medicine. Concerns have been raised about the explainability of the decisions that are made by these AI models. In this article, we give a systematic analysis of explainable artificial intelligence (XAI), with a primary focus on models that are currently being used in the field of healthcare. The literature search is conducted following the preferred reporting items for systematic reviews and meta-analyses (PRISMA) standards for relevant work published from 1 January 2012 to 02 February 2022. The review analyzes the prevailing trends in XAI and lays out the major directions in which research is headed. We investigate the why, how, and when of the uses of these XAI models and their implications. We present a comprehensive examination of XAI methodologies as well as an explanation of how a trustworthy AI can be derived from describing AI models for healthcare fields. The discussion of this work will contribute to the formalization of the XAI field.Comment: 15 pages, 3 figures, accepted for publication in the IEEE Transactions on Artificial Intelligenc

Non-Invasive Imaging for the Assessment of Cardiac Dose and Function Following Focused External Beam Irradiation

Technological advances in imaging and radiotherapy have led to significant improvement in the survival rate of breast cancer patients. However, a larger proportion of patients are now exhibiting the less understood, latent effects of incidental cardiac irradiation that occurs during left-sided breast radiotherapy. Here, we examine the utility of four-dimensional computed tomography (4D-CT) for the accurate assessment of cardiac dose; and a hybrid positron emission tomography (PET) magnetic resonance imaging (MRI) system to longitudinally study radiation-induced cardiac effects in a canine model. Using 4D-CT and deformable dose accumulation, we assessed the variation caused by breathing motion in the estimated dose to the heart, left-ventricle, and left anterior descending artery (LAD) of left-sided breast cancer patients. The LAD showed substantial variation in dose due to breathing. In light of this, we suggest the use of 4D-CT and dose accumulation for future clinical studies looking at the relationship between LAD dose and cardiac toxicity. Although symptoms of cardiac dysfunction may not manifest clinically for 10-15 years post radiation, PET-MRI can potentially identify earlier changes in cardiac inflammation and perfusion that are typically asymptomatic. Using PET-MRI, the progression of radiation-induced cardiac toxicity was assessed in a large animal model. Five canines were imaged using 13N-ammonia and 18F-fluorodeoxyglucose (FDG) PET-MRI to assess changes in myocardial perfusion and inflammation, respectively. All subjects were imaged at baseline, 1 week, 4 weeks, 3 months, 6 months, and 12 months after focused cardiac irradiation. To the best of our knowledge PET has not been previously used to assess cardiac perfusion following irradiation. The delivered dose to the heart, left ventricle, LAD, and left circumflex artery were comparable to what has been observed during breast radiotherapy. Relative to baseline, a transient increase in myocardial perfusion was observed followed by a gradual return to baseline. However, a persistent increase in FDG uptake was observed throughout the entire left ventricle, including both irradiated and less-irradiated portions of the heart. In light of these findings, we suggest the use of this imaging approach for future human studies to assess mitigation strategies aimed at minimizing cardiac exposure and long-term toxicity subsequent to left-sided breast irradiation

What not to do in facial infrared thermographic measurements: A post data enhancement

The accuracy of infrared thermographic measurements depends on several factors, including movement of target. In this study, accuracy of nose tip temperatures obtained in a mental workload assessment using a thermal imaging camera were impacted by participants’ movement and camera zooming/panning. To correct these measurement errors, we compared manual facial landmark identification techniques using data labelling software with an automated deep learning-based approach utilised for facial landmark tracking and evaluated both against the built-in tracking features of the thermal camera, Thermal Spot Tracking. Using the Manual Thermal Landmark Annotation measurements as the ground truth, our results show that the Automated Facial Feature Tracking approach, which is the AI based approach performed better than the Thermal Spot Tracking as it matched comparatively more spatial coordinates and temperature datapoints as well as showed comparatively lower mean relative error. The study highlights the potential of AI in enhancing the accuracy of thermographic measurements, particularly in applications involving facial temperature analysis

Whole-cell segmentation of tissue images with human-level performance using large-scale data annotation and deep learning

Understanding the spatial organization of tissues is of critical importance for both basic and translational research. While recent advances in tissue imaging are opening an exciting new window into the biology of human tissues, interpreting the data that they create is a significant computational challenge. Cell segmentation, the task of uniquely identifying each cell in an image, remains a substantial barrier for tissue imaging, as existing approaches are inaccurate or require a substantial amount of manual curation to yield useful results. Here, we addressed the problem of cell segmentation in tissue imaging data through large-scale data annotation and deep learning. We constructed TissueNet, an image dataset containing >1 million paired whole-cell and nuclear annotations for tissue images from nine organs and six imaging platforms. We created Mesmer, a deep learning-enabled segmentation algorithm trained on TissueNet that performs nuclear and whole-cell segmentation in tissue imaging data. We demonstrated that Mesmer has better speed and accuracy than previous methods, generalizes to the full diversity of tissue types and imaging platforms in TissueNet, and achieves human-level performance for whole-cell segmentation. Mesmer enabled the automated extraction of key cellular features, such as subcellular localization of protein signal, which was challenging with previous approaches. We further showed that Mesmer could be adapted to harness cell lineage information present in highly multiplexed datasets. We used this enhanced version to quantify cell morphology changes during human gestation. All underlying code and models are released with permissive licenses as a community resource

A Comprehensive Review on Machine Learning Based Models for Healthcare Applications

At present, there has been significant progress concerning AI and machine learning, specifically in medical sector. Artificial intelligence refers to computing programmes that replicate and simulate human intelligence, such as an individual's problem-solving capabilities or their capacity for learning. Moreover, machine learning can be considered as a subfield within the broader domain of artificial intelligence. The process automatically identifies and analyses patterns within unprocessed data. The objective of this work is to facilitate researchers in acquiring an extensive knowledge of machine learning and its utilisation within the healthcare domain. This research commences by providing a categorization of machine learning-based methodologies concerning healthcare. In accordance with the taxonomy, we have put forth, machine learning approaches in the healthcare domain are classified according to various factors. These factors include the methods employed for the process of preparing data for analysis, which includes activities such as data cleansing and data compression techniques. Additionally, the strategies for learning are utilised, such as reinforcement learning, semi-supervised learning, supervised learning, and unsupervised learning. are considered. Also, the evaluation approaches employed encompass simulation-based evaluation as well as evaluation of actual use in everyday situations. Lastly, the applications of these ML-based methods in medicine pertain towards diagnosis and treatment. Based on the classification we have put forward; we proceed to examine a selection of research that have been presented in the framework of machine learning applications within the healthcare domain. This review paper serves as a valuable resource for researchers seeking to gain familiarity with the latest research on ML applications concerning medicine. It aids towards the recognition for obstacles and limitations associated with ML in this domain, while also facilitating the identification of potential future research directions