Semantic Characteristics Prediction of Pulmonary Nodule Using Artificial Neural Networks

The 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC'13), July 3-7, 2013, Osaka, JapanSince it is difficult to choose which computer calculated features are effective to predict the malignancy of pulmonary nodules, in this study, we add a semantic-level of Artificial Neural Networks (ANNs) structure to improve intuition of features selection. The works of this study include two: 1) seeking the relationships between computer-calculated features and medical semantic concepts which could be understood by human; 2) providing an objective assessment method to predict the malignancy from semantic characteristics. We used 60 thoracic CT scans collected from the Lung Image Database Consortium (LIDC) database, in which the suspicious lesions had been delineated and annotated by 4 radiologists independently. Corresponding to the two works of this study, correlation analysis experiment and agreement experiment were performed separately

Semantic Characteristics Prediction of Pulmonary Nodule Using Artificial Neural Networks

Since it is difficult to choose which computer calculated features are effective to predict the malignancy of pulmonary nodules, in this study, we add a semantic-level of Artificial Neural Networks (ANNs) structure to improve intuition of features selection. The works of this study include two: 1) seeking the relationships between computer-calculated features and medical semantic concepts which could be understood by human; 2) providing an objective assessment method to predict the malignancy from semantic characteristics. We used 60 thoracic CT scans collected from the Lung Image Database Consortium (LIDC) database, in which the suspicious lesions had been delineated and annotated by 4 radiologists independently. Corresponding to the two works of this study, correlation analysis experiment and agreement experiment were performed separately.The 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC\u2713), July 3-7, 2013, Osaka, Japa

Pattern classification approaches for breast cancer identification via MRI: state‐of‐the‐art and vision for the future

Mining algorithms for Dynamic Contrast Enhanced Magnetic Resonance Imaging (DCEMRI) of breast tissue are discussed. The algorithms are based on recent advances in multidimensional signal processing and aim to advance current state‐of‐the‐art computer‐aided detection and analysis of breast tumours when these are observed at various states of development. The topics discussed include image feature extraction, information fusion using radiomics, multi‐parametric computer‐aided classification and diagnosis using information fusion of tensorial datasets as well as Clifford algebra based classification approaches and convolutional neural network deep learning methodologies. The discussion also extends to semi‐supervised deep learning and self‐supervised strategies as well as generative adversarial networks and algorithms using generated confrontational learning approaches. In order to address the problem of weakly labelled tumour images, generative adversarial deep learning strategies are considered for the classification of different tumour types. The proposed data fusion approaches provide a novel Artificial Intelligence (AI) based framework for more robust image registration that can potentially advance the early identification of heterogeneous tumour types, even when the associated imaged organs are registered as separate entities embedded in more complex geometric spaces. Finally, the general structure of a high‐dimensional medical imaging analysis platform that is based on multi‐task detection and learning is proposed as a way forward. The proposed algorithm makes use of novel loss functions that form the building blocks for a generated confrontation learning methodology that can be used for tensorial DCE‐MRI. Since some of the approaches discussed are also based on time‐lapse imaging, conclusions on the rate of proliferation of the disease can be made possible. The proposed framework can potentially reduce the costs associated with the interpretation of medical images by providing automated, faster and more consistent diagnosis

Radiomics for Response Assessment after Stereotactic Radiotherapy for Lung Cancer

Stereotactic ablative radiotherapy (SABR) is a guideline-specified treatment option for patients with early stage non-small cell lung cancer. After treatment, patients are followed up regularly with computed tomography (CT) imaging to determine treatment response. However, benign radiographic changes to the lung known as radiation-induced lung injury (RILI) frequently occur. Due to the large doses delivered with SABR, these changes can mimic the appearance of a recurring tumour and confound response assessment. The objective of this work was to evaluate the accuracy of radiomics, for prediction of eventual local recurrence based on CT images acquired within 6 months of treatment. A semi-automatic decision support system was developed to segment and sample regions of common post-SABR changes, extract radiomic features and classify images as local recurrence or benign injury. Physician ability to detect timely local recurrence was also measured on CT imaging, and compared with that of the radiomics tool. Within 6 months post-SABR, physicians assessed the majority of images as no recurrence and had an overall lower accuracy compared to the radiomics system. These results suggest that radiomics can detect early changes associated with local recurrence that are not typically considered by physicians. These appearances detected by radiomics may be early indicators of the promotion and progression to local recurrence. This has the potential to lead to a clinically useful computer-aided decision support tool based on routinely acquired CT imaging, which could lead to earlier salvage opportunities for patients with recurrence and fewer invasive investigations of patients with only benign injury

Advanced machine learning methods for oncological image analysis

Cancer is a major public health problem, accounting for an estimated 10 million deaths worldwide in 2020 alone. Rapid advances in the field of image acquisition and hardware development over the past three decades have resulted in the development of modern medical imaging modalities that can capture high-resolution anatomical, physiological, functional, and metabolic quantitative information from cancerous organs. Therefore, the applications of medical imaging have become increasingly crucial in the clinical routines of oncology, providing screening, diagnosis, treatment monitoring, and non/minimally- invasive evaluation of disease prognosis. The essential need for medical images, however, has resulted in the acquisition of a tremendous number of imaging scans. Considering the growing role of medical imaging data on one side and the challenges of manually examining such an abundance of data on the other side, the development of computerized tools to automatically or semi-automatically examine the image data has attracted considerable interest. Hence, a variety of machine learning tools have been developed for oncological image analysis, aiming to assist clinicians with repetitive tasks in their workflow. This thesis aims to contribute to the field of oncological image analysis by proposing new ways of quantifying tumor characteristics from medical image data. Specifically, this thesis consists of six studies, the first two of which focus on introducing novel methods for tumor segmentation. The last four studies aim to develop quantitative imaging biomarkers for cancer diagnosis and prognosis. The main objective of Study I is to develop a deep learning pipeline capable of capturing the appearance of lung pathologies, including lung tumors, and integrating this pipeline into the segmentation networks to leverage the segmentation accuracy. The proposed pipeline was tested on several comprehensive datasets, and the numerical quantifications show the superiority of the proposed prior-aware DL framework compared to the state of the art. Study II aims to address a crucial challenge faced by supervised segmentation models: dependency on the large-scale labeled dataset. In this study, an unsupervised segmentation approach is proposed based on the concept of image inpainting to segment lung and head- neck tumors in images from single and multiple modalities. The proposed autoinpainting pipeline shows great potential in synthesizing high-quality tumor-free images and outperforms a family of well-established unsupervised models in terms of segmentation accuracy. Studies III and IV aim to automatically discriminate the benign from the malignant pulmonary nodules by analyzing the low-dose computed tomography (LDCT) scans. In Study III, a dual-pathway deep classification framework is proposed to simultaneously take into account the local intra-nodule heterogeneities and the global contextual information. Study IV seeks to compare the discriminative power of a series of carefully selected conventional radiomics methods, end-to-end Deep Learning (DL) models, and deep features-based radiomics analysis on the same dataset. The numerical analyses show the potential of fusing the learned deep features into radiomic features for boosting the classification power. Study V focuses on the early assessment of lung tumor response to the applied treatments by proposing a novel feature set that can be interpreted physiologically. This feature set was employed to quantify the changes in the tumor characteristics from longitudinal PET-CT scans in order to predict the overall survival status of the patients two years after the last session of treatments. The discriminative power of the introduced imaging biomarkers was compared against the conventional radiomics, and the quantitative evaluations verified the superiority of the proposed feature set. Whereas Study V focuses on a binary survival prediction task, Study VI addresses the prediction of survival rate in patients diagnosed with lung and head-neck cancer by investigating the potential of spherical convolutional neural networks and comparing their performance against other types of features, including radiomics. While comparable results were achieved in intra- dataset analyses, the proposed spherical-based features show more predictive power in inter-dataset analyses. In summary, the six studies incorporate different imaging modalities and a wide range of image processing and machine-learning techniques in the methods developed for the quantitative assessment of tumor characteristics and contribute to the essential procedures of cancer diagnosis and prognosis