Content-based CT image retrieval system using deep learning: Preliminary assessment of its accuracy for classifying lesion patterns and retrieving similar cases among patients with diffuse lung diseases

Practical image retrieval systems must fully use image databases. We investigated the accuracy of our content-based computer tomography (CT) image retrieval system (CB-CTIRS) for classifying lesion patterns and retrieving similar cases in patients with diffuse lung diseases. The study included 503 individuals, with 328 having diffuse lung disease and 175 having normal chest CT scans. Among the former, we randomly selected ten scans that revealed one of five specific patterns [consolidation, ground-glass opacity (GGO), emphysema, honeycombing, or micronodules: two cases each]. Two radiologists separated the squares into six categories (five abnormal patterns and one normal pattern) to create a reference standard. Subsequently, each square was entered into the CB-CTIRS, and the F-score used to classify squares was determined. Next, we selected 15 cases (three per pattern) among the 503 cases, which served as the query cases. Three other radiologists graded the similarity between the retrieved and query cases using a 5-point grading system, where grade 5 = similar in both the opacity pattern and distribution and 1 = different therein. The F-score was 0.71 for consolidation, 0.63 for GGO, 0.74 for emphysema, 0.61 for honeycombing, 0.15 for micronodules, and 0.67 for normal lung. All three radiologists assigned grade 4 or 5 to 67.7% of retrieved cases with consolidation, emphysema, or honeycombing, and grade 2 or 3 to 67.7% of the retrieved cases with GGO or micronodules. The retrieval accuracy of CB-CTIRS is satisfactory for consolidation, emphysema, and honeycombing but not for GGO or micronodules

Cancer diagnosis using deep learning: A bibliographic review

In this paper, we first describe the basics of the field of cancer diagnosis, which includes steps of cancer diagnosis followed by the typical classification methods used by doctors, providing a historical idea of cancer classification techniques to the readers. These methods include Asymmetry, Border, Color and Diameter (ABCD) method, seven-point detection method, Menzies method, and pattern analysis. They are used regularly by doctors for cancer diagnosis, although they are not considered very efficient for obtaining better performance. Moreover, considering all types of audience, the basic evaluation criteria are also discussed. The criteria include the receiver operating characteristic curve (ROC curve), Area under the ROC curve (AUC), F1 score, accuracy, specificity, sensitivity, precision, dice-coefficient, average accuracy, and Jaccard index. Previously used methods are considered inefficient, asking for better and smarter methods for cancer diagnosis. Artificial intelligence and cancer diagnosis are gaining attention as a way to define better diagnostic tools. In particular, deep neural networks can be successfully used for intelligent image analysis. The basic framework of how this machine learning works on medical imaging is provided in this study, i.e., pre-processing, image segmentation and post-processing. The second part of this manuscript describes the different deep learning techniques, such as convolutional neural networks (CNNs), generative adversarial models (GANs), deep autoencoders (DANs), restricted Boltzmann’s machine (RBM), stacked autoencoders (SAE), convolutional autoencoders (CAE), recurrent neural networks (RNNs), long short-term memory (LTSM), multi-scale convolutional neural network (M-CNN), multi-instance learning convolutional neural network (MIL-CNN). For each technique, we provide Python codes, to allow interested readers to experiment with the cited algorithms on their own diagnostic problems. The third part of this manuscript compiles the successfully applied deep learning models for different types of cancers. Considering the length of the manuscript, we restrict ourselves to the discussion of breast cancer, lung cancer, brain cancer, and skin cancer. The purpose of this bibliographic review is to provide researchers opting to work in implementing deep learning and artificial neural networks for cancer diagnosis a knowledge from scratch of the state-of-the-art achievements

Detection and description of pulmonary nodules through 2D and 3D clustering

Precise 3D automated detection, description and classification of pulmonary nodules offer the potential for early diagnosis of cancer and greater efficiency in the reading of computerised tomography (CT) images. CT scan centres are currently experiencing high loads and experts shortage, especially in developing countries such as Iraq where the results of the current research will be used. This motivates the researchers to address these problems and challenges by developing automated processes for the early detection and efficient description of cancer cases. This research attempts to reduce workloads, enhance the patient throughput and improve the diagnosis performance. To achieve this goal, the study selects techniques for segmentation, classification, detection and implements the best candidates alongside a novel automated approach. Techniques for each stage in the process are quantitatively evaluated to select the best performance against standard data for lung cancer. In addition, the ideal approach is identified by comparing them against other works in detecting and describing pulmonary nodules. This work detects and describes the nodules and their characteristics in several stages: automated lung segmentation from the background, automated 2D and 3D clustering of vessels and nodules, applying shape and textures features, classification and automatic measurement of nodule characteristics. This work is tested on standard CT lung image data and shows promising results, matching or close to experts’ diagnosis in the nodules number and their features (size/volume, location) and in terms the accuracy and automation. It also achieved a classification accuracy of 98% and efficient results in measuring the nodules’ volume automatically

Image processing in medicine advances for phenotype characterization, computer-assisted diagnosis and surgical planning

En esta Tesis presentamos nuestras contribuciones al estado del arte en procesamiento digital de imágenes médicas, articulando nuestra exposición en torno a los tres principales objetivos de la adquisición de imágenes en medicina: la prevención, el diagnóstico y el tratamiento de las enfermedades. La prevención de la enfermedad se puede conseguir a veces mediante una caracterización cuidadosa de los fenotipos propios de la misma. Tal caracterización a menudo se alcanza a partir de imágenes. Presentamos nuestro trabajo en caracterización del enfisema pulmonar a partir de imágenes TAC (Tomografía Axial Computerizada) de tórax en alta resolución, a través del análisis de las texturas locales de la imagen. Nos proponemos llenar el vacío existente entre la práctica clínica actual, y las sofisticadas pero costosas técnicas de caracterización de regiones texturadas, disponibles en la literatura. Lo hacemos utilizando la distribución local de intensidades como un descriptor adecuado para determinar el grado de destrucción de tejido en pulmones enfisematosos. Se presentan interesantes resultados derivados del análisis de varios cientos de imágenes para niveles variables de severidad de la enfermedad, sugiriendo tanto la validez de nuestras hipótesis, como la pertinencia de este tipo de análisis para la comprensión de la enfermedad pulmonar obstructiva crónica. El procesado de imágenes médicas también puede asistir en el diagnóstico y detección de enfermedades. Presentamos nuestras contribuciones a este campo, que consisten en técnicas de segmentación y cuantificación de imágenes dermatoscópicas de lesiones de la piel. La segmentación se obtiene mediante un novedoso algoritmo basado en contornos activos que explota al máximo el contenido cromático de las imágenes, gracias a la maximización de la discrepancia mediante comparaciones cross-bin. La cuantificación de texturas en lesiones melanocíticas se lleva a cabo utilizando un modelado de los patrones de pigmentación basado en campos aleatorios de Markov, en un esfuerzo por adoptar la tendencia emergente en dermatología: la detección de la malignidad mediante el análisis de la irregularidad de la textura. Los resultados para ambas técnicas son validados con un conjunto significativo de imágenes dermatológicas, sugiriendo líneas interesantes para la detección automática del melanoma maligno. Cuando la enfermedad ya está presente, el tratamiento digital de imágenes puede asistir en la planificación quirúrgica y la intervención guiada por imagen. La planificación terapeútica, ejemplicada por la planificación de cirugía plástica usando realidad virtual, se aborda en nuestro trabajo en segmentación de hueso/grasa/músculo en imágenes TAC. Usando un abordaje interactivo e incremental, nuestro sistema permite obtener segmentaciones precisas a partir de unos cuantos clics de ratón para una gran variedad de condiciones de adquisición y frente a anatomícas anormales. Presentamos nuestra metodología, y nuestra validación experimental profusa basada tanto en segmentaciones manuales como en valoraciones subjetivas de los usuarios, e indicamos referencias al lector que detallan los beneficios obtenidos con el uso de la plataforma de planifificación que utiliza nuestro algoritmo. Como conclusión presentamos una disertación final sobre la importancia de nuestros resultados y las líneas probables de trabajo futuro hacía el objetivo último de mejorar el cuidado de la salud mediante técnicas de tratamiento digital de imágenes médicas.In this Thesis we present our contributions to the state-of-the-art in medical image processing, articulating our exposition around the three main roles of medical imaging: disease prevention, diagnosis and treatment. Disease prevention can sometimes be achieved by proper characterization of disease phenotypes. Such characterization is often attained from the standpoint of imaging. We present our work in characterization of emphysema from highresolution computed-tomography images via quanti_cation of local texture. We propose to _ll the gap between current clinical practice and sophisticated texture approaches by the use of local intensity distributions as an adequate descriptor for the degree of tissue destruction in the emphysematous lung. Interesting results are presented from the analysis of several hundred datasets of lung CT for varying disease severity, suggesting both the correctness of our hypotheses and the pertinence of _ne emphysema quanti_cation for understanding of chronic obstructive pulmonary disease. Medical image processing can also assist in the diagnosis and detection of disease. We introduce our contributions to this_eld, consisting of segmentation and quanti_cation techniques in application to dermatoscopy images of skin lesions. Segmentation is achieved via a novel active contour algorithm that fully exploits the color content of the images, via cross-bin histogram dissimilarity maximization. Texture quanti_cation in the context of melanocytic lesions is performed using modelization of the pigmentation patterns via Markov random elds, in an e_ort to embrace the emerging trend in dermatology: malignancy assessment based on texture irregularity analysis. Experimental results for both, the segmentation and quanti_cation proposed techniques, will be validated on a signi_cant set of dermatoscopy images, suggesting interesting pathways towards automatic detection and diagnosis of malignant melanoma. Once disease has occurred, image processing can assist in therapeutical planning and image-guided intervention. Therapeutical planning, exempli_ed by virtual reality surgical planning, is tackled by our work in segmentation of bone/fat/muscle in CT images for plastic surgery planning. Using an interactive, incremental approach, our system is able to provide accurate segmentations based on a couple of mouse-clicks for a wide variety of imaging conditions and abnormal anatomies. We present our methodology, and provide profuse experimental validation based on manual segmentations and subjective assessment, and refer the reader to related work reporting on the clinical bene_ts obtained using the virtual reality platform hosting our algorithm. As a conclusion we present a _nal dissertation on the signi_cance of our results and the probable lines of future work towards fully bene_tting healthcare using medical image processing

Image similarity in medical images

Recent experiments have indicated a strong influence of the substrate grain orientation on the self-ordering in anodic porous alumina. Anodic porous alumina with straight pore channels grown in a stable, self-ordered manner is formed on (001) oriented Al grain, while disordered porous pattern is formed on (101) oriented Al grain with tilted pore channels growing in an unstable manner. In this work, numerical simulation of the pore growth process is carried out to understand this phenomenon. The rate-determining step of the oxide growth is assumed to be the Cabrera-Mott barrier at the oxide/electrolyte (o/e) interface, while the substrate is assumed to determine the ratio β between the ionization and oxidation reactions at the metal/oxide (m/o) interface. By numerically solving the electric field inside a growing porous alumina during anodization, the migration rates of the ions and hence the evolution of the o/e and m/o interfaces are computed. The simulated results show that pore growth is more stable when β is higher. A higher β corresponds to more Al ionized and migrating away from the m/o interface rather than being oxidized, and hence a higher retained O:Al ratio in the oxide. Experimentally measured oxygen content in the self-ordered porous alumina on (001) Al is indeed found to be about 3% higher than that in the disordered alumina on (101) Al, in agreement with the theoretical prediction. The results, therefore, suggest that ionization on (001) Al substrate is relatively easier than on (101) Al, and this leads to the more stable growth of the pore channels on (001) Al

Adaptive Quantification and Subtyping of Pulmonary Emphysema on Computed Tomography

Pulmonary emphysema contributes to the chronic airflow limitation characteristic of chronic obstructive pulmonary disease (COPD), which is a leading cause of morbidity and mortality worldwide. Computed tomography (CT) has enabled in vivo assessment of pulmonary emphysema at the macroscopic level, and is commonly used to identify and assess the extent of the disease. During the past decade, the availability of CT imaging data has increased rapidly, while the image quality has continued to improve. High-resolution CT is extremely valuable both for patient diagnosis and for studying diseases at the population level. However, visual assessment of these large data sets is subjective, inefficient, and expensive. This has increased the demand for objective, automatic, and reproducible image analysis methods. For the assessment of pulmonary emphysema on CT, computational models usually aim either to give a measure of the extent of the disease, or to categorize the emphysema subtypes apparent in a scan. The standard methods for quantitating emphysema extent are widely used, but they remain sensitive to changes in imaging protocols and patient inspiration level. For computational subtyping of emphysema, the methods remain at a developmental stage, and one of the main challenges is the lack of reliable label data. Furthermore, the classic emphysema subtypes were defined on autopsy before the availability of CT and could be considered outdated. There is also no consensus on how to match the subtypes on autopsy to the varying emphysema patterns present on CT. This work presents two methodological improvements for analyzing emphysema on CT. For the assessment of emphysema extent, a novel probabilistic approach is introduced and evaluated on a longitudinal data set with varying imaging protocols. The presented model is shown to improve significantly compared to standard methods, particularly at the presence of differing noise levels. The approach is also applied on quantifying emphysema on a large data set of cardiac CT scans, and is shown to improve the prediction of emphysema extent on subsequent full-lung CT scans. The second major contribution of this work applies unsupervised learning to recognizing patterns of emphysema on CT. Instead of trying to reproduce the classic subtypes, the novel approach aims to capture the most dominant variations of lung structure pertaining to emphysema. While removing the reliance on visually assigned labels, the learned patterns are shown to represent different manifestations of emphysema with distinct appearances and regular spatial distributions. The clinical significance of the patterns is also demonstrated, along with high-level performance in the application of content-based image retrieval. The contributions of this work advance the analysis of emphysema on CT by applying novel machine learning approaches to increase the value of the available imaging data. Probabilistic methods improve from the crude standard methods that are currently used to quantitate emphysema, and the value of learning disease patterns directly from image data is demonstrated. The common framework relying on replicating visually assigned labels of outdated subtypes has not achieved widespread acceptance. The methodology presented in this work may have a substantial impact on how emphysema subtypes on CT are recognized and defined in the future