Convolutional Neural Network Based Localized Classification of Uterine Cervical Cancer Digital Histology Images

In previous research, we introduced an automated localized, fusion-based algorithm to classify squamous epithelium into Normal, CIN1, CIN2, and CIN3 grades of cervical intraepithelial neoplasia (CIN). The approach partitioned the epithelium into 10 segments. Image processing and machine vision algorithms were used to extract features from each segment. The features were then used to classify the segment and the result was fused to classify the whole epithelium. This research extends the previous research by dividing each of the 10 segments into 3 parts and uses a convolutional neural network to classify the 3 parts. The result is then fused to classify the segments and the whole epithelium. The experimental data consists of 65 images. The proposed method accuracy is 77.25% compared to 75.75% using the previous method for the same dataset

Epithelium detection and cervical intraepithelial neoplasia classification in digitized histology images

“Cervical cancer is one of the most deadly cancers faced by women. It is the second leading cause of cancer death in women aged 20 to 39 years. In order to detect cancer at early stages, pathologists analyze the epithelium region from the cervical histology images. These histology images have a pre-cervical cancer condition called cervical intraepithelial neoplasia (CIN) determined by pathologists. This study deals with automating the process of epithelium detection and epithelium CIN classification in digitized histology images. For epithelium detection, the objective is to detect epithelium regions in microscopy images from non-epithelium regions and background. convolutional neural networks, both shallow and deep networks are used for epithelium detection. The highest epithelium detection accuracy of 98.84% is obtained using transfer learning on VGG-19 architecture, pre-trained on the ImageNet dataset. For CIN classification, the epithelium region is divided into 5 segments along the medial axis and patches from each segment were used for training the deep learning model. Vertical segment level classification probabilities from deep learning model are obtained and further classified using SVM, LDA, MLP, logistic and RF classifiers. The highest image level accuracy obtained is 77.27% for MLP classifier using voting”--Abstract, page iii

Deep learning for digitized histology image analysis

“Cervical cancer is the fourth most frequent cancer that affects women worldwide. Assessment of cervical intraepithelial neoplasia (CIN) through histopathology remains as the standard for absolute determination of cancer. The examination of tissue samples under a microscope requires considerable time and effort from expert pathologists. There is a need to design an automated tool to assist pathologists for digitized histology slide analysis. Pre-cervical cancer is generally determined by examining the CIN which is the growth of atypical cells from the basement membrane (bottom) to the top of the epithelium. It has four grades, including: Normal, CIN1, CIN2, and CIN3. In this research, different facets of an automated digitized histology epithelium assessment pipeline have been explored to mimic the pathologist diagnostic approach. The entire pipeline from slide to epithelium CIN grade has been designed and developed using deep learning models and imaging techniques to analyze the whole slide image (WSI). The process is as follows: 1) identification of epithelium by filtering the regions extracted from a low-resolution image with a binary classifier network; 2) epithelium segmentation; 3) deep regression for pixel-wise segmentation of epithelium by patch-based image analysis; 4) attention-based CIN classification with localized sequential feature modeling. Deep learning-based nuclei detection by superpixels was performed as an extension of our research. Results from this research indicate an improved performance of CIN assessment over state-of-the-art methods for nuclei segmentation, epithelium segmentation, and CIN classification, as well as the development of a prototype WSI-level tool”--Abstract, page iv

Nuclei segmentation using level set method and data fusion for the CIN classification

This paper deals with the automation of the detection of the cervical cancer through histology images. This process is divided into two parts, corresponding to segmentation and data fusion. The segmentation and classification of the cervical epithelium images is done using hybrid image processing techniques. The digitized histology images provided have a pre-cervical cancer condition called cervical intraepithelial neoplasia (CIN) by expert pathologists. Previously, image analysis studies focused on nuclei-level features to classify the epithelium into the CIN grades. The current study focuses on nuclei segmentation based on the level set segmentation and fuzzy c-means clustering methods. Morphological post-processing operations are used to smooth the image and to remove non-nuclei objects. This algorithm is evaluated on a 71-image dataset of digitized histology images for nuclei segmentation. Experimental results showed a nuclei detection accuracy of 99.53 percent. The second section of this thesis deals with the fusion of the 117 CIN features obtained after processing the input cervical images. Various data fusion techniques are tested using machine learning tools. For further research, the best algorithm from Weka is chosen --Abstract, page iv

Data fusion techniques for biomedical informatics and clinical decision support

Data fusion can be used to combine multiple data sources or modalities to facilitate enhanced visualization, analysis, detection, estimation, or classification. Data fusion can be applied at the raw-data, feature-based, and decision-based levels. Data fusion applications of different sorts have been built up in areas such as statistics, computer vision and other machine learning aspects. It has been employed in a variety of realistic scenarios such as medical diagnosis, clinical decision support, and structural health monitoring. This dissertation includes investigation and development of methods to perform data fusion for cervical cancer intraepithelial neoplasia (CIN) and a clinical decision support system. The general framework for these applications includes image processing followed by feature development and classification of the detected region of interest (ROI). Image processing methods such as k-means clustering based on color information, dilation, erosion and centroid locating methods were used for ROI detection. The features extracted include texture, color, nuclei-based and triangle features. Analysis and classification was performed using feature- and decision-level data fusion techniques such as support vector machine, statistical methods such as logistic regression, linear discriminant analysis and voting algorithms --Abstract, page iv

A Polarization-Imaging-Based Machine Learning Framework for Quantitative Pathological Diagnosis of Cervical Precancerous Lesions

Polarization images encode high resolution microstructural information even at low resolution. We propose a framework combining polarization imaging and traditional microscopy imaging, constructing a dual-modality machine learning framework that is not only accurate but also generalizable and interpretable. We demonstrate the viability of our proposed framework using the cervical intraepithelial neoplasia grading task, providing a polarimetry feature parameter to quantitatively characterize microstructural variations with lesion progression in hematoxylin-eosin-stained pathological sections of cervical precancerous tissues. By taking advantages of polarization imaging techniques and machine learning methods, the model enables interpretable and quantitative diagnosis of cervical precancerous lesion cases with improved sensitivity and accuracy in a low-resolution and wide-field system. The proposed framework applies routine image-analysis technology to identify the macro-structure and segment the target region in H&E-stained pathological images, and then employs emerging polarization method to extract the micro-structure information of the target region, which intends to expand the boundary of the current image-heavy digital pathology, bringing new possibilities for quantitative medical diagnosis

xPath: Human-AI Diagnosis in Pathology with Multi-Criteria Analyses and Explanation by Hierarchically Traceable Evidence

Data-driven AI promises support for pathologists to discover sparse tumor patterns in high-resolution histological images. However, from a pathologist's point of view, existing AI suffers from three limitations: (i) a lack of comprehensiveness where most AI algorithms only rely on a single criterion; (ii) a lack of explainability where AI models tend to work as 'black boxes' with little transparency; and (iii) a lack of integrability where it is unclear how AI can become part of pathologists' existing workflow. Based on a formative study with pathologists, we propose two designs for a human-AI collaborative tool: (i) presenting joint analyses of multiple criteria at the top level while (ii) revealing hierarchically traceable evidence on-demand to explain each criterion. We instantiate such designs in xPath -- a brain tumor grading tool where a pathologist can follow a top-down workflow to oversee AI's findings. We conducted a technical evaluation and work sessions with twelve medical professionals in pathology across three medical centers. We report quantitative and qualitative feedback, discuss recurring themes on how our participants interacted with xPath, and provide initial insights for future physician-AI collaborative tools.Comment: 31 pages, 11 figure

Deep learning and localized features fusion for medical image classification

Local image features play an important role in many classification tasks as translation and rotation do not severely deteriorate the classification process. They have been commonly used for medical image analysis. In medical applications, it is important to get accurate diagnosis/aid results in the fastest time possible. This dissertation tries to tackle these problems, first by developing a localized feature-based classification system for medical images and using these features and to give a classification for the entire image, and second, by improving the computational complexity of feature analysis to make it viable as a diagnostic aid system in practical clinical situations. For local feature development, a new approach based on combining the rising deep learning paradigm with the use of handcrafted features is developed to classify cervical tissue histology images into different cervical intra-epithelial neoplasia classes. Using deep learning combined with handcrafted features improved the accuracy by 8.4% achieving 80.72% exact class classification accuracy compared to 72.29% when using the benchmark feature-based classification method --Abstract, page iv

Cervical cancer histology image feature extraction and classification

Cervical cancer, the second most common cancer affecting women worldwide and the most common in developing countries can be cured if detected early and treated. Expert pathologists routinely visually examine histology slides for cervix tissue abnormality assessment. In previous research, an automated, localized, fusion-based approach was investigated for classifying squamous epithelium into Normal, CIN1, CIN2, and CIN3 grades of cervical intraepithelial neoplasia (CIN) based on image analysis of 62 digitized histology images obtained through the National Library of Medicine. In this research, CIN grade assessments from two pathologists are analyzed and are used to facilitate atypical cell concentration feature development from vertical segment partitions of the epithelium region for the same digitized histology images. Using features developed in this thesis with prior work, a particle swarm optimization and Receiver Operating Characteristic curve (ROC) explored for CIN classification showing exact grade labeling accuracy as high as 90%. --Abstract, page iii