Identification of Topological Features in Renal Tumor Microenvironment Associated with Patient Survival

Motivation As a highly heterogeneous disease, the progression of tumor is not only achieved by unlimited growth of the tumor cells, but also supported, stimulated, and nurtured by the microenvironment around it. However, traditional qualitative and/or semi-quantitative parameters obtained by pathologist’s visual examination have very limited capability to capture this interaction between tumor and its microenvironment. With the advent of digital pathology, computerized image analysis may provide a better tumor characterization and give new insights into this problem. Results We propose a novel bioimage informatics pipeline for automatically characterizing the topological organization of different cell patterns in the tumor microenvironment. We apply this pipeline to the only publicly available large histopathology image dataset for a cohort of 190 patients with papillary renal cell carcinoma obtained from The Cancer Genome Atlas project. Experimental results show that the proposed topological features can successfully stratify early- and middle-stage patients with distinct survival, and show superior performance to traditional clinical features and cellular morphological and intensity features. The proposed features not only provide new insights into the topological organizations of cancers, but also can be integrated with genomic data in future studies to develop new integrative biomarkers

Histopathological image analysis : a review

Over the past decade, dramatic increases in computational power and improvement in image analysis algorithms have allowed the development of powerful computer-assisted analytical approaches to radiological data. With the recent advent of whole slide digital scanners, tissue histopathology slides can now be digitized and stored in digital image form. Consequently, digitized tissue histopathology has now become amenable to the application of computerized image analysis and machine learning techniques. Analogous to the role of computer-assisted diagnosis (CAD) algorithms in medical imaging to complement the opinion of a radiologist, CAD algorithms have begun to be developed for disease detection, diagnosis, and prognosis prediction to complement the opinion of the pathologist. In this paper, we review the recent state of the art CAD technology for digitized histopathology. This paper also briefly describes the development and application of novel image analysis technology for a few specific histopathology related problems being pursued in the United States and Europe

Added benefits of computer-assisted analysis of Hematoxylin-Eosin stained breast histopathological digital slides

This thesis aims at determining if computer-assisted analysis can be used to better understand pathologists’ perception of mitotic figures on Hematoxylin-Eosin (HE) stained breast histopathological digital slides. It also explores the feasibility of reproducible histologic nuclear atypia scoring by incorporating computer-assisted analysis to cytological scores given by a pathologist. In addition, this thesis investigates the possibility of computer-assisted diagnosis for categorizing HE breast images into different subtypes of cancer or benign masses. In the first study, a data set of 453 mitoses and 265 miscounted non-mitoses within breast cancer digital slides were considered. Different features were extracted from the objects in different channels of eight colour spaces. The findings from the first research study suggested that computer-aided image analysis can provide a better understanding of image-related features related to discrepancies among pathologists in recognition of mitoses. Two tasks done routinely by the pathologists are making diagnosis and grading the breast cancer. In the second study, a new tool for reproducible nuclear atypia scoring in breast cancer histological images was proposed. The third study proposed and tested MuDeRN (MUlti-category classification of breast histopathological image using DEep Residual Networks), which is a framework for classifying hematoxylin-eosin stained breast digital slides either as benign or cancer, and then categorizing cancer and benign cases into four different subtypes each. The studies indicated that computer-assisted analysis can aid in both nuclear grading (COMPASS) and breast cancer diagnosis (MuDeRN). The results could be used to improve current status of breast cancer prognosis estimation through reducing the inter-pathologist disagreement in counting mitotic figures and reproducible nuclear grading. It can also improve providing a second opinion to the pathologist for making a diagnosis

Classification and Retrieval of Digital Pathology Scans: A New Dataset

In this paper, we introduce a new dataset, \textbf{Kimia Path24}, for image classification and retrieval in digital pathology. We use the whole scan images of 24 different tissue textures to generate 1,325 test patches of size 1000$\times$1000 (0.5mm$\times$0.5mm). Training data can be generated according to preferences of algorithm designer and can range from approximately 27,000 to over 50,000 patches if the preset parameters are adopted. We propose a compound patch-and-scan accuracy measurement that makes achieving high accuracies quite challenging. In addition, we set the benchmarking line by applying LBP, dictionary approach and convolutional neural nets (CNNs) and report their results. The highest accuracy was 41.80\% for CNN.Comment: Accepted for presentation at Workshop for Computer Vision for Microscopy Image Analysis (CVMI 2017) @ CVPR 2017, Honolulu, Hawai

Accuracy of computer-aided image analysis in the diagnosis of odontogenic cysts:a systematic review

This study aimed to search for scientific evidence concerning the accuracy of computer-assisted analysis for diagnosing odontogenic cysts. A systematic review was conducted according to the PRISMA statements and considering eleven databases, including the grey literature. Protocol was registered in PROSPERO (CRD 42020189349). The PECO strategy was used to define the eligibility criteria and only studies involving diagnostic accuracy were included. Their risk of bias was investigated using the Joanna Briggs Institute Critical Appraisal tool. Out of 437 identified citations, five papers, published between 2006 and 2019, fulfilled the criteria and were included in this systematic review. A total of 5,264 images from 508 lesions, classified as radicular cyst, odontogenic keratocyst, lateral periodontal cyst, glandular odontogenic cyst, or dentigerous cyst, were analyzed. All selected articles scored low risk of bias. In three studies, the best performances were achieved when the two subtypes of odontogenic keratocysts (solitary or syndromic) were pooled together, the case-wise analysis showing a success rate of 100% for odontogenic keratocysts and radicular cysts, in one of them. In two studies, the dentigerous cyst was associated with the majority of misclassifications, and its omission from the dataset improved significantly the classification rates. The overall evaluation showed all studies presented high accuracy rates of computer-aided systems in classifying odontogenic cysts in digital images of histological tissue sections. However, due to the heterogeneity of the studies, a meta-analysis evaluating the outcomes of interest was not performed and a pragmatic recommendation about their use is not possible

Prospects for Theranostics in Neurosurgical Imaging: Empowering Confocal Laser Endomicroscopy Diagnostics via Deep Learning

Confocal laser endomicroscopy (CLE) is an advanced optical fluorescence imaging technology that has the potential to increase intraoperative precision, extend resection, and tailor surgery for malignant invasive brain tumors because of its subcellular dimension resolution. Despite its promising diagnostic potential, interpreting the gray tone fluorescence images can be difficult for untrained users. In this review, we provide a detailed description of bioinformatical analysis methodology of CLE images that begins to assist the neurosurgeon and pathologist to rapidly connect on-the-fly intraoperative imaging, pathology, and surgical observation into a conclusionary system within the concept of theranostics. We present an overview and discuss deep learning models for automatic detection of the diagnostic CLE images and discuss various training regimes and ensemble modeling effect on the power of deep learning predictive models. Two major approaches reviewed in this paper include the models that can automatically classify CLE images into diagnostic/nondiagnostic, glioma/nonglioma, tumor/injury/normal categories and models that can localize histological features on the CLE images using weakly supervised methods. We also briefly review advances in the deep learning approaches used for CLE image analysis in other organs. Significant advances in speed and precision of automated diagnostic frame selection would augment the diagnostic potential of CLE, improve operative workflow and integration into brain tumor surgery. Such technology and bioinformatics analytics lend themselves to improved precision, personalization, and theranostics in brain tumor treatment.Comment: See the final version published in Frontiers in Oncology here: https://www.frontiersin.org/articles/10.3389/fonc.2018.00240/ful

Deep Learning Solutions for Lung Cancer Characterization in Histopathological Images

Cancer is one of the leading death causes in the world, specifically, lung cancer. According to theWorld Health Organization (WHO), at the end of 2020, around 2.2 million people were diagnosedwith lung cancer, and 1.8 million fatalities resulted from it. Correctly identifying it's presence in apatient and classifying it's sub-type and stage is fundamental for the adoption of appropriate targettherapies. One of the gold standards used to identify and classify cancer is the microscopic visual in-spection of histopathological imagesi.e.small tissue samples excised from a patient. Expertpathologists are responsible for this inspection, however, it requires a significant amount of timeand sometimes leads to non-consensual results . With the growth of computational power and data availability, modern Artificial Intelligencesolutions can be developed to automate and speed up this process. Deep Neural Networks us-ing histopathological images as an input currently embody the state-of-the-art in automated lungcancer diagnostic solutions, with Deep Convolutional Neural Networks achieving the most com-pelling acuracies in tissue type classification. One of the main reasons for such results is theincreasing availability of voluminous amounts of data, acquired through the efforts employed byextensive projects like The Cancer Genome Atlas. Nonetheless, histopathological images remain weakly labelled/annotated, as most commonpathologist annotations refer to the entirety of the image and not to individual regions of interestin the patient's tissue sample. Recent works have demonstrated Multiple Instance Learning as asuccessful approach in classification tasks entangled with this lack of annotation, by representingimages as a bag of instances where a single label is available for the whole bag. Thus, we propose a bag/embedding-level lung tissue type and sub-type classifier using a Con-volutional Neural Network in a Multiple Instance Learning approach, where the automated inspec-tion of lung histopathological images determines the presence of cancer, and it's possible sub-type,in a given patient. Furthermore, we employ a post-model interpretability algorithm to validate ourmodel's predictions and highlight the regions of interest for such predictions

Comparative Analysis of Deep Learning Architectures for Breast Cancer Diagnosis Using the BreaKHis Dataset

Cancer is an extremely difficult and dangerous health problem because it manifests in so many different ways and affects so many different organs and tissues. The primary goal of this research was to evaluate deep learning models' ability to correctly identify breast cancer cases using the BreakHis dataset. The BreakHis dataset covers a wide range of breast cancer subtypes through its huge collection of histopathological pictures. In this study, we use and compare the performance of five well-known deep learning models for cancer classification: VGG, ResNet, Xception, Inception, and InceptionResNet. The results placed the Xception model at the top, with an F1 score of 0.9 and an accuracy of 89%. At the same time, the Inception and InceptionResNet models both hit accuracy of 87% . However, the F1 score for the Inception model was 87, while that for the InceptionResNet model was 86. These results demonstrate the importance of deep learning methods in making correct breast cancer diagnoses. This highlights the potential to provide improved diagnostic services to patients. The findings of this study not only improve current methods of cancer diagnosis, but also make significant contributions to the creation of new and improved cancer treatment strategies. In a nutshell, the results of this study represent a major advancement in the direction of achieving these vital healthcare goals.Comment: 7 pages, 1 figure, 2 table