Spatial Organization and Molecular Correlation of Tumor-Infiltrating Lymphocytes Using Deep Learning on Pathology Images

Beyond sample curation and basic pathologic characterization, the digitized H&E-stained images of TCGA samples remain underutilized. To highlight this resource, we present mappings of tumorinfiltrating lymphocytes (TILs) based on H&E images from 13 TCGA tumor types. These TIL maps are derived through computational staining using a convolutional neural network trained to classify patches of images. Affinity propagation revealed local spatial structure in TIL patterns and correlation with overall survival. TIL map structural patterns were grouped using standard histopathological parameters. These patterns are enriched in particular T cell subpopulations derived from molecular measures. TIL densities and spatial structure were differentially enriched among tumor types, immune subtypes, and tumor molecular subtypes, implying that spatial infiltrate state could reflect particular tumor cell aberration states. Obtaining spatial lymphocytic patterns linked to the rich genomic characterization of TCGA samples demonstrates one use for the TCGA image archives with insights into the tumor-immune microenvironment

Histopathological image analysis : a review

Over the past decade, dramatic increases in computational power and improvement in image analysis algorithms have allowed the development of powerful computer-assisted analytical approaches to radiological data. With the recent advent of whole slide digital scanners, tissue histopathology slides can now be digitized and stored in digital image form. Consequently, digitized tissue histopathology has now become amenable to the application of computerized image analysis and machine learning techniques. Analogous to the role of computer-assisted diagnosis (CAD) algorithms in medical imaging to complement the opinion of a radiologist, CAD algorithms have begun to be developed for disease detection, diagnosis, and prognosis prediction to complement the opinion of the pathologist. In this paper, we review the recent state of the art CAD technology for digitized histopathology. This paper also briefly describes the development and application of novel image analysis technology for a few specific histopathology related problems being pursued in the United States and Europe

Joint co-clustering: co-clustering of genomic and clinical bioimaging data

AbstractFor better understanding the genetic mechanisms underlying clinical observations, and better defining a group of potential candidates for protein-family-inhibiting therapy, it is interesting to determine the correlations between genomic, clinical data and data coming from high resolution and fluorescent microscopy. We introduce a computational method, called joint co-clustering, that can find co-clusters or groups of genes, bioimaging parameters and clinical traits that are believed to be closely related to each other based on the given empirical information. As bioimaging parameters, we quantify the expression of growth factor receptor EGFR/erb-B family in non-small cell lung carcinoma (NSCLC) through a fully-automated computer-aided analysis approach. This immunohistochemical analysis is usually performed by pathologists via visual inspection of tissue samples images. Our fully-automated techniques streamlines this error-prone and time-consuming process, thereby facilitating analysis and diagnosis. Experimental results for several real-life datasets demonstrate the high quantitative precision of our approach. The joint co-clustering method was tested with the receptor EGFR/erb-B family data on non-small cell lung carcinoma (NSCLC) tissue and identified statistically significant co-clusters of genes, receptor protein expression and clinical traits. The validation of our results with the literature suggest that the proposed method can provide biologically meaningful co-clusters of genes and traits and that it is a very promising approach to analyse large-scale biological data and to study multi-factorial genetic pathologies through their genetic alterations

The State of Applying Artificial Intelligence to Tissue Imaging for Cancer Research and Early Detection

Artificial intelligence represents a new frontier in human medicine that could save more lives and reduce the costs, thereby increasing accessibility. As a consequence, the rate of advancement of AI in cancer medical imaging and more particularly tissue pathology has exploded, opening it to ethical and technical questions that could impede its adoption into existing systems. In order to chart the path of AI in its application to cancer tissue imaging, we review current work and identify how it can improve cancer pathology diagnostics and research. In this review, we identify 5 core tasks that models are developed for, including regression, classification, segmentation, generation, and compression tasks. We address the benefits and challenges that such methods face, and how they can be adapted for use in cancer prevention and treatment. The studies looked at in this paper represent the beginning of this field and future experiments will build on the foundations that we highlight

Developing a machine learning model for tumor cell quantification in standard histology images of lung cancer

Summary Background Tumor purity estimation plays a crucial role in genomic profiling and is traditionally carried out manually by pathologists. This manual approach has several disadvantages, including potential inaccuracies due to human error, inconsistency in evaluation criteria among different pathologists, and the time-consuming nature of the process. These issues may be addressed by adopting a digital approach. In this thesis, we employ a machine learning (ML)-based, cell- based classifier to estimate tumor purity in lung cancer tissues. Materials and methods In this study, conducted as part of the subsequent clinical trial TNM-I, we incorporated 61 patients diagnosed with non-small cell lung cancer (NSCLC). Tumor purity was initially estimated manually by two pathologists. The digital estimation of tumor purity was executed using a ML-based classifier in QuPath. To determine the level of agreement and inter-rater reliability between the two pathologists, as well as between the manual and digital estimations, we computed Intraclass Correlation Coefficient (ICC) and Cohen’s Kappa using SPSS. Results The ICC coefficient when comparing the tumor purity estimations done by the two pathologists was 0.833, indicating good reliability. According to Cohen’s Kappa the inter- rater reliability between the pathologists was moderate with a value of 0.534. The ICC coefficient when comparing the manual and digital tumor purity estimation was 0.838, which indicates good reliability. When analyzing for Cohen’s Kappa we got a value of 0.563, indicating moderate inter-rater reliability between the tumor purity estimations done manually and digitally. All the results were statistically significant. Conclusion In summary, we have successfully developed a ML classifier that estimates tumor purity in lung cancer tissue. Our findings align with previous research and demonstrate strong correlation with traditional detection methods. These results underscore the importance of continuing research in enhancing ML-based strategies for tumor purity estimation