1,060 research outputs found
Histopathological image analysis : a review
Over the past decade, dramatic increases in computational power and improvement in image analysis algorithms have allowed the development of powerful computer-assisted analytical approaches to radiological data. With the recent advent of whole slide digital scanners, tissue histopathology slides can now be digitized and stored in digital image form. Consequently, digitized tissue histopathology has now become amenable to the application of computerized image analysis and machine learning techniques. Analogous to the role of computer-assisted diagnosis (CAD) algorithms in medical imaging to complement the opinion of a radiologist, CAD algorithms have begun to be developed for disease detection, diagnosis, and prognosis prediction to complement the opinion of the pathologist. In this paper, we review the recent state of the art CAD technology for digitized histopathology. This paper also briefly describes the development and application of novel image analysis technology for a few specific histopathology related problems being pursued in the United States and Europe
Tissue Phenomics for prognostic biomarker discovery in low- and intermediate-risk prostate cancer
Tissue Phenomics is the discipline of mining tissue images to identify patterns that are related to clinical outcome providing potential prognostic and predictive value. This involves the discovery process from assay development, image analysis, and data mining to the final interpretation and validation of the findings. Importantly, this process is not linear but allows backward steps and optimization loops over multiple sub-processes. We provide a detailed description of the Tissue Phenomics methodology while exemplifying each step on the application of prostate cancer recurrence prediction. In particular, we automatically identified tissue-based biomarkers having significant prognostic value for low-and intermediate-risk prostate cancer patients (Gleason scores 6-7b) after radical prostatectomy. We found that promising phenes were related to CD8(+) and CD68(+) cells in the microenvironment of cancerous glands in combination with the local micro-vascularization. Recurrence prediction based on the selected phenes yielded accuracies up to 83% thereby clearly outperforming prediction based on the Gleason score. Moreover, we compared different machine learning algorithms to combine the most relevant phenes resulting in increased accuracies of 88% for tumor progression prediction. These findings will be of potential use for future prognostic tests for prostate cancer patients and provide a proof-of-principle of the Tissue Phenomics approach
Artificial intelligence in histopathology image analysis for cancer precision medicine
In recent years, there have been rapid advancements in the field of computational
pathology. This has been enabled through the adoption of digital pathology
workflows that generate digital images of histopathological slides, the publication
of large data sets of these images and improvements in computing infrastructure.
Objectives in computational pathology can be subdivided into two categories,
first the automation of routine workflows that would otherwise be performed by
pathologists and second the addition of novel capabilities. This thesis focuses on
the development, application, and evaluation of methods in this second category,
specifically the prediction of gene expression from pathology images and the
registration of pathology images among each other.
In Study I, we developed a computationally efficient cluster-based technique to
perform transcriptome-wide predictions of gene expression in prostate cancer
from H&E-stained whole-slide-images (WSIs). The suggested method
outperforms several baseline methods and is non-inferior to single-gene CNN
predictions, while reducing the computational cost with a factor of approximately
300. We included 15,586 transcripts that encode proteins in the analysis and
predicted their expression with different modelling approaches from the WSIs. In
a cross-validation, 6,618 of these predictions were significantly associated with
the RNA-seq expression estimates with FDR-adjusted p-values <0.001. Upon
validation of these 6,618 expression predictions in a held-out test set, the
association could be confirmed for 5,419 (81.9%). Furthermore, we demonstrated
that it is feasible to predict the prognostic cell-cycle progression score with a
Spearman correlation to the RNA-seq score of 0.527 [0.357, 0.665].
The objective of Study II is the investigation of attention layers in the context of
multiple-instance-learning for regression tasks, exemplified by a simulation study
and gene expression prediction. We find that for gene expression prediction, the
compared methods are not distinguishable regarding their performance, which
indicates that attention mechanisms may not be superior to weakly supervised
learning in this context.
Study III describes the results of the ACROBAT 2022 WSI registration challenge,
which we organised in conjunction with the MICCAI 2022 conference. Participating
teams were ranked on the median 90th percentile of distances between
registered and annotated target landmarks. Median 90th percentiles for eight
teams that were eligible for ranking in the test set consisting of 303 WSI pairs
ranged from 60.1 µm to 15,938.0 µm. The best performing method therefore has a
score slightly below the median 90th percentile of distances between first and
second annotator of 67.0 µm.
Study IV describes the data set that we published to facilitate the ACROBAT
challenge. The data set is available publicly through the Swedish National Data
Service SND and consists of 4,212 WSIs from 1,153 breast cancer patients.
Study V is an example of the application of WSI registration for computational
pathology. In this study, we investigate the possibility to register invasive cancer
annotations from H&E to KI67 WSIs and then subsequently train cancer detection
models. To this end, we compare the performance of models optimised with
registered annotations to the performance of models that were optimised with
annotations generated for the KI67 WSIs. The data set consists of 272 female
breast cancer cases, including an internal test set of 54 cases. We find that in this
test set, the performance of both models is not distinguishable regarding
performance, while there are small differences in model calibration
A Survey on Deep Learning in Medical Image Analysis
Deep learning algorithms, in particular convolutional networks, have rapidly
become a methodology of choice for analyzing medical images. This paper reviews
the major deep learning concepts pertinent to medical image analysis and
summarizes over 300 contributions to the field, most of which appeared in the
last year. We survey the use of deep learning for image classification, object
detection, segmentation, registration, and other tasks and provide concise
overviews of studies per application area. Open challenges and directions for
future research are discussed.Comment: Revised survey includes expanded discussion section and reworked
introductory section on common deep architectures. Added missed papers from
before Feb 1st 201
Context-aware convolutional neural network for grading of colorectal cancer histology images
Digital histology images are amenable to the application of convolutional neural networks (CNNs) for analysis due to the sheer size of pixel data present in them. CNNs are generally used for representation learning from small image patches (e.g. 224 × 224) extracted from digital histology images due to computational and memory constraints. However, this approach does not incorporate high-resolution contextual information in histology images. We propose a novel way to incorporate a larger context by a context-aware neural network based on images with a dimension of 1792 × 1792 pixels. The proposed framework first encodes the local representation of a histology image into high dimensional features then aggregates the features by considering their spatial organization to make a final prediction. We evaluated the proposed method on two colorectal cancer datasets for the task of cancer grading. Our method outperformed the traditional patch-based approaches, problem-specific methods, and existing context-based methods. We also presented a comprehensive analysis of different variants of the proposed method
- …