4,547 research outputs found
Context-aware stacked convolutional neural networks for classification of breast carcinomas in whole-slide histopathology images
Automated classification of histopathological whole-slide images (WSI) of
breast tissue requires analysis at very high resolutions with a large
contextual area. In this paper, we present context-aware stacked convolutional
neural networks (CNN) for classification of breast WSIs into normal/benign,
ductal carcinoma in situ (DCIS), and invasive ductal carcinoma (IDC). We first
train a CNN using high pixel resolution patches to capture cellular level
information. The feature responses generated by this model are then fed as
input to a second CNN, stacked on top of the first. Training of this stacked
architecture with large input patches enables learning of fine-grained
(cellular) details and global interdependence of tissue structures. Our system
is trained and evaluated on a dataset containing 221 WSIs of H&E stained breast
tissue specimens. The system achieves an AUC of 0.962 for the binary
classification of non-malignant and malignant slides and obtains a three class
accuracy of 81.3% for classification of WSIs into normal/benign, DCIS, and IDC,
demonstrating its potentials for routine diagnostics
Artificial intelligence in histopathology image analysis for cancer precision medicine
In recent years, there have been rapid advancements in the field of computational
pathology. This has been enabled through the adoption of digital pathology
workflows that generate digital images of histopathological slides, the publication
of large data sets of these images and improvements in computing infrastructure.
Objectives in computational pathology can be subdivided into two categories,
first the automation of routine workflows that would otherwise be performed by
pathologists and second the addition of novel capabilities. This thesis focuses on
the development, application, and evaluation of methods in this second category,
specifically the prediction of gene expression from pathology images and the
registration of pathology images among each other.
In Study I, we developed a computationally efficient cluster-based technique to
perform transcriptome-wide predictions of gene expression in prostate cancer
from H&E-stained whole-slide-images (WSIs). The suggested method
outperforms several baseline methods and is non-inferior to single-gene CNN
predictions, while reducing the computational cost with a factor of approximately
300. We included 15,586 transcripts that encode proteins in the analysis and
predicted their expression with different modelling approaches from the WSIs. In
a cross-validation, 6,618 of these predictions were significantly associated with
the RNA-seq expression estimates with FDR-adjusted p-values <0.001. Upon
validation of these 6,618 expression predictions in a held-out test set, the
association could be confirmed for 5,419 (81.9%). Furthermore, we demonstrated
that it is feasible to predict the prognostic cell-cycle progression score with a
Spearman correlation to the RNA-seq score of 0.527 [0.357, 0.665].
The objective of Study II is the investigation of attention layers in the context of
multiple-instance-learning for regression tasks, exemplified by a simulation study
and gene expression prediction. We find that for gene expression prediction, the
compared methods are not distinguishable regarding their performance, which
indicates that attention mechanisms may not be superior to weakly supervised
learning in this context.
Study III describes the results of the ACROBAT 2022 WSI registration challenge,
which we organised in conjunction with the MICCAI 2022 conference. Participating
teams were ranked on the median 90th percentile of distances between
registered and annotated target landmarks. Median 90th percentiles for eight
teams that were eligible for ranking in the test set consisting of 303 WSI pairs
ranged from 60.1 µm to 15,938.0 µm. The best performing method therefore has a
score slightly below the median 90th percentile of distances between first and
second annotator of 67.0 µm.
Study IV describes the data set that we published to facilitate the ACROBAT
challenge. The data set is available publicly through the Swedish National Data
Service SND and consists of 4,212 WSIs from 1,153 breast cancer patients.
Study V is an example of the application of WSI registration for computational
pathology. In this study, we investigate the possibility to register invasive cancer
annotations from H&E to KI67 WSIs and then subsequently train cancer detection
models. To this end, we compare the performance of models optimised with
registered annotations to the performance of models that were optimised with
annotations generated for the KI67 WSIs. The data set consists of 272 female
breast cancer cases, including an internal test set of 54 cases. We find that in this
test set, the performance of both models is not distinguishable regarding
performance, while there are small differences in model calibration
The ACROBAT 2022 Challenge: Automatic Registration Of Breast Cancer Tissue
The alignment of tissue between histopathological whole-slide-images (WSI) is
crucial for research and clinical applications. Advances in computing, deep
learning, and availability of large WSI datasets have revolutionised WSI
analysis. Therefore, the current state-of-the-art in WSI registration is
unclear. To address this, we conducted the ACROBAT challenge, based on the
largest WSI registration dataset to date, including 4,212 WSIs from 1,152
breast cancer patients. The challenge objective was to align WSIs of tissue
that was stained with routine diagnostic immunohistochemistry to its
H&E-stained counterpart. We compare the performance of eight WSI registration
algorithms, including an investigation of the impact of different WSI
properties and clinical covariates. We find that conceptually distinct WSI
registration methods can lead to highly accurate registration performances and
identify covariates that impact performances across methods. These results
establish the current state-of-the-art in WSI registration and guide
researchers in selecting and developing methods
Automated histopathological analyses at scale
Thesis: S.M., Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2017.Cataloged from PDF version of thesis.Includes bibliographical references (pages 68-73).Histopathology is the microscopic examination of processed human tissues to diagnose conditions like cancer, tuberculosis, anemia and myocardial infractions. The diagnostic procedure is, however, very tedious, time-consuming and prone to misinterpretation. It also requires highly trained pathologists to operate, making it unsuitable for large-scale screening in resource-constrained settings, where experts are scarce and expensive. In this thesis, we present a software system for automated screening, backed by deep learning algorithms. This cost-effective, easily-scalable solution can be operated by minimally trained health workers and would extend the reach of histopathological analyses to settings such as rural villages, mass-screening camps and mobile health clinics. With metastatic breast cancer as our primary case study, we describe how the system could be used to test for the presence of a tumor, determine the precise location of a lesion, as well as the severity stage of a patient. We examine how the algorithms are combined into an end-to-end pipeline for utilization by hospitals, doctors and clinicians on a Software as a Service (SaaS) model. Finally, we discuss potential deployment strategies for the technology, as well an analysis of the market and distribution chain in the specific case of the current Indian healthcare ecosystem.by Mrinal Mohit.S.M
Translation of tissue-based artificial intelligence into clinical practice: from discovery to adoption.
Digital pathology (DP), or the digitization of pathology images, has transformed oncology research and cancer diagnostics. The application of artificial intelligence (AI) and other forms of machine learning (ML) to these images allows for better interpretation of morphology, improved quantitation of biomarkers, introduction of novel concepts to discovery and diagnostics (such as spatial distribution of cellular elements), and the promise of a new paradigm of cancer biomarkers. The application of AI to tissue analysis can take several conceptual approaches, within the domains of language modelling and image analysis, such as Deep Learning Convolutional Neural Networks, Multiple Instance Learning approaches, or the modelling of risk scores and their application to ML. The use of different approaches solves different problems within pathology workflows, including assistive applications for the detection and grading of tumours, quantification of biomarkers, and the delivery of established and new image-based biomarkers for treatment prediction and prognostic purposes. All these AI formats, applied to digital tissue images, are also beginning to transform our approach to clinical trials. In parallel, the novelty of DP/AI devices and the related computational science pipeline introduces new requirements for manufacturers to build into their design, development, regulatory and post-market processes, which may need to be taken into account when using AI applied to tissues in cancer discovery. Finally, DP/AI represents challenge to the way we accredit new diagnostic tools with clinical applicability, the understanding of which will allow cancer patients to have access to a new generation of complex biomarkers
Classification and Retrieval of Digital Pathology Scans: A New Dataset
In this paper, we introduce a new dataset, \textbf{Kimia Path24}, for image
classification and retrieval in digital pathology. We use the whole scan images
of 24 different tissue textures to generate 1,325 test patches of size
10001000 (0.5mm0.5mm). Training data can be generated according
to preferences of algorithm designer and can range from approximately 27,000 to
over 50,000 patches if the preset parameters are adopted. We propose a compound
patch-and-scan accuracy measurement that makes achieving high accuracies quite
challenging. In addition, we set the benchmarking line by applying LBP,
dictionary approach and convolutional neural nets (CNNs) and report their
results. The highest accuracy was 41.80\% for CNN.Comment: Accepted for presentation at Workshop for Computer Vision for
Microscopy Image Analysis (CVMI 2017) @ CVPR 2017, Honolulu, Hawai
Digital pathology - Rising to the challenge.
Digital pathology has gone through considerable technical advances during the past few years and certain aspects of digital diagnostics have been widely and swiftly adopted in many centers, catalyzed by the COVID-19 pandemic. However, analysis of requirements, careful planning, and structured implementation should to be considered in order to reap the full benefits of a digital workflow. The aim of this review is to provide a practical, concise and hands-on summary of issues relevant to implementing and developing digital diagnostics in the pathology laboratory. These include important initial considerations, possible approaches to overcome common challenges, potential diagnostic pitfalls, validation and regulatory issues and an introduction to the emerging field of image analysis in routine
Histopathological image analysis : a review
Over the past decade, dramatic increases in computational power and improvement in image analysis algorithms have allowed the development of powerful computer-assisted analytical approaches to radiological data. With the recent advent of whole slide digital scanners, tissue histopathology slides can now be digitized and stored in digital image form. Consequently, digitized tissue histopathology has now become amenable to the application of computerized image analysis and machine learning techniques. Analogous to the role of computer-assisted diagnosis (CAD) algorithms in medical imaging to complement the opinion of a radiologist, CAD algorithms have begun to be developed for disease detection, diagnosis, and prognosis prediction to complement the opinion of the pathologist. In this paper, we review the recent state of the art CAD technology for digitized histopathology. This paper also briefly describes the development and application of novel image analysis technology for a few specific histopathology related problems being pursued in the United States and Europe
- …