2,688 research outputs found
Spatial Organization and Molecular Correlation of Tumor-Infiltrating Lymphocytes Using Deep Learning on Pathology Images
Beyond sample curation and basic pathologic characterization, the digitized H&E-stained images
of TCGA samples remain underutilized. To highlight this resource, we present mappings of tumorinfiltrating lymphocytes (TILs) based on H&E images from 13 TCGA tumor types. These TIL
maps are derived through computational staining using a convolutional neural network trained to
classify patches of images. Affinity propagation revealed local spatial structure in TIL patterns and
correlation with overall survival. TIL map structural patterns were grouped using standard
histopathological parameters. These patterns are enriched in particular T cell subpopulations
derived from molecular measures. TIL densities and spatial structure were differentially enriched
among tumor types, immune subtypes, and tumor molecular subtypes, implying that spatial
infiltrate state could reflect particular tumor cell aberration states. Obtaining spatial lymphocytic
patterns linked to the rich genomic characterization of TCGA samples demonstrates one use for
the TCGA image archives with insights into the tumor-immune microenvironment
A Survey on Deep Learning in Medical Image Analysis
Deep learning algorithms, in particular convolutional networks, have rapidly
become a methodology of choice for analyzing medical images. This paper reviews
the major deep learning concepts pertinent to medical image analysis and
summarizes over 300 contributions to the field, most of which appeared in the
last year. We survey the use of deep learning for image classification, object
detection, segmentation, registration, and other tasks and provide concise
overviews of studies per application area. Open challenges and directions for
future research are discussed.Comment: Revised survey includes expanded discussion section and reworked
introductory section on common deep architectures. Added missed papers from
before Feb 1st 201
A Novel Dataset and a Deep Learning Method for Mitosis Nuclei Segmentation and Classification
Mitosis nuclei count is one of the important indicators for the pathological
diagnosis of breast cancer. The manual annotation needs experienced
pathologists, which is very time-consuming and inefficient. With the
development of deep learning methods, some models with good performance have
emerged, but the generalization ability should be further strengthened. In this
paper, we propose a two-stage mitosis segmentation and classification method,
named SCMitosis. Firstly, the segmentation performance with a high recall rate
is achieved by the proposed depthwise separable convolution residual block and
channel-spatial attention gate. Then, a classification network is cascaded to
further improve the detection performance of mitosis nuclei. The proposed model
is verified on the ICPR 2012 dataset, and the highest F-score value of 0.8687
is obtained compared with the current state-of-the-art algorithms. In addition,
the model also achieves good performance on GZMH dataset, which is prepared by
our group and will be firstly released with the publication of this paper. The
code will be available at:
https://github.com/antifen/mitosis-nuclei-segmentation.Comment: 19 pages,11 figures, 4 table
LUNG CANCER DETECTION IN LOW-RESOLUTION IMAGES
One of the most important prognostic factors for all lung cancer patients is the accurate detection of metastases. Pathologists, as we all know, examine the body and its tissues. On the existing clinical method, they have a tedious and manual task. Recent analysis has been inspired by these aspects. Deep Learning (DL) algorithms have been used to identify lung cancer. The developed cutting-edge technologies beat pathologists in terms of cancer identification and localization inside pathology images. These technologies, though, are not medically feasible because they need a massive amount of time or computing capabilities to perceive high-resolution images. Image processing techniques are primarily employed for lung cancer prediction and early identification and therapy to avoid lung cancer. This research aimed to assess lung cancer diagnosis by employing DL algorithms and low-resolution images. The goal would be to see if Machine Learning (ML) models might be created that generate higher confidence conclusions while consuming fractional resources by comparing low and high-resolution images. A DL pipeline has been built to a small enough size from compressing high-resolution images to be fed into an or before CNN (Convolutional Neural Network) for binary classification i.e. cancer or normal. Numerous enhancements have been done to increase overall performance, providing data augmentations, including augmenting training data and implementing tissue detection. Finally, the created low-resolution models are practically incapable of handling extremely low-resolution inputs i.e. 299 x 299 to 2048 x 2048 pixels. Considering the lack of classification ability, a substantial reduction in models’ predictable times is only a marginal benefit. Due to an obvious drawback with the methodology, this is disheartening but predicted finding: very low resolutions, essentially expanding out on a slide, preserve only data about macro-cellular structures, which is usually insufficient to diagnose cancer by itself
Case-based similar image retrieval for weakly annotated large histopathological images of malignant lymphoma using deep metric learning
In the present study, we propose a novel case-based similar image retrieval
(SIR) method for hematoxylin and eosin (H&E)-stained histopathological images
of malignant lymphoma. When a whole slide image (WSI) is used as an input
query, it is desirable to be able to retrieve similar cases by focusing on
image patches in pathologically important regions such as tumor cells. To
address this problem, we employ attention-based multiple instance learning,
which enables us to focus on tumor-specific regions when the similarity between
cases is computed. Moreover, we employ contrastive distance metric learning to
incorporate immunohistochemical (IHC) staining patterns as useful supervised
information for defining appropriate similarity between heterogeneous malignant
lymphoma cases. In the experiment with 249 malignant lymphoma patients, we
confirmed that the proposed method exhibited higher evaluation measures than
the baseline case-based SIR methods. Furthermore, the subjective evaluation by
pathologists revealed that our similarity measure using IHC staining patterns
is appropriate for representing the similarity of H&E-stained tissue images for
malignant lymphoma
RECENT CNN-BASED TECHNIQUES FOR BREAST CANCER HISTOLOGY IMAGE CLASSIFICATION
Histology images are extensively used by pathologists to assess abnormalities and detect malignancy in breast tissues. On the other hand, Convolutional Neural Networks (CNN) are by far, the privileged models for image classification and interpretation. Based on these two facts, we surveyed the recent CNN-based methods for breast cancer histology image analysis. The survey focuses on two major issues usually faced by CNN-based methods namely the design of an appropriate CNN architecture and the lack of a sufficient labelled dataset for training the model. Regarding the design of the CNN architecture, methods examining breast histology images adopt three main approaches: Designing manually from scratch the CNN architecture, using pre-trained models and adopting an automatic architecture design. Methods addressing the lack of labelled datasets are grouped into four categories: methods using pre-trained models, methods using data augmentation, methods adopting weakly supervised learning and those adopting feedforward filter learning. Research works from each category and reported performance are presented in this paper. We conclude the paper by indicating some future research directions related to the analysis of histology images
An Aggregation of Aggregation Methods in Computational Pathology
Image analysis and machine learning algorithms operating on multi-gigapixel
whole-slide images (WSIs) often process a large number of tiles (sub-images)
and require aggregating predictions from the tiles in order to predict
WSI-level labels. In this paper, we present a review of existing literature on
various types of aggregation methods with a view to help guide future research
in the area of computational pathology (CPath). We propose a general CPath
workflow with three pathways that consider multiple levels and types of data
and the nature of computation to analyse WSIs for predictive modelling. We
categorize aggregation methods according to the context and representation of
the data, features of computational modules and CPath use cases. We compare and
contrast different methods based on the principle of multiple instance
learning, perhaps the most commonly used aggregation method, covering a wide
range of CPath literature. To provide a fair comparison, we consider a specific
WSI-level prediction task and compare various aggregation methods for that
task. Finally, we conclude with a list of objectives and desirable attributes
of aggregation methods in general, pros and cons of the various approaches,
some recommendations and possible future directions.Comment: 32 pages, 4 figure
Recommended from our members
Functional Magnetic Resonance Imaging of Breast Cancer
This thesis examines the use of magnetic resonance imaging (MRI) techniques in the detection of breast cancer and the prediction of pathological complete response (pCR) to neoadjuvant chemotherapy (NACT).
This thesis compares the diagnostic performance of diffusion-weighted imaging (DWI) models in the breast using a systematic review and meta-analysis. Advanced diffusion models have been proposed that may improve the performance of standard DWI using the apparent diffusion coefficient (ADC) to discriminate between malignant and benign breast lesions. Pooling the results from 73 studies, comparable diagnostic accuracy is shown using the ADC and parameters from the intra-voxel incoherent motion (IVIM) and diffusion tensor imaging (DTI) models. This work highlights a lack of standardisation in DWI protocols and methodology. Conventional acquisition techniques used in DWI often suffer from image artefacts and low spatial resolution. A multi-shot DWI technique, multiplexed sensitivity encoding (MUSE), can improve the image quality of DWI. A MUSE protocol has been optimised through a series of phantom experiments and validated in 20 patients. Comparing MUSE to conventional DWI, statistically significant improvements are shown in distortion and blurring metrics and qualitative image quality metrics such as lesion conspicuity and diagnostic confidence, increasing the clinical utility of DWI.
This thesis investigates the use of dynamic contrast-enhanced MRI (DCE-MRI) in the detection of breast cancer and the prediction of pCR. Abbreviated MRI (ABB-MRI) protocols have gained increasing attention for the detection of breast cancer, acquiring a shortened version of a full diagnostic protocol (FDP-MRI) in a fraction of the time, reducing the cost of the examination. The diagnostic performance of abbreviated and full diagnostic protocols is systematically compared using a meta-analysis. Pooling 13 studies, equivalent diagnostic accuracy is shown for ABB-MRI in cohorts enriched with cancers, and lower but not significantly different diagnostic performance is shown in screening cohorts.
Higher order imaging features derived from pre-treatment DCE-MRI could be used to predict pCR and inform decisions regarding targeted treatment, avoiding unnecessary toxicity. Using data from 152 patients undergoing NACT, radiomics features are extracted from baseline DCE-MRI and machine learning models trained to predict pCR with moderate accuracy. The stability of feature selection using logistic regression classification is demonstrated and a comparison of models trained using features from different time points in the dynamic series demonstrates that a full dynamic series enables the most accurate prediction of pCR.GE Healthcare funded PhD Studentshi
Nuclei & Glands Instance Segmentation in Histology Images: A Narrative Review
Instance segmentation of nuclei and glands in the histology images is an
important step in computational pathology workflow for cancer diagnosis,
treatment planning and survival analysis. With the advent of modern hardware,
the recent availability of large-scale quality public datasets and the
community organized grand challenges have seen a surge in automated methods
focusing on domain specific challenges, which is pivotal for technology
advancements and clinical translation. In this survey, 126 papers illustrating
the AI based methods for nuclei and glands instance segmentation published in
the last five years (2017-2022) are deeply analyzed, the limitations of current
approaches and the open challenges are discussed. Moreover, the potential
future research direction is presented and the contribution of state-of-the-art
methods is summarized. Further, a generalized summary of publicly available
datasets and a detailed insights on the grand challenges illustrating the top
performing methods specific to each challenge is also provided. Besides, we
intended to give the reader current state of existing research and pointers to
the future directions in developing methods that can be used in clinical
practice enabling improved diagnosis, grading, prognosis, and treatment
planning of cancer. To the best of our knowledge, no previous work has reviewed
the instance segmentation in histology images focusing towards this direction.Comment: 60 pages, 14 figure
A Comprehensive Overview of Computational Nuclei Segmentation Methods in Digital Pathology
In the cancer diagnosis pipeline, digital pathology plays an instrumental
role in the identification, staging, and grading of malignant areas on biopsy
tissue specimens. High resolution histology images are subject to high variance
in appearance, sourcing either from the acquisition devices or the H\&E
staining process. Nuclei segmentation is an important task, as it detects the
nuclei cells over background tissue and gives rise to the topology, size, and
count of nuclei which are determinant factors for cancer detection. Yet, it is
a fairly time consuming task for pathologists, with reportedly high
subjectivity. Computer Aided Diagnosis (CAD) tools empowered by modern
Artificial Intelligence (AI) models enable the automation of nuclei
segmentation. This can reduce the subjectivity in analysis and reading time.
This paper provides an extensive review, beginning from earlier works use
traditional image processing techniques and reaching up to modern approaches
following the Deep Learning (DL) paradigm. Our review also focuses on the weak
supervision aspect of the problem, motivated by the fact that annotated data is
scarce. At the end, the advantages of different models and types of supervision
are thoroughly discussed. Furthermore, we try to extrapolate and envision how
future research lines will potentially be, so as to minimize the need for
labeled data while maintaining high performance. Future methods should
emphasize efficient and explainable models with a transparent underlying
process so that physicians can trust their output.Comment: 47 pages, 27 figures, 9 table
- …