736 research outputs found
Mitosis Detection, Fast and Slow: Robust and Efficient Detection of Mitotic Figures
Counting of mitotic figures is a fundamental step in grading and
prognostication of several cancers. However, manual mitosis counting is tedious
and time-consuming. In addition, variation in the appearance of mitotic figures
causes a high degree of discordance among pathologists. With advances in deep
learning models, several automatic mitosis detection algorithms have been
proposed but they are sensitive to {\em domain shift} often seen in histology
images. We propose a robust and efficient two-stage mitosis detection
framework, which comprises mitosis candidate segmentation ({\em Detecting
Fast}) and candidate refinement ({\em Detecting Slow}) stages. The proposed
candidate segmentation model, termed \textit{EUNet}, is fast and accurate due
to its architectural design. EUNet can precisely segment candidates at a lower
resolution to considerably speed up candidate detection. Candidates are then
refined using a deeper classifier network, EfficientNet-B7, in the second
stage. We make sure both stages are robust against domain shift by
incorporating domain generalization methods. We demonstrate state-of-the-art
performance and generalizability of the proposed model on the three largest
publicly available mitosis datasets, winning the two mitosis domain
generalization challenge contests (MIDOG21 and MIDOG22). Finally, we showcase
the utility of the proposed algorithm by processing the TCGA breast cancer
cohort (1,125 whole-slide images) to generate and release a repository of more
than 620K mitotic figures.Comment: Extended version of the work done for MIDOG challenge submissio
Deep Learning for Semantic Segmentation versus Classification in Computational Pathology: Application to mitosis analysis in Breast Cancer grading
Existing computational pathology approaches did not allow, yet, the emergence of effective/efficient computer-aided tools used as a second opinion for pathologists in the daily practice. Focusing on the case of computer-based qualification for breast cancer diagnosis, the present article proposes two deep learning architectures to efficiently and effectively detect and classify mitosis in a histopathological tissue sample. The first method consisted of two parts, entailing a preprocessing of the digital histological image and a free-handcrafted-feature Convolutional Neural Network (CNN) used for binary classification. Results show that the methodology proposed can achieve 95% accuracy in testing with an F1-score of 94.35%, which is higher than the results from the literature using classical image processing techniques and also higher than the approaches using handcrafted features combined with CNNs. The second approach was an end-to-end methodology using semantic segmentation. Results showed that this algorithm can achieve an accuracy higher than 95% in testing and an average Dice index of 0.6 which is higher than the results from the literature using CNNs (0.9 F1-score). Additionally, due to the semantic properties of the deep learning approach, an end-to-end deep learning framework is viable to perform both tasks: detection and classification of mitosis. The results showed the potential of deep learning in the analysis of Whole Slide Images (WSI) and its integration to computer-aided systems. The extension of this work to whole slide images is also addressed in the last two chapters; as well as, some computational key points that are useful when constructing a computer-aided-system inspired by the described technology.Trabajo de investigació
Deep Learning in Breast Cancer Imaging: A Decade of Progress and Future Directions
Breast cancer has reached the highest incidence rate worldwide among all
malignancies since 2020. Breast imaging plays a significant role in early
diagnosis and intervention to improve the outcome of breast cancer patients. In
the past decade, deep learning has shown remarkable progress in breast cancer
imaging analysis, holding great promise in interpreting the rich information
and complex context of breast imaging modalities. Considering the rapid
improvement in the deep learning technology and the increasing severity of
breast cancer, it is critical to summarize past progress and identify future
challenges to be addressed. In this paper, we provide an extensive survey of
deep learning-based breast cancer imaging research, covering studies on
mammogram, ultrasound, magnetic resonance imaging, and digital pathology images
over the past decade. The major deep learning methods, publicly available
datasets, and applications on imaging-based screening, diagnosis, treatment
response prediction, and prognosis are described in detail. Drawn from the
findings of this survey, we present a comprehensive discussion of the
challenges and potential avenues for future research in deep learning-based
breast cancer imaging.Comment: Survey, 41 page
Domain Generalization in Computational Pathology: Survey and Guidelines
Deep learning models have exhibited exceptional effectiveness in
Computational Pathology (CPath) by tackling intricate tasks across an array of
histology image analysis applications. Nevertheless, the presence of
out-of-distribution data (stemming from a multitude of sources such as
disparate imaging devices and diverse tissue preparation methods) can cause
\emph{domain shift} (DS). DS decreases the generalization of trained models to
unseen datasets with slightly different data distributions, prompting the need
for innovative \emph{domain generalization} (DG) solutions. Recognizing the
potential of DG methods to significantly influence diagnostic and prognostic
models in cancer studies and clinical practice, we present this survey along
with guidelines on achieving DG in CPath. We rigorously define various DS
types, systematically review and categorize existing DG approaches and
resources in CPath, and provide insights into their advantages, limitations,
and applicability. We also conduct thorough benchmarking experiments with 28
cutting-edge DG algorithms to address a complex DG problem. Our findings
suggest that careful experiment design and CPath-specific Stain Augmentation
technique can be very effective. However, there is no one-size-fits-all
solution for DG in CPath. Therefore, we establish clear guidelines for
detecting and managing DS depending on different scenarios. While most of the
concepts, guidelines, and recommendations are given for applications in CPath,
we believe that they are applicable to most medical image analysis tasks as
well.Comment: Extended Versio
Roto-Translation Equivariant Convolutional Networks: Application to Histopathology Image Analysis
Rotation-invariance is a desired property of machine-learning models for
medical image analysis and in particular for computational pathology
applications. We propose a framework to encode the geometric structure of the
special Euclidean motion group SE(2) in convolutional networks to yield
translation and rotation equivariance via the introduction of SE(2)-group
convolution layers. This structure enables models to learn feature
representations with a discretized orientation dimension that guarantees that
their outputs are invariant under a discrete set of rotations. Conventional
approaches for rotation invariance rely mostly on data augmentation, but this
does not guarantee the robustness of the output when the input is rotated. At
that, trained conventional CNNs may require test-time rotation augmentation to
reach their full capability. This study is focused on histopathology image
analysis applications for which it is desirable that the arbitrary global
orientation information of the imaged tissues is not captured by the machine
learning models. The proposed framework is evaluated on three different
histopathology image analysis tasks (mitosis detection, nuclei segmentation and
tumor classification). We present a comparative analysis for each problem and
show that consistent increase of performances can be achieved when using the
proposed framework
Machine learning based prediction of squamous cell carcinoma in ex vivo confocal laser scanning microscopy
Image classification with convolutional neural networks (CNN) offers an unprecedented opportunity to medical imaging. Regulatory agencies in the USA and Europe have already cleared numerous deep learning/machine learning based medical devices and algorithms. While the field of radiology is on the forefront of artificial intelligence (AI) revolution, conventional pathology, which commonly relies on examination of tissue samples on a glass slide, is falling behind in leveraging this technology. On the other hand, ex vivo confocal laser scanning microscopy (ex vivo CLSM), owing to its digital workflow features, has a high potential to benefit from integrating AI tools into the assessment and decision-making process. Aim of this work was to explore a preliminary application of CNN in digitally stained ex vivo CLSM images of cutaneous squamous cell carcinoma (cSCC) for automated detection of tumor tissue. Thirty-four freshly excised tissue samples were prospectively collected and examined immediately after resection. After the histologically confirmed ex vivo CLSM diagnosis, the tumor tissue was annotated for segmentation by experts, in order to train the MobileNet CNN. The model was then trained and evaluated using cross validation. The overall sensitivity and specificity of the deep neural network for detecting cSCC and tumor free areas on ex vivo CLSM slides compared to expert evaluation were 0.76 and 0.91, respectively. The area under the ROC curve was equal to 0.90 and the area under the precision-recall curve was 0.85. The results demonstrate a high potential of deep learning models to detect cSCC regions on digitally stained ex vivo CLSM slides and to distinguish them from tumor-free skin
- …