110 research outputs found
Pre and Post-hoc Diagnosis and Interpretation of Malignancy from Breast DCE-MRI
We propose a new method for breast cancer screening from DCE-MRI based on a
post-hoc approach that is trained using weakly annotated data (i.e., labels are
available only at the image level without any lesion delineation). Our proposed
post-hoc method automatically diagnosis the whole volume and, for positive
cases, it localizes the malignant lesions that led to such diagnosis.
Conversely, traditional approaches follow a pre-hoc approach that initially
localises suspicious areas that are subsequently classified to establish the
breast malignancy -- this approach is trained using strongly annotated data
(i.e., it needs a delineation and classification of all lesions in an image).
Another goal of this paper is to establish the advantages and disadvantages of
both approaches when applied to breast screening from DCE-MRI. Relying on
experiments on a breast DCE-MRI dataset that contains scans of 117 patients,
our results show that the post-hoc method is more accurate for diagnosing the
whole volume per patient, achieving an AUC of 0.91, while the pre-hoc method
achieves an AUC of 0.81. However, the performance for localising the malignant
lesions remains challenging for the post-hoc method due to the weakly labelled
dataset employed during training.Comment: Submitted to Medical Image Analysi
Deep Learning in Breast Cancer Imaging: A Decade of Progress and Future Directions
Breast cancer has reached the highest incidence rate worldwide among all
malignancies since 2020. Breast imaging plays a significant role in early
diagnosis and intervention to improve the outcome of breast cancer patients. In
the past decade, deep learning has shown remarkable progress in breast cancer
imaging analysis, holding great promise in interpreting the rich information
and complex context of breast imaging modalities. Considering the rapid
improvement in the deep learning technology and the increasing severity of
breast cancer, it is critical to summarize past progress and identify future
challenges to be addressed. In this paper, we provide an extensive survey of
deep learning-based breast cancer imaging research, covering studies on
mammogram, ultrasound, magnetic resonance imaging, and digital pathology images
over the past decade. The major deep learning methods, publicly available
datasets, and applications on imaging-based screening, diagnosis, treatment
response prediction, and prognosis are described in detail. Drawn from the
findings of this survey, we present a comprehensive discussion of the
challenges and potential avenues for future research in deep learning-based
breast cancer imaging.Comment: Survey, 41 page
Recommended from our members
Pattern classification approaches for breast cancer identification via MRI: stateāofātheāart and vision for the future
Mining algorithms for Dynamic Contrast Enhanced Magnetic Resonance Imaging (DCEMRI)
of breast tissue are discussed. The algorithms are based on recent advances in multidimensional
signal processing and aim to advance current stateāofātheāart computerāaided detection
and analysis of breast tumours when these are observed at various states of development. The topics
discussed include image feature extraction, information fusion using radiomics, multiāparametric
computerāaided classification and diagnosis using information fusion of tensorial datasets as well
as Clifford algebra based classification approaches and convolutional neural network deep learning
methodologies. The discussion also extends to semiāsupervised deep learning and selfāsupervised
strategies as well as generative adversarial networks and algorithms using generated
confrontational learning approaches. In order to address the problem of weakly labelled tumour
images, generative adversarial deep learning strategies are considered for the classification of
different tumour types. The proposed data fusion approaches provide a novel Artificial Intelligence
(AI) based framework for more robust image registration that can potentially advance the early
identification of heterogeneous tumour types, even when the associated imaged organs are
registered as separate entities embedded in more complex geometric spaces. Finally, the general
structure of a highādimensional medical imaging analysis platform that is based on multiātask
detection and learning is proposed as a way forward. The proposed algorithm makes use of novel
loss functions that form the building blocks for a generated confrontation learning methodology
that can be used for tensorial DCEāMRI. Since some of the approaches discussed are also based on
timeālapse imaging, conclusions on the rate of proliferation of the disease can be made possible. The
proposed framework can potentially reduce the costs associated with the interpretation of medical
images by providing automated, faster and more consistent diagnosis
Deep learning-based prediction of response to HER2-targeted neoadjuvant chemotherapy from pre-treatment dynamic breast MRI: A multi-institutional validation study
Predicting response to neoadjuvant therapy is a vexing challenge in breast
cancer. In this study, we evaluate the ability of deep learning to predict
response to HER2-targeted neo-adjuvant chemotherapy (NAC) from pre-treatment
dynamic contrast-enhanced (DCE) MRI acquired prior to treatment. In a
retrospective study encompassing DCE-MRI data from a total of 157 HER2+ breast
cancer patients from 5 institutions, we developed and validated a deep learning
approach for predicting pathological complete response (pCR) to HER2-targeted
NAC prior to treatment. 100 patients who received HER2-targeted neoadjuvant
chemotherapy at a single institution were used to train (n=85) and tune (n=15)
a convolutional neural network (CNN) to predict pCR. A multi-input CNN
leveraging both pre-contrast and late post-contrast DCE-MRI acquisitions was
identified to achieve optimal response prediction within the validation set
(AUC=0.93). This model was then tested on two independent testing cohorts with
pre-treatment DCE-MRI data. It achieved strong performance in a 28 patient
testing set from a second institution (AUC=0.85, 95% CI 0.67-1.0, p=.0008) and
a 29 patient multicenter trial including data from 3 additional institutions
(AUC=0.77, 95% CI 0.58-0.97, p=0.006). Deep learning-based response prediction
model was found to exceed a multivariable model incorporating predictive
clinical variables (AUC < .65 in testing cohorts) and a model of
semi-quantitative DCE-MRI pharmacokinetic measurements (AUC < .60 in testing
cohorts). The results presented in this work across multiple sites suggest that
with further validation deep learning could provide an effective and reliable
tool to guide targeted therapy in breast cancer, thus reducing overtreatment
among HER2+ patients.Comment: Braman and El Adoui contributed equally to this work. 33 pages, 3
figures in main tex
A Survey on Deep Learning in Medical Image Analysis
Deep learning algorithms, in particular convolutional networks, have rapidly
become a methodology of choice for analyzing medical images. This paper reviews
the major deep learning concepts pertinent to medical image analysis and
summarizes over 300 contributions to the field, most of which appeared in the
last year. We survey the use of deep learning for image classification, object
detection, segmentation, registration, and other tasks and provide concise
overviews of studies per application area. Open challenges and directions for
future research are discussed.Comment: Revised survey includes expanded discussion section and reworked
introductory section on common deep architectures. Added missed papers from
before Feb 1st 201
A Comparative Study for Brain Tumor Detection Analysis using CNN and VGG-16 and its Application
The incidence of brain tumors, a highly
malignant form of cancer, is widespread around the
world, affecting millions of individuals. Early detection
plays a crucial role in saving lives, but the process of
identifying and classifying tumor types accurately
requires reviewing numerous MRI images. Deep learning
models have the capability to handle such large datasets
and provide precise results. However, it is important to
note that the outcomes produced by deep learning models
can vary depending on the dataset used.
This comparative study focused on evaluating the
effectiveness of deep learning models on two distinct
Magnetic Resonance Imaging (MRI) brain tumor
datasets. The goal of this research was to identify the best
deep learning model that can achieve the highest
accuracy in detecting brain tumors compared to others in
the dataset. The models were individually applied to pre-
processed datasets to extract features from the MRI
images. Segmentation of tumor regions can be
challenging due to the visual similarity between normal
tissue and brain tumor cells. Therefore, an automatic
tumor detection approach with high accuracy is
necessary.
To train our algorithm effectively, a diverse range of
MRI images with different tumor sizes, locations, shapes,
and intensities was utilized. We employed "TensorFlow"
and "Keras" frameworks within the programming
language "Python" to develop our optimal solution, as
this language provides efficient functionality for rapid
implementation. As part of the research process, a
comprehensive literature review was conducted, and
secondary data was collected. Performance metrics were
employed for data analysis, leading to conclusions and
recommendations for the most suitable deep learning
approach model
- ā¦