AI-enhanced diagnosis of challenging lesions in breast MRI: a methodology and application primer

Computer-aided diagnosis (CAD) systems have become an important tool in the assessment of breast tumors with magnetic resonance imaging (MRI). CAD systems can be used for the detection and diagnosis of breast tumors as a “second opinion” review complementing the radiologist’s review. CAD systems have many common parts such as image pre-processing, tumor feature extraction and data classification that are mostly based on machine learning (ML) techniques. In this review paper, we describe the application of ML-based CAD systems in MRI of the breast covering the detection of diagnostically challenging lesions such as non-mass enhancing (NME) lesions, multiparametric MRI, neo-adjuvant chemotherapy (NAC) and radiomics all applied to NME. Since ML has been widely used in the medical imaging community, we provide an overview about the state-ofthe-art and novel techniques applied as classifiers to CAD systems. The differences in the CAD systems in MRI of the breast for several standard and novel applications for NME are explained in detail to provide important examples illustrating: (i) CAD for the detection and diagnosis, (ii) CAD in multi-parametric imaging (iii) CAD in NAC and (iv) breast cancer radiomics. We aim to provide a comparison between these CAD applications and to illustrate a global view on intelligent CAD systems based on ANN in MRI of the breast

Computer-aided detection and diagnosis of breast cancer in 2D and 3D medical imaging through multifractal analysis

This Thesis describes the research work performed in the scope of a doctoral research program and presents its conclusions and contributions. The research activities were carried on in the industry with Siemens S.A. Healthcare Sector, in integration with a research team. Siemens S.A. Healthcare Sector is one of the world biggest suppliers of products, services and complete solutions in the medical sector. The company offers a wide selection of diagnostic and therapeutic equipment and information systems. Siemens products for medical imaging and in vivo diagnostics include: ultrasound, computer tomography, mammography, digital breast tomosynthesis, magnetic resonance, equipment to angiography and coronary angiography, nuclear imaging, and many others. Siemens has a vast experience in Healthcare and at the beginning of this project it was strategically interested in solutions to improve the detection of Breast Cancer, to increase its competitiveness in the sector. The company owns several patents related with self-similarity analysis, which formed the background of this Thesis. Furthermore, Siemens intended to explore commercially the computer- aided automatic detection and diagnosis eld for portfolio integration. Therefore, with the high knowledge acquired by University of Beira Interior in this area together with this Thesis, will allow Siemens to apply the most recent scienti c progress in the detection of the breast cancer, and it is foreseeable that together we can develop a new technology with high potential. The project resulted in the submission of two invention disclosures for evaluation in Siemens A.G., two articles published in peer-reviewed journals indexed in ISI Science Citation Index, two other articles submitted in peer-reviewed journals, and several international conference papers. This work on computer-aided-diagnosis in breast led to innovative software and novel processes of research and development, for which the project received the Siemens Innovation Award in 2012. It was very rewarding to carry on such technological and innovative project in a socially sensitive area as Breast Cancer.No cancro da mama a deteção precoce e o diagnóstico correto são de extrema importância na prescrição terapêutica e caz e e ciente, que potencie o aumento da taxa de sobrevivência à doença. A teoria multifractal foi inicialmente introduzida no contexto da análise de sinal e a sua utilidade foi demonstrada na descrição de comportamentos siológicos de bio-sinais e até na deteção e predição de patologias. Nesta Tese, três métodos multifractais foram estendidos para imagens bi-dimensionais (2D) e comparados na deteção de microcalci cações em mamogramas. Um destes métodos foi também adaptado para a classi cação de massas da mama, em cortes transversais 2D obtidos por ressonância magnética (RM) de mama, em grupos de massas provavelmente benignas e com suspeição de malignidade. Um novo método de análise multifractal usando a lacunaridade tri-dimensional (3D) foi proposto para classi cação de massas da mama em imagens volumétricas 3D de RM de mama. A análise multifractal revelou diferenças na complexidade subjacente às localizações das microcalci cações em relação aos tecidos normais, permitindo uma boa exatidão da sua deteção em mamogramas. Adicionalmente, foram extraídas por análise multifractal características dos tecidos que permitiram identi car os casos tipicamente recomendados para biópsia em imagens 2D de RM de mama. A análise multifractal 3D foi e caz na classi cação de lesões mamárias benignas e malignas em imagens 3D de RM de mama. Este método foi mais exato para esta classi cação do que o método 2D ou o método padrão de análise de contraste cinético tumoral. Em conclusão, a análise multifractal fornece informação útil para deteção auxiliada por computador em mamogra a e diagnóstico auxiliado por computador em imagens 2D e 3D de RM de mama, tendo o potencial de complementar a interpretação dos radiologistas

Modified fuzzy rough set technique with stacked autoencoder model for magnetic resonance imaging based breast cancer detection

Breast cancer is the common cancer in women, where early detection reduces the mortality rate. The magnetic resonance imaging (MRI) images are efficient in analyzing breast cancer, but it is hard to identify the abnormalities. The manual breast cancer detection in MRI images is inefficient; therefore, a deep learning-based system is implemented in this manuscript. Initially, the visual quality improvement is done using region growing and adaptive histogram equalization (AHE), and then, the breast lesion is segmented by Otsu thresholding with morphological transform. Next, the features are extracted from the segmented lesion, and a modified fuzzy rough set technique is proposed to reduce the dimensions of the extracted features that decreases the system complexity and computational time. The active features are fed to the stacked autoencoder for classifying the benign and malignant classes. The results demonstrated that the proposed model attained 99% and 99.22% of classification accuracy on the benchmark datasets, which are higher related to the comparative classifiers: decision tree, naïve Bayes, random forest and k-nearest neighbor (KNN). The obtained results state that the proposed model superiorly screens and detects the breast lesions that assists clinicians in effective therapeutic intervention and timely treatment

Pre and Post-hoc Diagnosis and Interpretation of Malignancy from Breast DCE-MRI

We propose a new method for breast cancer screening from DCE-MRI based on a post-hoc approach that is trained using weakly annotated data (i.e., labels are available only at the image level without any lesion delineation). Our proposed post-hoc method automatically diagnosis the whole volume and, for positive cases, it localizes the malignant lesions that led to such diagnosis. Conversely, traditional approaches follow a pre-hoc approach that initially localises suspicious areas that are subsequently classified to establish the breast malignancy -- this approach is trained using strongly annotated data (i.e., it needs a delineation and classification of all lesions in an image). Another goal of this paper is to establish the advantages and disadvantages of both approaches when applied to breast screening from DCE-MRI. Relying on experiments on a breast DCE-MRI dataset that contains scans of 117 patients, our results show that the post-hoc method is more accurate for diagnosing the whole volume per patient, achieving an AUC of 0.91, while the pre-hoc method achieves an AUC of 0.81. However, the performance for localising the malignant lesions remains challenging for the post-hoc method due to the weakly labelled dataset employed during training.Comment: Submitted to Medical Image Analysi

Breast Tumor Identification in Ultrafast MRI Using Temporal and Spatial Information

Purpose: To investigate the feasibility of using deep learning methods to differentiate benign from malignant breast lesions in ultrafast MRI with both temporal and spatial information. Methods: A total of 173 single breasts of 122 women (151 examinations) with lesions above 5 mm were retrospectively included. A total of 109 out of 173 lesions were benign. Maximum intensity projection (MIP) images were generated from each of the 14 contrast-enhanced T1-weighted acquisitions in the ultrafast MRI scan. A 2D convolutional neural network (CNN) and a long short-term memory (LSTM) network were employed to extract morphological and temporal features, respectively. The 2D CNN model was trained with the MIPs from the last four acquisitions to ensure the visibility of the lesions, while the LSTM model took MIPs of an entire scan as input. The performance of each model and their combination were evaluated with 100-times repeated stratified four-fold cross-validation. Those models were then compared with models developed with standard DCE-MRI which followed the same data split. Results: In the differentiation between benign and malignant lesions, the ultrafast MRI-based 2D CNN achieved a mean AUC of 0.81 ± 0.06, and the LSTM network achieved a mean AUC of 0.78 ± 0.07; their combination showed a mean AUC of 0.83 ± 0.06 in the cross-validation. The mean AUC values were significantly higher for ultrafast MRI-based models than standard DCE-MRI-based models. Conclusion: Deep learning models developed with ultrafast breast MRI achieved higher performances than standard DCE-MRI for malignancy discrimination. The improved AUC values of the combined models indicate an added value of temporal information extracted by the LSTM model in breast lesion characterization

Radiomic and Artificial Intelligence Analysis with Textural Metrics, Morphological and Dynamic Perfusion Features Extracted by Dynamic Contrast-Enhanced Magnetic Resonance Imaging in the Classification of Breast Lesions

The aim of the study was to estimate the diagnostic accuracy of textural, morpho- logical and dynamic features, extracted by dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) images, by carrying out univariate and multivariate statistical analyses including artificial intelligence approaches. Methods: In total, 85 patients with known breast lesion were enrolled in this retrospective study according to regulations issued by the local Institutional Review Board. All patients underwent DCE-MRI examination. The reference standard was pathology from a surgical specimen for malignant lesions and pathology from a surgical specimen or fine needle aspiration cytology, core or Tru-Cut needle biopsy for benign lesions. In total, 91 samples of 85 patients were ana- lyzed. Furthermore, 48 textural metrics, 15 morphological and 81 dynamic parameters were extracted by manually segmenting regions of interest. Statistical analyses including univariate and multivari- ate approaches were performed: non-parametric Wilcoxon–Mann–Whitney test; receiver operating characteristic (ROC), linear classifier (LDA), decision tree (DT), k-nearest neighbors (KNN), and support vector machine (SVM) were utilized. A balancing approach and feature selection methods were used. Results: The univariate analysis showed low accuracy and area under the curve (AUC) for all considered features. Instead, in the multivariate textural analysis, the best performance (accuracy (ACC) = 0.78; AUC = 0.78) was reached with all 48 metrics and an LDA trained with balanced data. The best performance (ACC = 0.75; AUC = 0.80) using morphological features was reached with an SVM trained with 10-fold cross-variation (CV) and balanced data (with adaptive synthetic (ADASYN) function) and a subset of five robust morphological features (circularity, rectangularity, sphericity, gleaning and surface). The best performance (ACC = 0.82; AUC = 0.83) using dynamic features was reached with a trained SVM and balanced data (with ADASYN function). Conclusion: Multivariate analyses using pattern recognition approaches, including all morphological, textural and dynamic features, optimized by adaptive synthetic sampling and feature selection operations obtained the best results and showed the best performance in the discrimination of benign and malignant lesions

Tensor based multichannel reconstruction for breast tumours identification from DCE-MRIs

A new methodology based on tensor algebra that uses a higher order singular value decomposition to perform three-dimensional voxel reconstruction from a series of temporal images obtained using dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) is proposed. Principal component analysis (PCA) is used to robustly extract the spatial and temporal image features and simultaneously de-noise the datasets. Tumour segmentation on enhanced scaled (ES) images performed using a fuzzy C-means (FCM) cluster algorithm is compared with that achieved using the proposed tensorial framework. The proposed algorithm explores the correlations between spatial and temporal features in the tumours. The multi-channel reconstruction enables improved breast tumour identification through enhanced de-noising and improved intensity consistency. The reconstructed tumours have clear and continuous boundaries; furthermore the reconstruction shows better voxel clustering in tumour regions of interest. A more homogenous intensity distribution is also observed, enabling improved image contrast between tumours and background, especially in places where fatty tissue is imaged. The fidelity of reconstruction is further evaluated on the basis of five new qualitative metrics. Results confirm the superiority of the tensorial approach. The proposed reconstruction metrics should also find future applications in the assessment of other reconstruction algorithms

Radiologic evaluation of breast disorders related to tuberculosis amongst women in Durban, KwaZulu-Natal, South Africa.

Doctor of Philosophy in Clinical Medicine, University of KwaZulu-Natal, Durban, 2016.Women in KwaZulu-Natal Province, South Africa, are at high risk of developing breast tuberculosis (BTB) due to the increased incidence of HIV. However, there is a general lack of knowledge regarding the various diseases that can affect the breast. This is compounded by lack of the national breast screening program. As a result, many patients with breast cancer (BCA) and BTB are initially misdiagnosed by clinicians. It was evident from the study that much still has to be done in educating the public and healthcare workers about breast diseases. This project endeavoured to compare the effectiveness of various radiological technologies to identify breast problems. The study consisted of three phases all based at Ethekwini Municipality tertiary referral hospitals. The first phase aimed to determine the prevalence of the BTB using retrospective data over a period of 13 years. The same data further provided information of the clinical and radiological manifestations of BTB. This study concluded that while BTB is not common, it shares the clinical and radiology features with BCA, and is difficult to diagnose with current pathology methods. The second phase was done prospectively by recruiting patients who were newly diagnosed with BTB. The aim was to evaluate the use of modern imaging techniques to further describe the radiology patterns of BTB and to determine the radiological parameters that may be used in disease monitoring. The results provided insight into disease extent, and showed that it is usually more severe than perceived with current diagnostic methods. The third phase was performed using retrospective image analysis of patients who had BCA and BTB by using modern radiology techniques. The purpose was to identify the salient features that can differentiate BTB from the BCA. Several radiology parameters were identified as possible biomarkers for differentiation between the two conditions. The knowledge of their respective features would aid in the timeous diagnosis of both conditions, particularly in cases where the pathology results are inconclusive for various reasons. Overall the study highlights the lack of evidence based information on BTB. Recommendations and conclusions are provided in the last chapter

Automated Detection and Segmentation of Nonmass-Enhancing Breast Tumors with Dynamic Contrast-Enhanced Magnetic Resonance Imaging

Nonmass-enhancing (NME) lesions constitute a diagnostic challenge in dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) of the breast. Computer-aided diagnosis (CAD) systems provide physicians with advanced tools for analysis, assessment, and evaluation that have a significant impact on the diagnostic performance. Here, we propose a new approach to address the challenge of NME lesion detection and segmentation, taking advantage of independent component analysis (ICA) to extract data-driven dynamic lesion characterizations. A set of independent sources was obtained from the DCE-MRI dataset of breast cancer patients, and the dynamic behavior of the different tissues was described by multiple dynamic curves, together with a set of eigenimages describing the scores for each voxel. A new test image is projected onto the independent source space using the unmixing matrix, and each voxel is classified by a support vector machine (SVM) that has already been trained with manually delineated data. A solution to the high false-positive rate problem is proposed by controlling the SVM hyperplane location, outperforming previously published approaches.European Unions Horizon 2020 Research and Innovation Programme under the Marie Skodowska-Curie grant agreement No. 656886Austrian National Bank "Jubilaeumsfond" Project 162192020-Research and Innovation Framework Programme PHC-11-2015 667211-2Siemens AustriaNovomedGuerbet, FranceNIH/NCI Cancer Center Support Grant P30CA00874