Breast Tumor Identification in Ultrafast MRI Using Temporal and Spatial Information

Purpose: To investigate the feasibility of using deep learning methods to differentiate benign from malignant breast lesions in ultrafast MRI with both temporal and spatial information. Methods: A total of 173 single breasts of 122 women (151 examinations) with lesions above 5 mm were retrospectively included. A total of 109 out of 173 lesions were benign. Maximum intensity projection (MIP) images were generated from each of the 14 contrast-enhanced T1-weighted acquisitions in the ultrafast MRI scan. A 2D convolutional neural network (CNN) and a long short-term memory (LSTM) network were employed to extract morphological and temporal features, respectively. The 2D CNN model was trained with the MIPs from the last four acquisitions to ensure the visibility of the lesions, while the LSTM model took MIPs of an entire scan as input. The performance of each model and their combination were evaluated with 100-times repeated stratified four-fold cross-validation. Those models were then compared with models developed with standard DCE-MRI which followed the same data split. Results: In the differentiation between benign and malignant lesions, the ultrafast MRI-based 2D CNN achieved a mean AUC of 0.81 ± 0.06, and the LSTM network achieved a mean AUC of 0.78 ± 0.07; their combination showed a mean AUC of 0.83 ± 0.06 in the cross-validation. The mean AUC values were significantly higher for ultrafast MRI-based models than standard DCE-MRI-based models. Conclusion: Deep learning models developed with ultrafast breast MRI achieved higher performances than standard DCE-MRI for malignancy discrimination. The improved AUC values of the combined models indicate an added value of temporal information extracted by the LSTM model in breast lesion characterization

Deep Learning in Breast Cancer Imaging: A Decade of Progress and Future Directions

Breast cancer has reached the highest incidence rate worldwide among all malignancies since 2020. Breast imaging plays a significant role in early diagnosis and intervention to improve the outcome of breast cancer patients. In the past decade, deep learning has shown remarkable progress in breast cancer imaging analysis, holding great promise in interpreting the rich information and complex context of breast imaging modalities. Considering the rapid improvement in the deep learning technology and the increasing severity of breast cancer, it is critical to summarize past progress and identify future challenges to be addressed. In this paper, we provide an extensive survey of deep learning-based breast cancer imaging research, covering studies on mammogram, ultrasound, magnetic resonance imaging, and digital pathology images over the past decade. The major deep learning methods, publicly available datasets, and applications on imaging-based screening, diagnosis, treatment response prediction, and prognosis are described in detail. Drawn from the findings of this survey, we present a comprehensive discussion of the challenges and potential avenues for future research in deep learning-based breast cancer imaging.Comment: Survey, 41 page

Radiomics for the Discrimination of Infiltrative vs In Situ Breast Cancer

Breast cancer is the most common malignant tumor in women worldwide. Its early diagnosis relies on radiology and clinical evaluation, supplemented by biopsy confirmation. Technological advances in medical imaging, especially in the field of artificial intelligence, allow to address clinical challenges in cancer detection and classification, as well as in the assessment of treatment response, and in monitoring disease progression. Radiomics allows to extract features from images, related to tumor size, shape, intensity, and texture, providing comprehensive tumor characterization. In this paper, we briefly review some Radiomics approaches in breast cancer, focusing on the non-invasive distinction between in-situ and infiltrating breast tumors, and present a preliminary test using Radiomics signatures in DCE-MRI and machine learning, aimed to investigate the feasibility of distinguishing infiltrating cancer from ductal carcinoma in situ (DCIS) diagnosed by preoperative core needle biopsy

Breast cancer classification through multivariate radiomic time series analysis in DCE-MRI sequences

Breast cancer is the most prevalent disease that poses a significant threat to women’s health. Despite the Dynamic Contrast-Enhanced MRI (DCE-MRI) has been widely used for breast cancer classification, its diagnostic performance is still suboptimal. In this work, the Radiomic workflow was implemented to classify the whole DCE-MRI sequence based on the distinction in contrast agent uptake between benign and malignant lesions. The radiomic features extracted from each of the seven time instants within the DCE-MRI sequence were fed into a multi-instant features selection strategy to select the discriminative features for time series classification. Several time series classification algorithms including Rocket, MultiRocket, K-Nearest Neighbor, Time Series Forest, and Supervised Time Series Forest were compared. Firstly, a univariate classification was performed to find the five most informative radiomic series, and then, a multivariate time series classification was implemented via a voting mechanism. The Multivariate Rocket model was the most accurate (Accuracy = 0.852, AUC-ROC = 0.852, Specificity = 0.823, Sensitivity = 0.882). The intelligible radiomic features enabled model findings explanations and clinical validation. In particular, the Energy and TotalEnergy were among the most important features, and the most descriptive for the change in signal intensity, which is the main effect of the contrast agent

Emerging Techniques in Breast MRI

As indicated throughout this chapter, there is a constant effort to move to more sensitive, specific, and quantitative methods for characterizing breast tissue via magnetic resonance imaging (MRI). In the present chapter, we focus on six emerging techniques that seek to quantitatively interrogate the physiological and biochemical properties of the breast. At the physiological scale, we present an overview of ultrafast dynamic contrast-enhanced MRI and magnetic resonance elastography which provide remarkable insights into the vascular and mechanical properties of tissue, respectively. Moving to the biochemical scale, magnetization transfer, chemical exchange saturation transfer, and spectroscopy (both “conventional” and hyperpolarized) methods all provide unique, noninvasive, insights into tumor metabolism. Given the breadth and depth of information that can be obtained in a single MRI session, methods of data synthesis and interpretation must also be developed. Thus, we conclude the chapter with an introduction to two very different, though complementary, methods of data analysis: (1) radiomics and habitat imaging, and (2) mechanism-based mathematical modeling

Scientific Status Quo of Small Renal Lesions: Diagnostic Assessment and Radiomics

Background: Small renal masses (SRMs) are defined as contrast-enhanced renal lesions less than or equal to 4 cm in maximal diameter, which can be compatible with stage T1a renal cell carcinomas (RCCs). Currently, 50-61% of all renal tumors are found incidentally. Methods: The characteristics of the lesion influence the choice of the type of management, which include several methods SRM of management, including nephrectomy, partial nephrectomy, ablation, observation, and also stereotactic body radiotherapy. Typical imaging methods available for differentiating benign from malignant renal lesions include ultrasound (US), contrast-enhanced ultrasound (CEUS), computed tomography (CT), and magnetic resonance imaging (MRI). Results: Although ultrasound is the first imaging technique used to detect small renal lesions, it has several limitations. CT is the main and most widely used imaging technique for SRM characterization. The main advantages of MRI compared to CT are the better contrast resolution and tissue characterization, the use of functional imaging sequences, the possibility of performing the examination in patients allergic to iodine-containing contrast medium, and the absence of exposure to ionizing radiation. For a correct evaluation during imaging follow-up, it is necessary to use a reliable method for the assessment of renal lesions, represented by the Bosniak classification system. This classification was initially developed based on contrast-enhanced CT imaging findings, and the 2019 revision proposed the inclusion of MRI features; however, the latest classification has not yet received widespread validation. Conclusions: The use of radiomics in the evaluation of renal masses is an emerging and increasingly central field with several applications such as characterizing renal masses, distinguishing RCC subtypes, monitoring response to targeted therapeutic agents, and prognosis in a metastatic context

Computer-aided detection and diagnosis of breast cancer in 2D and 3D medical imaging through multifractal analysis

This Thesis describes the research work performed in the scope of a doctoral research program and presents its conclusions and contributions. The research activities were carried on in the industry with Siemens S.A. Healthcare Sector, in integration with a research team. Siemens S.A. Healthcare Sector is one of the world biggest suppliers of products, services and complete solutions in the medical sector. The company offers a wide selection of diagnostic and therapeutic equipment and information systems. Siemens products for medical imaging and in vivo diagnostics include: ultrasound, computer tomography, mammography, digital breast tomosynthesis, magnetic resonance, equipment to angiography and coronary angiography, nuclear imaging, and many others. Siemens has a vast experience in Healthcare and at the beginning of this project it was strategically interested in solutions to improve the detection of Breast Cancer, to increase its competitiveness in the sector. The company owns several patents related with self-similarity analysis, which formed the background of this Thesis. Furthermore, Siemens intended to explore commercially the computer- aided automatic detection and diagnosis eld for portfolio integration. Therefore, with the high knowledge acquired by University of Beira Interior in this area together with this Thesis, will allow Siemens to apply the most recent scienti c progress in the detection of the breast cancer, and it is foreseeable that together we can develop a new technology with high potential. The project resulted in the submission of two invention disclosures for evaluation in Siemens A.G., two articles published in peer-reviewed journals indexed in ISI Science Citation Index, two other articles submitted in peer-reviewed journals, and several international conference papers. This work on computer-aided-diagnosis in breast led to innovative software and novel processes of research and development, for which the project received the Siemens Innovation Award in 2012. It was very rewarding to carry on such technological and innovative project in a socially sensitive area as Breast Cancer.No cancro da mama a deteção precoce e o diagnóstico correto são de extrema importância na prescrição terapêutica e caz e e ciente, que potencie o aumento da taxa de sobrevivência à doença. A teoria multifractal foi inicialmente introduzida no contexto da análise de sinal e a sua utilidade foi demonstrada na descrição de comportamentos siológicos de bio-sinais e até na deteção e predição de patologias. Nesta Tese, três métodos multifractais foram estendidos para imagens bi-dimensionais (2D) e comparados na deteção de microcalci cações em mamogramas. Um destes métodos foi também adaptado para a classi cação de massas da mama, em cortes transversais 2D obtidos por ressonância magnética (RM) de mama, em grupos de massas provavelmente benignas e com suspeição de malignidade. Um novo método de análise multifractal usando a lacunaridade tri-dimensional (3D) foi proposto para classi cação de massas da mama em imagens volumétricas 3D de RM de mama. A análise multifractal revelou diferenças na complexidade subjacente às localizações das microcalci cações em relação aos tecidos normais, permitindo uma boa exatidão da sua deteção em mamogramas. Adicionalmente, foram extraídas por análise multifractal características dos tecidos que permitiram identi car os casos tipicamente recomendados para biópsia em imagens 2D de RM de mama. A análise multifractal 3D foi e caz na classi cação de lesões mamárias benignas e malignas em imagens 3D de RM de mama. Este método foi mais exato para esta classi cação do que o método 2D ou o método padrão de análise de contraste cinético tumoral. Em conclusão, a análise multifractal fornece informação útil para deteção auxiliada por computador em mamogra a e diagnóstico auxiliado por computador em imagens 2D e 3D de RM de mama, tendo o potencial de complementar a interpretação dos radiologistas

The impact of tumor edema on T2-weighted 3T-MRI invasive breast cancer histological characterization: a pilot radiomics study

Background: to evaluate the contribution of edema associated with histological features to the prediction of breast cancer (BC) prognosis using T2-weighted MRI radiomics. Methods: 160 patients who underwent staging 3T-MRI from January 2015 to January 2019, with 164 histologically proven invasive BC lesions, were retrospectively reviewed. Patient data (age, menopausal status, family history, hormone therapy), tumor MRI-features (location, margins, enhancement) and histological features (histological type, grading, ER, PgR, HER2, Ki-67 index) were collected. Of the 160 MRI exams, 120 were considered eligible, corresponding to 127 lesions. T2-MRI were used to identify edema, which was classified in four groups: peritumoral, pre-pectoral, subcutaneous, or diffuse. A semi-automatic segmentation of the edema was performed for each lesion, using 3D Slicer open-source software. Main radiomics features were extracted and selected using a wrapper selection method. A Random Forest type classifier was trained to measure the performance of predicting histological factors using semantic features (patient data and MRI features) alone and semantic features associated with edema radiomics features. Results: edema was absent in 37 lesions and present in 127 (62 peritumoral, 26 pre-pectoral, 16 subcutaneous, 23 diffuse). The AUC-classifier obtained by associating edema radiomics with semantic features was always higher compared to the AUC-classifier obtained from semantic features alone, for all five histological classes prediction (0.645 vs. 0.520 for histological type, 0.789 vs. 0.590 for grading, 0.487 vs. 0.466 for ER, 0.659 vs. 0.546 for PgR, and 0.62 vs. 0.573 for Ki67). Conclusions: radiomic features extracted from tumor edema contribute significantly to predicting tumor histology, increasing the accuracy obtained from the combination of patient clinical characteristics and breast imaging data

Pattern classification approaches for breast cancer identification via MRI: state‐of‐the‐art and vision for the future

Mining algorithms for Dynamic Contrast Enhanced Magnetic Resonance Imaging (DCEMRI) of breast tissue are discussed. The algorithms are based on recent advances in multidimensional signal processing and aim to advance current state‐of‐the‐art computer‐aided detection and analysis of breast tumours when these are observed at various states of development. The topics discussed include image feature extraction, information fusion using radiomics, multi‐parametric computer‐aided classification and diagnosis using information fusion of tensorial datasets as well as Clifford algebra based classification approaches and convolutional neural network deep learning methodologies. The discussion also extends to semi‐supervised deep learning and self‐supervised strategies as well as generative adversarial networks and algorithms using generated confrontational learning approaches. In order to address the problem of weakly labelled tumour images, generative adversarial deep learning strategies are considered for the classification of different tumour types. The proposed data fusion approaches provide a novel Artificial Intelligence (AI) based framework for more robust image registration that can potentially advance the early identification of heterogeneous tumour types, even when the associated imaged organs are registered as separate entities embedded in more complex geometric spaces. Finally, the general structure of a high‐dimensional medical imaging analysis platform that is based on multi‐task detection and learning is proposed as a way forward. The proposed algorithm makes use of novel loss functions that form the building blocks for a generated confrontation learning methodology that can be used for tensorial DCE‐MRI. Since some of the approaches discussed are also based on time‐lapse imaging, conclusions on the rate of proliferation of the disease can be made possible. The proposed framework can potentially reduce the costs associated with the interpretation of medical images by providing automated, faster and more consistent diagnosis