3D Anisotropic Hybrid Network: Transferring Convolutional Features from 2D Images to 3D Anisotropic Volumes

While deep convolutional neural networks (CNN) have been successfully applied for 2D image analysis, it is still challenging to apply them to 3D anisotropic volumes, especially when the within-slice resolution is much higher than the between-slice resolution and when the amount of 3D volumes is relatively small. On one hand, direct learning of CNN with 3D convolution kernels suffers from the lack of data and likely ends up with poor generalization; insufficient GPU memory limits the model size or representational power. On the other hand, applying 2D CNN with generalizable features to 2D slices ignores between-slice information. Coupling 2D network with LSTM to further handle the between-slice information is not optimal due to the difficulty in LSTM learning. To overcome the above challenges, we propose a 3D Anisotropic Hybrid Network (AH-Net) that transfers convolutional features learned from 2D images to 3D anisotropic volumes. Such a transfer inherits the desired strong generalization capability for within-slice information while naturally exploiting between-slice information for more effective modelling. The focal loss is further utilized for more effective end-to-end learning. We experiment with the proposed 3D AH-Net on two different medical image analysis tasks, namely lesion detection from a Digital Breast Tomosynthesis volume, and liver and liver tumor segmentation from a Computed Tomography volume and obtain the state-of-the-art results

Models of breast lesions based on three-dimensional X-ray breast images

This paper presents a method for creation of computational models of breast lesions with irregular shapes from patient Digital Breast Tomosynthesis (DBT) images or breast cadavers and whole-body Computed Tomography (CT) images. The approach includes six basic steps: (a) normalization of the intensity of the tomographic images; (b) image noise reduction; (c) binarization of the lesion area, (d) application of morphological operations to further decrease the level of artefacts; (e) application of a region growing technique to segment the lesion; and (f) creation of a final 3D lesion model. The algorithm is semi-automatic as the initial selection of the region of the lesion and the seeds for the region growing are done interactively. A software tool, performing all of the required steps, was developed in MATLAB. The method was tested and evaluated by analysing anonymized sets of DBT patient images diagnosed with lesions. Experienced radiologists evaluated the segmentation of the tumours in the slices and the obtained 3D lesion shapes. They concluded for a quite satisfactory delineation of the lesions. In addition, for three DBT cases, a delineation of the tumours was performed independently by the radiologists. In all cases the abnormality volumes segmented by the proposed algorithm were smaller than those outlined by the experts. The calculated Dice similarity coefficients for algorithm-radiologist and radiologist-radiologist showed similar values. Another selected tumour case was introduced into a computational breast model to recursively assess the algorithm. The relative volume difference between the ground-truth tumour volume and the one obtained by applying the algorithm on the synthetic volume from the virtual DBT study is 5% which demonstrates the satisfactory performance of the proposed segmentation algorithm. The software tool we developed was used to create models of different breast abnormalities, which were then stored in a database for use by researchers working in this field

Deformable mapping technique to correlate lesions in digital breast tomosynthesis and automated breast ultrasound images

Peer Reviewedhttps://deepblue.lib.umich.edu/bitstream/2027.42/146324/1/mp13113.pdfhttps://deepblue.lib.umich.edu/bitstream/2027.42/146324/2/mp13113_am.pd

Deep learning, radiomics and radiogenomics applications in the digital breast tomosynthesis: a systematic review

Background: Recent advancements in computing power and state-of-the-art algorithms have helped in more accessible and accurate diagnosis of numerous diseases. In addition, the development of de novo areas in imaging science, such as radiomics and radiogenomics, have been adding more to personalize healthcare to stratify patients better. These techniques associate imaging phenotypes with the related disease genes. Various imaging modalities have been used for years to diagnose breast cancer. Nonetheless, digital breast tomosynthesis (DBT), a state-of-the-art technique, has produced promising results comparatively. DBT, a 3D mammography, is replacing conventional 2D mammography rapidly. This technological advancement is key to AI algorithms for accurately interpreting medical images. Objective and methods: This paper presents a comprehensive review of deep learning (DL), radiomics and radiogenomics in breast image analysis. This review focuses on DBT, its extracted synthetic mammography (SM), and full-field digital mammography (FFDM). Furthermore, this survey provides systematic knowledge about DL, radiomics, and radiogenomics for beginners and advanced-level researchers. Results: A total of 500 articles were identified, with 30 studies included as the set criteria. Parallel benchmarking of radiomics, radiogenomics, and DL models applied to the DBT images could allow clinicians and researchers alike to have greater awareness as they consider clinical deployment or development of new models. This review provides a comprehensive guide to understanding the current state of early breast cancer detection using DBT images. Conclusion: Using this survey, investigators with various backgrounds can easily seek interdisciplinary science and new DL, radiomics, and radiogenomics directions towards DBT

Proceedings Virtual Imaging Trials in Medicine 2024

This submission comprises the proceedings of the 1st Virtual Imaging Trials in Medicine conference, organized by Duke University on April 22-24, 2024. The listed authors serve as the program directors for this conference. The VITM conference is a pioneering summit uniting experts from academia, industry and government in the fields of medical imaging and therapy to explore the transformative potential of in silico virtual trials and digital twins in revolutionizing healthcare. The proceedings are categorized by the respective days of the conference: Monday presentations, Tuesday presentations, Wednesday presentations, followed by the abstracts for the posters presented on Monday and Tuesday

Mass detection in digital breast tomosynthesis: Deep convolutional neural network with transfer learning from mammography

Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/135545/1/mp7345_am.pdfhttp://deepblue.lib.umich.edu/bitstream/2027.42/135545/2/mp7345.pd

A new challenge in Radiology: Radiomics in breast cancer diagnostics

Breast cancer is one of the most common and widespread cancers that women can have. In order to prevent the occurrence of cancer, it is important to perform a preventive examination, which includes ultrasound and mammography. Radiology as a branch of medicine has seen rapid development in recent decades thanks to the development of technology, and artificial intelligence is increasingly used in radiology. Radiomics is a new method of radiological image processing that uses software programs to analyse tissue during diagnostic imaging. It is a combination of multiple imaging modalities with the aim of highlighting pathological formations that are not visible to the naked eye or are less significant. The aim of the paper is to introduce to the readers with radiomics and to explain in more detail how it works, and how it was integrated into certain radiological diagnostics and greatly facilitated the image processing process and the diagnosis of breast cancer. Many studies have confirmed that radiomics is a method with numerous advantages, but like any new field, it has its drawbacks. The main limitation is the computer system, which must be standardised so that radiomic data processing can be used in all institutions and so that these institutions can exchange information with each other without difficulty. The problem is also false positive findings, which greatly increase the costs of institutions and the time it takes for patients to reach a diagnosis. The solution to these allegations is the development of new computer algorithms and an increase in the sensitivity of computer detection of lesions. Radiomics will certainly play an important role in diagnostics and image analysis over a period of time. Given that artificial intelligence is still in the process of development, radiomics may not have an independent application, but it will certainly make the work of doctors easier in the analysis of radiological images

Enhanced Digital Breast Tomosynthesis diagnosis using 3D visualization and automatic classification of lesions

Breast cancer represents the main cause of cancer-related deaths in women. Nonetheless, the mortality rate of this disease has been decreasing over the last three decades, largely due to the screening programs for early detection. For many years, both screening and clinical diagnosis were mostly done through Digital Mammography (DM). Approved in 2011, Digital Breast Tomosynthesis (DBT) is similar to DM but it allows a 3D reconstruction of the breast tissue, which helps the diagnosis by reducing the tissue overlap. Currently, DBT is firmly established and is approved as a stand-alone modality to replace DM. The main objective of this thesis is to develop computational tools to improve the visualization and interpretation of DBT data. Several methods for an enhanced visualization of DBT data through volume rendering were studied and developed. Firstly, important rendering parameters were considered. A new approach for automatic generation of transfer functions was implemented and two other parameters that highly affect the quality of volume rendered images were explored: voxel size in Z direction and sampling distance. Next, new image processing methods that improve the rendering quality by considering the noise regularization and the reduction of out-of-plane artifacts were developed. The interpretation of DBT data with automatic detection of lesions was approached through artificial intelligence methods. Several deep learning Convolutional Neural Networks (CNNs) were implemented and trained to classify a complete DBT image for the presence or absence of microcalcification clusters (MCs). Then, a faster R-CNN (region-based CNN) was trained to detect and accurately locate the MCs in the DBT images. The detected MCs were rendered with the developed 3D rendering software, which provided an enhanced visualization of the volume of interest. The combination of volume visualization with lesion detection may, in the future, improve both diagnostic accuracy and also reduce analysis time. This thesis promotes the development of new computational imaging methods to increase the diagnostic value of DBT, with the aim of assisting radiologists in their task of analyzing DBT volumes and diagnosing breast cancer

Automated Deformable Mapping Methods to Relate Corresponding Lesions in 3D X-ray and 3D Ultrasound Breast Images

Mammography is the current standard imaging method for detecting breast cancer by using x-rays to produce 2D images of the breast. However, with mammography alone there is difficulty determining whether a lesion is benign or malignant and reduced sensitivity to detecting lesions in dense breasts. Ultrasound imaging used in conjunction with mammography has shown valuable contributions for lesion characterization by differentiating between solid and cystic lesions. Conventional breast ultrasound has high false positive rates; however, it has shown improved abilities to detect lesions in dense breasts. Breast ultrasound is typically performed freehand to produce anterior-to-posterior 2D images in a different geometry (supine) than mammography (upright). This difference in geometries is likely responsible for the finding that at least 10% of the time lesions found in the ultrasound images do not correspond with lesions found in mammograms. To solve this problem additional imaging techniques must be investigated to aid a radiologist in identifying corresponding lesions in the two modalities to ensure early detection of a potential cancer. This dissertation describes and validates automated deformable mapping methods to register and relate corresponding lesions between multi-modality images acquired using 3D mammography (Digital Breast Tomosynthesis (DBT) and dedicated breast Computed Tomography (bCT)) and 3D ultrasound (Automated Breast Ultrasound (ABUS)). The methodology involves the use of finite element modeling and analysis to simulate the differences in compression and breast orientation to better align lesions acquired from images from these modalities. Preliminary studies were performed using several multimodality compressible breast phantoms to determine breast lesion registrations between: i) cranio-caudal (CC) and mediolateral oblique (MLO) DBT views and ABUS, ii) simulated bCT and DBT (CC and MLO views), and iii) simulated bCT and ABUS. Distances between the centers of masses, dCOM, of corresponding lesions were used to assess the deformable mapping method. These phantom studies showed the potential to apply this technique for real breast lesions with mean dCOM registration values as low as 4.9 ± 2.4 mm for DBT (CC view) mapped to ABUS, 9.3 ± 2.8 mm for DBT (MLO view) mapped to ABUS, 4.8 ± 2.4 mm for bCT mapped to ABUS, 5.0 ± 2.2 mm for bCT mapped to DBT (CC view), and 4.7 ± 2.5 mm for bCT mapped to DBT (MLO view). All of the phantom studies showed that using external fiducial markers helped improve the registration capability of the deformable mapping algorithm. An IRB-approved proof-of-concept study was performed with patient volunteers to validate the deformable registration method on 5 patient datasets with a total of up to 7 lesions for DBT (CC and MLO views) to ABUS registration. Resulting dCOM’s using the deformable method showed statistically significant improvements over rigid registration techniques with a mean dCOM of 11.6 ± 5.3 mm for DBT (CC view) mapped to ABUS and a mean dCOM of 12.3 ± 4.8 mm for DBT (MLO view) mapped to ABUS. The present work demonstrates the potential for using deformable registration techniques to relate corresponding lesions in 3D x-ray and 3D ultrasound images. This methodology should improve a radiologists’ characterization of breast lesions which can reduce patient callbacks, misdiagnoses, additional patient dose and unnecessary biopsies. Additionally, this technique can save a radiologist time in navigating 3D image volumes and the one-to-one lesion correspondence between modalities can aid in the early detection of breast malignancies.PHDNuclear Engineering & Radiological SciencesUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttps://deepblue.lib.umich.edu/bitstream/2027.42/150042/1/canngree_1.pd