Enhanced Digital Breast Tomosynthesis diagnosis using 3D visualization and automatic classification of lesions

Breast cancer represents the main cause of cancer-related deaths in women. Nonetheless, the mortality rate of this disease has been decreasing over the last three decades, largely due to the screening programs for early detection. For many years, both screening and clinical diagnosis were mostly done through Digital Mammography (DM). Approved in 2011, Digital Breast Tomosynthesis (DBT) is similar to DM but it allows a 3D reconstruction of the breast tissue, which helps the diagnosis by reducing the tissue overlap. Currently, DBT is firmly established and is approved as a stand-alone modality to replace DM. The main objective of this thesis is to develop computational tools to improve the visualization and interpretation of DBT data. Several methods for an enhanced visualization of DBT data through volume rendering were studied and developed. Firstly, important rendering parameters were considered. A new approach for automatic generation of transfer functions was implemented and two other parameters that highly affect the quality of volume rendered images were explored: voxel size in Z direction and sampling distance. Next, new image processing methods that improve the rendering quality by considering the noise regularization and the reduction of out-of-plane artifacts were developed. The interpretation of DBT data with automatic detection of lesions was approached through artificial intelligence methods. Several deep learning Convolutional Neural Networks (CNNs) were implemented and trained to classify a complete DBT image for the presence or absence of microcalcification clusters (MCs). Then, a faster R-CNN (region-based CNN) was trained to detect and accurately locate the MCs in the DBT images. The detected MCs were rendered with the developed 3D rendering software, which provided an enhanced visualization of the volume of interest. The combination of volume visualization with lesion detection may, in the future, improve both diagnostic accuracy and also reduce analysis time. This thesis promotes the development of new computational imaging methods to increase the diagnostic value of DBT, with the aim of assisting radiologists in their task of analyzing DBT volumes and diagnosing breast cancer

Sequential slice object labeling in tomographic data via trajectory estimation

The increasing usage of volumetric imaging modalities, such as magnetic resonance imaging (MRI) and computed tomography (CT) in areas such as medicine and nondestructive evaluation (NDE) has placed a great importance on 3D visualization techniques. This growth of volume data in the form of cross sections has created the need for object labeling in volume data sets for 3D visualization. A sequential, slice-to-slice approach is proposed that is less computational and memory intensive than 3D connected-component labeling while achieving better results than the 2D overlap sequential processing approach. Labeling occurs while tracking each object through the 3D volume via updated trajectory approximation. This thesis is motivated by the desire to develop a labeling technique that captures key aspects of the human visual approach to the task. The proposed approach, while labeling 3D data, also provides a computationally efficient method by sequential processing of 2D slices instead of the whole 3D volume at once. Additionally, the proposed trajectory tracking approach performs correctly in many cases where current 2D sequential labeling techniques fail. Trajectory tracking for labeling is a new approach, representing the 3D objects as curves and performing 3D curve tracing to label the approximate trajectories of the objects. The labeled trajectories are then mapped back to the 3D objects to complete the labeling process. Development of the proposed labeling approach is discussed while multiple examples are presented. These examples are used to illustrate that the proposed approach performs correctly where the current overlap approach fails; examples are also used to show that the behavior of the proposed approach parallels that of the typical human approach to object tracking

The VolumePro Real-Time Ray-Casting System

This paper describes VolumePro, the world’s first single-chip realtime volume rendering system for consumer PCs. VolumePro implements ray-casting with parallel slice-by-slice processing. Our discussion of the architecture focuses mainly on the rendering pipeline and the memory organization. VolumePro has hardware for gradient estimation, classification, and per-sample Phong illumination. The system does not perform any pre-processing and makes parameter adjustments and changes to the volume data immediately visible. We describe several advanced features of VolumePro, such as gradient magnitude modulation of opacity and illumination, supersampling, cropping and cut planes. The system renders 500 million interpolated, Phong illuminated, composited samples per second. This is sufficient to render volumes with up to 16 million voxels (e.g., 2563) at 30 frames per second.Engineering and Applied Science

Accurate,robust and harmonized implementation of morpho-functional imaging in treatment planning for personalized radiotherapy

In this work we present a methodology able to use harmonized PET/CT imaging in dose painting by number (DPBN) approach by means of a robust and accurate treatment planning system. Image processing and treatment planning were performed by using a Matlab-based platform, called CARMEN, in which a full Monte Carlo simulation is included. Linear programming formulation was developed for a voxel-by-voxel robust optimization and a specific direct aperture optimization was designed for an efficient adaptive radiotherapy implementation. DPBN approach with our methodology was tested to reduce the uncertainties associated with both, the absolute value and the relative value of the information in the functional image. For the same H&N case, a single robust treatment was planned for dose prescription maps corresponding to standardized uptake value distributions from two different image reconstruction protocols: One to fulfill EARL accreditation for harmonization of [18F]FDG PET/CT image, and the other one to use the highest available spatial resolution. Also, a robust treatment was planned to fulfill dose prescription maps corresponding to both approaches, the dose painting by contour based on volumes and our voxel-by-voxel DPBN. Adaptive planning was also carried out to check the suitability of our proposal. Different plans showed robustness to cover a range of scenarios for implementation of harmonizing strategies by using the highest available resolution. Also, robustness associated to discretization level of dose prescription according to the use of contours or numbers was achieved. All plans showed excellent quality index histogram and quality factors below 2%. Efficient solution for adaptive radiotherapy based directly on changes in functional image was obtained. We proved that by using voxel-by-voxel DPBN approach it is possible to overcome typical drawbacks linked to PET/CT images, providing to the clinical specialist confidence enough for routinely implementation of functional imaging for personalized radiotherapy.Junta de Andalucía (FISEVI, reference project CTS 2482)European Regional Development Fund (FEDER