Comparison of registration strategies for USCT–MRI image fusion: preliminary results

Comparing Ultrasound Computer Tomography (USCT) to the well-known Magnetic Resonance Imaging (MRI) is an essential step in evaluating the clinical value of USCT. Yet the different conditions of the breast either embedded in water (USCT) or in air (MRI) prevent direct comparison. In this work we compare two strategies for image registration based on biomechanical modeling to automatically establish spatial correspondence: a) by applying buoyancy to the MRI, or b) by removing buoyancy from the USCT. The registration was applied to 9 datasets from 8 patients. Both registration strategies revealed similar registration accuracies (MRI to USCT: mean = 5.6 mm, median = 5.6 mm, USCT to MRI: mean = 6.6 mm, median = 5.7 mm). Image registration of USCT and MRI allows to delineate corresponding tissue structures in both modalities in the same or nearby slices. Our preliminary results indicate that both simulation strategies seem to perform similarly. Yet the newly developed deformation of the USCT volume is less computationally demanding: As the breast is subjected to buoyancy it can thereby serve as the unloaded state while for the contrary strategy we have to solve an inverse problem

Analytical derivation of elasticity in breast phantoms for deformation tracking

Patient-specific biomedical modeling of the breast is of interest for medical applications such as image registration, image guided procedures and the alignment for biopsy or surgery purposes. The computation of elastic properties is essential to simulate deformations in a realistic way. This study presents an innovative analytical method to compute the elastic modulus and evaluate the elasticity of a breast using magnetic resonance (MRI) images of breast phantoms.An analytical method for elasticity computation was developed and subsequently validated on a series of geometric shapes, and on four physical breast phantoms that are supported by a planar frame. This method can compute the elasticity of a shape directly from a set of MRI scans. For comparison, elasticity values were also computed numerically using two different simulation software packages.Application of the different methods on the geometric shapes shows that the analytically derived elongation differs from simulated elongation by less than 9% for cylindrical shapes, and up to 18% for other shapes that are also substantially vertically supported by a planar base. For the four physical breast phantoms, the analytically derived elasticity differs from numeric elasticity by 18% on average, which is in accordance with the difference in elongation estimation for the geometric shapes. The analytic method has shown to be multiple orders of magnitude faster than the numerical methods.It can be concluded that the analytical elasticity computation method has good potential to supplement or replace numerical elasticity simulations in gravity-induced deformations, for shapes that are substantially supported by a planar base perpendicular to the gravitational field. The error is manageable, while the calculation procedure takes less than one second as opposed to multiple minutes with numerical methods. The results will be used in the MRI and Ultrasound Robotic Assisted Biopsy (MURAB) project

A finite element-based machine learning approach for modeling the mechanical behavior of the breast tissues under compression in real-time

[EN] This work presents a data-driven method to simulate, in real-time, the biomechanical behavior of the breast tissues in some image-guided interventions such as biopsies or radiotherapy dose delivery as well as to speed up multimodal registration algorithms. Ten real breasts were used for this work. Their deformation due to the displacement of two compression plates was simulated off-line using the finite element (FE) method. Three machine learning models were trained with the data from those simulations. Then, they were used to predict in real-time the deformation of the breast tissues during the compression. The models were a decision tree and two tree-based ensemble methods (extremely randomized trees and random forest). Two different experimental setups were designed to validate and study the performance of these models under different conditions. The mean 3D Euclidean distance between nodes predicted by the models and those extracted from the FE simulations was calculated to assess the performance of the models in the validation set. The experiments proved that extremely randomized trees performed better than the other two models. The mean error committed by the three models in the prediction of the nodal displacements was under 2 man, a threshold usually set for clinical applications. The time needed for breast compression prediction is sufficiently short to allow its use in real-time (< 0.2 s).This work has been funded by the Spanish Ministry of Economy and Competitiveness (MINECO) through research projects TIN2014-52033-R and DPI2013-40859-R with the support of European FEDER funds.Martínez Martínez, F.; Rupérez Moreno, MJ.; Martínez-Sober, M.; Solves Llorens, JA.; Lorente, D.; Serrano-Lopez, A.; Martinez-Sanchis, S.... (2017). A finite element-based machine learning approach for modeling the mechanical behavior of the breast tissues under compression in real-time. Computers in Biology and Medicine. 90:116-124. https://doi.org/10.1016/j.compbiomed.2017.09.019S1161249

Challenges and applications of registering of 3D Ultrasound Computer Tomography with conventional breast imaging techniques

To evaluate the diagnostic value of Ultrasound Computer Tomography (USCT), the imaging results have to be correlated with conventional breast imaging techniques. This is challenging due to different patient positioning in the modalities with nonlinear deformations of the breast tissue. We have developed a patient-specific image registration method, which simulates different breast positionings in both X-ray mammography and Magnetic Resonance Imaging (MRI) through biomechanical modelling. An average registration error below 5 and 17 mm for MRI to USCT and USCT to mammography registration, respectively, allowed us to evaluate the diagnostic performance of USCT. It was shown that regions of high sound speed corresponded well with the tumour position indicated from the MRI contrast kinetic map. Moreover, the quantitative analysis of sound speed and attenuation values with respect to the segmented mammograms revealed that sound speed gives a better distinction between breast tissue, whereas their combined information further improves the classification. Although the results are based on a preliminary study, the promising outcome points that the registration could assist radiologists in comparing the USCT with both MRI and X-ray mammography

Strain elastography with ultrasound computer tomography: a simulation study based on biomechanical models

Ultrasound computer tomography (USCT) is a promising modality for breast cancer diagnosis which images the reflectivity, sound speed and attenuation of tissue. Elastic properties of breast tissue, however, cannot directly be imaged although they have shown to be applicable as a discriminator between different tissue types. In this work we propose a novel approach combining USCT with the principles of strain elastography. Socalled USCT-SE makes use of imaging the breast in two deformation states, estimating the deformation field based on reconstructed images and thereby allows localizing and distinguishing soft and hard masses. We use a biomechanical model of the breast to realistically simulate both deformation states of the breast. The analysis of the strain is performed by estimating the deformation field from the deformed to the undeformed image by a non-rigid registration. In two experiments the non-rigid registration is applied to ground truth sound speed images and simulated SAFT images. Results of the strain analysis show that for both cases soft and hard lesions can be distinguished visually in the elastograms. This paper provides a first approach to obtain mechanical information based on external mechanical excitation of breast tissue in a USCT system

Iterative simulations to estimate the elastic properties from a series of MRI images followed by MRI-US validation

The modeling of breast deformations is of interest in medical applications such as image-guided biopsy, or image registration for diagnostic purposes. In order to have such information, it is needed to extract the mechanical properties of the tissues. In this work, we propose an iterative technique based on finite element analysis that estimates the elastic modulus of realistic breast phantoms, starting from MRI images acquired in different positions (prone and supine), when deformed only by the gravity force. We validated the method using both a single-modality evaluation in which we simulated the effect of the gravity force to generate four different configurations (prone, supine, lateral, and vertical) and a multi-modality evaluation in which we simulated a series of changes in orientation (prone to supine). Validation is performed, respectively, on surface points and lesions using as ground-truth data from MRI images, and on target lesions inside the breast phantom compared with the actual target segmented from the US image. The use of pre-operative images is limited at the moment to diagnostic purposes. By using our method we can compute patient-specific mechanical properties that allow compensating deformations

Complexity Reduction in Image-Based Breast Cancer Care

The diversity of malignancies of the breast requires personalized diagnostic and therapeutic decision making in a complex situation. This thesis contributes in three clinical areas: (1) For clinical diagnostic image evaluation, computer-aided detection and diagnosis of mass and non-mass lesions in breast MRI is developed. 4D texture features characterize mass lesions. For non-mass lesions, a combined detection/characterisation method utilizes the bilateral symmetry of the breast s contrast agent uptake. (2) To improve clinical workflows, a breast MRI reading paradigm is proposed, exemplified by a breast MRI reading workstation prototype. Instead of mouse and keyboard, it is operated using multi-touch gestures. The concept is extended to mammography screening, introducing efficient navigation aids. (3) Contributions to finite element modeling of breast tissue deformations tackle two clinical problems: surgery planning and the prediction of the breast deformation in a MRI biopsy device

A new approach for the in-vivo characterization of the biomechanical behavior of the breast and the cornea

The characterization of the mechanical behavior of soft living tissues is a big challenge in Biomechanics. The difficulty arises from both the access to the tissues and the manipulation in order to know their physical properties. Currently, the biomechanical characterization of the organs is mainly performed by testing ex-vivo samples or by means of indentation tests. In the first case, the obtained behavior does not represent the real behavior of the organ. In the second case, it is only a representation of the mechanical response of the indented areas. The purpose of the research reported in this thesis is the development of a methodology to in-vivo characterize the biomechanical behavior of two different organs: the breast and the cornea. The proposed methodology avoids invasive measurements to obtain the mechanical response of the organs and is able to completely characterize of the biomechanical behavior of them. The research reported in this thesis describes a methodology to in-vivo characterize the biomechanical behavior of the breast and the cornea. The estimation of the elastic constants of the constitutive equations that define the mechanical behavior of these organs is performed using an iterative search algorithm which optimizes these parameters. The search is based on the iterative variation of the elastic constants of the model in order to increase the similarity between a simulated deformation of the organ and the real one. The similarity is measured by means of a volumetric similarity function which combines overlap-based coefficients and distance-based coefficients. Due to the number of parameters to be characterized as well as the non-convergences that the solution may present in some regions, genetic heuristics were chosen to drive the search algorithm. In the case of the breast, the elastic constants of an anisotropic hyperelastic neo-Hookean model proposed to simulate the compression of the breast during an MRI-guided biopsy were estimated. Results from this analysis showed that the proposed algorithm accurately found the elastic constants of the proposed model, providing an average relative error below 10%. The methodology was validated using breast software phantoms. Nevertheless, this methodology can be easily transferred into its use with real breasts. In the case of the cornea, the elastic constants of a hyperelastic second-order Ogden model were estimated for 24 corneas corresponding to 12 patients. The finite element method was applied in order to simulate the deformation of the human corneas due to non-contact tonometry. The iterative search was applied in order to estimate the elastic constants of the model which approximates the most the simulated deformation to the real one. Results showed that these constants can be estimated with an error of about 5%. After the results obtained for both organs, it can be concluded that the iterative search methodology presented in this thesis allows the \textit{in-vivo} estimation the patient-specific elastic constants of the constitutive biomechanical models that govern the biomechanical behavior of these two organs.Lago Ángel, MÁ. (2014). A new approach for the in-vivo characterization of the biomechanical behavior of the breast and the cornea [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/44116TESI