Symmetric Biomechanically Guided Prone-to-Supine Breast Image Registration

Prone-to-supine breast image registration has potential application in the fields of surgical and radiotherapy planning, image guided interventions, and multi-modal cancer diagnosis, staging, and therapy response prediction. However, breast image registration of three dimensional images acquired in different patient positions is a challenging problem, due to large deformations induced to the soft breast tissue caused by the change in gravity loading. We present a symmetric, biomechanical simulation based registration framework which aligns the images in a central, virtually unloaded configuration. The breast tissue is modelled as a neo-Hookean material and gravity is considered as the main source of deformation in the original images. In addition to gravity, our framework successively applies image derived forces directly into the unloading simulation in place of a subsequent image registration step. This results in a biomechanically constrained deformation. Using a finite difference scheme avoids an explicit meshing step and enables simulations to be performed directly in the image space. The explicit time integration scheme allows the motion at the interface between chest and breast to be constrained along the chest wall. The feasibility and accuracy of the approach presented here was assessed by measuring the target registration error (TRE) using a numerical phantom with known ground truth deformations, nine clinical prone MRI and supine CT image pairs, one clinical prone-supine CT image pair and four prone-supine MRI image pairs. The registration reduced the mean TRE for the numerical phantom experiment from initially 19.3 to 0.9 mm and the combined mean TRE for all fourteen clinical data sets from 69.7 to 5.6 mm

Integration of biomechanical models into image registration in the presence of large deformations

Prone-to-supine breast image registration has potential application in the fields of surgical and radiotherapy planning, and image guided interventions. However, breast image registration of three-dimensional images acquired in different patient positions is a challenging problem, due to large deformations induced to the soft breast tissue caused by the change in gravity loading. Biomechanical modelling is a promising tool to predict gravity induced deformations, however such simulations alone are unlikely to produce good alignment due to inter-patient variability and image acquisition related influences on the breast shape. This thesis presents a symmetric, biomechanical simulation based registration framework which aligns images in a central, stress-free configuration. Soft tissue is modelled as a neo-Hookean material and external forces are considered as the main source of deformation in the original images. The framework successively applies image derived forces directly into the unloading simulation in place of a subsequent image registration step. This results in a biomechanically constrained deformation. Using a finite difference scheme enables simulations to be performed directly in the image space. Motion constrained boundary conditions have been incorporated which can capture tangential motion of membranes and fasciae. The accuracy of the approach is assessed by measuring the target registration error (TRE) using nine prone MRI and supine CT image pairs, one prone-supine CT image pair, and four prone-supine MRI image pairs. The registration reduced the combined mean TRE for all clinical data sets from initially 69.7mm to 5.6mm. Prone-supine image pairs might not always be available in the clinical breast cancer workflow, especially prior to surgery. Hence an alternative surface driven registration methodology was also developed that incorporates biomechanical simulations, material parameter optimisation, and constrained surface matching. For three prone MR images and corresponding supine CT-derived surfaces a final mean TRE of 10.0mm was measured

Surface Driven Biomechanical Breast Image Registration

Biomechanical modelling enables large deformation simulations of breast tissues under different loading conditions to be performed. Such simulations can be utilised to transform prone Magnetic Resonance (MR) images into a different patient position, such as upright or supine. We present a novel integration of biomechanical modelling with a surface registration algorithm which optimises the unknown material parameters of a biomechanical model and performs a subsequent regularised surface alignment. This allows deformations induced by effects other than gravity, such as those due to contact of the breast and MR coil, to be reversed. Correction displacements are applied to the biomechanical model enabling transformation of the original pre-surgical images to the corresponding target position. The algorithm is evaluated for the prone-to-supine case using prone MR images and the skin outline of supine Computed Tomography (CT) scans for three patients. A mean target registration error (TRE) of 10:9 mm for internal structures is achieved. For the prone-to-upright scenario, an optical 3D surface scan of one patient is used as a registration target and the nipple distances after alignment between the transformed MRI and the surface are 10:1 mm and 6:3 mm respectively

Analytical derivation of elasticity in breast phantoms for deformation tracking

Patient-specific biomedical modeling of the breast is of interest for medical applications such as image registration, image guided procedures and the alignment for biopsy or surgery purposes. The computation of elastic properties is essential to simulate deformations in a realistic way. This study presents an innovative analytical method to compute the elastic modulus and evaluate the elasticity of a breast using magnetic resonance (MRI) images of breast phantoms.An analytical method for elasticity computation was developed and subsequently validated on a series of geometric shapes, and on four physical breast phantoms that are supported by a planar frame. This method can compute the elasticity of a shape directly from a set of MRI scans. For comparison, elasticity values were also computed numerically using two different simulation software packages.Application of the different methods on the geometric shapes shows that the analytically derived elongation differs from simulated elongation by less than 9% for cylindrical shapes, and up to 18% for other shapes that are also substantially vertically supported by a planar base. For the four physical breast phantoms, the analytically derived elasticity differs from numeric elasticity by 18% on average, which is in accordance with the difference in elongation estimation for the geometric shapes. The analytic method has shown to be multiple orders of magnitude faster than the numerical methods.It can be concluded that the analytical elasticity computation method has good potential to supplement or replace numerical elasticity simulations in gravity-induced deformations, for shapes that are substantially supported by a planar base perpendicular to the gravitational field. The error is manageable, while the calculation procedure takes less than one second as opposed to multiple minutes with numerical methods. The results will be used in the MRI and Ultrasound Robotic Assisted Biopsy (MURAB) project

Breast Tumor Localization by Prone to Supine Landmark Driven Registration for Surgical Planning

Breast cancer is the most common cancer in women worldwide. Screening programs and imaging improvements have increased the detection of clinically occult non-palpable lesions requiring preoperative localization. Wire guided localization (WGL) is the current standard of care for the excision of non-palpable carcinomas during breast conserving surgery. Due to the current limitations of intraoperative tumor localization approaches, the integration of multimodal imaging information may be especially relevant in surgical planning. This research proposes a novel method for performing preoperative image-to-surgical surface data alignment to determine the position of the tumor at the time of surgery and aid preoperative planning. First, the volume of the breast in the surgical position is reconstructed and a set of surface correspondences is defined. Then, the preoperative (prone) and intraoperative (supine) volumes are co-registered using landmark driven non-rigid registration methods. We compared the performances of diffeomorphic and Bspline based registration methods. Finally, our method was validated using clinical data from 67 patients considering as target registration error (TRE) the distance between the estimated tumor position and the reference surgical position. The proposed method achieved a TRE of 16.21 ± 8.18 mm and it could potentially assist the surgery planning and guidance of breast cancer treatment in the clinical practice.This work was supported in part by the Spanish Ministry of Science and Innovation under Project RTI2018-098682-B-I00 (MCIU/AEI/FEDER,UE), Project PI18/01625 (Instituto de Salud Carlos III) and Grant BGP18/00178 under Beatriz Galindo Programme; in part by the European Union's European Regional Development Fund (ERDF); and in part by the Madrid Government (Comunidad de Madrid-Spain) under the Multiannual Agreement with Universidad Politécnica de Madrid in the line Support for Research and Development Projects for Beatriz Galindo researchers, in the context of the V Plan Regional de Investigación Científíca e Innovación Tecnológica (PRICIT)

Iterative simulations to estimate the elastic properties from a series of MRI images followed by MRI-US validation

The modeling of breast deformations is of interest in medical applications such as image-guided biopsy, or image registration for diagnostic purposes. In order to have such information, it is needed to extract the mechanical properties of the tissues. In this work, we propose an iterative technique based on finite element analysis that estimates the elastic modulus of realistic breast phantoms, starting from MRI images acquired in different positions (prone and supine), when deformed only by the gravity force. We validated the method using both a single-modality evaluation in which we simulated the effect of the gravity force to generate four different configurations (prone, supine, lateral, and vertical) and a multi-modality evaluation in which we simulated a series of changes in orientation (prone to supine). Validation is performed, respectively, on surface points and lesions using as ground-truth data from MRI images, and on target lesions inside the breast phantom compared with the actual target segmented from the US image. The use of pre-operative images is limited at the moment to diagnostic purposes. By using our method we can compute patient-specific mechanical properties that allow compensating deformations

A finite element-based machine learning approach for modeling the mechanical behavior of the breast tissues under compression in real-time

[EN] This work presents a data-driven method to simulate, in real-time, the biomechanical behavior of the breast tissues in some image-guided interventions such as biopsies or radiotherapy dose delivery as well as to speed up multimodal registration algorithms. Ten real breasts were used for this work. Their deformation due to the displacement of two compression plates was simulated off-line using the finite element (FE) method. Three machine learning models were trained with the data from those simulations. Then, they were used to predict in real-time the deformation of the breast tissues during the compression. The models were a decision tree and two tree-based ensemble methods (extremely randomized trees and random forest). Two different experimental setups were designed to validate and study the performance of these models under different conditions. The mean 3D Euclidean distance between nodes predicted by the models and those extracted from the FE simulations was calculated to assess the performance of the models in the validation set. The experiments proved that extremely randomized trees performed better than the other two models. The mean error committed by the three models in the prediction of the nodal displacements was under 2 man, a threshold usually set for clinical applications. The time needed for breast compression prediction is sufficiently short to allow its use in real-time (< 0.2 s).This work has been funded by the Spanish Ministry of Economy and Competitiveness (MINECO) through research projects TIN2014-52033-R and DPI2013-40859-R with the support of European FEDER funds.Martínez Martínez, F.; Rupérez Moreno, MJ.; Martínez-Sober, M.; Solves Llorens, JA.; Lorente, D.; Serrano-Lopez, A.; Martinez-Sanchis, S.... (2017). A finite element-based machine learning approach for modeling the mechanical behavior of the breast tissues under compression in real-time. Computers in Biology and Medicine. 90:116-124. https://doi.org/10.1016/j.compbiomed.2017.09.019S1161249

NiftySim: A GPU-based nonlinear finite element package for simulation of soft tissue biomechanics

Purpose NiftySim, an open-source finite element toolkit, has been designed to allow incorporation of high-performance soft tissue simulation capabilities into biomedical applications. The toolkit provides the option of execution on fast graphics processing unit (GPU) hardware, numerous constitutive models and solid-element options, membrane and shell elements, and contact modelling facilities, in a simple to use library. Methods The toolkit is founded on the total Lagrangian explicit dynamics (TLEDs) algorithm, which has been shown to be efficient and accurate for simulation of soft tissues. The base code is written in C ++++ , and GPU execution is achieved using the nVidia CUDA framework. In most cases, interaction with the underlying solvers can be achieved through a single Simulator class, which may be embedded directly in third-party applications such as, surgical guidance systems. Advanced capabilities such as contact modelling and nonlinear constitutive models are also provided, as are more experimental technologies like reduced order modelling. A consistent description of the underlying solution algorithm, its implementation with a focus on GPU execution, and examples of the toolkit’s usage in biomedical applications are provided. Results Efficient mapping of the TLED algorithm to parallel hardware results in very high computational performance, far exceeding that available in commercial packages. Conclusion The NiftySim toolkit provides high-performance soft tissue simulation capabilities using GPU technology for biomechanical simulation research applications in medical image computing, surgical simulation, and surgical guidance applications

Multiscale Mechano-Biological Finite Element Modelling of Oncoplastic Breast Surgery-Numerical Study towards Surgical Planning and Cosmetic Outcome Prediction

Surgical treatment for early-stage breast carcinoma primarily necessitates breast conserving therapy (BCT), where the tumour is removed while preserving the breast shape. To date, there have been very few attempts to develop accurate and efficient computational tools that could be used in the clinical environment for pre-operative planning and oncoplastic breast surgery assessment. Moreover, from the breast cancer research perspective, there has been very little effort to model complex mechano-biological processes involved in wound healing. We address this by providing an integrated numerical framework that can simulate the therapeutic effects of BCT over the extended period of treatment and recovery. A validated, three-dimensional, multiscale finite element procedure that simulates breast tissue deformations and physiological wound healing is presented. In the proposed methodology, a partitioned, continuum-based mathematical model for tissue recovery and angiogenesis, and breast tissue deformation is considered. The effectiveness and accuracy of the proposed numerical scheme is illustrated through patient-specific representative examples. Wound repair and contraction numerical analyses of real MRI-derived breast geometries are investigated, and the final predictions of the breast shape are validated against post-operative follow-up optical surface scans from four patients. Mean (standard deviation) breast surface distance errors in millimetres of 3.1 (±3.1), 3.2 (±2.4), 2.8 (±2.7) and 4.1 (±3.3) were obtained, demonstrating the ability of the surgical simulation tool to predict, pre-operatively, the outcome of BCT to clinically useful accuracy