Nonrigid reconstruction of 3D breast surfaces with a low-cost RGBD camera for surgical planning and aesthetic evaluation

Accounting for 26% of all new cancer cases worldwide, breast cancer remains the most common form of cancer in women. Although early breast cancer has a favourable long-term prognosis, roughly a third of patients suffer from a suboptimal aesthetic outcome despite breast conserving cancer treatment. Clinical-quality 3D modelling of the breast surface therefore assumes an increasingly important role in advancing treatment planning, prediction and evaluation of breast cosmesis. Yet, existing 3D torso scanners are expensive and either infrastructure-heavy or subject to motion artefacts. In this paper we employ a single consumer-grade RGBD camera with an ICP-based registration approach to jointly align all points from a sequence of depth images non-rigidly. Subtle body deformation due to postural sway and respiration is successfully mitigated leading to a higher geometric accuracy through regularised locally affine transformations. We present results from 6 clinical cases where our method compares well with the gold standard and outperforms a previous approach. We show that our method produces better reconstructions qualitatively by visual assessment and quantitatively by consistently obtaining lower landmark error scores and yielding more accurate breast volume estimates

Computer vision and optimization methods applied to the measurements of in-plane deformations

fi=vertaisarvioitu|en=peerReviewed

Nonrigid Registration of Brain Tumor Resection MR Images Based on Joint Saliency Map and Keypoint Clustering

This paper proposes a novel global-to-local nonrigid brain MR image registration to compensate for the brain shift and the unmatchable outliers caused by the tumor resection. The mutual information between the corresponding salient structures, which are enhanced by the joint saliency map (JSM), is maximized to achieve a global rigid registration of the two images. Being detected and clustered at the paired contiguous matching areas in the globally registered images, the paired pools of DoG keypoints in combination with the JSM provide a useful cluster-to-cluster correspondence to guide the local control-point correspondence detection and the outlier keypoint rejection. Lastly, a quasi-inverse consistent deformation is smoothly approximated to locally register brain images through the mapping the clustered control points by compact support radial basis functions. The 2D implementation of the method can model the brain shift in brain tumor resection MR images, though the theory holds for the 3D case

Organ-focused mutual information for nonrigid multimodal registration of liver CT and Gd–EOB–DTPA-enhanced MRI

Accurate detection of liver lesions is of great importance in hepatic surgery planning. Recent studies have shown that the detection rate of liver lesions is significantly higher in gadoxetic acid-enhanced magnetic resonance imaging (Gd–EOB–DTPA-enhanced MRI) than in contrast-enhanced portal-phase computed tomography (CT); however, the latter remains essential because of its high specificity, good performance in estimating liver volumes and better vessel visibility. To characterize liver lesions using both the above image modalities, we propose a multimodal nonrigid registration framework using organ-focused mutual information (OF-MI). This proposal tries to improve mutual information (MI) based registration by adding spatial information, benefiting from the availability of expert liver segmentation in clinical protocols. The incorporation of an additional information channel containing liver segmentation information was studied. A dataset of real clinical images and simulated images was used in the validation process. A Gd–EOB–DTPA-enhanced MRI simulation framework is presented. To evaluate results, warping index errors were calculated for the simulated data, and landmark-based and surface-based errors were calculated for the real data. An improvement of the registration accuracy for OF-MI as compared with MI was found for both simulated and real datasets. Statistical significance of the difference was tested and confirmed in the simulated dataset (p < 0.01)

Parallel Computation of Nonrigid Image Registration

Automatic intensity-based nonrigid image registration brings significant impact in medical applications such as multimodality fusion of images, serial comparison for monitoring disease progression or regression, and minimally invasive image-guided interventions. However, due to memory and compute intensive nature of the operations, intensity-based image registration has remained too slow to be practical for clinical adoption, with its use limited primarily to as a pre-operative too. Efficient registration methods can lead to new possibilities for development of improved and interactive intraoperative tools and capabilities. In this thesis, we propose an efficient parallel implementation for intensity-based three-dimensional nonrigid image registration on a commodity graphics processing unit. Optimization techniques are developed to accelerate the compute-intensive mutual information computation. The study is performed on the hierarchical volume subdivision-based algorithm, which is inherently faster than other nonrigid registration algorithms and structurally well-suited for data-parallel computation platforms. The proposed implementation achieves more than 50-fold runtime improvement over a standard implementation on a CPU. The execution time of nonrigid image registration is reduced from hours to minutes while retaining the same level of registration accuracy

Characterizing geometric distortions of 3D sequences in clinical head MRI

Objective Phantoms are often used to estimate the geometric accuracy in magnetic resonance imaging (MRI). However, the distortions may differ between anatomical and phantom images. This study aimed to investigate the applicability of a phantom-based and a test-subject-based method in evaluating geometric distortion present in clinical head-imaging sequences. Materials and methods We imaged a 3D-printed phantom and test subjects with two MRI scanners using two clinical head-imaging 3D sequences with varying patient-table positions and receiver bandwidths. The geometric distortions were evaluated through nonrigid registrations: the displaced acquisitions were compared against the ideal isocenter positioning, and the varied bandwidth volumes against the volume with the highest bandwidth. The phantom acquisitions were also registered to a computed tomography scan. Results Geometric distortion magnitudes increased with larger table displacements and were in good agreement between the phantom and test-subject acquisitions. The effect of increased distortions with decreasing receiver bandwidth was more prominent for test-subject acquisitions. Conclusion Presented results emphasize the sensitivity of the geometric accuracy to positioning and imaging parameters. Phantom limitations may become an issue with some sequence types, encouraging the use of anatomical images for evaluating the geometric accuracy.Peer reviewe

Image databases in medical applications

The number of medical images acquired yearly in hospitals increases all the time. These imaging data contain lots of information on the characteristics of anatomical structures and on their variations. This information can be utilized in numerous medical applications. In deformable model-based segmentation and registration methods, the information in the image databases can be used to give a priori information on the shape of the object studied and the gray-level values in the image, and on their variations. On the other hand, by studying the variations of the object of interest in different populations, the effects of, for example, aging, gender, and diseases on anatomical structures can be detected. In the work described in this Thesis, methods that utilize image databases in medical applications were studied. Methods were developed and compared for deformable model-based segmentation and registration. Model selection procedure, mean models, and combination of classifiers were studied for the construction of a good a priori model. Statistical and probabilistic shape models were generated to constrain the deformations in segmentation and registration so that only the shapes typical to the object studied were accepted. In the shape analysis of the striatum, both volume and local shape changes were studied. The effects of aging and gender, and also the asymmetries were examined. The results proved that the segmentation and registration accuracy of deformable model-based methods can be improved by utilizing the information in image databases. The databases used were relatively small. Therefore, the statistical and probabilistic methods were not able to model all the population-specific variation. On the other hand, the simpler methods, the model selection procedure, mean models, and combination of classifiers, gave good results also with the small image databases. Two main applications were the reconstruction of 3-D geometry from incomplete data and the segmentation of heart ventricles and atria from short- and long-axis magnetic resonance images. In both applications, the methods studied provided promising results. The shape analysis of the striatum showed that the volume of the striatum decreases in aging. Also, the shape of the striatum changes locally. Asymmetries in the shape were found, too, but any gender-related local shape differences were not found.reviewe