Nonrigid Medical Image Registration by Finite-Element Deformable Sheet-Curve Models

Image-based change quantitation has been recognized as a promising tool for accurate assessment of tumor's early response to chemoprevention in cancer research. For example, various changes on breast density and vascularity in glandular tissue are the indicators of early response to treatment. Accurate extraction of glandular tissue from pre- and postcontrast magnetic resonance (MR) images requires a nonrigid registration of sequential MR images embedded with local deformations. This paper reports a newly developed registration method that aligns MR breast images using finite-element deformable sheet-curve models. Specifically, deformable curves are constructed to match the boundaries dynamically, while a deformable sheet of thin-plate splines is designed to model complex local deformations. The experimental results on both digital phantoms and real MR breast images using the new method have been compared to point-based thin-plate-spline (TPS) approach, and have demonstrated a significant and robust improvement in both boundary alignment and local deformation recovery

On voxel-by-voxel accumulated dose for prostate radiation therapy using deformable image registration.

Since delivered dose is rarely the same with planned, we calculated the delivered total dose to ten prostate radiotherapy patients treated with rectal balloons using deformable dose accumulation (DDA) and compared it with the planned dose. The patients were treated with TomoTherapy using two rectal balloon designs: five patients had the Radiadyne balloon (balloon A), and five patients had the EZ-EM balloon (balloon B). Prostate and rectal wall contours were outlined on each pre-treatment MVCT for all patients. Delivered fractional doses were calculated using the MVCT taken immediately prior to delivery. Dose grids were accumulated to the last MVCT using DDA tools in Pinnacle3 TM (v9.100, Philips Radiation Oncology Systems, Fitchburg, USA). Delivered total doses were compared with planned doses using prostate and rectal wall DVHs. The rectal NTCP was calculated based on total delivered and planned doses for all patients using the Lyman model. For 8/10 patients, the rectal wall NTCP calculated using the delivered total dose was less than planned, with seven patients showing a decrease of more than 5% in NTCP. For 2/10 patients studied, the rectal wall NTCP calculated using total delivered dose was 2% higher than planned. This study indicates that for patients receiving hypofractionated radiotherapy for prostate cancer with a rectal balloon, total delivered doses to prostate is similar with planned while delivered dose to rectal walls may be significantly different from planned doses. 8/10 patients show significant correlation between rectal balloon anterior-posterior positions and some VD values

Validating Dose Uncertainty Estimates Produced by AUTODIRECT: An Automated Program to Evaluate Deformable Image Registration Accuracy.

Deformable image registration is a powerful tool for mapping information, such as radiation therapy dose calculations, from one computed tomography image to another. However, deformable image registration is susceptible to mapping errors. Recently, an automated deformable image registration evaluation of confidence tool was proposed to predict voxel-specific deformable image registration dose mapping errors on a patient-by-patient basis. The purpose of this work is to conduct an extensive analysis of automated deformable image registration evaluation of confidence tool to show its effectiveness in estimating dose mapping errors. The proposed format of automated deformable image registration evaluation of confidence tool utilizes 4 simulated patient deformations (3 B-spline-based deformations and 1 rigid transformation) to predict the uncertainty in a deformable image registration algorithm's performance. This workflow is validated for 2 DIR algorithms (B-spline multipass from Velocity and Plastimatch) with 1 physical and 11 virtual phantoms, which have known ground-truth deformations, and with 3 pairs of real patient lung images, which have several hundred identified landmarks. The true dose mapping error distributions closely followed the Student t distributions predicted by automated deformable image registration evaluation of confidence tool for the validation tests: on average, the automated deformable image registration evaluation of confidence tool-produced confidence levels of 50%, 68%, and 95% contained 48.8%, 66.3%, and 93.8% and 50.1%, 67.6%, and 93.8% of the actual errors from Velocity and Plastimatch, respectively. Despite the sparsity of landmark points, the observed error distribution from the 3 lung patient data sets also followed the expected error distribution. The dose error distributions from automated deformable image registration evaluation of confidence tool also demonstrate good resemblance to the true dose error distributions. Automated deformable image registration evaluation of confidence tool was also found to produce accurate confidence intervals for the dose-volume histograms of the deformed dose

Evaluation of Image Registration Accuracy for Tumor and Organs at Risk in the Thorax for Compliance With TG 132 Recommendations

Purpose To evaluate accuracy for 2 deformable image registration methods (in-house B-spline and MIM freeform) using image pairs exhibiting changes in patient orientation and lung volume and to assess the appropriateness of registration accuracy tolerances proposed by the American Association of Physicists in Medicine Task Group 132 under such challenging conditions via assessment by expert observers. Methods and Materials Four-dimensional computed tomography scans for 12 patients with lung cancer were acquired with patients in prone and supine positions. Tumor and organs at risk were delineated by a physician on all data sets: supine inhale (SI), supine exhale, prone inhale, and prone exhale. The SI image was registered to the other images using both registration methods. All SI contours were propagated using the resulting transformations and compared with physician delineations using Dice similarity coefficient, mean distance to agreement, and Hausdorff distance. Additionally, propagated contours were anonymized along with ground-truth contours and rated for quality by physician-observers. Results Averaged across all patients, the accuracy metrics investigated remained within tolerances recommended by Task Group 132 (Dice similarity coefficient \u3e0.8, mean distance to agreement \u3c3 \u3emm). MIM performed better with both complex (vertebrae) and low-contrast (esophagus) structures, whereas the in-house method performed better with lungs (whole and individual lobes). Accuracy metrics worsened but remained within tolerances when propagating from supine to prone; however, the Jacobian determinant contained regions with negative values, indicating localized nonphysiologic deformations. For MIM and in-house registrations, 50% and 43.8%, respectively, of propagated contours were rated acceptable as is and 8.2% and 11.0% as clinically unacceptable. Conclusions The deformable image registration methods performed reliably and met recommended tolerances despite anatomically challenging cases exceeding typical interfraction variability. However, additional quality assurance measures are necessary for complex applications (eg, dose propagation). Human review rather than unsupervised implementation should always be part of the clinical registration workflow

Imaging Informatics and the Human Brain Project: the Role of Structure, Review

(no abstract

Mesh-to-raster based non-rigid registration of multi-modal images

Region of interest (ROI) alignment in medical images plays a crucial role in diagnostics, procedure planning, treatment, and follow-up. Frequently, a model is represented as triangulated mesh while the patient data is provided from CAT scanners as pixel or voxel data. Previously, we presented a 2D method for curve-to-pixel registration. This paper contributes (i) a general mesh-to-raster (M2R) framework to register ROIs in multi-modal images; (ii) a 3D surface-to-voxel application, and (iii) a comprehensive quantitative evaluation in 2D using ground truth provided by the simultaneous truth and performance level estimation (STAPLE) method. The registration is formulated as a minimization problem where the objective consists of a data term, which involves the signed distance function of the ROI from the reference image, and a higher order elastic regularizer for the deformation. The evaluation is based on quantitative light-induced fluoroscopy (QLF) and digital photography (DP) of decalcified teeth. STAPLE is computed on 150 image pairs from 32 subjects, each showing one corresponding tooth in both modalities. The ROI in each image is manually marked by three experts (900 curves in total). In the QLF-DP setting, our approach significantly outperforms the mutual information-based registration algorithm implemented with the Insight Segmentation and Registration Toolkit (ITK) and Elastix

Whole slide image registration for the study of tumor heterogeneity

Consecutive thin sections of tissue samples make it possible to study local variation in e.g. protein expression and tumor heterogeneity by staining for a new protein in each section. In order to compare and correlate patterns of different proteins, the images have to be registered with high accuracy. The problem we want to solve is registration of gigapixel whole slide images (WSI). This presents 3 challenges: (i) Images are very large; (ii) Thin sections result in artifacts that make global affine registration prone to very large local errors; (iii) Local affine registration is required to preserve correct tissue morphology (local size, shape and texture). In our approach we compare WSI registration based on automatic and manual feature selection on either the full image or natural sub-regions (as opposed to square tiles). Working with natural sub-regions, in an interactive tool makes it possible to exclude regions containing scientifically irrelevant information. We also present a new way to visualize local registration quality by a Registration Confidence Map (RCM). With this method, intra-tumor heterogeneity and charateristics of the tumor microenvironment can be observed and quantified.Comment: MICCAI2018 - Computational Pathology and Ophthalmic Medical Image Analysis - COMPA

"Dose of the day" based on cone beam computed tomography and deformable image registration for lung cancer radiotherapy.

PURPOSE:Adaptive radiotherapy (ART) has potential to reduce toxicity and facilitate safe dose escalation. Dose calculations with the planning CT deformed to cone beam CT (CBCT) have shown promise for estimating the "dose of the day". The purpose of this study is to investigate the "dose of the day" calculation accuracy based on CBCT and deformable image registration (DIR) for lung cancer radiotherapy. METHODS:A total of 12 lung cancer patients were identified, for which daily CBCT imaging was performed for treatment positioning. A re-planning CT (rCT) was acquired after 20 Gy for all patients. A virtual CT (vCT) was created by deforming initial planning CT (pCT) to the simulated CBCT that was generated from deforming CBCT to rCT acquired on the same day. Treatment beams from the initial plan were copied to the vCT and rCT for dose calculation. Dosimetric agreement between vCT-based and rCT-based accumulated doses was evaluated using the Bland-Altman analysis. RESULTS:Mean differences in dose-volume metrics between vCT and rCT were smaller than 1.5%, and most discrepancies fell within the range of ± 5% for the target volume, lung, esophagus, and heart. For spinal cord Dmax , a large mean difference of -5.55% was observed, which was largely attributed to very limited CBCT image quality (e.g., truncation artifacts). CONCLUSION:This study demonstrated a reasonable agreement in dose-volume metrics between dose accumulation based on vCT and rCT, with the exception for cases with poor CBCT image quality. These findings suggest potential utility of vCT for providing a reasonable estimate of the "dose of the day", and thus facilitating the process of ART for lung cancer