A review of segmentation and deformable registration methods applied to adaptive cervical cancer radiation therapy treatment planning

Objective: Manual contouring and registration for radiotherapy treatment planning and online adaptation for cervical cancer radiation therapy in computed tomography (CT) and magnetic resonance images (MRI) are often necessary. However manual intervention is time consuming and may suffer from inter or intra-rater variability. In recent years a number of computer-guided automatic or semi-automatic segmentation and registration methods have been proposed. Segmentation and registration in CT and MRI for this purpose is a challenging task due to soft tissue deformation, inter-patient shape and appearance variation and anatomical changes over the course of treatment. The objective of this work is to provide a state-of-the-art review of computer-aided methods developed for adaptive treatment planning and radiation therapy planning for cervical cancer radiation therapy. Methods: Segmentation and registration methods published with the goal of cervical cancer treatment planning and adaptation have been identified from the literature (PubMed and Google Scholar). A comprehensive description of each method is provided. Similarities and differences of these methods are highlighted and the strengths and weaknesses of these methods are discussed. A discussion about choice of an appropriate method for a given modality is provided. Results: In the reviewed papers a Dice similarity coefficient of around 0.85 along with mean absolute surface distance of 2-4. mm for the clinically treated volume were reported for transfer of contours from planning day to the treatment day. Conclusions: Most segmentation and non-rigid registration methods have been primarily designed for adaptive re-planning for the transfer of contours from planning day to the treatment day. The use of shape priors significantly improved segmentation and registration accuracy compared to other models

Three-dimensional quantitative evaluation method of nonrigid registration algorithms for adaptive radiotherapy

Purpose: Current radiotherapy is progressing to the concept of adaptive radiotherapy, which implies the adaptation of planning along the treatment course. Nonrigid registration is an essential image processing tool for adaptive radiotherapy and image guided radiotherapy, and the three-dimensional (3D) nature of the current radiotherapy techniques requires a 3D quantification of the registration error that existing evaluation methods do not cover appropriately. The authors present a method for 3D evaluation of nonrigid registration algorithms’ performance, based on organ delineations, capable of working with near-spherical volumes even in the presence of concavities. Methods: The evaluation method is composed by a volume shape description stage, developed using a new ad hoc volume reconstruction algorithm proposed by the authors, and an error quantification stage. The evaluation method is applied to the organ delineations of prostate and seminal vesicles, obtained by an automatic segmentation method over images of prostate cancer patients treated with intensity modulated radiation therapy. Results: The volume reconstruction algorithm proposed has been shown to accurately model complex 3D surfaces by the definition of clusters of control points. The quantification method, inspired by the Haussdorf–Chebysev distance, provides a measure of the largest registration error per control direction, defining a valid metric for concave-convex volumes. Summarizing, the proposed evaluation methodology presents accurate results with a high spatial resolution in a negligible computation time in comparison with the nonrigid registration time. Conclusions: Experimental results show that the metric selected for quantifying the registration error is of utmost importance in a quantitative evaluation based on measuring distances between volumes. The accuracy of the volume reconstruction algorithm is not so relevant as long as the reconstruction is tight enough on the actual volume of the organ. The new evaluation method provides a smooth and accurate volume reconstruction for both the reference and the registered organ, and a complete 3D description of nonrigid registration algorithms’ performance, resulting in a useful tool for study and comparison of registration algorithms for adaptive radiotherapy

3D fusion of histology to multi-parametric MRI for prostate cancer imaging evaluation and lesion-targeted treatment planning

Multi-parametric magnetic resonance imaging (mpMRI) of localized prostate cancer has the potential to support detection, staging and localization of tumors, as well as selection, delivery and monitoring of treatments. Delineating prostate cancer tumors on imaging could potentially further support the clinical workflow by enabling precise monitoring of tumor burden in active-surveillance patients, optimized targeting of image-guided biopsies, and targeted delivery of treatments to decrease morbidity and improve outcomes. Evaluating the performance of mpMRI for prostate cancer imaging and delineation ideally includes comparison to an accurately registered reference standard, such as prostatectomy histology, for the locations of tumor boundaries on mpMRI. There are key gaps in knowledge regarding how to accurately register histological reference standards to imaging, and consequently further gaps in knowledge regarding the suitability of mpMRI for tasks, such as tumor delineation, that require such reference standards for evaluation. To obtain an understanding of the magnitude of the mpMRI-histology registration problem, we quantified the position, orientation and deformation of whole-mount histology sections relative to the formalin-fixed tissue slices from which they were cut. We found that (1) modeling isotropic scaling accounted for the majority of the deformation with a further small but statistically significant improvement from modeling affine transformation, and (2) due to the depth (mean±standard deviation (SD) 1.1±0.4 mm) and orientation (mean±SD 1.5±0.9°) of the sectioning, the assumption that histology sections are cut from the front faces of tissue slices, common in previous approaches, introduced a mean error of 0.7 mm. To determine the potential consequences of seemingly small registration errors such as described above, we investigated the impact of registration accuracy on the statistical power of imaging validation studies using a co-registered spatial reference standard (e.g. histology images) by deriving novel statistical power formulae that incorporate registration error. We illustrated, through a case study modeled on a prostate cancer imaging trial at our centre, that submillimeter differences in registration error can have a substantial impact on the required sample sizes (and therefore also the study cost) for studies aiming to detect mpMRI signal differences due to 0.5 – 2.0 cm3 prostate tumors. With the aim of achieving highly accurate mpMRI-histology registrations without disrupting the clinical pathology workflow, we developed a three-stage method for accurately registering 2D whole-mount histology images to pre-prostatectomy mpMRI that allowed flexible placement of cuts during slicing for pathology and avoided the assumption that histology sections are cut from the front faces of tissue slices. The method comprised a 3D reconstruction of histology images, followed by 3D–3D ex vivo–in vivo and in vivo–in vivo image transformations. The 3D reconstruction method minimized fiducial registration error between cross-sections of non-disruptive histology- and ex-vivo-MRI-visible strand-shaped fiducials to reconstruct histology images into the coordinate system of an ex vivo MR image. We quantified the mean±standard deviation target registration error of the reconstruction to be 0.7±0.4 mm, based on the post-reconstruction misalignment of intrinsic landmark pairs. We also compared our fiducial-based reconstruction to an alternative reconstruction based on mutual-information-based registration, an established method for multi-modality registration. We found that the mean target registration error for the fiducial-based method (0.7 mm) was lower than that for the mutual-information-based method (1.2 mm), and that the mutual-information-based method was less robust to initialization error due to multiple sources of error, including the optimizer and the mutual information similarity metric. The second stage of the histology–mpMRI registration used interactively defined 3D–3D deformable thin-plate-spline transformations to align ex vivo to in vivo MR images to compensate for deformation due to endorectal MR coil positioning, surgical resection and formalin fixation. The third stage used interactively defined 3D–3D rigid or thin-plate-spline transformations to co-register in vivo mpMRI images to compensate for patient motion and image distortion. The combined mean registration error of the histology–mpMRI registration was quantified to be 2 mm using manually identified intrinsic landmark pairs. Our data set, comprising mpMRI, target volumes contoured by four observers and co-registered contoured and graded histology images, was used to quantify the positive predictive values and variability of observer scoring of lesions following the Prostate Imaging Reporting and Data System (PI-RADS) guidelines, the variability of target volume contouring, and appropriate expansion margins from target volumes to achieve coverage of histologically defined cancer. The analysis of lesion scoring showed that a PI-RADS overall cancer likelihood of 5, denoting “highly likely cancer”, had a positive predictive value of 85% for Gleason 7 cancer (and 93% for lesions with volumes \u3e0.5 cm3 measured on mpMRI) and that PI-RADS scores were positively correlated with histological grade (ρ=0.6). However, the analysis also showed interobserver differences in PI-RADS score of 0.6 to 1.2 (on a 5-point scale) and an agreement kappa value of only 0.30. The analysis of target volume contouring showed that target volume contours with suitable margins can achieve near-complete histological coverage for detected lesions, despite the presence of high interobserver spatial variability in target volumes. Prostate cancer imaging and delineation have the potential to support multiple stages in the management of localized prostate cancer. Targeted biopsy procedures with optimized targeting based on tumor delineation may help distinguish patients who need treatment from those who need active surveillance. Ongoing monitoring of tumor burden based on delineation in patients undergoing active surveillance may help identify those who need to progress to therapy early while the cancer is still curable. Preferentially targeting therapies at delineated target volumes may lower the morbidity associated with aggressive cancer treatment and improve outcomes in low-intermediate-risk patients. Measurements of the accuracy and variability of lesion scoring and target volume contouring on mpMRI will clarify its value in supporting these roles

Biomechanical Modeling for Lung Tumor Motion Prediction during Brachytherapy and Radiotherapy

A novel technique is proposed to develop a biomechanical model for estimating lung’s tumor position as a function of respiration cycle time. Continuous tumor motion is a major challenge in lung cancer treatment techniques where the tumor needs to be targeted; e.g. in external beam radiotherapy and brachytherapy. If not accounted for, this motion leads to areas of radiation over and/or under dosage for normal tissue and tumors. In this thesis, biomechanical models were developed for lung tumor motion predication in two distinct cases of lung brachytherapy and lung external beam radiotherapy. The lung and other relevant surrounding organs geometries, loading, boundary conditions and mechanical properties were considered and incorporated properly for each case. While using material model with constant incompressibility is sufficient to model the lung tissue in the brachytherapy case, in external beam radiation therapy the tissue incompressibility varies significantly due to normal breathing. One of the main issues tackled in this research is characterizing lung tissue incompressibility variations and measuring its corresponding parameters as a function of respiration cycle time. Results obtained from an ex-vivo porcine deflated lung indicated feasibility and reliability of using the developed biomechanical model to predict tumor motion during brachytherapy. For external beam radiotherapy, in-silico studies indicated very significant impact of considering the lung tissue incompressibility on the accuracy of predicting tumor motion. Furthermore, ex-vivo porcine lung experiments demonstrated the capability and reliability of the proposed approach for predicting tumor motion as a function of cyclic time. As such, the proposed models have a good potential to be incorporated effectively in computer assisted lung radiotherapy treatment systems

Deformable models for adaptive radiotherapy planning

Radiotherapy is the most widely used treatment for cancer, with 4 out of 10 cancer patients receiving radiotherapy as part of their treatment. The delineation of gross tumour volume (GTV) is crucial in the treatment of radiotherapy. An automatic contouring system would be beneficial in radiotherapy planning in order to generate objective, accurate and reproducible GTV contours. Image guided radiotherapy (IGRT) acquires patient images just before treatment delivery to allow any necessary positional correction. Consequently, real-time contouring system provides an opportunity to adopt radiotherapy on the treatment day. In this thesis, freely deformable models (FDM) and shape constrained deformable models (SCDMs) were used to automatically delineate the GTV for brain cancer and prostate cancer. Level set method (LSM) is a typical FDM which was used to contour glioma on brain MRI. A series of low level image segmentation methodologies are cascaded to form a case-wise fully automatic initialisation pipeline for the level set function. Dice similarity coefficients (DSCs) were used to evaluate the contours. Results shown a good agreement between clinical contours and LSM contours, in 93% of cases the DSCs was found to be between 60% and 80%. The second significant contribution is a novel development to the active shape model (ASM), a profile feature was selected from pre-computed texture features by minimising the Mahalanobis distance (MD) to obtain the most distinct feature for each landmark, instead of conventional image intensity. A new group-wise registration scheme was applied to solve the correspondence definition within the training data. This ASM model was used to delineated prostate GTV on CT. DSCs for this case was found between 0.75 and 0.91 with the mean DSC 0.81. The last contribution is a fully automatic active appearance model (AAM) which captures image appearance near the GTV boundary. The image appearance of inner GTV was discarded to spare the potential disruption caused by brachytherapy seeds or gold markers. This model outperforms conventional AAM at the prostate base and apex region by involving surround organs. The overall mean DSC for this case is 0.85

Multimodality Biomedical Image Registration Using Free Point Transformer Networks

We describe a point-set registration algorithm based on a novel free point transformer (FPT) network, designed for points extracted from multimodal biomedical images for registration tasks, such as those frequently encountered in ultrasound-guided interventional procedures. FPT is constructed with a global feature extractor which accepts unordered source and target point-sets of variable size. The extracted features are conditioned by a shared multilayer perceptron point transformer module to predict a displacement vector for each source point, transforming it into the target space. The point transformer module assumes no vicinity or smoothness in predicting spatial transformation and, together with the global feature extractor, is trained in a data-driven fashion with an unsupervised loss function. In a multimodal registration task using prostate MR and sparsely acquired ultrasound images, FPT yields comparable or improved results over other rigid and non-rigid registration methods. This demonstrates the versatility of FPT to learn registration directly from real, clinical training data and to generalize to a challenging task, such as the interventional application presented

Multimodality Biomedical Image Registration using Free Point Transformer Networks

We describe a point-set registration algorithm based on a novel free point transformer (FPT) network, designed for points extracted from multimodal biomedical images for registration tasks, such as those frequently encountered in ultrasound-guided interventional procedures. FPT is constructed with a global feature extractor which accepts unordered source and target point-sets of variable size. The extracted features are conditioned by a shared multilayer perceptron point transformer module to predict a displacement vector for each source point, transforming it into the target space. The point transformer module assumes no vicinity or smoothness in predicting spatial transformation and, together with the global feature extractor, is trained in a data-driven fashion with an unsupervised loss function. In a multimodal registration task using prostate MR and sparsely acquired ultrasound images, FPT yields comparable or improved results over other rigid and non-rigid registration methods. This demonstrates the versatility of FPT to learn registration directly from real, clinical training data and to generalize to a challenging task, such as the interventional application presented.Comment: 10 pages, 4 figures. Accepted for publication at International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) workshop on Advances in Simplifying Medical UltraSound (ASMUS) 202