Non-rigid registration of 2-D/3-D dynamic data with feature alignment

In this work, we are computing the matching between 2D manifolds and 3D manifolds with temporal constraints, that is we are computing the matching among a time sequence of 2D/3D manifolds. It is solved by mapping all the manifolds to a common domain, then build their matching by composing the forward mapping and the inverse mapping. At first, we solve the matching problem between 2D manifolds with temporal constraints by using mesh-based registration method. We propose a surface parameterization method to compute the mapping between the 2D manifold and the common 2D planar domain. We can compute the matching among the time sequence of deforming geometry data through this common domain. Compared with previous work, our method is independent of the quality of mesh elements and more efficient for the time sequence data. Then we develop a global intensity-based registration method to solve the matching problem between 3D manifolds with temporal constraints. Our method is based on a 4D(3D+T) free-from B-spline deformation model which has both spatial and temporal smoothness. Compared with previous 4D image registration techniques, our method avoids some local minimum. Thus it can be solved faster and achieve better accuracy of landmark point predication. We demonstrate the efficiency of these works on the real applications. The first one is applied to the dynamic face registering and texture mapping. The second one is applied to lung tumor motion tracking in the medical image analysis. In our future work, we are developing more efficient mesh-based 4D registration method. It can be applied to tumor motion estimation and tracking, which can be used to calculate the read dose delivered to the lung and surrounding tissues. Thus this can support the online treatment of lung cancer radiotherapy

Improving the Accuracy of CT-derived Attenuation Correction in Respiratory-Gated PET/CT Imaging

The effect of respiratory motion on attenuation correction in Fludeoxyglucose (18F) positron emission tomography (FDG-PET) was investigated. Improvements to the accuracy of computed tomography (CT) derived attenuation correction were obtained through the alignment of the attenuation map to each emission image in a respiratory gated PET scan. Attenuation misalignment leads to artefacts in the reconstructed PET image and several methods were devised for evaluating the attenuation inaccuracies caused by this. These methods of evaluation were extended to finding the frame in the respiratory gated PET which best matched the CT. This frame was then used as a reference frame in mono-modality compensation for misalignment. Attenuation correction was found to affect the quantification of tumour volumes; thus a regional analysis was used to evaluate the impact of mismatch and the benefits of compensating for misalignment. Deformable image registration was used to compensate for misalignment, however, there were inaccuracies caused by the poor signal-to-noise ratio (SNR) in PET images. Two models were developed that were robust to a poor SNR allowing for the estimation of deformation from very noisy images. Firstly, a cross population model was developed by statistically analysing the respiratory motion in 10 4DCT scans. Secondly, a 1D model of respiration was developed based on the physiological function of respiration. The 1D approach correctly modelled the expansion and contraction of the lungs and the differences in the compressibility of lungs and surrounding tissues. Several additional models were considered but were ruled out based on their poor goodness of fit to 4DCT scans. Approaches to evaluating the developed models were also used to assist with optimising for the most accurate attenuation correction. It was found that the multimodality registration of the CT image to the PET image was the most accurate approach to compensating for attenuation correction mismatch. Mono-modality image registration was found to be the least accurate approach, however, incorporating a motion model improved the accuracy of image registration. The significance of these findings is twofold. Firstly, it was found that motion models are required to improve the accuracy in compensating for attenuation correction mismatch and secondly, a validation method was found for comparing approaches to compensating for attenuation mismatch

Improving the Accuracy of CT-derived Attenuation Correction in Respiratory-Gated PET/CT Imaging

The effect of respiratory motion on attenuation correction in Fludeoxyglucose (18F) positron emission tomography (FDG-PET) was investigated. Improvements to the accuracy of computed tomography (CT) derived attenuation correction were obtained through the alignment of the attenuation map to each emission image in a respiratory gated PET scan. Attenuation misalignment leads to artefacts in the reconstructed PET image and several methods were devised for evaluating the attenuation inaccuracies caused by this. These methods of evaluation were extended to finding the frame in the respiratory gated PET which best matched the CT. This frame was then used as a reference frame in mono-modality compensation for misalignment. Attenuation correction was found to affect the quantification of tumour volumes; thus a regional analysis was used to evaluate the impact of mismatch and the benefits of compensating for misalignment. Deformable image registration was used to compensate for misalignment, however, there were inaccuracies caused by the poor signal-to-noise ratio (SNR) in PET images. Two models were developed that were robust to a poor SNR allowing for the estimation of deformation from very noisy images. Firstly, a cross population model was developed by statistically analysing the respiratory motion in 10 4DCT scans. Secondly, a 1D model of respiration was developed based on the physiological function of respiration. The 1D approach correctly modelled the expansion and contraction of the lungs and the differences in the compressibility of lungs and surrounding tissues. Several additional models were considered but were ruled out based on their poor goodness of fit to 4DCT scans. Approaches to evaluating the developed models were also used to assist with optimising for the most accurate attenuation correction. It was found that the multimodality registration of the CT image to the PET image was the most accurate approach to compensating for attenuation correction mismatch. Mono-modality image registration was found to be the least accurate approach, however, incorporating a motion model improved the accuracy of image registration. The significance of these findings is twofold. Firstly, it was found that motion models are required to improve the accuracy in compensating for attenuation correction mismatch and secondly, a validation method was found for comparing approaches to compensating for attenuation mismatch

Heterogeneous volumetric data mapping and its medical applications

With the advance of data acquisition techniques, massive solid geometries are being collected routinely in scientific tasks, these complex and unstructured data need to be effectively correlated for various processing and analysis. Volumetric mapping solves bijective low-distortion correspondence between/among 3D geometric data, and can serve as an important preprocessing step in many tasks in compute-aided design and analysis, industrial manufacturing, medical image analysis, to name a few. This dissertation studied two important volumetric mapping problems: the mapping of heterogeneous volumes (with nonuniform inner structures/layers) and the mapping of sequential dynamic volumes. To effectively handle heterogeneous volumes, first, we studied the feature-aligned harmonic volumetric mapping. Compared to previous harmonic mapping, it supports the point, curve, and iso-surface alignment, which are important low-dimensional structures in heterogeneous volumetric data. Second, we proposed a biharmonic model for volumetric mapping. Unlike the conventional harmonic volumetric mapping that only supports positional continuity on the boundary, this new model allows us to have higher order continuity $C^1$ along the boundary surface. This suggests a potential model to solve the volumetric mapping of complex and big geometries through divide-and-conquer. We also studied the medical applications of our volumetric mapping in lung tumor respiratory motion modeling. We were building an effective digital platform for lung tumor radiotherapy based on effective volumetric CT/MRI image matching and analysis. We developed and integrated in this platform a set of geometric/image processing techniques including advanced image segmentation, finite element meshing, volumetric registration and interpolation. The lung organ/tumor and surrounding tissues are treated as a heterogeneous region and a dynamic 4D registration framework is developed for lung tumor motion modeling and tracking. Compared to the previous 3D pairwise registration, our new 4D parameterization model leads to a significantly improved registration accuracy. The constructed deforming model can hence approximate the deformation of the tissues and tumor

Estimating the 4D respiratory lung motion by spatiotemporal registration and super-resolution image reconstruction

One of the main challenges in lung cancer radiation therapy is how to reduce the treatment margin but accommodate the geometric uncertainty of moving tumor. 4D-CT is able to provide the full range of motion information for the lung and tumor. However, accurate estimation of lung motion with respect to the respiratory phase is difficult due to various challenges in image registration, e.g., motion artifacts and large interslice thickness in 4D-CT. Meanwhile, the temporal coherence across respiration phases is usually not guaranteed in the conventional registration methods which consider each phase image in 4D-CT independently. To address these challenges, the authors present a unified approach to estimate the respiratory lung motion with two iterative steps

Feasibility of automated 3-dimensional magnetic resonance imaging pancreas segmentation.

PurposeWith the advent of MR guided radiotherapy, internal organ motion can be imaged simultaneously during treatment. In this study, we evaluate the feasibility of pancreas MRI segmentation using state-of-the-art segmentation methods.Methods and materialT2 weighted HASTE and T1 weighted VIBE images were acquired on 3 patients and 2 healthy volunteers for a total of 12 imaging volumes. A novel dictionary learning (DL) method was used to segment the pancreas and compared to t mean-shift merging (MSM), distance regularized level set (DRLS), graph cuts (GC) and the segmentation results were compared to manual contours using Dice's index (DI), Hausdorff distance and shift of the-center-of-the-organ (SHIFT).ResultsAll VIBE images were successfully segmented by at least one of the auto-segmentation method with DI >0.83 and SHIFT ≤2 mm using the best automated segmentation method. The automated segmentation error of HASTE images was significantly greater. DL is statistically superior to the other methods in Dice's overlapping index. For the Hausdorff distance and SHIFT measurement, DRLS and DL performed slightly superior to the GC method, and substantially superior to MSM. DL required least human supervision and was faster to compute.ConclusionOur study demonstrated potential feasibility of automated segmentation of the pancreas on MRI images with minimal human supervision at the beginning of imaging acquisition. The achieved accuracy is promising for organ localization

Multiframe Temporal Estimation of Cardiac Nonrigid Motion

A robust, flexible system for tracking the point to point nonrigid motion of the left ventricular (LV) endocardial wall in image sequences has been developed. This system is unique in its ability to model motion trajectories across multiple frames. The foundation of this system is an adaptive transversal filter based on the recursive least-squares algorithm. This filter facilitates the integration of models for periodicity and proximal smoothness as appropriate using a contour-based description of the object’s boundaries. A set of correspondences between contours and an associated set of correspondence quality measures comprise the input to the system. Frame-to-frame relationships from two different frames of reference are derived and analyzed using synthetic and actual images. Two multiframe temporal models, both based on a sum of sinusoids, are derived. Illustrative examples of the system’s output are presented for quantitative analysis. Validation of the system is performed by comparing computed trajectory estimates with the trajectories of physical markers implanted in the LV wall. Sample case studies of marker trajectory comparisons are presented. Ensemble statistics from comparisons with 15 marker trajectories are acquired and analyzed. A multiframe temporal model without spatial periodicity constraints was determined to provide excellent performance with the least computational cost. A multiframe spatiotemporal model provided the best performance based on statistical standard deviation, although at significant computational expense.National Heart, Lung, and Blood InstituteAir Force of Scientific ResearchNational Science FoundationOffice of Naval ResearchR01HL44803F49620-99-1-0481F49620-99-1-0067MIP-9615590N00014-98-1-054

Investigation of time-resolved volumetric MRI to enhance MR-guided radiotherapy of moving lung tumors

In photon radiotherapy of lung cancer, respiratory-induced motion introduces systematic and statistical uncertainties in treatment planning and dose delivery. By integrating magnetic resonance imaging (MRI) in the treatment planning process in MR-guided radiotherapy (MRgRT), uncertainties in target volume definition can be reduced with respect to state-of-the-art X-ray-based approaches. Furthermore, MR-guided linear accelerators (MR-Linacs) offer dose delivery with enhanced accuracy and precision through daily treatment plan adaptation and gated beam delivery based on real-time MRI. Today, the potential of MRgRT of moving targets is, however, not fully exploited due to the lack of time-resolved four-dimensional MRI (4D-MRI) in clinical practice. Therefore, the aim of this thesis was to develop and experimentally validate new methods for motion characterization and estimation with 4D-MRI for MRgRT of lung cancer. Different concepts were investigated for all phases of the clinical workflow - treatment planning, beam delivery, and post-treatment analysis. Firstly, a novel internal target volume (ITV) definition method based on the probability-of-presence of moving tumors derived from real-time 4D-MRI was developed. The ability of the ITVs to prospectively account for changes occurring over the course of several weeks was assessed in retrospective geometric analyses of lung cancer patient data. Higher robustness of the probabilistic 4D-MRI-based ITVs against interfractional changes was observed compared to conventional target volumes defined with four-dimensional computed tomography (4D-CT). The study demonstrated that motion characterization over extended times enabled by real-time 4D-MRI can reduce systematic and statistical uncertainties associated with today’s standard workflow. Secondly, experimental validation of a published motion estimation method - the propagation method - was conducted with a porcine lung phantom under realistic patient-like conditions. Estimated 4D-MRIs with a temporal resolution of 3.65 Hz were created based on orthogonal 2D cine MRI acquired at the scanner unit of an MR-Linac. A comparison of these datasets with ground truth respiratory-correlated 4D-MRIs in geometric analyses showed that the propagation method can generate geometrically accurate estimated 4D-MRIs. These could decrease target localization errors and enable 3D motion monitoring during beam delivery at the MR-Linac in the future. Lastly, the propagation method was extended to create continuous time-resolved estimated synthetic CTs (tresCTs). The proposed method was experimentally tested with the porcine lung phantom, successively imaged at a CT scanner and an MR-Linac. A high agreement of the images and corresponding dose distributions of the tresCTs and measured ground truth 4D-CTs was found in geometric and dosimetric analyses. The tresCTs could be used for post-treatment time-resolved reconstruction of the delivered dose to guide treatment adaptations in the future. These studies represent important steps towards a clinical application of time-resolved 4D-MRI methods for enhanced MRgRT of lung tumors in the near future