Efficient deformable motion correction for 3-D abdominal MRI using manifold regression

We present a novel framework for efficient retrospective respiratory motion correction of 3-D abdominal MRI using manifold regression. K-space data are continuously acquired under free breathing using the stack-of-stars radial gold-en-angle trajectory. The stack-of-profiles (SoP) from all temporal positions are embedded into a common manifold, in which SoPs that were acquired at similar respiratory states are close together. Next, the SoPs in the manifold are clustered into groups using the k-means algorithm. One 3-D volume is reconstructed at the central SoP position of each cluster (a.k.a. key-volumes). Motion fields are estimated using deformable image registration between each of these key-volumes and a reference end-exhale volume. Subsequently, the motion field at any other SoP position in the manifold is derived using manifold regression. The regressed motion fields for each of the SoPs are used to deter-mine a final motion-corrected MRI volume. The method was evaluated on realistic synthetic datasets which were generated from real MRI data and also tested on an in vivo dataset. The framework enables more accurate motion correction compared to the conventional binning-based approach, with high computational efficiency

An analysis of the regional heterogeneity in tissue elasticity in lung cancer patients with COPD

PurposeRecent advancements in obtaining image-based biomarkers from CT images have enabled lung function characterization, which could aid in lung interventional planning. However, the regional heterogeneity in these biomarkers has not been well documented, yet it is critical to several procedures for lung cancer and COPD. The purpose of this paper is to analyze the interlobar and intralobar heterogeneity of tissue elasticity and study their relationship with COPD severity.MethodsWe retrospectively analyzed a set of 23 lung cancer patients for this study, 14 of whom had COPD. For each patient, we employed a 5DCT scanning protocol to obtain end-exhalation and end-inhalation images and semi-automatically segmented the lobes. We calculated tissue elasticity using a biomechanical property estimation model. To obtain a measure of lobar elasticity, we calculated the mean of the voxel-wise elasticity values within each lobe. To analyze interlobar heterogeneity, we defined an index that represented the properties of the least elastic lobe as compared to the rest of the lobes, termed the Elasticity Heterogeneity Index (EHI). An index of 0 indicated total homogeneity, and higher indices indicated higher heterogeneity. Additionally, we measured intralobar heterogeneity by calculating the coefficient of variation of elasticity within each lobe.ResultsThe mean EHI was 0.223 ± 0.183. The mean coefficient of variation of the elasticity distributions was 51.1% ± 16.6%. For mild COPD patients, the interlobar heterogeneity was low compared to the other categories. For moderate-to-severe COPD patients, the interlobar and intralobar heterogeneities were highest, showing significant differences from the other groups.ConclusionWe observed a high level of lung tissue heterogeneity to occur between and within the lobes in all COPD severity cases, especially in moderate-to-severe cases. Heterogeneity results demonstrate the value of a regional, function-guided approach like elasticity for procedures such as surgical decision making and treatment planning

Deep learning-based simultaneous multi-phase deformable image registration of sparse 4D-CBCT

Purpose: Respiratory gated 4D-CBCT suffers from sparseness artefacts caused by the limited number of projections available for each respiratory phase/amplitude. These artefacts severely impact deformable image registration methods used to extract motion information. We use deep learning-based methods to predict displacement vector-fields (DVF) from sparse 4D-CBCT images to alleviate the impacts of sparseness artefacts. Methods: We trained U-Net-type convolutional neural network models to predict multiple (10) DVFs in a single forward pass given multiple sparse, gated CBCT and an optional artefact-free reference image as inputs. The predicted DVFs are used to warp the reference image to the different motion states, resulting in an artefact-free image for each state. The supervised training uses data generated by a motion simulation framework. The training dataset consists of 560 simulated 4D-CBCT images of 56 different patients; the generated data include fully sampled ground-truth images that are used to train the network. We compare the results of our method to pairwise image registration (reference image to single sparse image) using a) the deeds algorithm and b) VoxelMorph with image pair inputs. Results: We show that our method clearly outperforms pairwise registration using the deeds algorithm alone. PSNR improved from 25.8 to 46.4, SSIM from 0.9296 to 0.9999. In addition, the runtime of our learning-based method is orders of magnitude shorter (2 seconds instead of 10 minutes). Our results also indicate slightly improved performance compared to pairwise registration (delta-PSNR=1.2). We also trained a model that does not require the artefact-free reference image (which is usually not available) during inference demonstrating only marginally compromised results (delta-PSNR=-0.8). Conclusion: To the best of our knowledge, this is the first time CNNs are used to predict multi-phase DVFs in a single forward pass. This enables novel applications such as 4D-auto-segmentation, motion compensated image reconstruction, motion analyses, and patient motion modeling

Image registration via stochastic gradient markov chain monte carlo

We develop a fully Bayesian framework for non-rigid registration of three-dimensional medical images, with a focus on uncertainty quantification. Probabilistic registration of large images along with calibrated uncertainty estimates is difficult for both computational and modelling reasons. To address the computational issues, we explore connections between the Markov chain Monte Carlo by backprop and the variational inference by backprop frameworks in order to efficiently draw thousands of samples from the posterior distribution. Regarding the modelling issues, we carefully design a Bayesian model for registration to overcome the existing barriers when using a dense, high-dimensional, and diffeomorphic parameterisation of the transformation. This results in improved calibration of uncertainty estimates

Transformer Lesion Tracker

Evaluating lesion progression and treatment response via longitudinal lesion tracking plays a critical role in clinical practice. Automated approaches for this task are motivated by prohibitive labor costs and time consumption when lesion matching is done manually. Previous methods typically lack the integration of local and global information. In this work, we propose a transformer-based approach, termed Transformer Lesion Tracker (TLT). Specifically, we design a Cross Attention-based Transformer (CAT) to capture and combine both global and local information to enhance feature extraction. We also develop a Registration-based Anatomical Attention Module (RAAM) to introduce anatomical information to CAT so that it can focus on useful feature knowledge. A Sparse Selection Strategy (SSS) is presented for selecting features and reducing memory footprint in Transformer training. In addition, we use a global regression to further improve model performance. We conduct experiments on a public dataset to show the superiority of our method and find that our model performance has improved the average Euclidean center error by at least 14.3% (6mm vs. 7mm) compared with the state-of-the-art (SOTA). Code is available at https://github.com/TangWen920812/TLT.Comment: Accepted MICCAI 202