Fast-MC-PET: A Novel Deep Learning-aided Motion Correction and Reconstruction Framework for Accelerated PET

Patient motion during PET is inevitable. Its long acquisition time not only increases the motion and the associated artifacts but also the patient's discomfort, thus PET acceleration is desirable. However, accelerating PET acquisition will result in reconstructed images with low SNR, and the image quality will still be degraded by motion-induced artifacts. Most of the previous PET motion correction methods are motion type specific that require motion modeling, thus may fail when multiple types of motion present together. Also, those methods are customized for standard long acquisition and could not be directly applied to accelerated PET. To this end, modeling-free universal motion correction reconstruction for accelerated PET is still highly under-explored. In this work, we propose a novel deep learning-aided motion correction and reconstruction framework for accelerated PET, called Fast-MC-PET. Our framework consists of a universal motion correction (UMC) and a short-to-long acquisition reconstruction (SL-Reon) module. The UMC enables modeling-free motion correction by estimating quasi-continuous motion from ultra-short frame reconstructions and using this information for motion-compensated reconstruction. Then, the SL-Recon converts the accelerated UMC image with low counts to a high-quality image with high counts for our final reconstruction output. Our experimental results on human studies show that our Fast-MC-PET can enable 7-fold acceleration and use only 2 minutes acquisition to generate high-quality reconstruction images that outperform/match previous motion correction reconstruction methods using standard 15 minutes long acquisition data.Comment: Accepted at Information Processing in Medical Imaging (IPMI 2023

Quantitative PET image reconstruction employing nested expectation-maximization deconvolution for motion compensation

Bulk body motion may randomly occur during PET acquisitions introducing blurring, attenuation-emission mismatches and, in dynamic PET, discontinuities in the measured time activity curves between consecutive frames. Meanwhile, dynamic PET scans are longer, thus increasing the probability of bulk motion. In this study, we propose a streamlined 3D PET motion-compensated image reconstruction (3D-MCIR) framework, capable of robustly deconvolving intra-frame motion from a static or dynamic 3D sinogram. The presented 3D-MCIR methods need not partition the data into multiple gates, such as 4D MCIR algorithms, or access list-mode (LM) data, such as LM MCIR methods, both associated with increased computation or memory resources. The proposed algorithms can support compensation for any periodic and non-periodic motion, such as cardio-respiratory or bulk motion, the latter including rolling, twisting or drifting. Inspired from the widely adopted point-spread function (PSF) deconvolution 3D PET reconstruction techniques, here we introduce an image-based 3D generalized motion deconvolution method within the standard 3D maximum-likelihood expectation-maximization (ML-EM) reconstruction framework. In particular, we initially integrate a motion blurring kernel, accounting for every tracked motion within a frame, as an additional MLEM modeling component in the image space (integrated 3D-MCIR). Subsequently, we replaced the integrated model component with a nested iterative Richardson-Lucy (RL) image-based deconvolution method to accelerate the MLEM algorithm convergence rate (RL-3D-MCIR). The final method was evaluated with realistic simulations of whole-body dynamic PET data employing the XCAT phantom and real human bulk motion profiles, the latter estimated from volunteer dynamic MRI scans. In addition, metabolic uptake rate Ki parametric images were generated with the standard Patlak method. Our results demonstrate significant improvement in contrast-to-noise ratio (CNR) and noise-bias performance in both dynamic and parametric images. The proposed nested RL-3D-MCIR method is implemented on the Software for Tomographic Image Reconstruction (STIR) open-source platform and is scheduled for public release

Event-by-event non-rigid data-driven PET respiratory motion correction methods: comparison of principal component analysis and centroid of distribution

Respiratory motion is a major cause of degradation of PET image quality. Respiratory gating and motion correction can be performed to reduce the effects of respiratory motion; these methods require motion information, typically obtained from external tracking systems. Various groups have studied data-driven (DD) motion estimation methods. Recently, a data-driven respiratory motion estimation method was established by calculating the centroid of distribution (COD) of listmode events, which was then used with event-by-event respiratory motion correction (EBE-MC), and showed results comparable to those with an external motion tracking device. The EBE-MC method only corrected for rigid motion, so that non-rigid components still contributed to motion-induced blurring. A nonrigid respiratory motion correction (NRMC) was later developed to overcome this problem, but was only evaluated using signal from an external monitor. Thus, it is desirable to further develop data-driven to achieve the best respiratory motion correction results. 
 We evaluated 2 data-driven respiratory motion detection methods, COD and Principal Component Analysis (PCA), by comparing the extracted motion trace to that acquired by the Anzai system in dynamic studies with two tracers. PCA was chosen as a preliminary study indicated that it produced stable results than other DD methods. We then developed and performed DD-EBE-NRMC using either COD- or PCA-derived respiratory motion information. Data-driven correction results were compared with Anzai-based results. For all tested studies, both COD and PCA showed good-to-excellent match with Anzai signals, with PCA showing a higher correlation with Anzai signals. The DD-EBE-NRMC results showed that both COD and PCA provide comparable image quality improvement as the Anzai-based correction. Although COD showed a lower correlation with Anzai than PCA, COD-based NRMC results are comparable to those of PCA, both of which showed great reduction in motion-induced blurring

Respiratory Motion Correction in Dynamic PET with a Single Attenuation Map

In addition to static tracer uptake values used routinely in clinical facilities, PET imaging can provide useful information on tracer kinetics via the use of dynamic acquisitions where a set of time frames are acquired starting from the injection/inhalation of the radiotracer. In lung studies, kinetic parameters, estimated from compartmental modelling, are however affected by respiratory motion. When only one attenuation image is available, most existing motion compensation strategies are not appropriate for the initial short time frames, especially as the activity distribution changes rapidly over the early part of the dynamic acquisition. This work presents a preliminary study to handle respiratory motion using a two-step process that uses gated dynamic data as input. We first use joint reconstruction of activity and motion on the entire gated PET data to estimate deformation fields. This allows the subsequent reconstruction of each time frame separately with motion compensation. We present results comparing on one hand the compartment model fit residuals with and without respiratory motion compensation and on the other hand the diaphragm position in non-attenuation corrected images and from this method

Improving the Accuracy of CT-derived Attenuation Correction in Respiratory-Gated PET/CT Imaging

The effect of respiratory motion on attenuation correction in Fludeoxyglucose (18F) positron emission tomography (FDG-PET) was investigated. Improvements to the accuracy of computed tomography (CT) derived attenuation correction were obtained through the alignment of the attenuation map to each emission image in a respiratory gated PET scan. Attenuation misalignment leads to artefacts in the reconstructed PET image and several methods were devised for evaluating the attenuation inaccuracies caused by this. These methods of evaluation were extended to finding the frame in the respiratory gated PET which best matched the CT. This frame was then used as a reference frame in mono-modality compensation for misalignment. Attenuation correction was found to affect the quantification of tumour volumes; thus a regional analysis was used to evaluate the impact of mismatch and the benefits of compensating for misalignment. Deformable image registration was used to compensate for misalignment, however, there were inaccuracies caused by the poor signal-to-noise ratio (SNR) in PET images. Two models were developed that were robust to a poor SNR allowing for the estimation of deformation from very noisy images. Firstly, a cross population model was developed by statistically analysing the respiratory motion in 10 4DCT scans. Secondly, a 1D model of respiration was developed based on the physiological function of respiration. The 1D approach correctly modelled the expansion and contraction of the lungs and the differences in the compressibility of lungs and surrounding tissues. Several additional models were considered but were ruled out based on their poor goodness of fit to 4DCT scans. Approaches to evaluating the developed models were also used to assist with optimising for the most accurate attenuation correction. It was found that the multimodality registration of the CT image to the PET image was the most accurate approach to compensating for attenuation correction mismatch. Mono-modality image registration was found to be the least accurate approach, however, incorporating a motion model improved the accuracy of image registration. The significance of these findings is twofold. Firstly, it was found that motion models are required to improve the accuracy in compensating for attenuation correction mismatch and secondly, a validation method was found for comparing approaches to compensating for attenuation mismatch

Improving the Accuracy of CT-derived Attenuation Correction in Respiratory-Gated PET/CT Imaging

The effect of respiratory motion on attenuation correction in Fludeoxyglucose (18F) positron emission tomography (FDG-PET) was investigated. Improvements to the accuracy of computed tomography (CT) derived attenuation correction were obtained through the alignment of the attenuation map to each emission image in a respiratory gated PET scan. Attenuation misalignment leads to artefacts in the reconstructed PET image and several methods were devised for evaluating the attenuation inaccuracies caused by this. These methods of evaluation were extended to finding the frame in the respiratory gated PET which best matched the CT. This frame was then used as a reference frame in mono-modality compensation for misalignment. Attenuation correction was found to affect the quantification of tumour volumes; thus a regional analysis was used to evaluate the impact of mismatch and the benefits of compensating for misalignment. Deformable image registration was used to compensate for misalignment, however, there were inaccuracies caused by the poor signal-to-noise ratio (SNR) in PET images. Two models were developed that were robust to a poor SNR allowing for the estimation of deformation from very noisy images. Firstly, a cross population model was developed by statistically analysing the respiratory motion in 10 4DCT scans. Secondly, a 1D model of respiration was developed based on the physiological function of respiration. The 1D approach correctly modelled the expansion and contraction of the lungs and the differences in the compressibility of lungs and surrounding tissues. Several additional models were considered but were ruled out based on their poor goodness of fit to 4DCT scans. Approaches to evaluating the developed models were also used to assist with optimising for the most accurate attenuation correction. It was found that the multimodality registration of the CT image to the PET image was the most accurate approach to compensating for attenuation correction mismatch. Mono-modality image registration was found to be the least accurate approach, however, incorporating a motion model improved the accuracy of image registration. The significance of these findings is twofold. Firstly, it was found that motion models are required to improve the accuracy in compensating for attenuation correction mismatch and secondly, a validation method was found for comparing approaches to compensating for attenuation mismatch

Developments in PET-MRI for Radiotherapy Planning Applications

The hybridization of magnetic resonance imaging (MRI) and positron emission tomography (PET) provides the benefit of soft-tissue contrast and specific molecular information in a simultaneous acquisition. The applications of PET-MRI in radiotherapy are only starting to be realised. However, quantitative accuracy of PET relies on accurate attenuation correction (AC) of, not only the patient anatomy but also MRI hardware and current methods, which are prone to artefacts caused by dense materials. Quantitative accuracy of PET also relies on full characterization of patient motion during the scan. The simultaneity of PET-MRI makes it especially suited for motion correction. However, quality assurance (QA) procedures for such corrections are lacking. Therefore, a dynamic phantom that is PET and MR compatible is required. Additionally, respiratory motion characterization is needed for conformal radiotherapy of lung. 4D-CT can provide 3D motion characterization but suffers from poor soft-tissue contrast. In this thesis, I examine these problems, and present solutions in the form of improved MR-hardware AC techniques, a PET/MRI/CT-compatible tumour respiratory motion phantom for QA measurements, and a retrospective 4D-PET-MRI technique to characterise respiratory motion. Chapter 2 presents two techniques to improve upon current AC methods that use a standard helical CT scan for MRI hardware in PET-MRI. One technique uses a dual-energy computed tomography (DECT) scan to construct virtual monoenergetic image volumes and the other uses a tomotherapy linear accelerator to create CT images at megavoltage energies (1.0 MV) of the RF coil. The DECT-based technique reduced artefacts in the images translating to improved μ-maps. The MVCT-based technique provided further improvements in artefact reduction, resulting in artefact free μ-maps. This led to more AC of the breast coil. In chapter 3, I present a PET-MR-CT motion phantom for QA of motion-correction protocols. This phantom is used to evaluate a clinically available real-time dynamic MR images and a respiratory-triggered PET-MRI protocol. The results show the protocol to perform well under motion conditions. Additionally, the phantom provided a good model for performing QA of respiratory-triggered PET-MRI. Chapter 4 presents a 4D-PET/MRI technique, using MR sequences and PET acquisition methods currently available on hybrid PET/MRI systems. This technique is validated using the motion phantom presented in chapter 3 with three motion profiles. I conclude that our 4D-PET-MRI technique provides information to characterise tumour respiratory motion while using a clinically available pulse sequence and PET acquisition method

Synthesis of Realistic Simultaneous Positron Emission Tomography and Magnetic Resonance Imaging Data

The investigation of the performance of different positron emission tomography (PET) reconstruction and motion compensation methods requires accurate and realistic representation of the anatomy and motion trajectories as observed in real subjects during acquisitions. The generation of well-controlled clinical datasets is difficult due to the many different clinical protocols, scanner specifications, patient sizes, and physiological variations. Alternatively, computational phantoms can be used to generate large data sets for different disease states, providing a ground truth. Several studies use registration of dynamic images to derive voxel deformations to create moving computational phantoms. These phantoms together with simulation software generate raw data. This paper proposes a method for the synthesis of dynamic PET data using a fast analytic method. This is achieved by incorporating realistic models of respiratory motion into a numerical phantom to generate datasets with continuous and variable motion with magnetic resonance imaging (MRI)-derived motion modeling and high resolution MRI images. In this paper, data sets for two different clinical traces are presented, ¹⁸F-FDG and ⁶⁸Ga-PSMA. This approach incorporates realistic models of respiratory motion to generate temporally and spatially correlated MRI and PET data sets, as those expected to be obtained from simultaneous PET-MRI acquisitions

System matrix modeling of externally tracked motion

Background and aim In high-resolution emission tomography imaging, even small patient movements can considerably degrade image quality. The aim of this work was to develop a general approach to motion-corrected reconstruction of motion-contaminated data in the case of rigid motion (particularly brain imaging) which would be applicable to any PET scanner in the field, without specialized data-acquisition requirements. Methods Assuming the ability to externally track subject motion during scanning (e.g., using the Polaris camera), we proposed to incorporate the measured rigid motion information into the system matrix of the expectation maximization reconstruction algorithm. Furthermore, we noted and developed a framework to incorporate the additional effect of motion on modifying the attenuation factors. A new mathematical brain phantom was developed and used along with elaborate combined Simset/GATE simulations to compare the proposed framework with the cases of no motion correction. Results and conclusion Clear qualitative and quantitative improvements were observed when incorporating the proposed framework. The method is very practical to implement for any scanner in the field, not requiring any hardware modifications or access to the list-mode acquisition capability

PET Respiratory Motion Correction in Simultaneous PET/MR

In Positron Emission Tomography (PET) imaging, patient motion due to respiration can lead to artefacts and blurring, in addition to quantification errors. The integration of PET imaging with Magnetic Resonance (MR) imaging in PET/MR scanners provides spatially aligned complementary clinical information, and allows the use of high spatial resolution and high contrast MR images to monitor and correct motion-corrupted PET data. In this thesis, we form a methodology for respiratory motion correction of PET data, and show it can improve PET image quality. The approach is practical, having minimal impact on clinical PET/MR protocols, with no need for external respiratory monitoring, using standard MR sequences and minimal extra acquisition time. First we validate the use of PET-derived respiratory signal to use for motion tracking, that uses raw PET data only, via Principal Component Analysis (PCA), then set up the tools to carry out PET Motion Compensated Image Reconstruction (MCIR). We introduce a joint PET-MR motion model, using one minute of PET and MR data to provide a motion model that captures inter-cycle and intra-cycle breathing variations. Different motion models (one/two surrogates, linear/polynomial) are evaluated on dynamic MR data sets. Finally we apply the methodology on 45 clinical PET-MR patient datasets. Qualitative PET reconstruction improvements and artefact reduction are assessed with visual analysis, and quantitative improvements are calculated using Standardised Uptake Value (SUV) changes in avid lesions. Lesion detectability changes are explored with a study where two radiologists identify lesions or ’hot spots’, with confidence levels, in uncorrected and motion-corrected images. In summary, we developed a methodology for motion correction in PET/MR by using a joint motion model and demonstrated the capability of a joint PET-MR motion model to predict respiratory motion by showing significantly improved image quality of PET data, with one minute of extra scan time, and no external hardware