IMAGE-BASED RESPIRATORY MOTION EXTRACTION AND RESPIRATION-CORRELATED CONE BEAM CT (4D-CBCT) RECONSTRUCTION

Accounting for respiration motion during imaging helps improve targeting precision in radiation therapy. Respiratory motion can be a major source of error in determining the position of thoracic and upper abdominal tumor targets during radiotherapy. Thus, extracting respiratory motion is a key task in radiation therapy planning. Respiration-correlated or four-dimensional CT (4DCT) imaging techniques have been recently integrated into imaging systems for verifying tumor position during treatment and managing respiration-induced tissue motion. The quality of the 4D reconstructed volumes is highly affected by the respiratory signal extracted and the phase sorting method used. This thesis is divided into two parts. In the first part, two image-based respiratory signal extraction methods are proposed and evaluated. Those methods are able to extract the respiratory signals from CBCT images without using external sources, implanted markers or even dependence on any structure in the images such as the diaphragm. The first method, called Local Intensity Feature Tracking (LIFT), extracts the respiratory signal depending on feature points extracted and tracked through the sequence of projections. The second method, called Intensity Flow Dimensionality Reduction (IFDR), detects the respiration signal by computing the optical flow motion of every pixel in each pair of adjacent projections. Then, the motion variance in the optical flow dataset is extracted using linear and non-linear dimensionality reduction techniques to represent a respiratory signal. Experiments conducted on clinical datasets showed that the respiratory signal was successfully extracted using both proposed methods and it correlates well with standard respiratory signals such as diaphragm position and the internal markers’ signal. In the second part of this thesis, 4D-CBCT reconstruction based on different phase sorting techniques is studied. The quality of the 4D reconstructed images is evaluated and compared for different phase sorting methods such as internal markers, external markers and image-based methods (LIFT and IFDR). Also, a method for generating additional projections to be used in 4D-CBCT reconstruction is proposed to reduce the artifacts that result when reconstructing from an insufficient number of projections. Experimental results showed that the feasibility of the proposed method in recovering the edges and reducing the streak artifacts

Super-resolution T2-weighted 4D MRI for image guided radiotherapy.

BACKGROUND AND PURPOSE:The superior soft-tissue contrast of 4D-T2w MRI motivates its use for delineation in radiotherapy treatment planning. We address current limitations of slice-selective implementations, including thick slices and artefacts originating from data incompleteness and variable breathing. MATERIALS AND METHODS:A method was developed to calculate midposition and 4D-T2w images of the whole thorax from continuously acquired axial and sagittal 2D-T2w MRI (1.5 × 1.5 × 5.0 mm3). The method employed image-derived respiratory surrogates, deformable image registration and super-resolution reconstruction. Volunteer imaging and a respiratory motion phantom were used for validation. The minimum number of dynamic acquisitions needed to calculate a representative midposition image was investigated by retrospectively subsampling the data (10-30 dynamic acquisitions). RESULTS:Super-resolution 4D-T2w MRI (1.0 × 1.0 × 1.0 mm3, 8 respiratory phases) did not suffer from data incompleteness and exhibited reduced stitching artefacts compared to sorted multi-slice MRI. Experiments using a respiratory motion phantom and colour-intensity projection images demonstrated a minor underestimation of the motion range. Midposition diaphragm differences in retrospectively subsampled acquisitions were <1.1 mm compared to the full dataset. 10 dynamic acquisitions were found sufficient to generate midposition MRI. CONCLUSIONS:A motion-modelling and super-resolution method was developed to calculate high quality 4D/midposition T2w MRI from orthogonal 2D-T2w MRI

Respiratory organ motion in interventional MRI : tracking, guiding and modeling

Respiratory organ motion is one of the major challenges in interventional MRI, particularly in interventions with therapeutic ultrasound in the abdominal region. High-intensity focused ultrasound found an application in interventional MRI for noninvasive treatments of different abnormalities. In order to guide surgical and treatment interventions, organ motion imaging and modeling is commonly required before a treatment start. Accurate tracking of organ motion during various interventional MRI procedures is prerequisite for a successful outcome and safe therapy. In this thesis, an attempt has been made to develop approaches using focused ultrasound which could be used in future clinically for the treatment of abdominal organs, such as the liver and the kidney. Two distinct methods have been presented with its ex vivo and in vivo treatment results. In the first method, an MR-based pencil-beam navigator has been used to track organ motion and provide the motion information for acoustic focal point steering, while in the second approach a hybrid imaging using both ultrasound and magnetic resonance imaging was combined for advanced guiding capabilities. Organ motion modeling and four-dimensional imaging of organ motion is increasingly required before the surgical interventions. However, due to the current safety limitations and hardware restrictions, the MR acquisition of a time-resolved sequence of volumetric images is not possible with high temporal and spatial resolution. A novel multislice acquisition scheme that is based on a two-dimensional navigator, instead of a commonly used pencil-beam navigator, was devised to acquire the data slices and the corresponding navigator simultaneously using a CAIPIRINHA parallel imaging method. The acquisition duration for four-dimensional dataset sampling is reduced compared to the existing approaches, while the image contrast and quality are improved as well. Tracking respiratory organ motion is required in interventional procedures and during MR imaging of moving organs. An MR-based navigator is commonly used, however, it is usually associated with image artifacts, such as signal voids. Spectrally selective navigators can come in handy in cases where the imaging organ is surrounding with an adipose tissue, because it can provide an indirect measure of organ motion. A novel spectrally selective navigator based on a crossed-pair navigator has been developed. Experiments show the advantages of the application of this novel navigator for the volumetric imaging of the liver in vivo, where this navigator was used to gate the gradient-recalled echo sequence

Developments in PET-MRI for Radiotherapy Planning Applications

The hybridization of magnetic resonance imaging (MRI) and positron emission tomography (PET) provides the benefit of soft-tissue contrast and specific molecular information in a simultaneous acquisition. The applications of PET-MRI in radiotherapy are only starting to be realised. However, quantitative accuracy of PET relies on accurate attenuation correction (AC) of, not only the patient anatomy but also MRI hardware and current methods, which are prone to artefacts caused by dense materials. Quantitative accuracy of PET also relies on full characterization of patient motion during the scan. The simultaneity of PET-MRI makes it especially suited for motion correction. However, quality assurance (QA) procedures for such corrections are lacking. Therefore, a dynamic phantom that is PET and MR compatible is required. Additionally, respiratory motion characterization is needed for conformal radiotherapy of lung. 4D-CT can provide 3D motion characterization but suffers from poor soft-tissue contrast. In this thesis, I examine these problems, and present solutions in the form of improved MR-hardware AC techniques, a PET/MRI/CT-compatible tumour respiratory motion phantom for QA measurements, and a retrospective 4D-PET-MRI technique to characterise respiratory motion. Chapter 2 presents two techniques to improve upon current AC methods that use a standard helical CT scan for MRI hardware in PET-MRI. One technique uses a dual-energy computed tomography (DECT) scan to construct virtual monoenergetic image volumes and the other uses a tomotherapy linear accelerator to create CT images at megavoltage energies (1.0 MV) of the RF coil. The DECT-based technique reduced artefacts in the images translating to improved μ-maps. The MVCT-based technique provided further improvements in artefact reduction, resulting in artefact free μ-maps. This led to more AC of the breast coil. In chapter 3, I present a PET-MR-CT motion phantom for QA of motion-correction protocols. This phantom is used to evaluate a clinically available real-time dynamic MR images and a respiratory-triggered PET-MRI protocol. The results show the protocol to perform well under motion conditions. Additionally, the phantom provided a good model for performing QA of respiratory-triggered PET-MRI. Chapter 4 presents a 4D-PET/MRI technique, using MR sequences and PET acquisition methods currently available on hybrid PET/MRI systems. This technique is validated using the motion phantom presented in chapter 3 with three motion profiles. I conclude that our 4D-PET-MRI technique provides information to characterise tumour respiratory motion while using a clinically available pulse sequence and PET acquisition method

Validating and improving CT ventilation imaging by correlating with ventilation 4D-PET/CT using 68Ga-labeled nanoparticles.

PURPOSE: CT ventilation imaging is a novel functional lung imaging modality based on deformable image registration. The authors present the first validation study of CT ventilation using positron emission tomography with (68)Ga-labeled nanoparticles (PET-Galligas). The authors quantify this agreement for different CT ventilation metrics and PET reconstruction parameters. METHODS: PET-Galligas ventilation scans were acquired for 12 lung cancer patients using a four-dimensional (4D) PET/CT scanner. CT ventilation images were then produced by applying B-spline deformable image registration between the respiratory correlated phases of the 4D-CT. The authors test four ventilation metrics, two existing and two modified. The two existing metrics model mechanical ventilation (alveolar air-flow) based on Hounsfield unit (HU) change (VHU) or Jacobian determinant of deformation (VJac). The two modified metrics incorporate a voxel-wise tissue-density scaling (ρVHU and ρVJac) and were hypothesized to better model the physiological ventilation. In order to assess the impact of PET image quality, comparisons were performed using both standard and respiratory-gated PET images with the former exhibiting better signal. Different median filtering kernels (σm = 0 or 3 mm) were also applied to all images. As in previous studies, similarity metrics included the Spearman correlation coefficient r within the segmented lung volumes, and Dice coefficient d20 for the (0 - 20)th functional percentile volumes. RESULTS: The best agreement between CT and PET ventilation was obtained comparing standard PET images to the density-scaled HU metric (ρVHU) with σm = 3 mm. This leads to correlation values in the ranges 0.22 ≤ r ≤ 0.76 and 0.38 ≤ d20 ≤ 0.68, with r = 0.42 ± 0.16 and d20 = 0.52 ± 0.09 averaged over the 12 patients. Compared to Jacobian-based metrics, HU-based metrics lead to statistically significant improvements in r and d20 (p < 0.05), with density scaled metrics also showing higher r than for unscaled versions (p < 0.02). r and d20 were also sensitive to image quality, with statistically significant improvements using standard (as opposed to gated) PET images and with application of median filtering. CONCLUSIONS: The use of modified CT ventilation metrics, in conjunction with PET-Galligas and careful application of image filtering has resulted in improved correlation compared to earlier studies using nuclear medicine ventilation. However, CT ventilation and PET-Galligas do not always provide the same functional information. The authors have demonstrated that the agreement can improve for CT ventilation metrics incorporating a tissue density scaling, and also with increasing PET image quality. CT ventilation imaging has clear potential for imaging regional air volume change in the lung, and further development is warranted

Registration based respiratory motion models for use in lung radiotherapy.

Respiratory motion is a major factor contributing to errors and uncertainties in Radiotherapy (RT) treatment of lung tumours. Knowledge of this motion may improve the planning and delivery of RT treatment for lung cancer patients. This thesis develops and evaluates methods of building patient specific respiratory motion models. These relate the internal motion to respiratory parameters derived from an external surrogate signal that can be measured during data acquisition and treatment delivery. The models offer a number of advantages over current methods of imaging and analysing respiratory motion, in particular their ability to account for variations in the respiratory motion. Computer Tomography (CT) data is acquired over several respiratory cycles to sample some of the variation in the respiratory motion. B-spline registrations are used to recover the motion and deformation from the CT data. The models are then constructed by fitting functions that relate the registration results to the respiratory parameters. This thesis describes the CT data and respiratory parameters that have been used to construct the motion models. It details the registrations protocols used and evaluates their results. The initial models presented in the thesis relate the registration results to a single parameter, the phase of the respiratory cycle, and average out any variation in the respiratory motion. The later models relate the registration results to two respiratory parameters, with the intention of modelling some of the variation. A number of different functions are assessed for both the single and two parameter models. The results show that the models can predict the respiratory motion in the CT data very accurately (mean error < 1.4 mm). This thesis also discusses some of the uses of the motion models in RT and, in particular, explores the use of the motion models for 'tracking' respiratory motion while delivering intensity modulated RT.

Improving the Accuracy of CT-derived Attenuation Correction in Respiratory-Gated PET/CT Imaging

The effect of respiratory motion on attenuation correction in Fludeoxyglucose (18F) positron emission tomography (FDG-PET) was investigated. Improvements to the accuracy of computed tomography (CT) derived attenuation correction were obtained through the alignment of the attenuation map to each emission image in a respiratory gated PET scan. Attenuation misalignment leads to artefacts in the reconstructed PET image and several methods were devised for evaluating the attenuation inaccuracies caused by this. These methods of evaluation were extended to finding the frame in the respiratory gated PET which best matched the CT. This frame was then used as a reference frame in mono-modality compensation for misalignment. Attenuation correction was found to affect the quantification of tumour volumes; thus a regional analysis was used to evaluate the impact of mismatch and the benefits of compensating for misalignment. Deformable image registration was used to compensate for misalignment, however, there were inaccuracies caused by the poor signal-to-noise ratio (SNR) in PET images. Two models were developed that were robust to a poor SNR allowing for the estimation of deformation from very noisy images. Firstly, a cross population model was developed by statistically analysing the respiratory motion in 10 4DCT scans. Secondly, a 1D model of respiration was developed based on the physiological function of respiration. The 1D approach correctly modelled the expansion and contraction of the lungs and the differences in the compressibility of lungs and surrounding tissues. Several additional models were considered but were ruled out based on their poor goodness of fit to 4DCT scans. Approaches to evaluating the developed models were also used to assist with optimising for the most accurate attenuation correction. It was found that the multimodality registration of the CT image to the PET image was the most accurate approach to compensating for attenuation correction mismatch. Mono-modality image registration was found to be the least accurate approach, however, incorporating a motion model improved the accuracy of image registration. The significance of these findings is twofold. Firstly, it was found that motion models are required to improve the accuracy in compensating for attenuation correction mismatch and secondly, a validation method was found for comparing approaches to compensating for attenuation mismatch

Improving the Accuracy of CT-derived Attenuation Correction in Respiratory-Gated PET/CT Imaging

The effect of respiratory motion on attenuation correction in Fludeoxyglucose (18F) positron emission tomography (FDG-PET) was investigated. Improvements to the accuracy of computed tomography (CT) derived attenuation correction were obtained through the alignment of the attenuation map to each emission image in a respiratory gated PET scan. Attenuation misalignment leads to artefacts in the reconstructed PET image and several methods were devised for evaluating the attenuation inaccuracies caused by this. These methods of evaluation were extended to finding the frame in the respiratory gated PET which best matched the CT. This frame was then used as a reference frame in mono-modality compensation for misalignment. Attenuation correction was found to affect the quantification of tumour volumes; thus a regional analysis was used to evaluate the impact of mismatch and the benefits of compensating for misalignment. Deformable image registration was used to compensate for misalignment, however, there were inaccuracies caused by the poor signal-to-noise ratio (SNR) in PET images. Two models were developed that were robust to a poor SNR allowing for the estimation of deformation from very noisy images. Firstly, a cross population model was developed by statistically analysing the respiratory motion in 10 4DCT scans. Secondly, a 1D model of respiration was developed based on the physiological function of respiration. The 1D approach correctly modelled the expansion and contraction of the lungs and the differences in the compressibility of lungs and surrounding tissues. Several additional models were considered but were ruled out based on their poor goodness of fit to 4DCT scans. Approaches to evaluating the developed models were also used to assist with optimising for the most accurate attenuation correction. It was found that the multimodality registration of the CT image to the PET image was the most accurate approach to compensating for attenuation correction mismatch. Mono-modality image registration was found to be the least accurate approach, however, incorporating a motion model improved the accuracy of image registration. The significance of these findings is twofold. Firstly, it was found that motion models are required to improve the accuracy in compensating for attenuation correction mismatch and secondly, a validation method was found for comparing approaches to compensating for attenuation mismatch

Data-Efficient Machine Learning with Focus on Transfer Learning

Machine learning (ML) has attracted a significant amount of attention from the artifi- cial intelligence community. ML has shown state-of-art performance in various fields, such as signal processing, healthcare system, and natural language processing (NLP). However, most conventional ML algorithms suffer from three significant difficulties: 1) insufficient high-quality training data, 2) costly training process, and 3) domain dis- crepancy. Therefore, it is important to develop solutions for these problems, so the future of ML will be more sustainable. Recently, a new concept, data-efficient ma- chine learning (DEML), has been proposed to deal with the current bottlenecks of ML. Moreover, transfer learning (TL) has been considered as an effective solution to address the three shortcomings of conventional ML. Furthermore, TL is one of the most active areas in the DEML. Over the past ten years, significant progress has been made in TL. In this dissertation, I propose to address the three problems by developing a software- oriented framework and TL algorithms. Firstly, I introduce a DEML framework and a evaluation system. Moreover, I present two novel TL algorithms and applications on real-world problems. Furthermore, I will first present the first well-defined DEML framework and introduce how it can address the challenges in ML. After that, I will give an updated overview of the state-of-the-art and open challenges in the TL. I will then introduce two novel algorithms for two of the most challenging TL topics: distant domain TL and cross-modality TL (image-text). A detailed algorithm introduction and preliminary results on real-world applications (Covid-19 diagnosis and image clas- sification) will be presented. Then, I will discuss the current trends in TL algorithms and real-world applications. Lastly, I will present the conclusion and future research directions