Depth Superresolution using Motion Adaptive Regularization

Spatial resolution of depth sensors is often significantly lower compared to that of conventional optical cameras. Recent work has explored the idea of improving the resolution of depth using higher resolution intensity as a side information. In this paper, we demonstrate that further incorporating temporal information in videos can significantly improve the results. In particular, we propose a novel approach that improves depth resolution, exploiting the space-time redundancy in the depth and intensity using motion-adaptive low-rank regularization. Experiments confirm that the proposed approach substantially improves the quality of the estimated high-resolution depth. Our approach can be a first component in systems using vision techniques that rely on high resolution depth information

Complementary Time-Frequency Domain Networks for Dynamic Parallel MR Image Reconstruction

Purpose: To introduce a novel deep learning based approach for fast and high-quality dynamic multi-coil MR reconstruction by learning a complementary time-frequency domain network that exploits spatio-temporal correlations simultaneously from complementary domains. Theory and Methods: Dynamic parallel MR image reconstruction is formulated as a multi-variable minimisation problem, where the data is regularised in combined temporal Fourier and spatial (x-f) domain as well as in spatio-temporal image (x-t) domain. An iterative algorithm based on variable splitting technique is derived, which alternates among signal de-aliasing steps in x-f and x-t spaces, a closed-form point-wise data consistency step and a weighted coupling step. The iterative model is embedded into a deep recurrent neural network which learns to recover the image via exploiting spatio-temporal redundancies in complementary domains. Results: Experiments were performed on two datasets of highly undersampled multi-coil short-axis cardiac cine MRI scans. Results demonstrate that our proposed method outperforms the current state-of-the-art approaches both quantitatively and qualitatively. The proposed model can also generalise well to data acquired from a different scanner and data with pathologies that were not seen in the training set. Conclusion: The work shows the benefit of reconstructing dynamic parallel MRI in complementary time-frequency domains with deep neural networks. The method can effectively and robustly reconstruct high-quality images from highly undersampled dynamic multi-coil data ($16 \times$ and $24 \times$ yielding 15s and 10s scan times respectively) with fast reconstruction speed (2.8s). This could potentially facilitate achieving fast single-breath-hold clinical 2D cardiac cine imaging.Comment: Accepted by Magnetic Resonance in Medicin

Advanced H-1 Lung Magnetic Resonance Imaging

Magnetic resonance imaging (MRI) is one of the widely used medical imaging modality, since it can provide both structural and functional assessment in a single imaging session. However, two major challenges should be considered by using MRI for lung imaging. The first challenge is the intrinsic low SNR of H-1 lung MRI due to the low proton density as well as the fast decay of the lung parenchyma signal. And the second challenge is subject motion. To achieve high resolution structural image, MRI requires a long scan time, usually a few minutes or even longer, which make MRI sensitive to subject motion. To address the first challenge, ultra-short echo time (UTE) MRI sequence is used to capture the lung parenchyma signal before decay. As for subject motion, two major strategies are widely used. One strategy is fast breath-holding scan, the subjects are asked to hold their breaths for a short duration, and the fast 3D MR sequence would be used to acquire data within that duration. This dissertation proposes a new acquisition scheme based on the standard UTE sequence, which largely increases the encoding efficiency and improves the breath-holding scan images. The other is free breathing scan with motion correction. The subjects are allowed to breathe during the MR acquisition. After the acquisition, the motion corrupted data would go through the motion correction step to reconstruct the motion free images. In this dissertation, two novel motion corrected reconstruction strategies are proposed to incorporate the motion modeling and compensation into the reconstruction to get high SNR motion corrected 3D and 4D images. When translating the developed techniques to the clinical studies, specifically for pediatric and neonatal studies, more practical problems need to be considered, such as smaller but finer anatomy to image, the different respiratory patterns of the young subjects etc. This dissertation proposes a 5-minute free breathing UTE MRI strategy to achieve a 3D high resolution motion free lung image for pediatric and neonatal studies