2 research outputs found
Temporal Interpolation via Motion Field Prediction
Navigated 2D multi-slice dynamic Magnetic Resonance (MR) imaging enables high
contrast 4D MR imaging during free breathing and provides in-vivo observations
for treatment planning and guidance. Navigator slices are vital for
retrospective stacking of 2D data slices in this method. However, they also
prolong the acquisition sessions. Temporal interpolation of navigator slices an
be used to reduce the number of navigator acquisitions without degrading
specificity in stacking. In this work, we propose a convolutional neural
network (CNN) based method for temporal interpolation via motion field
prediction. The proposed formulation incorporates the prior knowledge that a
motion field underlies changes in the image intensities over time. Previous
approaches that interpolate directly in the intensity space are prone to
produce blurry images or even remove structures in the images. Our method
avoids such problems and faithfully preserves the information in the image.
Further, an important advantage of our formulation is that it provides an
unsupervised estimation of bi-directional motion fields. We show that these
motion fields can be used to halve the number of registrations required during
4D reconstruction, thus substantially reducing the reconstruction time.Comment: Submitted to 1st Conference on Medical Imaging with Deep Learning
(MIDL 2018), Amsterdam, The Netherland
A Spatiotemporal Volumetric Interpolation Network for 4D Dynamic Medical Image
Dynamic medical imaging is usually limited in application due to the large
radiation doses and longer image scanning and reconstruction times. Existing
methods attempt to reduce the dynamic sequence by interpolating the volumes
between the acquired image volumes. However, these methods are limited to
either 2D images and/or are unable to support large variations in the motion
between the image volume sequences. In this paper, we present a spatiotemporal
volumetric interpolation network (SVIN) designed for 4D dynamic medical images.
SVIN introduces dual networks: first is the spatiotemporal motion network that
leverages the 3D convolutional neural network (CNN) for unsupervised parametric
volumetric registration to derive spatiotemporal motion field from two-image
volumes; the second is the sequential volumetric interpolation network, which
uses the derived motion field to interpolate image volumes, together with a new
regression-based module to characterize the periodic motion cycles in
functional organ structures. We also introduce an adaptive multi-scale
architecture to capture the volumetric large anatomy motions. Experimental
results demonstrated that our SVIN outperformed state-of-the-art temporal
medical interpolation methods and natural video interpolation methods that have
been extended to support volumetric images. Our ablation study further
exemplified that our motion network was able to better represent the large
functional motion compared with the state-of-the-art unsupervised medical
registration methods.Comment: 10 pages, 8 figures, Conference on Computer Vision and Pattern
Recognition (CVPR) 202