Non-rigid 3D motion estimation at high temporal resolution from prospectively undersampled k-space data using low-rank MR-MOTUS

With the recent introduction of the MR-LINAC, an MR-scanner combined with a radiotherapy LINAC, MR-based motion estimation has become of increasing interest to (retrospectively) characterize tumor and organs-at-risk motion during radiotherapy. To this extent, we introduce low-rank MR-MOTUS, a framework to retrospectively reconstruct time-resolved non-rigid 3D+t motion-fields from a single low-resolution reference image and prospectively undersampled k-space data acquired during motion. Low-rank MR-MOTUS exploits spatio-temporal correlations in internal body motion with a low-rank motion model, and inverts a signal model that relates motion-fields directly to a reference image and k-space data. The low-rank model reduces the degrees-of-freedom, memory consumption and reconstruction times by assuming a factorization of space-time motion-fields in spatial and temporal components. Low-rank MR-MOTUS was employed to estimate motion in 2D/3D abdominothoracic scans and 3D head scans. Data were acquired using golden-ratio radial readouts. Reconstructed 2D and 3D respiratory motion-fields were respectively validated against time-resolved and respiratory-resolved image reconstructions, and the head motion against static image reconstructions from fully-sampled data acquired right before and right after the motion. Results show that 2D+t respiratory motion can be estimated retrospectively at 40.8 motion-fields-per-second, 3D+t respiratory motion at 7.6 motion-fields-per-second and 3D+t head-neck motion at 9.3 motion-fields-per-second. The validations show good consistency with image reconstructions. The proposed framework can estimate time-resolved non-rigid 3D motion-fields, which allows to characterize drifts and intra and inter-cycle patterns in breathing motion during radiotherapy, and could form the basis for real-time MR-guided radiotherapy.Comment: 18 pages main text, 8 main figures, 1 main table, 12 supporting videos, 2 supporting figures, 1 supporting information PDF. Submitted to Magnetic Resonance in Medicine as Full Pape

Gaussian Processes for real-time 3D motion and uncertainty estimation during MR-guided radiotherapy

Respiratory motion during radiotherapy causes uncertainty in the tumor's location, which is typically addressed by an increased radiation area and a decreased dose. As a result, the treatments' efficacy is reduced. The recently proposed hybrid MR-linac scanner holds the promise to efficiently deal with such respiratory motion through real-time adaptive MR-guided radiotherapy (MRgRT). For MRgRT, motion-fields should be estimated from MR-data and the radiotherapy plan should be adapted in real-time according to the estimated motion-fields. All of this should be performed with a total latency of maximally 200 ms, including data acquisition and reconstruction. A measure of confidence in such estimated motion-fields is highly desirable, for instance to ensure the patient's safety in case of unexpected and undesirable motion. In this work, we propose a framework based on Gaussian Processes to infer 3D motion-fields and uncertainty maps in real-time from only three readouts of MR-data. We demonstrated an inference frame rate up to 69 Hz including data acquisition and reconstruction, thereby exploiting the limited amount of required MR-data. Additionally, we designed a rejection criterion based on the motion-field uncertainty maps to demonstrate the framework's potential for quality assurance. The framework was validated in silico and in vivo on healthy volunteer data (n=5) acquired using an MR-linac, thereby taking into account different breathing patterns and controlled bulk motion. Results indicate end-point-errors with a 75th percentile below 1mm in silico, and a correct detection of erroneous motion estimates with the rejection criterion. Altogether, the results show the potential of the framework for application in real-time MR-guided radiotherapy with an MR-linac.Comment: This manuscript has supplementary files which can be downloaded at https://surfdrive.surf. nl/files/index.php/s/scLts9nJYXfbLMx. The files include videos that show reconstructed motion-fields and spatial uncertainty maps. See the Appendix for a description of all individual file

Spectro-Dynamic MRI: Characterizing Mechanical Systems on a Millisecond Scale

Measuring in vivo dynamics can yield valuable information for studying the functioning of the cardiovascular or the musculoskeletal system and for the diagnosis of related diseases. MRI is a powerful medical imaging modality, but it shows severe limitations when dealing with motion at high spatial and temporal resolutions. In this work, a method called spectro-dynamic MRI is proposed, which can identify dynamical information directly from k-space data. It combines a measurement model, relating the measured data in k-space to the displacement fields, and a dynamical model, introducing prior knowledge about the dynamics of a system. The data sampling process is tailored to compute spatial and temporal derivatives in the spectral domain at a high temporal resolution. Preliminary results from four simple pendulum setups for which the dynamics are explicitly known show that spectro-dynamic MRI can estimate motion fields from heavily undersampled data on a millisecond timescale. Furthermore, the length of the pendula and the stiffness of the spring can be identified as the dynamical system's parameters, giving additional information about the systems under investigation

⊥-loss: A symmetric loss function for magnetic resonance imaging reconstruction and image registration with deep learning

Convolutional neural networks (CNNs) are increasingly adopted in medical imaging, e.g., to reconstruct high-quality images from undersampled magnetic resonance imaging (MRI) acquisitions or estimate subject motion during an examination. MRI is naturally acquired in the complex domain C, obtaining magnitude and phase information in k-space. However, CNNs in complex regression tasks are almost exclusively trained to minimize the L2 loss or maximizing the magnitude structural similarity (SSIM), which are possibly not optimal as they do not take full advantage of the magnitude and phase information present in the complex domain. This work identifies that minimizing the L2 loss in the complex field has an asymmetry in the magnitude/phase loss landscape and is biased, underestimating the reconstructed magnitude. To resolve this, we propose a new loss function for regression in the complex domain called ⊥-loss, which adds a novel phase term to established magnitude loss functions, e.g., L2 or SSIM. We show ⊥-loss is symmetric in the magnitude/phase domain and has favourable properties when applied to regression in the complex domain. Specifically, we evaluate the ⊥+ℓ 2-loss and ⊥+SSIM-loss for complex undersampled MR image reconstruction tasks and MR image registration tasks. We show that training a model to minimize the ⊥+ℓ 2-loss outperforms models trained to minimize the L2 loss and results in similar performance compared to models trained to maximize the magnitude SSIM while offering high-quality phase reconstruction. Moreover, ⊥-loss is defined in R n, and we apply the loss function to the R 2 domain by learning 2D deformation vector fields for image registration. We show that a model trained to minimize the ⊥+ℓ 2-loss outperforms models trained to minimize the end-point error loss

Cartesian vs radial MR-STAT: An efficiency and robustness study

MR Spin TomogrAphy in Time-domain (“MR-STAT”) is quantitative MR technique in which multiple quantitative parameters are estimated from a single short scan by solving a large-scale non-linear optimization problem. In this work we extended the MR-STAT framework to non-Cartesian gradient trajectories. Cartesian MR-STAT and radial MR-STAT were compared in terms of time-efficiency and robustness in simulations, gel phantom measurements and in vivo measurements. In simulations, we observed that both Cartesian and radial MR-STAT are highly robust against undersampling. Radial MR-STAT does have a lower spatial encoding power because the outer corners of k-space are never sampled. However, especially in T2, this is compensated by a higher dynamic encoding power that comes from sampling the k-space center with each readout. In gel phantom measurements, Cartesian MR-STAT was observed to be robust against overfitting whereas radial MR-STAT suffered from high-frequency artefacts in the parameter maps at later iterations. These artefacts are hypothesized to be related to hardware imperfections and were (partially) suppressed with image filters. The time-efficiencies were higher for Cartesian MR-STAT in all vials. In-vivo, the radial reconstruction again suffered from overfitting artefacts. The robustness of Cartesian MR-STAT over the entire range of experiments may make it preferable in a clinical setting, despite radial MR-STAT resulting in a higher T1 time-efficiency in white matter

Static Future Technologies, Dynamic Professionalism : Co-creating Future Scenarios in Medical Imaging Practices

New magnetic resonance imaging (MRI) techniques that offer faster scanning and potential artificial intelligence-assisted interpretation and diagnosis can significantly impact existing workflows in radiology. In a qualitative study embedded within a responsible research and innovation design, we investigate the development and potential implementation of quantitative MRI. We aim to investigate postdigital MRI futures, covered by scenarios of potential workflows, as well as the resulting implications for professions and related education involved in the MRI process. Furthermore, we examine the related and changing responsibilities, more specifically reflecting on ‘forward-looking responsibilities’. Through expert interviews (n = 20) and a focus group, stakeholder perspectives on the future of quantitative imaging techniques were explored. During a subsequent co-creation workshop and another focus group, stakeholders reflected on future scenarios in quantitative MRI. Our study shows that a proactive and future-oriented investigation of the influence of emerging technologies on potential workflows and subsequent changes in expertise and roles help in gaining or increasing awareness about the wider impact of a technology developed to contribute to faster and quantitative MRI exams. We argue that anticipating postdigital worlds by reflecting on future responsibilities through the co-creation of imaginaries can help making uncertain futures tangible in other ways

GPU-accelerated Bloch simulations and MR-STAT reconstructions using the Julia programming language

PURPOSE: MR-STAT is a relatively new multiparametric quantitative MRI technique in which quantitative paramater maps are obtained by solving a large-scale nonlinear optimization problem. Managing reconstruction times is one of the main challenges of MR-STAT. In this work we leverage GPU hardware to reduce MR-STAT reconstruction times. A highly optimized, GPU-compatible Bloch simulation toolbox is developed as part of this work that can be utilized for other quantitative MRI techniques as well. METHODS: The Julia programming language was used to develop a flexible yet highly performant and GPU-compatible Bloch simulation toolbox called BlochSimulators.jl. The runtime performance of the toolbox is benchmarked against other Bloch simulation toolboxes. Furthermore, a (partially matrix-free) modification of a previously presented (matrix-free) MR-STAT reconstruction algorithm is proposed and implemented using the Julia language on GPU hardware. The proposed algorithm is combined with BlochSimulators.jl and the resulting MR-STAT reconstruction times on GPU hardware are compared to previously presented MR-STAT reconstruction times. RESULTS: The BlochSimulators.jl package demonstrates superior runtime performance on both CPU and GPU hardware when compared to other existing Bloch simulation toolboxes. The GPU-accelerated partially matrix-free MR-STAT reconstruction algorithm, which relies on BlochSimulators.jl, allows for reconstructions of 68 seconds per two-dimensional (2D slice). CONCLUSION: By combining the proposed Bloch simulation toolbox and the partially matrix-free reconstruction algorithm, 2D MR-STAT reconstructions can be performed in the order of one minute on a modern GPU card. The Bloch simulation toolbox can be utilized for other quantitative MRI techniques as well, for example for online dictionary generation for MR Fingerprinting

Time-Resolved Reconstruction of Motion, Force, and Stiffness Using Spectro-Dynamic MRI

Measuring the dynamics and mechanical properties of muscles and joints is important to understand the (patho)physiology of muscles. However, acquiring dynamic time-resolved MRI data is challenging. We have previously developed Spectro-Dynamic MRI which allows the characterization of dynamical systems at a high spatial and temporal resolution directly from k-space data. This work presents an extended Spectro-Dynamic MRI framework that reconstructs 1) time-resolved MR images, 2) time-resolved motion fields, 3) dynamical parameters, and 4) an activation force, at a temporal resolution of 11 ms. An iterative algorithm solves a minimization problem containing four terms: a motion model relating the motion to the fully-sampled k-space data, a dynamical model describing the expected type of dynamics, a data consistency term describing the undersampling pattern, and finally a regularization term for the activation force. We acquired MRI data using a dynamic motion phantom programmed to move like an actively driven linear elastic system, from which all dynamic variables could be accurately reconstructed, regardless of the sampling pattern. The proposed method performed better than a two-step approach, where time-resolved images were first reconstructed from the undersampled data without any information about the motion, followed by a motion estimation step