High-resolution self-gated dynamic abdominal MRI using manifold alignment

We present a novel retrospective self-gating method based on manifold alignment (MA), which enables reconstruction of free-breathing, high spatial and temporal resolution abdominal MRI sequences. Based on a radial golden-angle (RGA) acquisition trajectory, our method enables a multi-dimensional self-gating signal to be extracted from the k-space data for more accurate motion representation. The k-space radial profiles are evenly divided into a number of overlapping groups based on their radial angles. MA is then used to simultaneously learn and align the low dimensional manifolds of all groups, and embed them into a common manifold. In the manifold, k-space profiles that represent similar respiratory positions are close to each other. Image reconstruction is performed by combining radial profiles with evenly distributed angles that are close in the manifold. Our method was evaluated on both 2D and 3D synthetic and in vivo datasets. On the synthetic datasets, our method achieved high correlation with the ground truth in terms of image intensity and virtual navigator values. Using the in vivo data, compared to a state-of-the-art approach based on centre of k-space gating, our method was able to make use of much richer profile data for self-gating, resulting in statistically significantly better quantitative measurements in terms of organ sharpness and image gradient entropy

Sparse Projections of Medical Images onto Manifolds

Manifold learning has been successfully applied to a variety of medical imaging problems. Its use in real-time applications requires fast projection onto the low-dimensional space. To this end, out-of-sample extensions are applied by constructing an interpolation function that maps from the input space to the low-dimensional manifold. Commonly used approaches such as the Nyström extension and kernel ridge regression require using all training points. We propose an interpolation function that only depends on a small subset of the input training data. Consequently, in the testing phase each new point only needs to be compared against a small number of input training data in order to project the point onto the low-dimensional space. We interpret our method as an out-of-sample extension that approximates kernel ridge regression. Our method involves solving a simple convex optimization problem and has the attractive property of guaranteeing an upper bound on the approximation error, which is crucial for medical applications. Tuning this error bound controls the sparsity of the resulting interpolation function. We illustrate our method in two clinical applications that require fast mapping of input images onto a low-dimensional space.National Alliance for Medical Image Computing (U.S.) (grant NIH NIBIB NAMIC U54-EB005149)National Institutes of Health (U.S.) (grant NIH NCRR NAC P41-RR13218)National Institutes of Health (U.S.) (grant NIH NIBIB NAC P41-EB-015902

Efficient deformable motion correction for 3-D abdominal MRI using manifold regression

We present a novel framework for efficient retrospective respiratory motion correction of 3-D abdominal MRI using manifold regression. K-space data are continuously acquired under free breathing using the stack-of-stars radial gold-en-angle trajectory. The stack-of-profiles (SoP) from all temporal positions are embedded into a common manifold, in which SoPs that were acquired at similar respiratory states are close together. Next, the SoPs in the manifold are clustered into groups using the k-means algorithm. One 3-D volume is reconstructed at the central SoP position of each cluster (a.k.a. key-volumes). Motion fields are estimated using deformable image registration between each of these key-volumes and a reference end-exhale volume. Subsequently, the motion field at any other SoP position in the manifold is derived using manifold regression. The regressed motion fields for each of the SoPs are used to deter-mine a final motion-corrected MRI volume. The method was evaluated on realistic synthetic datasets which were generated from real MRI data and also tested on an in vivo dataset. The framework enables more accurate motion correction compared to the conventional binning-based approach, with high computational efficiency

Dynamic imaging using Motion-Compensated SmooThness Regularization on Manifolds (MoCo-SToRM)

We introduce an unsupervised motion-compensated reconstruction scheme for high-resolution free-breathing pulmonary MRI. We model the image frames in the time series as the deformed version of the 3D template image volume. We assume the deformation maps to be points on a smooth manifold in high-dimensional space. Specifically, we model the deformation map at each time instant as the output of a CNN-based generator that has the same weight for all time-frames, driven by a low-dimensional latent vector. The time series of latent vectors account for the dynamics in the dataset, including respiratory motion and bulk motion. The template image volume, the parameters of the generator, and the latent vectors are learned directly from the k-t space data in an unsupervised fashion. Our experimental results show improved reconstructions compared to state-of-the-art methods, especially in the context of bulk motion during the scans

Autoadaptive motion modelling for MR-based respiratory motion estimation

© 2016 The Authors.Respiratory motion poses significant challenges in image-guided interventions. In emerging treatments such as MR-guided HIFU or MR-guided radiotherapy, it may cause significant misalignments between interventional road maps obtained pre-procedure and the anatomy during the treatment, and may affect intra-procedural imaging such as MR-thermometry. Patient specific respiratory motion models provide a solution to this problem. They establish a correspondence between the patient motion and simpler surrogate data which can be acquired easily during the treatment. Patient motion can then be estimated during the treatment by acquiring only the simpler surrogate data.In the majority of classical motion modelling approaches once the correspondence between the surrogate data and the patient motion is established it cannot be changed unless the model is recalibrated. However, breathing patterns are known to significantly change in the time frame of MR-guided interventions. Thus, the classical motion modelling approach may yield inaccurate motion estimations when the relation between the motion and the surrogate data changes over the duration of the treatment and frequent recalibration may not be feasible.We propose a novel methodology for motion modelling which has the ability to automatically adapt to new breathing patterns. This is achieved by choosing the surrogate data in such a way that it can be used to estimate the current motion in 3D as well as to update the motion model. In particular, in this work, we use 2D MR slices from different slice positions to build as well as to apply the motion model. We implemented such an autoadaptive motion model by extending our previous work on manifold alignment.We demonstrate a proof-of-principle of the proposed technique on cardiac gated data of the thorax and evaluate its adaptive behaviour on realistic synthetic data containing two breathing types generated from 6 volunteers, and real data from 4 volunteers. On synthetic data the autoadaptive motion model yielded 21.45% more accurate motion estimations compared to a non-adaptive motion model 10 min after a change in breathing pattern. On real data we demonstrated the methods ability to maintain motion estimation accuracy despite a drift in the respiratory baseline. Due to the cardiac gating of the imaging data, the method is currently limited to one update per heart beat and the calibration requires approximately 12 min of scanning. Furthermore, the method has a prediction latency of 800 ms. These limitations may be overcome in future work by altering the acquisition protocol

Autoadaptive motion modelling for MR-based respiratory motion estimation

This repository contains four T1-weighted 2D MR slice datasets from multiple slice positions covering the entire thorax during free breathing and breath holds. The data was used to evaluate our novel autoadaptive respiratory motion model which we proposed in [1]. In particular, the datasets contain the following: Acquisition of all sagittal slice positions covering the thorax and one coronal slice position acquired during a breath hold. Results of registration between adjacent sagittal slice positions [control point displacements (cpp) and displacement fields (dfs)] 40 dynamic acquisitions of each slice position also present in the breath-hold acquired during free breathing. Results of registration of the dynamic acquisitions to the respective breath-holds slices (cpp's and dfs's). The data is divided into 4 zip files, each containing the data of one volunteer. The folder structure for each is as follows: |-- bhs (breath hold data) | |-- images (images) | | |-- cor | | `-- sag | `-- mfs_slpos2slpos (registration results) | `-- sag `-- dyn (dynamic free-breathing data) |-- images (images) | |-- cor | `-- sag `-- mfs_tpos2tpos (registration results) |-- cor `-- sag Please, see our publication [1] for details on the acquisition sequence and registration used. -- [1]: CF Baumgartner, C Kolbitsch, JR McClelland, D Rueckert, AP King, Autoadaptive motion modelling for MR-based respiratory motion estimation, Medical Image Analysis (2016), http://dx.doi.org/10.1016/j.media.2016.06.00

Respiratory-induced organ motion compensation for MRgHIFU

Summary: High Intensity Focused Ultrasound is an emerging non-invasive technology for the precise thermal ablation of pathological tissue deep within the body. The fitful, respiratoryinduced motion of abdominal organs, such as of the liver, renders targeting challenging. The work in hand describes methods for imaging, modelling and managing respiratoryinduced organ motion. The main objective is to enable 3D motion prediction of liver tumours for the treatment with Magnetic Resonance guided High Intensity Focused Ultrasound (MRgHIFU). To model and predict respiratory motion, the liver motion is initially observed in 3D space. Fast acquired 2D magnetic resonance images are retrospectively reconstructed to time-resolved volumes, thus called 4DMRI (3D + time). From these volumes, dense deformation fields describing the motion from time-step to time-step are extracted using an intensity-based non-rigid registration algorithm. 4DMRI sequences of 20 subjects, providing long-term recordings of the variability in liver motion under free breathing, serve as the basis for this study. Based on the obtained motion data, three main types of models were investigated and evaluated in clinically relevant scenarios. In particular, subject-specific motion models, inter-subject population-based motion models and the combination of both are compared in comprehensive studies. The analysis of the prediction experiments showed that statistical models based on Principal Component Analysis are well suited to describe the motion of a single subject as well as of a population of different and unobserved subjects. In order to enable target prediction, the respiratory state of the respective organ was tracked in near-real-time and a temporal prediction of its future position is estimated. The time span provided by the prediction is used to calculate the new target position and to readjust the treatment focus. In addition, novel methods for faster acquisition of subject-specific 3D data based on a manifold learner are presented and compared to the state-of-the art 4DMRI method. The developed methods provide motion compensation techniques for the non-invasive and radiation-free treatment of pathological tissue in moving abdominal organs for MRgHIFU. ---------- Zusammenfassung: High Intensity Focused Ultrasound ist eine aufkommende, nicht-invasive Technologie für die präzise thermische Zerstörung von pathologischem Gewebe im Körper. Die unregelmässige ateminduzierte Bewegung der Unterleibsorgane, wie z.B. im Fall der Leber, macht genaues Zielen anspruchsvoll. Die vorliegende Arbeit beschreibt Verfahren zur Bildgebung, Modellierung und zur Regelung ateminduzierter Organbewegung. Das Hauptziel besteht darin, 3D Zielvorhersagen für die Behandlung von Lebertumoren mittels Magnetic Resonance guided High Intensity Focused Ultrasound (MRgHIFU) zu ermöglichen. Um die Atembewegung modellieren und vorhersagen zu können, wird die Bewegung der Leber zuerst im dreidimensionalen Raum beobachtet. Schnell aufgenommene 2DMagnetresonanz- Bilder wurden dabei rückwirkend zu Volumen mit sowohl guter zeitlicher als auch räumlicher Auflösung, daher 4DMRI (3D + Zeit) genannt, rekonstruiert. Aus diesen Volumen werden Deformationsfelder, welche die Bewegung von Zeitschritt zu Zeitschritt beschreiben, mit einem intensitätsbasierten, nicht-starren Registrierungsalgorithmus extrahiert. 4DMRI-Sequenzen von 20 Probanden, welche Langzeitaufzeichungen von der Variabilität der Leberbewegung beinhalten, dienen als Grundlage für diese Studie. Basierend auf den gewonnenen Bewegungsdaten wurden drei Arten von Modellen in klinisch relevanten Szenarien untersucht und evaluiert. Personen-spezifische Bewegungsmodelle, populationsbasierende Bewegungsmodelle und die Kombination beider wurden in umfassenden Studien verglichen. Die Analyse der Vorhersage-Experimente zeigte, dass statistische Modelle basierend auf Hauptkomponentenanalyse gut geeignet sind, um die Bewegung einer einzelnen Person sowie einer Population von unterschiedlichen und unbeobachteten Personen zu beschreiben. Die Bewegungsvorhersage basiert auf der Abschätzung der Organposition, welche fast in Echtzeit verfolgt wird. Die durch die Vorhersage bereitgestellte Zeitspanne wird verwendet, um die neue Zielposition zu berechnen und den Behandlungsfokus auszurichten. Darüber hinaus werden neue Methoden zur schnelleren Erfassung patienten-spezifischer 3D-Daten und deren Rekonstruktion vorgestellt und mit der gängigen 4DMRI-Methode verglichen. Die entwickelten Methoden beschreiben Techniken zur nichtinvasiven und strahlungsfreien Behandlung von krankhaftem Gewebe in bewegten Unterleibsorganen mittels MRgHIFU