A comparative evaluation of 3 different free-form deformable image registration and contour propagation methods for head and neck MRI : the case of parotid changes radiotherapy

Purpose: To validate and compare the deformable image registration and parotid contour propagation process for head and neck magnetic resonance imaging in patients treated with radiotherapy using 3 different approachesthe commercial MIM, the open-source Elastix software, and an optimized version of it. Materials and Methods: Twelve patients with head and neck cancer previously treated with radiotherapy were considered. Deformable image registration and parotid contour propagation were evaluated by considering the magnetic resonance images acquired before and after the end of the treatment. Deformable image registration, based on free-form deformation method, and contour propagation available on MIM were compared to Elastix. Two different contour propagation approaches were implemented for Elastix software, a conventional one (DIR_Trx) and an optimized homemade version, based on mesh deformation (DIR_Mesh). The accuracy of these 3 approaches was estimated by comparing propagated to manual contours in terms of average symmetric distance, maximum symmetric distance, Dice similarity coefficient, sensitivity, and inclusiveness. Results: A good agreement was generally found between the manual contours and the propagated ones, without differences among the 3 methods; in few critical cases with complex deformations, DIR_Mesh proved to be more accurate, having the lowest values of average symmetric distance and maximum symmetric distance and the highest value of Dice similarity coefficient, although nonsignificant. The average propagation errors with respect to the reference contours are lower than the voxel diagonal (2 mm), and Dice similarity coefficient is around 0.8 for all 3 methods. Conclusion: The 3 free-form deformation approaches were not significantly different in terms of deformable image registration accuracy and can be safely adopted for the registration and parotid contour propagation during radiotherapy on magnetic resonance imaging. More optimized approaches (as DIR_Mesh) could be preferable for critical deformations

Physiological basis and image processing in functional magnetic resonance imaging: Neuronal and motor activity in brain

Functional magnetic resonance imaging (fMRI) is recently developing as imaging modality used for mapping hemodynamics of neuronal and motor event related tissue blood oxygen level dependence (BOLD) in terms of brain activation. Image processing is performed by segmentation and registration methods. Segmentation algorithms provide brain surface-based analysis, automated anatomical labeling of cortical fields in magnetic resonance data sets based on oxygen metabolic state. Registration algorithms provide geometric features using two or more imaging modalities to assure clinically useful neuronal and motor information of brain activation. This review article summarizes the physiological basis of fMRI signal, its origin, contrast enhancement, physical factors, anatomical labeling by segmentation, registration approaches with examples of visual and motor activity in brain. Latest developments are reviewed for clinical applications of fMRI along with other different neurophysiological and imaging modalities

Fusion of Color Doppler and Magnetic Resonance Images of the Heart

This study was designed to establish and analyze color Doppler and magnetic resonance fusion images of the heart, an approach for simultaneous testing of cardiac pathological alterations, performance, and hemodynamics. Ten volunteers were tested in this study. The echocardiographic images were produced by Philips IE33 system and the magnetic resonance images were generated from Philips 3.0-T system. The fusion application was implemented on MATLAB platform utilizing image processing technology. The fusion image was generated from the following steps: (1) color Doppler blood flow segmentation, (2) image registration of color Doppler and magnetic resonance imaging, and (3) image fusion of different image types. The fusion images of color Doppler blood flow and magnetic resonance images were implemented by MATLAB programming in our laboratory. Images and videos were displayed and saved as AVI and JPG. The present study shows that the method we have developed can be used to fuse color flow Doppler and magnetic resonance images of the heart. We believe that the method has the potential to: fill in information missing from the ultrasound or MRI alone, show structures outside the field of view of the ultrasound through MR imaging, and obtain complementary information through the fusion of the two imaging methods (structure from MRI and function from ultrasound)

Primitive Simultaneous Optimization of Similarity Metrics for Image Registration

Even though simultaneous optimization of similarity metrics represents a standard procedure in the field of semantic segmentation, surprisingly, this does not hold true for image registration. To close this unexpected gap in the literature, we investigate in a complex multi-modal 3D setting whether simultaneous optimization of registration metrics, here implemented by means of primitive summation, can benefit image registration. We evaluate two challenging datasets containing collections of pre- to post-operative and pre- to intra-operative Magnetic Resonance Imaging (MRI) of glioma. Employing the proposed optimization we demonstrate improved registration accuracy in terms of Target Registration Error (TRE) on expert neuroradiologists' landmark annotations

Multimodal T2w and DWI Prostate Gland Automated Registration

Multiparametric magnetic resonance imaging (mpMRI) is emerging as a promising tool in the clinical pathway of prostate cancer (PCa). The registration between a structural and a functional imaging modality, such as T2-weighted (T2w) and diffusion-weighted imaging (DWI) is fundamental in the development of a mpMRI-based computer aided diagnosis (CAD) system for PCa. Here, we propose an automated method to register the prostate gland in T2w and DWI image sequences by a landmark-based affine registration and a non-parametric diffeomorphic registration. An expert operator manually segmented the prostate gland in both modalities on a dataset of 20 patients. Target registration error and Jaccard index, which measures the overlap between masks, were evaluated pre-and post-registration resulting in an improvement of 44% and 21%, respectively. In the future, the proposed method could be useful in the framework of a CAD system for PCa detection and characterization in mpMRI

Unsupervised image registration towards enhancing performance and explainability in cardiac and brain image analysis

Magnetic Resonance Imaging (MRI) typically recruits multiple sequences (defined here as “modalities”). As each modality is designed to offer different anatomical and functional clinical information, there are evident disparities in the imaging content across modalities. Inter- and intra-modality affine and non-rigid image registration is an essential medical image analysis process in clinical imaging, as for example before imaging biomarkers need to be derived and clinically evaluated across different MRI modalities, time phases and slices. Although commonly needed in real clinical scenarios, affine and non-rigid image registration is not extensively investigated using a single unsupervised model architecture. In our work, we present an unsupervised deep learning registration methodology that can accurately model affine and non-rigid transformations, simultaneously. Moreover, inverse-consistency is a fundamental inter-modality registration property that is not considered in deep learning registration algorithms. To address inverse consistency, our methodology performs bi-directional cross-modality image synthesis to learn modality-invariant latent representations, and involves two factorised transformation networks (one per each encoder-decoder channel) and an inverse-consistency loss to learn topology-preserving anatomical transformations. Overall, our model (named “FIRE”) shows improved performances against the reference standard baseline method (i.e., Symmetric Normalization implemented using the ANTs toolbox) on multi-modality brain 2D and 3D MRI and intra-modality cardiac 4D MRI data experiments. We focus on explaining model-data components to enhance model explainability in medical image registration. On computational time experiments, we show that the FIRE model performs on a memory-saving mode, as it can inherently learn topology-preserving image registration directly in the training phase. We therefore demonstrate an efficient and versatile registration technique that can have merit in multi-modal image registrations in the clinical setting

Meta-Learning Initializations for Interactive Medical Image Registration

We present a meta-learning framework for interactive medical image registration. Our proposed framework comprises three components: a learning-based medical image registration algorithm, a form of user interaction that refines registration at inference, and a meta-learning protocol that learns a rapidly adaptable network initialization. This paper describes a specific algorithm that implements the registration, interaction and meta-learning protocol for our exemplar clinical application: registration of magnetic resonance (MR) imaging to interactively acquired, sparsely-sampled transrectal ultrasound (TRUS) images. Our approach obtains comparable registration error (4.26 mm) to the best-performing non-interactive learning-based 3D-to-3D method (3.97 mm) while requiring only a fraction of the data, and occurring in real-time during acquisition. Applying sparsely sampled data to non-interactive methods yields higher registration errors (6.26 mm), demonstrating the effectiveness of interactive MR-TRUS registration, which may be applied intraoperatively given the real-time nature of the adaptation process.Comment: 11 pages, 10 figures. Paper accepted to IEEE Transactions on Medical Imaging (October 26 2022

FASTR: Using Local Structure Tensors as a Similarity Metric

AbstractWe describe a novel structural image descriptor for image registration called the Fractionally Anisotropic Structural Tensor Representation (FASTR), calculated from the local structural tensor (LST). The metric has several characteristics that are advantageous for multi-modality registration, such as not depending on absolute voxel intensities, and being insensitive to slowly varying in- tensity inhomogeneities across the image. This latter property is very useful, since many imaging modalities suffer from such artefacts. Registration accuracy is tested on both computed tomography (CT) to cone-beam CT (CBCT) rigid registration, and CT to magnetic resonance (MR) rigid registration. The performance is compared with Mutual Information (MI) metric and the Self Similarity Context (SSC) descriptor. The results show that, for images with significant intensity inhomogeneity, FASTR produced more accurate results than MI, and faster results than SSC. The results suggest FASTR gives similar benefits in images with intensity inhomogeneity, but at a fraction of the computation and memory demand