Bayesian Image Quality Transfer with CNNs: Exploring Uncertainty in dMRI Super-Resolution

In this work, we investigate the value of uncertainty modeling in 3D super-resolution with convolutional neural networks (CNNs). Deep learning has shown success in a plethora of medical image transformation problems, such as super-resolution (SR) and image synthesis. However, the highly ill-posed nature of such problems results in inevitable ambiguity in the learning of networks. We propose to account for intrinsic uncertainty through a per-patch heteroscedastic noise model and for parameter uncertainty through approximate Bayesian inference in the form of variational dropout. We show that the combined benefits of both lead to the state-of-the-art performance SR of diffusion MR brain images in terms of errors compared to ground truth. We further show that the reduced error scores produce tangible benefits in downstream tractography. In addition, the probabilistic nature of the methods naturally confers a mechanism to quantify uncertainty over the super-resolved output. We demonstrate through experiments on both healthy and pathological brains the potential utility of such an uncertainty measure in the risk assessment of the super-resolved images for subsequent clinical use.Comment: Accepted paper at MICCAI 201

Implementation of the MR tractography visualization kit based on the anisotropic Allen-Cahn equation

summary:Magnetic Resonance Diffusion Tensor Imaging (MR–DTI) is a noninvasive in vivo method capable of examining the structure of human brain, providing information about the position and orientation of the neural tracts. After a short introduction to the principles of MR–DTI, this paper describes the steps of the proposed neural tract visualization technique based on the DTI data. The cornerstone of the algorithm is a texture diffusion procedure modeled mathematically by the problem for the Allen–Cahn equation with diffusion anisotropy controlled by a tensor field. Focus is put on the issues of the numerical solution of the given problem, using the finite volume method for spatial domain discretization. Several numerical schemes are compared with the aim of reducing the artificial (numerical) isotropic diffusion. The remaining steps of the algorithm are commented on as well, including the acquisition of the tensor field before the actual computation begins and the postprocessing used to obtain the final images. Finally, the visualization results are presented

Wave-type threshold dynamics and the hyperbolic mean curvature flow

We introduce a method for computing interfacial motions governed by curvature dependent acceleration. Our method is a thresholding algorithm of the BMO-type which, instead of utilizing a diffusion process, thresholds evolution by the wave equation to obtain the desired interfacial dynamics. We also develop the numerical method and present results of its application, including an investigation of the volume preserving and multiphase motions

High rank tensor and spherical harmonic models for diffusion MRI processing

Diffusion tensor imaging (DTI) is a non-invasive quantitative method of characterizing tissue micro-structure. Diffusion imaging attempts to characterize the manner by which the water molecules within a particular location move within a given amount of time. Measurement of the diffusion tensor (D) within a voxel allows a macroscopic voxel-averaged description of fiber structure, orientation and fully quantitative evaluation of the microstructural features of healthy and diseased tissue.;The rank two tensor model is incapable of resolving multiple fiber orientations within an individual voxel. This shortcoming of single tensor model stems from the fact that the tensor possesses only a single orientational maximum. Several authors reported this non-mono-exponential behavior for the diffusion-induced attenuation in brain tissue in water and N-Acetyl Aspartate (NAA) signals, that is why the Multi-Tensor, Higher Rank Tensor and Orientation Distribution Function (ODF) were introduced.;Using the higher rank tensor, we will propose a scheme for tensor field interpolation which is inspired by subdivision surfaces in computer graphics. The method applies to Cartesian tensors of all ranks and imposes smoothness on the interpolated field by constraining the divergence and curl of the tensor field. Results demonstrate that the subdivision scheme can better preserve anisotropicity and interpolate rotations than some other interpolation methods. As one of the most important applications of DTI, fiber tractography was implemented to study the shape geometry changes. Based on the divergence and curl measurement, we will introduce new scalar measures that are sensitive to behaviors such as fiber bending and fanning.;Based on the ODF analysis, a new anisotropy measure that has the ability to describe multi-fiber heterogeneity while remaining rotationally invariant, will be introduced, which is a problem with many other anisotropy measures defined using the ODF. The performance of this novel measure is demonstrated for data with varying Signal to Noise Ratio (SNR), and different material characteristics

Image quality transfer and applications in diffusion MRI

This paper introduces a new computational imaging technique called image quality transfer (IQT). IQT uses machine learning to transfer the rich information available from one-off experimental medical imaging devices to the abundant but lower-quality data from routine acquisitions. The procedure uses matched pairs to learn mappings from low-quality to corresponding high-quality images. Once learned, these mappings then augment unseen low quality images, for example by enhancing image resolution or information content. Here, we demonstrate IQT using a simple patch-regression implementation and the uniquely rich diffusion MRI data set from the human connectome project (HCP). Results highlight potential benefits of IQT in both brain connectivity mapping and microstructure imaging. In brain connectivity mapping, IQT reveals, from standard data sets, thin connection pathways that tractography normally requires specialised data to reconstruct. In microstructure imaging, IQT shows potential in estimating, from standard “single-shell” data (one non-zero b-value), maps of microstructural parameters that normally require specialised multi-shell data. Further experiments show strong generalisability, highlighting IQT's benefits even when the training set does not directly represent the application domain. The concept extends naturally to many other imaging modalities and reconstruction problems

Information-Theoretic Registration with Explicit Reorientation of Diffusion-Weighted Images

We present an information-theoretic approach to the registration of images with directional information, and especially for diffusion-Weighted Images (DWI), with explicit optimization over the directional scale. We call it Locally Orderless Registration with Directions (LORD). We focus on normalized mutual information as a robust information-theoretic similarity measure for DWI. The framework is an extension of the LOR-DWI density-based hierarchical scale-space model that varies and optimizes the integration, spatial, directional, and intensity scales. As affine transformations are insufficient for inter-subject registration, we extend the model to non-rigid deformations. We illustrate that the proposed model deforms orientation distribution functions (ODFs) correctly and is capable of handling the classic complex challenges in DWI-registrations, such as the registration of fiber-crossings along with kissing, fanning, and interleaving fibers. Our experimental results clearly illustrate a novel promising regularizing effect, that comes from the nonlinear orientation-based cost function. We show the properties of the different image scales and, we show that including orientational information in our model makes the model better at retrieving deformations in contrast to standard scalar-based registration.Comment: 16 pages, 19 figure