Fast Predictive Multimodal Image Registration

We introduce a deep encoder-decoder architecture for image deformation prediction from multimodal images. Specifically, we design an image-patch-based deep network that jointly (i) learns an image similarity measure and (ii) the relationship between image patches and deformation parameters. While our method can be applied to general image registration formulations, we focus on the Large Deformation Diffeomorphic Metric Mapping (LDDMM) registration model. By predicting the initial momentum of the shooting formulation of LDDMM, we preserve its mathematical properties and drastically reduce the computation time, compared to optimization-based approaches. Furthermore, we create a Bayesian probabilistic version of the network that allows evaluation of registration uncertainty via sampling of the network at test time. We evaluate our method on a 3D brain MRI dataset using both T1- and T2-weighted images. Our experiments show that our method generates accurate predictions and that learning the similarity measure leads to more consistent registrations than relying on generic multimodal image similarity measures, such as mutual information. Our approach is an order of magnitude faster than optimization-based LDDMM.Comment: Accepted as a conference paper for ISBI 201

Quicksilver: Fast Predictive Image Registration - a Deep Learning Approach

This paper introduces Quicksilver, a fast deformable image registration method. Quicksilver registration for image-pairs works by patch-wise prediction of a deformation model based directly on image appearance. A deep encoder-decoder network is used as the prediction model. While the prediction strategy is general, we focus on predictions for the Large Deformation Diffeomorphic Metric Mapping (LDDMM) model. Specifically, we predict the momentum-parameterization of LDDMM, which facilitates a patch-wise prediction strategy while maintaining the theoretical properties of LDDMM, such as guaranteed diffeomorphic mappings for sufficiently strong regularization. We also provide a probabilistic version of our prediction network which can be sampled during the testing time to calculate uncertainties in the predicted deformations. Finally, we introduce a new correction network which greatly increases the prediction accuracy of an already existing prediction network. We show experimental results for uni-modal atlas-to-image as well as uni- / multi- modal image-to-image registrations. These experiments demonstrate that our method accurately predicts registrations obtained by numerical optimization, is very fast, achieves state-of-the-art registration results on four standard validation datasets, and can jointly learn an image similarity measure. Quicksilver is freely available as an open-source software.Comment: Add new discussion

Neonatal White Matter Maturation Is Associated With Infant Language Development

Background: While neonates have no sophisticated language skills, the neural basis for acquiring this function is assumed to already be present at birth. Receptive language is measurable by 6 months of age and meaningful speech production by 10-18 months of age. Fiber tracts supporting language processing include the corpus callosum (CC), which plays a key role in the hemispheric lateralization of language; the left arcuate fasciculus (AF), which is associated with syntactic processing; and the right AF, which plays a role in prosody and semantics. We examined if neonatal maturation of these fiber tracts is associated with receptive language development at 12 months of age. Methods: Diffusion-weighted imaging (DWI) was performed in 86 infants at 26.6 ± 12.2 days post-birth. Receptive language was assessed via the MacArthur-Bates Communicative Development Inventory at 12 months of age. Tract-based fractional anisotropy (FA) was determined using the NA-MIC atlas-based fiber analysis toolkit. Associations between neonatal regional FA, adjusted for gestational age at birth and age at scan, and language development at 12 months of age were tested using ANOVA models. Results: After multiple comparisons correction, higher neonatal FA was positively associated with receptive language at 12 months of age within the genu (p < 0.001), rostrum (p < 0.001), and tapetum (p < 0.001) of the CC and the left fronto-parietal AF (p = 0.008). No significant clusters were found in the right AF. Conclusion: Microstructural development of the CC and the AF in the newborn is associated with receptive language at 12 months of age, demonstrating that interindividual variation in white matter microstructure is relevant for later language development, and indicating that the neural foundation for language processing is laid well ahead of the majority of language acquisition. This suggests that some origins of impaired language development may lie in the intrauterine and potentially neonatal period of life. Understanding how interindividual differences in neonatal brain maturity relate to the acquisition of function, particularly during early development when the brain is in an unparalleled window of plasticity, is key to identifying opportunities for harnessing neuroplasticity in health and disease

Hippocampal shape and volume changes with antipsychotics in early stage psychotic illness

Progression of hippocampal shape and volume abnormalities has been described in psychotic disorders such as schizophrenia. However it is unclear how specific antipsychotic medications influence the development of hippocampal structure. We conducted a longitudinal, randomized, controlled, multisite, double-blind study involving 14 academic medical centers (United States 11, Canada 1, Netherlands 1, and England 1). 134 first-episode psychosis (receiving either haloperidol or olanzapine) patients and 51 healthy controls were treated and followed up for up to 104 weeks using magnetic resonance imaging and large-deformation high-dimensional brain mapping of the hippocampus. Changes in hippocampal volume and shape metrics (i.e., percentage of negative surface vertex slopes, and surface deformation) were evaluated. Mixed-models analysis did not show a significant group-by-time interaction for hippocampal volume. However, the cumulative distribution function of hippocampal surface vertex slopes showed a notable left shift with haloperidol treatment compared to olanzapine treatment and to controls. Olanzapine treatment was associated with a significantly lower percentage of large magnitude negative surface vertex slopes compared to haloperidol treatment (p=0.004). Surface deformation maps however did not localize any hippocampal regions that differentially contracted over time with olanzapine treatment, after FDR correction. These results indicate that surface analysis provides supplementary information to volumetry in detecting differential treatment effects of the hippocampus. Our results suggest that olanzapine is associated with less longitudinal hippocampal surface deformation than haloperidol, however the hippocampal regions affected appear to be variable across patients

Evaluation of atlas based mouse brain segmentation

Magentic Reasonance Imaging for mouse phenotype study is one of the important tools to understand human diseases. In this paper, we present a fully automatic pipeline for the process of morphometric mouse brain analysis. The method is based on atlas-based tissue and regional segmentation, which was originally developed for the human brain. To evaluate our method, we conduct a qualitative and quantitative validation study as well as compare of b-spline and fluid registration methods as components in the pipeline. The validation study includes visual inspection, shape and volumetric measurements and stability of the registration methods against various parameter settings in the processing pipeline. The result shows both fluid and b-spline registration methods work well in murine settings, but the fluid registration is more stable. Additionally, we evaluated our segmentation methods by comparing volume differences between Fmr1 FXS in FVB background vs C57BL/6J mouse strains

Closed and open source neuroimage analysis tools and libraries at UNC

pre-printThe emergence of open-source libraries and development tools in the last decade has changed the process of academic software development in many ways. In medical image processing and visualization this change is especially evident, also because open source projects are actively furthered by grant funding institutions. This manuscript presents the use of such development tools and libraries at the UNC Neuro-Image Analysis Laboratory for open source applications and tools. We have also experienced in our research that the development of open source in academics raises the issue of access to unpublished methodology. The strategy at our laboratory is to combine all in-house libraries and applications into a single repository that consists of two parts: a fully open source part that is distributed under a Berkley-style license and a private, closed source part with unpublished tools and methods. Access to the open source part is unrestricted, whereas the private parts can only be downloaded via cvs user login. This setup solved our issues regarding unpublished methodology, as migration from the private to the open source part is very simple. Overall our experience with this development environment within the academic setting is very positive

Minimum description length with local geometry

pre-printEstablishing optimal correspondence across object populations is essential to statistical shape analysis. Minimizing the description length (MDL) is a popular method for finding correspondence. In this work, we extend the MDL method by incorporating various local curvature metrics. Using local curvature can improve performance by ensuring that corresponding points exhibit similar local geometric characteristics that can't always be captured by mere point locations. We illustrate results on a variety of anatomical structures. The MDL method with a combination of point locations and curvature outperforms all the other methods we analyzed, including traditional MDL and spherical harmonics (SPHARM) correspondence, when the analyzed object population exhibits complex structure. When the objects are of simple nature, however, there's no added benefit to using the local curvature. In our experiments, we did not observe a significant difference in the correspondence quality when different curvature metrics (e.g. principal curvatures, mean curvature, Gaussian curvature) were used

Statistical group differences in anatomical shape analysis using Hotelling T2 Metric

journal articleShape analysis has become of increasing interest to the neuroimaging community due to its potential to precisely locate morphological changes between healthy and pathological structures. This manuscript presents a comprehensive set of tools for the computation of 3D structural statistical shape analysis. It has been applied in several studies on brain morphometry, but can potentially be employed in other 3D shape problems. Its main limitations is the necessity of spherical topology. The input of the proposed shape analysis is a set of binary segmentation of a single brain structure, such as the hippocampus or caudate. These segmentations are converted into a corresponding spherical harmonic description (SPHARM), which is then sampled into a triangulated surfaces (SPHARM-PDM). After alignment, differences between groups of surfaces are computed using the Hotelling T2 two sample metric. Statistical pvalues, both raw and corrected for multiple comparisons, result in significance maps. Additional visualization of the group tests are provided via mean difference magnitude and vector maps, as well as maps of the group covariance information. The correction for multiple comparisons is performed via two separate methods that each have a distinct view of the problem. The first one aims to control the family-wise error rate (FWER) or false-positives via the extrema histogram of non-parametric permutations. The second method controls the false discovery rate and results in a less conservative estimate of the false-negatives. Prior versions of this shape analysis framework have been applied already to clinical studies on hippocampus and lateral ventricle shape in adult schizophrenics. The novelty of this submission is the use of the Hotelling T2 two-sample group difference metric for the computation of a template free statistical shape analysis. Template free group testing allowed this framework to become independent of any template choice, as well as it improved the sensitivity of our method considerably. In addition to our existing correction methodology for the multiple comparison problem using non-parametric permutation tests, we have extended the testing framework to include False Discovery Rate (FDR). FDR provides a significance correction with higher sensitivity while allowing a expected minimal amount of false-positives compared to our prior testing scheme