Fast and Sequence-Adaptive Whole-Brain Segmentation Using Parametric Bayesian Modeling

AbstractQuantitative analysis of magnetic resonance imaging (MRI) scans of the brain requires accurate automated segmentation of anatomical structures. A desirable feature for such segmentation methods is to be robust against changes in acquisition platform and imaging protocol. In this paper we validate the performance of a segmentation algorithm designed to meet these requirements, building upon generative parametric models previously used in tissue classification. The method is tested on four different datasets acquired with different scanners, field strengths and pulse sequences, demonstrating comparable accuracy to state-of-the-art methods on T1-weighted scans while being one to two orders of magnitude faster. The proposed algorithm is also shown to be robust against small training datasets, and readily handles images with different MRI contrast as well as multi-contrast data

Nonlinear Markov Random Fields Learned via Backpropagation

Although convolutional neural networks (CNNs) currently dominate competitions on image segmentation, for neuroimaging analysis tasks, more classical generative approaches based on mixture models are still used in practice to parcellate brains. To bridge the gap between the two, in this paper we propose a marriage between a probabilistic generative model, which has been shown to be robust to variability among magnetic resonance (MR) images acquired via different imaging protocols, and a CNN. The link is in the prior distribution over the unknown tissue classes, which are classically modelled using a Markov random field. In this work we model the interactions among neighbouring pixels by a type of recurrent CNN, which can encode more complex spatial interactions. We validate our proposed model on publicly available MR data, from different centres, and show that it generalises across imaging protocols. This result demonstrates a successful and principled inclusion of a CNN in a generative model, which in turn could be adapted by any probabilistic generative approach for image segmentation.Comment: Accepted for the international conference on Information Processing in Medical Imaging (IPMI) 2019, camera ready versio

Supervised Nonparametric Image Parcellation

Author Manuscript 2010 August 25. 12th International Conference, London, UK, September 20-24, 2009, Proceedings, Part IISegmentation of medical images is commonly formulated as a supervised learning problem, where manually labeled training data are summarized using a parametric atlas. Summarizing the data alleviates the computational burden at the expense of possibly losing valuable information on inter-subject variability. This paper presents a novel framework for Supervised Nonparametric Image Parcellation (SNIP). SNIP models the intensity and label images as samples of a joint distribution estimated from the training data in a non-parametric fashion. By capitalizing on recently developed fast and robust pairwise image alignment tools, SNIP employs the entire training data to segment a new image via Expectation Maximization. The use of multiple registrations increases robustness to occasional registration failures. We report experiments on 39 volumetric brain MRI scans with manual labels for the white matter, cortex and subcortical structures. SNIP yields better segmentation than state-of-the-art algorithms in multiple regions of interest.NAMIC (NIHNIBIBNAMICU54-EB005149)NAC (NIHNCRRNACP41-RR13218)mBIRN (NIHNCRRmBIRNU24-RR021382)NIH NINDS (Grant R01-NS051826)National Science Foundation (U.S.) (CAREER Grant 0642971)NCRR (P41-RR14075)NCRR (R01 RR16594-01A1)NIBIB (R01 EB001550)NIBIB (R01EB006758)NINDS (R01 NS052585-01)Mind Research InstituteEllison Medical FoundationSingapore. Agency for Science, Technology and Researc

An MRF-UNet Product of Experts for Image Segmentation

While convolutional neural networks (CNNs) trained by back-propagation have seen unprecedented success at semantic segmentation tasks, they are known to struggle on out-of-distribution data. Markov random fields (MRFs) on the other hand, encode simpler distributions over labels that, although less flexible than UNets, are less prone to over-fitting. In this paper, we propose to fuse both strategies by computing the product of distributions of a UNet and an MRF. As this product is intractable, we solve for an approximate distribution using an iterative mean-field approach. The resulting MRF-UNet is trained jointly by back-propagation. Compared to other works using conditional random fields (CRFs), the MRF has no dependency on the imaging data, which should allow for less over-fitting. We show on 3D neuroimaging data that this novel network improves generalisation to out-of-distribution samples. Furthermore, it allows the overall number of parameters to be reduced while preserving high accuracy. These results suggest that a classic MRF smoothness prior can allow for less over-fitting when principally integrated into a CNN model. Our implementation is available at https://github.com/balbasty/nitorch

A Biomarker for Alzheimer’s Disease Based on Patterns of Regional Brain Atrophy

Introduction: It has been shown that Alzheimer’s disease (AD) is accompanied by marked structural brain changes that can be detected several years before clinical diagnosis via structural magnetic resonance (MR) imaging. In this study, we developed a structural MR-based biomarker for in vivo detection of AD using a supervised machine learning approach. Based on an individual’s pattern of brain atrophy a continuous AD score is assigned which measures the similarity with brain atrophy patterns seen in clinical cases of AD. Methods: The underlying statistical model was trained with MR scans of patients and healthy controls from the Alzheimer’s Disease Neuroimaging Initiative (ADNI-1 screening). Validation was performed within ADNI-1 and in an independent patient sample from the Open Access Series of Imaging Studies (OASIS-1). In addition, our analyses included data from a large general population sample of the Study of Health in Pomerania (SHIP-Trend). Results: Based on the proposed AD score we were able to differentiate patients from healthy controls in ADNI-1 and OASIS-1 with an accuracy of 89% (AUC = 95%) and 87% (AUC = 93%), respectively. Moreover, we found the AD score to be significantly associated with cognitive functioning as assessed by the Mini-Mental State Examination in the OASIS-1 sample after correcting for diagnosis, age, sex, age·sex, and total intracranial volume (Cohen’s f2 = 0.13). Additional analyses showed that the prediction accuracy of AD status based on both the AD score and the MMSE score is significantly higher than when using just one of them. In SHIP-Trend we found the AD score to be weakly but significantly associated with a test of verbal memory consisting of an immediate and a delayed word list recall (again after correcting for age, sex, age·sex, and total intracranial volume, Cohen’s f2 = 0.009). This association was mainly driven by the immediate recall performance. Discussion: In summary, our proposed biomarker well differentiated between patients and healthy controls in an independent test sample. It was associated with measures of cognitive functioning both in a patient sample and a general population sample. Our approach might be useful for defining robust MR-based biomarkers for other neurodegenerative diseases, too