Fully Deformable 3D Digital Partition Model with Topological Control

International audienceWe propose a purely discrete deformable partition model for segmenting 3D images. Its main ability is to maintain the topology of the partition during the minimization process. To do so, our main contribution is a new definition of multi-label simple points (ML simple point) that is easily computable. An ML simple point can be relabeled without modifying the overall topology of the partition. The definition is based on intervoxel properties, and uses the notion of collapse on cubical complexes. This work is an extension of a former restricted definition [DupasAl09] that prohibits the move of intersections of boundary surfaces. A deformation process is carried out with a greedy energy minimization algorithm. A discrete area estimator is used to approach at best standard regularizers classically used in continuous energy minimizing methods. We illustrate the potential of our approach with the segmentation of 3D medical images with known expected topology

Segmentation of medical images under topological constraints

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, February 2006.Includes bibliographical references (p. 135-142).Major advances in the field of medical imaging over the past two decades have provided physicians with powerful, non-invasive techniques to probe the structure, function, and pathology of the human body. This increasingly vast and detailed amount of information constitutes a great challenge for the medical imaging community, and requires significant innovations in all aspect of image processing. To achieve accurate and topologically-correct delineations of anatomical structures from medical images is a critical step for many clinical and research applications. In this thesis, we extend the theoretical tools applicable to the segmentation of images under topological control, apply these new concepts to broaden the class of segmentation methodologies, and develop generally applicable and well-founded algorithms to achieve accurate segmentations of medical images under topological constraints. First, we introduce a digital concept that offers more flexibility in controlling the topology of digital segmentations. Second, we design a level set framework that offers a subtle control over the topology of the level set components. Our method constitutes a trade-off between traditional level sets and topology-preserving level sets.(cont.) Third, we develop an algorithm for the retrospective topology correction of 3D digital segmentations. Our method is nested in the theory of Bayesian parameter estimation, and integrates statistical information into the topology correction process. In addition, no assumption is made on the topology of the initial input images. Finally, we propose a genetic algorithm to accurately correct the spherical topology of cortical surfaces. Unlike existing approaches, our method is able to generate several potential topological corrections and to select the maximum-a-posteriori retessellation in a Bayesian framework. Our approach integrates statistical, geometrical, and shape information into the correction process, providing optimal solutions relatively to the MRI intensity profile and the expected curvature.by Florent Ségonne.Ph.D

Computational Anatomy for Multi-Organ Analysis in Medical Imaging: A Review

The medical image analysis field has traditionally been focused on the development of organ-, and disease-specific methods. Recently, the interest in the development of more 20 comprehensive computational anatomical models has grown, leading to the creation of multi-organ models. Multi-organ approaches, unlike traditional organ-specific strategies, incorporate inter-organ relations into the model, thus leading to a more accurate representation of the complex human anatomy. Inter-organ relations are not only spatial, but also functional and physiological. Over the years, the strategies 25 proposed to efficiently model multi-organ structures have evolved from the simple global modeling, to more sophisticated approaches such as sequential, hierarchical, or machine learning-based models. In this paper, we present a review of the state of the art on multi-organ analysis and associated computation anatomy methodology. The manuscript follows a methodology-based classification of the different techniques 30 available for the analysis of multi-organs and multi-anatomical structures, from techniques using point distribution models to the most recent deep learning-based approaches. With more than 300 papers included in this review, we reflect on the trends and challenges of the field of computational anatomy, the particularities of each anatomical region, and the potential of multi-organ analysis to increase the impact of 35 medical imaging applications on the future of healthcare.Comment: Paper under revie

Conditional Temporal Attention Networks for Neonatal Cortical Surface Reconstruction

Cortical surface reconstruction plays a fundamental role in modeling the rapid brain development during the perinatal period. In this work, we propose Conditional Temporal Attention Network (CoTAN), a fast end-to-end framework for diffeomorphic neonatal cortical surface reconstruction. CoTAN predicts multi-resolution stationary velocity fields (SVF) from neonatal brain magnetic resonance images (MRI). Instead of integrating multiple SVFs, CoTAN introduces attention mechanisms to learn a conditional time-varying velocity field (CTVF) by computing the weighted sum of all SVFs at each integration step. The importance of each SVF, which is estimated by learned attention maps, is conditioned on the age of the neonates and varies with the time step of integration. The proposed CTVF defines a diffeomorphic surface deformation, which reduces mesh self-intersection errors effectively. It only requires 0.21 seconds to deform an initial template mesh to cortical white matter and pial surfaces for each brain hemisphere. CoTAN is validated on the Developing Human Connectome Project (dHCP) dataset with 877 3D brain MR images acquired from preterm and term born neonates. Compared to state-of-the-art baselines, CoTAN achieves superior performance with only 0.12mm geometric error and 0.07% self-intersecting faces. The visualization of our attention maps illustrates that CoTAN indeed learns coarse-to-fine surface deformations automatically without intermediate supervision.Comment: Accepted by the 26th International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 202

Deformable Image Registration in the Analysis of Multiple Sclerosis

In medical image analysis, image registration is the task of finding corresponding features in two or more images, and using them to solve for the transformation that best aligns the images. Knowing the alignment allows information, such as landmarks and functional metrics, to be easily transferred between images, and allows them to be analyzed together. This dissertation focuses on the development of deformable image registration techniques for the analysis of multiple sclerosis (MS), a neurodegenerative disease that damages the myelin sheath of nervous tissue. MS is known to affect the entire central nervous system (CNS), and can result in the loss of sensorimotor control, cognition, and vision. Hence, the four primary contributions of this dissertation are on the development and application of deformable image registration in the three areas of the CNS that are most currently studied for MS -- the spinal cord, the retina, and the brain. First, for spinal cord magnetic resonance imaging (MRI), an approach is presented that uses deformable registration to provide atlas priors for automatic topology-preserving segmentation of the spinal cord and cerebrospinal fluid. The method shows high accuracy and robustness when compared to manual raters, and allows spinal cord atrophy to be analyzed on large datasets without manual segmentations. Second, for spinal cord diffusion tensor imaging, a pipeline is presented that uses deformable registration to correct for susceptibility distortions in the images. The pipeline allows for accurate computation of spinal cord diffusion metrics, which are shown to be significantly correlated with clinical measures of sensorimotor function and disability levels. Third, for optical coherence tomography (OCT) of the retina, a deformable registration technique is presented that constrains the transformation to follow the OCT acquisition geometry. 3D voxel-based analysis using the algorithm found significant differences between healthy and MS cohorts in regions of the retina that is consistent with previous findings using 2D analysis. Lastly, for brain MRI, a multi-channel registration framework is presented that can use distance transforms and image synthesis to improve registration accuracy. Together, these techniques have enabled several types of analysis that were previously unavailable for the study of MS

Medical image analysis via Fréchet means of diffeomorphisms

The construction of average models of anatomy, as well as regression analysis of anatomical structures, are key issues in medical research, e.g., in the study of brain development and disease progression. When the underlying anatomical process can be modeled by parameters in a Euclidean space, classical statistical techniques are applicable. However, recent work suggests that attempts to describe anatomical differences using flat Euclidean spaces undermine our ability to represent natural biological variability. In response, this dissertation contributes to the development of a particular nonlinear shape analysis methodology. This dissertation uses a nonlinear deformable model to measure anatomical change and define geometry-based averaging and regression for anatomical structures represented within medical images. Geometric differences are modeled by coordinate transformations, i.e., deformations, of underlying image coordinates. In order to represent local geometric changes and accommodate large deformations, these transformations are taken to be the group of diffeomorphisms with an associated metric. A mean anatomical image is defined using this deformation-based metric via the Fréchet mean—the minimizer of the sum of squared distances. Similarly, a new method called manifold kernel regression is presented for estimating systematic changes—as a function of a predictor variable, such as age—from data in nonlinear spaces. It is defined by recasting kernel regression in terms of a kernel-weighted Fréchet mean. This method is applied to determine systematic geometric changes in the brain from a random design dataset of medical images. Finally, diffeomorphic image mapping is extended to accommodate extraneous structures—objects that are present in one image and absent in another and thus change image topology—by deflating them prior to the estimation of geometric change. The method is applied to quantify the motion of the prostate in the presence of transient bowel gas

Geometric deep learning: going beyond Euclidean data

Many scientific fields study data with an underlying structure that is a non-Euclidean space. Some examples include social networks in computational social sciences, sensor networks in communications, functional networks in brain imaging, regulatory networks in genetics, and meshed surfaces in computer graphics. In many applications, such geometric data are large and complex (in the case of social networks, on the scale of billions), and are natural targets for machine learning techniques. In particular, we would like to use deep neural networks, which have recently proven to be powerful tools for a broad range of problems from computer vision, natural language processing, and audio analysis. However, these tools have been most successful on data with an underlying Euclidean or grid-like structure, and in cases where the invariances of these structures are built into networks used to model them. Geometric deep learning is an umbrella term for emerging techniques attempting to generalize (structured) deep neural models to non-Euclidean domains such as graphs and manifolds. The purpose of this paper is to overview different examples of geometric deep learning problems and present available solutions, key difficulties, applications, and future research directions in this nascent field