Non-Euclidean classification of medically imaged objects via s-reps

AbstractClassifying medically imaged objects, e.g., into diseased and normal classes, has been one of the important goals in medical imaging. We propose a novel classification scheme that uses a skeletal representation to provide rich non-Euclidean geometric object properties. Our statistical method combines distance weighted discrimination (DWD) with a carefully chosen Euclideanization which takes full advantage of the geometry of the manifold on which these non-Euclidean geometric object properties (GOPs) live. Our method is evaluated via the task of classifying 3D hippocampi between schizophrenics and healthy controls. We address three central questions. 1) Does adding shape features increase discriminative power over the more standard classification based only on global volume? 2) If so, does our skeletal representation provide greater discriminative power than a conventional boundary point distribution model (PDM)? 3) Especially, is Euclideanization of non-Euclidean shape properties important in achieving high discriminative power? Measuring the capability of a method in terms of area under the receiver operator characteristic (ROC) curve, we show that our proposed method achieves strongly better classification than both the classification method based on global volume alone and the s-rep-based classification method without proper Euclideanization of non-Euclidean GOPs. We show classification using Euclideanized s-reps is also superior to classification using PDMs, whether the PDMs are first Euclideanized or not. We also show improved performance with Euclideanized boundary PDMs over non-linear boundary PDMs. This demonstrates the benefit that proper Euclideanization of non-Euclidean GOPs brings not only to s-rep-based classification but also to PDM-based classification

Skeletal Shape Correspondence Through Entropy

We present a novel approach for improving the shape statistics of medical image objects by generating correspondence of skeletal points. Each object's interior is modeled by an s-rep, i.e., by a sampled, folded, two-sided skeletal sheet with spoke vectors proceeding from the skeletal sheet to the boundary. The skeleton is divided into three parts: the up side, the down side, and the fold curve. The spokes on each part are treated separately and, using spoke interpolation, are shifted along that skeleton in each training sample so as to tighten the probability distribution on those spokes' geometric properties while sampling the object interior regularly. As with the surface/boundary-based correspondence method of Cates et al., entropy is used to measure both the probability distribution tightness and the sampling regularity, here of the spokes' geometric properties. Evaluation on synthetic and real world lateral ventricle and hippocampus data sets demonstrate improvement in the performance of statistics using the resulting probability distributions. This improvement is greater than that achieved by an entropy-based correspondence method on the boundary points

CLASSIFICATION OF NEUROANATOMICAL STRUCTURES BASED ON NON-EUCLIDEAN GEOMETRIC OBJECT PROPERTIES

Studying the observed morphological differences in neuroanatomical structures between individuals with neurodevelopmental disorders and a control group of typically developing individuals has been an important objective. Researchers study the differences with two goals: to assist an accurate diagnosis of the disease and to gain insights into underlying mechanisms of the disease that cause such changes. Shape classification is commonly utilized in such studies. An effective classification is difficult because it requires 1) a choice of an object model that can provide rich geometric object properties (GOPs) relevant for a given classification task, and 2) a choice of a statistical classification method that accounts for the non-Euclidean nature of GOPs. I lay out my methodological contributions to address the aforementioned challenges in the context of early diagnosis and detection of Autism Spectrum Disorder (ASD) in infants based on shapes of hippocampi and caudate nuclei; morphological deviations in these structures between individuals with ASD and typically developing individuals have been reported in the literature. These contributions respectively lead to 1) an effective modeling of shapes of objects of interest and 2) an effective classification. As the first contribution for modeling shapes of objects, I propose a method to obtain a set of skeletal models called s-reps from a set of 3D objects. First, the method iteratively deforms the object surface via Mean Curvature Flow (MCF) until the deformed surface is approximately ellipsoidal. Then, an s-rep of the approximate ellipsoid is obtained analytically. Finally, the ellipsoid s-rep is deformed via a series of inverse MCF transformations. The method has two important properties: 1) it is fully automatic, and 2) it yields a set of s-reps with good correspondence across the set. The method is shown effective in generating a set of s-reps for a few neuroanatomical structures. As the second contribution with respect to modeling shapes of objects, I introduce an extension to the current s-rep for representing an object with a narrowing sharp tail. This includes a spoke interpolation method for interpolating a discrete s-rep of an object with a narrowing sharp tail into a continuous object. This extension is necessary for representing surface geometry of objects whose boundary has a singular point. I demonstrate that this extension allows appropriate surface modeling of a narrowing sharp tail region of the caudate nucleus. In addition, I show that the extension is beneficial in classifying autistic and non-autistic infants at high risk of ASD based on shapes of caudate nuclei. As the first contribution with respect to statistical methods, I propose a novel shape classification framework that uses the s-rep to capture rich localized geometric descriptions of an object, a statistical method called Principal Nested Spheres (PNS) analysis to handle the non-Euclidean s-rep GOPs, and a classification method called Distance Weighted Discrimination (DWD). I evaluate the effectiveness of the proposed method in classifying autistic and non-autistic infants based on either hippocampal shapes or caudate shapes in terms of the Area Under the ROC curve (AUC). In addition, I show that the proposed method is superior to commonly used shape classification methods in the literature. As my final methodological contribution, I extend the proposed shape classification method to perform the classifcation task based on temporal shape differences. DWD learns a class separation direction based on the temporal shape differences that are obtained by taking differences of the temporal pair of Euclideanized s-reps. In the context of early diagnosis and detection of ASD in young infants, the proposed temporal shape difference classification produces some interesting results; the temporal differences in shapes of hippocampi and caudate nuclei do not seem to be as predictive as the cross-sectional shape of these structures alone.Doctor of Philosoph

Shape Deformation Statistics and Regional Texture-Based Appearance Models for Segmentation

Transferring identified regions of interest (ROIs) from planning-time MRI images to the trans-rectal ultrasound (TRUS) images used to guide prostate biopsy is difficult because of the large difference in appearance between the two modalities as well as the deformation of the prostate's shape caused by the TRUS transducer. This dissertation describes methods for addressing these difficulties by both estimating a patient's prostate shape after the transducer is applied and then locating it in the TRUS image using skeletal models (s-reps) of prostate shapes. First, I introduce a geometrically-based method for interpolating discretely sampled s-reps into continuous objects. This interpolation is important for many tasks involving s-reps, including fitting them to new objects as well as the later applications described in this dissertation. This method is shown to be accurate for ellipsoids where an analytical solution is known. Next, I create a method for estimating a probability distribution on the difference between two shapes. Because s-reps live in a high-dimensional curved space, I use Principal Nested Spheres (PNS) to transform these representations to instead live in a flat space where standard techniques can be applied. This method is shown effective both on synthetic data as well as for modeling the deformation caused by the TRUS transducer to the prostate. In cases where appearance is described via a large number of parameters, such as intensity combined with multiple texture features, it is computationally beneficial to be able to turn these large tuples of descriptors into a scalar value. Using the inherent localization properties of s-reps, I develop a method for using regionally-trained classifiers to turn appearance tuples into the probability that the appearance tuple in question came from inside the prostate boundary. This method is shown to be able to accurately discern inside appearances from outside appearances over a large majority of the prostate boundary. Finally, I combine these techniques into a deformable model-based segmentation framework to segment the prostate in TRUS. By applying the learned mean deformation to a patient's prostate and then deforming it so that voxels with high probability of coming from the prostate's interior are also in the model's interior, I am able to generate prostate segmentations which are comparable to state of the art methods.Doctor of Philosoph

Geometric and statistical models for multi-object shape analysis

Shape analysis of multi-object complexes is important in many applications because it reveals additional information of interest over single-object shape analysis. For example, in medical applications where multiple structures in the human body often deform together, joint shape analysis of those interrelated structures facilitates robust and efficient algorithms. Specifically, shape correlation of functionally related structures allows us to understand the common underlying biological factors (e.g., disease). Also, beyond the within-object shape relations, between-object shape relations provide additional understanding of multi-object complexes. Despite the need of multi-object shape analysis, this field has been challenged by many issues. For instance, shape variation is often coupled with pose and size variation between objects. Moreover, within-object shape variation is often coupled with between-object shape variation. These issues have prevented us from sufficiently understanding multi-object complexes. To address the issues, this dissertation proposes geometric and statistical methods for joint analysis of multi-object complexes. In particular, I base my research on skeletal representations (i.e., s-reps) that are designed to provide intrinsic shape features with good correspondences. This dissertation improves the previous method fitting an s-rep to an object such that the fitted s-reps have desirable geometric and statistical properties. This improvement allows me to analyze intrinsic shape correlation between objects. To this end, this dissertation extends the existing statistical method to effectively extract joint shape variation, leading to a method called Non-EUclidean Joint and Individual Variation Explained (NEUJIVE). NEUJIVE shows notable robustness in analyzing multi-block non-Euclidean data with different variability. Last, to decouple within- and between-object shape variation, I develop non-branching linking structures for statistical analysis of between-object shape features. To capture geometric features that are insensitive to pose variation of multi-object complexes, this dissertation extends fitted local frames on s-reps to affine frames. The fitted local affine frames show special advantage because they free multi-object shape analysis from pre-alignment. The driving problem of the proposed methods involves classifying and testing hypotheses on the shape of the hippocampus-caudate pairs between an autism group and a non-autism group. Also, this dissertation discusses other potential applications that can benefit from the proposed methods.Doctor of Philosoph