Multiscale Dictionary Learning for Estimating Conditional Distributions

Nonparametric estimation of the conditional distribution of a response given high-dimensional features is a challenging problem. It is important to allow not only the mean but also the variance and shape of the response density to change flexibly with features, which are massive-dimensional. We propose a multiscale dictionary learning model, which expresses the conditional response density as a convex combination of dictionary densities, with the densities used and their weights dependent on the path through a tree decomposition of the feature space. A fast graph partitioning algorithm is applied to obtain the tree decomposition, with Bayesian methods then used to adaptively prune and average over different sub-trees in a soft probabilistic manner. The algorithm scales efficiently to approximately one million features. State of the art predictive performance is demonstrated for toy examples and two neuroscience applications including up to a million features

Doctor of Philosophy

dissertationAn important aspect of medical research is the understanding of anatomy and its relation to function in the human body. For instance, identifying changes in the brain associated with cognitive decline helps in understanding the process of aging and age-related neurological disorders. The field of computational anatomy provides a rich mathematical setting for statistical analysis of complex geometrical structures seen in 3D medical images. At its core, computational anatomy is based on the representation of anatomical shape and its variability as elements of nonflat manifold of diffeomorphisms with an associated Riemannian structure. Although such manifolds effectively represent natural biological variability, intrinsic methods of statistical analysis within these spaces remain deficient at large. This dissertation contributes two critical missing pieces for statistics in diffeomorphisms: (1) multivariate regression models for cross-sectional study of shapes, and (2) generalization of classical Euclidean, mixed-effects models to manifolds for longitudinal studies. These models are based on the principle that statistics on manifold-valued information must respect the intrinsic geometry of that space. The multivariate regression methods provide statistical descriptors of the relationships of anatomy with clinical indicators. The novel theory of hierarchical geodesic models (HGMs) is developed as a natural generalization of hierarchical linear models (HLMs) to describe longitudinal data on curved manifolds. Using a hierarchy of geodesics, the HGMs address the challenge of modeling the shape-data with unbalanced designs typically arising as a result of follow-up medical studies. More generally, this research establishes a mathematical foundation to study dynamics of changes in anatomy and the associated clinical progression with time. This dissertation also provides efficient algorithms that utilize state-of-the-art high performance computing architectures to solve models on large-scale, longitudinal imaging data. These manifold-based methods are applied to predictive modeling of neurological disorders such as Alzheimer's disease. Overall, this dissertation enables clinicians and researchers to better utilize the structural information available in medical images

Explainable Anatomical Shape Analysis through Deep Hierarchical Generative Models

Quantification of anatomical shape changes currently relies on scalar global indexes which are largely insensitive to regional or asymmetric modifications. Accurate assessment of pathology-driven anatomical remodeling is a crucial step for the diagnosis and treatment of many conditions. Deep learning approaches have recently achieved wide success in the analysis of medical images, but they lack interpretability in the feature extraction and decision processes. In this work, we propose a new interpretable deep learning model for shape analysis. In particular, we exploit deep generative networks to model a population of anatomical segmentations through a hierarchy of conditional latent variables. At the highest level of this hierarchy, a two-dimensional latent space is simultaneously optimised to discriminate distinct clinical conditions, enabling the direct visualisation of the classification space. Moreover, the anatomical variability encoded by this discriminative latent space can be visualised in the segmentation space thanks to the generative properties of the model, making the classification task transparent. This approach yielded high accuracy in the categorisation of healthy and remodelled left ventricles when tested on unseen segmentations from our own multi-centre dataset as well as in an external validation set, and on hippocampi from healthy controls and patients with Alzheimer's disease when tested on ADNI data. More importantly, it enabled the visualisation in three-dimensions of both global and regional anatomical features which better discriminate between the conditions under exam. The proposed approach scales effectively to large populations, facilitating high-throughput analysis of normal anatomy and pathology in large-scale studies of volumetric imaging