Nonlinear tube-fitting for the analysis of anatomical and functional structures

We are concerned with the estimation of the exterior surface and interior summaries of tube-shaped anatomical structures. This interest is motivated by two distinct scientific goals, one dealing with the distribution of HIV microbicide in the colon and the other with measuring degradation in white-matter tracts in the brain. Our problem is posed as the estimation of the support of a distribution in three dimensions from a sample from that distribution, possibly measured with error. We propose a novel tube-fitting algorithm to construct such estimators. Further, we conduct a simulation study to aid in the choice of a key parameter of the algorithm, and we test our algorithm with validation study tailored to the motivating data sets. Finally, we apply the tube-fitting algorithm to a colon image produced by single photon emission computed tomography (SPECT) and to a white-matter tract image produced using diffusion tensor imaging (DTI).Comment: Published in at http://dx.doi.org/10.1214/10-AOAS384 the Annals of Applied Statistics (http://www.imstat.org/aoas/) by the Institute of Mathematical Statistics (http://www.imstat.org

DeepNav: Joint View Learning for Direct Optimal Path Perception in Cochlear Surgical Platform Navigation

Although much research has been conducted in the field of automated cochlear implant navigation, the problem remains challenging. Deep learning techniques have recently achieved impressive results in a variety of computer vision problems, raising expectations that they might be applied in other domains, such as identifying the optimal navigation zone (OPZ) in the cochlear. In this paper, a 2.5D joint-view convolutional neural network (2.5D CNN) is proposed and evaluated for the identification of the OPZ in the cochlear segments. The proposed network consists of 2 complementary sagittal and bird-view (or top view) networks for the 3D OPZ recognition, each utilizing a ResNet-8 architecture consisting of 5 convolutional layers with rectified nonlinearity unit (ReLU) activations, followed by average pooling with size equal to the size of the final feature maps. The last fully connected layer of each network has 4 indicators, equivalent to the classes considered: the distance to the adjacent left and right walls, collision probability and heading angle. To demonstrate this, the 2.5D CNN was trained using a parametric data generation model, and then evaluated using anatomically constructed cochlea models from the micro-CT images of different cases. Prediction of the indicators demonstrates the effectiveness of the 2.5D CNN, for example the heading angle has less than 1° error with computation delays of less that <1 milliseconds

NONLINEAR TUBE-FITTING FOR THE ANALYSIS OF ANATOMICAL AND FUNCTIONAL STRUCTURES

We are concerned with the estimation of the exterior surface of tube-shaped anatomical structures. This interest is motivated by two distinct scientific goals, one dealing with the distribution of HIV microbicide in the colon and the other with measuring degradation in white-matter tracts in the brain. Our problem is posed as the estimation of the support of a distribution in three dimensions from a sample from that distribution, possibly measured with error. We propose a novel tube-fitting algorithm to construct such estimators. Further, we conduct a simulation study to aid in the choice of a key parameter of the algorithm, and we test our algorithm with validation study tailored to the motivating data sets. Finally, we apply the tube-fitting algorithm to a colon image produced by single photon emission computed tomography (SPECT)and to a white-matter tract image produced using diffusion tensor `imaging (DTI)

Quantification of spinal cord atrophy in magnetic resonance images

Quantifying the volume of the spinal cord is of vital interest for studying and understanding diseases of the central nervous system such as multiple sclerosis (MS). In this thesis, which is motivated by MS research, we propose methods for measuring the spinal cord cross-sectional area and volume in magnetic resonance (MR) images. These measurements are used for determining neural atrophy and for performing both longitudinal and cross-sectional comparisons in clinical trials. We present three evolutionary steps of our approach: In the first step, we use graph cut–based image segmentation on the intensities of T1-weighted MR images. In the second step, we combine a continuous max flow segmentation algorithm with a cross-sectional similarity prior and Hessian-based structural features, which we apply to T1- and T2-weighted images. The prior leverages the fact that the spinal cord is an elongated structure by constraining its cross-sectional shape to vary only slowly along one image axis. In conjunction with the additional features, the segmentation robustness is thus increased. In the third step, we combine continuous max flow with anisotropic total variation regularization, which enables us to direct the regularization of the cross-sectional shape of the spinal cord more flexibly. We implement the proposed approach as a semi-automatic software toolchain that automatically segments the spinal cord, reconstructs its surface, and acquires the desired measurements. The software employs a user-provided anatomical landmark as well as hints for the location of the spinal cord and its surroundings. It accounts for the bending of the spine, MR-induced image distortions, and noise. We evaluate the proposed methods in experiments on phantom, healthy subject, and patient data. Our measurement accuracy and precision are on par with the state of the art. At the same time, our measurements on MS patient data are in accordance with the medical literature

Development of an Atlas-Based Segmentation of Cranial Nerves Using Shape-Aware Discrete Deformable Models for Neurosurgical Planning and Simulation

Twelve pairs of cranial nerves arise from the brain or brainstem and control our sensory functions such as vision, hearing, smell and taste as well as several motor functions to the head and neck including facial expressions and eye movement. Often, these cranial nerves are difficult to detect in MRI data, and thus represent problems in neurosurgery planning and simulation, due to their thin anatomical structure, in the face of low imaging resolution as well as image artifacts. As a result, they may be at risk in neurosurgical procedures around the skull base, which might have dire consequences such as the loss of eyesight or hearing and facial paralysis. Consequently, it is of great importance to clearly delineate cranial nerves in medical images for avoidance in the planning of neurosurgical procedures and for targeting in the treatment of cranial nerve disorders. In this research, we propose to develop a digital atlas methodology that will be used to segment the cranial nerves from patient image data. The atlas will be created from high-resolution MRI data based on a discrete deformable contour model called 1-Simplex mesh. Each of the cranial nerves will be modeled using its centerline and radius information where the centerline is estimated in a semi-automatic approach by finding a shortest path between two user-defined end points. The cranial nerve atlas is then made more robust by integrating a Statistical Shape Model so that the atlas can identify and segment nerves from images characterized by artifacts or low resolution. To the best of our knowledge, no such digital atlas methodology exists for segmenting nerves cranial nerves from MRI data. Therefore, our proposed system has important benefits to the neurosurgical community

Diffusion Kurtosis Imaging of neonatal Spinal Cord in clinical routine

Diffusion kurtosis imaging (DKI) has undisputed advantages over the more classical diffusion magnetic resonance imaging (dMRI) as witnessed by the fast-increasing number of clinical applications and software packages widely adopted in brain imaging. However, in the neonatal setting, DKI is still largely underutilized, in particular in spinal cord (SC) imaging, because of its inherently demanding technological requirements. Due to its extreme sensitivity to non-Gaussian diffusion, DKI proves particularly suitable for detecting complex, subtle, fast microstructural changes occurring in this area at this early and critical stage of development, which are not identifiable with only DTI. Given the multiplicity of congenital anomalies of the spinal canal, their crucial effect on later developmental outcome, and the close interconnection between the SC region and the brain above, managing to apply such a method to the neonatal cohort becomes of utmost importance. This study will (i) mention current methodological challenges associated with the application of advanced dMRI methods, like DKI, in early infancy, (ii) illustrate the first semi-automated pipeline built on Spinal Cord Toolbox for handling the DKI data of neonatal SC, from acquisition setting to estimation of diffusion measures, through accurate adjustment of processing algorithms customized for adult SC, and (iii) present results of its application in a pilot clinical case study. With the proposed pipeline, we preliminarily show that DKI is more sensitive than DTI-related measures to alterations caused by brain white matter injuries in the underlying cervical SC

Analysis of contrast-enhanced medical images.

Early detection of human organ diseases is of great importance for the accurate diagnosis and institution of appropriate therapies. This can potentially prevent progression to end-stage disease by detecting precursors that evaluate organ functionality. In addition, it also assists the clinicians for therapy evaluation, tracking diseases progression, and surgery operations. Advances in functional and contrast-enhanced (CE) medical images enabled accurate noninvasive evaluation of organ functionality due to their ability to provide superior anatomical and functional information about the tissue-of-interest. The main objective of this dissertation is to develop a computer-aided diagnostic (CAD) system for analyzing complex data from CE magnetic resonance imaging (MRI). The developed CAD system has been tested in three case studies: (i) early detection of acute renal transplant rejection, (ii) evaluation of myocardial perfusion in patients with ischemic heart disease after heart attack; and (iii), early detection of prostate cancer. However, developing a noninvasive CAD system for the analysis of CE medical images is subject to multiple challenges, including, but are not limited to, image noise and inhomogeneity, nonlinear signal intensity changes of the images over the time course of data acquisition, appearances and shape changes (deformations) of the organ-of-interest during data acquisition, determination of the best features (indexes) that describe the perfusion of a contrast agent (CA) into the tissue. To address these challenges, this dissertation focuses on building new mathematical models and learning techniques that facilitate accurate analysis of CAs perfusion in living organs and include: (i) accurate mathematical models for the segmentation of the object-of-interest, which integrate object shape and appearance features in terms of pixel/voxel-wise image intensities and their spatial interactions; (ii) motion correction techniques that combine both global and local models, which exploit geometric features, rather than image intensities to avoid problems associated with nonlinear intensity variations of the CE images; (iii) fusion of multiple features using the genetic algorithm. The proposed techniques have been integrated into CAD systems that have been tested in, but not limited to, three clinical studies. First, a noninvasive CAD system is proposed for the early and accurate diagnosis of acute renal transplant rejection using dynamic contrast-enhanced MRI (DCE-MRI). Acute rejection–the immunological response of the human immune system to a foreign kidney–is the most sever cause of renal dysfunction among other diagnostic possibilities, including acute tubular necrosis and immune drug toxicity. In the U.S., approximately 17,736 renal transplants are performed annually, and given the limited number of donors, transplanted kidney salvage is an important medical concern. Thus far, biopsy remains the gold standard for the assessment of renal transplant dysfunction, but only as the last resort because of its invasive nature, high cost, and potential morbidity rates. The diagnostic results of the proposed CAD system, based on the analysis of 50 independent in-vivo cases were 96% with a 95% confidence interval. These results clearly demonstrate the promise of the proposed image-based diagnostic CAD system as a supplement to the current technologies, such as nuclear imaging and ultrasonography, to determine the type of kidney dysfunction. Second, a comprehensive CAD system is developed for the characterization of myocardial perfusion and clinical status in heart failure and novel myoregeneration therapy using cardiac first-pass MRI (FP-MRI). Heart failure is considered the most important cause of morbidity and mortality in cardiovascular disease, which affects approximately 6 million U.S. patients annually. Ischemic heart disease is considered the most common underlying cause of heart failure. Therefore, the detection of the heart failure in its earliest forms is essential to prevent its relentless progression to premature death. While current medical studies focus on detecting pathological tissue and assessing contractile function of the diseased heart, this dissertation address the key issue of the effects of the myoregeneration therapy on the associated blood nutrient supply. Quantitative and qualitative assessment in a cohort of 24 perfusion data sets demonstrated the ability of the proposed framework to reveal regional perfusion improvements with therapy, and transmural perfusion differences across the myocardial wall; thus, it can aid in follow-up on treatment for patients undergoing the myoregeneration therapy. Finally, an image-based CAD system for early detection of prostate cancer using DCE-MRI is introduced. Prostate cancer is the most frequently diagnosed malignancy among men and remains the second leading cause of cancer-related death in the USA with more than 238,000 new cases and a mortality rate of about 30,000 in 2013. Therefore, early diagnosis of prostate cancer can improve the effectiveness of treatment and increase the patient’s chance of survival. Currently, needle biopsy is the gold standard for the diagnosis of prostate cancer. However, it is an invasive procedure with high costs and potential morbidity rates. Additionally, it has a higher possibility of producing false positive diagnosis due to relatively small needle biopsy samples. Application of the proposed CAD yield promising results in a cohort of 30 patients that would, in the near future, represent a supplement of the current technologies to determine prostate cancer type. The developed techniques have been compared to the state-of-the-art methods and demonstrated higher accuracy as shown in this dissertation. The proposed models (higher-order spatial interaction models, shape models, motion correction models, and perfusion analysis models) can be used in many of today’s CAD applications for early detection of a variety of diseases and medical conditions, and are expected to notably amplify the accuracy of CAD decisions based on the automated analysis of CE images

Segmentation automatique de la moelle épinière sur des images de résonance magnétique par propagation de modèles déformables

RÉSUMÉ Les lésions de la moelle épinière, induites par des traumas (e.g. accident de la route) ou par des maladies neurodégénératives, touchent plus 85 000 personnes au Canada avec environ 4250 nouveaux cas chaque année1. Elles ont de plus un impact majeur sur la vie quotidienne des personnes atteintes, en provoquant des pertes de sensibilité et de contrôle moteur dont la gravité dépend de la taille et de l’emplacement des lésions. Bien qu’il existe des approches thérapeutiques permettant d’améliorer la réhabilitation fonctionnelle des patients, toutes ces approches se heurtent à une inconnue majeure : l’étendue des dégâts causés par les lésions. Un diagnostic précoce et précis des maladies neurodégénératives touchant la moelle épinière permettrait d’améliorer grandement l’efficacité de leurs traitements. Depuis de nombreuses années, l’IRM a prouvé son potentiel dans le diagnostic et le pronostic des lésions de la moelle épinière (Cadotte, 2011; Cohen-Adad et al., 2011). Ce domaine manque cependant encore d’outils complètement automatisés permettant l’extraction et la comparaison de métriques cliniques reliées à la structure de la moelle (aire de section transverse, volume, etc.). La segmentation de la moelle épinière sur des images IRM anatomiques peut fournir des mesures d’aires et de volumes de la moelle (Losseff et al., 1996) et peut quantifier son atrophie en cas de maladies neurodégénératives telles que la sclérose en plaques (Chen et al., 2013) et la sclérose latérale amyotrophique (Cohen-Adad et al., 2011). Ce projet de maîtrise vise à développer une méthode de segmentation complètement automatique de la moelle épinière, fonctionnant sur plusieurs types d’images IRM (pondérées en T1 et en T2) et sur n’importe quel champ de vue (cervical ou thoracique), et permettant d’extraire et de comparer des mesures précises de la moelle épinière. La revue de la littérature a permis de mettre en évidence le manque de méthode de segmentation automatique de la moelle épinière fonctionnant sur n’importe quel type de contraste et de champ de vue. Elle a toutefois fait ressortir une série de propriétés intéressantes, dans les méthodes semi-automatiques existantes, pouvant être combinées pour former une méthode complètement automatisée.----------ABSTRACT Spinal cord lesions affects more than 85,000 people in Canada with about 4,250 new cases every year. Lesions can be caused by traumatic injuries or by neurodegenerative diseases such as multiple sclerosis. They have an important impact on a patient’s daily life, inducing loss of sensibility or motor control in the human body. The extent of damages caused by a lesion varies with the number of damaged spinal cord tracks, and depends on the size and the position of the lesion within the spinal cord. Although therapeutic approaches for patient functional rehabilitation exist, they all face an unknown variable: the extent of spinal cord lesions. A precise and early diagnosis of neurodegenerative diseases would improve their treatment efficiency. For a number of years, MRI has demonstrated its potential in the diagnosis and prognosis of spinal cord lesions (Cadotte, 2011; Cohen-Adad et al., 2010). However, this research field still lacks of fully automatized tools for the extraction and comparison of clinical metrics related to the spinal cord structure (e.g. cross-sectional area, volumes). Spinal cord segmentation on anatomical MR images can provide accurate area and volume measurements (Losseff et al., 1996) and could quantify spinal cord atrophy caused by neurodegenerative diseases such as multiple sclerosis (Chen et al., 2013) or amyotrophic lateral sclerosis (Cohen-Adad et al., 2011). The objective of this Master’s project is to develop a fully automatic spinal cord segmentation method, working on multiple MR contrasts and any field of view, able to extract and compare accurate spinal cord measurements. The literature review pointed out the lack of such a method but highlighted several interesting features in existing methods, that can be combined to develop a new automatic segmentation algorithm. The method developed in this project is based on the multi-resolution propagation of a deformable model. First, the spinal cord position and orientation is detected in the image using an elliptical Hough transform on multiple adjacent axial slices. A low-resolution tubular mesh is then build around the detection point and direction and deformed on spinal cord edges by minimizing an energy equation. An iterative process, composed by the duplication, translation, orientation and deformation of the mesh, propagates the surface along the spinal cord. Finally, a refinement and a global deformation of the surface provide accurate segmentation of the spinal cord. Measurements can be directly extracted from the segmentation surface. The spinal canal can also be segmented with our method by simply inversing the gradient in the image an

Registration and Analysis of Vascular Images

We have developed a method for rigidly aligning images of tubes. This paper presents an evaluation of the consistency of that method for three-dimensional images of human vasculature. Vascular images may contain alignment ambiguities, poorly corresponding vascular networks, and non-rigid deformations, yet the Monte Carlo experiments presented in this paper show that our method provides registrations with sub-voxel consistency in less than one minute. Our registration method builds on the principals of our ridges-and-widths tube modeling work; this registration method operates by aligning models of the tubes in a source image with subsequent target images. The registration method’s consistency results from incorporate multi-scale ridge and width measures into the model-image match metric. The method’s speed comes from the use of coarse-to-fine registration strategies that are directly enabled by our tube models and the model-image match metric. In this paper we also show that the method’s insensitivity to local, non-rigid deformations enables the visualization and quantification of the effects of such deformations