In Vivo Human Right Ventricle Shape and Kinematic Analysis with and without Pulmonary Hypertension

Pulmonary hypertension (PH) is a severe cardio-pulmonary illness which has been commonly observed to induce substantial and ultimately deleterious changes to the human right ventricle (RV) shape and function. As such, the functional state of the RV is thought to be a major determinant of symptoms and survival rates for PH. However, there has been little success to-date to identify clinically obtainable metrics of RV shape and deformation as a means to detect the onset and progression of PH. This difficulty is largely the result of the absence of a proven approach that is generally applicable for consistent and reliable quantitative analysis of anatomical shapes, particularly the RV, between patients and over time. Therefore, a computational framework which can quantitatively analyze RV shape and deformation could be a key to assist in clinically detecting the onset and progression of PH. Statistical shape analysis techniques were developed, implemented, and assessed to analyze variations in human RV endocardial surface (RVES) shapes and kinematics from noninvasive clinical medical imaging data with respect to a spectrum of hemodynamic states. A computational framework for the quantitative analysis and statistical decomposition of sets of 3D genus-0 shapes that combines a modified harmonic mapping approach directly with proper orthogonal decomposition (DM-POD) is presented. The DM-POD approach is shown to be a robust technique for recovering inherent shape-related features through the analysis of sets of artificially generated shapes. The DM-POD approach is then applied to obtain kinematic features of the human RV based on the relative change in shape of the endocardial surface using cardiac computed tomography images. In addition, the kinematic features of the RVES obtained by the DM-POD approach are shown to be consistent and associated with intrinsically physiological components of the heart, and thus may potentially provide a more accurate means for classifying the progressive change in RV function caused by PH, in comparison to traditional clinical hemodynamic and volume-based metrics. Statistical shape analysis for the human RV is further evaluated through analysis of alternate components of the DM-POD approach, as well as through comparison of the DM-POD workflow with an alternate spherical harmonic function-based workflow (SPHARM), with respect to the aspects of surface representation, alignment, and decomposition. Additionally, different ways of utilizing the available imaging data with respect to the classification potential are investigated by considering analysis results when applying both the various DM-POD and SPHARM approaches with several different combinations of the phases captured throughout a single cardiac cycle for the patient set. Lastly, a novel statistical decomposition technique known as independent component analysis (ICA) was incorporated into the statistical shape analysis framework (i.e., DM-POD) to produce an alternative workflow (DM-ICA). Both the DM-POD and DM-ICA approaches are applied to analyze sets of artificially generated data and the human RVES datasets, and the respective results are compared. The DM-POD and DM-ICA workflows are shown to produce consistent, but substantially different results due to the various principles and views of each of the two statistical decomposition algorithms (i.e., POD and ICA). Most importantly, the results from the DM-POD and DM-ICA workflows appear to relate to RV function in unique ways, with respect to both traditional clinical metrics and each other, and have the potential to provide new metrics for better understanding of the human RV and its relationship to PH

Combining Shape and Learning for Medical Image Analysis

Automatic methods with the ability to make accurate, fast and robust assessments of medical images are highly requested in medical research and clinical care. Excellent automatic algorithms are characterized by speed, allowing for scalability, and an accuracy comparable to an expert radiologist. They should produce morphologically and physiologically plausible results while generalizing well to unseen and rare anatomies. Still, there are few, if any, applications where today\u27s automatic methods succeed to meet these requirements.\ua0The focus of this thesis is two tasks essential for enabling automatic medical image assessment, medical image segmentation and medical image registration. Medical image registration, i.e. aligning two separate medical images, is used as an important sub-routine in many image analysis tools as well as in image fusion, disease progress tracking and population statistics. Medical image segmentation, i.e. delineating anatomically or physiologically meaningful boundaries, is used for both diagnostic and visualization purposes in a wide range of applications, e.g. in computer-aided diagnosis and surgery.The thesis comprises five papers addressing medical image registration and/or segmentation for a diverse set of applications and modalities, i.e. pericardium segmentation in cardiac CTA, brain region parcellation in MRI, multi-organ segmentation in CT, heart ventricle segmentation in cardiac ultrasound and tau PET registration. The five papers propose competitive registration and segmentation methods enabled by machine learning techniques, e.g. random decision forests and convolutional neural networks, as well as by shape modelling, e.g. multi-atlas segmentation and conditional random fields

Object Recognition

Vision-based object recognition tasks are very familiar in our everyday activities, such as driving our car in the correct lane. We do these tasks effortlessly in real-time. In the last decades, with the advancement of computer technology, researchers and application developers are trying to mimic the human's capability of visually recognising. Such capability will allow machine to free human from boring or dangerous jobs

Methods and algorithms for quantitative analysis of metallomic images to assess traumatic brain injury

The primary aim of this thesis is to develop image processing algorithms to quantitatively determine the link between traumatic brain injury (TBI) severity and chronic traumatic encephalopathy (CTE) neuropathology, specifically looking into the role of blood-brain barrier disruption following TBI. In order to causally investigate the relationship between the tau protein neurodegenerative disease CTE and TBI, mouse models of blast neurotrauma (BNT) and impact neurotrauma (INT) are investigated. First, a high-speed video tracking algorithm is developed based on K-means clustering, active contours and Kalman filtering to comparatively study the head kinematics in blast and impact experiments. Then, to compare BNT and INT neuropathology, methods for quantitative analysis of macroscopic optical images and fluorescent images are described. The secondary aim of this thesis focuses on developing methods for a novel application of metallomic imaging mass spectrometry (MIMS) to biological tissue. Unlike traditional modalities used to assess neuropathology, that suffer from limited sensitivity and analytical capacity, MIMS uses a mass spectrometer -- an analytical instrument for measuring elements and isotopes with high dynamic range, sensitivity and specificity -- as the imaging sensor to generate spatial maps with spectral (vector-valued) data per pixel. Given the vector nature of MIMS data, a unique end-to-end processing pipeline is designed to support data acquisition, visualization and interpretation. A novel multi-modal and multi-channel image registration (MMMCIR) method using multi-variate mutual information as a similarity metric is developed in order to establish correspondence between two images of arbitrary modality. The MMMCIR method is then used to automatically segment MIMS images of the mouse brain and systematically evaluate the levels of relevant elements and isotopes after experimental closed-head impact injury on the impact side (ipsilateral) and opposing side (contralateral) of the brain. This method quantifiably confirms observed differences in gadolinium levels for a cohort of images. Finally, MIMS images of human lacrimal sac biopsy samples are used for preliminary clinicopathological assessments, supporting the utility of the unique insights MIMS provides by correlating areas of inflammation to areas of elevated toxic metals. The image processing methods developed in this work demonstrate the significant capabilities of MIMS and its role in enhancing our understanding of the underlying pathological mechanisms of TBI and other medical conditions.2019-07-09T00:00:00

Medical image analysis using statistical shape model based on subdivision surface wavelet

Ph.DDOCTOR OF PHILOSOPH

ADVANCED MOTION MODELS FOR RIGID AND DEFORMABLE REGISTRATION IN IMAGE-GUIDED INTERVENTIONS

Image-guided surgery (IGS) has been a major area of interest in recent decades that continues to transform surgical interventions and enable safer, less invasive procedures. In the preoperative contexts, diagnostic imaging, including computed tomography (CT) and magnetic resonance (MR) imaging, offers a basis for surgical planning (e.g., definition of target, adjacent anatomy, and the surgical path or trajectory to the target). At the intraoperative stage, such preoperative images and the associated planning information are registered to intraoperative coordinates via a navigation system to enable visualization of (tracked) instrumentation relative to preoperative images. A major limitation to such an approach is that motions during surgery, either rigid motions of bones manipulated during orthopaedic surgery or brain soft-tissue deformation in neurosurgery, are not captured, diminishing the accuracy of navigation systems. This dissertation seeks to use intraoperative images (e.g., x-ray fluoroscopy and cone-beam CT) to provide more up-to-date anatomical context that properly reflects the state of the patient during interventions to improve the performance of IGS. Advanced motion models for inter-modality image registration are developed to improve the accuracy of both preoperative planning and intraoperative guidance for applications in orthopaedic pelvic trauma surgery and minimally invasive intracranial neurosurgery. Image registration algorithms are developed with increasing complexity of motion that can be accommodated (single-body rigid, multi-body rigid, and deformable) and increasing complexity of registration models (statistical models, physics-based models, and deep learning-based models). For orthopaedic pelvic trauma surgery, the dissertation includes work encompassing: (i) a series of statistical models to model shape and pose variations of one or more pelvic bones and an atlas of trajectory annotations; (ii) frameworks for automatic segmentation via registration of the statistical models to preoperative CT and planning of fixation trajectories and dislocation / fracture reduction; and (iii) 3D-2D guidance using intraoperative fluoroscopy. For intracranial neurosurgery, the dissertation includes three inter-modality deformable registrations using physic-based Demons and deep learning models for CT-guided and CBCT-guided procedures

The Probabilistic Active Shape Model: From Model Construction to Flexible Medical Image Segmentation

Automatic processing of three-dimensional image data acquired with computed tomography or magnetic resonance imaging plays an increasingly important role in medicine. For example, the automatic segmentation of anatomical structures in tomographic images allows to generate three-dimensional visualizations of a patient’s anatomy and thereby supports surgeons during planning of various kinds of surgeries. Because organs in medical images often exhibit a low contrast to adjacent structures, and because the image quality may be hampered by noise or other image acquisition artifacts, the development of segmentation algorithms that are both robust and accurate is very challenging. In order to increase the robustness, the use of model-based algorithms is mandatory, as for example algorithms that incorporate prior knowledge about an organ’s shape into the segmentation process. Recent research has proven that Statistical Shape Models are especially appropriate for robust medical image segmentation. In these models, the typical shape of an organ is learned from a set of training examples. However, Statistical Shape Models have two major disadvantages: The construction of the models is relatively difficult, and the models are often used too restrictively, such that the resulting segmentation does not delineate the organ exactly. This thesis addresses both problems: The first part of the thesis introduces new methods for establishing correspondence between training shapes, which is a necessary prerequisite for shape model learning. The developed methods include consistent parameterization algorithms for organs with spherical and genus 1 topology, as well as a nonrigid mesh registration algorithm for shapes with arbitrary topology. The second part of the thesis presents a new shape model-based segmentation algorithm that allows for an accurate delineation of organs. In contrast to existing approaches, it is possible to integrate not only linear shape models into the algorithm, but also nonlinear shape models, which allow for a more specific description of an organ’s shape variation. The proposed segmentation algorithm is evaluated in three applications to medical image data: Liver and vertebra segmentation in contrast-enhanced computed tomography scans, and prostate segmentation in magnetic resonance images

On Improving Generalization of CNN-Based Image Classification with Delineation Maps Using the CORF Push-Pull Inhibition Operator

Deployed image classification pipelines are typically dependent on the images captured in real-world environments. This means that images might be affected by different sources of perturbations (e.g. sensor noise in low-light environments). The main challenge arises by the fact that image quality directly impacts the reliability and consistency of classification tasks. This challenge has, hence, attracted wide interest within the computer vision communities. We propose a transformation step that attempts to enhance the generalization ability of CNN models in the presence of unseen noise in the test set. Concretely, the delineation maps of given images are determined using the CORF push-pull inhibition operator. Such an operation transforms an input image into a space that is more robust to noise before being processed by a CNN. We evaluated our approach on the Fashion MNIST data set with an AlexNet model. It turned out that the proposed CORF-augmented pipeline achieved comparable results on noise-free images to those of a conventional AlexNet classification model without CORF delineation maps, but it consistently achieved significantly superior performance on test images perturbed with different levels of Gaussian and uniform noise