Computer integrated system: medical imaging & visualization

The intent of this book’s conception is to present research work using a user centered design approach. Due to space constraints, the story of the journey, included in this book is relatively brief. However we believe that it manages to adequately represent the story of the journey, from its humble beginnings in 2008 to the point where it visualizes future trends amongst both researchers and practitioners across the Computer Science and Medical disciplines. This book aims not only to present a representative sampling of real-world collaboration between said disciplines but also to provide insights into the different aspects related to the use of real-world Computer Assisted Medical applications. Readers and potential clients should find the information particularly useful in analyzing the benefits of collaboration between these two fields, the products in and of their institutions. The work discussed here is a compilation of the work of several PhD students under my supervision, who have since graduated and produced several publications either in journals or proceedings of conferences. As their work has been published, this book will be more focused on the research methodology based on medical technology used in their research. The research work presented in this book partially encompasses the work under the MOA for collaborative Research and Development in the field of Computer Assisted Surgery and Diagnostics pertaining to Thoracic and Cardiovascular Diseases between UPM, UKM and IJN, spanning five years beginning from 15 Feb 2013

Left Ventricle Myocardium Segmentation from 3D Cardiac MR Images using Combined Probabilistic Atlas and Graph Cut-based Approaches

Medical imaging modalities, including Computed Tomography (CT) Magnetic Resonance Imaging (MRI) and Ultrasound (US) are critical for the diagnosis and progress monitoring of many cardiac conditions, planning, visualization and delivery of therapy via minimally invasive intervention procedures, as well as for teaching, training and simulation applications. Image segmentation is a processing technique that allows the user to extract the necessary information from an image dataset, in the form of a surface model of the region of interest from the anatomy. A wide variety of segmentation techniques have been developed and implemented for cardiac MR images. Despite their complexity and performance, many of them are intended for specific image datasets or are too specific to be employed for segmenting classical clinical quality Magnetic Resonance (MR) images. Graph Cut based segmentation algorithms have been shown to work well in regards to medical image segmentation. In addition, they are computationally efficient, which scales well to real time applications. While the basic graph cuts algorithms use lower-order statistics, combining this segmentation approach with atlas-based methods may help improve segmentation accuracy at a lower computational cost. The proposed technique will be tested at each step during the development by assessing the segmentation results against the available ground truth segmentation. Several metrics will be used to quantify the performance of the proposed technique, including computational performance, segmentation accuracy and fidelity assessed via the Sørensen-Dice Coefficient (DSC), Mean Absolute Distance (MAD) and Hausdorff Distance (HD) metrics

Deep Learning in Cardiology

The medical field is creating large amount of data that physicians are unable to decipher and use efficiently. Moreover, rule-based expert systems are inefficient in solving complicated medical tasks or for creating insights using big data. Deep learning has emerged as a more accurate and effective technology in a wide range of medical problems such as diagnosis, prediction and intervention. Deep learning is a representation learning method that consists of layers that transform the data non-linearly, thus, revealing hierarchical relationships and structures. In this review we survey deep learning application papers that use structured data, signal and imaging modalities from cardiology. We discuss the advantages and limitations of applying deep learning in cardiology that also apply in medicine in general, while proposing certain directions as the most viable for clinical use.Comment: 27 pages, 2 figures, 10 table

Deep learning for cardiac image segmentation: A review

Deep learning has become the most widely used approach for cardiac image segmentation in recent years. In this paper, we provide a review of over 100 cardiac image segmentation papers using deep learning, which covers common imaging modalities including magnetic resonance imaging (MRI), computed tomography (CT), and ultrasound (US) and major anatomical structures of interest (ventricles, atria and vessels). In addition, a summary of publicly available cardiac image datasets and code repositories are included to provide a base for encouraging reproducible research. Finally, we discuss the challenges and limitations with current deep learning-based approaches (scarcity of labels, model generalizability across different domains, interpretability) and suggest potential directions for future research

Computational Methods for Segmentation of Multi-Modal Multi-Dimensional Cardiac Images

Segmentation of the heart structures helps compute the cardiac contractile function quantified via the systolic and diastolic volumes, ejection fraction, and myocardial mass, representing a reliable diagnostic value. Similarly, quantification of the myocardial mechanics throughout the cardiac cycle, analysis of the activation patterns in the heart via electrocardiography (ECG) signals, serve as good cardiac diagnosis indicators. Furthermore, high quality anatomical models of the heart can be used in planning and guidance of minimally invasive interventions under the assistance of image guidance. The most crucial step for the above mentioned applications is to segment the ventricles and myocardium from the acquired cardiac image data. Although the manual delineation of the heart structures is deemed as the gold-standard approach, it requires significant time and effort, and is highly susceptible to inter- and intra-observer variability. These limitations suggest a need for fast, robust, and accurate semi- or fully-automatic segmentation algorithms. However, the complex motion and anatomy of the heart, indistinct borders due to blood flow, the presence of trabeculations, intensity inhomogeneity, and various other imaging artifacts, makes the segmentation task challenging. In this work, we present and evaluate segmentation algorithms for multi-modal, multi-dimensional cardiac image datasets. Firstly, we segment the left ventricle (LV) blood-pool from a tri-plane 2D+time trans-esophageal (TEE) ultrasound acquisition using local phase based filtering and graph-cut technique, propagate the segmentation throughout the cardiac cycle using non-rigid registration-based motion extraction, and reconstruct the 3D LV geometry. Secondly, we segment the LV blood-pool and myocardium from an open-source 4D cardiac cine Magnetic Resonance Imaging (MRI) dataset by incorporating average atlas based shape constraint into the graph-cut framework and iterative segmentation refinement. The developed fast and robust framework is further extended to perform right ventricle (RV) blood-pool segmentation from a different open-source 4D cardiac cine MRI dataset. Next, we employ convolutional neural network based multi-task learning framework to segment the myocardium and regress its area, simultaneously, and show that segmentation based computation of the myocardial area is significantly better than that regressed directly from the network, while also being more interpretable. Finally, we impose a weak shape constraint via multi-task learning framework in a fully convolutional network and show improved segmentation performance for LV, RV and myocardium across healthy and pathological cases, as well as, in the challenging apical and basal slices in two open-source 4D cardiac cine MRI datasets. We demonstrate the accuracy and robustness of the proposed segmentation methods by comparing the obtained results against the provided gold-standard manual segmentations, as well as with other competing segmentation methods

Fast fully automatic myocardial segmentation in 4D cine cardiac magnetic resonance datasets

Dissertação de mestrado integrado em Engenharia BiomédicaCardiovascular diseases (CVDs) are the leading cause of death in the world, representing 30% of all global deaths. Among others, assessment of the left ventricular (LV) morphology and global function using non-invasive cardiac imaging is an interesting technique for diagnosis and treatment follow-up of patients with CVDs. Nowadays, cardiac magnetic resonance (CMR) imaging is the gold-standard technique for the quantification of LV volumes, mass and ejection fraction, requiring the delineation of endocardial and epicardial contours of the left ventricle from cine MR images. In clinical practice, the physicians perform this segmentation manually, being a tedious, time consuming and unpractical task. Even though several (semi-)automated methods have been presented for LV CMR segmentation, fast, automatic and optimal boundaries assessment is still lacking, usually requiring the physician to manually correct the contours. In the present work, we propose a novel fast fully automatic 3D+time LV segmentation framework for CMR datasets. The proposed framework presents three conceptual blocks: 1) an automatic 2D mid-ventricular initialization and segmentation; 2) an automatic stack initialization followed by a 3D segmentation at the end-diastolic phase; and 3) a tracking procedure to delineate both endo and epicardial contours throughout the cardiac cycle. In each block, specific CMR-targeted algorithms are proposed for the different steps required. Hereto, we propose automatic and feasible initialization procedures. Moreover, we adapt the recent B-spline Explicit Active Surfaces (BEAS) framework to the properties of CMR image segmentation by integrating dedicated energy terms and making use of a cylindrical coordinate system that better fits the topology of CMR data. At last, two tracking methods are presented and compared. The proposed framework has been validated on 45 4D CMR datasets from a publicly available database and on a large database from an ongoing multi-center clinical trial with 318 4D datasets. In the technical validation, the framework showed competitive results against the state-of-the-art methods, presenting leading results in both accuracy and average computational time in the common database used for comparative purposes. Moreover, the results in the large scale clinical validation confirmed the high feasibility and robustness of the proposed framework for accurate LV morphology and global function assessment. In combination with the low computational burden of the method, the present methodology seems promising to be used in daily clinical practice.As doenças cardiovasculares (DCVs) são a principal causa de morte no mundo, representando 30% destas a nível global. Na prática clínica, uma técnica empregue no diagnóstico de pacientes com DCVs é a avaliação da morfologia e da função global do ventrículo esquerdo (VE), através de técnicas de imagiologia não-invasivas. Atualmente, a ressonância magnética cardíaca (RMC) é a modalidade de referência na quantificação dos volumes, massa e fração de ejeção do VE, exigindo a delimitação dos contornos do endocárdio e epicárdio a partir de imagens dinâmicas de RMC. Na prática clínica diária, o método preferencial é a segmentação manual. No entanto, esta é uma tarefa demorada, sujeita a erro humano e pouco prática. Apesar de até à data diversos métodos (semi)-automáticos terem sido apresentados para a segmentação do VE em imagens de RMC, ainda não existe um método capaz de avaliar idealmente os contornos de uma forma automática, rápida e precisa, levando a que geralmente o médico necessite de corrigir manualmente os contornos. No presente trabalho é proposta uma nova framework para a segmentação automática do VE em imagens 3D+tempo de RMC. O algoritmo apresenta três blocos principais: 1) uma inicialização e segmentação automática 2D num corte medial do ventrículo; 2) uma inicialização e segmentação tridimensional no volume correspondente ao final da diástole; e 3) um algoritmo de tracking para obter os contornos ao longo de todo o ciclo cardíaco. Neste sentido, são propostos procedimentos de inicialização automática com elevada robustez. Mais ainda, é proposta uma adaptação da recente framework “B-spline Explicit Active Surfaces” (BEAS) com a integração de uma energia específica para as imagens de RMC e utilizando uma formulação cilíndrica para tirar partido da topologia destas imagens. Por último, são apresentados e comparados dois algoritmos de tracking para a obtenção dos contornos ao longo do tempo. A framework proposta foi validada em 45 datasets de RMC provenientes de uma base de dados disponível ao público, bem como numa extensa base de dados com 318 datasets para uma validação clínica. Na avaliação técnica, a framework proposta obteve resultados competitivos quando comparada com outros métodos do estado da arte, tendo alcançado resultados de precisão e tempo computacional superiores a estes. Na validação clínica em larga escala, a framework provou apresentar elevada viabilidade e robustez na avaliação da morfologia e função global do VE. Em combinação com o baixo custo computacional do algoritmo, a presente metodologia apresenta uma perspetiva promissora para a sua aplicação na prática clínica diária

Automated volume measurements in echocardiography by utilizing expert knowledge

Left ventricular (LV) volumes and ejection fraction (EF) are important parameters for diagnosis, prognosis, and treatment planning in patients with heart disease. These parameters are commonly measured by manual tracing in echocardiographic images, a procedure that is time consuming, prone to inter- and intra-observer variability, and require highly trained operators. This is particularly the case in three-dimensional (3D) echocardiography, where the increased amount of data makes manual tracing impractical. Automated methods for measuring LV volumes and EF can therefore improve efficiency and accuracy of echocardiographic examinations, giving better diagnosis at a lower cost. The main goal of this thesis was to improve the efficiency and quality of cardiac measurements. More specifically, the goal was to develop rapid and accurate methods that utilize expert knowledge for automated evaluation of cardiac function in echocardiography. The thesis presents several methods for automated volume and EF measurements in echocardiographic data. For two-dimensional (2D) echocardiography, an atlas based segmentation algorithm is presented in paper A. This method utilizes manually traced endocardial contours in a validated case database to control a snake optimized by dynamic programming. The challenge with this approach is to find the most optimal case in the database. More promising results are achieved in triplane echocardiography using a multiview and multi-frame extension to the active appearance model (AAM) framework, as demonstrated in paper B. The AAM generalizes better to new patient data and is based on more robust optimization schemes than the atlas-based method. In triplane images, the results of the AAM algorithm may be improved further by integrating a snake algorithm into the AAM framework and by constraining the AAM to manually defined landmarks, and this is shown in paper C. For 3D echocardiograms, a clinical semi-automated volume measurement tool with expert selected points is validated in paper D. This tool compares favorably to a reference measurement tool, with good agreement in measured volumes, and with a significantly lower analysis time. Finally, in paper E, fully automated real-time segmentation in 3D echocardiography is demonstrated using a 3D active shape model (ASM) of the left ventricle in a Kalman filter framework. The main advantage of this approach is its processing performance, allowing for real-time volume and EF estimates. Statistical models such as AAMs and ASMs provide elegant frameworks for incorporating expert knowledge into segmentation algorithms. Expert knowledge can also be utilized directly through manual input to semi-automated methods, allowing for manual initialization and correction of automatically determined volumes. The latter technique is particularly suitable for clinical routine examinations, while the fully automated 3D ASM method can extend the use of echocardiography to new clinical areas such as automated patient monitoring. In this thesis, different methods for utilizing expert knowledge in automated segmentation algorithms for echocardiography have been developed and evaluated. Particularly in 3D echocardiography, these contributions are expected to improve efficiency and quality of cardiac measurements

Image based approach for early assessment of heart failure.

In diagnosing heart diseases, the estimation of cardiac performance indices requires accurate segmentation of the left ventricle (LV) wall from cine cardiac magnetic resonance (CMR) images. MR imaging is noninvasive and generates clear images; however, it is impractical to manually process the huge number of images generated to calculate the performance indices. In this dissertation, we introduce a novel, fast, robust, bi-directional coupled parametric deformable models that are capable of segmenting the LV wall borders using first- and second-order visual appearance features. These features are embedded in a new stochastic external force that preserves the topology of the LV wall to track the evolution of the parametric deformable models control points. We tested the proposed segmentation approach on 15 data sets in 6 infarction patients using the Dice similarity coefficient (DSC) and the average distance (AD) between the ground truth and automated segmentation contours. Our approach achieves a mean DSC value of 0.926±0.022 and mean AD value of 2.16±0.60 mm compared to two other level set methods that achieve mean DSC values of 0.904±0.033 and 0.885±0.02; and mean AD values of 2.86±1.35 mm and 5.72±4.70 mm, respectively. Also, a novel framework for assessing both 3D functional strain and wall thickening from 4D cine cardiac magnetic resonance imaging (CCMR) is introduced. The introduced approach is primarily based on using geometrical features to track the LV wall during the cardiac cycle. The 4D tracking approach consists of the following two main steps: (i) Initially, the surface points on the LV wall are tracked by solving a 3D Laplace equation between two subsequent LV surfaces; and (ii) Secondly, the locations of the tracked LV surface points are iteratively adjusted through an energy minimization cost function using a generalized Gauss-Markov random field (GGMRF) image model in order to remove inconsistencies and preserve the anatomy of the heart wall during the tracking process. Then the circumferential strains are straight forward calculated from the location of the tracked LV surface points. In addition, myocardial wall thickening is estimated by co-allocation of the corresponding points, or matches between the endocardium and epicardium surfaces of the LV wall using the solution of the 3D laplace equation. Experimental results on in vivo data confirm the accuracy and robustness of our method. Moreover, the comparison results demonstrate that our approach outperforms 2D wall thickening estimation approaches