Automated volume measurements in echocardiography by utilizing expert knowledge

Left ventricular (LV) volumes and ejection fraction (EF) are important parameters for diagnosis, prognosis, and treatment planning in patients with heart disease. These parameters are commonly measured by manual tracing in echocardiographic images, a procedure that is time consuming, prone to inter- and intra-observer variability, and require highly trained operators. This is particularly the case in three-dimensional (3D) echocardiography, where the increased amount of data makes manual tracing impractical. Automated methods for measuring LV volumes and EF can therefore improve efficiency and accuracy of echocardiographic examinations, giving better diagnosis at a lower cost. The main goal of this thesis was to improve the efficiency and quality of cardiac measurements. More specifically, the goal was to develop rapid and accurate methods that utilize expert knowledge for automated evaluation of cardiac function in echocardiography. The thesis presents several methods for automated volume and EF measurements in echocardiographic data. For two-dimensional (2D) echocardiography, an atlas based segmentation algorithm is presented in paper A. This method utilizes manually traced endocardial contours in a validated case database to control a snake optimized by dynamic programming. The challenge with this approach is to find the most optimal case in the database. More promising results are achieved in triplane echocardiography using a multiview and multi-frame extension to the active appearance model (AAM) framework, as demonstrated in paper B. The AAM generalizes better to new patient data and is based on more robust optimization schemes than the atlas-based method. In triplane images, the results of the AAM algorithm may be improved further by integrating a snake algorithm into the AAM framework and by constraining the AAM to manually defined landmarks, and this is shown in paper C. For 3D echocardiograms, a clinical semi-automated volume measurement tool with expert selected points is validated in paper D. This tool compares favorably to a reference measurement tool, with good agreement in measured volumes, and with a significantly lower analysis time. Finally, in paper E, fully automated real-time segmentation in 3D echocardiography is demonstrated using a 3D active shape model (ASM) of the left ventricle in a Kalman filter framework. The main advantage of this approach is its processing performance, allowing for real-time volume and EF estimates. Statistical models such as AAMs and ASMs provide elegant frameworks for incorporating expert knowledge into segmentation algorithms. Expert knowledge can also be utilized directly through manual input to semi-automated methods, allowing for manual initialization and correction of automatically determined volumes. The latter technique is particularly suitable for clinical routine examinations, while the fully automated 3D ASM method can extend the use of echocardiography to new clinical areas such as automated patient monitoring. In this thesis, different methods for utilizing expert knowledge in automated segmentation algorithms for echocardiography have been developed and evaluated. Particularly in 3D echocardiography, these contributions are expected to improve efficiency and quality of cardiac measurements

Real time 3D US-tagging combined with 3D phase-based motion estimation

International audienceBy contrast with 2D imaging, quantitative analysis of 3D motion from ultrasound images can provide improved information in several applications, such as arterial mechanical assessment, heart motion and blood flow. Unfortunately, it remains difficult to obtain a high definition of the motion estimate in the lateral and elevation directions (i.e. perpendicular to the beam axis). To increase the definition in both these directions, this paper presents a 3D extension of a the transverse oscillations method that enables one to obtain ultrasound fields featuring oscillations along the 3 spatial dimensions, using a single apodization function. The 3D motion method is estimated using the phases of the images. Simulation results show that a 3D trajectory can be followed with a relative mean error smaller than 8%

Automated Analysis of 3D Stress Echocardiography

__Abstract__ The human circulatory system consists of the heart, blood, arteries, veins and capillaries. The heart is the muscular organ which pumps the blood through the human body (Fig. 1.1,1.2). Deoxygenated blood flows through the right atrium into the right ventricle, which pumps the blood into the pulmonary arteries. The blood is carried to the lungs, where it passes through a capillary network that enables the release of carbon dioxide and the uptake of oxygen. Oxygenated blood then returns to the heart via the pulmonary veins and flows from the left atrium into the left ventricle. The left ventricle then pumps the blood through the aorta, the major artery which supplies blood to the rest of the body [Drake et a!., 2005; Guyton and Halt 1996]. Therefore, it is vital that the cardiovascular system remains healthy. Disease of the cardiovascular system, if untreated, ultimately leads to the failure of other organs and death

Automated analysis of 3D echocardiography

In this thesis we aim at automating the analysis of 3D echocardiography, mainly targeting the functional analysis of the left ventricle. Manual analysis of these data is cumbersome, time-consuming and is associated with inter-observer and inter-institutional variability. Methods for reconstruction of 3D echocardiographic images from fast rotating ultrasound transducers is presented and methods for analysis of 3D echocardiography in general, using tracking, detection and model-based segmentation techniques to ultimately fully automatically segment the left ventricle for functional analysis. We show that reliable quantification of left ventricular volume and mitral valve displacement can be achieved using the presented techniques.SenterNovem (IOP Beeldverwerking, grant IBVC02003), Dutch Technology Foundation STW (grant 06666)UBL - phd migration 201

Automated Echocardiographic Image Interpretation Using Artificial Intelligence

In addition to remaining as one of the leading causes of global mortality, cardio vascular disease has a significant impact on overall health, well-being, and life expectancy. Therefore, early detection of anomalies in cardiac function has become essential for early treatment, and therefore reduction in mortalities. Echocardiography is the most commonly used modality for evaluating the structure and function of the heart. Analysis of echocardiographic images has an important role in the clinical practice in assessing the cardiac morphology and function and thereby reaching a diagnosis. The process of interpretation of echocardiographic images is considered challenging for several reasons. The manual annotation is still a daily work in the clinical routine due to the lack of reliable automatic interpretation methods. This can lead to time-consuming tasks that are prone to intra- and inter-observer variability. Echocardiographic images inherently suffer from a high level of noise and poor qualities. Therefore, although several studies have attempted automating the process, this re-mains a challenging task, and improving the accuracy of automatic echocardiography interpretation is an ongoing field. Advances in Artificial Intelligence and Deep Learning can help to construct an auto-mated, scalable pipeline for echocardiographic image interpretation steps, includingview classification, phase-detection, image segmentation with a focus on border detection, quantification of structure, and measurement of the clinical markers. This thesis aims to develop optimised automated methods for the three individual steps forming part of an echocardiographic exam, namely view classification, left ventricle segmentation, quantification, and measurement of left ventricle structure. Various Neural Architecture Search methods were employed to design efficient neural network architectures for the above tasks. Finally, an optimisation-based speckle tracking echocardiography algorithm was proposed to estimate the myocardial tissue velocities and cardiac deformation. The algorithm was adopted to measure cardiac strain which is used for detecting myocardial ischaemia. All proposed techniques were compared with the existing state-of-the-art methods. To this end, publicly available patients datasets, as well as two private datasets provided by the clinical partners to this project, were used for developments and comprehensive performance evaluations of the proposed techniques. Results demonstrated the feasibility of using automated tools for reliable echocardiographic image interpretations, which can be used as assistive tools to clinicians in obtaining clinical measurements

Model-driven segmentation of X-ray left ventricular angiograms

X-ray left ventricular (LV) angiography is an important imaging modality to assess cardiac function. Using a contrast fluid a 2D projection of the heart is obtained. In current clinical practice cardiac function is analyzed by drawing two contours manually: one in the end diastolic (ED) phase and one in the end systolic (ES) phase. From the contours the LV volumes in these phases are calculated and the patient__s ejection fraction is assessed. Drawing these contours manually is a cumbersome and time-consuming task for a medical doctor. Furthermore, manual drawing introduces inter- and intra-observer variabilities. The focus of the research presented in this thesis was to automate the process of contour drawing in X-ray LV angiography. The developed method is based on Active Appearance Models. These statistical models, in which the cardiac shape and the cardiac appearance are modeled, have proven to be able to mimic the drawing behavior of an expert cardiologist. The clinical parameters, as determined by the automated method, showed a similar degree of accuracy as when determined by an expert. Furthermore, the required time for patient analysis was reduced considerably and the inter- and intra-observer variabilities were structurally decreased.UBL - phd migration 201

Myocardial tagging by Cardiovascular Magnetic Resonance: evolution of techniques--pulse sequences, analysis algorithms, and applications

Cardiovascular magnetic resonance (CMR) tagging has been established as an essential technique for measuring regional myocardial function. It allows quantification of local intramyocardial motion measures, e.g. strain and strain rate. The invention of CMR tagging came in the late eighties, where the technique allowed for the first time for visualizing transmural myocardial movement without having to implant physical markers. This new idea opened the door for a series of developments and improvements that continue up to the present time. Different tagging techniques are currently available that are more extensive, improved, and sophisticated than they were twenty years ago. Each of these techniques has different versions for improved resolution, signal-to-noise ratio (SNR), scan time, anatomical coverage, three-dimensional capability, and image quality. The tagging techniques covered in this article can be broadly divided into two main categories: 1) Basic techniques, which include magnetization saturation, spatial modulation of magnetization (SPAMM), delay alternating with nutations for tailored excitation (DANTE), and complementary SPAMM (CSPAMM); and 2) Advanced techniques, which include harmonic phase (HARP), displacement encoding with stimulated echoes (DENSE), and strain encoding (SENC). Although most of these techniques were developed by separate groups and evolved from different backgrounds, they are in fact closely related to each other, and they can be interpreted from more than one perspective. Some of these techniques even followed parallel paths of developments, as illustrated in the article. As each technique has its own advantages, some efforts have been made to combine different techniques together for improved image quality or composite information acquisition. In this review, different developments in pulse sequences and related image processing techniques are described along with the necessities that led to their invention, which makes this article easy to read and the covered techniques easy to follow. Major studies that applied CMR tagging for studying myocardial mechanics are also summarized. Finally, the current article includes a plethora of ideas and techniques with over 300 references that motivate the reader to think about the future of CMR tagging

Automated image analysis techniques for cardiovascular magnetic resonance imaging

The introductory chapter provides an overview of various aspects related to quantitative analysis of cardiovascular MR (CMR) imaging studies. Subsequently, the thesis describes several automated methods for quantitative assessment of left ventricular function from CMR imaging studies. Several novel computer algorithms are introduced and validated for automated segmentation of short-axis CMR images and validated by comparing functional results derived from automated segmentation with results derived from manually traced contours. In addition an automated method is presented for assessment of flow through the aorta based on Phase-Contrast flow velocity mapping MRI. Finally a method is presented for accurate assessment of the thickness of the left ventricular myocardium taking advantage of the three-dimensional nature of MRI.UBL - phd migration 201

Automated Diagnosis of Cardiovascular Diseases from Cardiac Magnetic Resonance Imaging Using Deep Learning Models: A Review

In recent years, cardiovascular diseases (CVDs) have become one of the leading causes of mortality globally. CVDs appear with minor symptoms and progressively get worse. The majority of people experience symptoms such as exhaustion, shortness of breath, ankle swelling, fluid retention, and other symptoms when starting CVD. Coronary artery disease (CAD), arrhythmia, cardiomyopathy, congenital heart defect (CHD), mitral regurgitation, and angina are the most common CVDs. Clinical methods such as blood tests, electrocardiography (ECG) signals, and medical imaging are the most effective methods used for the detection of CVDs. Among the diagnostic methods, cardiac magnetic resonance imaging (CMR) is increasingly used to diagnose, monitor the disease, plan treatment and predict CVDs. Coupled with all the advantages of CMR data, CVDs diagnosis is challenging for physicians due to many slices of data, low contrast, etc. To address these issues, deep learning (DL) techniques have been employed to the diagnosis of CVDs using CMR data, and much research is currently being conducted in this field. This review provides an overview of the studies performed in CVDs detection using CMR images and DL techniques. The introduction section examined CVDs types, diagnostic methods, and the most important medical imaging techniques. In the following, investigations to detect CVDs using CMR images and the most significant DL methods are presented. Another section discussed the challenges in diagnosing CVDs from CMR data. Next, the discussion section discusses the results of this review, and future work in CVDs diagnosis from CMR images and DL techniques are outlined. The most important findings of this study are presented in the conclusion section