Computer Vision Techniques for Transcatheter Intervention

Minimally invasive transcatheter technologies have demonstrated substantial promise for the diagnosis and treatment of cardiovascular diseases. For example, TAVI is an alternative to AVR for the treatment of severe aortic stenosis and TAFA is widely used for the treatment and cure of atrial fibrillation. In addition, catheter-based IVUS and OCT imaging of coronary arteries provides important information about the coronary lumen, wall and plaque characteristics. Qualitative and quantitative analysis of these cross-sectional image data will be beneficial for the evaluation and treatment of coronary artery diseases such as atherosclerosis. In all the phases (preoperative, intraoperative, and postoperative) during the transcatheter intervention procedure, computer vision techniques (e.g., image segmentation, motion tracking) have been largely applied in the field to accomplish tasks like annulus measurement, valve selection, catheter placement control, and vessel centerline extraction. This provides beneficial guidance for the clinicians in surgical planning, disease diagnosis, and treatment assessment. In this paper, we present a systematical review on these state-of-the-art methods.We aim to give a comprehensive overview for researchers in the area of computer vision on the subject of transcatheter intervention. Research in medical computing is multi-disciplinary due to its nature, and hence it is important to understand the application domain, clinical background, and imaging modality so that methods and quantitative measurements derived from analyzing the imaging data are appropriate and meaningful. We thus provide an overview on background information of transcatheter intervention procedures, as well as a review of the computer vision techniques and methodologies applied in this area

Exploiting Temporal Image Information in Minimally Invasive Surgery

Minimally invasive procedures rely on medical imaging instead of the surgeons direct vision. While preoperative images can be used for surgical planning and navigation, once the surgeon arrives at the target site real-time intraoperative imaging is needed. However, acquiring and interpreting these images can be challenging and much of the rich temporal information present in these images is not visible. The goal of this thesis is to improve image guidance for minimally invasive surgery in two main areas. First, by showing how high-quality ultrasound video can be obtained by integrating an ultrasound transducer directly into delivery devices for beating heart valve surgery. Secondly, by extracting hidden temporal information through video processing methods to help the surgeon localize important anatomical structures. Prototypes of delivery tools, with integrated ultrasound imaging, were developed for both transcatheter aortic valve implantation and mitral valve repair. These tools provided an on-site view that shows the tool-tissue interactions during valve repair. Additionally, augmented reality environments were used to add more anatomical context that aids in navigation and in interpreting the on-site video. Other procedures can be improved by extracting hidden temporal information from the intraoperative video. In ultrasound guided epidural injections, dural pulsation provides a cue in finding a clear trajectory to the epidural space. By processing the video using extended Kalman filtering, subtle pulsations were automatically detected and visualized in real-time. A statistical framework for analyzing periodicity was developed based on dynamic linear modelling. In addition to detecting dural pulsation in lumbar spine ultrasound, this approach was used to image tissue perfusion in natural video and generate ventilation maps from free-breathing magnetic resonance imaging. A second statistical method, based on spectral analysis of pixel intensity values, allowed blood flow to be detected directly from high-frequency B-mode ultrasound video. Finally, pulsatile cues in endoscopic video were enhanced through Eulerian video magnification to help localize critical vasculature. This approach shows particular promise in identifying the basilar artery in endoscopic third ventriculostomy and the prostatic artery in nerve-sparing prostatectomy. A real-time implementation was developed which processed full-resolution stereoscopic video on the da Vinci Surgical System

A Deep Learning-Based Fully Automated Pipeline for Regurgitant Mitral Valve Anatomy Analysis From 3D Echocardiography

Three-dimensional transesophageal echocardiography (3DTEE) is the recommended imaging technique for the assessment of mitral valve (MV) morphology and lesions in case of mitral regurgitation (MR) requiring surgical or transcatheter repair. Such assessment is key to thorough intervention planning and to intraprocedural guidance. However, it requires segmentation from 3DTEE images, which is timeconsuming, operator-dependent, and often merely qualitative. In the present work, a novel workflow to quantify the patient-specific MV geometry from 3DTEE is proposed. The developed approach relies on a 3D multi-decoder residual convolutional neural network (CNN) with a U-Net architecture for multi-class segmentation of MV annulus and leaflets. The CNN was trained and tested on a dataset comprising 55 3DTEE examinations of MR-affected patients. After training, the CNN is embedded into a fully automatic, and hence fully repeatable, pipeline that refines the predicted segmentation, detects MV anatomical landmarks and quantifies MV morphology. The trained 3D CNN achieves an average Dice score of 0.82 +/- 0.06, mean surface distance of 0.43 +/- 0.14 mm and 95% Hausdorff Distance (HD) of 3.57 +/- 1.56 mm before segmentation refinement, outperforming a state-of-the-art baseline residual U-Net architecture, and provides an unprecedented multi-class segmentation of the annulus, anterior and posterior leaflet. The automatic 3D linear morphological measurements of the annulus and leaflets, specifically diameters and lengths, exhibit differences of less than 1.45 mm when compared to ground truth values. These measurements also demonstrate strong overall agreement with analyses conducted by semi-automated commercial software. The whole process requires minimal user interaction and requires approximately 15 seconds

Role of echocardiography in diagnosis and risk stratification in heart failure with left ventricular systolic dysfunction

Heart failure (HF) is a complex clinical syndrome that can result from any structural or functional cardiac disorder that impairs the ability of the ventricle to fill with or eject blood. Echocardiography represents the "gold standard" in the assessment of LV systolic dysfunction and in the recognition of systolic heart failure, since dilatation of the LV results in alteration of intracardiac geometry and hemodynamics leading to increased morbidity and mortality

Shear wave echocardiography

In this thesis we demonstrate that the assessment of the diastolic function of the left ventricle withclassical echocardiography remain

Artificial intelligence and automation in valvular heart diseases

Artificial intelligence (AI) is gradually changing every aspect of social life, and healthcare is no exception. The clinical procedures that were supposed to, and could previously only be handled by human experts can now be carried out by machines in a more accurate and efficient way. The coming era of big data and the advent of supercomputers provides great opportunities to the development of AI technology for the enhancement of diagnosis and clinical decision-making. This review provides an introduction to AI and highlights its applications in the clinical flow of diagnosing and treating valvular heart diseases (VHDs). More specifically, this review first introduces some key concepts and subareas in AI. Secondly, it discusses the application of AI in heart sound auscultation and medical image analysis for assistance in diagnosing VHDs. Thirdly, it introduces using AI algorithms to identify risk factors and predict mortality of cardiac surgery. This review also describes the state-of-the-art autonomous surgical robots and their roles in cardiac surgery and intervention

Quantitative imaging in cardiovascular CT angiography

In de afgelopen decennia is computertomografie (CT) een prominente niet-invasieve modaliteit om hart- en vaatziekten te evalueren geworden. Dit proefschrift heeft als doel de rol van CT in de therapeutische behandeling van coronaire hartziekte (CAD) en klepaandoeningen te onderzoeken.De relatie tussen kransslagadergeometrie (statisch en dynamisch) en aanwezigheid en omvang van CAD met CT werd onderzocht. De resultaten suggereren dat de statische geometrie van de kransslagader significant gerelateerd is aan de aanwezigheid van plaque en stenose. Er was echter geen verband tussen dynamische verandering van de coronaire arterie-geometrie en de ernst van CAD. Een algoritme om de invloed van intraluminair contrastmiddel op niet-verkalkte atherosclerotische plaque Hounsfield-Unit-waarden te corrigeren werd gepresenteerd en gevalideerd met behulp van fantomen.Diagnose en operatieplanning kunnen cruciale gevolgen hebben voor de klinische uitkomst van chirurgische ingrepen. In dit proefschrift wordt beschreven dat halfautomatische softwareprogramma’s het kwantificeren van het aortaklepgebied betere reproduceerbare resultaten toonden in vergelijking met handmatige metingen, en vergelijkbare resultaten met de huidige gouden standaard, de echocardiografie. Een systematische review over het dynamische gedrag van de aorta-annulus toont aan dat de vorm van de aorta-annulus tijdens de hartcyclus verandert, wat impliceert dat er bij het bepalen van een prothese rekening moet worden gehouden met meerdere fasen. Een andere review beschrijft het gebruik van 3D-printen in de chirurgische planning samen met andere toepassingen voor de behandeling van hartklepaandoeningen.CT is de belangrijkste beeldvormingsmodaliteit in deze onderzoeken, die gericht waren op de therapeutische behandeling van hart- en vaatziekten, van vroege risicobepaling tot diagnose en chirurgische planning.In the recent decades computed tomography (CT) has emerged as a dominant non-invasive modality to evaluate cardiovascular diseases. This thesis aimed to explore the role of CT in the therapeutic management of coronary artery disease (CAD) and valvular diseases.The relationship between both static and dynamic coronary artery geometry and presence and extent of CAD using CT was investigated. The results suggest that the static coronary artery geometry is significantly related to presence of plaque and significant stenosis. However, there were no such relationship between dynamic change of coronary artery geometry and severity of CAD. As part of this thesis an algorithm to correct the influence of lumen contrast enhancement on non-calcified atherosclerotic plaque Hounsfield-Unit values was presented. The algorithm was validated using phantoms. The diagnosis and surgical planning may have crucial impact on clinical outcome. Semi-automatic software for aortic valve area quantification presented in this thesis was proven to be more repeatable and similar to gold standard echocardiography in comparison to manual measurements. The systematic review regarding the dynamic behavior of aortic annulus revealed that aortic annulus geometry changes throughout the cardiac cycle which implies that multiple phases should be taken into account for prosthesis sizing. Another review in this thesis discusses the use of 3D printing in the surgical planning along with other applications for the treatment of valvular diseases.CT is the main imaging modality in these studies which were focused on the therapeutic management of cardiovascular diseases from early risk determination to diagnosis and surgical planning